KR102495019B1 - Sound Device for Recognizing Animal Sound - Google Patents

Abstract

According to the animal sound recognition sound device of the present invention, a sound module including a sound input unit for receiving a sound signal and a sound output unit for outputting a sound signal, a communication module including at least one communication unit connected to a communication network, and a short-range camera device A sound device comprising a short-range module for processing short-range wireless communication and a camera module for acquiring image information of a subject, wherein sound data corresponding to a sound signal of an audible frequency band input through the sound input unit is stored in a designated buffer A sound processing unit that checks sound data buffered in an area or buffered in a designated buffer area and reads the buffered sound data to recognize at least one animal sound designated for determining a specific situation among nonverbal sounds or noises that may occur in a designated space An animal sound recognition unit for recognizing an animal sound unique to an animal sound generator corresponding to an animal sound frequency band of at least one animal sound generator designated for and corresponding to an animal sound pattern of the animal sound generator, and when the animal sound is recognized The camera device using at least s (1≤s≤S) service functions related to the animal sounds among the S (S≥1) service functions specified in and any one or more of the short-distance module, communication module, and camera module. A control module including a service control unit for activating a video service function for photographing an animal sound generating source that generates the recognized animal sound through An information storage unit for storing corresponding M animal sound frequency band information and N animal sound pattern information corresponding to N (N≥1) animal sound patterns in a designated storage area and using the M animal sound frequency band information to generate animal sound frequency distribution information corresponding to the animal sound frequency distributions recognized at least i (i≥2) times during a designated period of time, and at least j (j for a designated period of time using the N animal sound pattern information Animal cow corresponding to the distribution of validly recognized animal sound patterns ≥2) times m (1≤m) optimized (or customized) to the animal sound of the animal sound source in the space through which the sound device passed through a distribution generator that generates sound pattern distribution information and statistical processing of the generated animal sound frequency distribution information m pieces of animal sound frequency band information corresponding to ≤M) number of animal sound frequency bands are determined, and the generated animal sound pattern distribution information is statistically processed to determine the animal sounds of the animal sound generator in the space where the sound device is installed. An information determination unit that determines n pieces of animal sound pattern information corresponding to n (1≤n≤N) optimized (or customized) animal sound patterns and reads the buffered sound data to recognize the user's language utterance and natural language A speech content recognition unit that processes and recognizes speech content information corresponding to the user's speech content, and the user's speech content is recognized while the animal sound is being recognized or the user's speech content is recognized within a certain time after the end of the recognition of the animal sound. If the user's speech is recognized within a certain time during or after the animal sound is recognized, the recognized user's speech is interpreted by associating it with s service functions related to the animal sound. It further includes an intelligent processing unit for processing and a service providing unit for providing a service corresponding to the activated service function.

Description

Animal sound recognition sound device {Sound Device for Recognizing Animal Sound}

The present invention is a sound device having a sound module for inputting and outputting sound signals and a communication module for connecting to a communication network to read sound data corresponding to a sound signal of an audible frequency band input through the sound module to generate non-verbal information that can be generated in a designated space. Corresponds to at least one animal sound frequency band designated for recognizing at least one animal sound designated for determining a specific reimbursement among sounds or noises and / or corresponds to at least one animal sound pattern designated for recognizing the animal sound When a specific animal sound is recognized by attempting to recognize it, at least one designated service function related to the animal sound is activated among services that can be provided through at least one of the sound module and the communication module (or a combination of the two), or the designated service is It is to provide a sound device that provides.

Recently, a stationary sound device that recognizes a user's voice and provides a service corresponding to the recognized voice has been sold. For example, stationary sound devices such as Amazon's 'Echo', SK Telecom's 'Who', and KT's 'Giga Genie' are on sale.

However, the conventional stationary sound device is a combination of a sound source service and voice recognition technology, and operates mainly on a service that simply provides or reproduces a sound source desired by a user through voice recognition, and has a problem in that it is difficult to use in other fields.

An object of the present invention for solving the above problems is a sound module including a sound input unit for receiving a sound signal and a sound output unit for outputting a sound signal, and a communication module including at least one communication unit connected to a communication network and a short distance A sound device comprising a short-range module for processing short-range wireless communication with a camera device and a camera module for obtaining image information of a subject, wherein sound data corresponding to a sound signal of an audible frequency band input through the sound input unit A sound processing unit that buffers the sound data in a designated buffer area or checks sound data buffered in the designated buffer area, and at least one animal sound designated for determining a specific situation among nonverbal sounds or noises that may occur in a designated space by reading the buffered sound data. An animal sound recognition unit for recognizing an animal sound unique to an animal sound generating source corresponding to an animal sound frequency band of at least one animal sound generating source designated for recognizing an animal sound and corresponding to an animal sound pattern of the animal sound generating source, and the animal sound In case of recognition, using at least s (1≤s≤S) service functions related to the animal sound among the designated S (S≥1) service functions and any one or more modules among the short-distance module, communication module, and camera module A control module including a service control unit for activating a video service function for photographing an animal sound source generating the recognized animal sound through the camera device, wherein the control module includes M (M≥1) animal sounds. An information storage unit for storing M animal sound frequency band information corresponding to frequency bands and N animal sound pattern information corresponding to N (N≥1) animal sound patterns in a designated storage area, and the M animal sound frequency bands generating animal sound frequency distribution information corresponding to animal sound frequency distributions that have been recognized validly at least i (i≥2) times during a designated period of time using the information, and using the N animal sound pattern information to generate at least i (i≥2) times during a designated period of time Corresponding to the distribution of validly recognized animal sound patterns j (j≥2) times m (1 m animal sound frequency band information corresponding to ≤m≤M) animal sound frequency bands are determined, the generated animal sound pattern distribution information is statistically processed, and the animal of the animal sound source in the space through which the sound device is installed An information determination unit for determining n pieces of animal sound pattern information corresponding to n (1≤n≤N) animal sound patterns optimized (or customized) for sound and reading the buffered sound data to recognize the user's language utterance and a speech content recognition unit that recognizes speech content information corresponding to the user's speech content through natural language processing, and the user's speech content is recognized while the animal sound is being recognized, or the user's Recognition determination unit for confirming whether the content of speech is recognized, and if the content of the user's speech is recognized within a certain time during or after the animal sound is recognized, the recognized user's speech content is associated with s service functions related to the animal sound It is to provide a sound device for recognizing animal sounds, further comprising an intelligent processing unit for interpreting and processing an intelligent processing unit, and a service providing unit for providing a service corresponding to the activated service function.

A sound device for recognizing animal sounds according to the present invention includes a sound module including a sound input unit for receiving a sound signal and a sound output unit for outputting a sound signal, a communication module including at least one communication unit connected to a communication network, and a short-distance camera device. A sound device comprising a short-range module for processing short-range wireless communication and a camera module for acquiring image information of a subject, wherein sound data corresponding to a sound signal of an audible frequency band input through the sound input unit is stored in a designated buffer A sound processing unit that checks sound data buffered in an area or buffered in a designated buffer area and reads the buffered sound data to recognize at least one animal sound designated for determining a specific situation among nonverbal sounds or noises that may occur in a designated space An animal sound recognition unit for recognizing an animal sound unique to an animal sound generator corresponding to an animal sound frequency band of at least one animal sound generator designated for and corresponding to an animal sound pattern of the animal sound generator, and when the animal sound is recognized The camera device using at least s (1≤s≤S) service functions related to the animal sounds among the S (S≥1) service functions specified in and any one or more of the short-distance module, communication module, and camera module. A control module including a service control unit for activating a video service function for photographing an animal sound generating source that generates the recognized animal sound through An information storage unit for storing corresponding M animal sound frequency band information and N animal sound pattern information corresponding to N (N≥1) animal sound patterns in a designated storage area and using the M animal sound frequency band information to generate animal sound frequency distribution information corresponding to the animal sound frequency distributions recognized at least i (i≥2) times during a designated period of time, and at least j (j for a designated period of time using the N animal sound pattern information ≥ 2) animal sounds corresponding to the validly recognized animal sound pattern distribution m (1≤m≤) optimized (or customized) to the animal sound of the animal sound source in the space through which the sound device passed through a distribution generator that generates pattern distribution information and statistically processes the generated animal sound frequency distribution information m animal sound frequency band information corresponding to M) number of animal sound frequency bands is determined, and the generated animal sound pattern distribution information is statistically processed to optimize the animal sound of the animal sound source in the space where the sound device is installed An information determination unit for determining n animal sound pattern information corresponding to (or customized) n (1≤n≤N) animal sound patterns, and reading the buffered sound data to recognize the user's language utterance and process natural language a speech content recognition unit that recognizes speech content information corresponding to the user's speech content and the user's speech content is recognized while the animal sound is being recognized or the user's speech content is recognized within a certain time after the end of the animal sound recognition If the user's speech is recognized within a certain time during or after the animal sound is recognized, a recognition determination unit for confirming whether it is recognized or not, interpreting the recognized user's speech by associating it with s service functions related to the animal sound It is characterized in that it further comprises an intelligent processing unit for processing and a service providing unit for providing a service corresponding to the activated service function.

According to the present invention, the animal sound may include at least one of an animal's cry, an animal's bark, and an animal's non-audible region sound.

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

According to the present invention, the animal sound recognition unit reads the buffered sound data to correspond to at least one animal sound frequency band among the M number of animal sound frequency bands and at least one animal sound pattern among the N number of animal sound patterns. It is characterized in that it comprises a function of recognizing animal sounds corresponding to.

delete

delete

delete

According to the present invention, the information storage unit further includes a function of setting the determined m number of animal sound frequency bands as animal sound frequency bands to be read first and storing new or updated sounds, and the animal sound recognition unit may perform the buffered sound. and a function of first recognizing an animal sound corresponding to at least one animal sound frequency band among the stored m animal sound frequency bands by reading the data.

delete

delete

According to the present invention, the information storage unit further includes a function of setting the determined n animal sound patterns as animal sound patterns to be read first and storing new or updated sounds, and the animal sound recognition unit stores the buffered sound data and a function of first recognizing an animal sound corresponding to at least one animal sound pattern among the stored n animal sound patterns.

delete

delete

According to the present invention, the service controller includes a function of activating a specific service function related to the animal sound and corresponding to the recognized user's utterance.

According to the present invention, the s services are a server interworking service provided in conjunction with an operation server on a communication network through the communication module, a sound-based service provided through the sound module, and a combination of the sound module and the communication module It may include at least one service among complex services provided by

According to the present invention, the server interworking service includes at least one of a paging service using wireless terminal information, a situation notification service using wireless terminal information, a paging service using an app installed in a wireless terminal, and a situation notification service using an app installed in a wireless terminal. It may include at least one of a video service that provides video information captured through a camera of at least one camera to an app installed in a wireless terminal, and a video service that provides video information captured through at least one camera to a designated IPTV device.

According to the present invention, the sound-based service may include a noise output service for outputting a designated service sound at a designated signal output strength through a sound output unit of a sound module.

According to the present invention, the signal output strength may include a signal strength that is inversely proportional to the signal input strength of the animal sound.

According to the present invention, the complex service recognizes the contents of the user's speech within a certain period of time during or after the animal sound is recognized and associates the contents of the user's speech with a service function related to the animal sound, based on an analysis result. It is characterized by including a service provided through an operation server on a communication network.

delete

delete

delete

delete

delete

delete

delete

delete

According to the present invention, when at least one animal sound designated for a specific reimbursement determination is not recognized among nonverbal sounds or noises that can be generated in a designated space, at least one animal sound designated to recognize the animal sound is operated in a sleep mode. When a specific animal sound corresponding to a frequency band and/or corresponding to at least one animal sound pattern designated for recognizing the animal sound is recognized and recognized, it automatically wakes up from the sleep mode and provides at least service related to the animal sound. There is an advantage of providing a sound device that activates a function or provides a service related to the animal sound.

1 is a diagram showing the functional configuration of a sound device for recognizing animal sounds according to an embodiment of the present invention.
2 is a diagram showing the functional configuration of a sound device and an operating server according to another embodiment of the present invention.
3 illustrates an embodiment of activating a service related to animal sounds by recognizing animal sounds according to an exemplary embodiment of the present invention.
FIG. 4 illustrates an embodiment of optimizing (or customizing) an animal sound frequency band for animal sound recognition according to an animal sound of an animal sound generator according to an exemplary embodiment of the present invention.
5 illustrates an embodiment of optimizing (or customizing) an animal sound pattern for recognizing an animal sound to an animal sound of a whistling sound generator according to another embodiment of the present invention.
FIG. 6 illustrates an embodiment of activating a service related to animal sounds by recognizing animal sounds and speech content in conjunction with each other according to another embodiment of the present invention.

Hereinafter, the operating principle of the preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings and description. However, the drawings shown below and the description below relate to preferred implementation methods among various methods for effectively explaining the features of the present invention, and the present invention is not limited to only the drawings and description below.

That is, the following examples correspond to examples of preferred union types among numerous embodiments of the present invention, and examples in which specific components (or steps) are omitted or specific configurations (or steps) are omitted in the following embodiments. Embodiments in which functions implemented in are divided into specific configurations (or steps), or embodiments in which functions implemented in two or more configurations (or steps) are integrated into any one configuration (or steps), specific configurations (or steps) It is clearly stated that the embodiments in which the operation sequence of is replaced are all within the scope of the present invention, even if not separately mentioned in the following embodiments. Therefore, it is clearly stated that various examples corresponding to subsets or complements can be divided retroactively from the filing date of the present invention based on the following examples.

In addition, in the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. In addition, terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to the intention or custom of a user or operator. Therefore, the definition should be made based on the contents throughout the present invention.

As a result, the technical spirit of the present invention is determined by the claims, and the following embodiments are a means for efficiently explaining the technical spirit of the present invention to those skilled in the art to which the present invention belongs. only

Figure 1 is a diagram showing the functional configuration of a sound device 100 for recognizing animal sounds according to an embodiment of the present invention.

In more detail, Figure 1 shows a communication including a sound module 105 including a sound input unit 105a receiving a sound signal and a sound output unit 105b outputting a sound signal and at least one communication unit connected to a communication network. A sound processing unit having a module 120 and buffering sound data corresponding to a sound signal of an audible frequency band input through the sound input unit 105a in a designated buffer area or checking sound data buffered in a designated buffer area ( 140) and at least one animal sound frequency band designated to recognize at least one animal sound designated for determining a specific situation among non-verbal sounds or noises that may occur in a designated space by reading the buffered sound data, and/or Among the animal sound recognizing unit 145 for recognizing a specific animal sound corresponding to at least one animal sound pattern designated to recognize the animal sound and S (S≥1) service functions designated when the animal sound is recognized As a functional configuration of a sound device 100 having a control module 130 including a service control unit 150 for activating at least s (1≤s≤S) service functions related to the animal sounds, the present Those skilled in the art to which the invention pertains may refer to and/or modify this Figure 1 in various implementation methods for the sound device 100 (eg, some components are omitted, subdivided, or combined). Implementation method) may be inferred, but the present invention includes all the implementation methods inferred above, and its technical characteristics are not limited only to the implementation method shown in FIG. 1.

Referring to the embodiment of FIG. 1, the sound device 100 includes a sound module 105 including a sound input unit 105a receiving a sound signal and a sound output unit 105b outputting a sound signal; It has a communication module 120 including at least one communication unit connected to a communication network, and reads sound data corresponding to a sound signal of an audible frequency band input through the sound input unit 105a to generate non-verbal information that can occur in a designated space. Corresponding to at least one animal sound frequency band designated to recognize at least one animal sound designated for determining a specific situation among sounds or noises and/or corresponding to at least one animal sound pattern designated to recognize the animal sound A control module 130 having one or more functional components for activating at least one designated service function related to the animal sound or providing the designated service function when a specific animal sound is recognized by attempting to recognize it, and an operating power supply It is provided with a power module 115 for supplying. Meanwhile, according to the implementation method, the sound device 100 includes at least one of the short-distance module 125 for processing short-distance wireless communication with the short-distance camera device 185 and the camera module 110 for acquiring image information of a photographed subject. A module may be further provided, and in some cases, an input unit (not shown) including a key button or a touch pad for receiving a user's operation may be further provided, and/or an LED or display for outputting various operating states or information. An included output unit (not shown) may be further provided. On the other hand, in the embodiment of Figure 1, the name "module" is only a term for explaining the function and role of the sound device 100 for convenience, and it is clearly clarified that it does not refer to any independent hardware configuration. it is put

The sound module 105 is a generic name for components related to sound input/output including one or more of a sound input unit 105a receiving a sound signal and a sound output unit 105b outputting a sound signal among components of the sound device 100. , Preferably, the sound input unit 105a and the sound output unit 105b can input or output sound signals of at least an audible frequency band, and the sound input unit 105a or the sound output unit 105b is used as a control module 130 and an interface unit (not shown) that interfaces with.

The sound input unit 105a is a general term for a component that receives a sound signal, and encodes the sound signal according to one or more microphones and a designated encoding rule for receiving a sound signal that detects air vibration and converts it into an electrical signal. It is configured to include a program (and/or circuit) module that generates sound data. Preferably, the sound input unit 105a receives a sound signal of an audible frequency band (eg, a sound signal including a voice signal uttered by a user) through the microphone, and outputs the input audio frequency band according to a designated encoding rule. Sound data generated by encoding the sound signal of may be provided to the control module 130 .

According to the implementation method of the present invention, the sound input unit 105a includes one or more directional microphones to detect the direction in which the animal sound is generated when an animal sound is recognized in the space where the sound device 100 is mounted. may be implemented, and the present invention is not limited thereby.

According to the implementation method of the present invention, the animal sound may include at least one of an animal's crying sound, an animal's barking sound, and an animal's non-audible region sound.

According to the implementation method of the present invention, the animal sound may include at least one of sounds designated for determining a specific situation of animals (eg, animals' hunger, a stranger's visit, an owner's crisis, etc.).

The sound output unit 105b is a generic term for a component that outputs a sound signal, and checks one or more speakers that output sound signals and sound data to be output through the speakers and decodes them into the sound signals that can be output through the speakers. It is configured to include a program (and/or circuit) module that controls the signal output strength and output quality of the sound signal while decoding. Preferably, the sound output unit 105b outputs a sound signal generated by decoding the sound data requested to output sound through the control module 130 through the speaker, and the signal of the sound signal output as sound Control the output strength to a specified signal strength (e.g., amplify or reduce the signal strength set to enable receiving (or listening) with a signal strength higher than the specified signal reception strength at a distance greater than a specified reference distance, and/or even in the presence of a specified obstacle) Receive (or listen) at a signal strength higher than the specified signal reception strength at a specified distance, amplify or reduce to a set signal strength, and/or receive at a specified distance at a signal strength higher than the specified signal reception strength even in an environment where noise of a specified decibel or higher exists Sound distortion is minimized by outputting sound by amplifying or reducing (or listening) to a set signal strength) and/or controlling the output quality (eg, speaker parameters such as Fs. Qts, Vas, etc.) of the output sound signal. Sound output by blocking or suppressing (eg, output by controlling the output quality of sound to block / suppress sound distortion caused by resonance of a speaker, or in the case of a voice signal, so that audibility (or hearing sensitivity) can be maintained at a certain level or higher Controls the output quality of the sound so that the sound components corresponding to the articulations on the voice signal are clearly distinguished and outputs it, or blocks/suppresses distortion of the frequency at which the bit string is encoded or signal strength when bit strings are encoded and output in the sound signal. It can be output by controlling the output quality of the sound so that it can be output).

The communication module 120 is a general term for components that process the communication network connection of the sound device 100, and is preferably a designated server (or device) via a wireless network (eg, mobile communication network, mobile Internet, etc.) via a base station. and a wireless network communication unit 120a communicating by connecting a communication channel with a local area network (eg, wireless LAN, etc.) via a wireless AP or repeater to communicate by connecting a designated server (or device) and a communication channel to communicate At least one communication unit among the network communication units 120b is provided, and an interface unit (not shown) for interfacing the communication unit with the control module 130 is further provided.

The wireless network communication unit 120a is a general term for a communication component that connects the sound device 100 to a wide area wireless network (eg, a mobile communication network) via a base station, and transmits and receives a radio frequency signal of a designated frequency band. An antenna, It is configured to include at least one RF module, a baseband module, and a signal processing module, and is connected to the control unit 130a to transmit operation results corresponding to wireless communication among various operation results of the control unit 130a through a wireless network. Alternatively, data is received through a wireless network and transmitted to the control unit 130a, and at the same time, the wireless communication access, registration, communication, and handoff procedures are performed.

According to the implementation method of the present invention, when the wireless network accessed through the wireless network communication unit 120a is a mobile communication network, the wireless network communication unit 120a accesses and registers a location according to at least one mobile communication standard. , call processing, call connection, data communication, and a mobile communication configuration that performs at least one handoff. On the other hand, according to the intention of those skilled in the art, the wireless network communication unit 120a performs at least one of connection, location registration, data communication, and handoff to a wide area wireless network other than the mobile communication network (eg, portable Internet according to IEEE 802.16 standards). It is clear that the present invention is not limited by the wireless communication configuration provided by the wireless network communication unit 120a. That is, the wireless network communication unit 120a provides wireless data communication based on packet communication via the cell-based base station on the wireless network for the sound device 100 regardless of the frequency band of the wireless section or the type or protocol of the communication network. It is a general term for components connected to the data network.

The local area network communication unit 120b uses a radio frequency signal as a communication medium within a certain distance (eg, within 10 m, or within 30 m, etc.) for short-range wireless communication with a network connection device (eg, wireless AP, etc.) provided in a short distance. A general term for communication resources that connect the sound device 100 to a communication network connected by the network access device through a local area wireless network that connects a session, preferably WiFi-based local area network communication, Bluetooth local area network communication, Zigbee-based local area network A short-range wireless communication session is connected between a network connection device provided in a short distance and the sound device 100 through at least one of communication, UWB-based local area network communication, and public wireless communication, and based on this, the sound device 100 is It can be connected to the communication network to which the network access device is connected.

According to the implementation method of the present invention, the local area network communication unit 120b connects a local area wireless communication session with a network connection device provided in a local area within a certain distance from the sound device 100 when a local area wireless network is implemented. It is a general term for components that connect the sound device 100 to a data network that provides wireless data communication based on packet communication via the network connection device of the local area network. Hereinafter, for convenience, the network communication function of the sound device 100 will be mainly described using the wireless network communication unit 120a, but the present invention is not limited thereto, and the network communication function using the local area network communication unit 120b. It is also clearly stated that it is provided.

Meanwhile, according to one example of the implementation method of the present invention, the local area network communication unit 120b connects the camera device 185 provided in the local area of the sound device 100 via the local area wireless network and a local area wireless network-based wireless network. communication can be handled. When the local area network communication unit 120b processes wireless communication based on a local area network with the camera device 185 in the local area, the sound device 100 and the camera device 185 perform wireless communication based on the local area wireless network. It is possible to store a key value for encrypted communication or to exchange a key value for encrypted communication at the time of connecting wireless communication based on a local area network, whereby the sound device 100 and the camera device 185 Encrypted communication using key values can be performed.

The short-distance module 125 is a general term for components that process short-range wireless communication of the sound device 100, and includes a short-range wireless unit 125a that connects short-range wireless communication of a predetermined standard, and the short-range wireless unit ( 125a) and an interface unit (not shown) that interfaces the control module 130. For example, the short-range wireless unit 125a may process Bluetooth-based short-range wireless communication according to the Bluetooth standard. However, it is clearly stated that the standard for short-range wireless communication of the short-range wireless unit 125a is not limited to the Bluetooth standard, and may include all short-range wireless communication standards including Wi-Fi, ZigBee, and UWB. Meanwhile, depending on the implementation method, the local area wireless unit 125a may be the local area network communication unit 120b.

The short-distance radio unit 125a is a general term for a component that processes short-range wireless communication of a designated standard, and preferably may include a Bluetooth component that processes Bluetooth-based short-range wireless communication according to the Bluetooth standard. However, the short-range wireless communication-related configuration of the short-range wireless unit 125a is not limited to Bluetooth-based short-range wireless communication according to the Bluetooth standard, and short-range wireless communication of various standards other than Bluetooth may be used according to the intention of a person skilled in the art (e.g., , WiFi-based short-range wireless communication according to the Wi-Fi standard, ZigBee-based short-range wireless communication according to the ZigBee standard, UWB-based short-range wireless communication according to the UWB standard, etc. available) is clearly stated. Hereinafter, for convenience, the characteristics of the present invention will be described mainly in an embodiment in which the short-range wireless unit 125a processes Bluetooth-based short-range wireless communication, but it is clearly stated that the present invention is not limited thereto.

According to the implementation method of the present invention, the short-distance module 125 (or short-distance wireless unit 125a) is capable of processing short-range wireless communication of a specified standard with the camera device 185 provided in the short-range of the sound device 100. can When the short-distance module 125 (or short-distance wireless unit 125a) processes short-range wireless communication with the short-range camera device 185, the sound device 100 and the camera device 185 operate based on short-range wireless communication. The key value for encrypted communication can be stored or the key value for encrypted communication can be exchanged at the time of connecting short-range wireless communication, whereby the sound device 100 and the camera device 185 use the key value. Encrypted communication can be performed.

According to the implementation method of the present invention, when the sound device 100 and the app of the wireless terminal used by the user are mapped (e.g., when a designated app is installed in the user wireless terminal and executed for the first time (or executed before mapping registration), the user wireless terminal Device identification information for identifying the sound device 100 in the terminal app and identification information of the user's wireless terminal (or unique identification information of the user's wireless terminal app) are registered in the designated operation server 200, and the sound device 100 and the application of the user's wireless terminal are matched and registered), the short-range wireless unit 125a connects the matched app of the user's wireless terminal and short-range wireless communication to provide various identification information or processing information specified to process a specific service. can be exchanged For example, information received as an app of a user's wireless terminal from a designated operation server 200 or input, extracted, or generated through an app of the user's wireless terminal is transmitted through the short-range wireless communication to the stationary sound device 100. It is transmitted to the control module 130 and processed (for example, sound output or transmitted to the operation server 200) and/or received by the sound device 100 from the designated operation server 200 or the sound device 100 for installation. ) The information recognized, extracted, or generated from may be transmitted to the app of the user's wireless terminal through the short-range wireless communication and processed (eg, screen output or transmitted to the operation server 200).

The camera module 110 is a general term for components that process camera shooting of the sound device 100, and preferably obtains image information (eg, image) or video information (eg, video) of a subject (eg, video) ( 110a), and an interface unit (not shown) that interfaces the camera unit 110a and the control module 130. On the other hand, if the short-distance module 125 (or short-range wireless unit 125a) and/or the short-range camera device 185 can be interlocked through the short-range wireless unit, the camera module 110 (or the camera unit 110a) It can be omitted, and the present invention is not limited thereby.

The camera unit 110a includes at least one lens unit that receives an optical signal reflected from a subject, an image sensor unit that detects an optical signal input through the lens unit and converts the optical signal into an electrical image signal, and a gap between the lens unit and the image sensor unit. It includes an actuator unit that implements an autofocus function or an image stabilization function, and according to an implementation method, one or more filter units (eg, an infrared filter, etc.) may be further provided between the lens unit and the image sensor unit. can Meanwhile, the camera unit 110a includes an image signal processing processor (ISP) that processes the image information or image information according to a designated procedure to improve the quality of the image information or image information generated through the image sensor unit. more can be provided.

Meanwhile, when the camera module 110 is provided in the sound device 100, the camera module 110 includes a driving unit for changing the shooting direction of the camera unit 110a, and the control module 130 ( Alternatively, the camera module 110 controls the driving unit to change the shooting direction of the camera unit 110a and reads image information or image information generated through the image sensor unit of the camera unit 110a to generate the sound device 100. It is possible to recognize a sound generating source (eg, a person or object generating animal sounds) in the same space as the space where the sound generating device is mounted, and operate the drive unit to photograph the sound generating source through the camera unit 110a. On the other hand, when one or more directional microphones are included in the sound input unit 105a provided in the sound module 105, the control module 130 (or camera module 110) is the sound input unit of the sound module 105 ( 105a) may check the direction of animal sound detected through one or more directional microphones, and operate the drive unit to photograph the direction of animal sound identified through the camera unit 110a.

The control module 130 is a general term for components that control various operations of the sound device 100, and is preferably an operation of generating image data through the camera module 110 and a sensor module through the short-distance module 125. Equipped with a control unit 130a for controlling at least one operation of an operation of collecting sensing data and an operation of communicating with a designated server (eg, operation server 200) through the communication module 120 or an operation of combining two or more operations and a memory unit for storing various information or program codes necessary for the operation of the control unit 130a.

The control unit 130a is a general term for components that control the operation of the sound device 100, and is configured to include at least one processor and an execution memory and/or various chips or control circuits, and is configured to include the sound It is connected to each component provided in the device 100 through a designated interface (eg, a bus (BUS), etc.). According to the present invention, the controller 130a loads and calculates at least one program code provided in the sound device 100 into the execution memory through the processor, and transmits the result to at least one component through the bus. and controls the operation of the sound device 100. The functional configuration of the present invention may be implemented in the form of program code and/or in the form of a chip or control circuit. Hereinafter, for convenience, it is implemented in the form of a program code, stored in a memory unit, and loaded and operated in the form of a program and/or chip. However, the functional components of the present invention implemented in the form of a control circuit will be illustrated and described in the control unit 130a.

The memory unit is a generic term for non-volatile memory corresponding to storage resources of the sound device 100, and stores at least one program code executed through the control unit 130a and at least one data set used by the program code. and keep it The memory unit basically includes system program codes and system data sets corresponding to the operating system of the sound device 100, communication program codes and communication data sets for processing wireless communication connection of the sound device 100, and at least one application program. Codes and application data sets are stored, and program codes and data sets corresponding to functional configurations implementing the present invention may also be stored in the memory unit.

The power module 115 is a general term for a component that supplies/applies power necessary for the operation of the sound device 100, and preferably uses an external power source (eg, AC power, DC power obtained by rectifying AC power, USB power, etc.) It is provided with a power supply unit (not shown) for receiving and applying, and when the voltage value or current value of the external power source is different from the voltage value or current value required for the operation of the sound device 100, the external power source is supplied to a specified voltage value or current value. It further includes a power converter (not shown) that converts power into operating power having a current value. Meanwhile, when the external power is supplied through the power supply unit or the external power is converted into operating power through the power conversion unit, the power module 115 charges the external power or operation power and operates the sound device 100. When external power is not supplied, a power charging unit (not shown) may be further provided to apply the charged charging power.

According to the first embodiment of the present invention, the sound device 100 is a dedicated sound device 100 manufactured for an animal sound recognition-based service that recognizes a designated animal sound in a designated space and provides a service related to the animal sound. can be

According to the second embodiment of the present invention, the sound device 100 provides a voice recognition operation mode that provides a well-known voice recognition-based service, but sets a specific setting through a predetermined input unit provided in the sound device 100. It may be a mode switching sound device 100 that switches from the voice recognition operation mode to the animal sound recognition operation mode for the animal sound recognition based service according to the present invention based on specific voice recognition through input or voice recognition.

According to the third embodiment of the present invention, the sound device 100 is a composite sound device manufactured to provide a well-known voice recognition-based service and at the same time recognize animal sounds according to the present invention and provide multiple services based on animal sound recognition. (100).

Referring to FIG. 1, the control module 130 selects recognition target information to be recognized in order to initiate or process a specific service among speech contents information to be recognized through the speech recognition unit of the control module 130 and acquired through natural language processing. It is provided with an information storage unit 135 that checks and stores it in a designated storage area of the memory unit.

When it is necessary to recognize the user's speech contents in order to determine the start or process of a specific service, the information storage unit 135 provides recognition target information including the speech contents to be recognized from the user's speech in order to initiate or process the specific service. It is possible to check and store service provision information and mapping for initiation or processing of the specific service.

According to the implementation method of the present invention, the recognition target information to be mapped with the service provision information is specified including the previously designated utterance content, and/or is provided to the user through the sound output unit 105b of the sound device 100. After requesting the content of speech to be used as the recognition target information, it may be received through the sound input unit 105a, acquired through natural language processing, and registered/updated. Meanwhile, according to the implementation method, the recognition target information may be registered/updated through an app of a user wireless terminal mapped with the sound device 100, and the present invention is not limited thereto.

Referring to FIG. 1, the control module 130 buffers sound data corresponding to a sound signal of an audible frequency band input through the sound input unit 105a in a designated buffer area or buffers sound data buffered in a designated buffer area. and at least one animal sound frequency designated to recognize at least one animal sound designated for determining a specific situation among non-verbal sounds or noises that may occur in a designated space by reading the buffered sound data. An animal sound recognizing unit 145 for recognizing a specific animal sound corresponding to a band and/or corresponding to at least one animal sound pattern designated for recognizing the animal sound, and a designated S( When at least s (1≤s≤S) service functions related to animal sounds are activated among S≥1) service functions and/or animal sounds or user's speech are not recognized for a specified period of time, the sound device ( 100) is provided with a service controller 150 that sets the operation mode to a sleep mode, and a service provider 180 that provides a service corresponding to the activated service function is further provided. Meanwhile, according to another implementation method of the present invention, at least one of the animal sound recognition unit 145, the service control unit 150, and the service providing unit 180 operates as an operation server on a communication network interworking with the sound device 100. 200. If the animal sound recognition unit 145 is implemented in the operation server 200, the sound processing unit 140 transfers sound data buffered to a designated buffer area to the operation server 200. ), or selectively extract sound data determined to correspond to animal sounds among the buffered sound data and provide the sound data to the operation server 200. However, for convenience, Figure 1 describes the features of the present invention, focusing on an embodiment in which the animal sound recognition unit 145, the service control unit 150, and the service provider 180 are implemented through the sound device 100. . Meanwhile, when the animal sound recognition unit 145, the service control unit 150, and the service provider 180 are implemented through the sound device 100, the animal sound recognition unit 145, the service control unit 150, and the service The study 180 may be implemented in the form of at least one or a combination of two of a program code form and a chip or control circuit form, and the animal sound recognition unit 145, the service control unit 150, and the service provider 180 The present invention is not limited by an implementation method or implemented module.

After operating power is applied to the sound device 100 through the power module 115, the sound processing unit 140 generates sound data corresponding to a sound signal of an audible frequency band input through the sound input unit 105a. buffering in the designated buffer area and/or continuing (or repeating) the process of checking sound data buffered in the designated buffer area, and the animal sound recognition unit 145 reads the buffered sound data in the designated space. Corresponds to at least one animal sound frequency band designated for recognizing at least one animal sound designated for determining a specific situation among possible nonverbal sounds or noises and/or at least one animal sound pattern designated for recognizing the animal sound Continue (or repeat) the process of recognizing a specific animal sound corresponding to Meanwhile, when the animal sound recognition unit 145 is implemented in the operation server 200, the sound processing unit 140 provides sound data buffered in a designated buffer area to the operation server 200 or the buffered sound data Among them, sound data determined to correspond to animal sounds may be selectively extracted and provided to the operation server 200, whereby the present invention is not limited.

The service control unit 150 checks whether an animal sound is not recognized for a specified period of time or longer after operating power is applied to the sound device 100 and/or effectively recognizes an animal sound through the animal sound recognition unit 145. After that, it is checked whether the animal sound is not recognized for a certain period of time or not, and/or the sound device 100 is powered on, and then it is checked whether the content of the user's utterance is not recognized for a certain period of time or not. After the content of the user's speech is effectively recognized according to a designated procedure (for example, the content of the user's speech is recognized during or after the effective recognition of the animal sound through the animal sound recognition unit 145), the user for a specified period of time or more It can be checked whether the contents of the utterance are not recognized. If the sound of an animal is not recognized for a certain period of time or the user's speech is not recognized for a certain period of time or longer, the service control unit 150 sets the operation mode of the sound device 100 (or control module 130). It includes a function to set to sleep mode. Here, the sleep mode reads the buffered sound data to wake up from the sleep mode by recognizing an animal sound even if the user's speech is recognized, and/or pre-specified specific speech information (e.g., animal sound). In addition, before waking up from sleep mode by recognizing specific speech information set to wake up the sound device 100, services based on the recognized user's speech (eg, sound source or signal sound) are recognized. This includes a state in which a function providing a sound-based service) is disabled. Hereinafter, for convenience, features of the present invention will be described focusing on an embodiment in which an animal sound is recognized to wake up from a sleep mode.

According to the implementation method of the present invention, the sound processing unit 140 buffers sound data corresponding to the sound signal of the audible frequency band input through the sound input unit 105a in a designated buffer area even in the sleep mode, and/or It is preferable to continue (or repeat) the process of checking the sound data buffered in the designated buffer area. Corresponding to at least one animal sound frequency band designated to recognize at least one animal sound designated for determining a specific situation among sounds or noises and/or corresponding to at least one animal sound pattern designated to recognize the animal sound It is desirable to continue (or repeat) the process of recognizing a specific animal sound. Preferably, when an animal sound is effectively recognized through the animal sound recognition unit 145 in the sleep mode, the service control unit 150 wakes up to activate s number of service functions related to the animal sound. The service providing unit 180 may perform a procedure of providing services corresponding to the activated s number of service functions.

Meanwhile, when two or more service functions related to animal sounds are activated through the service control unit 150, the service providing unit 180 performs a procedure for providing services corresponding to the activated service functions according to a designated order, or And/or a procedure for providing at least one service according to a predetermined condition (eg, a condition for recognizing user's speech) among the activated service functions may be performed.

According to the implementation method of the present invention, the animal sound recognizing unit 145 corresponds to the animal sound frequency band of the animal sound generating source and/or the animal sound unique to the animal sound generating source corresponding to the animal sound pattern of the animal sound generating source. For this purpose, the control module 130 has a function of learning at least one animal sound frequency band specific to an animal sound generating source and/or a function of learning at least one animal sound pattern specific to an animal sound generating source. It is desirable to have.

Referring to Figure 1, the control module 130 stores M animal sound frequency band information corresponding to M (M≥1) animal sound frequency bands in a designated storage area and/or N(N≥1) animal sound frequency band information. An information storage unit 135 for storing N animal sound pattern information corresponding to ) number of animal sound patterns in a designated storage area is provided, and the animal sound recognition unit 145 stores animal sound frequency bands stored in the designated storage area. An animal sound may be recognized using information and/or animal sound pattern information. On the other hand, according to another implementation method of the present invention, at least one component of the information storage unit 135 and the animal sound recognition unit 145 is implemented through the operating server 200 on a communication network that works with the sound device 100. It can be. However, for convenience, the features of the present invention will be described in FIG. 1 focusing on an embodiment in which the information storage unit 135 and the animal sound recognition unit 145 are implemented through the sound device 100. On the other hand, when the information storage unit 135 and the animal sound recognition unit 145 are implemented through the sound device 100, the information storage unit 135 and the animal sound recognition unit 145 are program code type and chip or control. It may be implemented in at least one or a combination of two circuit types, and the present invention is not limited by a method of implementing the information storage unit 135 and the animal sound recognition unit 145 or a module to be implemented.

The information storage unit 135 stores M animal sounds corresponding to M (M≥1) animal sound frequency bands in a designated storage area of the memory unit at the time of manufacturing the control module 130 (or sound device 100). Frequency band information may be stored. Among nonverbal sounds or noises that can be generated in a designated space in the present invention, designated animal sounds may have a wide range of frequencies (or a frequency difference of at least 100 Hz or more between the lowest frequency and the highest frequency) depending on the type of sound or sound source. there is. Therefore, the present invention can divide the frequency band of animal sounds into M frequency bands (eg, equal division or experimentally selective division based on a plurality of frequency bands in which animal sounds are concentrated), and the information storage unit 135 may store M animal sound frequency band information corresponding to the divided M animal sound frequency bands in a designated storage area.

The information storage unit 135 stores N animal sound patterns corresponding to N (N≥1) animal sound patterns in a designated storage area of the memory unit at the time of manufacturing the control module 130 (or sound device 100). Information can be stored in a designated storage area. The present invention first generates animal sound pattern information by qualitatively and/or quantitatively analyzing patterns of animal sounds identified through sample experiments for each case, and the information storage unit 135 stores the generated animal sound patterns. Information can be stored in a designated storage area.

Meanwhile, according to the implementation method of the present invention, the sound device 100 (or control module 130) may recognize animal sounds and then transmit the recognized animal sound information to a designated operation server 200, The server 200 collects animal sound information from each sound device 100 (or control module 130), and normalizes individual sound characteristics for each sound source from the collected animal sounds, and / Or through the process of qualitative analysis and / or quantitative analysis for each case, the animal sound pattern information can be refined or diversified. (130)). The information storage unit 135 receives refined or diversified animal sound pattern information from the operation server 200 through the above process, and provides N animal sound pattern information including the received animal sound pattern information. It can be stored in the designated storage area.

According to the implementation method of the present invention, M animal sound frequency band information corresponding to M animal sound frequency bands is stored in the designated storage area, and/or N animals corresponding to N animal sound patterns are stored in the designated storage area. When the sound pattern information is stored, the animal sound recognition unit 145 reads the buffered sound data to correspond to at least one animal sound frequency band among the stored M animal sound frequency bands and/or the stored N animal sound frequency bands. It is preferable to recognize an animal sound corresponding to at least one animal sound pattern among animal sound patterns.

Meanwhile, the M pieces of animal sound frequency band information and/or the N pieces of animal sound pattern information stored in the designated storage area are not optimized (or customized) for the animal sounds of the animal sound source, but the frequency bands and/or sounds of statistical animal sounds. It will be information corresponding to the pattern. Therefore, in order to quickly recognize the animal sound of the animal sound generator existing in the space where the sound device 100 is installed and/or prevent (or minimize) recognition errors, the stored animal sound frequency band information and/or animal sound A process of optimizing (or customizing) the pattern information to the animal sound of the animal sound generating source is required.

Referring to Figure 1, the control module 130 uses the M number of animal sound frequency band information for a specified period of time, at least i (i≥2) animal sound frequencies corresponding to the recognized animal sound frequency distribution. Distribution generation that generates distribution information and/or generates animal sound pattern distribution information corresponding to animal sound pattern distributions that have been validly recognized at least j (j≥2) times during a specified period of time using the N pieces of animal sound pattern information. unit 155 and m (1≤m≤M) optimized (or customized) for the animal sound of the animal sound source in the space through which the sound device 100 passed through statistical processing of the generated animal sound frequency distribution information m animal sound frequency band information corresponding to ) number of animal sound frequency bands is determined and/or the generated animal sound pattern distribution information is statistically processed to obtain the An information determination unit 160 for determining n animal sound pattern information corresponding to n (1≤n≤N) animal sound patterns optimized (or customized) for animal sounds is further provided. On the other hand, according to another implementation method of the present invention, at least one component of the distribution generating unit 155 and the information determining unit 160 is implemented through the operation server 200 on a communication network that works with the sound device 100. can However, for convenience, the features of the present invention will be described in FIG. 1 based on an embodiment in which the distribution generating unit 155 and the information determining unit 160 are implemented through the sound device 100. Meanwhile, when the distribution generating unit 155 and the information determining unit 160 are implemented through the sound device 100, the distribution generating unit 155 and the information determining unit 160 are in the form of program codes and chips or control circuits. It may be implemented in the form of at least one or a combination of the two, and the present invention is not limited by a method of implementing the distribution generating unit 155 and the information determining unit 160 or a module to be implemented.

When M animal sound frequency band information corresponding to the M animal sound frequency bands is stored in the storage area designated through the information storage unit 135, the distribution generating unit 155 stores the M number of animals stored in the designated storage area. Whenever an animal sound is effectively recognized using the sound frequency band information, the frequency band information of the effectively recognized animal sound may be stored in a designated storage area. The distribution generating unit 155 operates i animal sound frequency bands effectively recognized and recognized at least i (i≥2) times during a designated period based on the animal sound frequency bands effectively recognized and stored through the information on the M number of animal sound frequency bands. , and animal sound frequency distribution information corresponding to the distribution of the identified i animal sound frequency bands may be generated.

On the other hand, when animal sound frequency distribution information corresponding to the animal sound frequency distribution that has been recognized validly at least i for a specified period of time is generated through the distribution generating unit 155, the information determining unit 160 determines the generated animal sound frequency Distribution information is statistically processed to optimize (or customize) the animal sound of the animal sound source in the space through which the sound device 100 has passed through, thereby recognizing the animal sound of the animal sound source at high speed or preventing (or minimizing) recognition errors It is possible to determine m pieces of animal sound frequency band information corresponding to m (1≤m≤M) number of animal sound frequency bands. Here, the m animal sound frequency bands may be any one of the M animal sound frequency bands, or may include a newly defined animal sound frequency band within the animal sound frequency band range. When the m animal sound frequency band information is determined through the information determination unit 160, the information storage unit 135 sets the determined m animal sound frequency bands as animal sound frequency bands to be read first and stores the designated information. It may be newly stored in the storage area, or the animal sound frequency band information stored in the storage area may be updated and stored. Thereafter, the animal sound recognizing unit 145 may first recognize an animal sound corresponding to at least one animal sound frequency band among m animal sound frequency bands that are new or updated and stored by reading the buffered sound data.

Meanwhile, when N animal sound pattern information corresponding to N animal sound patterns is stored in the storage area designated through the information storage unit 135, the distribution generating unit 155 stores the N animal sound patterns stored in the designated storage area. Whenever an animal sound is effectively recognized using the pattern information, the sound pattern of the effectively recognized animal sound may be stored in a designated storage area. The distribution generating unit 155 checks the validly recognized j animal sound patterns at least j (j≥2) times during a specified period of time based on the animal sound pattern information that has been validly recognized and stored through the N animal sound pattern information. and may generate animal sound pattern distribution information corresponding to the distribution of the identified j animal sound patterns.

On the other hand, when animal sound pattern distribution information corresponding to the animal sound pattern distribution that has been recognized validly at least j times during a specified period of time is generated through the distribution generating unit 155, the information determination unit 160 determines the generated animal sound pattern Distribution information is statistically processed to optimize (or customize) the animal sound of the animal sound source in the space through which the sound device 100 has passed through, thereby recognizing the animal sound of the animal sound source at high speed or preventing (or minimizing) recognition errors It is possible to determine n animal sound pattern information corresponding to n (1≤n≤N) animal sound patterns for Here, the n animal sound patterns may be any one of the N animal sound patterns, or may include a combination of two or more animal sound patterns or a new animal sound pattern. When n animal sound patterns are determined through the information determining unit 160, the information storage unit 135 sets the determined n animal sound patterns as animal sound patterns to be read first and stores them in a designated storage area, or Animal sound frequency band information stored in the storage area may be updated and stored. Thereafter, the animal sound recognizing unit 145 may first recognize an animal sound corresponding to at least one animal sound pattern among the n number of animal sound patterns by reading the buffered sound data.

Referring to FIG. 1, the control module 130 reads the buffered sound data, recognizes the user's language utterance, and processes natural language to recognize speech content information corresponding to the user's utterance content. 165), and a recognition determination unit 170 for confirming whether the content of the user's speech is recognized while the animal sound is recognized or within a certain time after the end of the recognition of the animal sound, and a recognition determination unit 170, and the animal sound When the content of the user's speech is recognized during or after the recognition of the user's speech, the intelligent processing unit 175 is provided to interpret the contents of the user's speech in association with s service functions related to animal sounds. there is. On the other hand, according to another implementation method of the present invention, at least one component of the utterance recognition unit 165, the recognition determination unit 170, and the intelligence processing unit 175 is an operation server on a communication network that interworks with the sound device 100. 200. If the utterance recognition unit 165 is implemented in the operation server 200, the sound processing unit 140 transfers sound data buffered to a designated buffer area to the operation server 200. ), or selectively extract sound data determined to correspond to the user's speech among the buffered sound data and provide the sound data to the operation server 200. However, for convenience, Figure 1 describes the features of the present invention, focusing on an embodiment in which the utterance recognition unit 165, the recognition determination unit 170, and the intelligent processing unit 175 are implemented through the sound device 100. . Meanwhile, when the speech contents recognition unit 165, the recognition determination unit 170, and the intelligence processing unit 175 are implemented through the sound device 100, the speech contents recognition unit 165, the recognition determination unit 170 and the intelligence processing unit 175 are implemented. The processing unit 175 may be implemented in the form of at least one or a combination of two of a program code form and a chip or control circuit form, and the utterance recognition unit 165, the recognition determination unit 170, and the intelligence processing unit 175 The present invention is not limited by an implementation method or implemented module.

The animal sound recognition unit 145 reads the buffered sound data and recognizes the animal sound, and at the same time, the speech content recognition unit 165 reads the buffered sound data to utter the user's language. and performs a procedure of recognizing speech content information corresponding to the user's speech content by natural language processing. Meanwhile, when the utterance recognition unit 165 is implemented in the operation server 200, the sound processing unit 140 provides sound data buffered in a designated buffer area to the operation server 200 or the buffered sound data It is possible to selectively extract sound data that is determined to correspond to the user's utterance (eg, including segmented sounds) and provide it to the operation server 200, whereby the present invention is not limited.

According to the implementation method of the present invention, the speech content recognition unit 165 analyzes the buffered sound data through a designated speech recognition algorithm, recognizes and converts the speech spoken by the user into text, and simultaneously analyzes form, semantics, and dialogue. Speech content information by recognizing the user's utterance content may be generated through one or more natural language processing procedures during the analysis.

On the other hand, according to the implementation method of the present invention, the speech content recognition unit 165 recognizes animal sounds by the animal sound recognition unit 145, and through the service control unit 150, the operation mode of the service device is in the sleep mode. It is preferable to perform a function of recognizing the user's utterance in case of waking up. If the operation mode of the sound device 100 is set to the sleep mode by the service control unit 150, the speech content recognition unit 165 may not perform a function of recognizing the user's speech content. Even if the content of the user's speech is recognized, it can be processed so that it is not used for the service.

Meanwhile, when the user's speech content is recognized through the speech content recognition unit 165, the recognition determination unit 170 determines that the user's speech content is recognized while the animal sound recognition unit 145 recognizes the user's speech content. It is confirmed whether or not the user's speech is recognized within a certain time after the recognition of the animal sound is terminated through the animal sound recognition unit 145.

If it is confirmed through the recognition determination unit 170 that the contents of the user's speech have been recognized within a certain period of time during or after the animal sounds are recognized, the intelligence processing unit 175 determines the contents of speech recognizing unit 165 The user's speech content recognized through is processed to be interpreted by relating it to s service functions related to animal sounds, whereby a specific service function corresponding to the speech content among s service functions related to animal sounds can be determined. In this case, the service control unit 150 may activate a specific service function related to the specific sound and corresponding to the recognized user's utterance, and the service providing unit 180 may activate the specific service function. The provided procedure can be performed according to the specified procedure.

If the content of the user's speech is not recognized within a certain period of time during or after the animal sound is recognized through the recognition determination unit 170, the intelligent processing unit 175 enters the sleep mode through the service control unit 150. and/or a process of waking up from the sleep mode by the sound of the animal may be performed.

On the other hand, according to the implementation method of the present invention, the s number of services related to animal sounds activated by the service control unit 150 and/or provided through the service providing unit 180 are stored on the communication network through the communication module 120. A server interworking service provided in conjunction with the operating server 200, a sound-based service provided through the sound module 105, and a composite service provided by using the sound module 105 and the communication module 120 in combination. It may include at least one of the services.

On the other hand, among the s services related to the animal sound, the server interlocking service is a paging service using wireless terminal information, a situation notification service using wireless terminal information, a paging service using an app installed on the wireless terminal, and using an app installed on the wireless terminal. At least one of a situation notification service, a video service that provides video information captured through at least one camera to an app installed in a wireless terminal, and a video service that provides video information captured through at least one camera to a designated IPTV device can include

Meanwhile, among the s number of services related to the animal sound, the sound-based service may include a noise output service for outputting a designated service sound at a designated signal output strength through the sound output unit 105b of the sound module 105. Preferably, the signal output strength of the sound-based service includes a signal strength that is inversely proportional to the signal input strength of the animal sound.

On the other hand, among the s services related to the animal sound, the complex service recognizes the user's speech content within a certain time during or after the animal sound is recognized, and interprets the user's speech content in association with the service function related to the animal sound. Based on one result, the service provided through the operation server 200 on the communication network may be included.

Meanwhile, according to the first camera embodiment of the present invention, the sound device 100 is provided with a short-range module 125 for processing short-range wireless communication with the short-range camera device 185, and through the short-range module 125 When processing short-range wireless communication with the short-range camera device 185, the service control unit 150 recognizes an animal sound through the animal sound recognition unit 145 through the short-range module 125 to the camera. By communicating with the device 185, it is possible to activate s number of service functions including an image service function for photographing a sound generator that generated the recognized animal sound through the camera device 185, and the service providing unit 180 ) communicates with the camera device 185 through the short-distance module 125, receives image information captured through the camera device 185, and provides the image to the app installed in the wireless terminal through the operation server 200. At least one video service among service and/or video services provided to a designated IPTV device may be provided. Meanwhile, when the camera device 185 can provide the video service, the service providing unit 180 may process the video service function of the camera device 185 to operate through the short distance module 125 .

Alternatively, according to the second camera embodiment of the present invention, wireless communication based on a local area network with the camera device 185 is performed through the local area network communication unit 120b of the communication module 120 included in the sound device 100. In case of processing, the service control unit 150 communicates with the camera device 185 through the local area network communication unit 120b when recognizing an animal sound through the animal sound recognition unit 145, and the camera device ( 185), it is possible to activate s number of service functions including an image service function for photographing a sound generating source that generated the recognized animal sound, and the service provider 180 communicates through the local area network communication unit 120b. Communicate with the camera device 185 to receive video information captured through the camera device 185 and provide it to an app installed in the wireless terminal through the operation server 200 and / or to a designated IPTV device At least one video service among video services may be provided. Meanwhile, when the camera device 185 can provide the video service, the service providing unit 180 may process the video service function of the camera device 185 to operate through the local area network communication unit 120b.

Alternatively, according to the third camera embodiment of the present invention, when the sound device 100 is provided with a camera module 110 for obtaining image information of a photographed subject, the service control unit 150 is configured to recognize the animal sound ( 145), when an animal sound is recognized, an image service function for photographing a sound source generating the recognized animal sound may be activated through the camera module 110, and the service providing unit 180 At least one of a video service providing video information captured by the camera module 110 to an app installed in a wireless terminal through the operation server 200 and/or a video service provided to a designated IPTV device may be provided. there is.

Figure 2 is a diagram showing the functional configuration of the sound device 100 and the operating server 200 according to another embodiment of the present invention.

In more detail, FIG. 2 shows an embodiment in which at least some of the functional configurations of the control module 130 of the sound device 100 shown in FIG. 1 are implemented on the operation server 200 side, Those of ordinary skill in the art to which the present invention pertains, a method of at least partially modifying the embodiments of FIG. 1 and 2 by referring to and/or modifying FIG. 2 (eg, FIG. 2 Some of the functional configurations implemented on the operation server 200 are implemented on the operation server 200 side as they are, but other parts are implemented in the control module 130 of the sound device 100 or the control module 130 of the above drawing 1 An implementation method in which some of the functional configurations implemented in the control module 130 are implemented as they are in the control module 130, but other parts are implemented on the operation server 200 side. However, the present invention includes all the inferred implementation methods as the scope of rights, and the technical characteristics are not limited only to the implementation methods shown in Figure 1 and this Figure 2. No.

Referring to Figure 2, the operation server 200, the sound receiving unit 205 for receiving the sound data input through the sound input unit 105a of the designated sound device 100 and temporarily storing it in a designated storage medium, By reading the received sound data, it corresponds to at least one animal sound frequency band designated to recognize at least one animal sound designated for determining a specific situation among non-verbal sounds or noises that may occur in a designated space, and/or the animal sound An animal sound recognition unit 145 for recognizing a specific animal sound corresponding to at least one animal sound pattern designated to be recognized, and when the animal sound is recognized, among the designated S (S≥1) service functions, the animal sound and When at least s (1≤s≤S) related service functions are activated and/or animal sounds or user's utterances are not recognized for a specified period of time, the operation mode of the sound device 100 is set to a sleep mode It has a service control unit 150 set to , and further includes a service providing unit 180 that provides a service corresponding to the activated service function.

When sound data input through the sound input unit 105a is transmitted from the designated sound device 100, the sound receiving unit 205 receives the sound data transmitted from the sound apparatus 100 and temporarily stores the sound data in the designated storage medium. can be stored Meanwhile, when the sound device 100 selectively transmits one or more sound data among sound data corresponding to an animal sound or sound data corresponding to a user's speech, the sound receiver 205 transmits from the sound device 100 The selectively transmitted sound data may be received and temporarily stored in a designated storage medium.

The animal sound recognizing unit 145 reads the received sound data and recognizes at least one animal sound frequency band designated for determining a specific situation among non-verbal sounds or noises that may occur in a designated space. and/or continues (or repeats) a process of recognizing a specific animal sound corresponding to at least one animal sound pattern designated for recognizing the animal sound.

The service control unit 150 checks whether an animal sound is not recognized for a specified period of time or longer after operating power is applied to the sound device 100 and/or effectively recognizes an animal sound through the animal sound recognition unit 145. After that, it is checked whether the animal sound is not recognized for a certain period of time or not, and/or the sound device 100 is powered on, and then it is checked whether the content of the user's utterance is not recognized for a certain period of time or not. After the content of the user's speech is effectively recognized according to a designated procedure (for example, the content of the user's speech is recognized during or after the effective recognition of the animal sound through the animal sound recognition unit 145), the user for a specified period of time or more It can be checked whether the contents of the utterance are not recognized. If the sound of an animal is not recognized for a specified period of time or longer than a specified period of time or the user's utterance is not recognized for a period of time or longer, the service control unit 150 remotely sets the operation mode of the sound device 100 to a sleep mode. It can be made including the function to do.

According to the implementation method of the present invention, the sound device 100 can transmit the input sound data in a sleep mode, and the sound receiver 205 determines that the operation mode of the sound device 100 is the sleep mode. receiving the sound data in this state, and the animal sound recognition unit 145 also reads the received sound data in a state where the operation mode of the sound device 100 is the sleep mode, and non-verbal sounds or noises that can be generated in a designated space A specific animal sound corresponding to at least one animal sound frequency band designated for recognizing at least one animal sound designated for determining a specific situation and/or corresponding to at least one animal sound pattern designated for recognizing the animal sound. The process of recognizing can be continued (or repeated). Preferably, when an animal sound is effectively recognized through the animal sound recognition unit 145 in the sleep mode, the service control unit 150 wakes up the sound device 100 and simultaneously generates s number of sounds related to the animal sound. A service function may be activated, and the service providing unit 180 may perform a procedure for providing a service corresponding to the activated s number of service functions.

Meanwhile, when two or more service functions related to animal sounds are activated through the service control unit 150, the service providing unit 180 performs a procedure for providing services corresponding to the activated service functions according to a designated order, or And/or a procedure for providing at least one service according to a predetermined condition (eg, a condition for recognizing user's speech) among the activated service functions may be performed.

According to the implementation method of the present invention, the animal sound recognizing unit 145 corresponds to the animal sound frequency band of the animal sound generating source and/or the animal sound unique to the animal sound generating source corresponding to the animal sound pattern of the animal sound generating source. For this purpose, the operation server 200 has a function of learning at least one animal sound frequency band specific to an animal sound generating source and/or a function of learning at least one animal sound pattern specific to an animal sound generating source. It is desirable to have.

Referring to FIG. 2, the operation server 200 stores M animal sound frequency band information corresponding to M (M≥1) animal sound frequency bands in a designated storage medium and/or N(N≥1) animal sound frequency band information. An information storage unit 135 for storing N animal sound pattern information corresponding to ) number of animal sound patterns in a designated storage medium is provided, and the animal sound recognition unit 145 is provided with animal sound frequency bands stored in the designated storage medium. An animal sound may be recognized using information and/or animal sound pattern information.

The information storage unit 135 may store M animal sound frequency band information corresponding to M (M≥1) animal sound frequency bands in a designated storage medium. Among nonverbal sounds or noises that can be generated in a designated space in the present invention, designated animal sounds may have a wide range of frequencies (or a frequency difference of at least 100 Hz or more between the lowest frequency and the highest frequency) depending on the type of sound or sound source. there is. Therefore, the present invention can divide the frequency band of animal sounds into M frequency bands (eg, equal division or experimentally selective division based on a plurality of frequency bands in which animal sounds are concentrated), and the information storage unit 135 may store M animal sound frequency band information corresponding to the divided M animal sound frequency bands in a designated storage medium.

The information storage unit 135 may store N animal sound pattern information corresponding to N (N≥1) animal sound patterns in a designated storage medium. The present invention first generates animal sound pattern information by qualitatively and/or quantitatively analyzing patterns of animal sounds identified through sample experiments for each case, and the information storage unit 135 stores the generated animal sound patterns. Information can be stored in a designated storage medium.

On the other hand, according to the implementation method of the present invention, the sound device 100 can transmit the recognized animal sound information to the designated operation server 200 after recognizing the animal sound, and the intelligent processing unit 175 of the operation server 200 ) is a normalization process of collecting animal sound information from each sound device 100 and normalizing individual sound characteristics for each sound source in the collected animal sounds and/or qualitative analysis and/or quantitative analysis for each case. Animal sound pattern information can be refined or diversified through the analysis process. The information storage unit 135 may receive refined or diversified animal sound pattern information through the above process, and store N pieces of animal sound pattern information including the received animal sound pattern information in a designated storage medium. .

According to the implementation method of the present invention, M animal sound frequency band information corresponding to M animal sound frequency bands is stored in the designated storage medium, and/or N animals corresponding to N animal sound patterns are stored in the designated storage medium. When the sound pattern information is stored, the animal sound recognition unit 145 reads the received sound data to correspond to at least one animal sound frequency band among the stored M animal sound frequency bands and/or the stored N number of animal sound frequency bands. It is preferable to recognize an animal sound corresponding to at least one animal sound pattern among animal sound patterns.

Meanwhile, the M number of animal sound frequency band information and/or N number of animal sound pattern information stored in the designated storage medium are not optimized (or customized) for the animal sound of the animal sound source, but the frequency band and/or sound of the statistical animal sound. It will be information corresponding to the pattern. Therefore, in order to quickly recognize the animal sound of the animal sound generator existing in the space where the sound device 100 is installed and/or prevent (or minimize) recognition errors, the stored animal sound frequency band information and/or animal sound A process of optimizing (or customizing) the pattern information to the animal sound of the animal sound generating source is required.

Referring to FIG. 2, the operating server 200 uses the M number of animal sound frequency band information to correspond to animal sound frequency distributions that have been effectively recognized at least i (i≥2) times during a specified period of time. Distribution generation that generates distribution information and/or generates animal sound pattern distribution information corresponding to animal sound pattern distributions that have been validly recognized at least j (j≥2) times during a specified period of time using the N pieces of animal sound pattern information. unit 155 and m (1≤m≤M) optimized (or customized) for the animal sound of the animal sound source in the space through which the sound device 100 passed through statistical processing of the generated animal sound frequency distribution information m animal sound frequency band information corresponding to ) number of animal sound frequency bands is determined and/or the generated animal sound pattern distribution information is statistically processed to obtain the An information determination unit 160 for determining n animal sound pattern information corresponding to n (1≤n≤N) animal sound patterns optimized (or customized) for animal sounds is further provided.

When M animal sound frequency band information corresponding to the M animal sound frequency bands is stored in the storage medium designated through the information storage unit 135, the distribution generating unit 155 determines the M number of animals stored in the designated storage medium. Using the sound frequency band information, at least i (i≥2) times for a designated period of time, verify i animal sound frequency bands recognized as effective, and animal sound frequency distributions corresponding to the distribution of the identified i animal sound frequency bands. information can be generated.

On the other hand, when animal sound frequency distribution information corresponding to the animal sound frequency distribution that has been recognized validly at least i for a specified period of time is generated through the distribution generating unit 155, the information determining unit 160 determines the generated animal sound frequency Distribution information is statistically processed to optimize (or customize) the animal sound of the animal sound source in the space through which the sound device 100 has passed through, thereby recognizing the animal sound of the animal sound source at high speed or preventing (or minimizing) recognition errors It is possible to determine m pieces of animal sound frequency band information corresponding to m (1≤m≤M) number of animal sound frequency bands. Here, the m animal sound frequency bands may be any one of the M animal sound frequency bands, or may include a newly defined animal sound frequency band within the animal sound frequency band range. When the m animal sound frequency band information is determined through the information determination unit 160, the information storage unit 135 sets the determined m animal sound frequency bands as animal sound frequency bands to be read first and stores the designated information. The information may be newly stored in a medium or updated and stored in the animal sound frequency band information stored in the storage medium. Thereafter, the animal sound recognizing unit 145 may first recognize an animal sound corresponding to at least one animal sound frequency band among the new or updated stored m animal sound frequency bands by reading the received sound data.

Meanwhile, when N animal sound pattern information corresponding to the N animal sound patterns is stored in a storage medium designated through the information storage unit 135, the distribution generating unit 155 determines the N animal sound patterns stored in the designated storage medium. Using the sound pattern information, at least j (j≥2) times during a designated period of time, verify j number of validly recognized animal sound patterns, and generate animal sound pattern distribution information corresponding to the distribution of the identified j number of animal sound patterns. can do.

On the other hand, when animal sound pattern distribution information corresponding to the animal sound pattern distribution that has been recognized validly at least j times during a specified period of time is generated through the distribution generating unit 155, the information determination unit 160 determines the generated animal sound pattern Distribution information is statistically processed to optimize (or customize) the animal sound of the animal sound source in the space through which the sound device 100 has passed through, thereby recognizing the animal sound of the animal sound source at high speed or preventing (or minimizing) recognition errors It is possible to determine n animal sound pattern information corresponding to n (1≤n≤N) animal sound patterns for Here, the n animal sound patterns may be any one of the N animal sound patterns, or may include a combination of two or more animal sound patterns or a new animal sound pattern. When n animal sound patterns are determined through the information determining unit 160, the information storage unit 135 sets the determined n animal sound patterns as animal sound patterns to be read first and newly stores them in a designated storage medium. Animal sound frequency band information stored in the storage medium may be updated and stored. Thereafter, the animal sound recognizing unit 145 may first recognize an animal sound corresponding to at least one animal sound pattern among the n number of animal sound patterns by reading the received sound data.

Referring to FIG. 2, the operation server 200 reads the received sound data, recognizes the user's language utterance, and processes natural language to recognize the utterance content information corresponding to the user's utterance content recognition unit ( 165), and a recognition determination unit 170 for confirming whether the content of the user's speech is recognized while the animal sound is recognized or within a certain time after the end of the recognition of the animal sound, and a recognition determination unit 170, and the animal sound When the content of the user's speech is recognized during or after the recognition of the user's speech, the intelligent processing unit 175 is provided to interpret the contents of the user's speech in association with s service functions related to animal sounds. there is.

At the same time as reading the received sound data through the animal sound recognition unit 145 and performing a process of recognizing animal sounds, the speech content recognition unit 165 reads the received sound data to utter the user's language. and performs a procedure of recognizing speech content information corresponding to the user's speech content by natural language processing.

According to the implementation method of the present invention, the speech content recognition unit 165 analyzes the received sound data through a designated speech recognition algorithm to recognize and characterize the speech spoken by the user, and at the same time analyze the form, semantics, and dialogue. Speech content information by recognizing the user's utterance content may be generated through one or more natural language processing procedures during the analysis.

On the other hand, according to the implementation method of the present invention, the speech content recognition unit 165 recognizes animal sounds by the animal sound recognition unit 145, and through the service control unit 150, the operation mode of the service device is in the sleep mode. It is preferable to perform a function of recognizing the user's utterance in case of waking up. If the operation mode of the sound device 100 is set to the sleep mode by the service control unit 150, the speech content recognition unit 165 may not perform a function of recognizing the user's speech content. Even if the content of the user's speech is recognized, it can be processed so that it is not used for the service.

Meanwhile, when the user's speech content is recognized through the speech content recognition unit 165, the recognition determination unit 170 determines that the user's speech content is recognized while the animal sound recognition unit 145 recognizes the user's speech content. It is confirmed whether or not the user's speech is recognized within a certain time after the recognition of the animal sound is terminated through the animal sound recognition unit 145.

If it is confirmed through the recognition determination unit 170 that the contents of the user's speech have been recognized within a certain period of time during or after the animal sounds are recognized, the intelligence processing unit 175 determines the contents of speech recognizing unit 165 The user's speech content recognized through is processed to be interpreted by relating it to s service functions related to animal sounds, whereby a specific service function corresponding to the speech content among s service functions related to animal sounds can be determined. In this case, the service control unit 150 may activate a specific service function related to the specific sound and corresponding to the recognized user's utterance, and the service providing unit 180 may activate the specific service function. The provided procedure can be performed according to the specified procedure.

If the content of the user's speech is not recognized within a certain period of time during or after the animal sound is recognized through the recognition determination unit 170, the intelligent processing unit 175 enters the sleep mode through the service control unit 150. and/or a process of waking up from the sleep mode by the sound of the animal may be performed.

Meanwhile, according to the implementation method of the present invention, s services related to animal sounds activated by the service control unit 150 of the operation server 200 and/or provided through the service providing unit 180 are the operation server ( 200) and at least one of a server-based service provided through the sound device 100 and a composite service provided in conjunction with the sound device 100.

On the other hand, among the s services related to the animal sound, the server-based service is a call service using wireless terminal information, a situation notification service using wireless terminal information, a call service using an app installed on the wireless terminal, and a call service using an app installed on the wireless terminal. At least one of a situation notification service, a video service that provides video information captured through at least one camera to an app installed in a wireless terminal, and a video service that provides video information captured through at least one camera to a designated IPTV device can include

On the other hand, among the s services related to the animal sound, the complex service recognizes the user's speech content within a certain time during or after the animal sound is recognized, and interprets the user's speech content in association with the service function related to the animal sound. Based on one result, the service provided through the operation server 200 on the communication network may be included.

3 illustrates an embodiment of recognizing animal sounds and activating a service related to animal sounds according to an exemplary embodiment of the present invention.

In more detail, FIG. 3 shows an embodiment of recognizing animal sounds using M pieces of animal sound frequency band information and/or N pieces of animal sound pattern information stored in a designated storage area and activating a service related to the recognized animal sounds. , and those of ordinary skill in the art to which the present invention pertains, various implementation methods (eg, some steps are omitted) for the animal sound recognition or service activation process by referring to and/or modifying this Figure 3 However, the present invention includes all the inferred implementation methods, and its technical characteristics are not limited only to the implementation method shown in FIG. 3. On the other hand, the process illustrated and described in FIG. 3 is provided through the sound device 100, the operation server 200, or provided in a distributed form through interworking between the sound device 100 and the operation server 200. It is possible, and for convenience, the features of the present invention will be described in FIG. 3 focusing on the process provided through the sound device 100.

Referring to the embodiment of FIG. 3, the sound apparatus 100 stores M animal sound frequency band information corresponding to M animal sound frequency bands for recognizing animal sounds in a designated storage area (300) and/or N pieces of animal sound pattern information corresponding to the N number of animal sound patterns for recognizing animal sounds are stored in a designated storage area (300). Thereafter, the sound device 100 receives sound data corresponding to the sound signal of the audible frequency band through the sound input unit 105a, buffers it in a designated buffer area (305), reads the buffered sound data, and reads the sound data in the designated space. To recognize at least one designated animal sound, an animal sound corresponding to a specific animal sound corresponding to at least one animal sound frequency band designated for recognizing the animal sound and/or a specific animal sound corresponding to at least one animal sound pattern specified for recognizing the animal sound A recognition procedure is performed (310).

According to one embodiment of the present invention, the sound device 100 reads the buffered sound data to correspond to at least one animal sound frequency band among the stored M animal sound frequency bands and/or to the stored N number of animal sound frequency bands. An animal sound corresponding to at least one of the animal sound patterns may be recognized (310). According to another embodiment of the present invention, through the process of FIG. 4 and/or FIG. 5, m animal sound frequencies optimized (or customized) for the animal sound of the animal sound generator in the space where the sound device 100 has passed through When band information is determined and stored in a designated storage area and/or n animal sound pattern information optimized (or customized) for animal sounds of the animal sound source is determined and stored in a designated storage area, the sound device 100 reads the buffered sound data to correspond to at least one animal sound frequency band among the stored m animal sound frequency bands and/or animal sounds corresponding to at least one animal sound pattern among the stored n animal sound patterns It is possible to recognize the animal sound unique to the source (310).

If the operation mode of the sound device 100 is the sleep mode at the time of recognizing the animal sound, the sound device 100 may wake up from the sleep mode (315).

On the other hand, when the animal sound is recognized and/or the operation mode of the sound device 100 wakes up from the sleep mode, the sound device 100 among the designated S (S≥1) service functions related to animal sounds. At least s (1≤s≤S) number of service functions may be activated (320), and a procedure for providing at least one service function among the activated s number of service functions according to a specified procedure may be performed (325).

Meanwhile, when the animal sound is not recognized by reading the sound data, the sound apparatus 100 checks whether the animal sound is not effectively recognized for a designated period of time (330). If the sound of an animal is not validly recognized for a designated period of time, the sound device 100 may set the operation mode of the sound device 100 to a sleep mode (335).

4 illustrates an embodiment of optimizing (or customizing) an animal sound frequency band for animal sound recognition according to an animal sound of an animal sound generator according to an embodiment of the present invention.

In more detail, FIG. 4 shows animal sound frequency distribution information corresponding to the animal sound frequency distribution that has been effectively recognized at least i (i≥2) times during a designated period of time using M pieces of animal sound frequency band information pre-stored in a designated storage area. m (1≤m≤M) number of optimized (or customized) animal sounds of the animal sound generating source in the space where the sound device 100 passed through by statistically processing the generated animal sound frequency distribution information. It shows an embodiment of determining m pieces of animal sound frequency band information corresponding to animal sound frequency bands and storing them in a new/updated storage area in a designated storage area. Various implementation methods (eg, implementation methods in which some steps are omitted or the order is changed) for the process of optimizing (or customizing) the animal sound frequency band may be inferred by referring to and/or modifying FIG. The invention is made including all the implementation methods inferred above, and its technical characteristics are not limited only to the implementation method shown in FIG. 4. On the other hand, the process illustrated and described in FIG. 4 is provided through the sound device 100, the operation server 200, or provided in a distributed form through interworking between the sound device 100 and the operation server 200. It is possible, and for convenience, the features of the present invention will be described mainly in the process provided through the sound device 100 in FIG. 4 .

Referring to the embodiment of FIG. 4, the sound device 100 effectively recognizes animal sounds using M pieces of animal sound frequency band information pre-stored in a designated storage area, and then animal sounds used to effectively recognize the animal sounds. The frequency band information is stored in a designated storage area and managed (400).

If i (i≥2) pieces of animal sound frequency band information used to effectively recognize animal sounds for a specified period of time are stored in the storage area (405), the sound apparatus 100 provides at least i (i for a specified period of time). Animal sound frequency distribution information corresponding to the animal sound frequency distribution that has been recognized validly ≥ 2) is generated (410), and the generated animal sound frequency distribution information is statistically processed to obtain After determining m animal sound frequency band information corresponding to m (1≤m≤M) animal sound frequency bands optimized (or customized) for animal sounds of the animal sound source (415), the determined m animal sound frequencies A band is first set as an animal sound frequency band to be read, and new/updated storage is stored in a designated storage area (420). Then, the sound device 100 recognizes animal sounds using the stored m animal sound frequency band information. can

5 illustrates an embodiment of optimizing (or customizing) an animal sound pattern for recognizing an animal sound to an animal sound of an animal sound generator according to another embodiment of the present invention.

In more detail, FIG. 5 shows animal sound pattern distribution information corresponding to animal sound pattern distributions that have been effectively recognized at least j (j≥2) times during a designated period of time using N pieces of animal sound pattern information pre-stored in a designated storage area. n (1≤n≤N) number of animals optimized (or customized) for the animal sound of the animal sound source in the space where the sound device 100 passed through by statistically processing the generated animal sound pattern distribution information It shows an embodiment of determining n animal sound pattern information corresponding to a sound pattern and storing it in a new/updated storage area in a designated storage area. Various implementation methods (eg, implementation methods in which some steps are omitted or the order is changed) for the process of optimizing (or customizing) the animal sound pattern may be inferred by reference and/or modification, but the present invention It is made including all the implementation methods that are, and the technical characteristics are not limited only to the implementation method shown in this Figure 5. On the other hand, the process illustrated and described in this Figure 5 is provided through the sound device 100, provided through the operation server 200, or provided in a distributed form through interworking between the sound device 100 and the operation server 200. It is possible, and for convenience, the features of the present invention will be described in Figure 5 focusing on the process provided through the sound device 100.

Referring to the embodiment of FIG. 5, the sound device 100 effectively recognizes animal sounds by using N pieces of animal sound pattern information pre-stored in a designated storage area, and then the animal sound patterns used to effectively recognize the animal sounds. Information is stored and managed in a designated storage area (500).

If j (j≥2) pieces of animal sound frequency band information used to effectively recognize animal sounds for a specified period of time are stored in the storage area (505), the sound apparatus 100 is valid at least j times for a specified period of time. Animal sound pattern distribution information corresponding to the recognized animal sound pattern distribution is generated (510), the generated animal sound pattern distribution information is statistically processed, and the animal of the animal sound source in the space where the sound device 100 passes through After determining (515) n pieces of animal sound pattern information corresponding to n (1≤n≤N) animal sound patterns optimized (or customized) for sound, the determined n animal sound patterns are to be read first. is set to new/updated storage in the designated storage area (520), and then the sound device 100 can recognize animal sounds using the stored n animal sound pattern information.

6 illustrates an embodiment of activating a service related to animal sounds by recognizing animal sounds and utterances in conjunction with each other according to another embodiment of the present invention.

In more detail, FIG. 6 shows that when the contents of the user's speech are recognized during or after the animal sounds are recognized, the recognized contents of the user's speech are interpreted in association with s number of service functions related to animal sounds, and the recognition This shows an embodiment of activating a service related to the sound of an animal, and those with ordinary knowledge in the art to which the present invention belongs may refer to and / or modify this figure 6 to recognize the animal sound or activate the service. Various implementation methods (eg, implementation methods in which some steps are omitted or the order is changed) may be inferred, but the present invention includes all implementation methods inferred above, and the implementation shown in FIG. The technical characteristics are not limited only by the method. On the other hand, the process shown and described in this Figure 6 is provided through the sound device 100, provided through the operation server 200, or provided in a distributed form through interworking between the sound device 100 and the operation server 200. It is possible, and for convenience, this Figure 6 will explain the features of the present invention mainly on the process provided through the sound device 100.

Referring to the embodiment of FIG. 6, the sound apparatus 100 reads sound data buffered in a designated buffer area, recognizes a user's language utterance, processes it in natural language, and recognizes speech content information corresponding to the user's speech content. is performed (600). If the user's speech content is not recognized, the sound device 100 checks whether the user's speech content is not validly recognized for a specified period of time or longer (605). If the content of the user's utterance is not validly recognized for a specified period of time or longer, the sound device 100 may set the operation mode of the sound device 100 to a sleep mode (610).

Meanwhile, when the user's utterance is recognized by reading the sound data, the sound device 100 determines whether the operation mode of the sound device 100 is a sleep mode (615). If in the sleep mode, it is preferable to perform a process of waking up by recognizing animal sounds.

On the other hand, if the operation mode of the sound device 100 is not the sleep mode at the time when the user's speech content is recognized (eg, while the user's speech content is being recognized or an animal sound is recognized before a certain time, the sound device 100 When the sleep mode wakes up), the sound device 100 confirms that the content of the user's speech is recognized while the animal sound is being recognized, and/or the user's speech is heard within a certain time after the end of the recognition of the animal sound. It is checked whether the contents are recognized (620). If the content of the user's speech is not recognized within a certain period of time during or after the animal sound is recognized, it is preferable that the sound device 100 checks whether it is in a sleep mode or wakes up by recognizing the animal sound. do.

On the other hand, when the user's speech content is recognized within a certain time during or after the animal sound is recognized, the sound device 100 associates the recognized user's speech content with s service functions related to the animal sound and interprets the (625), based on this, a specific service function related to the specific sound and corresponding to the recognized user's utterance can be activated (630), and the activated specific service function is designated as The provided procedure may be performed according to the procedure (635).

100: sound device 105: sound module
105a: sound input unit 105b: sound output unit
110: camera module 110a: camera unit
115: power module 120: communication module
120a: wireless network communication unit 120b: local area network communication unit
125: short-range module 125a: short-range wireless unit
130: control module 130a: control unit
130b: memory unit 135: information storage unit
140: sound processing unit 145: animal sound recognition unit
150: service control unit 155: distribution generation unit
160: information determination unit 165: speech content recognition unit
170: situation judgment unit 175: intelligence processing unit
180: service provider 185: camera device
200: operation server 205: sound receiver

Claims (23)

A sound module including a sound input unit for receiving a sound signal and a sound output unit for outputting a sound signal, a communication module including at least one communication unit connected to a communication network, a short range camera device, and a short range module for processing short range wireless communication and a subject In the sound device having a camera module for obtaining image information photographed,
a sound processing unit which buffers sound data corresponding to the sound signal of the audible frequency band input through the sound input unit in a designated buffer area or checks the sound data buffered in the designated buffer area;
The buffered sound data is read to correspond to an animal sound frequency band of at least one animal sound generating source designated for recognizing at least one animal sound designated for determining a specific situation among nonverbal sounds or noises that may be generated in a designated space, and the animal an animal sound recognizing unit that recognizes an animal sound unique to the animal sound generator corresponding to the animal sound pattern of the sound generator; and
When the animal sounds are recognized, at least s (1≤s≤S) service functions related to the animal sounds among the designated S (S≥1) service functions and any one or more of the short-distance module, communication module, and camera module A control module including a service control unit for activating an image service function for photographing an animal sound generating source that generates the recognized animal sound through the camera device using the module,
The control module,
Information for storing M animal sound frequency band information corresponding to M (M≥1) animal sound frequency bands and N animal sound pattern information corresponding to N (N≥1) animal sound patterns in a designated storage area wealth;
Using the M pieces of animal sound frequency band information, animal sound frequency distribution information corresponding to animal sound frequency distributions that have been effectively recognized at least i (i≥2) times during a specified period of time is generated, and the N animal sound pattern information is generated. a distribution generating unit generating animal sound pattern distribution information corresponding to animal sound pattern distributions that have been validly recognized at least j (j≥2) times during a specified period of time using the information;
Corresponding to m (1≤m≤M) animal sound frequency bands optimized (or customized) for the animal sound of the animal sound source in the space where the sound device is installed by statistically processing the generated animal sound frequency distribution information m animal sound frequency band information is determined, and the generated animal sound pattern distribution information is statistically processed so that n (1≤n) optimized (or customized) for the animal sound of the animal sound source in the space where the sound device passes through an information determination unit for determining n pieces of animal sound pattern information corresponding to ≤N) number of animal sound patterns;
an utterance content recognition unit that reads the buffered sound data, recognizes a user's language utterance, and recognizes utterance content information corresponding to the user's utterance content by natural language processing;
a recognition determiner for determining whether the user's speech content is recognized while the animal sound is being recognized or whether the user's speech content is recognized within a predetermined time after the end of the recognition of the animal sound;
If the user's speech content is recognized within a certain period of time during or after the animal sound is recognized, an intelligent processing unit for interpreting the recognized user's speech content by associating it with s service functions related to the animal sound; and
The animal sound recognizing sound device further comprising a; service provider providing a service corresponding to the activated service function.
The method of claim 1, wherein the animal sound,
animal cries,
animal barking,
An animal sound recognition sound device comprising at least one of animal inaudible region sounds.
delete delete delete delete delete The method of claim 1, wherein the animal sound recognition unit,
and a function of reading the buffered sound data and recognizing an animal sound corresponding to at least one animal sound frequency band among the M animal sound frequency bands and corresponding to at least one animal sound pattern among the N animal sound patterns. Animal sound recognition sound device, characterized in that made by.
delete According to claim 1,
The information storage unit further includes a function of setting the determined m animal sound frequency bands as animal sound frequency bands to be read first and storing new or updated data;
The animal sound recognizing unit includes a function of first recognizing an animal sound corresponding to at least one animal sound frequency band among the stored m animal sound frequency bands by reading the buffered sound data. recognition sound device.
delete According to claim 1,
The information storage unit further includes a function of setting the determined n animal sound patterns as animal sound patterns to be read first and storing new or updated data;
The animal sound recognizing unit includes a function of first recognizing an animal sound corresponding to at least one animal sound pattern among the stored n animal sound patterns by reading the buffered sound data. Device.
delete The method of claim 1, wherein the service control unit,
The animal sound recognition sound device comprising a function of activating a specific service function related to the animal sound and corresponding to the recognized user's utterance.
The method of claim 1, wherein the s number of services,
A server linkage service provided in conjunction with an operation server on a communication network through the communication module;
A sound-based service provided through the sound module;
An animal sound recognizing sound device comprising at least one service among complex services provided by combining the sound module and the communication module.
The method of claim 15, wherein the server interworking service,
Call service using wireless terminal information;
Situation notification service using wireless terminal information;
A call service using an app installed on a wireless terminal;
A situation notification service using an app installed on a wireless terminal,
A video service that provides video information captured by at least one camera to an app installed on a wireless terminal;
A sound device for recognizing animal sounds, characterized in that it includes at least one service among video services for providing video information captured by at least one camera to a designated IPTV device.
The method of claim 15, wherein the sound-based service,
An animal sound recognition sound device comprising a noise output service for outputting a designated service sound at a designated signal output strength through a sound output unit of a sound module.
The method of claim 17, wherein the signal output strength,
An animal sound recognition sound device comprising a signal intensity inversely proportional to the signal input intensity of the animal sound.
The method of claim 15, wherein the complex service,
A service provided through an operating server on a communication network based on the result of recognizing the user's speech content within a certain time during or after the animal sound is recognized and associating the user's speech content with a service function related to the animal sound and interpreting the result An animal sound recognition sound device comprising a.
delete delete delete delete

Images