KR20210079479A - Method for Providing Augmented Reality by Pet's Emotional Sate using Pet's Peripheral Region - Google Patents

Abstract

An object of the present invention is to automatically grasp various real-time information related to the current state of a pet. The present invention relates to a method for providing augmented reality by pet's emotional sate using an area around the pet. A method for enhancing the emotional state of a pet using a pet's peripheral region according to an embodiment of the present invention comprises: a first step of registering and storing virtual object matching information in an operation D/B; a second step of storing and managing audio data; a third step of recognizing pet expression recognition information; a fourth step of determining a pet emotion item; a fifth step of calculating a pet emotional state value; a sixth step of generating pet emotional state information; a seventh step of checking virtual object data; an eighth step corresponding to the pet emotional state information; and a ninth step of providing transmission data to an app of the wireless terminal of a user or an IPTV.

Description

Method for Providing Augmented Reality by Pet's Emotional Sate using Pet's Peripheral Region}

The present invention provides one or more data obtained through the camera device when transmitting data including video data of a specific pet in the base is provided to an app or IPTV of a designated user wireless terminal through a camera device provided at a designated base Based on the generation of pet emotional state information for each specified emotional item for the specific pet, and corresponding to the pet emotional state information for each of the generated emotional items in the area around the face of the pet on the video data of the transmission data, The virtual object data is superimposed and displayed so that the area around the pet's face is augmented to correspond to the pet emotional state information for each emotion item and provided.

Conventionally, a device for remotely observing a pet in a designated place using a camera has been proposed (Utility Model Registration Publication No. 20-0208356 (December 15, 2000)).

On the other hand, the conventional pet observing device simply provides a function of providing an image of a photographed pet, so it is technically difficult to automatically identify and provide various real-time information related to the current state of the pet in addition to the image of the pet. has a problem.

It is an object of the present invention to solve the above problems, matching relationship information between pattern information of a recognition target designated to be recognized to determine the emotional state of a pet, and each pet emotion item, and pattern information of the designated recognition target The emotional state identification information for each designated recognition target, including the numerical correlation information of the correlation between the and each pet emotional item, is registered and stored in the designated operation D/B, and the area around the face of the pet is stored as the emotional state Registers and stores R (R≥2) virtual object data for augmentation in response to the operation D/B, and collects virtual object matching information that matches pet emotional state information for each designated emotion item and one or more designated virtual object data. After registration and storage in the operation D/B, the acquired data including the video data obtained by photographing a specific pet in the base through the camera module of the camera device is received and stored in a specific storage area of a designated storage medium, Recognizes recognition information of a designated recognition target for determining the emotion of a pet by reading at least one data included in the acquired data, and based on the emotion state determination information for each designated recognition object, the recognized recognition information and preset Check the pattern information of the specified recognition target matched above the standard similarity, determine one or more pet emotion items having a matching relationship with the identified pattern information, and based on the matching ratio between the recognition information of the recognition target and the pattern information By reading the correlation numerical relationship between the pattern information and the pet emotion item, the pet emotion state value for each emotion item is calculated by digitizing the pet emotion state for each at least one emotion item corresponding to the recognition information, and the calculated one or more Generates pet emotional state information for each designated emotion item using the pet emotional state information, and checks virtual object data matching the pet emotional state information for each emotion item generated based on the virtual object matching information and superimposed on the area around the pet's face on the video data The application of the user wireless terminal to transmit data including video data augmented to correspond to the pet emotional state information for each emotional item, and to augment the area around the pet's face to correspond to the pet emotional state information for each emotional item Another object of the present invention is to provide a method for enhancing the emotional state of a pet using the area around the pet provided by the IPTV.

In the method for enhancing the emotional state of a pet using a region around the pet according to the present invention, the method is executed through an operation server that includes a sound input unit and a camera module and communicates with a camera device provided at a designated base. Among the F (F≥2) feature points existing in the facial region, E (E≥2) pet expression pattern information corresponding to the geometric relationship between the feature points related to the pet's emotional expression and designated N (N≥2) pets Among the animal emotion items, matching relationship information between N1 (1≤N1≤N) pet emotion items that can be distinguished based on pet expression patterns, and correlation between the E pet expression pattern information and N1 pet emotion items R (R ≥) to register and store expression-based emotional state identification information including numerical relationship information in the operation D/B, and to augment the area around the pet's face to correspond to the pet's emotional state. 2) First to register and store virtual object data in operation D/B, and register and store virtual object matching information that matches pet emotional state information for each specified emotion item with one or more specified virtual object data in operation D/B and receiving video data encoded in a designated manner by photographing a specific pet in the base through the camera module of the camera device and audio data encoded in a designated manner input through the sound input unit of the camera device, and receiving a designated storage medium The second step of linked storage and management in a specific storage area of , and reading the designated video data to recognize f (1≤f≤F) feature points for the facial region of a specific pet in the base, among the recognized f feature points A third step of recognizing i (i≥1) pet expression recognition information corresponding to the geometric relationship between feature points related to the emotional expression of the pet and the recognized i pets based on the expression-based emotional state determination information Check the facial expression recognition information and e (1≤e≤E) pet expression pattern information that is matched with or more than a preset standard similarity, and the e number of pet expression pattern information Based on the fourth step of determining n1 (1≤n1≤N1) pet emotion items having a matching relationship with the matching ratio between the recognized i pet expression recognition information and the e pet expression pattern information By reading the numerical relationship of correlation between the e pet expression pattern information and n1 pet emotion items, n1 pieces of n1 pet emotional states corresponding to the recognized i pet expression recognition information are numerically quantified. The fifth step of calculating the pet emotional state value for each emotion item and the pet emotional state information for each n (1≤n≤N) specified emotion item using the calculated pet emotional state value for each n1 emotion item A sixth step of generating and a seventh step of confirming r (1≤r≤R) virtual object data matching the pet emotional state information for each of the n emotion items generated based on the virtual object matching information; q (1≤q≤r) virtual object data that can be displayed overlapped in the area around the animal's face is displayed overlaid on the area around the pet's face on the video data, so that the area around the pet's face is expressed as a pet emotion for each of the n emotion items An eighth step of augmenting to correspond to the state information and a ninth step of providing transmission data including video data augmented to correspond to the pet emotional state information for each of the n emotion items to an app or IPTV of a user wireless terminal characterized in that

In the method for enhancing the emotional state of a pet using the area around the pet according to the present invention, the E pieces of pet expression pattern information is a geometry between each feature point corresponding to each pet expression pattern related to the pet's emotional expression. It is characterized in that it includes information about the scope of the relationship.

In the method for enhancing the emotional state of the pet using the area around the pet according to the person, the geometric relationship between the feature points includes a distance relationship between each feature point, an angular relationship between each feature point, and a combination relationship of a distance relationship and an angular relationship between each feature point. It is characterized in that it comprises one or more relationships.

In the method for augmenting the emotional state of a pet using the area around the pet according to the person, the expression-based correlation numerical relationship information includes: pet expression recognition information recognizing a pet's expression and pre-registered pet expression pattern information The correlation calculated through a relational expression proportional to the matching ratio between the two is also characterized in that it includes numerical information.

In the method for augmenting the emotional state of a pet using the area around the pet according to the person, the expression-based correlation numerical relationship information includes: pet expression recognition information recognizing a pet's expression and pre-registered pet expression pattern information It is characterized in that the correlation between each matching ratio section includes numerical information.

In the method for enhancing the emotional state of a pet using an area around the pet according to a person, the second step is to receive the moving picture data including the video data and the audio data from the camera device in a specific storage area of a designated storage medium. It is characterized in that it comprises the step of storage and management in the.

In the method for enhancing the emotional state of a pet using an area around the pet according to a person, the second step is to receive the video data and the audio data from the camera device, respectively, and store and manage them in a specific storage area of a designated storage medium. It is characterized in that it comprises a step.

In the method for enhancing the emotional state of a pet using an area around the pet according to a person, the second step is to synchronize the time of the video data and the audio data received from the camera device to a specific storage area of a designated storage medium. It characterized in that it further comprises the step of storing.

In the method for enhancing the emotional state of a pet using an area around the pet according to a person, the transmission data may further include audio data stored in a specific storage area of the storage medium.

In the method for enhancing the emotional state of a pet using an area around the pet according to a person, the designated video data includes at least one of video data periodically selected for each designated playback time unit and video data periodically selected for each designated number of playback frames. It is characterized in that it comprises one piece of video data.

In the method for enhancing the emotional state of a pet using an area around the pet according to a person, the step of checking whether transmission data including video data stored in a specific storage area of the storage medium is provided by an app or an IPTV of a designated user wireless terminal Further comprising, wherein the third step, when providing transmission data including video data to the app or IPTV of the specified user wireless terminal, reading the specified video data among the video data of the transmission data to a specific pet in the base Recognizing the f feature points for the facial region of the animal and recognizing the i pet expression recognition information corresponding to the geometric relationship between the feature points related to the emotional expression of the pet among the recognized f feature points do it with

In the method for enhancing the emotional state of a pet using an area around the pet according to the person, the third step is to read the specified video data from among the video data stored in the specific storage area of the specified storage medium, and Comprising the step of recognizing the f feature points for the facial region while recognizing the i pet expression recognition information corresponding to the geometric relationship between the feature points related to the emotional expression of the pet among the recognized f feature points, the sixth step is, characterized in that it further comprises the step of storing the pet emotional state information for each of the generated n emotion items in association with the video data.

In the method for enhancing the emotional state of a pet using a region around the pet according to a person, the sixth step is a time for synchronizing the pet emotional state information for each of the n emotion items generated with a designated playback time point of the video data. and storing in association with the value (or timestamp).

In the method for enhancing the emotional state of a pet using a region around the pet according to a person, the first step includes C (C≥2) animal sound pattern information related to the emotional expression of the pet among the animal sound patterns of the pet. and matching relationship information between N2 (1≤N2≤N) pet emotion items that can be distinguished based on animal sound patterns among the N designated pet emotion items, and the C animal sound pattern information and N2 pet emotion items Further comprising the step of registering and storing animal sound-based emotional state determination information including numerical relationship information based on animal sound-based correlations obtained by quantifying the degree of correlation between the two in operation D/B, wherein the third step is linked with the video data The method further includes the step of recognizing j (j≥1) animal sound recognition information for the specific pet by reading the audio data of a predetermined section, wherein the fourth step includes the animal sound-based emotional state determination information Based on the recognition information of the j recognized animal sounds, c (1≤c≤C) animal sound pattern information that is matched with or greater than a preset standard similarity is identified, and has a matching relationship with the identified c animal sound pattern information. The method further includes determining n2 (1≤n2≤N2) pet emotion items, wherein the fifth step is based on a matching ratio between the recognized j number of animal sound recognition information and the c number of animal sound pattern information. n2 emotions obtained by digitizing the pet emotional state for each n2 emotion items corresponding to the recognized j number of animal sound recognition information by reading the correlation numerical relationship between the c animal sound pattern information and n2 pet emotion items The method further includes calculating a pet emotional state value for each item, wherein the sixth step includes additionally using the calculated pet emotional state value for each of the n2 emotional items to provide pet emotional state information for each of the n emotion items specified. It is characterized in that it further comprises the step of generating.

In the method for enhancing the emotional state of a pet using the area around the pet according to the person, the C animal sound pattern information includes information on the range of animal sound features constituting each animal sound pattern related to the pet's emotional expression. It is characterized in that it comprises.

In the method for enhancing the emotional state of a pet using a region around the pet according to a person, the animal sound feature includes a frequency band feature, a frequency band feature arrangement relationship feature, a periodicity feature of a frequency band feature, a sound intensity feature, and a sound intensity At least one characteristic of an arrangement relational characteristic of a characteristic, a periodicity characteristic of a loudness characteristic, a combination characteristic of a frequency band characteristic and a loudness characteristic, an arrangement relation characteristic of a frequency band characteristic and a loudness characteristic, and a periodicity characteristic of a frequency band characteristic and a loudness characteristic It is characterized in that it comprises a.

In the method for enhancing the emotional state of a pet using the area around the pet according to the person, the animal sound-based correlation numerical relationship information includes: animal sound recognition information recognizing an animal sound of a pet and previously registered animal sound pattern information The correlation calculated through a relational expression proportional to the matching ratio between the two is also characterized in that it includes numerical information.

In the method for enhancing the emotional state of a pet using the area around the pet according to the person, the animal sound-based correlation numerical relationship information includes: animal sound recognition information recognizing an animal sound of a pet and previously registered animal sound pattern information It is characterized in that the correlation between each matching ratio section includes numerical information.

In the method for enhancing the emotional state of a pet using an area around the pet according to a person, the first step comprises: a designated designation related to the emotional expression of the pet among sensing data sensed through a sensor module provided in or linked to the camera device. N3 (1≤N3≤N) pets that can be distinguished based on S (S≥2) sensing value pattern information for the sensing data of the sensing target and the sensing value pattern of the specified sensing target among the N specified pet emotion items Sensing-based emotional state determination information including matching relationship information between emotion items and sensing-based correlation numerical relationship information that quantifies the correlation between the S sensed value pattern information and N3 pet emotion items to the operation D/B The method further includes registering and storing, wherein the second step is to receive sensing data sensed through a sensor module provided in or linked to the camera device and store and manage the data in a specific storage area of a designated storage medium in association with the video data. The third step is to read the sensing data associated with the video data, and k (k≥1) sensing values for the sensing data of the specified sensing target associated with the emotional expression of the specific pet. Further comprising the step of recognizing recognition information, wherein the fourth step, based on the sensing-based emotional state determination information, the recognition information of the k sensed values and matching s (1 ≤ s ≤ a preset reference similarity or more) Further comprising the step of checking S) pieces of sensing value pattern information and determining n3 (1≤n3≤N3) pet emotion items having a matching relationship with the identified s pieces of sensing value pattern information, the fifth step is, based on the matching ratio between the recognized k sensed value recognition information and the s sensed value pattern information, by reading the correlation numerical relationship between the s sensed value pattern information and n3 pet emotion items, the recognized Further comprising the step of calculating the pet emotional state value for each n3 emotion items that digitize the pet emotional state for each n3 emotion items corresponding to the k sensed value recognition information and, the sixth step may further include generating pet emotional state information for each of the n designated emotion items by additionally using the calculated pet emotional state values for each of the n3 emotion items.

In the method for enhancing the emotional state of a pet using an area around the pet according to a person, the sensor module comprises: a wearable sensor module for sensing a designated sensing target by wearing it on the body of the pet; a pet using a designated electromagnetic wave and at least one sensor module among radar sensor modules for sensing a designated sensing target of an animal.

In the method for enhancing the emotional state of a pet using an area around the pet according to the person, the sensing target includes at least one of a pet's heartbeat, a pet's body temperature, a pet's ambient humidity, and whether the pet is apnea It is characterized in that it is done.

In the method for enhancing the emotional state of a pet using an area around the pet according to a person, the S sensed value pattern information configures each sensing value pattern for sensing data of a designated sensing target related to the pet's emotional expression It is characterized in that it comprises the range information of the sensing value characteristic.

In the method for enhancing the emotional state of a pet using an area around the pet according to a person, the sensed value feature includes: a change rule feature of a sensed value, a change amount feature of a sensed value, a sensed value change rate feature, and periodicity feature of a change in a sensed value It is characterized in that it comprises at least one or a combination of two or more.

In the method for enhancing the emotional state of a pet using an area around the pet according to a person, the sensing-based correlation numerical relationship information includes: sensing value recognition information recognized through sensing data of a specified sensing target and a pre-registered sensing value pattern The correlation calculated through a relational expression proportional to the matching ratio between information is also characterized in that it includes numerical information.

In the method for enhancing the emotional state of a pet using a region around the pet according to a person, the sensing-based correlation numerical relationship information includes: sensing value recognition information recognized through sensing data of a specified sensing target and a pre-registered sensing value pattern It is characterized in that the correlation between the information for each matching ratio section also includes numerical information.

In the method for augmenting the emotional state of a pet using the area around the pet according to the person, the pet emotional state information for each n emotional items includes n emotional item information and numerical information of the pet emotional state for each emotional item. It is characterized in that it comprises.

In the method for enhancing the emotional state of a pet using a region around the pet according to a person, the q virtual object data is a sentence expressing the emotional state of the pet corresponding to the pet emotional state information for each of the n emotional items It is characterized in that it includes virtual object data that displays the column in the form of a speech bubble in the area around the pet's face.

In the method for enhancing the emotional state of a pet using an area around the pet according to the person, the method further comprising the step of recognizing an orientation direction of the pet's face on the video data, wherein the eighth step is the orientation of the pet's face and superimposing and displaying the q virtual object data on the area around the pet's face corresponding to the direction.

According to the present invention, when transmitting data including video data of a specific pet in the base is provided to an app or IPTV of a designated user wireless terminal through a camera device provided at a designated base, one acquired through the camera device Based on the above data, pet emotional state information for each specified emotional item for the specific pet is generated, and pet emotional state information for each of the generated emotional items is generated in the area around the face of the pet on the video data of the transmission data. By superimposing corresponding virtual object data and providing the area around the pet's face to correspond to the pet emotional state information for each emotion item, the user watching the transmission data through the app or IPTV of the wireless terminal is the In addition to viewing the video screen of the pet corresponding to the video data of the transmission data and listening to the sound of the pet corresponding to the audio data of the transmission data, through the virtual object data superimposed on the area around the pet's face on the video data It has the advantage of intuitively real-time understanding of the pet's current emotional state.

1 is a diagram showing the configuration of a system for enhancing the emotional state of a pet according to an embodiment of the present invention.
2 is a diagram illustrating an information storage/registration process according to an embodiment of the present invention.
FIG. 3 is a diagram illustrating storage and management of acquired data acquired through the camera device 190 of a designated base according to an embodiment of the present invention and stored in a designated storage medium.
4 is a diagram illustrating transmission data including video data augmented with a pet's emotional state according to the first embodiment of the present invention.
5 is a diagram illustrating transmission data including video data augmented with a pet emotional state according to a second embodiment of the present invention.
6 is a diagram illustrating transmission data including video data augmented with a pet's emotional state according to a third embodiment of the present invention.

Hereinafter, the principle of operation of the preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings and description. However, the drawings shown below and the following description are for preferred implementation methods among various methods for effectively explaining the features of the present invention, and the present invention is not limited only to the following drawings and description.

That is, the following embodiment corresponds to an embodiment of a preferred union type among numerous embodiments of the present invention, and an embodiment in which a specific configuration (or step) is omitted in the following embodiment, or a specific configuration (or step) An embodiment in which a function implemented in a function is divided into a specific configuration (or step), or an embodiment in which a function implemented in two or more configurations (or step) is integrated into any one configuration (or step), a specific configuration (or step) Embodiments in which the order of operation is replaced, and the like, are clearly stated to be within the scope of the present invention, even if not specifically mentioned in the following embodiments. Therefore, it is clearly specified that various embodiments corresponding to a subset or a complement can be divided retroactively from the filing date of the present invention based on the following examples.

In addition, in the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. And the terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to the intention or custom of the user or operator. Therefore, the definition should be made based on the content throughout the present invention.

As a result, the technical spirit of the present invention is determined by the claims, and the following examples are one means for efficiently explaining the technical spirit of the present invention to those of ordinary skill in the art to which the present invention belongs. only

1 is a diagram showing the configuration of a system for enhancing the emotional state of a pet according to an embodiment of the present invention.

In more detail, FIG. 1 shows transmission data including video data of a specific pet in the base through the camera device 190 provided at the designated base. The app of the designated user's wireless terminal 180 or IPTV 185 When provided as , based on one or more data acquired through the camera device 190, pet emotional state information for each designated emotional item for the specific pet is generated, and the area around the pet's face on the video data of the transmission data By superimposing and displaying virtual object data corresponding to the pet emotional state information for each emotion item generated, the area around the face of the pet is augmented to correspond to the pet emotional state information for each of the n emotion items. A system for providing As showing the configuration, those of ordinary skill in the art to which the present invention pertains, refer to and/or modify this figure 1 and various implementation methods for the configuration of the system (eg, some components are omitted, or subdivided or combined implementation method), but the present invention is made including all the inferred implementation methods, and the technical characteristics are not limited only to the implementation method illustrated in FIG. 1 .

In the system of the present invention, a camera device 190 provided at a designated base to photograph a subject and connectable to a communication network, and a video signal obtained by photographing a specific pet in the base through the camera module of the camera device 190 A function of receiving acquired data including video data encoded in a specified manner and storing it in a specific storage area of a specified storage medium, transmits data including video data stored in a specific storage area of the storage medium to a specified user wireless terminal ( 180), a function provided by the IPTV 185, and a function of generating pet emotional state information for each specified emotional item for the specific pet based on one or more data acquired through the camera device 190 , by superimposing virtual object data corresponding to the pet emotional state information for each emotion item generated in the area around the face of the pet on the video data, and displaying the area around the face of the pet as the pet emotional state for each of the n emotion items. It is made to include an operation server 100 that performs one or more functions of the functions augmented to correspond to information. The operation server 100 may be implemented in the form of an independent server, a combination of two or more servers, and at least one or a combination of two or more of software executed through a pre-equipped server, and implementing the operation server 100 The present invention is not limited by the embodiment or the name of the operation server 100 .

The camera device 190 is a generic term for a terminal or device provided at a designated base and equipped with a camera for photographing a subject. It may include a terminal or device having a camera for photographing a specific pet that exists.

According to the embodiment of the present invention, the camera device 190 encodes a video signal obtained through a camera module for photographing a designated subject in a base, a communication module connected to a designated communication network, and the camera module in a designated manner. and a control module for performing a procedure for generating acquired data including data and transmitting it to a designated operation server 100 through the communication module.

The camera module includes at least one lens unit receiving an optical signal reflected from a subject, an image sensor unit detecting an optical signal input through the lens unit and converting it into an electrical image signal, and automatically between the lens unit and the image sensor unit. It is made by including an actuator unit (Actuator) for implementing a specified function operation including a focus function or a zoom function. Meanwhile, according to an implementation method, the camera module may further include a filter unit including an infrared filter for photographing a subject even at night between the lens unit and the image sensor unit. Meanwhile, the camera module includes a PCB for providing the image signal generated through the image sensor unit to the control module. Meanwhile, according to an implementation method, the camera module may further include an image signal processing processor (ISP) that processes the image signal according to a specified procedure to improve the quality of the image signal generated through the image sensor unit. .

The communication module is a generic term for modules connecting to a packet-based communication network, and preferably includes at least one or both of a communication module connecting to a communication network using a wire such as a UTP cable and a communication module connecting to a communication network through a wireless LAN. may include Meanwhile, depending on the implementation method, the communication module may further (or replace) a communication module for connecting to a communication network through a mobile communication network or a separately designated wireless communication in addition to the wireless LAN, and the present invention is not limited thereto.

The control module may generate video data by encoding an image signal generated through the camera module in a specified manner. Meanwhile, according to an implementation method, the video data may be generated through the camera module and transmitted to the control module. Meanwhile, the video data may further include a time value (or timestamp) of a time point at which the image signal is captured.

The control module may perform a procedure of generating the acquired data including the video data and transmitting it to the designated operation server 100 through the communication module. Meanwhile, according to an implementation method, the acquired data may further include audio data in addition to the video data and/or may further include sensing data sensed through a designated sensor module.

According to the implementation method of the present invention, the camera device 190 further includes a sound input unit for receiving a sound signal in the base, and in this case, the control module encodes the sound signal obtained through the sound input unit in a specified manner. A procedure of generating acquired data further including audio data and transmitting it to a designated operation server 100 through the communication module may be performed.

The sound input unit is configured to include a microphone that converts air vibration into a sound signal in the form of an electrical signal, and an interface unit for interfacing it with a control module, and the control module converts the sound signal obtained through the sound input unit into a designated and specified manner. It can be encoded to generate audio data. Meanwhile, when the sound input unit is implemented in the form of a separate module according to the implementation method, the audio data may be generated through the camera module through the sound input unit and transmitted to the control module. Meanwhile, the audio data may further include a time value (or timestamp) at the time when the sound signal is input.

When the camera device 190 is provided with the sound input unit to generate audio data obtained by encoding a sound signal obtained through the sound input unit, the control module generates acquired data including the video data and audio data, A procedure of transmitting to the designated operation server 100 through the communication module may be performed.

According to an embodiment of the present invention, the acquired data may be generated in the form of moving picture data (or multimedia data) including the video data and audio data in a specified data format.

According to another embodiment of the present invention, the acquired data includes the video data and the audio data in each designated data format, but the time value (or timestamp) included in the video data and audio data is used to determine the viewpoint. It can be created in each data type that can be synchronized.

According to the embodiment of the present invention, the camera device 190 may further include a sound output unit for outputting a specified sound signal with a specified signal strength. In this case, the control module outputs the sound signal through the sound output unit according to a specified procedure. Audio data corresponding to the sound signal to be output through the sound output unit from the operation server 100 designated through the communication module and/or to generate audio data corresponding to the sound signal to be generated and/or extracted from the designated storage area and/or through the communication module A process of receiving and outputting a sound signal corresponding to the generated/extracted/received audio data through the sound output unit may be performed.

The sound output unit is configured to include a speaker for outputting a sound signal in the form of an electrical signal obtained by decoding audio data and an interface unit for interfacing the same with a control module, wherein the control module generates audio data to be output through the sound output unit, and / or extracts from a specified storage area and / or receives from the specified operation server 100 through the communication module, and receives a sound signal corresponding to the audio data through the sound output unit with a specified signal strength (eg, the camera device 190) ), the sound signal output through the speaker can be output at a signal strength set to be delivered at a specified sound level to pets spaced apart within a specified distance).

According to the implementation method of the present invention, the camera device 190 may be provided with or linked to a sensor module for sensing a specified sensing target of the pet through a specified sensor, and the control module is acquired by sensing through the sensor module. It is possible to perform a procedure of generating acquired data further including sensing data encoded in a designated manner by the detected sensing signal and transmitting it to the designated operation server 100 through the communication module. Preferably, the designated sensing target of the pet to be sensed through the sensor module may include at least one of the pet's heartbeat, the pet's body temperature, the pet's ambient humidity, and whether the pet is apnea.

The sensor module may include a wearable sensor module that is worn on a designated part of the pet's body to sense a designated sensing target of the pet, in this case, the control module is configured for short-distance communication (e.g., Bluetooth, etc.) ) in connection with the wearable sensor module to receive a sensing signal corresponding to a sensed value sensed through the sensor module or to receive sensing data obtained by encoding the sensing signal in a specified manner through the sensor module.

On the other hand, the sensor module may include a radar (Radar) sensor module for sensing a designated sensing target of the pet using a designated electromagnetic wave, in this case, the control module is a sensing corresponding to the sensing value sensed through the radar sensor module Signals can be identified and encoded in a specified manner to generate sensed data. Meanwhile, the radar sensor module may generate sensing data encoded in a specified manner and provide the sensing data to the control module. In this case, the control module may receive the sensing data from the radar sensor module.

According to the implementation method of the present invention, the sensed data includes a sensed value sensed by a sensing target designated through the sensor module, and preferably a time value (or timestamp) at the time when the sensed value is sensed through the sensor module. ) may be further included.

When sensing data for sensing a designated sensing target of a pet is generated by providing or linking the sensor module to the camera device 190, the control module adds the sensing data to the acquired data through the communication module It is possible to perform a procedure for transmitting to the designated operation server (100). Preferably, the sensing data may be included in the acquired data in a form included in a specified data format, and a time value (or timestamp) included in the video data and the sensing data may be generated in a data format capable of synchronizing a viewpoint. can

According to the embodiment of the present invention, the camera device 190 further includes a driving module for driving the photographing direction of the camera module within a specified angular range in up/down/left/right directions, and the control module includes the camera A process of recognizing an object corresponding to the pet (or the pet's face) or the pad on which the pet is lying may be attempted by reading the video data captured through the module. If the object is not recognized, the control module repeats the process of recognizing the object while the shooting direction of the camera module is spaced apart by a specified angular range in a specified direction through the driving module until the entire angular range is reached can do. If the object is recognized through the recognition process, the camera device 190 controls the shooting direction so that the recognized facial region of the pet exists within a designated region on the video data, and the facial region of the pet It is possible to control the photographing direction of the camera module so as to be present within a designated area on the video data by tracking the facial area of the pet in response to the movement or movement of the pet. Meanwhile, the process of controlling the shooting direction of the camera module or recognizing the object through the driving module may be executed through the server, and the present invention is not limited thereto.

According to the implementation method of the present invention, the camera device 190 may further include a projector unit for projecting a specified shape or image through a lamp on the ceiling or wall, in this case, the control module is the projector unit The lamp may be turned on/off, or the control module may receive control information for turning on/off the lamp of the projector unit from the designated operation server 100 through the communication module, and transmit the control information. Based on this, it is possible to turn on/off the lamp of the projector unit. On the other hand, when a shape or image to be projected by selecting any one of a plurality of films through the projector unit can be selected, the control module selects a film of the projector unit and/or turns on/off the lamp according to a specified procedure. Alternatively, the control module may receive control information for selecting the film of the projector unit and/or turning on/off the lamp from the designated operation server 100 through the communication module, and receiving the control information It is possible to select a film of the projector unit and/or to turn on/off the lamp on the basis. On the other hand, if it is possible to project an electronic shape or an electronic image through the projector unit, the control module extracts the electronic shape or electronic image stored in a designated storage area according to a specified procedure and processes it as a shape or image to be projected through the projector unit, and / Alternatively, the lamp may be turned on/off, or the control module receives the electronic shape or electronic image stored from the designated operation server 100 through the communication module and/or control information for turning the lamp on/off and may process the received electronic shape or electronic image as a shape or image to be projected through the projector unit and/or turn on/off the lamp based on the control information.

The user wireless terminal 180 is a generic term for a wireless communication device used by a user to receive transmission data including video data captured through the camera device 190, and is a mobile phone, a smartphone, and a tablet PC used by the user. It may include various wireless communication devices, such as.

According to the embodiment of the present invention, the user wireless terminal 180 registers information specified in the operation server 100, and includes video data captured from the operation server 100 through the camera device 190 An application is installed and executed to receive transmission data. Hereinafter, even if there is no separate mention, the description of the function implemented by using the user wireless terminal 180 as a subject or object is to clarify that the function is implemented through the app.

The operation server 100 is a generic name of a server capable of communicating with the camera device 190 provided at the designated base and communicating with the app of the user wireless terminal 180 that has installed and executed the designated app, and is the camera of the camera device 190 . A function of photographing a specific pet in the base through a module, receiving acquired data including video data encoded in a specified manner and storing it in a specific storage area of a specified storage medium, video data stored in a specific storage area of the storage medium At least one of the functions of providing transmission data including to the app of the designated user wireless terminal 180 or the IPTV 185, and one or more data acquired through the camera device 190 according to the present invention A function of generating pet emotional state information for each specified emotional item for the specific pet based on At least one of the functions of augmenting the area around the pet's face to correspond to the pet's emotional state information for each of the n emotion items by superimposing and displaying virtual object data is performed.

According to an embodiment of the present invention, the transmission data includes, in addition to video data stored in a specific storage area of the storage medium, audio data stored in a specific storage area of the storage medium in association with the video data, or the video data It may further include audio data of video data.

Referring to Figure 1, the operation server 100, the pattern information of the recognition target designated to be recognized to determine the emotional state of the pet, matching relationship information between each pet emotion item, and pattern information of the designated recognition target and an information management unit 105 that registers, stores, and manages emotional state determination information for each designated recognition target, including numerical correlation information obtained by quantifying the degree of correlation between each pet emotion item, in a designated operation D/B.

The information management unit 105 includes E (E≥2) pet expression pattern information corresponding to the geometric relationship between the feature points related to the emotional expression of the pet among F (F≥2) feature points existing in the facial region of the pet. and matching relationship information between N1 (1≤N1≤N) pet emotion items that can be distinguished based on a pet expression pattern among the specified N (N≥2) pet emotion items, and the E pet expression items Expression-based correlation, which quantifies the correlation between pattern information and N1 pet emotional items, is registered and stored in the designated operation D/B.

According to the implementation method of the present invention, the information management unit 105 corresponds to the geometric relationship between the characteristic points related to the emotional expression of the pet among the F characteristic points existing in the facial region of the pet from the designated operating terminal E facial expressions of the pet. Receive pattern information registration, and receive matching relationship information matching the E pet expression pattern information with N1 pet emotion items that can be distinguished based on a pet expression pattern among the designated N pet emotion items, and the E It is possible to register and store the facial expression-based correlation numerical relation information obtained by quantifying the correlation between the pet expression pattern information and the N1 pet emotion items of dogs, and register and store the information in the designated operation D/B. For example, the information management unit 105 includes the E pieces of pet expression pattern information and N1 pieces of pet emotion items as row or column titles, and stores the expression-based correlation numerical relationship information into cells ( Cell) information can be registered and stored in the designated operation D/B for expression-based emotional state determination information in the form of a table.

According to the embodiment of the present invention, the N pet emotion items are 'joy (喜)', 'anger (怒)', 'sad (哀)', 'pleasure (樂)', 'love (愛)' One or more of the basic emotions such as 'hate', 'greed', etc. (e.g., 'joy', 'anger', 'sad', ' It may include an emotion item corresponding to pleasure, etc.), and in addition to the basic emotion, various emotions assumed to be felt by the pet (eg, 'irritability', 'loneliness', 'stupid', 'discomfort', 'fear') ', etc.), and/or an emotion in which at least one of the basic emotions is embodied according to the pet's situation (eg, 'drowsiness' corresponding to sleep desire among 'greed' or ' corresponding to appetite) It may further include an emotion item corresponding to 'hunger', etc.).

According to an embodiment of the present invention, the E pieces of pet expression pattern information may include geometric relationship information between each feature point corresponding to each pet expression pattern associated with the pet's emotional expression. Preferably, the geometric relationship between the feature points may include at least one of a distance relationship between each feature point, an angular relationship between each feature point, and a combination relationship between a distance relationship between each feature point and an angular relationship. For example, the geometric relationship information between the feature points may include at least one of a distance value between each feature point based on a specified reference feature point distance value, an angle value between each feature point, and a combination of a distance value between each feature point and an angle value. can

Meanwhile, according to another embodiment of the present invention, the E pieces of pet expression pattern information may include range information of a geometric relationship between each feature point corresponding to each pet expression pattern related to the emotional expression of the pet. Preferably, the geometric relationship between the feature points may include at least one of a distance relationship between each feature point, an angular relationship between each feature point, and a combination relationship between a distance relationship between each feature point and an angular relationship. For example, the range information of the geometric relationship between the feature points may include a numerical range of distances between feature points based on a numerical value of distances between specified reference feature points, a numerical range of angles between each feature, and a combination of a numerical range of distances between feature points and an angular numerical range It may include more than one numerical range.

According to an embodiment of the present invention, the expression-based correlation numerical relationship information is calculated through a relational expression proportional to the matching ratio between the pet expression recognition information that recognizes the pet's expression and the registered pet expression pattern information. The correlation may also include numerical information. For example, the facial expression-based correlation numerical relationship information may be calculated as smaller numerical information as the matching ratio between the pet expression recognition information and the registered pet expression pattern information is smaller, and the larger the matching ratio, the greater the numerical information can be calculated as

Meanwhile, according to another embodiment of the present invention, the facial expression-based correlation numerical relationship information is a correlation diagram for each matching ratio section between the pet facial expression recognition information that recognizes the pet's facial expression and the registered pet facial expression pattern information. Numerical information may be included. For example, the facial expression-based correlation numerical relationship information may be calculated as '0' or numerical information of a specified minimum value when the matching ratio between the pet facial expression recognition information and the registered pet facial expression pattern information is a preset minimum ratio section. In addition, when the matching ratio is a preset maximum ratio section, it may be calculated as numerical information of a designated maximum value.

On the other hand, according to the implementation method of the present invention, after the expression-based emotional state determination information is registered and stored in the operation D/B through a designated operation terminal, the pet expression recognition information specified through the following information recognition unit 140 is recognized. In this case, the information management unit 105 reads the video data received from the camera device 190 and stored in a specific storage area of a designated storage medium after the pet expression recognition information is recognized to correspond to the pet's guardian. At the same time as an object is recognized, audio data associated with the video data is read, and among the voices uttered by the pet guardian to the pet, voices related to pet emotion recognition (eg, 'our xx hungry', 'our xx poop') ?奐lip?', 'We xx are sleepy', etc.) can be performed. If the voice related to the pet emotion recognition of the guardian is recognized after the pet expression recognition information is recognized, the information management unit 105 patterns the recognized pet expression recognition information and at the same time recognizes the pet emotion and Identifies a voice recognition-based pet emotion item corresponding to a related voice, and learns a combination of pet expression pattern information that patterned the recognized pet expression recognition information and the identified voice recognition-based pet emotion item By repeating the process, it is possible to continuously improve the big data-based accuracy and reliability of the expression-based emotional state determination information.

Meanwhile, according to an extended embodiment of the present invention, the information management unit 105 recognizes the animal sound of the pet based on the audio data obtained through the sound input unit of the camera device 190 in addition to the expression-based emotional state determination information. To register and store animal sound-based emotional state determination information for determining the emotional state of the pet in the operation D / B, and / or to sense a designated sensing target associated with the emotional expression of the pet in the camera device 190 When a sensor module is provided or linked and sensing data obtained by sensing a designated sensing target of a pet is received from the camera device 190 through the sensor module, using the sensing data to determine the pet's emotional state It is possible to register and store sensing-based emotional state determination information for operation D/B.

Meanwhile, according to another embodiment of the present invention, the information management unit 105 operates the animal sound-based emotional state determination information and/or sensing-based emotional state determination information instead of (or replaces) the expression-based emotional state determination information. It can be registered and stored in D/B, and the present invention is not limited thereto. Hereinafter, for convenience, the present invention through an embodiment in which expression-based emotional state identification information is used as basic emotional state identification information and the animal sound-based emotional state identification information and/or sensing-based emotional state identification information is used as secondary emotional state identification information. However, the technical features of the present invention are not limited thereto, and according to the embodiments of the present invention and the description of the claims, the animal sound-based emotional state determination information and/or sensing-based emotional state determination information is also basic. It is clearly stated that it can be used as emotional state identification information.

According to an extension/other embodiment of the present invention, the information management unit 105 includes C (C≥2) animal sound pattern information related to the emotional expression of the pet among the animal sound patterns of the pet and the designated N number of pet emotions. Among the items, it includes matching relationship information between N2 (1≤N2≤N) pet emotion items that can be distinguished based on animal sound patterns, and quantifies the correlation between the C animal sound pattern information and N2 pet emotion items. It is possible to register and store animal sound-based emotional state determination information including numerical relational information on one animal sound-based correlation in operation D/B.

According to the implementation method of the present invention, the information management unit 105 receives the registration of C animal sound pattern information related to the emotional expression of the pet among the animal sound patterns of the pet from the designated operating terminal, and the C animal sound pattern information is registered with matching relationship information matching N2 pet emotion items that can be distinguished based on animal sound patterns among the N designated pet emotion items, and the correlation between the C animal sound pattern information and N2 pet emotion items It is possible to register and store the numerical relationship information in the designated operation D/B by registering the animal sound-based correlation with numerical values. For example, the information management unit 105 includes C animal sound pattern information and N2 pet emotion items as row or column titles, and converts the animal sound-based correlation numerical relationship information into cell information corresponding to each row or column. It is possible to register and store animal sound-based emotional state identification information in the operating D/B in the form of a table including

According to an embodiment of the present invention, the C animal sound pattern information may include animal sound characteristic information constituting each animal sound pattern related to the emotional expression of the pet. Preferably, the animal sound characteristic includes a frequency band characteristic, an arrangement relational characteristic of a frequency band characteristic, a periodicity characteristic of a frequency band characteristic, a sound intensity characteristic, an arrangement relational characteristic of a sound intensity characteristic, a periodicity characteristic of a sound intensity characteristic, a frequency band characteristic, and It may include one or more characteristics of a combination characteristic of a sound intensity characteristic, a characteristic of an arrangement relationship between a frequency band characteristic and a sound intensity characteristic, and a periodicity characteristic of a frequency band characteristic and a sound intensity characteristic.

Meanwhile, according to another embodiment of the present invention, the C animal sound pattern information may include information on the range of animal sound characteristics constituting each animal sound pattern related to the emotional expression of the pet. Preferably, the animal sound characteristic includes a frequency band characteristic, an arrangement relational characteristic of a frequency band characteristic, a periodicity characteristic of a frequency band characteristic, a sound intensity characteristic, an arrangement relational characteristic of a sound intensity characteristic, a periodicity characteristic of a sound intensity characteristic, a frequency band characteristic, and It may include one or more characteristics of a combination characteristic of a sound intensity characteristic, a characteristic of an arrangement relationship between a frequency band characteristic and a sound intensity characteristic, and a periodicity characteristic of a frequency band characteristic and a sound intensity characteristic. For example, the range information of the animal sound feature may include an allowable range of a frequency band for each feature and/or an allowable range of a sound intensity for each feature.

According to an embodiment of the present invention, the animal sound-based correlation numerical relationship information is calculated through a relational expression proportional to the matching ratio between animal sound recognition information that recognizes animal sounds of pets and previously registered animal sound pattern information. The correlation may also include numerical information. For example, the animal sound-based correlation numerical relationship information may be calculated as smaller numerical information as the matching ratio between animal sound recognition information and previously registered animal sound pattern information is smaller, and the larger the matching ratio, the larger the numerical information. can be calculated.

On the other hand, according to another embodiment of the present invention, the animal sound-based correlation numerical relationship information is a correlation diagram for each matching ratio section between the animal sound recognition information that recognizes the animal sound of a pet and the registered animal sound pattern information. Numerical information may be included. For example, the animal sound-based correlation numerical relationship information can be calculated as '0' or numerical information of a specified minimum value when the matching ratio between the animal sound recognition information and the registered animal sound pattern information is a preset minimum ratio section. And, when the matching ratio is a preset maximum ratio section, it may be calculated as numerical information of a designated maximum value.

Meanwhile, according to the implementation method of the present invention, after the animal sound-based emotional state determination information is registered and stored in the operation D/B through a designated operation terminal, the specified animal sound recognition information is recognized through the following information recognition unit 140 . In this case, the information management unit 105 reads video data received from the camera device 190 and stored in a specific storage area of a designated storage medium after the animal sound recognition information is recognized, and an object corresponding to the pet's guardian. At the same time as recognizing , audio data associated with the video data is read, and among the voices uttered by the pet guardian to the pet, voices related to pet emotion recognition (eg, 'our xx hungry', 'our xx poop?奐lip?', 'we xx are sleepy', etc.) can be performed. If, after the animal sound recognition information is recognized, the voice related to the pet emotion recognition of the guardian is recognized, the information management unit 105 patterns the recognized animal sound recognition information and the voice related to the pet emotion recognition. Identifies a voice recognition-based pet emotion item corresponding to , and repeats the process of learning a combination of the animal sound pattern information patterned with the recognized animal sound recognition information and the identified voice recognition-based pet emotion item By doing so, it is possible to continuously improve the big data-based accuracy and reliability of the animal sound-based emotional state determination information.

Meanwhile, according to an extension/other embodiment of the present invention, the information management unit 105 is configured to select a designated sensing target associated with the emotional expression of a pet among sensing data sensed through a sensor module provided in or linked to the camera device 190 . Between S (S≥2) sensing value pattern information for sensing data and N3 (1≤N3≤N) pet evaluation items that can be distinguished based on the sensing value pattern of the specified sensing target among the N specified pet evaluation items Registers sensing-based emotional state determination information including the sensing-based correlation numerical relationship information that includes matching relationship information of and quantifies the correlation between the S sensed value pattern information and N3 pet emotion items to the operation D/B can be saved

According to the embodiment of the present invention, the sensor module is a wearable sensor module that is worn on the body of a pet to sense a specified sensing target, and a radar that senses a specified sensing target of the pet using a specified electromagnetic wave. The sensor module may include at least one sensor module, and the designated sensing target may include at least one of a pet's heartbeat, a pet's body temperature, a pet's ambient humidity, and whether the pet is apnea.

According to the implementation method of the present invention, the information management unit 105 of the sensing data sensed through the sensor module provided in or linked to the camera device 190 from the specified operating terminal is a designated sensing target associated with the emotional expression of the pet S sensing value pattern information for sensing data is registered, and the S sensing value pattern information can be distinguished based on the sensing value pattern of the specified sensing target among the N specified pet emotion items. Between N3 pet emotion items. Matching relationship information may be registered, and sensing-based correlation numerical relationship information obtained by quantifying the correlation between the S sensed value pattern information and N3 pet emotion items may be registered and stored in a designated operation D/B. For example, the information management unit 105 includes the S sensed value pattern information and N3 pet emotion items as row or column titles, and the sensing-based correlation numerical relationship information as information on cells corresponding to each row or column. It is possible to register and store sensing-based emotional state determination information in the form of a table including the operation D/B.

According to an embodiment of the present invention, the S sensing value pattern information may include sensing value characteristic information constituting each sensing value pattern for sensing data of a designated sensing target associated with an emotional expression of a pet. Preferably, the sensed value characteristic may include at least one or a combination of two or more of a change rule characteristic of a sensed value, a characteristic of a change amount of a sensed value, a characteristic of a change rate of a sensed value, and a characteristic of a periodicity of a change of a sensed value.

Meanwhile, according to another embodiment of the present invention, the S sensed value pattern information includes information on the range of sensing value characteristics constituting each sensing value pattern for sensing data of a designated sensing target related to the emotional expression of the pet. can do. Preferably, the sensed value characteristic may include at least one or a combination of two or more of a change rule characteristic of a sensed value, a characteristic of a change amount of a sensed value, a characteristic of a change rate of a sensed value, and a characteristic of a periodicity of a change of a sensed value. For example, the range information of the sensing value feature may include an allowable range of a change rule for each feature, an allowable range of a change amount of a sensing value for each feature, and an allowable range of a sensing value change rate for each feature.

According to an embodiment of the present invention, the sensing-based correlation numerical relation information is calculated through a relational expression proportional to a matching ratio between sensing value recognition information recognized through sensing data of a specified sensing target and pre-registered sensing value pattern information The correlation may also include numerical information. For example, the sensing-based correlation numerical relationship information may be calculated as smaller numerical information as the matching ratio between the sensing value recognition information and the previously registered sensing value pattern information is smaller, and the larger the matching ratio is, the larger the numerical information is calculated. can be

Meanwhile, according to another embodiment of the present invention, the sensing-based correlation numerical relationship information is a correlation for each matching ratio section between sensing value recognition information recognized through sensing data of a specified sensing target and pre-registered sensing value pattern information. It may also include numerical information. For example, the sensing-based correlation numerical relationship information may be calculated as '0' or numerical information of a specified minimum value when the matching ratio between the sensing value recognition information and the pre-registered sensing value pattern information is a preset minimum ratio section, , when the matching ratio is a preset maximum ratio section, it may be calculated as numerical information of a specified maximum value.

On the other hand, according to the implementation method of the present invention, after the sensing-based emotional state determination information is registered and stored in the operation D/B through a designated operation terminal, when the specified sensing value recognition information is recognized through the following information recognition unit 140 , the information management unit 105 reads the video data received from the camera device 190 and stored in a specific storage area of a designated storage medium after the sensing value recognition information is recognized, and an object corresponding to the guardian of the pet. At the same time as recognition, audio data associated with the video data is read, and among the voices uttered by the pet's guardian to the pet, voices related to pet emotion recognition (eg, 'our xx hungry', 'our xx poop? Lip?', 'We xx are sleepy', etc.) can be performed. If a voice related to the pet emotion recognition of the guardian is recognized after the sensing value recognition information is recognized, the information management unit 105 patterns the recognized sensing value recognition information and at the same time a voice related to the pet emotion recognition Identify the voice recognition-based pet emotion item corresponding to , and repeat the process of learning the combination of the animal sound pattern information patterned with the recognized sensing value recognition information and the identified voice recognition-based pet emotion item By doing so, it is possible to continuously improve the big data-based accuracy and reliability of the sensing-based emotional state determination information.

Referring to FIG. 1, the operation server 100 registers and stores R (R ≥ 2) virtual object data in operation D/B for augmenting the area around the pet's face to correspond to the emotional state of the pet. The virtual object management unit 110 and the information matching unit 115 for registering and storing virtual object matching information matching the pet emotional state information for each specified emotion item and one or more specified virtual object data in the operation D/B.

The virtual object management unit 110 corresponds to the pet's emotional state to augment the area around the pet's face existing on the video data acquired through the camera module of the camera device 190, Registers and stores R virtual object data that can be displayed by being superimposed on the operation D/B. For example, the virtual object management unit 110 may receive R virtual object data that can be displayed overlaid on the area around the pet's face from a designated operation terminal and store it in the operation D/B.

According to the implementation method of the present invention, at least some of the virtual object data of the R virtual object data is a text string expressing the emotional state of the pet corresponding to the pet emotional state information for each of the n emotional items. It may include virtual object data displayed in the form of a speech bubble in the surrounding area.

The information matching unit 115 is a pet emotion for each designated emotion item generated based on at least one of the expression-based emotional state determination information, the animal sound-based emotional state determination information, and the sensing-based emotional state determination information. Virtual object matching information matching the state information with one or more virtual object data among the R virtual object data is registered and stored in the operation D/B. For example, the information matching unit 115 may receive registered virtual object matching information that matches one or more specified virtual object data with the pet emotional state information for each emotion item specified from the specified operation terminal, and register and store it in the operation D/B. have.

According to the embodiment of the present invention, the pet emotional state information for each designated emotion item generated based on at least one emotional state determination information includes numerical information on the pet emotional state for each designated emotion item, the virtual object data may be formed in a structure capable of intuitively expressing the intensity (or intensity) of emotion corresponding to numerical information on the emotional state of the pet for each designated emotion item. For example, when the virtual object data is virtual object data in the form of tear flow marks displayed overlaid on 'the lower part of both eyes of the pet' in order to enhance the emotional state of 'sadness', the virtual object data is ' According to the numerical information on the emotional state of the pet in the emotional item of 'sadness', the width, length, or color of the tear flow marks may be changed in a structure.

Referring to Figure 1, the operation server 100, a target to be provided with transmission data including video data of a specific pet in the base through the camera device 190 provided at the designated base, and the camera device It includes an information registration unit 120 for receiving the mapping information (190) and storing it in a designated management D / B.

A user who purchases or receives the camera device 190 enters subscription application information through a user terminal or a paper-type subscription application (eg, an application for combining the service using the camera device 190 and the IPTV 185 ); When the application for combining the service using the camera device 190 and the user wireless terminal 180, etc.) is written, the information registration unit 120 corresponds to the subscription application information or the subscription application through the user terminal or a designated registration terminal. User information and camera device 190 information uniquely identifying the camera device 190 provided/supplied to the user may be registered and stored in the management D/B. Meanwhile, the information registration unit 120 provides ID/PW information for providing transmission data including video data captured through the camera device 190 to the IPTV 185 used by the user through the user terminal or a designated registration terminal. can be registered and stored in the management D/B in association with the user information and/or camera device 190 information. On the other hand, according to the embodiment of the present invention, the ID / PW information is to provide transmission data including video data photographed through the camera device 190 to a wired terminal or a wireless terminal 180 used by the user through the web. may be used, and the present invention may also include such an embodiment within the scope of its rights.

On the other hand, when the user installs a designated app on the user wireless terminal 180 used by the user and operates for the first time (or before subscription), the information registration unit 120 provides information about the user from the app of the user wireless terminal 180. User information and camera device 190 information uniquely identifying the camera device 190 provided/supplied to the user may be registered and stored in the management D/B. Meanwhile, the information registration unit 120 uniquely registers the app of the user wireless terminal 180 in order to provide transmission data including video data captured through the camera device 190 as the app of the user wireless terminal 180 . It is possible to generate unique identification information to identify or receive from the app of the user wireless terminal 180 and store it in the management D/B in connection with the user information and/or camera device 190 information, and generate the unique identification information In one case, it can be provided as an app of the user wireless terminal 180 and stored in a designated storage area. Meanwhile, the information registration unit 120 is an ID/PW for providing transmission data including video data captured through the camera device 190 from the app of the user wireless terminal 180 to the IPTV 185 used by the user. Information may be registered and stored in the management D/B in association with the user information and/or camera device 190 information. On the other hand, according to the embodiment of the present invention, the ID / PW information is to provide transmission data including video data photographed through the camera device 190 to a wired terminal or a wireless terminal 180 used by the user through the web. may be used, and the present invention may also include such an embodiment within the scope of its rights.

On the other hand, according to the embodiment of the present invention, the app of the user wireless terminal 180 is unique information (eg, of the other wireless terminal 180 to receive transmission data including the video data captured through the camera device 190) , mobile phone number, etc.) can be input/registered, and in this case, the information registration unit 120 stores the unique information of the other wireless terminal 180 in the management D/B, and the unique information of the other wireless terminal 180 is stored in the management D/B. Inducing the installation of the designated app to the other wireless terminal 180 through the information and/or checking the installed and executed app in the other wireless terminal 180, and uniquely identifying the app of the other wireless terminal 180 By generating unique identification information or storing it in the management D/B in connection with the registered camera device 190 information and being provided from the app of the other wireless terminal 180, in addition to the app of the user wireless terminal 180, the Transmission data including video data captured through the camera device 190 may be provided through an app of another wireless terminal 180 that is selected through an app of the user wireless terminal 180 .

1, the operation server 100 is obtained through a communication management unit 125 that manages a communication connection with a camera device 190 provided at a designated base, and a camera module of the camera device 190, and a data receiving unit 130 for receiving acquisition data including video data encoded in a specified manner, and a data storage unit 135 for storing and managing the received acquired data in a specific storage area of a specified storage medium.

When power is input to the camera device 190 provided in the designated base, the control module of the camera device 190 communicates by exchanging one or more designated information with the designated operation server 100 through the communication module according to the designated procedure. request, and the communication management unit 125 authenticates the validity of the camera device 190 based on the exchange of the specified information, and establishes a communication connection with the camera device 190 .

When communication with the camera device 190 is connected, the communication management unit 125 dynamically generates disposable address information for receiving the acquired data acquired through the camera device 190 and provides it to the camera device 190 . In this case, the control module of the camera device 190 receives the one-time address information, sets the one-time address information as a destination address to transmit the acquired data, and then sets the acquired data to the one-time address can be sent to a destination address. Here, the one-time address information may include address information composed of dynamically generated parameter values so that the address domain information is the same but the parameter values after the domain do not overlap.

According to the embodiment of the present invention, the communication management unit 125 may periodically dynamically generate new one-time address information for the camera device 190 and provide it to the camera device 190. In this case, the camera device The control module of 190 receives the new one-time address information, interrupts the process of transmitting the acquired data to the destination address corresponding to the previous one-time address, and at the same time transmits the previous transmission information of transmitting the acquired data to the previous one-time address. After confirming, and setting the new one-time address information as a new destination address to which the acquired data is to be subsequently transmitted, the acquired data transmitted to the previous one-time address based on the previous transmission information is transferred to the new destination address corresponding to the new one-time address. It can then be transmitted, and the above process can be repeated periodically. Hereinafter, it is specified that the camera device 190 can transmit the acquired data to the one-time address even if there is no separate mention. Meanwhile, according to another embodiment of the present invention, the process of generating or applying the one-time address information of the communication management unit 125 may be omitted, and the present invention is not limited thereto.

According to the embodiment of the present invention, when the control module of the camera device 190 transmits acquired data including video data that is acquired through the camera module and encoded in a specified manner, the data receiving unit 130 is the camera module Receives acquisition data including video data obtained through and encoded in a specified manner, and the data storage unit 135 stores the video data of the received acquisition data in a specific storage area of a specified storage medium for a certain period of time. can manage

On the other hand, according to the implementation method of the present invention, the control module of the camera device 190 is obtained through the camera module and encoded in a specified manner video data and audio data obtained through the sound input unit and encoded in a specified manner. When the acquisition data is transmitted, the data receiving unit 130 receives acquired data including video data obtained through the camera module and encoded in a specified manner and audio data obtained through the sound input unit and encoded in a specified manner, and , the data storage unit 135 associates and stores the video data and audio data of the received acquired data in a specific storage area of a designated storage medium and manages it for a certain period of time.

According to the embodiment of the present invention, the control module of the camera device 190 may transmit the acquired data in the form of moving picture data including the video data and audio data, in this case, the data receiving unit 130 is the camera device. Receives the acquired data in the form of moving picture data from 190, and the data storage unit 135 stores and manages the received moving picture data in a specific storage area of a designated storage medium.

Meanwhile, according to the embodiment of the present invention, the control module of the camera device 190 may transmit the acquired data including the video data and the audio data in the form of respective data, in this case, the data receiving unit 130 Receives acquisition data including the video data and audio data from the camera device 190, respectively, and the data storage unit 135 associates the video data and audio data respectively received from the camera device 190, It can be stored and managed in a specific storage area of a designated storage medium. Preferably, the data storage unit 135 may synchronize the times of the video data and the audio data based on the time values (or timestamps) of the video data and the audio data and store them in a specific storage area of a designated storage medium. .

On the other hand, according to the embodiment of the present invention, the control module of the camera device 190 is obtained through the camera module and encoded in a specified manner, in addition to video data and/or audio data obtained through the sound input and encoded in a specified manner. , when the acquired data is sensed through a specified sensor module and further includes sensing data encoded in a specified manner, the data receiving unit 130 receives the acquired data including the sensing data, and the data storage unit 135 ) can be managed for a certain period of time by linking and storing the video data and/or audio data of the received acquired data and the sensing data in a specific storage area of a designated storage medium. Preferably, the data storage unit 135 is configured to store the video data and/or audio data based on a time value (or timestamp) of the video data and/or audio data and a time value (or timestamp) of the sensing data. The time of the sensor may be synchronized with the time of the sensed data and stored in a specific storage area of a designated storage medium.

Referring to FIG. 1, the operation server 100 reads at least one of the acquired data acquired through the camera device 190 of the designated base to determine the emotion of the pet by reading the recognition information of the designated recognition target. The information recognition unit 140 for recognizing , and the pattern information of the specified recognition target matched with the recognized recognition information based on the specified emotional state determination information and a preset reference similarity level or more, and the identified pattern information and the matching relationship An information determining unit 145 for determining one or more pet emotion items possessed, based on a matching ratio between the recognition information and the pattern information, reads the correlation numerical relationship between the pattern information and the pet emotion item, and adds it to the recognition information. An emotional state calculator 150 for calculating a pet emotional state value for each emotional item obtained by digitizing the pet emotional state for each of the corresponding one or more emotional items, and each emotion designated using the calculated one or more pet emotional state values and an information generating unit 155 for generating pet emotional state information for each item.

According to the first pet emotional state generation embodiment of the present invention, the operation server 100 includes video data stored in a specific storage area of the storage medium as an app or IPTV 185 of a designated user wireless terminal 180. At the time of providing the transmission data to be transmitted, the video data included in the transmission data and/or data associated with the video data (eg, audio data and/or sensing data, etc.) Animal emotional state information can be generated. Here, the pet emotional state information for each emotion item may include numerical information (or grade information) on the emotional state of the pet for each emotion item.

Meanwhile, according to the second pet emotional state generation embodiment of the present invention, the operation server 100 stores the acquired data received from the camera device 190 in a specific storage area of a designated storage medium, and then Based on the acquired data stored in a specific storage area, pet emotional state information for each emotion item is generated according to a specified procedure and stored in association with the acquired data. In this case, the video stored in the specific storage area of the storage medium When the data is provided to the app of the designated user wireless terminal 180 or IPTV 185 including data, pet emotional state information for each emotion item associated with the video data of the transmitted data may be extracted. Here, the pet emotional state information for each emotion item may include numerical information (or grade information) on the emotional state of the pet for each emotion item.

The information recognition unit 140 reads the designated video data and recognizes f (1≤f≤F) feature points for the facial region of a specific pet within the base, and expresses the pet's emotion among the recognized f feature points. Recognizes i (i≥1) pieces of pet expression recognition information corresponding to the geometrical relationship between the related feature points.

According to an embodiment of the present invention, the designated video data may include at least one of video data periodically selected for each designated reproduction time unit and video data periodically selected for each designated number of reproduction frames.

In the case of the first pet emotional state generation embodiment of the present invention, the information recognition unit 140 is an app of the user wireless terminal 180 corresponding to the unique identification information stored in the management D / B or the management D / B It is checked whether transmission data including video data stored in a specific storage area of the storage medium is provided to the IPTV 185 identified/authenticated through the stored ID/PW information. If the transmission data is provided by the app of the user wireless terminal 180 or the IPTV 185, the information recognition unit 140 reads the designated video data among the video data of the transmission data and reads a specific pet in the base. While recognizing the f feature points for the facial region of the animal, it is possible to recognize i pet expression recognition information corresponding to the geometric relationship between the feature points related to the emotional expression of the pet among the recognized f feature points.

On the other hand, in the case of the second pet emotional state generation embodiment of the present invention, the information recognition unit 140 stores the acquired data received from the camera device 190 in a specific storage area of the storage medium and then selects the storage medium. Corresponding to the geometrical relationship between the f feature points related to the emotional expression of the pet among the recognized f feature points while recognizing the f feature points for the facial region of a specific pet in the base by reading the designated video data among the video data stored in the storage area It is possible to recognize the facial expression recognition information of i pets.

When the facial expression recognition information of i pets is recognized through the information recognition unit 140, the information determining unit 145 is the recognized i pets based on the expression-based emotional state determination information stored in the operation D/B. Check the facial expression pattern information of e (1≤e≤E) pets that match the animal expression recognition information and the preset standard similarity or higher. If it is confirmed that e pieces of pet expression pattern information matched with the recognized facial expression recognition information of the i pieces of pets and more than the preset standard similarity is identified, the information determining unit 145 matches the identified expression information of the e pieces of pet expression patterns Identify n1 (1≤n1≤N1) pet emotion items that have a relationship.

When n1 pet emotion items corresponding to the i pet expression recognition information are determined through the information determining unit 145, the emotional state calculating unit 150 is configured to include the recognized i pet expression recognition information and the Based on the matching ratio between the e pieces of pet expression pattern information, n1 corresponding to the recognized i pieces of pet expression recognition information by reading the numerical relationship of correlation between the e pieces of pet expression pattern information and n1 pieces of pet emotion items The pet emotional state value for each n1 emotion item obtained by digitizing the pet emotional state for each emotion item of dogs is calculated, and the information generating unit 155 uses the calculated pet emotional state value for each of the n1 emotion items to perform a video Creates pet emotional state information for each of the designated n (1≤n≤N) emotional items that can be displayed on the data. Here, the pet emotional state information for each emotion item may include numerical information (or grade information) on the emotional state of the pet for each emotion item.

Meanwhile, according to the second pet emotional state generation embodiment of the present invention, when the pet emotional state information for each of the n emotional items is generated after the acquired data is stored in a specific storage area of the storage medium, the information generating unit ( 155) may store the generated pet emotional state information for each of the n emotion items in a specific storage area of the storage medium in association with the video data.

According to an extension/other embodiment of the present invention, when the animal sound-based emotional state determination information is stored in the operation D/B and video data and audio data are linked and stored in a specific storage area of the storage medium, the information recognition unit 140 may recognize j (j ≥ 1) pieces of animal sound recognition information for the specific pet by reading audio data of a predetermined section associated with the video data.

On the other hand, when j pieces of animal sound recognition information are recognized through the information recognition unit 140, the information determination unit 145 sets the j recognized animal sounds based on the emotional state determination information stored in the operation D/B. The animal sound recognition information and c (1≤c≤C) animal sound pattern information matching the preset standard similarity or higher is checked. If the recognized j pieces of animal sound recognition information and the c pieces of animal sound pattern information matched with a preset level of similarity or more are identified, the information determining unit 145 has a matching relationship with the identified c pieces of animal sound pattern information. Identify n2 (1≤n2≤N2) pet emotion items.

When n2 pet emotion items corresponding to the j pieces of animal sound recognition information are determined through the information determining unit 145 , the emotional state calculating unit 150 determines the recognized j pieces of animal sound recognition information and the c pieces of animal sound recognition information. Based on the matching ratio between the animal sound pattern information, the numerical relationship of the correlation between the c animal sound pattern information and the n2 pet emotion items is read, and pets for each n2 emotion items corresponding to the recognized j pieces of animal sound recognition information. Calculates the pet emotional state value for each n2 emotional items that digitize the animal emotional state, and the information generating unit 155 uses (additionally) the calculated pet emotional state values for each of the n2 emotional items. Pet emotional state information for each emotion item may be generated. Here, the pet emotional state information for each emotion item may include numerical information (or grade information) on the emotional state of the pet for each emotion item.

According to the embodiment of the present invention, when the pet emotional state values for each n1 emotion items are previously calculated based on the i pet facial expression recognition information, the information generating unit 155 recognizes the i pet facial expressions. Pets for each n emotion item designated by combining the pet emotional state value for each n1 emotion item calculated based on the information and the pet emotional state value for each n2 emotion item calculated based on the j animal sound recognition information It is possible to generate emotional state information. Preferably, the pet emotional state information for each of the n emotion items is a union relationship of 'pet emotional state values for n1 emotion items ∩ pet emotional state values for n2 emotion items', or a subset relationship of the union can be

On the other hand, when generating pet emotional state information for each n emotion items by combining the pet emotional state value for each n1 emotion item and the pet emotional state value for each n2 emotion item, the information generating unit 155 generates the n1 For the emotion items of dogs and the overlapping emotion items among the n2 emotion items, it is specified according to a specified statistical calculation (eg, calculation of average value) or correlation between the emotion item and facial expression or animal sound for each pet emotional state value. Pet emotional state information of the overlapping emotion item may be generated through statistical calculation in which a specified weight is assigned to a recognition target.

According to an extension/other embodiment of the present invention, the sensing-based emotional state determination information is stored in the operation D/B, and video data and/or audio data and the camera device 190 are stored in a specific storage area of the storage medium. When the sensing data sensed through the provided or linked sensor module is linked and stored, the information recognition unit 140 reads the sensing data linked with the video data ??/or audio data to express the emotion of the specific pet and It is possible to recognize k (k≧1) pieces of sensing value recognition information for sensing data of an associated designated sensing target.

On the other hand, when the k sensed value recognition information is recognized through the information recognition unit 140, the information determining unit 145 detects the k sensed values based on the sensing-based emotional state determination information stored in the operation D/B. Check the value recognition information and s (1≤s≤S) sensed value pattern information that matches the preset reference similarity or more If the recognized k sensed value recognition information and the s sensed value pattern information matched with more than a preset reference similarity are matched, the information determining unit 145 has a matching relationship with the identified s sensed value pattern information Identify n3 (1≤n3≤N3) pet emotion items.

When n3 pet emotion items corresponding to k sensed value recognition information are determined through the information determining unit 145 , the emotional state calculating unit 150 is configured to include the recognized k sensed value recognition information and the s Based on the matching ratio between the sensed value pattern information, the correlation numerical relationship between the s sensed value pattern information and the n3 pet emotion items is read, and n3 pets for each emotion item corresponding to the recognized k sensed value recognition information. Calculating the pet emotional state value for each n3 emotion items that digitize the animal emotional state, and the information generating unit 155 uses (additionally) the calculated pet emotional state value for each of the n3 emotional items Pet emotional state information for each emotion item may be generated. Here, the pet emotional state information for each emotion item may include numerical information (or grade information) on the emotional state of the pet for each emotion item.

According to the implementation method of the present invention, when the pet emotional state values for each n1 emotion items are previously calculated based on the i pet expression recognition information, the information generating unit 155 recognizes the i pet facial expressions. Pets for each n emotion item designated by combining the pet emotional state value for each n1 emotion item calculated based on the information and the pet emotion state value for each n3 emotion item calculated based on the k sensed value recognition information It is possible to generate emotional state information. Preferably, the pet emotional state information for each of the n emotional items is a union relationship of 'pet emotional state values for n1 emotional items ∩ n3 pet emotional state values for n3 emotion items', or a subset relationship of the union can be

On the other hand, when generating pet emotional state information for each n emotion items by combining the pet emotional state value for each n1 emotion item and the pet emotional state value for each n3 emotion item, the information generating unit 155 generates the n1 For each emotion item and the overlapping emotion item among the n3 emotion items, a specified statistical calculation for each pet emotional state value (eg, an average value calculation calculation) or correlation between the emotion item and the expression or the sensing value of the specified sensing target Pet emotional state information of the overlapping emotional item may be generated through statistical calculation in which a specified weight is given to a specified recognition target according to a relationship.

Meanwhile, according to the implementation method of the present invention, based on the i pet expression recognition information, the pet emotional state value for each n1 emotion item and the j animal sound recognition information for each n2 emotion item are the pet emotional state values. In the pre-calculated case, the information generating unit 155 calculates the pet emotional state value for each n1 emotion item calculated based on the i pet expression recognition information and n2 calculated based on the j animal sound recognition information. By combining the pet emotional state value for each emotional item and the pet emotional state value for each n3 emotional item calculated based on the k sensed value recognition information, pet emotional state information for each n specified emotional item can be generated. have. Preferably, the pet emotional state information for each of the n emotion items is 'pet emotional state value for each n1 emotion item ∩ Pet emotional state value for n2 emotion items ∩ Pet emotional state value for each n3 emotion item' It may be a union relationship or a subset relationship of the union.

Meanwhile, by combining the pet emotional state value for each n1 emotion item, the pet emotional state value for each n2 emotion item, and the pet emotional state value for each n3 emotion item, pet emotional state information for each n emotion item is generated. At the time, the information generating unit 155 performs a specified statistical calculation (eg, an average value calculation calculation) for each pet emotional state value for the overlapping emotion items among the n1 emotion items, n2 emotion items, and n3 emotion items. ) or through statistical calculation in which a specified weight is given to a specified recognition target according to the correlation between the corresponding emotion item and the expression or animal sound or the sensing value of the specified sensing target, pet emotional state information of the overlapping emotion item can be generated. have.

Referring to Figure 1, the operation server 100, based on the virtual object matching information, r (1≤r≤R) virtual object data matching the pet emotional state information for each of the n emotion items generated The virtual object check unit 160 to confirm and display q (1≤q≤r) virtual object data that can be displayed overlaid on the area around the pet's face in the area around the pet's face on the video data to display the pet's face Transmission including an emotional state enhancing unit 165 that augments the surrounding area to correspond to the pet emotional state information for each of the n emotional items, and video data augmented to correspond to the pet emotional state information for each of the n emotional items and a data providing unit 170 that provides data to the app of the user wireless terminal 180 or to the IPTV 185 .

When the pet emotional state information for each n emotion items including numerical information (or grade information) on the emotional state of the pet for each emotion item is generated through the information generating unit 155, the virtual object check unit ( 160) confirms r virtual object data matching the pet emotional state information for each of the n emotion items created among the R virtual objects stored in the operation D/B based on the virtual object matching information.

When the r virtual object data matching the pet emotional state information for each of the n emotion items is checked through the virtual object check unit 160, the emotional state enhancer 165 is configured to select a pet from among the r virtual object data. Select q virtual object data that can be displayed overlapped in the area around the face For example, the r virtual object data may include two or more virtual object data that can be displayed overlaid on the same area around the pet's face. The q pieces of virtual object data may be selected through a process of selecting any one virtual object data to be displayed in an actual overlapping display among two or more virtual object data that can be displayed overlapped in the same area around the face.

According to the embodiment of the present invention, the q virtual object data displays a sentence string expressing the emotional state of the pet corresponding to the pet emotional state information for each of the n emotional items in the form of a speech bubble in the area around the pet's face. It may contain virtual object data.

When virtual object data of q to be displayed overlapped in the area around the pet's face is selected, the emotional state enhancer 165 overlaps and displays the selected q virtual object data in the area around the pet's face on the video data. By displaying, the area around the pet's face is augmented to correspond to the pet emotional state information for each of the n emotional items.

According to the implementation method of the present invention, the emotional state enhancing unit 165 recognizes the orientation direction of the pet's face on the video data, and the q pieces of the q pieces in the area around the pet's face corresponding to the orientation direction of the pet's face. Virtual object data can be displayed overlapped. For example, virtual object data including a character string in the form of a speech bubble may be displayed overlappingly in the form of lowering the tail of a speech bubble toward the face of the pet while being disposed in the direction in which the face of the pet is looking, thereby the video data The user who watches the video feels as if the pet expresses emotions corresponding to the emotional expression string (eg, 'I'm hungry', 'I'm annoyed', 'I'm lonely', etc.) inside the speech bubble.

The data providing unit 170 superimposes q virtual object data in the area around the pet's face and transmits data including video data augmented to correspond to the pet emotional state information for each of the n emotion items to a designated user wirelessly. It is provided to the app or IPTV 185 of the terminal 180, and the app or IPTV 185 of the user wireless terminal 180 may receive and output the transmission data. Preferably, the transmission data may further include audio data in addition to the video data, and the present invention is not limited thereto.

c

In more detail, Figure 2 shows a designated recognition target for generating pet emotional state information for each designated emotional item (eg, a pet expression, a pet animal sound, sensing a specified sensing line of Aging through a dirty sensor module) Sensing value, etc.) to store emotional state determination information for each operation D/B, or to receive transmission data including video data of a specific pet in the base through the camera device 190 provided at the designated base It shows a process of registering and storing information mapping the camera device 190 to a designated management D/B. Those of ordinary skill in the art to which the present invention pertains, refer to FIG. 2 and/or Alternatively, various implementation methods for the above process (eg, an implementation method in which some steps are omitted or the order is changed) may be inferred by modification, but the present invention is made including all the inferred implementation methods, and this drawing The technical characteristics are not limited only to the implementation method shown in 2 .

Referring to FIG. 2, the operation server 100 includes pattern information of a recognition target designated to be recognized to determine the emotional state of the pet, matching relationship information between each pet emotion item, and pattern information of the designated recognition target and The emotional state determination information for each designated recognition target including the correlation numerical relationship information obtained by quantifying the correlation between each pet emotional item is registered and stored in the designated operation D/B and managed (200).

According to the implementation method of the present invention, the operation server 100 corresponds to the geometric relationship between the feature points related to the emotional expression of the pet among the F feature points existing in the facial area of the pet, and E pieces of pet expression pattern information and designated Among the N pet emotion items, matching relationship information between N1 pet emotion items that can be distinguished based on a pet expression pattern is included, and the correlation between the E pet expression pattern information and N1 pet emotion items is quantified. The expression-based emotional state determination information including one facial expression-based correlation numerical relationship information is registered and stored in the designated operation D/B.

According to an extension/other embodiment of the present invention, the operation server 100 includes C animal sound pattern information related to the emotional expression of the pet among the animal sound patterns of the pet, and the animal sound pattern among the N designated pet emotion items. Including matching relationship information between N2 pet emotion items that can be distinguished based on , and animal sound-based correlation numerical relationship information that quantifies the correlation between the C animal sound pattern information and N2 pet emotion items. Animal sound-based emotional state determination information can be registered and stored in operation D/B.

On the other hand, according to an extension/other embodiment of the present invention, the operation server 100 is provided in the camera device 190, or of the sensing data sensed through a connected sensor module of the designated sensing target associated with the emotional expression of the pet. It includes matching relationship information between S sensing value pattern information for sensing data and N3 pet emotion items distinguishable based on the sensing value pattern of the specified sensing target among the N specified pet emotion items, and the S sensing values It is possible to register and store the sensing-based emotional state determination information including the sensing-based correlation numerical relationship information that quantifies the correlation between the pattern information and the N3 pet emotional items in the operation D/B.

2, the operation server 100 registers and stores R (R≥2) virtual object data in operation D/B for augmenting the area around the pet's face to correspond to the emotional state of the pet ( 205), the pet emotional state information for each designated emotion item generated based on at least one of the expression-based emotional state identification information, the animal sound-based emotional state identification information, and the sensing-based emotional state identification information, and one or more The virtual object matching information matching the designated virtual object data is registered and stored in the operation D/B (210).

Referring to Figure 2, the operation server 100 is a target to be provided with transmission data including video data of a specific pet in the base through the camera device 190 provided at the designated base and the camera device ( 190), user information about the user from the app of the user wireless terminal 180, camera device 190 information uniquely identifying the camera device 190 provided/supplied to the user, the user wireless terminal 180 ), unique identification information for uniquely identifying the app and ID / PW information set by the user can be requested for mapping registration according to a specified procedure (215), and the operation server 100 is the user's wireless terminal 180. Receives the user information, camera device 190 information, unique identification information and ID / PW information from the app according to a specified procedure (220), the user information, camera device 190 information, unique identification information and ID / PW information and the like are linked and stored in the designated management Dd/B (225). Meanwhile, according to the implementation method, the user information, camera device 190 information, ID/PW information, etc. is a user terminal used by a user who purchases or receives the camera device 190 or a designated registered terminal that has received the user's subscription application can be registered through

3 is a diagram illustrating storage and management of the acquired data acquired through the camera device 190 of a designated base in a designated storage medium according to an embodiment of the present invention.

In more detail, this figure 3 shows that the acquired data including the video data acquired through the camera module of the camera device 190 provided at the designated base is transmitted to the operation server 100 and stored in a specific storage area of the designated author media. As an illustration of the management process, those of ordinary skill in the art to which the present invention pertains, refer to and/or modify FIG. 3 and various implementation methods for the process (eg, some steps are omitted, or implementation method in which the order is changed), but the present invention is made including all the inferred implementation methods, and the technical characteristics are not limited only to the implementation method shown in FIG. 3 .

Referring to Figure 3, when the power supply for operation is confirmed (300), the camera device 190 exchanges one or more designated information with the designated operation server 100 through a communication module according to a designated procedure to establish a communication connection. When requesting (305), the operation server 100 authenticates the validity of the camera device 190 by exchanging specified information with the camera device 190 (310), communication connection with the camera device 190 and (315), and correspondingly, communication with the operation server 100 is connected to the camera device 190 (315).

Meanwhile, the operation server 100 dynamically generates ( 320 ) one-time address information for receiving the acquired data obtained through the camera device 190 , and provides the generated one-time address information to the camera device 190 . and (325), the camera device 190 may receive the one-time address information from the operation server 100 (330), and set the received one-time address information as a destination address to transmit the acquired data (335) ), the process of generating the one-time address information or setting the destination address may be repeated periodically (eg, every 30 seconds).

Meanwhile, the camera device 190 may acquire video data of a pet in a designated base through the camera module ( 340a ), and transmit the acquired data including the video data to a designated destination address ( 345 ).

Alternatively, the camera device 190 acquires video data of a pet in a designated base through the camera module (340a), and after acquiring audio data in the base through the sound input unit (340b), the video Acquisition data including data and audio data may be transmitted to a designated destination address ( 345 ).

Alternatively, the camera device 190 acquires video data of a pet in a designated base through the camera module (340a), and after acquiring sensing data sensing a designated sensing target of the pet through the sensor module In step 340c, the acquired data including the video data and the sensing data may be transmitted to a designated destination address (345).

Alternatively, the camera device 190 obtains video data of a pet in a designated base through the camera module (340a), and acquires audio data in the base through the sound input unit (340b), and the sensor module After acquiring the sensing data for sensing the designated sensing target of the pet (340c), the acquired data including the video data, the audio data, and the sensing data may be transmitted to the designated destination address (345).

The operation server 100 receives the acquired data including at least video data from the camera device 190 (350), and stores the received acquired data (or each data included in the acquired data) of a designated storage medium. It is stored and managed in a specific storage area (355).

4 is a diagram illustrating transmission data including video data augmented with a pet's emotional state according to the first embodiment of the present invention.

In more detail, FIG. 4 shows the area around the face of the pet on the video data after generating pet emotional state information for each n emotion items specified using the recognized pet expression recognition information by reading the designated video data. The process of providing transmission data including video data augmented to correspond to the pet emotional state information for each emotional item of the dog to the app of the user wireless terminal 180 or the IPTV 185 is shown, the technical field to which the present invention pertains Those of ordinary skill in the art will be able to infer various implementation methods (eg, an implementation method in which some steps are omitted or in which the order is changed) for the above process by referring and/or modifying this figure 4, but this The invention is made including all implementation methods inferred above, and the technical characteristics are not limited only to the implementation method shown in FIG. 4 .

Referring to FIG. 4, a time point at which transmission data including video data stored in a specific storage area of a storage medium designated through the process of FIG. 3 is provided to an app or IPTV 185 of a designated user wireless terminal 180, or After the acquired data including the video data acquired through the camera device 190 is stored in a specific storage area of the designated storage medium through the process of FIG. 3, the operation server 100 reads the designated video data to the base While recognizing the f feature points for the facial region of a specific pet within, recognize i pet expression recognition information corresponding to the geometric relationship between the feature points related to the emotional expression of the pet among the recognized f feature points ( 400 ).

If the facial expression recognition information of i pets is recognized based on the video data, the operation server 100 determines the recognition based on the facial expression-based emotional state determination information stored in the operation D/B through the process of FIG. 2 . Check the e pet expression pattern information matched with the i pet expression recognition information and the preset reference similarity or more (405), and determine n1 pet emotion items having a matching relationship with the e pet expression pattern information do (410).

If n1 pet emotion items corresponding to the recognized i pet facial expression recognition information are determined, the operation server 100 determines the recognized i pet facial expression recognition information and the e pet facial expression pattern information. Based on the matching ratio, by reading the correlation numerical relationship between the e pet expression pattern information and n1 pet emotion items, pet emotion for each n1 emotion item corresponding to the recognized i pet expression recognition information A pet emotional state value is calculated for each n1 emotional item that quantifies the state ( 415 ).

If the pet emotional state value for each of the n1 emotion items is calculated, the operation server 100 uses the calculated pet emotional state value for each of the n1 emotion items to display n designated emotion items on the video data. Creates star pet emotional state information ( 420 ).

If the pet emotional state information for each of the n emotion items is generated, the operation server 100 is configured for each of the generated n emotion items based on the virtual object matching information stored in the operation D/B through the process of FIG. 2 . Check r (1≤r≤R) virtual object data matching the pet emotional state information (425), and video q (1≤q≤r) virtual object data that can be displayed overlaid on the area around the pet's face Overlaid display on the area around the pet's face on the data to augment the area around the pet's face to correspond to the pet emotional state information for each of the n emotion items (430), and pet emotional state information for each of the n emotion items The operation server 100 transmits data including video data augmented to correspond to the app or the management D of the user wireless terminal 180 corresponding to the unique identification information stored in the management D / B through the process of FIG. 2 It is provided to the IPTV 185 identified/authenticated through the ID/PW information stored in /B (435). The app or IPTV 185 of the user wireless terminal 180 receives and outputs transmission data including video data augmented to correspond to the pet emotional state information for each of the n emotion items ( 440 ). Advantageously, the transmission data may further include audio data associated with the video data.

5 is a diagram illustrating transmission data including video data augmented with a pet's emotional state according to a second embodiment of the present invention.

In more detail, FIG. 5 is a view showing pet emotional state information for each n emotional items specified by reading audio data associated with specified video data and using (additionally) recognized animal sound recognition information, and then the pet on the video data. As showing the process of providing transmission data including video data augmented to correspond to the pet emotional state information for each of the n emotional items to the app of the user wireless terminal 180 or to the IPTV 185, the area around the face of the animal is shown. , Those of ordinary skill in the art to which the present invention pertains, refer to and/or modify this figure 5 to see various implementation methods for the above process (eg, an implementation method in which some steps are omitted or the order is changed) Although it can be inferred, the present invention is made including all of the inferred implementation methods, and the technical characteristics are not limited only to the implementation method illustrated in FIG. 5 .

Referring to FIG. 5, a time point at which transmission data including video data stored in a specific storage area of a storage medium designated through the process of FIG. 3 is provided to an app or IPTV 185 of a designated user wireless terminal 180, or After the acquired data including the video data acquired through the camera device 190 is stored in a specific storage area of the storage medium designated through the process of FIG. 3, or n1 pieces of pet expression recognition-based shown in FIG. In conjunction with the pet emotional state value calculation process for each emotion item, the operation server 100 reads audio data of a certain section associated with the specified video data to recognize j number of animal sound recognition information for the specific pet do (500).

If j pieces of animal sound recognition information are recognized based on the audio data, the operation server 100 performs the recognition based on the animal sound-based emotional state determination information stored in the operation D/B through the process of FIG. 2 . Check the c animal sound pattern information matched with the j number of animal sound recognition information and the preset standard similarity or more (505), and determine n2 pet emotion items having a matching relationship with the identified c animal sound pattern information (510).

If n2 pet emotion items corresponding to the recognized j number of animal sound recognition information are identified, the operation server 100 sets a matching ratio between the recognized j number of animal sound recognition information and the c animal sound pattern information. Based on n2, the numerical relationship of the correlation between the c animal sound pattern information and the n2 pet emotion items is read and the pet emotional state for each n2 emotion items corresponding to the recognized j animal sound recognition information is digitized. A pet emotional state value for each emotional item of the dog is calculated (515).

If the pet emotional state value for each of the n2 emotion items is calculated, the operation server 100 uses the calculated pet emotional state value for each of the n2 emotion items, and the designated n emotion items that can be displayed on the video data. It is possible to generate individual pet emotional state information ( 520 ).

On the other hand, when the pet emotional state value for each n1 emotion item is calculated through the process of FIG. 4 at a point before, during, or after the pet emotional state value for each of the n2 emotion items is calculated, the operation server 100 ) by combining the calculated pet emotional state value for each n1 emotion item and the pet emotional state value for each n2 emotion item to generate pet emotional state information for each n designated emotion item that can be displayed on the video data. may (520).

If the pet emotional state information for each of the n emotion items is generated, the operation server 100 is configured for each of the generated n emotion items based on the virtual object matching information stored in the operation D/B through the process of FIG. 2 . Check r (1≤r≤R) virtual object data matching the pet emotional state information (525), and video q (1≤q≤r) virtual object data that can be displayed overlaid on the area around the pet's face Overlaid display on the area around the pet's face on the data to augment the area around the pet's face to correspond to the pet emotional state information for each of the n emotion items (530), and pet emotional state information for each of the n emotion items The operation server 100 transmits data including video data augmented to correspond to the app or the management D of the user wireless terminal 180 corresponding to the unique identification information stored in the management D / B through the process of FIG. 2 It is provided to the IPTV 185 identified/authenticated through the ID/PW information stored in /B (535). The app or IPTV 185 of the user wireless terminal 180 receives and outputs transmission data including video data augmented to correspond to the pet emotional state information for each of the n emotion items (540). Advantageously, the transmission data may further include audio data associated with the video data.

6 is a diagram illustrating transmission data including video data augmented with a pet's emotional state according to a third embodiment of the present invention.

In more detail, FIG. 6 shows that after generating pet emotional state information for each of the n emotional items specified using (additional) sensing value recognition information recognized by reading the sensing data associated with the specified video data and/or audio data, To provide transmission data including video data in which the area around the face of the pet on the video data is augmented to correspond to the pet emotional state information for each of the n emotion items to the app of the user wireless terminal 180 or to the IPTV 185 As an illustration of the process, those of ordinary skill in the art to which the present invention pertains may refer to and/or modify this FIG. 6 to see various implementation methods for the process (eg, some steps are omitted, or the order is out of order). Changed implementation method) can be inferred, but the present invention includes all the inferred implementation methods, and the technical characteristics are not limited only to the implementation method illustrated in FIG. 6 .

Referring to FIG. 6 , a point in time when transmission data including video data stored in a specific storage area of a storage medium designated through the process of FIG. 3 is provided to an app or IPTV 185 of a designated user wireless terminal 180, or After the acquired data including the video data acquired through the camera device 190 is stored in a specific storage area of the storage medium designated through the process of FIG. 3, or n1 pieces of pet expression recognition-based shown in FIG. In conjunction with the process of calculating the pet emotional state value for each emotion item, or in conjunction with the process of calculating the pet emotional state value for each n2 emotion items based on the animal sound recognition shown in FIG. 5, the operation server 100 is the designated Sensing data associated with video data and/or audio data is read to recognize k sensed value recognition information for sensing data of a designated sensing target associated with the emotional expression of the specific pet ( 600 ).

If k sensed value recognition information is recognized based on the sensing data, the operation server 100 determines the k recognized based on the sensing-based emotional state determination information stored in the operation D/B through the process of FIG. 2 . Check the s sensed value recognition information and the s sensed value pattern information matched with the preset reference similarity or more (605), and determine n3 pet emotion items having a matching relationship with the identified s sensed value pattern information ( 610).

If n3 pet emotion items corresponding to the recognized k sensed value recognition information are determined, the operation server 100 determines a matching ratio between the recognized k sensed value recognition information and the s sensed value pattern information. Based on the s sensed value pattern information and the correlation numerical relationship between the n3 pet emotion items, the n3 values of the pet emotional state for each n3 emotion items corresponding to the recognized k sensed value recognition information are read. A pet emotional state value for each emotional item of the dog is calculated (615).

If the pet emotional state values for each of the n3 emotion items are calculated, the operation server 100 uses the calculated pet emotional state values for each of the n3 emotion items, and the designated n emotion items that can be displayed on the video data. It is possible to generate individual pet emotional state information ( 620 ).

On the other hand, when the pet emotional state value for each n1 emotion item is calculated through the process of FIG. 4 at a point in time before, during, or after the pet emotional state value for each of the n3 emotion items is calculated, the operation server 100 ) is to combine the calculated pet emotional state value for each n1 emotion item and the pet emotional state value for each n3 emotion item to generate pet emotional state information for each n specified emotion item that can be displayed on video data. may (620).

Or, at a time point before, during, or after the n3 emotional state values for each of the n3 emotional items are calculated, the pet emotional state values for each of the n1 emotional items are calculated through the process of FIG. 4, and through the process of FIG. When the pet emotional state value for each n2 emotion items is calculated, the operation server 100 calculates the pet emotional state value for each of the n1 emotion items, the pet emotional state value for each n2 emotion items, and the n3 By combining the pet emotional state values for each emotion item, pet emotional state information for each of the n designated emotion items that can be displayed on video data may be generated ( 620 ).

If the pet emotional state information for each of the n emotion items is generated, the operation server 100 is configured for each of the generated n emotion items based on the virtual object matching information stored in the operation D/B through the process of FIG. 2 . Check r (1≤r≤R) virtual object data matching the pet emotional state information (625), and video q (1≤q≤r) virtual object data that can be displayed overlaid on the area around the pet's face Overlaid display on the area around the pet's face on the data so that the area around the pet's face corresponds to the pet emotional state information for each of the n emotion items (630) The operation server 100 transmits data including video data augmented to correspond to the app or the management D of the user wireless terminal 180 corresponding to the unique identification information stored in the management D / B through the process of FIG. 2 It is provided to the IPTV 185 identified/authenticated through the ID/PW information stored in /B (635). The app or IPTV 185 of the user wireless terminal 180 receives and outputs transmission data including video data augmented to correspond to the pet emotional state information for each of the n emotion items ( 640 ). Advantageously, the transmission data may further include audio data associated with the video data.

100: operation server 105: information management unit
110: virtual object management unit 115: information matching unit
120: information register 125: communication management unit
130: data receiving unit 135: data storage unit
140: information recognition unit 145: information discrimination unit
150: emotional state calculating unit 155: information generating unit
160: virtual object confirmation unit 165: emotional state enhancement unit
170: data providing unit 180: wireless terminal
185: IPTV 190: camera device

Claims (28)

In the method executed through an operation server having a sound input unit and a camera module to communicate with a camera device provided in a designated base,
Among the F (F≥2) feature points existing in the facial region of the pet, E (E≥2) pet expression pattern information corresponding to the geometrical relationship between the feature points related to the pet's emotional expression and specified N (N≥2) ) of the pet emotion items, matching relationship information between N1 (1≤N1≤N) pet emotion items that can be distinguished based on the pet expression pattern, and the E pet expression pattern information and N1 pet emotion items Expression-based correlation that quantifies the correlation between facial expressions R to register and store expression-based emotional state identification information, including numerical relationship information, in the operation D/B, and to augment the area around the pet's face in response to the pet's emotional state (R≥2) virtual object data is registered and stored in operation D/B, and virtual object matching information that matches pet emotional state information for each specified emotion item with one or more specified virtual object data is registered and stored in operation D/B a first step;
Video data encoded in a specified manner by photographing a specific pet in the base through the camera module of the camera device and audio data encoded in a specified manner input through the sound input unit of the camera device are received to specify a specified storage medium a second step of managing storage in a storage area;
Corresponding to the geometrical relationship between the key points related to the emotional expression of the pet among the recognized f feature points while recognizing f (1≤f≤F) feature points for the facial region of a specific pet in the base by reading the designated video data a third step of recognizing i(i≥1) pet expression recognition information;
Based on the expression-based emotional state determination information, the recognized i pet expression recognition information and e (1≤e≤E) pet expression pattern information matched above a preset standard similarity are checked, and the e pets a fourth step of determining n1 (1≤n1≤N1) pet emotion items having a matching relationship with the expression pattern information;
Based on the matching ratio between the recognized i pet expression recognition information and the e pet expression pattern information, the correlation between the e pet expression pattern information and n1 pet emotion items is read and recognized a fifth step of calculating a pet emotional state value for each n1 emotion item obtained by digitizing the pet emotional state for each n1 emotion item corresponding to the i pet expression recognition information;
a sixth step of generating pet emotional state information for each of n (1≤n≤N) specified emotion items by using the calculated pet emotional state values for each of the n1 emotional items;
a seventh step of identifying r (1≤r≤R) virtual object data matching the pet emotional state information for each of the n emotion items generated based on the virtual object matching information;
q (1≤q≤r) virtual object data that can be displayed overlaid on the area around the pet's face is displayed overlaid on the area around the pet's face on the video data, so that the area around the pet's face is displayed as the pet for each of the n emotion items. an eighth step of augmenting to correspond to the emotional state information; and
A ninth step of providing transmission data including video data augmented to correspond to the pet emotional state information for each of the n emotion items to an app or IPTV of a user wireless terminal; How to augment your emotional state.
According to claim 1, wherein the E pet expression pattern information,
A method for enhancing the emotional state of a pet using a region around a pet, characterized in that it includes range information of a geometric relationship between each feature point corresponding to each pet expression pattern related to the pet's emotional expression.
According to claim 1 or 2, wherein the geometric relationship between the feature points,
A method for enhancing the emotional state of a pet using an area around the pet, comprising at least one of a distance relationship between each feature point, an angle relationship between each feature point, and a combination relationship of a distance relationship and an angle relationship between each feature point.
According to claim 1, wherein the expression-based correlation numerical relationship information,
Using the area around the pet, characterized in that it includes the correlation numerical information calculated through the relational expression proportional to the matching ratio between the pet expression recognition information that recognizes the pet's expression and the registered pet expression pattern information. How to enhance the emotional state of your pet.
According to claim 1, wherein the expression-based correlation numerical relationship information,
Pet emotion using the area around the pet, characterized in that it includes the correlation numerical information for each matching ratio section between the pet expression recognition information that recognizes the pet's expression and the pre-registered pet expression pattern information How to augment status.
According to claim 1, wherein the second step,
Reinforcing the emotional state of a pet using an area around the pet, characterized in that it comprises the step of receiving the moving picture data including the video data and the audio data from the camera device and storing and managing it in a specific storage area of a designated storage medium Way.
According to claim 1, wherein the second step,
and receiving the video data and the audio data from the camera device, respectively, and storing and managing them in a specific storage area of a designated storage medium.
The method of claim 7, wherein the second step comprises:
The method for enhancing the emotional state of a pet using an area around the pet, characterized in that it further comprises the step of synchronizing the time of the video data and the audio data received from the camera device and storing them in a specific storage area of a designated storage medium. .
According to claim 1, wherein the transmission data,
The method for enhancing the emotional state of a pet using an area around the pet, characterized in that it further comprises audio data stored in a specific storage area of the storage medium.
The method according to claim 1, wherein the designated video data comprises:
Video data that is periodically screened by a specified unit of playing time;
A method for enhancing the emotional state of a pet using a region around the pet, comprising at least one of video data periodically selected for each specified number of reproduction frames.
The method of claim 1,
The method further comprises the step of confirming whether transmission data including video data stored in a specific storage area of the storage medium is provided by an App or IPTV of a designated user wireless terminal,
In the third step, when transmission data including video data is provided to an app or IPTV of a designated user wireless terminal, designated video data among the video data of the transmission data is read and stored in the facial area of a specific pet in the base. Pet surrounding, characterized in that it comprises the step of recognizing i pet expression recognition information corresponding to the geometric relationship between the feature points related to the emotional expression of the pet among the recognized f feature points while recognizing the f feature points for A method of augmenting the emotional state of pets using domains.
The method of claim 1,
The third step is to read the specified video data from among the video data stored in the specific storage area of the specified storage medium and recognize the f characteristic points for the facial area of the specific pet in the base, while recognizing the f characteristic points among the recognized f characteristic points. Recognizing the facial expression recognition information of i pets corresponding to the geometric relationship between the feature points associated with the emotional expression of
The sixth step is a method for enhancing the emotional state of a pet using a region around a pet, characterized in that it further comprises the step of storing the pet emotional state information for each of the n emotion items generated in association with the video data. .
The method of claim 12, wherein the sixth step comprises:
and storing the pet emotional state information for each of the n emotion items generated in association with a time value (or timestamp) for synchronizing with a specified playback time of the video data. A method of enhancing the emotional state of a pet using
The method of claim 1,
The first step is
Among the animal sound patterns of pets, C (C≥2) animal sound pattern information related to the pet's emotional expression and N2 (1≤N2≤N) distinguishable based on the animal sound pattern among N designated pet emotion items Animal sound-based emotional state determination information including matching relationship information between pet emotion items and animal sound-based correlation numerical relationship information that digitizes the correlation between the C animal sound pattern information and N2 pet emotion items Further comprising the step of storing registration in the operation D / B,
The third step is
Further comprising the step of recognizing j (j ≥ 1) animal sound recognition information for the specific pet by reading audio data of a certain section associated with the video data,
The fourth step is
Based on the animal sound-based emotional state determination information, the recognized j number of animal sound recognition information and c (1≤c≤C) animal sound pattern information matched with a preset level of similarity or higher are checked, and the identified c animals Further comprising the step of determining n2 (1≤n2≤N2) pet emotion items having a matching relationship with the sound pattern information,
The fifth step is
Based on the matching ratio between the recognized j pieces of animal sound recognition information and the c pieces of animal sound pattern information, the number of correlations between the c pieces of animal sound pattern information and the n2 pieces of pet emotion items is read and the recognized j pieces Further comprising the step of calculating the pet emotional state value for each n2 emotion items that digitize the pet emotional state for each n2 emotion items corresponding to the animal sound recognition information,
The sixth step is
The step of generating pet emotional state information for each of the n specified emotional items by additionally using the calculated pet emotional state values for each of the n2 emotional items. How to augment your emotional state.
15. The method of claim 14, wherein the C animal sound pattern information,
A method for enhancing the emotional state of a pet using a region around the pet, characterized in that it includes information on the range of animal sound features constituting each animal sound pattern related to the emotional expression of the pet.
16. The method of claim 15, wherein the animal sound feature,
Frequency band characteristics, arrangement relation characteristics of frequency band characteristics, periodicity characteristics of frequency band characteristics, loudness characteristics, arrangement relation characteristics of sound intensity characteristics, periodicity characteristics of sound strength characteristics, combination characteristics of frequency band characteristics and sound intensity characteristics, frequency A method for enhancing the emotional state of a pet using a region around a pet, characterized in that it comprises at least one of a feature of an arrangement relationship between a band feature and a sound intensity feature, a frequency band feature and a periodic feature of the sound intensity feature.
15. The method of claim 14, wherein the animal sound-based correlation numerical relationship information,
Pet using the area around the pet, characterized in that it includes the correlation numerical information calculated through the relational expression proportional to the matching ratio between the animal sound recognition information that recognizes the animal sound of the pet and the previously registered animal sound pattern information. A method of augmenting the emotional state of animals.
15. The method of claim 14, wherein the animal sound-based correlation numerical relationship information,
The emotional state of the pet using the area around the pet, characterized in that it includes the correlation numerical information for each matching ratio section between the animal sound recognition information that recognizes the animal sound of the pet and the previously registered animal sound pattern information augmentation method.
The method of claim 1,
The first step is
Among the sensing data sensed through the sensor module provided in or linked to the camera device, S (S≥2) sensed value pattern information for the sensing data of the specified sensing target related to the emotional expression of the pet and the N specified pet emotions Matching relationship information between N3 (1≤N3≤N) pet emotion items that can be distinguished based on the sensing value pattern of a specified sensing target among items, and correlation between the S sensed value pattern information and N3 pet emotion items Further comprising the step of registering and storing sensing-based emotional state determination information, including the sensing-based correlation numerical relationship information that digitizes the
The second step is
Further comprising the step of receiving sensing data sensed through a sensor module provided in or linked to the camera device and storing and managing the data in a specific storage area of a designated storage medium in association with the video data,
The third step is
Further comprising the step of recognizing k (k ≥ 1) sensed value recognition information for the sensing data of a specified sensing target associated with the emotional expression of the specific pet by reading the sensing data associated with the video data,
The fourth step is
Based on the sensing-based emotional state determination information, s (1≤s≤S) sensed value pattern information matched with the recognized k sensed value recognition information and a preset standard similarity or higher is checked, and the identified s sensed values Further comprising the step of determining n3 (1≤n3≤N3) pet emotion items having a matching relationship with the pattern information,
The fifth step is
Based on the matching ratio between the recognized k sensed value recognition information and the s sensed value pattern information, the correlation numerical relationship between the s sensed value pattern information and n3 pet emotion items is read and the recognized k Further comprising the step of calculating the pet emotional state value for each n3 emotion items that digitize the pet emotional state for each n3 emotion items corresponding to the sensing value recognition information,
The sixth step is
The step of generating pet emotional state information for each of the n designated emotional items by additionally using the calculated pet emotional state values for each of the n3 emotional items. How to augment your emotional state.
The method of claim 19, wherein the sensor module,
A wearable sensor module that is worn on the body of a pet and senses a specified sensing target;
A method for enhancing the emotional state of a pet using an area around the pet, comprising at least one sensor module among radar sensor modules for sensing a designated sensing target of the pet using a designated electromagnetic wave.
The method of claim 19 or 20, wherein the sensing target,
A method for enhancing the emotional state of a pet using an area around the pet, comprising at least one of the pet's heartbeat, the pet's body temperature, the pet's ambient humidity, and whether the pet is apnea.
The method of claim 19, wherein the S sensed value pattern information comprises:
A method for enhancing the emotional state of a pet using an area around the pet, characterized in that it includes range information of a sensing value characteristic constituting each sensing value pattern for the sensing data of a specified sensing target related to the emotional expression of the pet. .
23. The method of claim 22, wherein the sensed value characteristic,
The emotional state of the pet using the area around the pet, characterized in that it comprises at least one or a combination of two or more of the sensing value change rule feature, the sensed value change feature, the sensed value change rate feature, and the sensed value change periodic feature augmentation method.
The method of claim 19, wherein the sensing-based correlation numerical relationship information,
The area around the pet, characterized in that it includes numerical information on correlation calculated through a relational expression proportional to the matching ratio between the sensing value recognition information recognized through the sensing data of the specified sensing target and the previously registered sensing value pattern information. A method of enhancing the emotional state of a pet using
The method of claim 19, wherein the sensing-based correlation numerical relationship information,
Pet using the area around the pet, characterized in that it includes the correlation numerical information for each matching ratio section between the sensing value recognition information recognized through the sensing data of the specified sensing target and the previously registered sensing value pattern information How to augment your emotional state.
According to claim 1, wherein the pet emotional state information for each of the n emotion items,
A method for enhancing the emotional state of a pet using an area around the pet, characterized in that it includes n emotional item information and numerical information of the pet's emotional state for each emotional item.
According to claim 1, wherein the q virtual object data,
Pet surrounding, characterized in that it comprises virtual object data for displaying a sentence string expressing the emotional state of the pet corresponding to the pet emotional state information for each of the n emotional items in the form of a speech bubble in the area around the pet's face. A method of augmenting the emotional state of pets using domains.
The method of claim 1,
Further comprising the step of recognizing the orientation direction of the pet's face on the video data,
The eighth step includes overlapping and displaying the q virtual object data on the area around the pet's face corresponding to the orientation direction of the pet's face. How to augment your emotional state.

Images