KR20230122470A - Virtual ai model creation and ai voice matching system - Google Patents

Abstract

A virtual AI model production and AI voice matching system, comprising: a user basic information input unit for inputting user information and setting an initial response character according to call word recognition; a call word setting unit for setting a voice command call word; a voice command analysis unit that analyzes a voice command uttered by a user and understands the user's emotion through acoustic analysis; And a video processing unit that recognizes the user's face image captured through the camera and recognizes the user's situation and emotion through gesture recognition; provides a virtual AI model production and AI voice matching system comprising a.
An apparatus according to an embodiment may be combined with hardware and controlled by a computer program stored in a medium to execute any one of the methods described above.

Description

Virtual AI model creation and AI voice matching system {VIRTUAL AI MODEL CREATION AND AI VOICE MATCHING SYSTEM}

The embodiments below relate to virtual AI model production and AI voice matching systems.

The voice assistant service processes audio signals with Automated Speech Recognition (ASR), Natural Language Understanding (NLU), Dialogue Manager (DM), and Natural Language Generation (NLG). and a service that provides a response to a user's utterance through Text To Speech (TTS) processing.

Conventionally, the voice assistant service provides answers only in a predetermined style, and to change the style, a change has to be made through a setting menu. In addition, ASR, NLU, DM, NLG, and TTS of the voice assistant can be operated through rule-based algorithms other than artificial intelligence, and artificial intelligence can be grafted to improve the performance of the voice assistant.

The following embodiments are intended to provide a virtual AI model production and AI voice matching system.

A virtual AI model production and AI voice matching system, comprising: a user basic information input unit for inputting user information and setting an initial response character according to call word recognition; a call word setting unit for setting a voice command call word; a voice command analysis unit that analyzes a voice command uttered by a user and understands the user's emotion through acoustic analysis; And a video processing unit that recognizes the user's face image captured through the camera and recognizes the user's situation and emotion through gesture recognition; provides a virtual AI model production and AI voice matching system comprising a.

An apparatus according to an embodiment may be combined with hardware and controlled by a computer program stored in a medium to execute any one of the methods described above.

The following embodiments have the effect of efficiently providing a virtual AI model production and AI voice matching system.

1 is a block diagram of a virtual AI model production and AI voice matching system according to an embodiment of the present invention.
2 is a block diagram of a relationship setting unit according to an embodiment of the present invention.
3 is an exemplary diagram of a configuration of a device according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, since various changes can be made to the embodiments, the scope of rights of the patent application is not limited or limited by these embodiments. It should be understood that all changes, equivalents or substitutes to the embodiments are included within the scope of rights.

Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only, and may be modified and implemented in various forms. Therefore, the embodiments are not limited to the specific disclosed form, and the scope of the present specification includes changes, equivalents, or substitutes included in the technical spirit.

Although terms such as first or second may be used to describe various components, such terms should only be construed for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element.

It should be understood that when an element is referred to as being “connected” to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle.

Terms used in the examples are used only for descriptive purposes and should not be construed as limiting. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the embodiment belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present application, they should not be interpreted in an ideal or excessively formal meaning. don't

In addition, in the description with reference to the accompanying drawings, the same reference numerals are given to the same components regardless of reference numerals, and overlapping descriptions thereof will be omitted. In describing the embodiment, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the embodiment, the detailed description will be omitted.

The embodiments may be implemented in various types of products such as personal computers, laptop computers, tablet computers, smart phones, televisions, smart home appliances, intelligent vehicles, kiosks, and wearable devices.

1 is a block diagram of a virtual AI model production and AI voice matching system according to an embodiment of the present invention.

2 is a block diagram of a relationship setting unit according to an embodiment of the present invention.

The user basic information input unit 101 refers to an input device such as a keypad for inputting user information and setting an initial response character according to a call word recognition.

The microphone 102 is a device for receiving a user's voice, and the voice pre-processing unit 103 pre-processes the voice input through the microphone 102 and outputs endpoints and characteristics.

The call word setting unit 104 serves to set a voice command call word, and the voice command analyzer 105 analyzes the voice command spoken by the user transmitted through the voice pre-processing unit 103 and analyzes the sound. It plays a role in understanding the user's emotions through

The camera 106 takes a user's image and takes a role in capturing a gesture, and the image processing unit 107 recognizes the user's face image captured through the camera 106 and recognizes the user's situation and behavior through gesture recognition. It plays a role in recognizing emotions.

The object database 109 serves to store a voice conversation object candidate group and realistic artificial intelligence (AI) assistant characters that match the voice command input by the user, and the environmental information database 110 stores the object candidate group. It serves to store corresponding surrounding environment information, and the voice database 111 serves to store voice characteristic information of the derived voice conversation object.

The display unit 112 serves to display an initial response screen according to a call word recognition word, and displays an expression image and gesture information of a voice conversation object on the screen. By displaying a response screen in which a voice conversation object according to the call word recognition is displayed in the form of a pop-up window, a multitasking work screen is realized during voice conversation.

The speaker 113 serves to output a response voice, and the GPS module 114 serves to acquire time and location information through artificial satellites.

The relationship setting unit 108 sets an initial response character based on the call word recognized through the call word recognition unit 104, displays it through the display unit 112, and acquires it from the user basic information input unit 101. A voice conversation object is derived by learning the image information based on the user interest information and voice command keywords with a machine learning algorithm, and a voice feature matched to the derived voice conversation object is applied, and the user's emotional state obtained from the image processing unit 107 It plays a role in characterizing the voice conversation object by reflecting it, and outputting user-customized video and voice feedback.

As shown in FIG. 2, the relationship setting unit 108 acquires basic information of the user through the input unit 101 and obtains user information to acquire interest information for understanding the user's interest by analyzing the user's own applications. A unit 121, an object candidate group derivation unit 122 that searches for an object candidate group matching the acquired voice command from the object database 109, and a surrounding environment candidate group corresponding to the candidate group derived from the object candidate group derivation unit 122. A surrounding environment candidate group derivation unit 123 searching from the environment information database 110 may be included.

In addition, the relationship setting unit 108 further includes an object and surrounding environment determination unit 124 for determining a final voice conversation object and surrounding environment through artificial intelligence learning of the object candidate group and the surrounding environment candidate group based on user information. can do. The object and surrounding environment determination unit 124 may determine voice conversation objects through artificial intelligence learning, and prioritize a voice conversation object having a high preference in the same age group and gender as the user.

In addition, the relationship setting unit 108 may further include a voice characteristic search unit 126 that extracts voice characteristics of the determined voice conversation object from the voice database 111 . When the voice feature of the voice conversation object is not found in the voice database, the voice feature search unit 126 searches the voice database 111 and applies a preset voice feature.

In addition, the relationship setting unit 108 determines the object emotion expression determination unit 125 for determining the emotional expression of the object determined based on the user situation information and emotion information obtained from the image processing unit 107, and the determined voice conversation object. It may further include a customized video and response audio output unit 127 that characterizes and outputs a user-customized video and response voice including a surrounding environment corresponding to the determined voice conversation object.

3 is an exemplary diagram of a configuration of a device according to an embodiment.

The processor 302 may execute a program and control the device 301 . Codes of programs executed by the processor 302 may be stored in the memory 303 . The device 301 may be connected to an external device (eg, a personal computer or network) through an input/output device (not shown) and exchange data.

The embodiments described above may be implemented as hardware components, software components, and/or a combination of hardware components and software components. For example, the devices, methods and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate (FPGA). array), programmable logic units (PLUs), microprocessors, or any other device capable of executing and responding to instructions. A processing device may run an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of software. For convenience of understanding, there are cases in which one processing device is used, but those skilled in the art will understand that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it can include. For example, a processing device may include a plurality of processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the embodiment or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Software may include a computer program, code, instructions, or a combination of one or more of the foregoing, which configures a processing device to operate as desired or processes independently or collectively. The device can be commanded. Software and/or data may be any tangible machine, component, physical device, virtual equipment, computer storage medium or device, intended to be interpreted by or provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed on networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

As described above, although the embodiments have been described with limited drawings, those skilled in the art can apply various technical modifications and variations based on the above. For example, the described techniques may be performed in an order different from the method described, and/or components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

Claims (3)

As a virtual AI model production and AI voice matching system,
a user basic information input unit for inputting user information and setting an initial response character according to call word recognition;
a call word setting unit for setting a voice command call word;
a voice command analysis unit that analyzes a voice command uttered by a user and understands the user's emotion through acoustic analysis; and
A virtual AI model production and AI voice matching system comprising: a video processing unit that recognizes a user's face image captured through a camera and recognizes the user's situation and emotion through gesture recognition. According to claim 1,
The relationship setting unit may include an object candidate group derivation unit and an environment candidate group derivation unit for deriving an object candidate group and a surrounding environment candidate group matching the acquired voice command; Based on user information, artificial intelligence learning of the object candidate group and the surrounding environment candidate group determines the final voice conversation object and surrounding environment, and a virtual AI model production and AI using relationship setting characterized in that it includes an object and surrounding environment determining unit. Voice matching system. According to claim 1,
The relationship setting unit produces a virtual AI model and AI voice matching system, characterized in that when the voice feature of the determined voice conversation object is not in the voice database, outputs voice feedback by applying a preset basic voice feature.