CN113375295A - Method for generating virtual character interaction, interaction system, electronic device and medium - Google Patents

Method for generating virtual character interaction, interaction system, electronic device and medium Download PDF

Info

Publication number
CN113375295A
CN113375295A CN202110577069.0A CN202110577069A CN113375295A CN 113375295 A CN113375295 A CN 113375295A CN 202110577069 A CN202110577069 A CN 202110577069A CN 113375295 A CN113375295 A CN 113375295A
Authority
CN
China
Prior art keywords
information
air conditioner
virtual character
interaction
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110577069.0A
Other languages
Chinese (zh)
Inventor
张桂芳
白泽远
赵宁
吴岩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Haier Air Conditioner Gen Corp Ltd
Qingdao Haier Air Conditioning Electric Co Ltd
Haier Smart Home Co Ltd
Original Assignee
Qingdao Haier Air Conditioner Gen Corp Ltd
Qingdao Haier Air Conditioning Electric Co Ltd
Haier Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haier Air Conditioner Gen Corp Ltd, Qingdao Haier Air Conditioning Electric Co Ltd, Haier Smart Home Co Ltd filed Critical Qingdao Haier Air Conditioner Gen Corp Ltd
Priority to CN202110577069.0A priority Critical patent/CN113375295A/en
Publication of CN113375295A publication Critical patent/CN113375295A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/50Control or safety arrangements characterised by user interfaces or communication
    • F24F11/56Remote control
    • F24F11/58Remote control using Internet communication
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/50Control or safety arrangements characterised by user interfaces or communication
    • F24F11/52Indication arrangements, e.g. displays
    • F24F11/526Indication arrangements, e.g. displays giving audible indications
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/62Control or safety arrangements characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
    • F24F11/63Electronic processing
    • F24F11/64Electronic processing using pre-stored data

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides a method, an interaction system, electronic equipment and a medium for generating virtual character interaction, wherein the method comprises the following steps: identifying control information in the interactive signal; matching the operation information, the environment information and the control information with a cloud database; and outputting a virtual image with a virtual character as a main body according to the matched image synthetic text. According to the method for generating the virtual character interaction by the air conditioner, the control information is acquired by identifying the interaction signal of the user to the air conditioner, and the control information is matched with the cloud database according to the acquired running information, environment information and control information.

Description

Method for generating virtual character interaction, interaction system, electronic device and medium
Technical Field
The invention relates to the technical field of air conditioners, in particular to a method, an interaction system, electronic equipment and a medium for generating virtual character interaction.
Background
The man-machine interaction refers to the process of information exchange between a person and a computer for completing a determined task in a certain interaction mode by using a certain dialogue language between the person and the computer. With the development of computer technology and the progress of artificial intelligence technology, an intelligent human-computer interaction mode becomes the mainstream of human-computer interaction at the present stage.
The existing air conditioner generally communicates with a user through a man-machine interface and operates. For example, the operation keys, remote control, voice control and the like of the air conditioner are not intuitive in visual presentation, the interaction mode is single, the interaction state is fixed, the interaction state between people in a real environment cannot be simulated, and the interaction experience of a user is poor.
Disclosure of Invention
The embodiment of the invention provides a method, an interaction system, electronic equipment and a medium for generating virtual character interaction, and solves the problems of single interaction mode, fixed interaction state and poor interaction experience of a user of the conventional air conditioner.
The embodiment of the invention provides a method for generating virtual character interaction by an air conditioner, which comprises the following steps:
identifying control information in the interactive signal;
acquiring operation information and environmental information of an air conditioner;
matching the operation information, the environment information and the control information with a cloud database; wherein, the high in the clouds database includes: synthesizing texts on the basis of the images corresponding to the operation information, the environment information and the control information one by one;
and outputting a virtual image taking a virtual character as a main body according to the matched image synthetic text.
According to one embodiment of the present invention, there is provided a method for generating avatar interactions by an air conditioner, wherein the identifying control information in an interaction signal further includes:
determining a target object in the potential interaction objects through object feature identification;
acquiring the interactive signal output by the target object; the interactive signal includes: one or more of a voice signal, an action signal or a touch signal.
According to the method for generating the virtual character interaction by the air conditioner, provided by one embodiment of the invention, if the interaction signal is the voice signal, the control information in the interaction signal is identified; acquiring operation information and environmental information of an air conditioner; the specific steps of matching the operation information, the environment information and the control information with a cloud database comprise:
carrying out voice recognition processing on the voice signal to acquire a sound wave frequency spectrum and text information in the voice information;
the method comprises the steps of obtaining operation information and environment information of the air conditioner, matching the operation information, the environment information, the sound wave frequency spectrum and the text information with a plurality of image synthetic texts based on the weight ratio of the operation information, the environment information, the sound wave frequency spectrum and the text information to the image synthetic texts, and determining the closest image synthetic texts.
According to the method for generating the virtual character interaction by the air conditioner, provided by one embodiment of the invention, the specific steps of acquiring the operation information and the environment information of the air conditioner comprise:
acquiring operation information of the air conditioner, wherein the operation information comprises: an operating mode and an operating state;
acquiring environmental information of a space where the air conditioner is located, wherein the environmental information comprises: ambient temperature and ambient humidity.
According to one embodiment of the present invention, the method for generating a virtual character interaction by an air conditioner further comprises, before identifying control information in an interaction signal:
constructing a plurality of virtual images based on a plurality of different voice characteristics, mouth shape characteristics, expression characteristics and limb characteristics of the virtual character;
constructing a mapping relation between the virtual image and response information of the air conditioner;
and constructing the cloud database according to the mapping relation.
According to one embodiment of the present invention, the method for generating an interaction between virtual characters by an air conditioner includes the specific steps of outputting a virtual image with a virtual character as a main body according to the matched image synthetic text:
acquiring the voice feature, the mouth shape feature, the expression feature and the limb feature in the matched image synthetic text;
constructing the virtual character according to the mouth shape characteristics, the expression characteristics and the limb characteristics;
and synthesizing and outputting the virtual image according to the voice information and the virtual character.
According to the method for generating virtual character interaction by the air conditioner provided by one embodiment of the invention, if the virtual character comprises: and a plurality of different image templates, wherein the specific steps of constructing a plurality of different virtual images based on the plurality of different voice characteristics, mouth shape characteristics, expression characteristics and limb characteristics of the virtual character comprise:
and constructing the virtual images of the plurality of image templates according to the voice characteristics, the mouth shape characteristics, the expression characteristics and the limb characteristics of the plurality of image templates.
An embodiment of the present invention further provides an air conditioner interaction system, including:
the pickup module is used for identifying control information in the interactive signals;
the sensing module is used for acquiring the operation information and the environmental information of the air conditioner;
the processing module is used for matching the operation information, the environment information and the control information with a cloud database; wherein, the high in the clouds database includes: synthesizing texts on the basis of the images corresponding to the operation information, the environment information and the control information one by one;
and the output module is used for outputting the virtual image taking the virtual character as the main body according to the matched image synthetic text.
The embodiment of the invention also provides electronic equipment which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the processor executes the program, the method for generating the virtual character interaction by the air conditioner is realized.
Embodiments of the present invention also provide a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a method for generating avatar interactions by an air conditioner.
According to the method, the interaction system, the electronic device and the medium for generating the virtual character interaction, the control information is acquired by identifying the interaction signal of the user to the air conditioner, and the cloud database is matched according to the acquired running information, the environment information and the control information.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a flowchart illustrating a method for generating avatar interactions by an air conditioner according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for generating avatar interactions by an air conditioner according to another embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for generating avatar interactions by an air conditioner according to another embodiment of the present invention;
fig. 4 is a schematic structural diagram of an air conditioner interaction system according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
reference numerals: 1. a pickup module; 2. a sensing module; 3. a processing module; 4. an output module; 510. a processor; 520. a communication interface; 530. a memory; 540. a communication bus.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention provides a method for generating virtual character interaction by an air conditioner, which realizes video interaction by adding a liquid crystal screen and a loudspeaker on the air conditioner, and as shown in figure 1, the method for generating virtual character interaction by the air conditioner comprises the following steps:
step S101: control information in the interactive signal is identified.
Step S102: and acquiring the operation information and the environmental information of the air conditioner.
Step S103: matching the operation information, the environment information and the control information with a cloud database; wherein, the high in the clouds database includes: and synthesizing the texts based on the images corresponding to the operation information, the environment information and the control information one by one.
Step S104: and outputting a virtual image with a virtual character as a main body according to the matched image synthetic text.
After the interactive function of the air conditioner is started, a user can input an interactive signal to the air conditioner, and the air conditioner identifies the acquired interactive signal and can obtain control information from the interactive signal.
Meanwhile, the air conditioner acquires operation information. The operation information mainly includes an operation mode and an operation state of the air conditioner. It is thus possible to determine whether the air conditioner is normally operated, malfunctioning, dirty, or in standby. After the operation information is determined, the environment information of the space where the air conditioner is located is obtained, and the environment temperature and the environment humidity are determined.
After the control information, the operation information and the environment information are obtained, the air conditioner transmits the data to the cloud database, and the operation information, the environment information and the control information are matched with the cloud database. Because the high in the clouds database includes: based on the image synthetic texts corresponding to the operation information, the environment information and the control information one to one, the image synthetic texts corresponding to the acquired data can be matched.
After matching is finished, the cloud database transmits data to a local air conditioner, the air conditioner reads the matched image synthetic text, and the virtual image with the virtual character as the main body can be output through the liquid crystal display. In addition, if the image synthetic text contains sound, the virtual image with the virtual character as the main body can be output through the liquid crystal screen and the loudspeaker at the same time, so that the virtual character presents corresponding expressions and limb actions, and responds to the user through the character mouth shape, and the user feels that the virtual character is completely communicated with the human body.
For example, when the user operates the air conditioner, the virtual character can present different feeling states such as cold, hot, comfortable and the like according to the environment information, so that the current environment feeling and the setting state condition can be visually transmitted to the user.
And in the running process of the air conditioner, the display is carried out according to different states of the air conditioner. For example, when the air conditioner is operating normally, the virtual character is in an operating state. When the air conditioner is in failure, the virtual character is in a sick state. When the air conditioner is dirty, the virtual character is in a sloppy state. When the air conditioner is in standby, the virtual character is in a rest state.
When the user consults product service, the virtual character answers and demonstrates answers simultaneously according to different service requirements of the user, such as replacing a dust filter screen.
When the user wants to know the product function or consult for purchase, the virtual character can explain the selling point of the main function of the product and perform automatic demonstration.
According to the method for generating the virtual character interaction by the air conditioner, control information is acquired by identifying the interaction signal of the user to the air conditioner, and the air conditioner is matched with the cloud database according to the acquired running information, environment information and control information.
In order to avoid interference from other external information during the interaction between the user and the air conditioner, the method further comprises the following steps before identifying the control information in the interaction signal:
step S1001: and determining a target object in the potential interaction objects through object feature identification.
Wherein the potential interaction object refers to a subject capable of interacting with the air conditioner. For example, there may be a natural person or terminal interacting with the interactive interface.
Step S1002: acquiring an interactive signal output by a target object; the interactive signal includes: one or more of a voice signal, an action signal or a touch signal.
Specifically, before the control information in the interactive signal is identified, potential interactive objects belonging to a specific category within a predetermined range can be detected by a camera, and a preset target object can be identified from the potential interactive objects through a human face, a height, a voiceprint and the like. And then acquiring an interactive signal output by the target object through one or more combinations of the voice signal, the action signal or the touch signal output by the target object.
If the interactive signal adopted by the target object is a voice signal, the voice signal is subjected to voice recognition processing in the process of generating the virtual character, so that the sound wave frequency spectrum and the text information in the voice information are obtained, and meanwhile, the operation information and the environment information of the air conditioner are obtained.
If there is an image synthetic text in which the operation information, the environment information, the sound wave spectrum, and the text information are completely consistent, the virtual image with the virtual character as the main body can be output through the liquid crystal display and the speaker after the image synthetic text is matched, as in the above embodiment.
If no image synthetic text with completely consistent operation information, environment information, sound wave frequency spectrum and text information exists, the operation information, the environment information, the sound wave frequency spectrum and the text information can be matched with the plurality of image synthetic texts based on the weight ratio of the operation information, the environment information, the sound wave frequency spectrum and the text information to the image synthetic text, and the closest image synthetic text is determined. For example, the weight ratio of the operation information is 30%, the weight ratio of the environment information is 10%, the weight ratio of the acoustic spectrum is 10%, and the weight ratio of the text information is 50%. And determining the closest image synthetic text according to the weight ratio and the similarity between the operation information, the environment information, the sound wave spectrum and the text information and the closest data in the cloud database. For example, if the text information is the same as a text information in the cloud database, but the operation information, the environment information, and the sound wave spectrum are not found to be consistent, the matching result is an image synthesized text corresponding to the text information. The operation information is the same as the operation information in the cloud database, but the text information, the environment information and the sound wave frequency spectrum are not consistent, and the matching result is the image synthesis text corresponding to the text information because the weight of the operation information is greater than that of the environment information and the sound wave frequency spectrum. And finally, after the image synthetic text is matched, outputting a virtual image taking a virtual character as a main body through a liquid crystal screen and a loudspeaker.
In another embodiment provided by the present invention, as shown in fig. 2, before identifying the control information in the interaction signal, a cloud database needs to be constructed, which includes the following steps:
step S1003: and constructing a plurality of virtual images based on a plurality of different voice characteristics, mouth shape characteristics, expression characteristics and limb characteristics of the virtual character.
Step S1004: and constructing a mapping relation between the virtual image and the response information of the air conditioner.
Step S1005: and constructing a cloud database according to the mapping relation.
In the process of constructing the cloud database, various different voice characteristics, mouth shape characteristics, expression characteristics and limb characteristics are arranged and combined to form different virtual images, and the mapping relation between the virtual images and corresponding information to be expressed by the air conditioner is constructed. For example, when the air conditioner is operating normally, the virtual character is in an operating state. When the air conditioner is in failure, the virtual character is in a sick state. When the air conditioner is dirty, the virtual character is in a sloppy state. When the air conditioner is in standby, the virtual character is in a rest state. And finally, constructing a cloud database according to the set of the mapping relations.
The virtual character can be provided with a plurality of groups of different image templates according to needs. According to the voice characteristics, the mouth shape characteristics, the expression characteristics and the limb characteristics of the image templates, virtual images of the image templates with different styles can be constructed.
In another embodiment of the present invention, as shown in fig. 3, the specific steps of outputting the virtual image with the virtual character as the main body include:
step S1041: and acquiring the voice feature, the mouth shape feature, the expression feature and the limb feature in the matched image synthetic text.
Step S1042: and constructing the virtual character according to the mouth shape characteristics, the expression characteristics and the limb characteristics.
Step S1043: and synthesizing and outputting the virtual image according to the voice information and the virtual character.
Specifically, after the matched image synthesized text is obtained, the data in the image synthesized text is firstly split to obtain the voice feature, the mouth shape feature, the expression feature and the limb feature. And then constructing a virtual character by using the obtained mouth shape characteristics, expression characteristics and limb characteristics. And voice information is guided into the virtual character by using the audio encoder, and a virtual image with synchronous sound and picture is synthesized and output by using the liquid crystal screen and the loudspeaker.
In the process of synthesizing the virtual image, a plurality of virtual characters may be provided in the same virtual image, and the voice information may be introduced into the corresponding virtual character to synthesize a virtual image in which the plurality of virtual characters are provided and the sound and the picture are synchronized.
An embodiment of the present invention further provides an air conditioner interaction system, as shown in fig. 4, the air conditioner interaction system includes: pickup module 1, perception module 2, processing module 3, output module 4 and communication module.
The communication module is electrically connected with the pickup module 1, the sensing module 2, the processing module 3 and the output module 4 at the same time, and is mainly used for data transmission. The sound pickup module 1 comprises a microphone, which can convert sound waves into electric signals for identifying control information in the interaction signals. The sensing module 2 is used for acquiring the operation information and the environmental information of the air conditioner. The processing module 3 is used as a core module of the whole system and is used for matching the operation information, the environment information and the control information with a cloud database; wherein, the high in the clouds database includes: and synthesizing the texts based on the images corresponding to the operation information, the environment information and the control information one by one. The output module 4 is used for outputting a virtual image with a virtual character as a main body according to the matched image synthetic text, and is divided into an audio playing module and a display module, wherein the audio playing module plays text synthetic audio, and the display module is a user interaction interface and can present different virtual characters.
After the interactive function of the air conditioner is started, a user inputs an interactive signal through the sound pickup module 1, and the sound pickup module 1 identifies the acquired interactive signal and can obtain control information from the interactive signal.
At the same time, the sensing module 2 acquires the operation information. The operation information mainly includes an operation mode and an operation state of the air conditioner. It is thus possible to determine whether the air conditioner is normally operated, malfunctioning, dirty, or in standby. After the operation information is determined, the sensing module 2 starts to acquire the environmental information of the space where the air conditioner is located, and determines the environmental temperature and the environmental humidity.
After acquiring the control information, the operation information and the environment information, the processing module 3 matches the operation information, the environment information and the control information with the cloud database. Because the high in the clouds database includes: based on the image synthetic texts corresponding to the operation information, the environment information and the control information one to one, the image synthetic texts corresponding to the acquired data can be matched.
After the processing module 3 finishes matching, the output module 4 reads the matched image synthetic text, and can output a virtual image with a virtual character as a main body through the liquid crystal display.
The present invention also provides an electronic device, as shown in fig. 5, the electronic device may include: a processor (processor)510, a communication Interface (Communications Interface)520, a memory (memory)530 and a communication bus 540, wherein the processor 510, the communication Interface 520 and the memory 530 communicate with each other via the communication bus 540. Processor 510 may invoke logic instructions in memory 530 to perform a method for the air conditioner to generate avatar interactions.
The method for generating the virtual character interaction by the air conditioner comprises the following steps:
step S101: control information in the interactive signal is identified.
Step S102: and acquiring the operation information and the environmental information of the air conditioner.
Step S103: matching the operation information, the environment information and the control information with a cloud database; wherein, the high in the clouds database includes: and synthesizing the texts based on the images corresponding to the operation information, the environment information and the control information one by one.
Step S104: and outputting a virtual image with a virtual character as a main body according to the matched image synthetic text.
Furthermore, the logic instructions in the memory 530 may be implemented in the form of software functional units and stored in a computer readable storage medium when the software functional units are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product comprising a computer program stored on a computer-readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform the method for generating virtual character interactions by an air conditioner provided by the above methods.
In still another aspect, the present invention further provides a computer-readable storage medium, which stores a computer program, which when read and executed by a processor, implements the method for generating avatar interactions by an air conditioner.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
In summary, according to the method, the interactive system, the electronic device and the medium for generating virtual character interaction provided by the invention, the control information is acquired by identifying the interaction signal of the user to the air conditioner, and the control information is matched with the cloud database according to the acquired running information, environment information and control information.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A method for generating virtual character interaction by an air conditioner is characterized by comprising the following steps:
identifying control information in the interactive signal;
acquiring operation information and environmental information of an air conditioner;
matching the operation information, the environment information and the control information with a cloud database; wherein, the high in the clouds database includes: synthesizing texts on the basis of the images corresponding to the operation information, the environment information and the control information one by one;
and outputting a virtual image taking a virtual character as a main body according to the matched image synthetic text.
2. The method of claim 1, wherein the identifying the control information in the interaction signal further comprises:
determining a target object in the potential interaction objects through object feature identification;
acquiring the interactive signal output by the target object; the interactive signal includes: one or more of a voice signal, an action signal or a touch signal.
3. The method as claimed in claim 2, wherein if the interactive signal is the voice signal, the control information in the interactive signal is recognized; acquiring operation information and environmental information of an air conditioner; the specific steps of matching the operation information, the environment information and the control information with a cloud database comprise:
carrying out voice recognition processing on the voice signal to acquire a sound wave frequency spectrum and text information in the voice information;
the method comprises the steps of obtaining operation information and environment information of the air conditioner, matching the operation information, the environment information, the sound wave frequency spectrum and the text information with a plurality of image synthetic texts based on the weight ratio of the operation information, the environment information, the sound wave frequency spectrum and the text information to the image synthetic texts, and determining the closest image synthetic texts.
4. The method for generating avatar interaction for air conditioner of claim 1, wherein said step of obtaining the operation information and environment information of the air conditioner comprises:
acquiring operation information of the air conditioner, wherein the operation information comprises: an operating mode and an operating state;
acquiring environmental information of a space where the air conditioner is located, wherein the environmental information comprises: ambient temperature and ambient humidity.
5. The method as claimed in any one of claims 1 to 4, wherein the identifying the control information in the interactive signal further comprises:
constructing a plurality of virtual images based on a plurality of different voice characteristics, mouth shape characteristics, expression characteristics and limb characteristics of the virtual character;
constructing a mapping relation between the virtual image and response information of the air conditioner;
and constructing the cloud database according to the mapping relation.
6. The method as claimed in claim 5, wherein the step of outputting the virtual image with the virtual character as the main body according to the matched image synthetic text comprises:
acquiring the voice feature, the mouth shape feature, the expression feature and the limb feature in the matched image synthetic text;
constructing the virtual character according to the mouth shape characteristics, the expression characteristics and the limb characteristics;
and synthesizing and outputting the virtual image according to the voice information and the virtual character.
7. The method as claimed in claim 5, wherein if the virtual character comprises: and a plurality of different image templates, wherein the specific steps of constructing a plurality of different virtual images based on the plurality of different voice characteristics, mouth shape characteristics, expression characteristics and limb characteristics of the virtual character comprise:
and constructing the virtual images of the plurality of image templates according to the voice characteristics, the mouth shape characteristics, the expression characteristics and the limb characteristics of the plurality of image templates.
8. An air conditioner interaction system, comprising:
the pickup module is used for identifying control information in the interactive signals;
the sensing module is used for acquiring the operation information and the environmental information of the air conditioner;
the processing module is used for matching the operation information, the environment information and the control information with a cloud database; wherein, the high in the clouds database includes: synthesizing texts on the basis of the images corresponding to the operation information, the environment information and the control information one by one;
and the output module is used for outputting the virtual image taking the virtual character as the main body according to the matched image synthetic text.
9. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program implements a method for generating avatar interactions by an air conditioner as claimed in any of claims 1 to 7.
10. A non-transitory computer readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements a method for generating avatar interactions by an air conditioner according to any of claims 1 to 7.
CN202110577069.0A 2021-05-26 2021-05-26 Method for generating virtual character interaction, interaction system, electronic device and medium Pending CN113375295A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110577069.0A CN113375295A (en) 2021-05-26 2021-05-26 Method for generating virtual character interaction, interaction system, electronic device and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110577069.0A CN113375295A (en) 2021-05-26 2021-05-26 Method for generating virtual character interaction, interaction system, electronic device and medium

Publications (1)

Publication Number Publication Date
CN113375295A true CN113375295A (en) 2021-09-10

Family

ID=77571984

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110577069.0A Pending CN113375295A (en) 2021-05-26 2021-05-26 Method for generating virtual character interaction, interaction system, electronic device and medium

Country Status (1)

Country Link
CN (1) CN113375295A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114818609A (en) * 2022-06-29 2022-07-29 阿里巴巴达摩院(杭州)科技有限公司 Interaction method for virtual object, electronic device and computer storage medium
CN115052030A (en) * 2022-06-27 2022-09-13 北京蔚领时代科技有限公司 Virtual digital person control method and system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6595430B1 (en) * 2000-10-26 2003-07-22 Honeywell International Inc. Graphical user interface system for a thermal comfort controller
CN101778198A (en) * 2010-01-25 2010-07-14 上海享云信息系统有限公司 Enhanced-type TV terminal system
CN103822330A (en) * 2014-01-21 2014-05-28 茹祥忠 Far-end intelligent energy-saving control system and method for central air-conditioner
CN110822648A (en) * 2019-11-25 2020-02-21 广东美的制冷设备有限公司 Air conditioner, control method thereof, and computer-readable storage medium
CN110822643A (en) * 2019-11-25 2020-02-21 广东美的制冷设备有限公司 Air conditioner, control method thereof and computer storage medium
CN112465935A (en) * 2020-11-19 2021-03-09 科大讯飞股份有限公司 Virtual image synthesis method and device, electronic equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6595430B1 (en) * 2000-10-26 2003-07-22 Honeywell International Inc. Graphical user interface system for a thermal comfort controller
CN101778198A (en) * 2010-01-25 2010-07-14 上海享云信息系统有限公司 Enhanced-type TV terminal system
CN103822330A (en) * 2014-01-21 2014-05-28 茹祥忠 Far-end intelligent energy-saving control system and method for central air-conditioner
CN110822648A (en) * 2019-11-25 2020-02-21 广东美的制冷设备有限公司 Air conditioner, control method thereof, and computer-readable storage medium
CN110822643A (en) * 2019-11-25 2020-02-21 广东美的制冷设备有限公司 Air conditioner, control method thereof and computer storage medium
CN112465935A (en) * 2020-11-19 2021-03-09 科大讯飞股份有限公司 Virtual image synthesis method and device, electronic equipment and storage medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115052030A (en) * 2022-06-27 2022-09-13 北京蔚领时代科技有限公司 Virtual digital person control method and system
CN114818609A (en) * 2022-06-29 2022-07-29 阿里巴巴达摩院(杭州)科技有限公司 Interaction method for virtual object, electronic device and computer storage medium
CN114818609B (en) * 2022-06-29 2022-09-23 阿里巴巴达摩院(杭州)科技有限公司 Interaction method for virtual object, electronic device and computer storage medium

Similar Documents

Publication Publication Date Title
CN109147784B (en) Voice interaction method, device and storage medium
CN113375295A (en) Method for generating virtual character interaction, interaction system, electronic device and medium
RU2720359C1 (en) Method and equipment for recognizing emotions in speech
CN111290682A (en) Interaction method and device and computer equipment
CN111475020A (en) Information interaction method, interaction device, electronic equipment and storage medium
CN112652041B (en) Virtual image generation method and device, storage medium and electronic equipment
CN113436602A (en) Virtual image voice interaction method and device, projection equipment and computer medium
WO2021223724A1 (en) Information processing method and apparatus, and electronic device
CN111291151A (en) Interaction method and device and computer equipment
CN110822641A (en) Air conditioner, control method and device thereof and readable storage medium
CN111273775A (en) Augmented reality glasses, KTV implementation method based on augmented reality glasses and medium
WO2020213468A1 (en) Information processing system, information processing method, and program
CN112365957A (en) Psychological treatment system based on virtual reality
CN113205569A (en) Image drawing method and device, computer readable medium and electronic device
CN117313785A (en) Intelligent digital human interaction method, device and medium based on weak population
CN112365956A (en) Psychological treatment method, psychological treatment device, psychological treatment server and psychological treatment storage medium based on virtual reality
CN116737883A (en) Man-machine interaction method, device, equipment and storage medium
CN112381926A (en) Method and apparatus for generating video
CN116185191A (en) Server, display equipment and virtual digital human interaction method
CN115223224A (en) Digital human speaking video generation method, system, terminal device and medium
KR20060091329A (en) Interactive system and method for controlling an interactive system
CN117370605A (en) Virtual digital person driving method, device, equipment and medium
CN114999441A (en) Avatar generation method, apparatus, device, storage medium, and program product
CN110718119A (en) Educational ability support method and system based on wearable intelligent equipment special for children
US20240096329A1 (en) Qa tv-making millions of characters alive

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination