CN114422740A - Virtual scene interaction method and system for instant messaging and video - Google Patents
Virtual scene interaction method and system for instant messaging and video Download PDFInfo
- Publication number
- CN114422740A CN114422740A CN202111605481.5A CN202111605481A CN114422740A CN 114422740 A CN114422740 A CN 114422740A CN 202111605481 A CN202111605481 A CN 202111605481A CN 114422740 A CN114422740 A CN 114422740A
- Authority
- CN
- China
- Prior art keywords
- character
- cartoon character
- user input
- scene
- cartoon
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 62
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000009471 action Effects 0.000 claims abstract description 49
- 230000001815 facial effect Effects 0.000 claims description 46
- 238000004891 communication Methods 0.000 claims description 19
- 230000014509 gene expression Effects 0.000 claims description 19
- 230000003321 amplification Effects 0.000 claims description 8
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 8
- 230000000694 effects Effects 0.000 description 12
- 230000000875 corresponding effect Effects 0.000 description 9
- 230000033001 locomotion Effects 0.000 description 7
- 230000008859 change Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000002452 interceptive effect Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000007654 immersion Methods 0.000 description 3
- 230000036651 mood Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/043—Real-time or near real-time messaging, e.g. instant messaging [IM] using or handling presence information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/10—Multimedia information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Engineering & Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a virtual scene interaction method and system for instant messaging and videos, and relates to the field of interaction systems. A virtual scene interaction method for instant messaging and video comprises the following steps: uploading a character photo and converting the character photo into a 3D cartoon character, so that the 3D cartoon character can execute a specified action according to a user input instruction; setting up the scene of above-mentioned 3D animation personage, above-mentioned appointed action includes moves above-mentioned 3D animation personage to the assigned position of above-mentioned scene, can realize people and fictitious object's interdynamic, satisfies the psychological demand in people's real life.
Description
Technical Field
The invention relates to the field of interactive systems, in particular to a virtual scene interactive method and system for instant messaging and videos.
Background
At present, instant messaging and videos are real person-to-person communication, but sometimes private messages or feelings of abreaction in mind, or nobody can't tell, and some people are inconvenient to find people or cannot find suitable objects. Therefore, the person-to-person communication is far from satisfying the complaint desire of the person or the inconvenient place. In order to solve the above problems, the present application provides a virtual scene interaction method and system for instant messaging and video, which satisfy the psychological needs of people in real life.
Disclosure of Invention
The invention aims to provide a virtual scene interaction method for instant messaging and videos, which can realize the interaction between people and virtual objects and meet the psychological needs of people in real life.
Another objective of the present invention is to provide a virtual scene interaction system for instant messaging and video, which can realize the interaction between people and virtual objects, and satisfy the psychological needs of people in real life.
The embodiment of the invention is realized by the following steps:
in a first aspect, an embodiment of the present application provides a virtual scene interaction method for instant messaging and video, which includes the following steps: uploading a character photo and converting the character photo into a 3D cartoon character, so that the 3D cartoon character can execute a specified action according to a user input instruction; setting a scene of the 3D cartoon character, wherein the specified action comprises moving the 3D cartoon character to a specified position of the scene.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: and the appointed action comprises voice communication, and AI intelligent voice is synthesized to the 3D cartoon character for the 3D cartoon character to communicate with the voice of the user according to the user input instruction.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: the above-mentioned specified actions include any one or more of chatting, dancing, singing, and speaking a joke.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: the user input command is set at any position of the scene, and the user input command are positioned at the same position by dragging the 3D cartoon character/the user input command, so that the 3D cartoon character can execute the designated action corresponding to the user input command.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: and the user replaces or newly creates the 3D cartoon character by uploading different character photos.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: the user inputs the user input instruction through language or motion.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: and the user establishes a personal associated account and provides the personal associated account to interact with the 3D cartoon character.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: uploading a plurality of the character photos with different expressions, identifying facial features of the character photos, selecting one or more facial features with small changes under different expressions as facial reference features, selecting one or more facial features with large differences from common facial features as facial personality features, selecting one or more facial features with large changes under different expressions as facial amplification features, amplifying any one or more facial amplification features, and generating the face image of the 3D cartoon character by using a plurality of facial features after repeating any one or more facial personality features.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: any one of the scenes is provided with a plurality of operation fields, any one of the appointed actions comprises finishing operation items in the operation fields in sequence, and the operation time of different operation items is set according to the user input instruction.
In a second aspect, an embodiment of the present application provides a virtual scene interaction system for instant messaging and video, which includes:
virtual portrait module: the system comprises a camera, a camera and a controller, wherein the camera is used for uploading a character photo and converting the character photo into a 3D cartoon character, and the 3D cartoon character executes a specified action according to a user input instruction;
a scene operation module: the scene for setting the 3D cartoon character, the specified action comprises moving the 3D cartoon character to the specified position of the scene.
Compared with the prior art, the embodiment of the invention has at least the following advantages or beneficial effects:
in a first aspect, an embodiment of the present application provides a virtual scene interaction method for instant messaging and video, which includes the following steps: uploading a character photo and converting the character photo into a 3D cartoon character, so that the 3D cartoon character can execute a specified action according to a user input instruction; setting a scene of the 3D cartoon character, wherein the specified action comprises moving the 3D cartoon character to a specified position of the scene.
In a second aspect, an embodiment of the present application provides a virtual scene interaction system for instant messaging and video, which includes: virtual portrait module: the system comprises a camera, a camera and a controller, wherein the camera is used for uploading a character photo and converting the character photo into a 3D cartoon character, and the 3D cartoon character executes a specified action according to a user input instruction; a scene operation module: the scene for setting the 3D cartoon character, the specified action comprises moving the 3D cartoon character to the specified position of the scene.
With respect to the first to second aspects: according to the embodiment of the application, the person photos are uploaded and converted into the 3D cartoon persons, so that the communication and interaction comfort of people can be improved, and the psychological needs of people can be met; the 3D cartoon characters execute the designated actions according to the user input instructions, so that the interaction effect is improved, and the interaction interest of people is enhanced; by setting the scene of the 3D cartoon character, the interestingness of human-computer interaction is stronger, and the immersion degree and the comfort of people are improved through the scene; the 3D cartoon character is moved to any position of the scene through the appointed action, so that the personification of the 3D cartoon character is improved, and the interaction effect is good. Through this application, establish virtual 3D animation personage and virtual scene according to the personage photo, can improve virtual personage's personification, help people relax and the mood is joyful to guide user to use and fall out, compare with the direct communication of people with people, solved the problem that is not convenient for select the object of communication, and move 3D animation personage according to the operation and carry out the interaction, can improve the taste effect.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a schematic flowchart of a virtual scene interaction method for instant messaging and video according to embodiment 1 of the present invention;
fig. 2 is a schematic diagram of a virtual scene interaction system for instant messaging and video according to embodiment 2 of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the description of the present application, it is also to be noted that, unless otherwise explicitly specified or limited, the terms "disposed" and "connected" are to be interpreted broadly, e.g., as being either fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the individual features of the embodiments can be combined with one another without conflict.
Example 1
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a virtual scene interaction method for instant messaging and video according to an embodiment of the present disclosure. A virtual scene interaction method for instant messaging and video comprises the following steps: uploading a character photo and converting the character photo into a 3D cartoon character, so that the 3D cartoon character can execute a specified action according to a user input instruction; setting a scene of the 3D cartoon character, wherein the specified action comprises moving the 3D cartoon character to a specified position of the scene.
In detail, when the computer is used for the operation, the uploaded character photo can be a photo of the user or a photo of another person, an electronic version of the character photo is uploaded through a network, and the portrait characteristics are obtained according to the character photo, so that a 3D cartoon character corresponding to the character image is obtained. The portrait characteristics can include any one of human face characteristics, gender characteristics and body characteristics, a 3D cartoon character is generated according to the face and/or body characteristics of the portrait characteristics, and the 3D cartoon character can be set to be a half body or a whole body. In detail, the 3D cartoon character performs a corresponding action according to an instruction input by the user. The user input instruction can be any conventional manner, such as gesture motion control or voice control, wherein gesture recognition and voice recognition can be implemented by using the prior art, and the 3D cartoon character is controlled to execute different motions according to different instructions input by the user. Optionally, a scene of the 3D cartoon character is set, and the scene may be a real scene or a virtual scene, so as to simulate a human-computer interaction scene. Optionally, the scenes may include indoor, outdoor, seaside, kitchen, etc., with different scenes being selected manually. In detail, the designated action includes moving the 3D cartoon character to any one position of the scene, thereby improving interactivity. Wherein the designated action may further include an action posture change or a consistency operation of the 3D cartoon character.
When the method is applied, the method interacts with the 3D cartoon characters in a live broadcast mode through mobile phone connection, and is used when the method is directly broadcast through a short video platform. Optionally, the uploaded photos can be replaced by a video format, so that 3D pictures can be collected conveniently, and the pictures can be converted into 3D cartoon characters. The mode that the video converts into the 3D cartoon figure is the process that can adopt above-mentioned photo conversion to it is more vivid to make the interactive mode of 3D cartoon figure through gathering dynamic motion. When the method is implemented by using a software program, the designed 3D cartoon characters can be stored by using a cloud end, so that the 3D cartoon characters can be conveniently selected by a user at any time.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: and the appointed action comprises voice communication, and AI intelligent voice is synthesized to the 3D cartoon character for the 3D cartoon character to communicate with the voice of the user according to the user input instruction.
In detail, the 3D cartoon character communicates with the user's voice according to the user input command, wherein the user input command may be specific voice content, and the control user moves to the designated location or specific voice content, such as chatting with me, moving to a certain location, or performing a certain operation. The AI intelligent voice technology is prior art and is not limited herein.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: the above-mentioned specified actions include any one or more of chatting, dancing, singing, and speaking a joke.
In detail, the specified action may be to control the 3D cartoon character to perform voice communication with the user, or to control the 3D cartoon character to complete the specified action.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: the user input command is set at any position of the scene, and the user input command are positioned at the same position by dragging the 3D cartoon character/the user input command, so that the 3D cartoon character can execute the designated action corresponding to the user input command.
In detail, the user input instruction is actually arranged at any position of the scene, for example, the user input instruction is represented in the scene by using characters or pictures, so that manual operation is facilitated. In detail, the 3D cartoon character is dragged or the user input instruction is dragged to enable the 3D cartoon character to be overlapped with the user input instruction, so that the 3D cartoon character is triggered to complete the appointed action corresponding to the user input instruction, and the interaction interestingness of the user and the cartoon character is improved.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: and the user replaces or newly creates the 3D cartoon character by uploading different character photos.
In detail, the image of the 3D cartoon character is replaced by uploading different character pictures, or a plurality of 3D cartoon characters are obtained by newly creating a 3D cartoon character. And, the user can interact with different 3D cartoon characters respectively, also can interact with a plurality of 3D cartoon characters simultaneously. Optionally, a plurality of 3D cartoon characters can communicate with the user respectively in sequence, and different 3D cartoon characters make expression and action responses according to user input instructions input by other 3D cartoon characters, further improving the diversity of scene interaction.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: the user inputs the user input instruction through language or motion.
In detail, the user inputs through language or motion, so that the user input instruction is obtained according to voice or motion recognition.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: and the user establishes a personal associated account and provides the personal associated account to interact with the 3D cartoon image.
In detail, the user establishes one or more associated accounts, so that a 3D cartoon image is established for family or friends to interact with the family or friends, wherein the 3D cartoon image can be the user's own image, so that the social contact of the user with other people is simulated, and the self-confidence of making friends of the user is improved. The personal association account can be a stranger, so that people can conveniently select according to the specific 3D cartoon image, and the personal association account and the user can communicate with the 3D cartoon image at the same time, so that friend making between different users is further promoted. Optionally, the user may authorize the associated account, allow the user to operate the 3D cartoon character, or remotely operate the 3D cartoon character to interact with the associated account, such as controlling the 3D cartoon character to move or directly communicate with the associated account through the 3D cartoon character. The communication between the 3D cartoon character and the associated account can be realized by using an AI intelligent voice technology, and the voice of the user can be transmitted or processed by changing voice in a 3D cartoon character recording mode and then communicated with the associated account, wherein the voice messages between the associated account and the user are mutually transmitted through a network. Optionally, the users can chat with the 3D cartoon image of the friend by adding the friend.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: uploading a plurality of the character photos with different expressions, identifying facial features of the character photos, selecting one or more facial features with small changes under different expressions as facial reference features, selecting one or more facial features with large differences from common facial features as facial personality features, selecting one or more facial features with large changes under different expressions as facial amplification features, amplifying any one or more facial amplification features, and generating the face image of the 3D cartoon character by using a plurality of facial features after repeating any one or more facial personality features. (dynamic change)
In detail, the photos of the people with different expressions are uploaded, wherein the photos of the people can be uploaded after being photographed in real time. In detail, the facial features of the photo of the person are recognized through a face recognition technology. And whether the facial feature recognition is the conventional feature judgment is utilized to obtain the facial personalized features with larger differences. The conventional facial features or the individual facial features can be stored in the database, and the facial features stored in the database are compared with the facial features obtained through recognition to obtain a plurality of unconventional facial individual features of the character photo. The facial personality can be that a specific position of the face has a mole, an eye-type upper pick, and a certain area of the face has a spot. And the facial personality characteristics are obtained by adopting a plurality of character photos with different expressions, so that the facial personality characteristics can be obtained by identifying different expressions, personal characteristic identification errors caused by expression change are eliminated, and the personification effect of the 3D cartoon character image is improved. In detail, the facial features with large changes under different expressions are used as the face amplification features, 3D cartoon characters are generated in an exaggerated mode, the facial personalized features are generated repeatedly, the personal personalized features can be enhanced, and the personifying and interesting effects are improved. And the human face image of the 3D cartoon character is generated by adopting any one or more face amplification characteristics, any one or more face personalized characteristics and one or more other human face characteristics, so that diversified and personalized 3D cartoon characters can be generated. In detail, the human face image can be spliced into different cartoon bodies, and the cartoon bodies can be arranged corresponding to the expression characteristics or the long-phase characteristics of the human face image, so that the human body can be conveniently used for finishing the designated action. The designated action may include a change of an expression and a body action, the expression change may be set up with a plurality of mark points according to the five sense organs so as to adjust the expression by moving each mark point, and similarly, the body action may also be changed by using the above manner.
In some embodiments of the present invention, the above virtual scene interaction method for instant messaging and video further includes the following steps: any one of the scenes is provided with a plurality of operation fields, any one of the appointed actions comprises finishing operation items in the operation fields in sequence, and the operation time of different operation items is set according to the user input instruction.
In detail, any scene is provided with a plurality of operation sites for people to control the 3D cartoon characters to move to each operation site. In detail, the designated action comprises the step of completing corresponding operation items in a plurality of operation places in sequence, so that the plurality of operation items are completed in sequence according to the user input instruction, and the interactivity is improved. For example, when the scene is a kitchen, the corresponding multiple operation sites may be a washing area, a cutting area and a frying area.
Example 2
Referring to fig. 2, an embodiment of the present application provides a virtual scene interaction system for instant messaging and video, including: virtual portrait module: the system comprises a camera, a camera and a controller, wherein the camera is used for uploading a character photo and converting the character photo into a 3D cartoon character, and the 3D cartoon character executes a specified action according to a user input instruction; a scene operation module: the scene for setting the 3D cartoon character, the specified action comprises moving the 3D cartoon character to the specified position of the scene.
The principle of the embodiment of the present application is the same as that of embodiment 1, and a repeated description thereof will not be provided.
In application, the memory may be used to store software programs and modules, such as program instructions/modules corresponding to the virtual scene interaction system for instant messaging and video provided in the embodiments of the present application, and the processor executes various functional applications and data processing by executing the software programs and modules stored in the memory. The communication interface may be used for communicating signaling or data with other node devices. The memory, processor and communication interface are electrically connected to each other, directly or indirectly, to enable transfer or interaction of data. For example, the components may be electrically connected to each other via one or more communication buses or signal lines.
The Memory may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like.
The processor may be an integrated circuit chip having signal processing capabilities. The Processor 102 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
It will be appreciated that the configuration shown in fig. 2 is merely illustrative and that the virtual scene interaction system for instant messaging and video may include more or fewer components than shown in fig. 2 or have a different configuration than shown in fig. 2. The components shown in fig. 2 may be implemented in hardware, software, or a combination thereof.
According to the embodiment of the application, the person photos are uploaded and converted into the 3D cartoon persons, so that the communication and interaction comfort of people can be improved, and the psychological needs of people can be met; the 3D cartoon characters execute the designated actions according to the user input instructions, so that the interaction effect is improved, and the interaction interest of people is enhanced; by setting the scene of the 3D cartoon character, the interestingness of human-computer interaction is stronger, and the immersion degree and the comfort of people are improved through the scene; the 3D cartoon character is moved to any position of the scene through the appointed action, so that the personification of the 3D cartoon character is improved, and the interaction effect is good. Through this application, establish virtual 3D animation personage and virtual scene according to the personage photo, can improve virtual personage's personification, help people relax and the mood is joyful to guide user to use and fall out, compare with the direct communication of people with people, solved the problem that is not convenient for select the object of communication, and move 3D animation personage according to the operation and carry out the interaction, can improve the taste effect. The user uploads the character image of the 3D cartoon character according to own preference, creates a virtual character and an environment, and performs interactive operation, so that the intimacy of the cartoon character is improved, and the interactive and entertainment effects are good. In addition, the method and the system can also be used in scenes of instant messaging and videos.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The above-described functions, if implemented in the form of software functional modules and sold or used as a separate product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-described method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
To sum up, the embodiment of the present application provides a virtual scene interaction method and system for instant messaging and video:
according to the embodiment of the application, the person photos are uploaded and converted into the 3D cartoon persons, so that the communication and interaction comfort of people can be improved, and the psychological needs of people can be met; the 3D cartoon characters execute the designated actions according to the user input instructions, so that the interaction effect is improved, and the interaction interest of people is enhanced; by setting the scene of the 3D cartoon character, the interestingness of human-computer interaction is stronger, and the immersion degree and the comfort of people are improved through the scene; the 3D cartoon character is moved to any position of the scene through the appointed action, so that the personification of the 3D cartoon character is improved, and the interaction effect is good. Through this application, establish virtual 3D animation personage and virtual scene according to the personage photo, can improve virtual personage's personification, help people relax and the mood is joyful to guide user to use and fall out, compare with the direct communication of people with people, solved the problem that is not convenient for select the object of communication, and move 3D animation personage according to the operation and carry out the interaction, can improve the taste effect.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
It will be evident to those skilled in the art that the present application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Claims (10)
1. A virtual scene interaction method for instant messaging and video is characterized by comprising the following steps: uploading a character photo and converting the character photo into a 3D cartoon character, so that the 3D cartoon character can execute a specified action according to a user input instruction; setting a scene of the 3D cartoon character, wherein the specified action comprises moving the 3D cartoon character to a specified position of the scene.
2. The method of claim 1, further comprising the steps of: and the appointed action comprises voice communication, and AI intelligent voice is synthesized to the 3D cartoon character for the 3D cartoon character to communicate with the voice of the user according to the user input instruction.
3. The method of claim 1, further comprising the steps of: the specified action includes any one or more of chatting, dancing, singing, and speaking a joke.
4. The method of claim 1, further comprising the steps of: the user input instruction is arranged at any position of the scene, and the 3D cartoon character/the user input instruction is dragged to enable the user input instruction and the user input instruction to be located at the same position, so that the 3D cartoon character can execute the designated action corresponding to the user input instruction.
5. The method of claim 1, further comprising the steps of: and the user replaces or newly builds the 3D cartoon character by uploading different character photos.
6. The method of claim 1, further comprising the steps of: the user inputs the user input instruction through a language or an action.
7. The method of claim 1, further comprising the steps of: and the user establishes a personal associated account and provides the personal associated account for interacting with the 3D cartoon character.
8. The method of claim 1, further comprising the steps of: uploading a plurality of the character photos with different expressions, identifying facial features of the character photos, selecting one or more facial features with small changes under different expressions as facial reference features, selecting one or more facial features with large differences from common facial features as facial personality features, selecting one or more facial features with large changes under different expressions as facial amplification features, amplifying any one or more facial amplification features, and generating a human face image of the 3D cartoon character by using a plurality of facial features after repeating any one or more facial personality features.
9. The method of claim 1, further comprising the steps of: any one scene is provided with a plurality of operation sites, any one appointed action comprises the completion of operation items in the plurality of operation sites in sequence, and the operation time of different operation items is set according to the user input instruction.
10. A virtual scene interaction system for instant messaging and video, comprising:
virtual portrait module: the system comprises a user input module, a storage module and a display module, wherein the user input module is used for uploading a character photo and converting the character photo into a 3D cartoon character, and the 3D cartoon character executes a specified action according to a user input instruction;
a scene operation module: setting a scene of the 3D cartoon character, the specified action including moving the 3D cartoon character to a specified position of the scene.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111605481.5A CN114422740A (en) | 2021-12-25 | 2021-12-25 | Virtual scene interaction method and system for instant messaging and video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111605481.5A CN114422740A (en) | 2021-12-25 | 2021-12-25 | Virtual scene interaction method and system for instant messaging and video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114422740A true CN114422740A (en) | 2022-04-29 |
Family
ID=81268637
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111605481.5A Pending CN114422740A (en) | 2021-12-25 | 2021-12-25 | Virtual scene interaction method and system for instant messaging and video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114422740A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107396001A (en) * | 2017-08-30 | 2017-11-24 | 郝翻翻 | A kind of method of record personal |
| WO2018107918A1 (en) * | 2016-12-15 | 2018-06-21 | 腾讯科技（深圳）有限公司 | Method for interaction between avatars, terminals, and system |
| CN110286751A (en) * | 2019-02-26 | 2019-09-27 | 深圳市看见网络科技有限公司 | A kind of virtual scene digital applications exchange method |
| CN111045582A (en) * | 2019-11-28 | 2020-04-21 | 深圳市木愚科技有限公司 | Personalized virtual portrait activation interaction system and method |
| CN111833418A (en) * | 2020-07-14 | 2020-10-27 | 北京百度网讯科技有限公司 | Animation interaction method, device, equipment and storage medium |
| KR102219367B1 (en) * | 2020-07-01 | 2021-02-24 | 주식회사 씨몬 | Method, apparatus, and system of online virtual 3d exhibition |
| CN112925411A (en) * | 2021-01-20 | 2021-06-08 | 深圳市金大智能创新科技有限公司 | Implementation method based on interaction with virtual character, intelligent sound box and intelligent terminal |
| CN113593013A (en) * | 2021-07-21 | 2021-11-02 | 吴浩诚 | Interaction method, system, terminal and VR (virtual reality) equipment based on VR dead person simulation |
-
2021
- 2021-12-25 CN CN202111605481.5A patent/CN114422740A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018107918A1 (en) * | 2016-12-15 | 2018-06-21 | 腾讯科技（深圳）有限公司 | Method for interaction between avatars, terminals, and system |
| CN107396001A (en) * | 2017-08-30 | 2017-11-24 | 郝翻翻 | A kind of method of record personal |
| CN110286751A (en) * | 2019-02-26 | 2019-09-27 | 深圳市看见网络科技有限公司 | A kind of virtual scene digital applications exchange method |
| CN111045582A (en) * | 2019-11-28 | 2020-04-21 | 深圳市木愚科技有限公司 | Personalized virtual portrait activation interaction system and method |
| KR102219367B1 (en) * | 2020-07-01 | 2021-02-24 | 주식회사 씨몬 | Method, apparatus, and system of online virtual 3d exhibition |
| CN111833418A (en) * | 2020-07-14 | 2020-10-27 | 北京百度网讯科技有限公司 | Animation interaction method, device, equipment and storage medium |
| CN112925411A (en) * | 2021-01-20 | 2021-06-08 | 深圳市金大智能创新科技有限公司 | Implementation method based on interaction with virtual character, intelligent sound box and intelligent terminal |
| CN113593013A (en) * | 2021-07-21 | 2021-11-02 | 吴浩诚 | Interaction method, system, terminal and VR (virtual reality) equipment based on VR dead person simulation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107340859B (en) | Multi-modal interaction method and system of multi-modal virtual robot | |
| CN105141587B (en) | A kind of virtual puppet interactive approach and device | |
| CN104170318B (en) | Use the communication of interaction incarnation | |
| CN111541950B (en) | Expression generating method and device, electronic equipment and storage medium | |
| CN104918670B (en) | The location-based enhancing read for story | |
| CN109635616B (en) | Interaction method and device | |
| KR20230096043A (en) | Side-by-side character animation from real-time 3D body motion capture | |
| CN105144286A (en) | Systems and methods for interactive synthetic character dialogue | |
| CN104994921A (en) | Visual content modification for distributed story reading | |
| CN104956317A (en) | Speech modification for distributed story reading | |
| WO2009100338A2 (en) | A web-browser based three-dimensional media aggregation social networking application | |
| KR20230107654A (en) | Real-time motion delivery for prosthetic rims | |
| CN117957582A (en) | Mixing a body mesh into an external mesh | |
| GB2622261A (en) | System and method for providing a relational terrain for social worlds | |
| CN117337443A (en) | Customized virtual store | |
| KR20230062857A (en) | augmented reality messenger system | |
| US20230171459A1 (en) | Platform for video-based stream synchronization | |
| KR20230029968A (en) | Bone tracking for real-time virtual effects | |
| US20230130535A1 (en) | User Representations in Artificial Reality | |
| WO2020063394A1 (en) | Voice message display method and apparatus in application program, computer device, and computer-readable storage medium | |
| WO2023034567A1 (en) | Parallel video call and artificial reality spaces | |
| KR20230047480A (en) | User interface for pose-driven virtual effects | |
| KR20230124082A (en) | Media content items with haptic feedback enhancements | |
| KR100957858B1 (en) | Avatar presenting method and computer readable medium processing the method | |
| CN107204026B (en) | Method and device for displaying animation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |