CN103218843A - Virtual character communication system and method - Google Patents
Virtual character communication system and method Download PDFInfo
- Publication number
- CN103218843A CN103218843A CN2013100820129A CN201310082012A CN103218843A CN 103218843 A CN103218843 A CN 103218843A CN 2013100820129 A CN2013100820129 A CN 2013100820129A CN 201310082012 A CN201310082012 A CN 201310082012A CN 103218843 A CN103218843 A CN 103218843A
- Authority
- CN
- China
- Prior art keywords
- module
- user
- action
- expression
- user terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to a virtual character communication system which comprises a plurality of user terminals capable of mutually communicating. Each user terminal comprises an image capture module, a displaying module, a communication module, a three-dimension (3D) virtual character model, a movement resolving module, a movement reappearing command module and a movement driving module, wherein the movement resolving module is used for recording movement composed of single limb movement resolved by limb movement of a user, the movement reappearing command module is used for reappearing a movement control command set of the limb movement of the user on the 3D virtual character model, and the movement driving module is used for reappearing the limb movement of the user on the 3D virtual character model. The virtual character communication system enables the movement and emotional expression of the user to be converted into command sets to send the command sets to other user terminals, reappears the command sets on the other user terminals through a 3D virtual character, and accordingly achieves a video call. Though the 3D virtual character is not a real character, movement and emotional expression of a speaker can be clearly expressed, and the virtual character communication system has enjoyment accordingly. The virtual character communication system has the advantages of being small in network communication flow, good in displaying effect and the like, and has wide market prospects.
Description
Technical field
The present invention relates to the 3D infotech, relate in particular to a kind of mechanics of communication that true user's video and audio frequency are reappeared by the 3D visual human.
Background technology
Video calling, video conference have been not fresh things, and it can show figure action and expression in conversation, thereby has better communication effectiveness.But, no matter be by internet communication, still 3G network communication, the data volume of video information is big, and transmission speed is slow, causes problems such as image fault, communication be not smooth to remain the important difficult problem that the restriction video calling develops.
Summary of the invention
At above-mentioned defective of the prior art, the invention provides a kind of simple, effective virtual portrait communication system that uses.
The invention provides a kind of virtual portrait communication system, it comprises several user terminals of communication mutually, each user terminal includes image capture module, display module and the communication module of the frame data of the action of gathering the user, and it is characterized in that: each user terminal also comprises:
3D visual human model in described image display demonstration;
The action parsing module is used for the user's of described frame data limb action is resolved into the action record of being made up of several single limb actions;
Action reappears instruction module, is used for being created on the action that reappears user's limb action on the described 3D visual human model according to described action record and controls instruction set;
The action drives module is used for controlling instruction set according to described action and drives the limb action that described 3D visual human model reappears the user.
Preferably, described user terminal also comprises the audio collection module of the audio-frequency information of gathering the user and the playing module of the described audio-frequency information of broadcast.
Preferably, also comprise:
The expression parsing module is used for the user's of user's frame data of described acquisition terminal collection expression is resolved into the expression record of being made up of single face or facial muscle action several;
Expression is reappeared instruction module, is used for being created on the expression of reappearing user's expression on the described 3D visual human model according to described expression record and controls instruction set;
The expression driver module is used for controlling instruction set according to described expression and drives the expression that described 3D visual human model reappears the user.
Preferably, described communication module carries out communication by internet or GPRS network or 3G network.
Preferably, described 3D visual human model is a virtual portrait model of being with bone by the 3D that the 3D modeling software is made.
The present invention also provides a kind of virtual portrait means of communication, and it comprises several user terminals of communication mutually, it is characterized in that: may further comprise the steps:
1) image capture module by described user terminal is gathered the frame data of user's action;
2) the action parsing module by described user terminal resolves into the action record of being made up of several single limb actions with the limb action of the user in the described frame data;
3) action by described user terminal reappears instruction module, is created on the action that reappears user's limb action on the 3D visual human model according to described action record and controls instruction set;
4) by the communication module of described user terminal instruction set is controlled in described action and sent to other described user terminals;
5) each described user terminal is all controlled instruction set by the action drives module according to the described action that receives and is driven described 3D visual human model and reappear user's limb action and show on described display module.
Preferably, described method further comprises: the audio-frequency information of gathering the user by the audio collection module of described user terminal, and sending to other user terminals by communication module, each described user terminal is all play the described audio-frequency information of its reception by playing module.
Preferably, described method further comprises:
6) image capture module by described user terminal is gathered the frame data of user's expression;
7) the expression parsing module by described user terminal resolves into the expression record of being made up of single face or facial muscle action several with user's expression;
8) reappear instruction module by the expression of described user terminal, be created on the expression of reappearing user's expression on the described 3D visual human model according to described expression record and control instruction set;
9) by the communication module of described user terminal described expression is controlled instruction set and send to other described user terminals;
10) each described user terminal is all controlled instruction set by the expression driver module according to the described expression that receives and is driven described 3D visual human model and reappear user's expression and show on described display module.
Virtual portrait communication system of the present invention and method are recorded user's action and expression by user terminal, convert thereof into instruction set and send to other user terminals, and on other user terminals, reappear by the 3D visual human, thereby realization video calling, though its fict figure image, but still can clearly give expression to caller's action and expression, have interest concurrently.It has advantages such as the network communication flow is little, display effect is good, has market outlook.
Description of drawings
The present invention is further detailed explanation below in conjunction with the drawings and specific embodiments.
Fig. 1 is the schematic diagram of most preferred embodiment of the present invention.
Embodiment
In order to make those skilled in the art person understand the present invention program better, and above-mentioned purpose of the present invention, feature and advantage can be become apparent more, the present invention is further detailed explanation below in conjunction with embodiment and embodiment accompanying drawing.
As shown in Figure 1, a kind of virtual portrait communication system of the present invention comprises several user terminals of communication mutually, and each user terminal all comprises image capture module, display module, communication module and the 3D visual human model that shows in image display.
Each user terminal also further comprises: action parsing module, action reappear instruction module, action drives module, audio collection module and playing module.
Each user terminal also can further comprise: expression parsing module, expression are reappeared instruction module and expression driver module.
With the double video calling that is installed on mobile phone is example, and use step of the present invention is:
1) 3D that makes by 3D modeling softwares such as 3DMAX, MAYA is with the virtual portrait model of bone and is installed on mobile phone by APP;
2) image capture module that passes through user terminal is gathered user's frame data, and promptly the camera that carries with mobile phone is taken user's video;
3) the action parsing module by user terminal resolves into the action record of being made up of several single limb actions with the limb action of the user in the video;
4) action by user terminal reappears instruction module, is created on the action that reappears user's limb action on the 3D visual human model according to action record and controls instruction set;
5) the expression parsing module by user terminal resolves into the expression record of being made up of single face or facial muscle action several with the expression of the user in the video;
6) reappear instruction module by the expression of user terminal, be created on the expression of reappearing user's expression on the 3D visual human model according to the expression record and control instruction set;
7) communication module by user terminal is controlled instruction set, expression with action and is controlled instruction set and audio collection module (MIC) and gather user's audio-frequency information and send to other user terminals;
8) take over party's user terminal is all controlled instruction set driving 3D visual human model reproduction user's limb action and is gone up demonstration at display module (display screen) according to the action that receives by the action drives module; Control instruction set by the expression driver module according to the expression that receives and drive 3D visual human model and reappear user's expression and on display module, show, and play the audio-frequency information of its reception by playing module (loudspeaker).
Can realize visual human's two-way video communication like this, with respect to video information, instruction set is controlled in action, the data volume of controlling instruction set of expressing one's feelings significantly reduces, thereby also can improve the quality and the communication speed of video greatly.
Certainly, also can finish, can also use it for the video conference of many people communication based on above design philosophy by PC with upper module.
The above only is the specific embodiment of the present invention, and the present invention can also be applied in other opertaing device, as computer system, games system, cell phone system etc.Protection scope of the present invention is not limited thereto, and anyly is familiar with those skilled in the art in the technical scope that the present invention discloses, and the variation that can expect easily or replacement all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection domain that claim was defined.
Claims (8)
1. virtual portrait communication system, it comprises several user terminals of communication mutually, each user terminal includes image capture module, display module and the communication module of the frame data of the action of gathering the user, and it is characterized in that: each user terminal also comprises:
3D visual human model in described image display demonstration;
The action parsing module is used for the user's of described frame data limb action is resolved into the action record of being made up of several single limb actions;
Action reappears instruction module, is used for being created on the action that reappears user's limb action on the described 3D visual human model according to described action record and controls instruction set;
The action drives module is used for controlling instruction set according to described action and drives the limb action that described 3D visual human model reappears the user.
2. system according to claim 1 is characterized in that: described user terminal also comprises the audio collection module of the audio-frequency information of gathering the user and plays the playing module of described audio-frequency information.
3. according to claim 1 or 2 one of them described system, it is characterized in that: also comprise:
The expression parsing module is used for the user's of user's frame data of described acquisition terminal collection expression is resolved into the expression record of being made up of single face or facial muscle action several;
Expression is reappeared instruction module, is used for being created on the expression of reappearing user's expression on the described 3D visual human model according to described expression record and controls instruction set;
The expression driver module is used for controlling instruction set according to described expression and drives the expression that described 3D visual human model reappears the user.
4. system according to claim 3 is characterized in that: described communication module carries out communication by internet or GPRS network or 3G network.
5. system according to claim 4 is characterized in that: described 3D visual human model is with the virtual portrait model of bone for the 3D that is made by the 3D modeling software.
6. virtual portrait means of communication, it comprises several user terminals of communication mutually, it is characterized in that: may further comprise the steps:
1) image capture module by described user terminal is gathered the frame data of user's action;
2) the action parsing module by described user terminal resolves into the action record of being made up of several single limb actions with the limb action of the user in the described frame data;
3) action by described user terminal reappears instruction module, is created on the action that reappears user's limb action on the 3D visual human model according to described action record and controls instruction set;
4) by the communication module of described user terminal instruction set is controlled in described action and sent to other described user terminals;
5) each described user terminal is all controlled instruction set by the action drives module according to the described action that receives and is driven described 3D visual human model and reappear user's limb action and show on described display module.
7. method according to claim 6, it is characterized in that: described method further comprises: the audio-frequency information of gathering the user by the audio collection module of described user terminal, and sending to other user terminals by communication module, each described user terminal is all play the described audio-frequency information of its reception by playing module.
8. method according to claim 7 is characterized in that: described method further comprises:
6) image capture module by described user terminal is gathered the frame data of user's expression;
7) the expression parsing module by described user terminal resolves into the expression record of being made up of single face or facial muscle action several with user's expression;
8) reappear instruction module by the expression of described user terminal, be created on the expression of reappearing user's expression on the described 3D visual human model according to described expression record and control instruction set;
9) by the communication module of described user terminal described expression is controlled instruction set and send to other described user terminals;
10) each described user terminal is all controlled instruction set by the expression driver module according to the described expression that receives and is driven described 3D visual human model and reappear user's expression and show on described display module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013100820129A CN103218843A (en) | 2013-03-15 | 2013-03-15 | Virtual character communication system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013100820129A CN103218843A (en) | 2013-03-15 | 2013-03-15 | Virtual character communication system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103218843A true CN103218843A (en) | 2013-07-24 |
Family
ID=48816586
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2013100820129A Pending CN103218843A (en) | 2013-03-15 | 2013-03-15 | Virtual character communication system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103218843A (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103415003A (en) * | 2013-08-26 | 2013-11-27 | 苏州跨界软件科技有限公司 | Virtual figure communication system |
| CN103442137A (en) * | 2013-08-26 | 2013-12-11 | 苏州跨界软件科技有限公司 | Method for allowing a user to look over virtual face of opposite side in mobile phone communication |
| CN104735389A (en) * | 2013-12-23 | 2015-06-24 | 联想(北京)有限公司 | Information processing method and equipment |
| CN104935860A (en) * | 2014-03-18 | 2015-09-23 | 北京三星通信技术研究有限公司 | Method and device for realizing video calling |
| CN105263040A (en) * | 2015-10-08 | 2016-01-20 | 安徽理工大学 | Method for watching ball game live broadcast in mobile phone flow saving mode |
| CN106205245A (en) * | 2016-07-15 | 2016-12-07 | 深圳市豆娱科技有限公司 | Immersion on-line teaching system, method and apparatus |
| CN107527033A (en) * | 2017-08-25 | 2017-12-29 | 歌尔科技有限公司 | Camera module and social intercourse system |
| CN107766785A (en) * | 2017-01-25 | 2018-03-06 | 丁贤根 | A kind of face recognition method |
| WO2018107918A1 (en) * | 2016-12-15 | 2018-06-21 | 腾讯科技（深圳）有限公司 | Method for interaction between avatars, terminals, and system |
| CN108271057A (en) * | 2018-02-02 | 2018-07-10 | 优酷网络技术（北京）有限公司 | Video interaction method, subscription client, server and readable storage medium storing program for executing |
| CN108881784A (en) * | 2017-05-12 | 2018-11-23 | 腾讯科技（深圳）有限公司 | Virtual scene implementation method, device, terminal and server |
| CN108874114A (en) * | 2017-05-08 | 2018-11-23 | 腾讯科技（深圳）有限公司 | Realize method, apparatus, computer equipment and the storage medium of virtual objects emotion expression service |
| CN109474856A (en) * | 2017-09-07 | 2019-03-15 | 连株式会社 | Game providing method and its system based on video calling and Object identifying |
| CN109740476A (en) * | 2018-12-25 | 2019-05-10 | 北京琳云信息科技有限责任公司 | Instant communication method, device and server |
| CN109753150A (en) * | 2018-12-11 | 2019-05-14 | 北京字节跳动网络技术有限公司 | Figure action control method, device, storage medium and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060055699A1 (en) * | 2004-09-15 | 2006-03-16 | Perlman Stephen G | Apparatus and method for capturing the expression of a performer |
| CN101594577A (en) * | 2008-05-30 | 2009-12-02 | 吴迪 | Phone chat pet, system and implementation method |
| CN102934144A (en) * | 2010-06-09 | 2013-02-13 | 微软公司 | Real-time animation of facial expressions |
-
2013
- 2013-03-15 CN CN2013100820129A patent/CN103218843A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060055699A1 (en) * | 2004-09-15 | 2006-03-16 | Perlman Stephen G | Apparatus and method for capturing the expression of a performer |
| CN101594577A (en) * | 2008-05-30 | 2009-12-02 | 吴迪 | Phone chat pet, system and implementation method |
| CN102934144A (en) * | 2010-06-09 | 2013-02-13 | 微软公司 | Real-time animation of facial expressions |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103415003A (en) * | 2013-08-26 | 2013-11-27 | 苏州跨界软件科技有限公司 | Virtual figure communication system |
| CN103442137A (en) * | 2013-08-26 | 2013-12-11 | 苏州跨界软件科技有限公司 | Method for allowing a user to look over virtual face of opposite side in mobile phone communication |
| CN103442137B (en) * | 2013-08-26 | 2016-04-13 | 苏州跨界软件科技有限公司 | A kind of method of checking the other side's conjecture face in mobile phone communication |
| CN104735389A (en) * | 2013-12-23 | 2015-06-24 | 联想(北京)有限公司 | Information processing method and equipment |
| CN104735389B (en) * | 2013-12-23 | 2018-08-31 | 联想(北京)有限公司 | Information processing method and information processing equipment |
| CN104935860A (en) * | 2014-03-18 | 2015-09-23 | 北京三星通信技术研究有限公司 | Method and device for realizing video calling |
| CN105263040A (en) * | 2015-10-08 | 2016-01-20 | 安徽理工大学 | Method for watching ball game live broadcast in mobile phone flow saving mode |
| CN106205245A (en) * | 2016-07-15 | 2016-12-07 | 深圳市豆娱科技有限公司 | Immersion on-line teaching system, method and apparatus |
| CN108234276A (en) * | 2016-12-15 | 2018-06-29 | 腾讯科技（深圳）有限公司 | Interactive method, terminal and system between a kind of virtual image |
| CN108234276B (en) * | 2016-12-15 | 2020-01-14 | 腾讯科技（深圳）有限公司 | Method, terminal and system for interaction between virtual images |
| WO2018107918A1 (en) * | 2016-12-15 | 2018-06-21 | 腾讯科技（深圳）有限公司 | Method for interaction between avatars, terminals, and system |
| CN107766785A (en) * | 2017-01-25 | 2018-03-06 | 丁贤根 | A kind of face recognition method |
| CN107766785B (en) * | 2017-01-25 | 2022-04-29 | 丁贤根 | Face recognition method |
| CN108874114A (en) * | 2017-05-08 | 2018-11-23 | 腾讯科技（深圳）有限公司 | Realize method, apparatus, computer equipment and the storage medium of virtual objects emotion expression service |
| CN108881784A (en) * | 2017-05-12 | 2018-11-23 | 腾讯科技（深圳）有限公司 | Virtual scene implementation method, device, terminal and server |
| CN108881784B (en) * | 2017-05-12 | 2020-07-03 | 腾讯科技（深圳）有限公司 | Virtual scene implementation method and device, terminal and server |
| CN107527033A (en) * | 2017-08-25 | 2017-12-29 | 歌尔科技有限公司 | Camera module and social intercourse system |
| CN109474856A (en) * | 2017-09-07 | 2019-03-15 | 连株式会社 | Game providing method and its system based on video calling and Object identifying |
| US11465044B2 (en) | 2017-09-07 | 2022-10-11 | Line Corporation | Method and system for providing game based on video call and object recognition |
| CN108271057A (en) * | 2018-02-02 | 2018-07-10 | 优酷网络技术（北京）有限公司 | Video interaction method, subscription client, server and readable storage medium storing program for executing |
| CN109753150A (en) * | 2018-12-11 | 2019-05-14 | 北京字节跳动网络技术有限公司 | Figure action control method, device, storage medium and electronic equipment |
| CN109740476A (en) * | 2018-12-25 | 2019-05-10 | 北京琳云信息科技有限责任公司 | Instant communication method, device and server |
| CN109740476B (en) * | 2018-12-25 | 2021-08-20 | 北京琳云信息科技有限责任公司 | Instant messaging method, device and server |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103218843A (en) | Virtual character communication system and method | |
| KR101768980B1 (en) | Virtual video call method and terminal | |
| CN106210703B (en) | The utilization of VR environment bust shot camera lenses and display methods and system | |
| US11113884B2 (en) | Techniques for immersive virtual reality experiences | |
| CN108074431B (en) | System and method for applying VR (virtual reality) technical lecture practical training | |
| CN202077141U (en) | Digitalized monitoring network application system | |
| CN103369289A (en) | Communication method of video simulation image and device | |
| CN105376547A (en) | Micro video course recording system and method based on 3D virtual synthesis technology | |
| CN106937039A (en) | A kind of imaging method based on dual camera, mobile terminal and storage medium | |
| CN112714327B (en) | Interaction method, device and equipment based on live application program and storage medium | |
| CN111654715B (en) | Live video processing method and device, electronic equipment and storage medium | |
| JP2014187559A (en) | Virtual reality presentation system and virtual reality presentation method | |
| CN108924464A (en) | Generation method, device and the storage medium of video file | |
| CN111405234A (en) | Video conference information system and method with integration of cloud computing and edge computing | |
| CN108337543A (en) | A kind of video broadcasting method, terminal and computer readable storage medium | |
| CN105933637A (en) | Video communication method and system | |
| CN105630145A (en) | Virtual sense realization method and apparatus as well as glasses or helmet using same | |
| CN203588489U (en) | A situational teaching device | |
| CN110543239A (en) | Digital interactive exhibition comprehensive application system | |
| CN114040318A (en) | Method and equipment for playing spatial audio | |
| CN202957933U (en) | 3D video communication device | |
| CN202584721U (en) | Three-dimensional courseware system | |
| CN113938620B (en) | Image processing method, mobile terminal and storage medium | |
| CN103929456A (en) | Far-end space simulation method | |
| CN205726152U (en) | A kind of internet video interaction systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130724 |