CN105578108A - Electronic computing device, video communication system and operation method of video communication system - Google Patents

Electronic computing device, video communication system and operation method of video communication system Download PDF

Info

Publication number
CN105578108A
CN105578108A CN201410617627.1A CN201410617627A CN105578108A CN 105578108 A CN105578108 A CN 105578108A CN 201410617627 A CN201410617627 A CN 201410617627A CN 105578108 A CN105578108 A CN 105578108A
Authority
CN
China
Prior art keywords
virtual component
image
computing device
electronic computing
numbering
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410617627.1A
Other languages
Chinese (zh)
Inventor
叶舟
萧新维
张志铭
吕英阁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ulsee Inc
Original Assignee
Ulsee Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ulsee Inc filed Critical Ulsee Inc
Priority to CN201410617627.1A priority Critical patent/CN105578108A/en
Publication of CN105578108A publication Critical patent/CN105578108A/en
Pending legal-status Critical Current

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention relates to a video communication system. The video communication system comprises at least two electronic computing devices; each electronic computing device include a display screen, an image shooting assembly, a face tracking module, a first virtual assembly database, a selection interface, a communication module and an image generation module; the image shooting assembly shoots the face image of a user; the face tracking module converts the shot face image into a plurality of face feature points so as to perform tracking and generate movement data; and the image generation module selects a virtual assembly corresponding to a serial number from the first virtual assembly database from a local end and generates a moving virtual assembly image through a function with a drawing function. When the video communication system provided by the invention is used, images with a large number of data are not required to be transmitted, and therefore, the problem of image delay can be avoided basically.

Description

Electronic computing device, video call system and its operation method
Technical field
A kind of video call system and its operation method, particularly a kind of video call system and its operation method that can produce virtual image in receiving terminal.
Background technology
Along with advancing by leaps and bounds of Information technology and mechanics of communication, current video call has been used in the occasion of business or even personal lifestyle widely.But when carrying out video call, owing to needing transmitting image, and the data volume of image is huger, and therefore the problem of picture delay often can occur, that is there is the problem that the voice of the other side and image each other cannot be compatible.
In addition, when carrying out video call, generally just can only hear the sound of the other side or see the image of the other side, but as biography note, (as software such as citation such as use Line or micro-letter etc.) cannot can transmit interesting pattern message, and lowering the entertaining of video call.
Therefore, how transmitting image swimmingly when video call, and increase the entertaining of video call, be worth those skilled in the art thinking.
Summary of the invention
The object of the present invention is to provide the operation method of a kind of video call system and a video call system, this video call system transmitting image swimmingly when video call, and increase the entertaining of video call.
Based on above-mentioned purpose and other objects, the invention provides a kind of video call system.This video call system, comprise at least two electronic computing device, wherein each electronic computing device comprises: a display screen, a filming image assembly, a face tracking module, one first virtual component database, an option interface, a communication module, with an image generation.Wherein, filming image assembly is suitable for an image of face of shooting one user, and face tracking module is suitable for the image of face captured by filming image assembly to convert to multiple facial feature points, and continue to follow the trail of these facial feature points, to produce the exercise data of facial feature points.First virtual component database storage has many virtual component, and every virtual component all has numbering corresponding separately.
In addition, option interface is then connected with the first virtual component database, and is suitable for selecting at least one virtual component for user.Communication module is suitable for the motion of described facial feature points, described facial feature points, is passed to another electronic computing device with by the numbering of virtual component selected.In addition, image generation by communication module receive the described facial feature points transmitted from another electronic computing device, described facial feature points motion, with by the numbering of virtual component selected, this image generation can select from the first virtual component database the virtual component corresponding to this numbering, by such as: OpenGL... etc. has the function of drawing function thus produces the virtual component image of a motion, and in display screen display virtual component image.
In above-mentioned video call system, the exercise data of described facial feature points, except the coordinate of facial feature points on image, also comprises overall scaling and attitude.Wherein, attitude comprises: roll angle, yaw angle and the angle of pitch.
In above-mentioned video call system, the kenel of described virtual component is the image or the model that comprise 2D or 3D, and it is such as the group selecting free head portrait, mask and thing of adoring to form.
In above-mentioned video call system, when being mask by the virtual component selected, face tracking module can produce a three-dimensional face model according to this image of face of this user.And this three-dimensional face model can be sent to another electronic computing device by communication module.
In above-mentioned video call system, also comprise a remote server, this remote server comprises one second virtual component database.Wherein, when the first virtual component database that image generation finds in electronic computing device does not comprise the virtual component corresponding to this numbering, this image generation can download to the second virtual component database request of remote server the virtual component corresponding to this numbering.
In above-mentioned video call system, when image generation finds that the first virtual component database in electronic computing device does not comprise this virtual component corresponding to this numbering, this image generation can download to the first virtual component database request in another electronic computing device the virtual component corresponding to this numbering.
In above-mentioned video call system, when filming image assembly photographs the image of a cavity interior of user, face tracking module can capture the image of this cavity interior according to described facial feature points, and by communication module, the image of this cavity interior is sent to another electronic computing device.
In above-mentioned video call system, option interface provides user to give up the numbering of the virtual component that another electronic computing device transmits, and selects another virtual component from local side first virtual component database voluntarily.
Based on above-mentioned purpose and other objects, the present invention also provides a kind of operation method of video call system, and this video call system comprises at least two electronic computing device, and the operation method of this video call system comprises the following steps:
H one user of () wherein electronic computing device selects virtual component image for being presented at another electronic computing device;
I (), by a filming image assembly of a wherein electronic computing device, continues to take to the image of face of user;
J () converts the image of face of shooting to multiple facial feature points;
K (), according to the motion of this facial feature points, produces the exercise data of this facial feature points;
(l) by for the numbering of virtual component of display, facial feature points, and the exercise data of facial feature points be sent to another electronic computing device;
M () another electronic computing device according to the numbering of transmitted virtual component, and captures the virtual component corresponding to this numbering from a local side first virtual component database; And
N the virtual component captured in (f) step is presented on a display screen of another electronic computing device by ().
In the operation method of above-mentioned video call system, in (f) step, when the first virtual component database does not store the virtual component corresponding to this numbering, following step can be performed: capture the virtual component corresponding to this numbering from a remote server.
In the operation method of above-mentioned video call system, in (f) step, when the first virtual component database does not store the virtual component corresponding to this numbering, following step can be performed: download to the first virtual component database request in another electronic computing device the virtual component corresponding to this numbering.
The invention has the beneficial effects as follows, when using video call system of the present invention, because the user of a wherein side can select the virtual component image wishing to be presented at the other side's display screen, therefore the enjoyment in use can be increased.And, image taken by filming image assembly is not directly pass in the electronic computing device of the other side, but only transmit numbering corresponding to virtual component and the image that regeneration is corresponding in the electronic computing device of the other side, therefore without the need to transmitting the huger image of data volume when using video call system, therefore more not easily there is the problem of picture delay.
For above-mentioned purpose of the present invention, feature and advantage more can be become apparent, hereafter will coordinate institute's accompanying drawings with embodiment, be described in detail below.It is noted that each assembly in institute's accompanying drawings is only signal, do not indicate according to the actual ratio of each assembly.
Accompanying drawing explanation
Figure 1A is depicted as the first embodiment of video call system of the present invention.
Figure 1B is depicted as the calcspar of video call system hardware aspect of the present invention.
Fig. 1 C is depicted as the calcspar of video call systems soft ware aspect of the present invention.
Fig. 2 A is depicted as the schematic diagram that image of face is converted to multiple facial feature points by face tracking module.
Fig. 2 B is depicted as facial feature points in the overall scaling change on the display screen of the complete rear image display of image capture.
Fig. 2 C is depicted as the attitudes vibration of head.
Figure 3 shows that the option interface be shown on display screen.
Fig. 4 A is depicted as the first embodiment of the operation workflow of video call system.
Fig. 4 B is depicted as the further operation workflow of step S101 in Fig. 4 A.
Fig. 4 C and Fig. 4 D is depicted as the second embodiment of the operation workflow of video call system.
Figure 5 shows that the second embodiment of video call system of the present invention.
Figure 6 shows that the 3rd embodiment of video call system of the present invention.
Figure 7 shows that real image and the virtual image of user face.
Embodiment
Refer to Figure 1A, Figure 1A is depicted as the first embodiment of video call system of the present invention.This video call system 10 comprises at least two flat computers, be respectively flat computer 100 and flat computer 200, flat computer 100 and flat computer 200 all comprise a display screen 110,210 and a filming image assembly 120,220, filming image assembly 120,220 can be used for filmed image, such as: the image of face of user.It is noted that be only the embodiment of electronic computing device at this flat computer 100,200, flat computer optionally can be replaced to intelligent mobile phone, notebook computer or desktop computer etc. by those skilled in the art.
The calcspar of video call system of the present invention is depicted as please with reference to Figure 1B, Figure 1B.From Figure 1B, flat computer 100 and flat computer 200 all also comprise central processing unit 102,202, graphic process unit 104,204, internal memory 180,280, with a communication module 160,260.Wherein, as shown in Figure 1 C, at internal memory 180,280 store multiple functional module, and these functional modules are: face tracking module 130,230, an one first virtual component database 140,240, an option interface 150,250, with an image generation 170,270.At the present embodiment, can by central processing unit 102,202 or graphic process unit 104,204 call out and perform these functional modules.Such as, by central processing unit 102,202 call out and perform face tracking module 130, and 230 and perform, by graphic process unit 104,204 call out and perform image generation 170,270.And it is noted that in the present embodiment, flat computer 100 and affiliated assembly and flat computer 200 and affiliated assembly have same or analogous structure respectively.Therefore, unless stated otherwise, when following when introducing structure and effect of flat computer 100 and affiliated assembly, those skilled in the art should understand flat computer 200 and affiliated assembly also has same or analogous structure and effect, and vice versa.
Face tracking module 130 is for the image of face 20 captured by filming image assembly 120 being converted to multiple facial feature points 21 (as shown in the round dot of Fig. 2 A), and face tracking module 130 can also be followed the trail of the motion continuation of these facial feature points 21.Wherein, face tracking module 130 is such as use local limited model (ConstrainedLocalModel, be called for short CLM) or the mode such as active appearance models (ActiveAppearanceModels, be called for short AAM) follow the trail of the motion of facial feature points 21.In the present embodiment, the motion of facial feature points 21, except comprising the coordinate points of facial feature points on image, also comprises the overall scaling of face and attitude.In more detail, overall scaling be face for judging user whether near or away from filming image assembly 120, when overall scaling becomes the face of large then representative of consumer near filming image assembly 120 (as shown in Figure 2 B shown in right), on the contrary then the face of representative of consumer away from filming image assembly 120 (as shown in Figure 2 B shown in left).In addition, as shown in Figure 2 C, attitude then comprise the roll angle of user face, yaw angle, with the angle of pitch etc.Above-mentioned characteristic point, scaling and attitude are all followed the trail of by face by face tracking module and produce.
Above-mentioned facial feature points 21 and the exercise data of facial feature points 21, can temporarily be stored in internal memory 180.In addition, the sound that user sends also temporarily can be stored in internal memory 180 via sound reception unit (not shown, as: microphone).
First virtual component database 140, stores many virtual component in 240, the kenel of these virtual component is such as head portrait, mask and adorn 2D or 3D image or the models such as thing ...And, it is noted that the virtual component stored by the first virtual component database 140 may be different from the virtual component stored by the first virtual component database 240.That is, the virtual component stored by the first virtual component database 140 has part possibly cannot find at the first virtual component database 240.In the present embodiment, head portrait can as the display screen 110 of Figure 1A, head portrait 30,30 ' shown in 210 is general, and ornament is such as then the ornament (sunglasses) 32 that head portrait 30 is worn, or the ornament (blush) 32 ' shown by head portrait 30 '.Please with reference to Fig. 3, Fig. 3 illustrate option interface 150 for being shown on display screen 110.This option interface 150 is connected to the first virtual component database 140, and this option interface 150 can allow user select the virtual component wanting to show.As shown in Figure 3, these virtual component are all endowed a numbering.After user selects desired virtual component, just the numbering corresponding to these virtual component can be stored in internal memory 180.
In the present embodiment, communication module 160 is such as wireless network communication chip, and flat computer can be allowed to be connected to internet.Via communication module 160 can extract from internal memory 180 sound, facial feature points 21, described facial feature points 21 exercise data, with this by the numbering of virtual component selected, be sent in the communication module 260 of another flat computer 200 after formation data packet (DataPackage).
In flat computer 200, after communication module 260 receives the data transmitted from the communication module 160 of flat computer 100, can temporarily be stored in internal memory 280.Afterwards, image generation 270 can according to the numbering of transmitted virtual component, and from the first virtual component database 240 of flat computer 200, capture the virtual component corresponding to this numbering, and this virtual component is produced this virtual component image by image generation 270, and be presented on the display screen 110 of flat computer 200.In addition, image generation 270 also according to the motion of facial feature points 21, and can change the motion of virtual component image.Such as, when the overall scaling of facial feature points 21 becomes large, then virtual component image also can become large.Because the attitude (as: roll angle, yaw angle and the angle of pitch) of user face also can be sent to image generation 270, therefore the display screen 210 of flat computer 200 also can demonstrate the facial pose of the other user, such as: when the user at flat computer 100 end produces the action of nodding, the virtual image on the display screen 210 of flat computer 200 also can the corresponding generation action of nodding.
Below, will introduce the operation workflow of video call system 10, please refer to Fig. 4 A, and please coordinate with reference to Figure 1A ~ Fig. 3 simultaneously, the operation workflow of video call system 10 comprises the following steps:
S101: utilize option interface 150 to select for display virtual image
S102: the image of face 20 starting filming image assembly 120 couples of users continues to take;
S104: face tracking module 130 converts the image of face of shooting to multiple facial feature points 21;
S106: face tracking module 130, according to the motion of facial feature points 21, produces the exercise data of facial feature points 21, these exercise datas be such as the coordinate points two-dimentional and three-dimensional on image of facial feature points, the overall scaling of user face and attitude;
S108: the exercise data of facial feature points 21 and facial feature points 21 is temporarily stored in an internal memory 180;
S110: by the exercise data of sound, facial feature points 21, described facial feature points 21, with this by the numbering of virtual image selected, after formation data packet (DataPackage), be sent to another flat computer 200;
S112: flat computer 200 from received data packet extract sound, facial feature points 21, described facial feature points 21 exercise data, with this by data such as the numberings of virtual component selected, and be stored in internal memory 280;
S114: according to the numbering of transmitted virtual image, image generation 270 captures the virtual component corresponding to this numbering from the first virtual component database 240 of flat computer 200; And
S116: captured virtual component is produced this virtual component image display on the display screen 210 of flat computer 200 by image generation by image generation 270;
Above flow process S102 ~ S116 is from flat computer 100 transmission of information to the flow process of flat computer 200 in the present embodiment, but similar to flow process S102 ~ S116 to the flow process of flat computer 100 from flat computer 200 transmission of information.Such as, in flat computer 100, after communication module 160 receives the data transmitted from the communication module 260 of flat computer 200, image generation 170 also can perform the step being similar to S114 and S116.
In addition, step S101 can also be subdivided into following step (as shown in Figure 4 B) further:
S101a: utilize option interface 150 to select for display head portrait or mask; And
S101b: utilize option interface 150 to select for display thing of adoring.
That is, user, after the head portrait selected for showing or mask, can select to adorn thing to decorate head portrait or mask.Certainly, user also only can carry out step S101a, and does not carry out step S101b.
As from the foregoing, when using the video call system 10 of the present embodiment, because the user of a wherein side can select the virtual component image wishing to be presented at the other side's display screen 100, therefore the enjoyment in use can be increased.And the image taken by filming image assembly 120 is not the flat computer 100 directly passing to the other side, in 200, but only transmit numbering corresponding to virtual component and at the flat computer 100 of the other side, the image that in 200, regeneration is corresponding; Or, in time selecting mask, only transmit the image beyond face, and mask can in the other end is by the flat computer of the numbering corresponding to virtual component the other side regeneration mask image, therefore without the need to transmitting the huger image of data volume when using video call system 10, therefore more not easily there is the problem of picture delay, that is the problem that the voice of the other side and image cannot agree with each other more not easily occurs.
In addition, continue referring to Figure 1A, at display screen 110, a wicket 112,212 on 210, can be shown, the true image of face of this wicket 112,212 display the other user, but those skilled in the art also can select not show this wicket 112,212.
Please refer to Fig. 5, Figure 5 shows that the second embodiment of video call system of the present invention.In a second embodiment, video call system 10 ' also comprises a remote server 300, and remote server 300 comprises one second virtual component database 340.Wherein, this remote server 300 is such as connected by internet and flat computer 100,200 communication.In the present embodiment, compared to flat computer 100, the first virtual component database 140,240 on 200, this second virtual component database 340 comprises more and more complete virtual component data.Therefore, in the step S114 of Fig. 4 A, when the first virtual component database 240 that image generation 270 finds in flat computer 200 does not comprise the virtual component corresponding to this numbering, image generation 270 can download to this second virtual component database 340 request of this remote server 300 virtual component corresponding to this numbering.Or, also can ask to the first virtual component database 140 in another flat computer 100 to download the virtual component corresponding to this numbering.
In addition, the user of flat computer 200 also can give up the numbering of the virtual component transmitted from the other side, and select voluntarily from the first virtual component database 240 of flat computer 200 for display virtual component.That is, the user of flat computer 200 can determine the other side (that is: the user of flat computer 200) display virtual component image on the display screen 210.
In order to make clearer second embodiment of those skilled in the art, hereby the step of relevant operation workflow is arranged as follows, and referring to Fig. 4 C and Fig. 4 D.
S114a: flat computer 200 receives the numbering of the virtual component (comprising: head portrait 30 ' and ornament 32 ') transmitted from flat computer 100;
S114b: whether determined by the user of flat computer 200 will the head portrait 30 ' that transmits of display panel computer 100 on the display screen 210; If not, then carry out step S114c, if so, then carry out step S114d;
S114c: by the user of flat computer 200 select voluntarily from the first virtual component database 240 for display head portrait;
S114d: judge whether store the head portrait 30 ' corresponding to this numbering in the first virtual component database 240; If have, then carry out step S114e, if nothing, then carry out step S114f;
S114e: head portrait 30 ' is extracted from the first virtual component database 240;
S114f: transmit a data download request to remote server 300;
S114g: download the first virtual component database 240 of head portrait 30 ' to flat computer 200 from the second virtual component database 340 of remote server 300;
S114h: whether determined by the user of flat computer 200 will the ornament 32 ' that transmits of display panel computer 100 on the display screen 210; If not, then carry out step S114i, if so, then carry out step S114j;
S114i: by the user of flat computer 200 select voluntarily from the first virtual component database 240 for display ornament;
S114j: judge whether store the ornament 32 ' corresponding to this numbering in the first virtual component database 240; If have, then carry out step S114k, if nothing, then carry out step S1141;
S114k: ornament 32 ' is extracted from the first virtual component database 240;
S1141: transmit a data download request to remote server 300;
S114m: download the first virtual component database 240 of ornament 32 ' to flat computer 200 from the second virtual component database 340 of remote server 300;
S116: captured virtual component (comprising head portrait 30 ' and ornament 32 ') is presented on the display screen 210 of flat computer 200 by image generation 270.
Those skilled in the art should understand, in above-mentioned step S114b ~ S114g, head portrait 30 ' can be replaced to mask 41 as shown in Figure 6.In addition, in step S114f and step S1141, also can transmit a data download request to flat computer 100, with downloading data from the first virtual component database 140 of flat computer 100; Or first can transmit a data download request to remote server 300, if the second virtual component database 340 of remote server 300 is without relevant virtual component, then transmit data download request to flat computer 100, vice versa.
In a first embodiment (as shown in Figure 1A), display screen 110, shown by 220 is head portrait 30,30 ', but user still can have other to select, as selected mask.Please refer to Fig. 6, Fig. 6 illustrate the 3rd embodiment into video call system of the present invention.In figure 6, demonstrate user can select oneself want show mask 40,41, be then presented at the display screen 110 of the other side when carrying out video call, on 210.In more detail, when user's utilization option interface 150 as shown in Figure 3 selects the virtual component data in the first virtual component database 140, have selected mask.If user selects virtual component image to display to be mask, then face tracking module 130 can produce a three-dimensional face model (3Dfacemodel) according to this image of face of user, this mask to be done by this three-dimensional face model with face's change of expression and is out of shape (deformation), and the pinup picture (texture) of this mask is attached to this three-dimensional face model; That is, when the face of user changes, this three-dimensional face model also can and then be out of shape, and is presented at display screen 110, and the mask 40,41 on 210 also can and then be out of shape.Therefore, in step S110 (as shown in Figure 4 A), except sound, facial feature points 21, described facial feature points 21 exercise data, with this by except the numbering of virtual component selected, also can together with being delivered to another flat computer 200 after three-dimensional face model in the lump data packet.And in step S116, by three-dimensional face model, the mask be presented on the display screen 110 of flat computer 200 also can change according to the expression of user; Such as, when user smiles, the mask on display screen 110 also can be smiled.
In the third embodiment, also be after selecting the kind of mask by the user of flat computer 100, transmit numbering belonging to this mask to flat computer 200 via communication module 160 again, from the first virtual component database 240, captured the assembly of this mask by the image generation 270 of flat computer 200 and be converted to assembly image display on display screen 110 more afterwards.Assembly image due to mask produced by flat computer 200, flat computer 100 is without the need to transmitting face area image again to flat computer 200, therefore compared to traditional video call system, when using the video call system 10 of the present embodiment without the need to transmitting the huger image of data volume, therefore more not easily there is the problem of picture delay, that is the problem that the voice of the other side and image cannot agree with each other more not easily occurs.
It should be noted that, in the third embodiment, because mask 40,41 only can cover a part for the whole head portrait of user, such as: face area, therefore in step S110 (as shown in Figure 4 A), communication module 160 still needs the images such as the hair style of user, ear, forehead and background to be passed to flat computer 200.
In addition, please refer to Fig. 7, Fig. 7 left illustrate image of face 20 into user, and Fig. 7 right illustrate image for being presented on the display screen 210 of flat computer 200.When user opens face, when exposing cavity interior, face tracking module 130 meeting basis is looped around the image of the cavity interior of facial feature points 21 extract user of user's face.And, in step s 110 (as shown in Figure 4 A), also together can be sent in another flat computer 200 together with the image of this cavity interior.Therefore, in step S116, the display screen 210 of flat computer 200 just can demonstrate the image of the cavity interior of user.In more detail, when user's lips, the mask on display screen 210 also can lips.Therefore, even if the first virtual component database 140 in flat computer 200 does not store the image of cavity interior, but when carrying out video call, display screen 210 still can show the image of cavity interior.
In sum, video call system of the present invention comprises following advantage:
I. in use without the need to transmitting the huger image of data volume, therefore more not easily there is the problem of picture delay.
II. can show virtual component image on screen, increase the enjoyment of video call.
Above-described embodiment is only illustrate for convenience of description, though suffer person of ordinary skill in the field modify arbitrarily, all can not depart from as in claims institute for protect scope.

Claims (12)

1. a video call system, comprises at least two electronic computing device, it is characterized in that, each this electronic computing device all comprises:
One display screen;
One filming image assembly, is suitable for an image of face of shooting one user;
One face tracking module, is suitable for converting the image of face captured by this filming image assembly to multiple facial feature points, and continues to follow the trail of these facial feature points, and produces the exercise data of facial feature points;
One first virtual component database, stores many virtual component, and every virtual component all has numbering corresponding separately;
One option interface, is connected with this first virtual component database, and is suitable for selecting at least one virtual component for this user;
One communication module, is suitable for the motion of described facial feature points, described facial feature points, is passed to another electronic computing device with this by the numbering of the virtual component selected; And
One video generation module, by this communication module receive the described facial feature points transmitted from another electronic computing device, described facial feature points motion, with this by the numbering of virtual component selected, this image generation can select from this first virtual component database the virtual component corresponding to this numbering, thus produce the virtual component image of a motion, and show this virtual component image in this display screen.
2. video call system as claimed in claim 1, it is characterized in that, the exercise data report of facial feature points is drawn together: the coordinate of facial feature points on image, overall scaling and attitude, and wherein attitude comprises: roll angle, yaw angle and the angle of pitch.
3. video call system as claimed in claim 1, it is characterized in that, the kenel of described virtual component is the image or the model that comprise 2D or 3D, and the image of this 2D or 3D or model are the groups selecting free head portrait, mask and thing of adoring to form.
4. video call system as claimed in claim 3, it is characterized in that, when this is mask by the virtual component selected, this face tracking module can produce a three-dimensional face model according to this image of face of this user, and this three-dimensional face model can be sent to another electronic computing device by this communication module.
5. video call system as claimed in claim 1, it is characterized in that, also comprise a remote server, this remote server comprises one second virtual component database, it is characterized in that, when this first virtual component database that this image generation finds in this electronic computing device does not comprise this virtual component corresponding to this numbering, this image generation can download to this second virtual component database request of this remote server this virtual component corresponding to this numbering.
6. video call system as claimed in claim 1, it is characterized in that, when this first virtual component database that this image generation finds in this electronic computing device does not comprise this virtual component corresponding to this numbering, this image generation can download to this first virtual component database request in another electronic computing device this virtual component corresponding to this numbering.
7. video call system as claimed in claim 1, it is characterized in that, when filming image assembly photographs the image of a cavity interior of this user, this face tracking module can capture the image of this cavity interior according to described facial feature points, and by this communication module, the image of this cavity interior is sent to another electronic computing device.
8. video call system as claimed in claim 1, it is characterized in that, this option interface provides user to give up the numbering of the virtual component that another electronic computing device transmits, and selects another virtual component from this first virtual component database voluntarily.
9. an operation method for video call system, this video call system comprises at least two electronic computing device, it is characterized in that, the operation method of this video call system comprises the following steps:
A one user of () wherein electronic computing device selects virtual component image for being presented at another electronic computing device;
B (), by a filming image assembly of a wherein electronic computing device, continues to take to the image of face of this user;
C () converts the image of face of shooting to multiple facial feature points;
D (), according to the motion of this facial feature points, produces the exercise data of this facial feature points;
(e) by for the numbering of virtual component of display, this facial feature points, and the exercise data of this facial feature points be sent to another electronic computing device;
F () another electronic computing device according to the numbering of transmitted virtual component, and captures the virtual component corresponding to this numbering from one first virtual component database; And
G the virtual component captured in (f) step is converted to virtual component image display on a display screen of another electronic computing device by ().
10. the operation method of video call system as claimed in claim 10, it is characterized in that, in (f) step, when this first virtual component database does not store the virtual component corresponding to this numbering, following step can be performed: capture the virtual component corresponding to this numbering from a remote server.
The operation method of 11. video call systems as claimed in claim 10, it is characterized in that, in (f) step, when this first virtual component database does not store the virtual component corresponding to this numbering, following step can be performed: download to the first virtual component database request in another electronic computing device the virtual component corresponding to this numbering.
12. 1 kinds of electronic computing device that can perform the video call system described in the arbitrary claim of the claims 1 ~ 8.
CN201410617627.1A 2014-11-05 2014-11-05 Electronic computing device, video communication system and operation method of video communication system Pending CN105578108A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410617627.1A CN105578108A (en) 2014-11-05 2014-11-05 Electronic computing device, video communication system and operation method of video communication system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410617627.1A CN105578108A (en) 2014-11-05 2014-11-05 Electronic computing device, video communication system and operation method of video communication system

Publications (1)

Publication Number Publication Date
CN105578108A true CN105578108A (en) 2016-05-11

Family

ID=55887711

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410617627.1A Pending CN105578108A (en) 2014-11-05 2014-11-05 Electronic computing device, video communication system and operation method of video communication system

Country Status (1)

Country Link
CN (1) CN105578108A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107277642A (en) * 2017-07-24 2017-10-20 硕诺科技(深圳)有限公司 A kind of method that entertaining textures are realized based on video call data stream process

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1606347A (en) * 2004-11-15 2005-04-13 北京中星微电子有限公司 A video communication method
CN1762145A (en) * 2002-12-12 2006-04-19 皇家飞利浦电子股份有限公司 Avatar database for mobile video communications
DE102007010664A1 (en) * 2007-03-02 2008-09-04 Deutsche Telekom Ag Method for transferring avatar-based information in video data stream in real time between two terminal equipments, which are arranged in avatar-based video communication environment, involves recording video sequence of person
CN101690071A (en) * 2007-06-29 2010-03-31 索尼爱立信移动通讯有限公司 Methods and terminals that control avatars during videoconferencing and other communications
CN102364965A (en) * 2011-10-05 2012-02-29 辜进荣 Refined display method of mobile phone communication information
CN102447873A (en) * 2010-10-13 2012-05-09 张明 Ha-ha video network video chat entertainment auxiliary system
WO2013152454A1 (en) * 2012-04-09 2013-10-17 Intel Corporation System and method for avatar management and selection
CN103368929A (en) * 2012-04-11 2013-10-23 腾讯科技(深圳)有限公司 Video chatting method and system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1762145A (en) * 2002-12-12 2006-04-19 皇家飞利浦电子股份有限公司 Avatar database for mobile video communications
CN1606347A (en) * 2004-11-15 2005-04-13 北京中星微电子有限公司 A video communication method
DE102007010664A1 (en) * 2007-03-02 2008-09-04 Deutsche Telekom Ag Method for transferring avatar-based information in video data stream in real time between two terminal equipments, which are arranged in avatar-based video communication environment, involves recording video sequence of person
CN101690071A (en) * 2007-06-29 2010-03-31 索尼爱立信移动通讯有限公司 Methods and terminals that control avatars during videoconferencing and other communications
CN102447873A (en) * 2010-10-13 2012-05-09 张明 Ha-ha video network video chat entertainment auxiliary system
CN102364965A (en) * 2011-10-05 2012-02-29 辜进荣 Refined display method of mobile phone communication information
WO2013152454A1 (en) * 2012-04-09 2013-10-17 Intel Corporation System and method for avatar management and selection
CN103368929A (en) * 2012-04-11 2013-10-23 腾讯科技(深圳)有限公司 Video chatting method and system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107277642A (en) * 2017-07-24 2017-10-20 硕诺科技(深圳)有限公司 A kind of method that entertaining textures are realized based on video call data stream process
CN107277642B (en) * 2017-07-24 2020-09-15 硕诺科技(深圳)有限公司 Method for realizing interesting mapping based on video call data stream processing

Similar Documents

Publication Publication Date Title
TWI708152B (en) Image processing method, device, and storage medium
US20220261960A1 (en) Super-resolution reconstruction method and related apparatus
US10055879B2 (en) 3D human face reconstruction method, apparatus and server
US20220222893A1 (en) Method and apparatus for generating three-dimensional face model, computer device, and storage medium
WO2021067044A1 (en) Systems and methods for video communication using a virtual camera
WO2020108404A1 (en) Parameter configuration method and device for three-dimensional face model, apparatus and storage medium
CN109671141B (en) Image rendering method and device, storage medium and electronic device
CN101309389A (en) Method, apparatus and terminal synthesizing visual images
US10084986B2 (en) System and method for video call using augmented reality
CN106506464B (en) A kind of toy exchange method and system based on augmented reality
CN106302132A (en) A kind of 3D instant communicating system based on augmented reality and method
CN106161939A (en) A kind of method, photo taking and terminal
CN105451090B (en) Image processing method and image processing apparatus
CN102571624A (en) Real-time communication system and relevant calculator readable medium
CN110536095A (en) Call method, device, terminal and storage medium
CN108668050A (en) Video capture method and apparatus based on virtual reality
WO2022088819A1 (en) Video processing method, video processing apparatus and storage medium
CN108234879A (en) It is a kind of to obtain the method and apparatus for sliding zoom video
CN110807769B (en) Image display control method and device
CN109754464A (en) Method and apparatus for generating information
CN110555815B (en) Image processing method and electronic equipment
WO2020056694A1 (en) Augmented reality communication method and electronic devices
CN108370437A (en) Multi-view point video stabilizes
CN108513090B (en) Method and device for group video session
CN113409468A (en) Image processing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160511

RJ01 Rejection of invention patent application after publication