CN109361888A - Method of adjustment and device, the video call device and storage medium of call background - Google Patents
Method of adjustment and device, the video call device and storage medium of call background Download PDFInfo
- Publication number
- CN109361888A CN109361888A CN201811251364.1A CN201811251364A CN109361888A CN 109361888 A CN109361888 A CN 109361888A CN 201811251364 A CN201811251364 A CN 201811251364A CN 109361888 A CN109361888 A CN 109361888A
- Authority
- CN
- China
- Prior art keywords
- background image
- image
- current virtual
- virtual
- virtual background
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72484—User interfaces specially adapted for cordless or mobile telephones wherein functions are triggered by incoming communication events
Abstract
The embodiment of the invention discloses a kind of methods of adjustment of call background and device, video call device and storage medium.The method of adjustment of the call background includes: to obtain the rotation or scaled data of camera；According to rotation or scaled data, the corresponding extension background image of current talking background image is obtained；Current talking background image is updated using background image is extended.It is single that the technical solution of the embodiment of the present invention solves video calling image background in the prior art, and the mobile technological deficiency changed in position that user can not be corresponded to, the change of rotating manner progress extended state of camera can be matched by realizing the background image in video calling image, so that dynamic consecutive variations can be presented in the background image in video calling image, the form for enriching video calling improves the video calling experience of user.
Description
Technical field
The present embodiments relate to video call technology field more particularly to the methods of adjustment and dress of a kind of call background
It sets, video call device and storage medium.
Background technique
With the continuous development of the verbal systems such as network communications technology and mobile phone, the talking mode of people is had occurred
The variation of matter.Nowadays people can realize the voice communication simultaneously participated in many ways and two sides or multi-party by verbal system
The video calling simultaneously participated in, enriches the exchange way of people, while greatly increasing the exchange efficiency of people.
Existing video call process, typically using the image of camera actual photographed as video calling image, or
It is the background in the image using fixed background image replacement camera actual photographed, then leads to composograph as video
Talk about image.
In the implementation of the present invention, the discovery prior art has following defects that the process in video calling to inventor
In, background image is single, and the position movement that cannot match user changes.
Summary of the invention
In view of this, the embodiment of the invention provides a kind of methods of adjustment of call background and device, video call device
And storage medium realizes the background image in video calling image and can match and take the photograph to optimize existing video call method
As the rotating manner of head carries out the change of extended state.
In a first aspect, being applied to video calling mistake the embodiment of the invention provides a kind of method of adjustment of call background
Cheng Zhong, comprising:
Obtain the rotation data or scaled data of camera；
According to the rotation data or the scaled data, the corresponding virtual extension background of current virtual background image is obtained
Image；
The current virtual background image is updated using the virtual extension background image.
In the above-mentioned methods, optionally, described according to the rotation data, it is corresponding to obtain current virtual background image
It is virtual to extend background image, comprising:
The angle and direction horizontally rotated, and the angle and direction vertically rotated are determined according to the rotation data；
Current virtual background image is extended according to the angle and direction horizontally rotated, dummy level is obtained and prolongs
Stretch background image；
The dummy level is extended background image to extend according to the angle and direction vertically rotated, obtains void
It is quasi- to extend background image.
In the above-mentioned methods, optionally, described according to the scaled data, it is corresponding to obtain current virtual background image
It is virtual to extend background image, comprising:
Imago in scaling will be used as with the matched point of the central pixel point of current virtual background image in virtual background image
Vegetarian refreshments, and according to the scaled data, operation is zoomed in and out to the virtual background image, obtains scaling virtual background image,
Wherein, the current virtual background image is the truncated picture from the virtual background image；
Centered on pixel corresponding with the scaling central pixel point in the scaling virtual background image, from described
Interception size image identical with the size of the current virtual background image in virtual background image is scaled, is virtually extended
Background image.
In the above-mentioned methods, optionally, further includes:
The background in the user images that the camera obtains is replaced using the updated current virtual background image
Image obtains video calling image；
Other verbal systems video calling image being sent in the video call process.
In the above-mentioned methods, optionally, further includes:
Obtain the word segmentation result of the corresponding text information of video calling voice of user；
Judge in the word segmentation result whether include and the matched word of current virtual background image；
If include in the word segmentation result with the matched word of current virtual background image, by the matched word
Corresponding image is added to the current virtual background image, generates new current virtual background image.
In the above-mentioned methods, optionally, further includes:
Judge in the current virtual background image whether to include the subject image with Speed attribute；
If including the subject image with Speed attribute in the current virtual background image, the video for obtaining user is logical
The word speed of language sound, and the subject image is adjusted according to the word speed, form new current virtual background image.
In second aspect, the embodiment of the invention provides a kind of adjustment devices of call background, are set to video calling and set
In standby, comprising:
Rotation data obtains module, for obtaining the rotation data or scaled data of camera；
The virtual background image that extends obtains module, for obtaining current according to the rotation data or the scaled data
The corresponding virtual extension background image of virtual background image；
Background image update module, for updating the current virtual Background using the virtual extension background image
Picture.
In above-mentioned apparatus, optionally, the virtual background image acquisition module that extends includes:
Angle and direction determination unit, the angle and direction for being horizontally rotated according to rotation data determination, and
The angle and direction vertically rotated；
Image level extension apparatus, for by current virtual background image according to the angle and direction horizontally rotated into
Row extends, and obtains dummy level and extends background image；
Image extends vertically unit, for the dummy level to be extended background image according to the angle vertically rotated
Extended with direction, obtains virtually extending background image.
In the third aspect, the embodiment of the invention provides a kind of video call device, the video call device includes:
One or more processors；
Storage device, for storing one or more programs；
When one or more of programs are executed by one or more of processors, so that one or more of processing
Device realizes the method for adjustment of the call background as described in any embodiment of that present invention.
It is described the embodiment of the invention provides a kind of storage medium comprising computer executable instructions in fourth aspect
Computer executable instructions as computer processor when being executed for executing the call back as described in any embodiment of that present invention
The method of adjustment of scape.
The embodiment of the invention provides a kind of methods of adjustment of call background and device, video call device and storage to be situated between
Matter changes the corresponding video calling of this video call device by the rotating manner of the camera according to this video call device
Virtual background image, solve in the prior art that video calling image background is single, and the position that can not correspond to user is moved
The dynamic technological deficiency changed, realize the background image in video calling image can match the rotating manner of camera into
The change of row extended state enriches video calling so that dynamic consecutive variations can be presented in the background image in video calling image
Form, improve user video calling experience.
Detailed description of the invention
Fig. 1 is a kind of flow chart of the method for adjustment for call background that the embodiment of the present invention one provides；
Fig. 2 a is a kind of flow chart of the method for adjustment of call background provided by Embodiment 2 of the present invention；
Fig. 2 b is the exemplary diagram of virtual background image provided by Embodiment 2 of the present invention；
Fig. 2 c is the exemplary diagram of the current virtual background image provided by Embodiment 2 of the present invention intercepted by Fig. 2 b；
Fig. 2 d is the exemplary diagram that the corresponding dummy level of Fig. 2 c provided by Embodiment 2 of the present invention extends background image；
Fig. 2 e is the corresponding virtual exemplary diagram for extending background image of Fig. 2 d provided by Embodiment 2 of the present invention；
Fig. 2 f is showing for the current virtual background image that Fig. 2 e addition moon provided by Embodiment 2 of the present invention obtains later
Example diagram；
Fig. 3 a is a kind of flow chart of the method for adjustment for call background that the embodiment of the present invention three provides；
Fig. 3 b is the exemplary diagram for the virtual background image that the embodiment of the present invention three provides；
Fig. 3 c is the exemplary diagram for the current virtual background image intercepted by Fig. 3 b that the embodiment of the present invention three provides；
Fig. 3 d is the corresponding virtual exemplary diagram for extending background image of Fig. 3 c that the embodiment of the present invention three provides；
Fig. 4 is a kind of structure chart of the adjustment device for call background that the embodiment of the present invention four provides；
Fig. 5 is a kind of structure chart for video call device that the embodiment of the present invention five provides.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawing to of the invention specific real
Example is applied to be described in further detail.It is understood that specific embodiment described herein is used only for explaining the present invention,
Rather than limitation of the invention.
It also should be noted that only the parts related to the present invention are shown for ease of description, in attached drawing rather than
Full content.It should be mentioned that some exemplary embodiments are described before exemplary embodiment is discussed in greater detail
At the processing or method described as flow chart.Although operations (or step) are described as the processing of sequence by flow chart,
It is that many of these operations can be implemented concurrently, concomitantly or simultaneously.In addition, the sequence of operations can be by again
It arranges.The processing can be terminated when its operations are completed, it is also possible to have the additional step being not included in attached drawing.
The processing can correspond to method, function, regulation, subroutine, subprogram etc..
Embodiment one
Fig. 1 is a kind of flow chart of the method for adjustment for call background that the embodiment of the present invention one provides, the side of the present embodiment
Method can be executed by the adjustment device of call background, which can be realized by way of hardware and/or software, and generally may be used
It is integrated in video call device, such as plate telegram, smart phone etc..The method of the present embodiment specifically includes:
S101, the rotation data or scaled data for obtaining camera.
It is appreciated that during video calling, for obtaining the camera shooting of video calling image in video call device
Head can follow the position of calling user mobile and the rotation of progress level and vertical direction, can also be the master according to user
Dynamic manipulation is correspondingly rotated.
In the present embodiment, the case where camera rotates includes at least above-mentioned two situations.The rotation data of camera has
Body refers to the angle and direction of horizontal turning of video camera, and the angle and direction vertically rotated.
In the present embodiment, the scaled data of camera specifically refers to corresponding with the adjustment mode of the focal length of camera
The diminution data of data, the specially amplification data of camera or camera.
S102, according to rotation data or scaled data, obtain the corresponding virtual extension Background of current virtual background image
Picture.
In the present embodiment, this video call device, which is exported to the video calling image of other video call devices, is not
The original image that camera obtains, but it is generated to replace the background image in above-mentioned original image using virtual background image
Image.
Further, in this embodiment virtual background image it is different from conventional virtual background image, conventional is virtual
Background image is usually limited content and size and the sub-picture that form to be shown matches.However, the void in the present embodiment
The size of quasi- background image is greater than the size of video calling image display window, i.e., only display is virtual in video calling window carries on the back
A part of image in scape image.Further, in this embodiment virtual background image either two dimensional image, can also be with
It is 3-D image.
In the present embodiment, current virtual background image specifically refers to the current angular according to camera, logical from this video
Truncated picture in the virtual background image that words equipment is currently chosen.For example, it can be set are as follows: when camera is in initial
It is current virtual background image by the image interception in the virtual background image middle region currently chosen when camera position.Its
In, the interception way of image specifically can be to be intercepted by image interception frame.
Further, in the present embodiment, it after camera generates rotation, will be obtained according to the rotating manner of camera
The corresponding virtual extension background image of current virtual background image is taken, to realize the corresponding video calling of this video call device
The background of image can extend variation with the rotation of camera.Specifically, it is necessary first to which it is different that setting corresponds to camera
Rotation direction, the every rotation minimum rotation degree of camera should be corresponding virtual in current virtual background image by image capture block
Which direction several rows or several column pixels are slided in background image.Wherein, image capture block specifically refers to working as according to camera
Front position intercepts the slider box of current virtual background image from virtual background image.
Since the size of different virtual background images may be not quite similar, and camera is along horizontal and vertical direction
Rotational angle is fixed, thus in order to guarantee camera turn to each different position can obtain it is different virtual
Extend background image, the virtual background image different corresponding to size, image acquisition when camera every rotation minimum rotation angle
The sliding distance of frame is different.
Further, correspond to camera identical rotational angle in the same direction, the sliding distance of image capture block
It may be the same or different.Specifically, the integrality in order to guarantee image, after image capture block should be made to slide as far as possible
The image newly obtained is the general image of object, or the image in image capture block is made to have globality, takes the photograph so corresponding to
As identical rotational angle, the rotational angle of image capture block are possible different in the same direction for head.
When camera all produces rotation in the horizontal direction and the vertical direction, image capture block specifically can first basis
Rotation data in horizontal direction is slided, and is then further continued for being slided according to the rotation data in vertical direction, in turn
Obtain last current virtual background image.
It further, in the present embodiment, will be according to the focal length of camera when the focal length of camera generates variation
Variation pattern obtains the corresponding virtual extension background image of current virtual background image, to realize that this video call device is corresponding
The background of video calling image can extend variation with the focal length variations of camera.Specifically, can be according to camera
Focal length variations, what determination should carry out the corresponding virtual background image of current virtual background image zooms in or out operation,
Then virtual extension background image is determined according to the virtual background image after zooming in or out.
Further, the corresponding virtual background image of current virtual background image is either the virtual background figure defaulted
Picture is also possible to the virtual background image of user's selection, can also be the void of the dialog context real-time change current according to user
Quasi- background image etc., the present embodiment is not limited this.
S103, current virtual background image is updated using the virtual background image that extends.
In the present embodiment, after obtaining virtual extension background image, it will use virtual extension background image replacement
Current virtual background image.Then, the video calling image obtained using new current virtual background image and camera is raw
The corresponding video calling image of cost video verbal system, and the video calling image is sent to other correspondents.
The embodiment of the invention provides a kind of methods of adjustment of call background, pass through the camera shooting according to this video call device
The rotating manner of head, changes the virtual background image of the corresponding video calling of this video call device, solves in the prior art
Video calling image background is single, and the mobile technological deficiency changed in the position that can not correspond to user, realizes video
The rotating manner that background image in call image can match camera carries out the change of extended state, so that video calling image
In background image dynamic consecutive variations can be presented, enrich the form of video calling, improve user video calling experience.
Embodiment two
Fig. 2 a is a kind of flow chart of the method for adjustment of call background provided by Embodiment 2 of the present invention.It is more than the present embodiment
It states and optimizes based on embodiment, in the present embodiment, give a kind of virtual acquisition side for extending background image of materialization
Method increases the acquisition and sending step of video calling image, increases according to user speech information into current virtual background image
The movement velocity of object is specific in the process and increase foundation user speed adjustment current virtual background image of addition image
Embodiment.
Correspondingly, the method for the present embodiment specifically includes:
S201, the rotation data for obtaining camera.
S202, the angle and direction horizontally rotated, and the angle and direction vertically rotated are determined according to rotation data.
In the present embodiment, according to the rotation data of camera, the angle that camera rotates in the horizontal direction can be determined
The direction (such as turning left, or turn right) of degree and rotation, can also determine the angle that camera rotates in vertical direction
And the direction (such as turning upwards, or turn downwards) of rotation.
S203, current virtual background image is extended according to the angle and direction horizontally rotated, obtains dummy level
Extend background image.
In the present embodiment, camera has carried out the rotation of horizontal direction, has also carried out the rotation of vertical direction, responds
Rotation in terms of the two first passes through this step 203 according to the angle and direction horizontally rotated and obtains dummy level extension back
Scape image, then final virtual extension background image is obtained according to the angle and direction vertically rotated by step 204.
In the present embodiment, current virtual background image is extended according to the angle and direction horizontally rotated and specifically may be used
To be that image capture block is located at position in virtual background image to the left (it is assumed that in the present embodiment from current virtual background image
Camera turns left in the horizontal direction) it is mobile with horizontally rotate at a distance from angle automatching (i.e. with the matched picture of rotational angle
The columns of element).
Fig. 2 b is the general image of virtual background image, and Fig. 2 c is the current virtual Background intercepted from Fig. 2 b
Picture, Fig. 2 d are that the corresponding dummy level of Fig. 2 c extends image, and as shown in Figure 2 d, the trees after horizontal extension in Fig. 2 c are moved out of
Current virtual background image, bus are moved into current virtual background image.
S204, dummy level extension background image is extended according to the angle and direction vertically rotated, is obtained virtual
Extend background image.
In the present embodiment, dummy level is extended into background image and carries out extension tool according to the angle and direction vertically rotated
It is upward (it is assumed that originally that body can be the position for being located at image capture block in virtual background image from dummy level extension background image
Camera is rotated up in vertical direction in embodiment) it is mobile with the matched distance of vertical rotational angle (i.e. and rotational angle
The line number of matched pixel).
Fig. 2 e is the virtual extension background image obtained after Fig. 2 d is upwardly extended in vertical direction, is schemed as shown in Figure 2 e
The sun in 2d is moved out of dummy level and extends background image, and bridge is moved into dummy level and extends background image.
S205, current virtual background image is updated using the virtual background image that extends.
S206, obtain user the corresponding text information of video calling voice word segmentation result.
In the present embodiment, new current virtual background image is obtained in addition to the rotation according to camera extends, also passed through
Step 206 and step 208 (step 206 to step 208 is collectively referred to as process A) will add with the matched image of the voice messaging of user
It adds in current virtual background image, also passes through step 209 and step 210 (step 209 and step 210 are collectively referred to as process B)
Movement velocity according to the object in the word speed adjustment current virtual background image of user is adjusted.
What needs to be explained here is that process A, process B and process C (step 201 to step 205 is collectively referred to as process C)
Implementation procedure there is no successive point, first carry out which process is all possible, being only in the present embodiment illustratively will be upper
The implementation procedure for stating three processes is expressed as first carrying out process C, then implementation procedure B, last implementation procedure C.
In the present embodiment, it by step 206 to step 208 can will in the video calling voice of user include and work as
The image information of preceding virtual background images match is added in current virtual background image.
Firstly, being analyzed by voice messaging of this step 206 to user, carried out correspondingly with will pass through step 207
Judgement.
In the present embodiment, after the video calling voice for obtaining user, the voice messaging is converted into text first
Then information carries out word segmentation processing to text information, obtains after removal stop words, punctuation mark, auxiliary word and modal particle
Last word segmentation result.
S207, judge in word segmentation result whether include with the matched word of current virtual background image, if so, executing step
Rapid 208, if it is not, thening follow the steps 209.
In the present embodiment, it is specifically referred to and current virtual background image pair with the matched word of current virtual background image
The word for the virtual background images match answered.Different virtual background images, which corresponds to, different adds image.For example, when
When virtual background image is sea, addible image may include ship, the sun, whale etc.；When virtual background image is highway
When, addible image may include automobile, bicycle and traffic instruction etc..
S208, the corresponding image of the matched word is added to current virtual background image, generates new current virtual
Background image.
In the present embodiment, when include in word segmentation result with the matched word of current virtual background image, then then can
The corresponding image of matching word is added in current virtual background image.Specifically, if the matching word is corresponding
Image is corresponding with the point of addition of setting, then need to then carry out the addition of image according to the point of addition；If the matching word
The point of addition that corresponding image is not set, then the addition of image can be carried out at an arbitrary position, certainly added figure
Face and body as video calling user cannot be blocked.
Assuming that being the moon with the matched word of current virtual background image, Fig. 2 f is to generate after the addition moon in Fig. 2 e
New current virtual background image.
S209, judge in current virtual background image whether to include the subject image with Speed attribute, if so, executing
Step 210, if it is not, thening follow the steps 211.
In the present embodiment, the speed (such as velocity of rotation, sway velocity etc.) of the object in current virtual background image
Can change, and be that the word speed current according to user is accordingly changed.Subject image with Speed attribute is specific
Refer to the object for existing and showing with forms of motion in current virtual background image, typically can be windmill, automobile (passes through
The original place rotor of wheel shows the travel speed of automobile) etc..
S210, obtain user video calling voice word speed, and subject image is adjusted according to word speed, is formed new current
Virtual background image.
In the present embodiment, subject image is adjusted according to word speed, the method for forming new current virtual background image is specific
It can be by changing in the corresponding virtual background image of current virtual background image, the speed parameter of the subject image, in turn
Change the virtual background image, is then obtained from the virtual background image after change again by image capture block new current
Virtual background image.
Background image in S211, the user images obtained using new current virtual background image replacement camera, is obtained
To video calling image.
In the present embodiment, after obtaining new current virtual background image, it just will use new current virtual background
Image replaces the background image in the user images that camera obtains, and then obtains new video calling image.
S212, other verbal systems being sent to video calling image in video call process.
The embodiment of the invention provides a kind of method of adjustment of call background, this method embodies virtual extension Background
The acquisition methods of picture, realizing current virtual background image can rotating manner progress phase that is correct, quickly responding camera
It adjusts with answering, increases the acquisition and sending step of video calling image, increase foundation user speech information to current virtual
The process of image, the dialog context for allowing the background image of video calling current with user more adjunction are added in background image
Closely, the call experience for substantially increasing user is also added according to object in user speed adjustment current virtual background image
Movement velocity enriches the entertainment of video calling.
Embodiment three
Fig. 3 a is a kind of flow chart of the method for adjustment for call background that the embodiment of the present invention three provides.It is more than the present embodiment
It states and optimizes based on embodiment, in the present embodiment, give a kind of virtual acquisition side for extending background image of materialization
The specific embodiment of method.
Correspondingly, the method for the present embodiment specifically includes:
S301, the scaled data for obtaining camera.
It in the present embodiment, can be according to the variation pattern of the focal length of camera, i.e., when the focal length of camera generates variation
The scaled data (such as the multiple zoomed in or out) of camera obtains virtual extension back corresponding with current virtual background image
Scape image.
S302, it will be used as in scaling in virtual background image with the matched point of the central pixel point of current virtual background image
Imago vegetarian refreshments, and according to scaled data, operation is zoomed in and out to virtual background image, obtains scaling virtual background image, wherein
Current virtual background image is the truncated picture from virtual background image.
In the present embodiment, the scaled data according to camera is realized by step 302 and step 303, obtains and works as
The corresponding virtual extension background image of preceding virtual background image.
Firstly, obtaining the zoomed image of virtual background image, concrete mode by step 302 are as follows:
A, scaling central pixel point is determined
It, can be in virtual background since current virtual background image is the image being truncated to from virtual background image
Location of pixels of the central pixel point of current virtual background image in virtual background image is relatively easily determined in image, and
The position is determined as to scale central pixel point.
Fig. 3 b show virtual background image, Fig. 3 c show intercepted from Fig. 3 b as current virtual background image
Image.
B, the corresponding zoomed image of virtual background image is obtained
After determining scaling central pixel point, virtual background image is integrally zoomed in or out according to scaled data
The operation arrived obtains scaling virtual background image.
S303, to scale in virtual background image centered on the corresponding pixel of scaling central pixel point, it is empty from scaling
Interception size image identical with the size of current virtual background image in quasi- background image, obtains virtually extending background image.
It when due to zooming in and out operation to virtual background image, is carried out centered on scaling central pixel point, therefore,
Pixel corresponding with scaling central pixel point can be relatively easily obtained from scaling virtual background image.
In the present embodiment, after obtaining scaling virtual background image, figure can be intercepted from scaling virtual background image
As extending background image as virtual, method particularly includes: it is corresponding with scaling central pixel point in virtual background image to scale
Centered on pixel, the interception size image identical with the size of current virtual background image from scaling virtual background image,
Extend background image using institute's truncated picture as virtual.
Fig. 3 d is to be intercepted centered on pixel corresponding with the central pixel point of Fig. 3 c from the enlarged drawing of Fig. 3 b
Image identical with Fig. 3 c size, the image are virtual extension background image.
S304, current virtual background image is updated using the virtual background image that extends.
The embodiment of the invention provides a kind of method of adjustment of call background, this method embodies virtual extension Background
The acquisition methods of picture, realizing current virtual background image can focal length variations progress phase that is correct, quickly responding camera
It adjusts with answering.
Example IV
Fig. 4 is a kind of structure chart of the adjustment device for call background that the embodiment of the present invention four provides.As shown in figure 4, institute
Stating device includes: that rotation data obtains module 401, the virtual background image that extends obtains module 402 and background image update mould
Block 403, in which:
Rotation data obtains module 401, for obtaining the rotation data of camera；
The virtual background image that extends obtains module 402, for it is corresponding to obtain current virtual background image according to rotation data
Virtual extension background image；
Background image update module 403, for updating current virtual background image using the virtual background image that extends.
The embodiment of the invention provides a kind of adjustment device of call background, which passes through rotation data first and obtains mould
Block 401 obtains the rotation data of camera, then obtains module 402 according to rotation data by virtually extending background image, obtains
The corresponding virtual extension background image of current virtual background image is taken, finally by background image update module 403, for using
The virtual background image that extends updates current virtual background image.
Which solves video calling image background in the prior art is single, and the position that can not correspond to user is mobile
The technological deficiency changed, the rotating manner progress of camera can be matched by realizing the background image in video calling image
The change of extended state enriches video calling so that dynamic consecutive variations can be presented in the background image in video calling image
Form improves the video calling experience of user.
On the basis of the various embodiments described above, the virtual background image acquisition module 402 that extends may include:
Angle and direction determination unit, the angle and direction for being horizontally rotated according to rotation data determination, and it is vertical
The angle and direction of rotation；
Image level extension apparatus, for prolonging current virtual background image according to the angle and direction horizontally rotated
It stretches, obtains dummy level and extend background image；
Image extends vertically unit, for by dummy level extend background image according to the angle and direction vertically rotated into
Row extends, and obtains virtually extending background image.
On the basis of the various embodiments described above, can also include:
Video calling image collection module, for using updated current virtual background image replacement camera to obtain
Background image in user images obtains video calling image；
Video calling image sending module, other calls for being sent to video calling image in video call process
Equipment.
On the basis of the various embodiments described above, can also include:
Word segmentation module, the word segmentation result of the corresponding text information of video calling voice for obtaining user；
Word segmentation result judgment module, for judge in word segmentation result whether include and the matched word of current virtual background image
Language；
Image adding module, if for include in word segmentation result with the matched word of current virtual background image, should
The corresponding image of matched word is added to current virtual background image, generates new current virtual background image.
On the basis of the various embodiments described above, can also include:
Subject image judgment module, for judging in current virtual background image whether to include the object with Speed attribute
Image；
Subject image adjusts module, if for including the subject image with Speed attribute in current virtual background image,
The word speed of the video calling voice of user is then obtained, and subject image is adjusted according to word speed, forms new current virtual Background
Picture.
The adjustment device of call background provided by the embodiment of the present invention can be used for executing any embodiment of that present invention offer
Call background method of adjustment, have corresponding functional module, realize identical beneficial effect.
Embodiment five
Fig. 5 is a kind of structural schematic diagram for video call device that the embodiment of the present invention five provides.Fig. 5, which is shown, to be suitable for using
Come realize embodiment of the present invention exemplary video verbal system 12 block diagram.The video call device 12 that Fig. 5 is shown is only
An example, should not function to the embodiment of the present invention and use scope bring any restrictions.
As shown in figure 5, video call device 12 is showed in the form of universal computing device.The component of video call device 12
Can include but is not limited to: one or more processor or processing unit 16, system storage 28 connect not homologous ray group
The bus 18 of part (including system storage 28 and processing unit 16).
Bus 18 indicates one of a few class bus structures or a variety of, including memory bus or Memory Controller,
Peripheral bus, graphics acceleration port, processor or the local bus using any bus structures in a variety of bus structures.It lifts
For example, these architectures include but is not limited to industry standard architecture (ISA) bus, microchannel architecture (MAC)
Bus, enhanced isa bus, Video Electronics Standards Association (VESA) local bus and peripheral component interconnection (PCI) bus.
Video call device 12 typically comprises a variety of computer system readable media.These media can be it is any can
The usable medium accessed by video call device 12, including volatile and non-volatile media, it is moveable and immovable
Medium.
System storage 28 may include the computer system readable media of form of volatile memory, such as arbitrary access
Memory (RAM) 30 and/or cache memory 32.Video call device 12 may further include it is other it is removable/no
Movably, volatile/non-volatile computer system storage medium.Only as an example, storage system 34 can be used for reading and writing
Immovable, non-volatile magnetic media (Fig. 5 do not show, commonly referred to as " hard disk drive ").It, can although being not shown in Fig. 5
To provide the disc driver for reading and writing to removable non-volatile magnetic disk (such as " floppy disk "), and it is non-volatile to moving
Property CD (such as CD-ROM, DVD-ROM or other optical mediums) read and write CD drive.In these cases, each drive
Dynamic device can be connected by one or more data media interfaces with bus 18.Memory 28 may include at least one program
Product, the program product have one group of (for example, at least one) program module, these program modules are configured to perform the present invention
The function of each embodiment.
Program/utility 40 with one group of (at least one) program module 42 can store in such as memory 28
In, such program module 42 include but is not limited to operating system, one or more application program, other program modules and
It may include the realization of network environment in program data, each of these examples or certain combination.Program module 42 is usual
Execute the function and/or method in embodiment described in the invention.
Video call device 12 can also be with one or more external equipments 14 (such as keyboard, sensing equipment, display 24
Deng) communication, the equipment interacted with the video call device 12 can be also enabled a user to one or more to be communicated, and/or with
Any equipment that the video call device 12 is communicated with one or more of the other calculating equipment (adjust by such as network interface card
Modulator-demodulator etc.) communication.This communication can be carried out by input/output (I/O) interface 22.Also, video call device
12 can also pass through network adapter 20 and one or more network (such as local area network (LAN), wide area network (WAN) and/or public affairs
Common network network, such as internet) communication.As shown, network adapter 20 passes through the other of bus 18 and video call device 12
Module communication.It should be understood that although not shown in the drawings, other hardware and/or software can be used in conjunction with video call device 12
Module, including but not limited to: microcode, device driver, redundant processing unit, external disk drive array, RAID system, magnetic
Tape drive and data backup storage system etc..
Processing unit 16 by the program that is stored in system storage 28 of operation, thereby executing various function application and
Data processing, such as realize the method for adjustment of call background provided by the embodiment of the present invention.Namely: obtain the rotation of camera
Data；According to the rotation data, the corresponding virtual extension background image of current virtual background image is obtained；Using described virtual
Extend background image and updates the current virtual background image.
Embodiment six
The embodiment of the present invention six additionally provides a kind of storage medium comprising computer executable instructions, and the computer can
It executes instruction when being executed as computer processor for executing the method for adjustment of call background described in the embodiment of the present invention.?
That is: the rotation data of camera is obtained；According to the rotation data, the corresponding virtual extension back of current virtual background image is obtained
Scape image；The current virtual background image is updated using the virtual extension background image.
The computer storage medium of the embodiment of the present invention, can be using any of one or more computer-readable media
Combination.Computer-readable medium can be computer-readable signal media or computer readable storage medium.It is computer-readable
Storage medium for example may be-but not limited to-the system of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, device or
Device, or any above combination.The more specific example (non exhaustive list) of computer readable storage medium includes: tool
There are electrical connection, the portable computer diskette, hard disk, random access memory (RAM), read-only memory of one or more conducting wires
(ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-
ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.In this document, computer-readable storage
Medium can be any tangible medium for including or store program, which can be commanded execution system, device or device
Using or it is in connection.
Computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal,
Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited
In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can
Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for
By the use of instruction execution system, device or device or program in connection.
The program code for including on computer-readable medium can transmit with any suitable medium, including --- but it is unlimited
In wireless, electric wire, optical cable, RF etc. or above-mentioned any appropriate combination.
The computer for executing operation of the present invention can be write with one or more programming languages or combinations thereof
Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++,
It further include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with
It fully executes, partly execute on the user computer on the user computer, being executed as an independent software package, portion
Divide and partially executes or executed on a remote computer or server completely on the remote computer on the user computer.?
Be related in the situation of remote computer, remote computer can pass through the network of any kind --- including local area network (LAN) or
Wide area network (WAN)-be connected to subscriber computer, or, it may be connected to outer computer (such as mentioned using Internet service
It is connected for quotient by internet).
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that
The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation,
It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention
It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also
It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.
Claims (10)
1. a kind of method of adjustment of call background is applied in video call process characterized by comprising
Obtain the rotation data or scaled data of camera；
According to the rotation data or the scaled data, the corresponding virtual extension Background of current virtual background image is obtained
Picture；
The current virtual background image is updated using the virtual extension background image.
2. the method according to claim 1, wherein described according to the rotation data, acquisition current virtual back
The corresponding virtual extension background image of scape image, comprising:
The angle and direction horizontally rotated, and the angle and direction vertically rotated are determined according to the rotation data；
Current virtual background image is extended according to the angle and direction horizontally rotated, dummy level is obtained and extends back
Scape image；
The dummy level is extended background image to extend according to the angle and direction vertically rotated, is virtually prolonged
Stretch background image.
3. the method according to claim 1, wherein described according to the scaled data, acquisition current virtual back
The corresponding virtual extension background image of scape image, comprising:
It will be used as scaling central pixel point with the matched point of the central pixel point of current virtual background image in virtual background image,
And according to the scaled data, operation is zoomed in and out to the virtual background image, obtains scaling virtual background image, wherein
The current virtual background image is the truncated picture from the virtual background image；
Centered on pixel corresponding with the scaling central pixel point in the scaling virtual background image, from the scaling
Interception size image identical with the size of the current virtual background image in virtual background image obtains virtually extending background
Image.
4. method according to any one of claim 1-3, which is characterized in that further include:
The background image in the user images that the camera obtains is replaced using the updated current virtual background image,
Obtain video calling image；
Other verbal systems video calling image being sent in the video call process.
5. the method according to claim 1, wherein further include:
Obtain the word segmentation result of the corresponding text information of video calling voice of user；
Judge in the word segmentation result whether include and the matched word of current virtual background image；
If include in the word segmentation result with the matched word of current virtual background image, the matched word is corresponding
Image be added to the current virtual background image, generate new current virtual background image.
6. the method according to claim 1, wherein further include:
Judge in the current virtual background image whether to include the subject image with Speed attribute；
If including the subject image with Speed attribute in the current virtual background image, the video calling language of user is obtained
The word speed of sound, and the subject image is adjusted according to the word speed, form new current virtual background image.
7. a kind of adjustment device of call background, is set in video call device characterized by comprising
Rotation data obtains module, for obtaining the rotation data or scaled data of camera；
The virtual background image that extends obtains module, for obtaining current virtual according to the rotation data or the scaled data
The corresponding virtual extension background image of background image；
Background image update module, for updating the current virtual background image using the virtual extension background image.
8. device according to claim 7, which is characterized in that virtual extension background image obtains module and includes:
Angle and direction determination unit, the angle and direction for being horizontally rotated according to rotation data determination, and it is vertical
The angle and direction of rotation；
Image level extension apparatus, for prolonging current virtual background image according to the angle and direction horizontally rotated
It stretches, obtains dummy level and extend background image；
Image extends vertically unit, for the dummy level to be extended background image according to the angle vertically rotated and side
To being extended, obtain virtually extending background image.
9. a kind of video call device, which is characterized in that the video call device includes:
One or more processors；
Storage device, for storing one or more programs；
When one or more of programs are executed by one or more of processors, so that one or more of processors are real
Now such as the method for adjustment of call background of any of claims 1-6.
10. a kind of storage medium comprising computer executable instructions, the computer executable instructions are by computer disposal
For executing the method for adjustment such as call background of any of claims 1-6 when device executes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811251364.1A CN109361888B (en) | 2018-10-25 | 2018-10-25 | Method and device for adjusting call background, video call equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811251364.1A CN109361888B (en) | 2018-10-25 | 2018-10-25 | Method and device for adjusting call background, video call equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109361888A true CN109361888A (en) | 2019-02-19 |
| CN109361888B CN109361888B (en) | 2022-10-14 |
Family
ID=65346679
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811251364.1A Active CN109361888B (en) | 2018-10-25 | 2018-10-25 | Method and device for adjusting call background, video call equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109361888B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111464699A (en) * | 2020-04-02 | 2020-07-28 | 北京小米移动软件有限公司 | Call background display method, device and storage medium |
| CN113422914A (en) * | 2021-06-24 | 2021-09-21 | 脸萌有限公司 | Video generation method, device, equipment and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104980651A (en) * | 2014-04-04 | 2015-10-14 | 佳能株式会社 | Image processing apparatus and control method |
| CN106383648A (en) * | 2015-07-27 | 2017-02-08 | 青岛海信电器股份有限公司 | Intelligent terminal voice display method and apparatus |
| WO2017141584A1 (en) * | 2016-02-16 | 2017-08-24 | ソニー株式会社 | Information processing apparatus, information processing system, information processing method, and program |
| CN107613227A (en) * | 2017-09-11 | 2018-01-19 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN107734266A (en) * | 2017-09-11 | 2018-02-23 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN108513060A (en) * | 2017-02-28 | 2018-09-07 | 三星电子株式会社 | Use the electronic equipment of the image pickup method and support this method of external electronic device |
| CN108664231A (en) * | 2018-05-11 | 2018-10-16 | 腾讯科技（深圳）有限公司 | Display methods, device, equipment and the storage medium of 2.5 dimension virtual environments |
-
2018
- 2018-10-25 CN CN201811251364.1A patent/CN109361888B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104980651A (en) * | 2014-04-04 | 2015-10-14 | 佳能株式会社 | Image processing apparatus and control method |
| CN106383648A (en) * | 2015-07-27 | 2017-02-08 | 青岛海信电器股份有限公司 | Intelligent terminal voice display method and apparatus |
| WO2017141584A1 (en) * | 2016-02-16 | 2017-08-24 | ソニー株式会社 | Information processing apparatus, information processing system, information processing method, and program |
| CN108513060A (en) * | 2017-02-28 | 2018-09-07 | 三星电子株式会社 | Use the electronic equipment of the image pickup method and support this method of external electronic device |
| CN107613227A (en) * | 2017-09-11 | 2018-01-19 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN107734266A (en) * | 2017-09-11 | 2018-02-23 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN108664231A (en) * | 2018-05-11 | 2018-10-16 | 腾讯科技（深圳）有限公司 | Display methods, device, equipment and the storage medium of 2.5 dimension virtual environments |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111464699A (en) * | 2020-04-02 | 2020-07-28 | 北京小米移动软件有限公司 | Call background display method, device and storage medium |
| CN113422914A (en) * | 2021-06-24 | 2021-09-21 | 脸萌有限公司 | Video generation method, device, equipment and medium |
| CN113422914B (en) * | 2021-06-24 | 2023-11-21 | 脸萌有限公司 | Video generation method, device, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109361888B (en) | 2022-10-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100971498B1 (en) | Method and apparatus for 2d image transformation with various artistic effect | |
| US20150153952A1 (en) | Techniques for interacting with handheld devices | |
| US11887235B2 (en) | Puppeteering remote avatar by facial expressions | |
| KR20120017869A (en) | Terminal device and method for providing step object information | |
| WO2020048484A1 (en) | Super-resolution image reconstruction method and apparatus, and terminal and storage medium | |
| WO2023035531A1 (en) | Super-resolution reconstruction method for text image and related device thereof | |
| US20180239973A1 (en) | A real-time multiple vehicle detection and tracking | |
| CN111603772B (en) | Area detection method, device, equipment and storage medium | |
| CN110706339B (en) | Three-dimensional face reconstruction method and device, electronic equipment and storage medium | |
| CN107566793A (en) | Method, apparatus, system and electronic equipment for remote assistance | |
| US11398020B2 (en) | Generating a composite image | |
| GB2558027A (en) | Quadrangulated layered depth images | |
| CN109361888A (en) | Method of adjustment and device, the video call device and storage medium of call background | |
| CN114428577A (en) | Vehicle-mounted interaction method, vehicle-mounted interaction terminal and vehicle-mounted system | |
| KR20210087043A (en) | Concurrent texture sampling | |
| CN110572717A (en) | Video editing method and device | |
| JP6671673B1 (en) | Layout analysis method, reading assistance device, circuit and medium | |
| CN112714263B (en) | Video generation method, device, equipment and storage medium | |
| JP2021500764A (en) | Improving video quality for video calls | |
| WO2020155908A1 (en) | Method and apparatus for generating information | |
| CN113496506A (en) | Image processing method, device, equipment and storage medium | |
| CN112528707A (en) | Image processing method, device, equipment and storage medium | |
| CN114040129B (en) | Video generation method, device, equipment and storage medium | |
| CN107730566A (en) | A kind of method, apparatus, mobile terminal and storage medium for generating expression | |
| CN115576470A (en) | Image processing method and apparatus, augmented reality system, and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210511 Address after: 201210 4 / F, building 1, 701 Naxian Road, Shanghai pilot Free Trade Zone, Pudong New Area, Shanghai, China Applicant after: Shanghai Xiaodu Technology Co.,Ltd. Address before: 100012 block K1, North America International Business Center, 86 Beiyuan Road, Datun street, Chaoyang District, Beijing Applicant before: BEIJING XIAOYU ZAIJIA TECHNOLOGY CO.,LTD. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |