CN109361888B - Method and device for adjusting call background, video call equipment and storage medium - Google Patents

Method and device for adjusting call background, video call equipment and storage medium Download PDF

Info

Publication number
CN109361888B
CN109361888B CN201811251364.1A CN201811251364A CN109361888B CN 109361888 B CN109361888 B CN 109361888B CN 201811251364 A CN201811251364 A CN 201811251364A CN 109361888 B CN109361888 B CN 109361888B
Authority
CN
China
Prior art keywords
background image
image
virtual
virtual background
video call
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811251364.1A
Other languages
Chinese (zh)
Other versions
CN109361888A (en
Inventor
陈剑峰
宋晨枫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Xiaodu Technology Co Ltd
Original Assignee
Shanghai Xiaodu Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Xiaodu Technology Co Ltd filed Critical Shanghai Xiaodu Technology Co Ltd
Priority to CN201811251364.1A priority Critical patent/CN109361888B/en
Publication of CN109361888A publication Critical patent/CN109361888A/en
Application granted granted Critical
Publication of CN109361888B publication Critical patent/CN109361888B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72484—User interfaces specially adapted for cordless or mobile telephones wherein functions are triggered by incoming communication events

Abstract

The embodiment of the invention discloses a method and a device for adjusting a call background, video call equipment and a storage medium. The method for adjusting the call background comprises the following steps: acquiring rotation or scaling data of a camera; acquiring an extension background image corresponding to the current call background image according to the rotation or scaling data; and updating the current call background image by using the extended background image. The technical scheme of the embodiment of the invention overcomes the technical defects that the background of the video call image is single and cannot be changed corresponding to the position movement of the user in the prior art, and realizes that the background image in the video call image can be matched with the rotation mode of the camera to change the extension state, so that the background image in the video call image can show dynamic continuous change, the video call mode is enriched, and the video call experience of the user is improved.

Description

Method and device for adjusting call background, video call equipment and storage medium
Technical Field
The embodiment of the invention relates to the technical field of video call, in particular to a method and a device for adjusting call background, video call equipment and a storage medium.
Background
With the continuous development of network communication technology and communication devices such as mobile phones, the communication modes of people are qualitatively changed. At present, people can realize voice call with simultaneous participation of multiple parties and video call with simultaneous participation of two or more parties through call equipment, so that the communication modes of people are enriched, and the communication efficiency of people is greatly improved.
In the existing video call process, generally, an image actually shot by a camera is used as a video call image, or a fixed background image is used to replace a background in the image actually shot by the camera, and then a composite image is used as the video call image.
In the process of implementing the invention, the inventor finds that the prior art has the following defects: in the process of video call, the background image is single and can not be changed according to the position movement of the user.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method and an apparatus for adjusting a call background, a video call device, and a storage medium, so as to optimize an existing video call method, and implement that a background image in a video call image can be matched with a rotation mode of a camera to change an extension state.
In a first aspect, an embodiment of the present invention provides a method for adjusting a call background, which is applied to a video call process, and includes:
acquiring rotation data or scaling data of a camera;
acquiring a virtual extended background image corresponding to the current virtual background image according to the rotation data or the zooming data;
updating the current virtual background image using the virtual extended background image.
In the above method, optionally, the obtaining a virtual extended background image corresponding to the current virtual background image according to the rotation data includes:
determining the angle and direction of horizontal rotation and the angle and direction of vertical rotation according to the rotation data;
extending the current virtual background image according to the angle and the direction of the horizontal rotation to obtain a virtual horizontally-extended background image;
and extending the virtual horizontally extending background image according to the vertical rotation angle and direction to obtain a virtual extending background image.
In the above method, optionally, the obtaining a virtual extended background image corresponding to the current virtual background image according to the zoom data includes:
taking a point in the virtual background image, which is matched with a center pixel point of the current virtual background image, as a zooming center pixel point, and zooming the virtual background image according to the zooming data to obtain a zoomed virtual background image, wherein the current virtual background image is an image intercepted from the virtual background image;
and taking a pixel point corresponding to the zooming center pixel point in the zoomed virtual background image as a center, and intercepting an image with the same size as that of the current virtual background image from the zoomed virtual background image to obtain a virtual extended background image.
In the above method, optionally, the method further includes:
replacing a background image in a user image acquired by the camera with the updated current virtual background image to obtain a video call image;
and sending the video call image to other call equipment in the video call process.
In the above method, optionally, the method further includes:
acquiring word segmentation results of text information corresponding to video call voice of a user;
judging whether the word segmentation result comprises words matched with the current virtual background image or not;
and if the word segmentation result comprises a word matched with the current virtual background image, adding an image corresponding to the matched word to the current virtual background image to generate a new current virtual background image.
In the above method, optionally, the method further includes:
judging whether the current virtual background image comprises an object image with a speed attribute;
and if the current virtual background image comprises an object image with a speed attribute, acquiring the speech rate of the video call voice of the user, and adjusting the object image according to the speech rate to form a new current virtual background image.
In a second aspect, an embodiment of the present invention provides an apparatus for adjusting a call background, where the apparatus is disposed in a video call device, and the apparatus includes:
the rotation data acquisition module is used for acquiring rotation data or scaling data of the camera;
the virtual extension background image acquisition module is used for acquiring a virtual extension background image corresponding to the current virtual background image according to the rotation data or the zooming data;
a background image update module for updating the current virtual background image using the virtual extended background image.
In the above apparatus, optionally, the virtual extended background image acquiring module includes:
an angle and direction determining unit for determining an angle and direction of horizontal rotation and an angle and direction of vertical rotation according to the rotation data;
the image horizontal extension unit is used for extending the current virtual background image according to the angle and the direction of the horizontal rotation to obtain a virtual horizontal extension background image;
and the image vertical extension unit is used for extending the virtual horizontal extension background image according to the vertical rotation angle and direction to obtain a virtual extension background image.
In a third aspect, an embodiment of the present invention provides a video call device, where the video call device includes:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the method for adjusting call context according to any embodiment of the present invention.
In a fourth aspect, an embodiment of the present invention provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a method for adjusting a call context according to any embodiment of the present invention.
The embodiment of the invention provides a method and a device for adjusting a call background, a video call device and a storage medium, wherein a virtual background image of a video call corresponding to the video call device is changed according to a rotation mode of a camera of the video call device, so that the technical defects that the background image of the video call in the prior art is single and cannot be changed corresponding to the position movement of a user are overcome, the background image in the video call image can be changed in an extension state by matching with the rotation mode of the camera, the background image in the video call image can show dynamic continuous change, the video call mode is enriched, and the video call experience of the user is improved.
Drawings
Fig. 1 is a flowchart of a method for adjusting a call background according to an embodiment of the present invention;
fig. 2a is a flowchart of a method for adjusting a call background according to a second embodiment of the present invention;
fig. 2b is an exemplary diagram of a virtual background image provided by the second embodiment of the present invention;
FIG. 2c is an exemplary diagram of the current virtual background image captured from FIG. 2b according to a second embodiment of the present invention;
fig. 2d is an exemplary diagram of the virtual horizontally-extending background image corresponding to fig. 2c provided in the second embodiment of the present invention;
fig. 2e is an exemplary diagram of the virtual extended background image corresponding to fig. 2d according to the second embodiment of the present invention;
FIG. 2f is an exemplary diagram of the current virtual background image obtained after the moon is added in FIG. 2e according to the second embodiment of the present invention;
fig. 3a is a flowchart of a method for adjusting a call background according to a third embodiment of the present invention;
fig. 3b is an exemplary diagram of a virtual background image provided by the third embodiment of the present invention;
fig. 3c is an exemplary diagram of the current virtual background image captured from fig. 3b according to a third embodiment of the present invention;
fig. 3d is an exemplary diagram of the virtual extended background image corresponding to fig. 3c provided in the third embodiment of the present invention;
fig. 4 is a structural diagram of an apparatus for adjusting a call background according to a fourth embodiment of the present invention;
fig. 5 is a structural diagram of a video call device according to a fifth embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention are described in further detail below with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention.
It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example one
Fig. 1 is a flowchart of a method for adjusting a call background according to an embodiment of the present invention, where the method of this embodiment may be executed by a device for adjusting a call background, and the device may be implemented in a hardware and/or software manner, and may be generally integrated in a video call device, such as a flat cable, a smart phone, and the like. The method of the embodiment specifically includes:
s101, obtaining rotation data or scaling data of the camera.
It can be known that, in the video call process, the camera that is used for acquireing the video call image among the video call equipment can follow the position of conversation user and move and carry out the rotation of level and vertical direction, can also be according to user's initiative and control and carry out corresponding rotation.
In this embodiment, the case where the camera is rotated includes at least the above two cases. The rotation data of the camera specifically refers to the angle and direction of horizontal rotation of the camera and the angle and direction of vertical rotation of the camera.
In this embodiment, the zoom data of the camera specifically refers to data corresponding to an adjustment manner of the focal length of the camera, and specifically refers to zoom-in data of the camera or zoom-out data of the camera.
And S102, acquiring a virtual extended background image corresponding to the current virtual background image according to the rotation data or the scaling data.
In this embodiment, the video call image output by the present video call apparatus to the other video call apparatus is not an original image acquired by the camera, but an image generated by replacing a background image in the original image with a virtual background image.
Further, the virtual background image in the present embodiment is different from a conventional virtual background image, which is generally an image having limited contents and a size matching the window to be displayed. However, the size of the virtual background image in the present embodiment is larger than the size of the video call image display window, that is, only a part of the image in the virtual background image is displayed in the video call window. Further, the virtual background image in the present embodiment may be a two-dimensional image or a three-dimensional image.
In this embodiment, the current virtual background image specifically refers to an image captured from a virtual background image currently selected by the video call device according to a current angle of the camera. For example, the following may be set: when the camera is at the initial shooting position, the image of the middle area of the currently selected virtual background image is intercepted into the current virtual background image. The image capturing mode may specifically be capturing through an image capturing frame.
Further, in this embodiment, after the camera is rotated, the virtual extended background image corresponding to the current virtual background image is obtained according to the rotation mode of the camera, so that the background of the video call image corresponding to the video call device can be extended and changed along with the rotation of the camera. Specifically, it is first necessary to set different rotation directions corresponding to the cameras, and the image capture frame should be slid by several rows or columns of pixels in which direction in the virtual background image corresponding to the current virtual background image every time the camera is rotated by the minimum rotation degree. The image acquisition frame is a sliding frame which specifically intercepts the current virtual background image from the virtual background image according to the current position of the camera.
Because the sizes of different virtual background images may be different, and the rotation angles of the camera in the horizontal and vertical directions are fixed, in order to ensure that the camera can acquire different virtual extension background images when rotating to each different position, the sliding distances of the image acquisition frames are different when the camera rotates by the minimum rotation angle corresponding to the virtual background images with different sizes.
Further, the sliding distances of the image capturing frames may be the same or different corresponding to the same rotation angle of the camera in the same direction. Specifically, in order to ensure the integrity of the image, the newly acquired image after the image acquisition frame slides should be made to be the whole image of the object or the image in the image acquisition frame should have the whole, so the rotation angles of the image acquisition frame may be different corresponding to the same rotation angle of the camera in the same direction.
When the camera rotates in both the horizontal direction and the vertical direction, the image acquisition frame can slide according to the rotation data in the horizontal direction, and then continue to slide according to the rotation data in the vertical direction, so as to acquire the final current virtual background image.
Further, in this embodiment, when the focal length of the camera changes, the virtual extended background image corresponding to the current virtual background image is obtained according to the change mode of the focal length of the camera, so that the background of the video call image corresponding to the video call device can be extended and changed along with the change of the focal length of the camera. Specifically, the zoom-in or zoom-out operation to be performed on the virtual background image corresponding to the current virtual background image may be determined according to the change of the focal length of the camera, and then the virtual extended background image may be determined according to the zoomed-in or zoomed-out virtual background image.
Further, the virtual background image corresponding to the current virtual background image may be a default virtual background image, a virtual background image selected by the user, a virtual background image that changes in real time according to the current call content of the user, and the like, which is not limited in this embodiment.
And S103, updating the current virtual background image by using the virtual extended background image.
In this embodiment, after the virtual extended background image is acquired, the current virtual background image is replaced with the virtual extended background image. And then, generating a video call image corresponding to the video call device by using the new current virtual background image and the video call image acquired by the camera, and sending the video call image to other call parties.
The embodiment of the invention provides a method for adjusting a call background, which changes a virtual background image of a video call corresponding to video call equipment according to a rotation mode of a camera of the video call equipment, solves the technical defects that the background image of the video call in the prior art is single and cannot be changed corresponding to the position movement of a user, and realizes that the background image in the video call image can be matched with the rotation mode of the camera to change an extension state, so that the background image in the video call image can show dynamic continuous change, the video call mode is enriched, and the video call experience of the user is improved.
Example two
Fig. 2a is a flowchart of a method for adjusting a call background according to a second embodiment of the present invention. In this embodiment, a specific implementation manner is added, in which a process of adding an image to a current virtual background image according to user voice information and a process of adjusting a motion speed of an object in the current virtual background image according to a user speech speed are added.
Correspondingly, the method of the embodiment specifically includes:
s201, obtaining rotation data of the camera.
S202, determining the angle and the direction of horizontal rotation and the angle and the direction of vertical rotation according to the rotation data.
In this embodiment, according to the rotation data of the camera, the angle of rotation of the camera in the horizontal direction and the direction of rotation (e.g., left turn, or right turn) can be determined, and the angle of rotation of the camera in the vertical direction and the direction of rotation (e.g., up turn, or down turn) can also be determined.
And S203, extending the current virtual background image according to the angle and the direction of horizontal rotation to obtain a virtual horizontally-extended background image.
In this embodiment, the camera performs rotation in both the horizontal direction and the vertical direction, and in response to the rotation in both the horizontal direction and the vertical direction, a virtual horizontally-extending background image is obtained in step 203 according to the angle and the direction of the horizontal rotation, and then a final virtual horizontally-extending background image is obtained in step 204 according to the angle and the direction of the vertical rotation.
In this embodiment, the extending the current virtual background image by the angle and the direction of the horizontal rotation may specifically be to move the image capturing frame from the position of the current virtual background image in the virtual background image to the left (assuming that the camera head rotates to the left in the horizontal direction in this embodiment) by a distance (i.e., the number of columns of pixels that match the horizontal rotation angle) that matches the horizontal rotation angle.
Fig. 2b is an overall image of the virtual background image, fig. 2c is a current virtual background image obtained by cutting from fig. 2b, and fig. 2d is a virtual horizontally-extending image corresponding to fig. 2c, as shown in fig. 2d, after horizontally extending, the tree in fig. 2c is moved out of the current virtual background image, and the bus is moved into the current virtual background image.
And S204, extending the virtual horizontally-extending background image according to the vertical rotation angle and direction to obtain a virtual extending background image.
In the present embodiment, the extending the virtual horizontally-extending background image by the angle and direction of the vertical rotation may specifically be moving the image capturing frame upward (assuming that the camera head is rotated upward in the vertical direction in the present embodiment) from the position where the virtual horizontally-extending background image is located in the virtual background image by a distance matching the vertical rotation angle (i.e., the number of lines of pixels matching the rotation angle).
Fig. 2e is the virtual extended background image obtained after fig. 2d is extended upward in the vertical direction, as shown in fig. 2e, the sun in fig. 2d is moved out of the virtual horizontally extended background image and the bridge is moved into the virtual horizontally extended background image.
And S205, updating the current virtual background image by using the virtual extended background image.
S206, obtaining word segmentation results of text information corresponding to the video call voice of the user.
In this embodiment, in addition to acquiring a new current virtual background image according to the rotational extension of the camera, an image matching the voice information of the user is added to the current virtual background image through step 206 and step 208 (step 206 to step 208 are collectively referred to as process a), and the movement speed of the object in the current virtual background image is adjusted according to the speech speed of the user through step 209 and step 210 (step 209 and step 210 are collectively referred to as process B).
It should be noted that, the execution processes of the process a, the process B, and the process C (step 201 to step 205 are collectively referred to as the process C) are not consecutive, and it is all possible to execute any process first.
In the present embodiment, image information matched with the current virtual background image included in the video call voice of the user may be added to the current virtual background image through steps 206 to 208.
First, the voice information of the user is analyzed in the present step 206 to make a corresponding judgment in the step 207.
In this embodiment, after the video call voice of the user is acquired, the voice information is first converted into text information, then word segmentation processing is performed on the text information, and a final word segmentation result is obtained after stop words, punctuation marks, auxiliary words and mood words are removed.
S207, judging whether the word segmentation result comprises a word matched with the current virtual background image, if so, executing a step 208, and if not, executing a step 209.
In this embodiment, the word matched with the current virtual background image specifically refers to a word matched with a virtual background image corresponding to the current virtual background image. Different virtual background images correspond to different addable images. For example, when the virtual background image is the sea, the images that may be added may include a boat, the sun, whales, etc.; when the virtual background image is a road, the images that can be added can include cars, bicycles, traffic instructions, and the like.
And S208, adding the image corresponding to the matched word to the current virtual background image to generate a new current virtual background image.
In this embodiment, when the word segmentation result includes a word matched with the current virtual background image, the image corresponding to the matched word is added to the current virtual background image. Specifically, if the image corresponding to the matching word corresponds to a set adding position, adding the image according to the adding position; if the image corresponding to the matching word does not have the set adding position, the image can be added at any position, and the added image cannot block the face and the body of the video call user.
Assuming that the word matched with the current virtual background image is a moon, fig. 2f is a new current virtual background image generated after the moon is added in fig. 2 e.
S209, determining whether the current virtual background image includes an object image with a speed attribute, if yes, executing step 210, and if no, executing step 211.
In this embodiment, the speed (e.g. rotation speed, swing speed, etc.) of the object in the current virtual background image may be changed, and is changed accordingly according to the current speech speed of the user. The object image with the speed attribute specifically refers to an object existing and displayed in a motion form in the current virtual background image, and may be a windmill, an automobile (the traveling speed of the automobile is represented by in-situ rotation of a wheel), and the like.
S210, obtaining the speech rate of the video call speech of the user, and adjusting the object image according to the speech rate to form a new current virtual background image.
In this embodiment, the method for adjusting the object image according to the speech rate and forming the new current virtual background image may specifically be to change the virtual background image by changing a speed parameter of the object image in the virtual background image corresponding to the current virtual background image, and then obtain the new current virtual background image from the changed virtual background image again through the image obtaining frame.
And S211, replacing the background image in the user image acquired by the camera with the new current virtual background image to obtain a video call image.
In this embodiment, after obtaining a new current virtual background image, the new current virtual background image is used to replace a background image in a user image obtained by a camera, so as to obtain a new video call image.
And S212, sending the video call image to other call equipment in the video call process.
The embodiment of the invention provides a method for adjusting a call background, which embodies a method for acquiring a virtual extension background image, realizes that the current virtual background image can be correctly and quickly adjusted correspondingly in response to the rotation mode of a camera, increases the steps of acquiring and sending a video call image, and increases the process of adding an image into the current virtual background image according to the voice information of a user, so that the background image of the video call can be closer to the current call content of the user, the call experience of the user is greatly improved, the movement speed of an object in the current virtual background image is adjusted according to the voice speed of the user, and the entertainment of the video call is enriched.
EXAMPLE III
Fig. 3a is a flowchart of a method for adjusting a call background according to a third embodiment of the present invention. The present embodiment is optimized based on the above embodiments, and in the present embodiment, a specific implementation of the method for acquiring the virtual extended background image is provided.
Correspondingly, the method of the embodiment specifically includes:
s301, acquiring zooming data of the camera.
In this embodiment, when the focal length of the camera changes, the virtual extended background image corresponding to the current virtual background image is obtained according to the changing manner of the focal length of the camera, that is, the zoom data (for example, the magnification factor) of the camera.
S302, taking a point in the virtual background image, which is matched with the center pixel point of the current virtual background image, as a zooming center pixel point, and performing zooming operation on the virtual background image according to zooming data to obtain a zoomed virtual background image, wherein the current virtual background image is an image captured from the virtual background image.
In this embodiment, the step 302 and the step 303 realize that the virtual extended background image corresponding to the current virtual background image is acquired according to the zoom data of the camera.
First, a zoom image of the virtual background image is obtained through step 302, specifically:
A. determining a zoom center pixel point
Because the current virtual background image is an image captured from the virtual background image, the pixel position of the central pixel point of the current virtual background image in the virtual background image can be easily determined in the virtual background image, and the position is determined as the zoom central pixel point.
Fig. 3b shows a virtual background image, and fig. 3c shows an image taken from fig. 3b as a current virtual background image.
B. Obtaining a zoom image corresponding to the virtual background image
And after the zooming center pixel point is determined, carrying out reduction or enlargement operation on the whole virtual background image according to the zooming data to obtain a zoomed virtual background image.
And S303, taking a pixel point corresponding to the zooming center pixel point in the zoomed virtual background image as a center, and intercepting an image with the same size as the current virtual background image from the zoomed virtual background image to obtain a virtual extended background image.
Because the zooming operation is performed by taking the zooming center pixel point as the center when the virtual background image is zoomed, the pixel point corresponding to the zooming center pixel point can be obtained from the zooming virtual background image more easily.
In this embodiment, after obtaining the scaled virtual background image, an image is captured from the scaled virtual background image as a virtual extended background image, and the specific method includes: and taking a pixel point corresponding to the zooming center pixel point in the zoomed virtual background image as a center, intercepting an image with the same size as that of the current virtual background image from the zoomed virtual background image, and taking the intercepted image as a virtual extended background image.
Fig. 3d is an image of the same size as fig. 3c, which is cut from the enlarged view of fig. 3b, with the pixel point corresponding to the central pixel point of fig. 3c as the center, and the image is the virtual extended background image.
And S304, updating the current virtual background image by using the virtual extended background image.
The embodiment of the invention provides a method for adjusting a call background, which embodies a method for acquiring a virtual extension background image and realizes that the current virtual background image can correctly and quickly respond to the focal length change of a camera to carry out corresponding adjustment.
Example four
Fig. 4 is a structural diagram of an apparatus for adjusting a call background according to a fourth embodiment of the present invention. As shown in fig. 4, the apparatus includes: a rotation data acquisition module 401, a virtual extended background image acquisition module 402, and a background image update module 403, wherein:
a rotation data obtaining module 401, configured to obtain rotation data of the camera;
a virtual extended background image obtaining module 402, configured to obtain, according to the rotation data, a virtual extended background image corresponding to the current virtual background image;
a background image updating module 403, configured to update the current virtual background image with the virtual extended background image.
The embodiment of the invention provides a device for adjusting a call background, which first obtains rotation data of a camera through a rotation data obtaining module 401, then obtains a virtual extension background image corresponding to a current virtual background image according to the rotation data through a virtual extension background image obtaining module 402, and finally uses the virtual extension background image to update the current virtual background image through a background image updating module 403.
The device solves the technical defects that the background of the video call image is single and cannot be changed corresponding to the position movement of the user in the prior art, and realizes that the background image in the video call image can be changed in an extension state in a manner of being matched with the rotation mode of the camera, so that the background image in the video call image can show dynamic continuous change, the video call mode is enriched, and the video call experience of the user is improved.
On the basis of the foregoing embodiments, the virtual extended background image acquisition module 402 may include:
an angle and direction determining unit for determining an angle and direction of horizontal rotation and an angle and direction of vertical rotation according to the rotation data;
the image horizontal extension unit is used for extending the current virtual background image according to the horizontal rotation angle and direction to obtain a virtual horizontal extension background image;
and the image vertical extension unit is used for extending the virtual horizontal extension background image according to the vertical rotation angle and direction to obtain a virtual extension background image.
On the basis of the above embodiments, the method may further include:
the video call image acquisition module is used for replacing a background image in a user image acquired by the camera with the updated current virtual background image to obtain a video call image;
and the video call image sending module is used for sending the video call image to other call equipment in the video call process.
On the basis of the above embodiments, the method may further include:
the word segmentation module is used for acquiring word segmentation results of text information corresponding to video call voice of a user;
the word segmentation result judging module is used for judging whether the word segmentation result comprises a word matched with the current virtual background image;
and the image adding module is used for adding the image corresponding to the matched word to the current virtual background image to generate a new current virtual background image if the word segmentation result comprises the word matched with the current virtual background image.
On the basis of the above embodiments, the method may further include:
the object image judging module is used for judging whether the current virtual background image comprises an object image with a speed attribute;
and the object image adjusting module is used for acquiring the speech rate of the video call voice of the user if the current virtual background image comprises the object image with the speed attribute, and adjusting the object image according to the speech rate to form a new current virtual background image.
The device for adjusting the call background provided by the embodiment of the invention can be used for executing the method for adjusting the call background provided by any embodiment of the invention, has corresponding functional modules and realizes the same beneficial effects.
EXAMPLE five
Fig. 5 is a schematic structural diagram of a video call device according to a fifth embodiment of the present invention. Figure 5 illustrates a block diagram of an exemplary video call device 12 suitable for use in implementing embodiments of the present invention. The video call device 12 shown in fig. 5 is only an example and should not bring any limitations to the function and the scope of use of the embodiment of the present invention.
As shown in fig. 5, video call device 12 is in the form of a general purpose computing device. The components of video call device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Video call device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by video call device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and/or cache memory 32. Video call device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 5 and commonly referred to as a "hard drive"). Although not shown in FIG. 5, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination of which may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.
Video call device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with video call device 12, and/or with any devices (e.g., network card, modem, etc.) that enable video call device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, video call device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via network adapter 20. As shown, network adapter 20 communicates with the other modules of video telephony device 12 via bus 18. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with video call device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 16 executes various functional applications and data processing by running a program stored in the system memory 28, for example, to implement the method for adjusting the call background provided by the embodiment of the present invention. Namely: acquiring rotation data of a camera; acquiring a virtual extended background image corresponding to the current virtual background image according to the rotation data; updating the current virtual background image using the virtual extended background image.
EXAMPLE six
The sixth embodiment of the present invention further provides a storage medium containing computer-executable instructions, where the computer-executable instructions are executed by a computer processor to perform the method for adjusting a call context according to the sixth embodiment of the present invention. Namely: acquiring rotation data of a camera; acquiring a virtual extended background image corresponding to the current virtual background image according to the rotation data; updating the current virtual background image using the virtual extended background image.
Computer storage media for embodiments of the present invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing description is only exemplary of the invention and that the principles of the technology may be employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (6)

1. A method for adjusting a call background is applied to a video call process, and is characterized by comprising the following steps:
acquiring zooming data of a camera;
acquiring a virtual extended background image corresponding to the current virtual background image according to the zooming data; the current virtual background image and the virtual extended background image are images intercepted by an image intercepting frame in the currently selected virtual background image, and image zooming operation corresponding to zooming of the camera is executed aiming at the currently selected virtual background image;
updating the current virtual background image using the virtual extended background image;
judging whether the current virtual background image comprises an object image with a speed attribute;
if the current virtual background image comprises an object image with a speed attribute, acquiring the speech rate of the video call voice of a user, and adjusting the object image according to the speech rate to form a new current virtual background image;
wherein, the obtaining of the virtual extended background image corresponding to the current virtual background image according to the zoom data includes:
taking a point in the virtual background image, which is matched with a center pixel point of the current virtual background image, as a zooming center pixel point, and zooming the virtual background image according to the zooming data to obtain a zoomed virtual background image, wherein the current virtual background image is an image intercepted from the virtual background image;
and taking a pixel point corresponding to the zooming center pixel point in the zoomed virtual background image as a center, and intercepting an image with the same size as that of the current virtual background image from the zoomed virtual background image to obtain a virtual extended background image.
2. The method of claim 1, further comprising:
replacing a background image in a user image acquired by the camera with the updated current virtual background image to obtain a video call image;
and sending the video call image to other call equipment in the video call process.
3. The method of claim 1, further comprising:
acquiring word segmentation results of text information corresponding to video call voice of a user;
judging whether the word segmentation result comprises words matched with the current virtual background image or not;
and if the word segmentation result comprises a word matched with the current virtual background image, adding an image corresponding to the matched word to the current virtual background image to generate a new current virtual background image.
4. A device for adjusting call background is arranged in a video call device, and is characterized by comprising:
the data acquisition module is used for acquiring zoom data of the camera;
the virtual extended background image acquisition module is used for acquiring a virtual extended background image corresponding to the current virtual background image according to the zooming data; the current virtual background image and the virtual extended background image are images intercepted by an image intercepting frame in the currently selected virtual background image, and image zooming operation corresponding to zooming of the camera is executed aiming at the currently selected virtual background image;
a background image update module for updating the current virtual background image using the virtual extended background image;
the object image judging module is used for judging whether the current virtual background image comprises an object image with a speed attribute;
the object image adjusting module is used for acquiring the speech rate of the video call voice of the user if the current virtual background image comprises an object image with a speed attribute, and adjusting the object image according to the speech rate to form a new current virtual background image;
the obtaining of the virtual extended background image corresponding to the current virtual background image according to the zoom data includes:
taking a point in the virtual background image, which is matched with a center pixel point of the current virtual background image, as a zooming center pixel point, and zooming the virtual background image according to the zooming data to obtain a zoomed virtual background image, wherein the current virtual background image is an image intercepted from the virtual background image;
and taking a pixel point corresponding to the zooming center pixel point in the zooming virtual background image as a center, and intercepting an image with the same size as that of the current virtual background image from the zooming virtual background image to obtain a virtual extended background image.
5. A video call device, characterized in that the video call device comprises:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the method of adjusting call context of any of claims 1-3.
6. A storage medium containing computer executable instructions for performing the method of call background adjustment of any one of claims 1-3 when executed by a computer processor.
CN201811251364.1A 2018-10-25 2018-10-25 Method and device for adjusting call background, video call equipment and storage medium Active CN109361888B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811251364.1A CN109361888B (en) 2018-10-25 2018-10-25 Method and device for adjusting call background, video call equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811251364.1A CN109361888B (en) 2018-10-25 2018-10-25 Method and device for adjusting call background, video call equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109361888A CN109361888A (en) 2019-02-19
CN109361888B true CN109361888B (en) 2022-10-14

Family

ID=65346679

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811251364.1A Active CN109361888B (en) 2018-10-25 2018-10-25 Method and device for adjusting call background, video call equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109361888B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111464699B (en) * 2020-04-02 2022-10-04 北京小米移动软件有限公司 Call background display method, device and storage medium
CN113422914B (en) * 2021-06-24 2023-11-21 脸萌有限公司 Video generation method, device, equipment and medium

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107734266A (en) * 2017-09-11 2018-02-23 广东欧珀移动通信有限公司 Image processing method and device, electronic installation and computer-readable recording medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6395423B2 (en) * 2014-04-04 2018-09-26 キヤノン株式会社 Image processing apparatus, control method, and program
CN106383648A (en) * 2015-07-27 2017-02-08 青岛海信电器股份有限公司 Intelligent terminal voice display method and apparatus
WO2017141584A1 (en) * 2016-02-16 2017-08-24 ソニー株式会社 Information processing apparatus, information processing system, information processing method, and program
KR20180099026A (en) * 2017-02-28 2018-09-05 삼성전자주식회사 Photographing method using external electronic device and electronic device supporting the same
CN107613227A (en) * 2017-09-11 2018-01-19 广东欧珀移动通信有限公司 Image processing method and device, electronic installation and computer-readable recording medium
CN108664231B (en) * 2018-05-11 2021-02-09 腾讯科技（深圳）有限公司 Display method, device, equipment and storage medium of 2.5-dimensional virtual environment

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107734266A (en) * 2017-09-11 2018-02-23 广东欧珀移动通信有限公司 Image processing method and device, electronic installation and computer-readable recording medium

Also Published As

Publication number Publication date
CN109361888A (en) 2019-02-19

Similar Documents

Publication Publication Date Title
JP7273129B2 (en) Lane detection method, device, electronic device, storage medium and vehicle
CN111292420B (en) Method and device for constructing map
US11783588B2 (en) Method for acquiring traffic state, relevant apparatus, roadside device and cloud control platform
WO2023035531A1 (en) Super-resolution reconstruction method for text image and related device thereof
US10572127B2 (en) Display control of an image on a display screen
US10878608B2 (en) Identifying planes in artificial reality systems
CN109361888B (en) Method and device for adjusting call background, video call equipment and storage medium
CN110796664A (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
US11494961B2 (en) Sticker generating method and apparatus, and medium and electronic device
US10199013B2 (en) Digital image comparison
CN113934297A (en) Interaction method and device based on augmented reality, electronic equipment and medium
WO2023098649A1 (en) Video generation method and apparatus, and device and storage medium
CN113703704B (en) Interface display method, head-mounted display device, and computer-readable medium
CN108920598B (en) Panorama browsing method and device, terminal equipment, server and storage medium
CN112036517A (en) Image defect classification method and device and electronic equipment
CN112465692A (en) Image processing method, device, equipment and storage medium
CN112070903A (en) Virtual object display method and device, electronic equipment and computer storage medium
CN111367598A (en) Action instruction processing method and device, electronic equipment and computer-readable storage medium
US20220301127A1 (en) Image processing pipeline for optimizing images in machine learning and other applications
CN115100360B (en) Image generation method and device, storage medium and electronic equipment
US20240098368A1 (en) Sensor Cropped Video Image Stabilization (VIS)
CN111091848B (en) Method and device for predicting head posture
CN115968544A (en) Real-time virtual remoting in a browser
CN115375801A (en) Image processing method, device, equipment and storage medium
JP2023542598A (en) Character display methods, devices, electronic devices, and storage media

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20210511

Address after: 201210 4 / F, building 1, 701 Naxian Road, Shanghai pilot Free Trade Zone, Pudong New Area, Shanghai, China

Applicant after: Shanghai Xiaodu Technology Co.,Ltd.

Address before: 100012 block K1, North America International Business Center, 86 Beiyuan Road, Datun street, Chaoyang District, Beijing

Applicant before: BEIJING XIAOYU ZAIJIA TECHNOLOGY CO.,LTD.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant