CN117041461A - Video communication background processing method and system based on VR technology - Google Patents

Video communication background processing method and system based on VR technology Download PDF

Info

Publication number
CN117041461A
CN117041461A CN202310778522.3A CN202310778522A CN117041461A CN 117041461 A CN117041461 A CN 117041461A CN 202310778522 A CN202310778522 A CN 202310778522A CN 117041461 A CN117041461 A CN 117041461A
Authority
CN
China
Prior art keywords
module
scene
video communication
environment
background processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310778522.3A
Other languages
Chinese (zh)
Inventor
戴光权
唐泽鹏
邓正豪
王晓杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Unicom Online Information Technology Co Ltd
China Unicom WO Music and Culture Co Ltd
Original Assignee
China Unicom Online Information Technology Co Ltd
China Unicom WO Music and Culture Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Unicom Online Information Technology Co Ltd, China Unicom WO Music and Culture Co Ltd filed Critical China Unicom Online Information Technology Co Ltd
Priority to CN202310778522.3A priority Critical patent/CN117041461A/en
Publication of CN117041461A publication Critical patent/CN117041461A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/12Messaging; Mailboxes; Announcements

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a video communication background processing method and a video communication background processing system based on VR technology, which belong to the technical field of video communication. According to the invention, the video communication module is arranged, wherein the camera module shoots human bodies and environments, the shot pictures are displayed through the image display module, then the human body scene segmentation module segments the human body parts and the scene parts into two independent parts, the scene picture deletion module deletes the scene parts to only keep the human body parts, and finally the background generation display module can display pictures of characters and backgrounds after scene switching, and only the switched scenes can be seen opposite in the video communication process, so that embarrassment is effectively avoided, and privacy of people in the video communication process is protected.

Description

Video communication background processing method and system based on VR technology
Technical Field
The invention belongs to the technical field of video communication, and particularly relates to a video communication background processing method and system based on VR technology.
Background
Video communication is also called video telephone, and is divided into two modes of routing IP line and routing ordinary telephone line. Video communication generally refers to a communication mode for transmitting voice and image of a person in real time between mobile phones based on the internet and a mobile internet terminal.
In the video communication process, the face and the environment of people are displayed in front of the other side, if the people are in a private environment at this time and do not want to know own privacy, the background is generally subjected to fuzzy processing by using the existing background fuzzy processing technology, but the situation of embarrassment is also caused, and inconvenience is brought to the communication of people.
Disclosure of Invention
The invention aims at: in order to solve the problem that people use a background blurring processing technology to blur the background to cause embarrassment and influence communication, the video communication background processing method and system based on the VR technology are provided.
In order to achieve the above purpose, the present invention adopts the following technical scheme:
the utility model provides a video communication background processing system based on VR technique, includes VR scene applet module, video communication module and environment adjustment module, VR scene applet module and video communication module two-way connection, video communication module and environment adjustment module two-way connection.
As a further description of the above technical solution:
the video communication module comprises a camera module, an image display module, a human body scene segmentation module, a scene picture deletion module, a scene introduction module, a human body scene fusion module, a background generation display module, a scene selection module and a background processing program opening module.
As a further description of the above technical solution:
the output end of the camera shooting module is electrically connected with the input end of the image display module, the output end of the image display module is electrically connected with the input end of the human body scene segmentation module, the output end of the human body scene segmentation module is electrically connected with the input end of the scene picture deleting module, the output end of the scene picture deleting module is electrically connected with the input end of the scene introducing module, the output end of the scene introducing module is electrically connected with the input end of the human body scene fusion module, and the output end of the human body scene fusion module is electrically connected with the input end of the background generation display module.
As a further description of the above technical solution:
the background processing program opening module is connected with the scene selection module in a bidirectional way, and the output end of the background processing program opening module is electrically connected with the input end of the scene introduction module.
As a further description of the above technical solution:
the VR scene applet module comprises an environment picture acquisition module, a VR model building module, a scene making module, a scene information storage module and a scene display module.
As a further description of the above technical solution:
the output end of the environment picture acquisition module is electrically connected with the input end of the VR model building module, the output end of the VR model building module is electrically connected with the input end of the scene making module, the output end of the scene making module is electrically connected with the input end of the scene information storage module, and the output end of the scene information storage module is electrically connected with the input end of the scene display module.
As a further description of the above technical solution:
the environment adjusting module comprises a weather selecting module, a brightness adjusting module, a rain potential adjusting module and an attached environment sound adjusting module.
As a further description of the above technical solution:
the output ends of the brightness adjusting module, the rain potential adjusting module and the attached environment sound adjusting module are electrically connected with the input end of the weather selecting module.
As a further description of the above technical solution:
the attached environment sound adjusting module comprises a reworking mechanical sound adjusting module, a talking noisy sound adjusting module and a natural sound adjusting module.
A use method of a video communication background processing system based on VR technology specifically comprises the following steps:
s1: the environment picture acquisition module can acquire pictures of a region with a frequent moving range, all the shot pictures are transmitted to the VR model building module, the VR model building module can fuse environment information of a large number of pictures together, finally the scene making module can make a piece of familiar real scene information according to the fused environment information, finally the scene information is transmitted to the scene information storage module to be stored for convenient subsequent use, and the scene display module can call out and display all the scene information from the scene information storage module;
s2: the shooting module shoots human bodies and environments, shot pictures are displayed through the image display module, then the human body scene segmentation module segments the human body parts and the scene parts into two independent parts, the scene picture deletion module deletes the scene parts and only retains the human body parts, the VR scene applet module can be connected when the background processing program opening module is controlled, and finally a proper scene is selected through the scene selection module;
s3: the scene is imported into the human body part through the scene importing module, then the selected scene information and the human body part information are imported into the human body scene fusing module, finally the human body scene fusing module fuses the two types together, finally the background generating and displaying module can display the pictures of the characters and the background after the scene is switched, and only the switched scene can be seen in the opposite direction in the video communication process;
s4: after the scene is selected, a weather item conforming to the current weather can be selected through the weather selection module, such as rainy, snowy or overcast days, and the brightness adjustment module can achieve the purpose of changing light brightness through adjusting brightness, so that the scene environment after adjustment can conform to the current environment more, by arranging the auxiliary environment sound adjustment module, the heavy engineering mechanical sound adjustment module can simulate the working sound of equipment when the surrounding environment has construction sites, the talking noisy sound adjustment module can adjust the talking noisy sound in the environment, and finally the natural sound adjustment module can simulate wind sound, rain sound, animal sound and the like, so that the selected scene can be more real in display.
In summary, due to the adoption of the technical scheme, the beneficial effects of the invention are as follows:
1. according to the invention, through setting up the video communication module, wherein the camera shooting module shoots the human body and the environment, the shot picture is displayed through the image display module, then the human body scene segmentation module segments the human body part and the scene part into two independent parts, the scene part is deleted by the scene picture deletion module, only the human body part is reserved, the VR scene applet module can be connected when the background processing program is controlled to start the module, finally, after a proper scene is selected through the scene selection module, the scene is imported into the human body part through the scene importing module, then, the selected scene information and the human body part information are imported into the human body scene fusion module, finally, the human body scene fusion module fuses the two parts together, and finally, the background generation display module can display the picture of the person and the background after the scene is switched, and only the switched scene can be seen opposite to the video communication process, thereby effectively avoiding embarrassment and protecting the privacy of people in the video communication process.
2. According to the invention, through setting the VR scene applet module, the environment picture acquisition module can acquire pictures of a region with a frequent activity range, and transmit all the shot pictures to the VR model building module, the VR model building module can fuse a large amount of environment information of the pictures together, finally the scene making module can make a piece of familiar real scene information according to the fused environment information, finally the scene information is transmitted to the scene information storage module for storage and convenient subsequent use, and the scene display module can call and display all the scene information from the scene information storage module, so that people can watch and select when selecting scenes conveniently, and the use of people is facilitated.
3. According to the invention, through arranging the environment adjusting module, after the scene is selected, a weather item conforming to the current weather can be selected through the weather selecting module, such as rainy, snowy or overcast days, and the brightness adjusting module can achieve the purpose of changing the light brightness through adjusting the brightness, so that the adjusted scene environment can conform to the current environment more, through arranging the attached environment sound adjusting module, the heavy machinery sound adjusting module can simulate the working sound of equipment when the surrounding environment has construction sites, the talking noisy sound adjusting module can adjust the talking noisy sound in the environment, and finally the natural sound adjusting module can simulate wind sound, rain sound, animal sounds and the like, so that the selected scene can be more realistic in display.
Drawings
Fig. 1 is a schematic structural diagram of a VR technology-based video communication background processing method and a VR technology-based video communication background processing system according to the present invention;
fig. 2 is a schematic diagram of a video communication background processing method and a system thereof based on VR technology according to the present invention;
fig. 3 is a schematic system diagram of a VR scene applet module in a VR technology-based video communication background processing method and system according to the present invention;
fig. 4 is a system schematic diagram of a VR technology-based video communication background processing method and a system heavy environment adjusting module thereof according to the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1-4, the present invention provides a technical solution: the video communication background processing system based on the VR technology comprises a VR scene applet module, a video communication module and an environment adjusting module, wherein the VR scene applet module is in bidirectional connection with the video communication module, the video communication module comprises a camera shooting module, an image display module, a human body scene segmentation module, a scene picture deleting module, a scene introducing module, a human body scene fusion module, a background generation display module, a scene selecting module and a background processing program starting module, the output end of the camera shooting module is in electric connection with the input end of the image display module, the output end of the image display module is in electric connection with the input end of the human body scene segmentation module, the output end of the human body scene segmentation module is in electric connection with the input end of the scene introducing module, the output end of the scene introducing module is in electric connection with the input end of the human body scene fusion module, the output end of the human body scene fusion module is in electric connection with the input end of the background generation display module, the background processing program starting module is in bidirectional connection with the scene selecting module, and the output end of the background processing program starting module is in electric connection with the input end of the scene introducing module;
the specific implementation mode is as follows: through setting up video communication module, wherein camera module shoots human body and environment, the picture of shooing shows through image display module, then human scene segmentation module cuts apart human body part and scene part into two independent parts, and remove the scene part by scene picture deletion module and only remain human body part, can connect VR scene applet module when controlling the background processing procedure and open the module, after selecting suitable scene through the scene selection module at last, with the scene import module with the scene import into human body part, the scene information and the human body part information of selection all import into human body scene fusion module at last, human scene fusion module fuses together two kinds, finally the scene that the scene was changed over can be shown to the scene generation display module, and just can see the scene after the switch over in video communication in-process face too, people's privacy has been effectively avoided in the video communication process to the embarrassment.
The VR scene applet module comprises an environment picture acquisition module, a VR model building module, a scene making module, a scene information storage module and a scene display module, wherein the output end of the environment picture acquisition module is electrically connected with the input end of the VR model building module;
the specific implementation mode is as follows: through setting up VR scene applet module, wherein the environment picture obtains the module and can gather people and shoot the regional picture of frequent range of activity to in transmitting the VR model establishment module with all pictures of shooing, VR model establishment module can be in the same place according to the environmental information fusion with a large amount of pictures, scene preparation module can be according to the real scene information of the preparation of fusion environmental information one person familiar with at last scene information is transmitted to scene information storage module in and is saved and make things convenient for subsequent use, and scene display module can call out and demonstrate each scene information in scene information storage module, make things convenient for people to watch when selecting the scene and select, made things convenient for people's use.
The video communication module is in bidirectional connection with the environment adjusting module, the environment adjusting module comprises a weather selecting module, a brightness adjusting module, a rain adjusting module and an attached environment sound adjusting module, the output ends of the brightness adjusting module, the rain adjusting module and the attached environment sound adjusting module are electrically connected with the input end of the weather selecting module, and the attached environment sound adjusting module comprises a reworking mechanical sound adjusting module, a talking noisy sound adjusting module and a natural sound adjusting module;
the specific implementation mode is as follows: through setting up environment adjustment module, accessible weather selection module selects the weather item that accords with current weather after the scene is selected, for example rainy, snowy or overcast, and brightness adjustment module can reach the purpose of changing light luminance through adjusting brightness, let the scene environment after adjusting can more accord with environment at present, through setting up subsidiary environment sound adjustment module, wherein heavy industry machinery sound adjustment module can simulate the sound of equipment work when the surrounding environment has the construction place, and conversation noisy sound adjustment module can adjust the size of conversation noisy sound in the environment, at last natural sound adjustment module can simulate wind sound, rain sound and animal sound etc. and can appear more true when showing the scene of using.
Working principle: when in use, the environment picture acquisition module can acquire pictures of areas with frequent activity ranges, all the shot pictures are transmitted into the VR model building module, the VR model building module can fuse environment information of a large number of pictures together, finally the scene making module can make a piece of familiar real scene information according to the fused environment information, finally the scene information is transmitted into the scene information storage module to be stored for convenient subsequent use, the scene display module can call and display each scene information from the scene information storage module, people can conveniently watch and select when selecting scenes, the shooting module shoots human bodies and environments, the shot pictures are displayed through the image display module, then the human body scene segmentation module segments the human body parts and the scene parts into two independent parts, the scene part is deleted by the scene picture deleting module, only a human body part is reserved, the VR scene applet module can be connected when the background processing program is controlled to start the module, finally, after a proper scene is selected by the scene selecting module, the scene is imported into the human body part by the scene importing module, then, the selected scene information and the human body part information are all imported into the human body scene fusing module, finally, the human body scene fusing module fuses the two kinds of information together, finally, the background generating and displaying module can display the pictures of characters and the background after the scene is switched, only the switched scene can be seen opposite in the video communication process, the weather item conforming to the current weather can be selected by the weather selecting module after the scene is selected, such as rainy, snowy or overcast, and the brightness adjusting module can achieve the aim of changing the brightness of light through adjusting the brightness, the scene environment after adjustment can more accord with the environment at present, through setting up subsidiary environment sound adjustment module, wherein heavy industry machinery sound adjustment module can simulate the sound of equipment work when the surrounding environment has construction place, and the conversation is noisy the size that the sound adjustment module can adjust the conversation in the environment noisy sound, and natural sound adjustment module can simulate wind sound, rain sound and animal and call sound etc. at last, and the scene of messenger's choosing can appear more true when the show.
The foregoing is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art, who is within the scope of the present invention, should make equivalent substitutions or modifications according to the technical scheme of the present invention and the inventive concept thereof, and should be covered by the scope of the present invention.

Claims (10)

1. The utility model provides a video communication background processing system based on VR technique, includes VR scene applet module, video communication module and environment adjustment module, its characterized in that, VR scene applet module and video communication module both way junction, video communication module and environment adjustment module both way junction.
2. The VR technology-based video communication background processing system of claim 1, wherein the video communication module comprises a camera module, an image display module, a human scene segmentation module, a scene picture deletion module, a scene import module, a human scene fusion module, a background generation display module, a scene selection module, and a background processing program opening module.
3. The VR technology-based video communication background processing system of claim 2, wherein the output end of the camera module is electrically connected to the input end of the image display module, the output end of the image display module is electrically connected to the input end of the human scene segmentation module, the output end of the human scene segmentation module is electrically connected to the input end of the scene picture deletion module, the output end of the scene picture deletion module is electrically connected to the input end of the scene import module, the output end of the scene import module is electrically connected to the input end of the human scene fusion module, and the output end of the human scene fusion module is electrically connected to the input end of the background generation display module.
4. The VR technology-based video communication background processing system of claim 3, wherein the background processing program starting module is bi-directionally connected with the scene selection module, and an output end of the background processing program starting module is electrically connected with an input end of the scene introduction module.
5. The VR technology based video communication background processing system of claim 1, wherein the VR scene applet module comprises an environment picture acquisition module, a VR model creation module, a scene information storage module, and a scene display module.
6. The VR technology based video communication background processing system of claim 5, wherein the output end of the environmental picture obtaining module is electrically connected to the input end of the VR model building module, the output end of the VR model building module is electrically connected to the input end of the scene making module, the output end of the scene making module is electrically connected to the input end of the scene information storage module, and the output end of the scene information storage module is electrically connected to the input end of the scene display module.
7. The VR technology based video communication background processing system of claim 1, wherein the environmental conditioning module comprises a weather selection module, a shading adjustment module, a rain level adjustment module, and an attached environmental sound adjustment module.
8. The VR technology-based video communication background processing system of claim 7, wherein the outputs of the dimming module, the rain level adjustment module, and the attached environmental sound adjustment module are electrically connected to the input of the weather selection module.
9. The VR technology based video communication background processing system of claim 8, wherein the ambient sound conditioning module comprises a reworking mechanical sound conditioning module, a talk noise conditioning module, and a natural sound conditioning module.
10. The method for using a VR technology-based video communication background processing system according to any one of claims 1-9, comprising the steps of:
s1: the environment picture acquisition module can acquire pictures of a region with a frequent moving range, all the shot pictures are transmitted to the VR model building module, the VR model building module can fuse environment information of a large number of pictures together, finally the scene making module can make a piece of familiar real scene information according to the fused environment information, finally the scene information is transmitted to the scene information storage module to be stored for convenient subsequent use, and the scene display module can call out and display all the scene information from the scene information storage module;
s2: the shooting module shoots human bodies and environments, shot pictures are displayed through the image display module, then the human body scene segmentation module segments the human body parts and the scene parts into two independent parts, the scene picture deletion module deletes the scene parts and only retains the human body parts, the VR scene applet module can be connected when the background processing program opening module is controlled, and finally a proper scene is selected through the scene selection module;
s3: the scene is imported into the human body part through the scene importing module, then the selected scene information and the human body part information are imported into the human body scene fusing module, finally the human body scene fusing module fuses the two types together, finally the background generating and displaying module can display the pictures of the characters and the background after the scene is switched, and only the switched scene can be seen in the opposite direction in the video communication process;
s4: after the scene is selected, a weather item conforming to the current weather can be selected through the weather selection module, such as rainy, snowy or overcast days, and the brightness adjustment module can achieve the purpose of changing light brightness through adjusting brightness, so that the scene environment after adjustment can conform to the current environment more, by arranging the auxiliary environment sound adjustment module, the heavy engineering mechanical sound adjustment module can simulate the working sound of equipment when the surrounding environment has construction sites, the talking noisy sound adjustment module can adjust the talking noisy sound in the environment, and finally the natural sound adjustment module can simulate wind sound, rain sound, animal sound and the like, so that the selected scene can be more real in display.
CN202310778522.3A 2023-06-29 2023-06-29 Video communication background processing method and system based on VR technology Pending CN117041461A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310778522.3A CN117041461A (en) 2023-06-29 2023-06-29 Video communication background processing method and system based on VR technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310778522.3A CN117041461A (en) 2023-06-29 2023-06-29 Video communication background processing method and system based on VR technology

Publications (1)

Publication Number Publication Date
CN117041461A true CN117041461A (en) 2023-11-10

Family

ID=88623311

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310778522.3A Pending CN117041461A (en) 2023-06-29 2023-06-29 Video communication background processing method and system based on VR technology

Country Status (1)

Country Link
CN (1) CN117041461A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117251059A (en) * 2023-11-17 2023-12-19 天津市品茗科技有限公司 Three-dimensional holographic interaction system and method based on AR

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117251059A (en) * 2023-11-17 2023-12-19 天津市品茗科技有限公司 Three-dimensional holographic interaction system and method based on AR
CN117251059B (en) * 2023-11-17 2024-01-30 天津市品茗科技有限公司 Three-dimensional holographic interaction system and method based on AR

Similar Documents

Publication Publication Date Title
CN117041461A (en) Video communication background processing method and system based on VR technology
CN101345843B (en) Method and system for implementing full view video of visible mobile terminal
CN100420297C (en) Mobile communication terminal and program
KR100628756B1 (en) Video effect provide apparatus for mobile station at Video telephony and the Method of the Same
JP2002354436A (en) Video telephone apparatus
EP0691780A3 (en) Multimedia conferencing system
CN113422903A (en) Photographing mode switching method, photographing mode switching apparatus, storage medium, and program product
EP1158786A3 (en) Transmission of the region of interest of an image
HK1082626A1 (en) A method of reducing bandwidth in a communication network
CN106331528A (en) Photograph processing method and image photograph equipment
CN102158681A (en) Method for coordinately shooting in videophone and mobile terminal
CN103096012B (en) Adjust method, equipment and system that image shows
EP2466883A1 (en) Method and device for realizing videophone
CN103716537A (en) Photograph synthesizing method and terminal
EP0797338A3 (en) Method and arrangement for inter-connecting a virtual-reality world and the real world for the purpose of establishing a real-time communications connection such as a telephone call connection
KR20070117284A (en) Method for image composition in dual camera having mobile phone
CN106488126A (en) A kind of can the photographic method of auto zoom picture size, system and its mobile terminal
CN106101575B (en) A kind of generation method, device and the mobile terminal of augmented reality photo
CN113395476A (en) Virtual character video call method and system based on three-dimensional face reconstruction
CN101500126A (en) Method for sending special effect scene in video call process
CN102984371A (en) Method for mobile phone to acquire and display current geographic position
KR101303279B1 (en) Method and device for synthesizing image using multiful cameras
JP2008160295A (en) Video telephone system and video telephone apparatus
CN100592750C (en) Folding communication terminal apparatus
CN107231482A (en) It is a kind of to avoid user from bowing the method for operating handset terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication