CN117201724A - Video conference processing method and system - Google Patents
Video conference processing method and system Download PDFInfo
- Publication number
- CN117201724A CN117201724A CN202311284489.5A CN202311284489A CN117201724A CN 117201724 A CN117201724 A CN 117201724A CN 202311284489 A CN202311284489 A CN 202311284489A CN 117201724 A CN117201724 A CN 117201724A
- Authority
- CN
- China
- Prior art keywords
- conference
- video conference
- background
- state
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title description 2
- 238000004458 analytical method Methods 0.000 claims abstract description 70
- 238000000034 method Methods 0.000 claims abstract description 44
- 238000009877 rendering Methods 0.000 claims description 5
- 230000002194 synthesizing effect Effects 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 239000000463 material Substances 0.000 description 4
- 235000008733 Citrus aurantifolia Nutrition 0.000 description 2
- 235000011941 Tilia x europaea Nutrition 0.000 description 2
- 239000004571 lime Substances 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000037237 body shape Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/144—Movement detection
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The invention relates to the field of video conferences, and particularly discloses a method and a system for processing a video conference. According to the method, the background occupation data is recorded by carrying out initialization processing of the video conference; acquiring real-time interconnection data of a mobile terminal, performing indoor positioning analysis, and identifying the video conference state of conference personnel; when the video conference state is a free conference state, audio follow-up transfer of the video conference is carried out, and pickup follow-up adjustment of the video conference is carried out; and when the video conference state is a fixed conference state, locking and adjusting the video conference. The method can acquire real-time interconnection data of the mobile terminal, carry out indoor positioning analysis, identify the video conference state of conference personnel, carry out audio follow-up transfer and pickup follow-up adjustment in the free conference state, and carry out video transfer identification in the fixed conference state, thereby realizing video and audio follow-up transfer and pickup follow-up adjustment of the video conference and creating a convenient video conference environment for home offices of the conference personnel.
Description
Technical Field
The invention belongs to the field of video conferences, and particularly relates to a method and a system for processing a video conference.
Background
The video conference is a conference in which people at two or more places talk face to face on line through communication equipment and a network, and at the transmitting end of communication, image and sound signals are converted into digital signals, and at the receiving end, the digital signals are reproduced into information which can be acquired visually and audibly.
In recent years, home offices have formed a trend of new offices, which promotes video conferences to flexible and easy use, popularization, civilian use, and home miniaturization.
Among the prior art, video conferencing uses when the office at home, can't follow the removal of meeting personnel, follows the transfer between a plurality of equipment, and can't carry out indoor location to the meeting personnel, can not carry out different pickup adjustment according to the different positions of meeting personnel, can't create convenient video conferencing environment for the office at home of meeting personnel.
Disclosure of Invention
The embodiment of the invention aims to provide a method and a system for processing a video conference, which aim to solve the problems in the background technology.
In order to achieve the above object, the embodiment of the present invention provides the following technical solutions:
a method of processing a video conference, the method comprising the steps of:
initializing a video conference, identifying the characteristics of conference personnel, generating a conference background image, analyzing background occupation, and recording background occupation data;
acquiring real-time interconnection data of a mobile terminal, performing indoor positioning analysis, determining a current positioning position, and identifying a video conference state of conference personnel;
when the video conference state is a free conference state, audio following transfer of the video conference is carried out to a mobile terminal, and pickup follow-up adjustment of the video conference is carried out according to the current positioning position;
and when the video conference state is a fixed conference state, video transfer identification is carried out according to the characteristics of conference personnel, and locking adjustment of the video conference is carried out according to the conference background image and the background occupation data.
As a further limitation of the technical scheme of the embodiment of the present invention, the initializing process of the video conference, identifying the characteristics of conference personnel, generating a conference background image, and performing background occupation analysis, and recording background occupation data specifically includes the following steps:
according to a preset initialization period, initializing guide shooting of the video conference is carried out, and initialization shooting data are obtained;
extracting a shooting personnel image and a shooting background image from the initialized shooting data;
carrying out fuzzy feature recognition on the photographed person image to obtain conference person features;
and integrating the shooting background image and the initialized shooting data, generating a conference background image, analyzing background occupation, and recording the background occupation data.
As a further limitation of the technical solution of the embodiment of the present invention, the step of synthesizing the shooting background image and the initialized shooting data, generating a conference background image, and performing background occupation analysis, and recording background occupation data specifically includes the following steps:
carrying out main body background recognition on the shooting background image to obtain main body background characteristics;
performing overall background row rendering according to the main body background characteristics to generate a conference background image;
performing background occupation analysis on the initialized shooting data, and determining a background occupation area and a background occupation proportion;
and recording background occupation data according to the background occupation area and the background occupation proportion.
As a further limitation of the technical solution of the embodiment of the present invention, the acquiring real-time interconnection data of the mobile terminal, performing indoor positioning analysis, determining a current positioning position, and identifying a video conference state of conference personnel specifically includes the following steps:
acquiring real-time interconnection data of a mobile terminal;
analyzing the real-time interconnection data, determining a plurality of fixed interconnection targets, and acquiring target interconnection power of the plurality of fixed interconnection targets;
according to the target interconnection powers, indoor positioning analysis is carried out, and the current positioning position is determined;
and carrying out state matching on the current positioning position according to preset state area information, and identifying the video conference state of conference personnel.
As a further limitation of the technical solution of the embodiment of the present invention, the indoor positioning analysis is performed according to the plurality of target interconnection powers, and determining the current positioning position specifically includes the following steps:
according to the target interconnection power, calculating a target interconnection distance between the mobile terminal and the fixed interconnection targets, wherein a calculation formula is as follows: p=p b -10nlog(L/L b ) Wherein P is the target interconnect power, P b Is of standard power, L b Different fixed interconnection targets correspond to different standard powers and standard distances for standard distances, L is the target interconnection distance, and n is the path loss index;
and carrying out indoor positioning analysis based on the plurality of target interconnection distances to determine the current positioning position.
As a further limitation of the technical solution of the embodiment of the present invention, when the video conference state is a free conference state, performing audio follow-up transfer of the video conference to the mobile terminal, and performing pickup follow-up adjustment of the video conference according to the current positioning position, specifically including the following steps:
when the video conference state is a free conference state, generating an audio transfer instruction;
according to the audio transfer instruction, audio follow-up transfer of the video conference is carried out to the mobile terminal;
performing authority matching on the current positioning position according to preset authority area information, and determining the current pickup authority;
and according to the current pickup authority, pickup follow-up adjustment of the video conference is carried out.
As a further limitation of the technical solution of the embodiment of the present invention, when the video conference state is a fixed conference state, performing video transfer identification according to the conference personnel feature, and performing locking adjustment of the video conference according to the conference background image and the background occupation data specifically includes the following steps:
selecting and marking a fixed conference target from a plurality of fixed interconnection targets when the video conference state is a fixed conference state;
acquiring fixed shooting data of the fixed conference target shooting;
according to the characteristics of the conference personnel, carrying out video transfer identification on the fixed shooting data, and judging whether the conference personnel are in a video conference or not;
and if the conference personnel are in the video conference, locking and adjusting the video conference according to the conference background image and the background occupation data.
The system specifically comprises an initialization processing module, an indoor positioning analysis module, a free state processing module and a fixed state processing module, wherein:
the initialization processing module is used for carrying out initialization processing of the video conference, identifying the characteristics of conference personnel, generating a conference background image, carrying out background occupation analysis and recording background occupation data;
the indoor positioning analysis module is used for acquiring real-time interconnection data of the mobile terminal, carrying out indoor positioning analysis, determining the current positioning position and identifying the video conference state of conference personnel;
the free state processing module is used for carrying out audio follow-up transfer of the video conference to the mobile terminal when the video conference state is the free conference state, and carrying out pickup follow-up adjustment of the video conference according to the current positioning position;
and the fixed state processing module is used for carrying out video transfer identification according to the characteristics of the conference personnel when the video conference state is a fixed conference state, and carrying out locking adjustment of the video conference according to the conference background image and the background occupation data.
As further defined by the technical solution of the embodiment of the present invention, the initialization processing module specifically includes:
the guiding shooting unit is used for carrying out initialization guiding shooting of the video conference according to a preset initialization period to acquire initialization shooting data;
an image extraction unit for extracting a photographer image and a photographing background image from the initialized photographing data;
the feature recognition unit is used for carrying out fuzzy feature recognition on the photographed person image and obtaining the features of the conference person;
and the occupation analysis unit is used for synthesizing the shooting background image and the initialized shooting data, generating a conference background image, carrying out background occupation analysis and recording background occupation data.
As a further limitation of the technical solution of the embodiment of the present invention, the indoor positioning analysis module specifically includes:
the interconnection acquisition unit is used for acquiring real-time interconnection data of the mobile terminal;
the target determining unit is used for analyzing the real-time interconnection data, determining a plurality of fixed interconnection targets and acquiring target interconnection power of the plurality of fixed interconnection targets;
the positioning analysis unit is used for carrying out indoor positioning analysis according to the plurality of target interconnection powers and determining the current positioning position;
and the state matching unit is used for carrying out state matching on the current positioning position according to the preset state area information and identifying the video conference state of conference personnel.
Compared with the prior art, the invention has the beneficial effects that:
(1) The method and the system can acquire real-time interconnection data of the mobile terminal, perform indoor positioning analysis, determine the current positioning position and identify the video conference state of conference personnel: in the free conference state, audio follow-up transfer and pickup follow-up adjustment are carried out; and when the conference state is fixed, video transfer identification is performed. Therefore, the following transfer and pickup follow-up adjustment of video and audio of the video conference are realized, and a convenient video conference environment is created for the home office of conference personnel;
(2) According to the method and the device, the characteristics of the conference personnel can be identified, the conference background image is generated, the background occupation analysis is carried out, the background occupation data is recorded, and when the video conference state is the fixed conference state, the locking adjustment of the video conference is carried out according to the conference background image and the background occupation data, so that the conference personnel can keep the conference background image and the background occupation unchanged when the video conference is transferred among a plurality of fixed interconnection targets, the privacy of the conference personnel can be protected, and the stability of the video conference display can be improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following description will briefly introduce the drawings that are needed in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are only some embodiments of the present invention.
Fig. 1 shows a flowchart of a method provided by an embodiment of the present invention.
Fig. 2 shows a flowchart of an initialization process of a video conference in the method provided by the embodiment of the present invention.
Fig. 3 shows a flowchart of conference background image generation and occupation analysis in the method provided by the embodiment of the invention.
Fig. 4 shows a flowchart of indoor positioning analysis in the method according to the embodiment of the present invention.
Fig. 5 shows a flowchart of pickup-follow-up adjustment of a video conference in a method provided by an embodiment of the present invention.
Fig. 6 shows a flowchart of lock adjustment of a video conference in the method provided by the embodiment of the invention.
Fig. 7 shows an application architecture diagram of a system provided by an embodiment of the present invention.
Fig. 8 is a block diagram illustrating a configuration of an initialization processing module in the system according to an embodiment of the present invention.
Fig. 9 shows a block diagram of an indoor positioning analysis module in the system according to the embodiment of the invention.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
It can be appreciated that in the prior art, when the video conference application is in the office of home, the video conference application can not follow the movement of conference personnel, follow and shift between a plurality of devices, and can not carry out indoor positioning to the conference personnel, can not carry out different pickup adjustment according to the different positions of conference personnel, can not create convenient video conference environment for the office of home of conference personnel.
In order to solve the problems, the embodiment of the invention identifies the characteristics of conference personnel by carrying out initialization processing of the video conference, generates a conference background image, carries out background occupation analysis and records background occupation data; acquiring real-time interconnection data of a mobile terminal, performing indoor positioning analysis, determining a current positioning position, and identifying a video conference state of conference personnel; when the video conference state is a free conference state, audio following transfer of the video conference is carried out to the mobile terminal, and pickup follow-up adjustment of the video conference is carried out according to the current positioning position; when the video conference state is a fixed conference state, video transfer identification is carried out according to the characteristics of conference personnel, and locking adjustment of the video conference is carried out according to conference background images and background occupation data. The method can acquire real-time interconnection data of the mobile terminal, carry out indoor positioning analysis, identify the video conference state of conference personnel, carry out audio follow-up transfer and pickup follow-up adjustment in the free conference state, and carry out video transfer identification in the fixed conference state, thereby realizing video and audio follow-up transfer and pickup follow-up adjustment of the video conference and creating a convenient video conference environment for home offices of the conference personnel.
Fig. 1 shows a flowchart of a method provided by an embodiment of the present invention.
In particular, in a preferred embodiment provided by the present invention, a method for processing a video conference, the method includes the following steps:
step S101, initializing a video conference, identifying the characteristics of conference personnel, generating a conference background image, analyzing background occupation, and recording background occupation data.
In the embodiment of the invention, in the process that a conference person carries out a video conference through an initial fixed interconnection target, according to a preset initialization period, the conference person is guided to carry out mirror entering shooting and mirror non-entering shooting through the initial fixed interconnection target to obtain initialization shooting data, further, a shooting person image shot by a mirror entering and a shooting background image shot by a mirror non-entering are extracted from the initialization shooting data, the feature of the conference person is obtained through the fuzzy feature recognition of the shooting person image, the feature of the conference person is obtained, the background recognition of the main body is carried out on the shooting background image, the main body background feature comprising the main body material and the main body color is obtained, the whole video conference background is subjected to row rendering based on the main body background feature, other objects in the video conference background are hidden, the conference background image is generated, and when the video conference is carried out through the background occupation analysis of the conference person by the initialization shooting data, the background occupation area and the background occupation proportion of the conference person are determined, and the corresponding background occupation data are recorded according to the background occupation area and the background occupation proportion.
It can be understood that the fixed interconnection target is a device for performing video conference, has a shooting function, can be a computer, a tablet, a smart television and the like, may have a plurality of fixed interconnection targets in one household, and the plurality of fixed interconnection targets are all in communication connection with the mobile terminal.
It can be appreciated that the fuzzy feature recognition may be a feature recognition of a garment style, color, body shape, etc. of the conference person.
It will be appreciated that the body background features include body material, body color, for example: when conference personnel carry out video conference, the main body of shooting background image is "white wall", then main body material is "lime wall", and main body colour is "white", and then builds conference background image with "white lime wall", hides other objects in the background.
It can be understood that the background occupation analysis can determine the area and proportion of the background occupied by the conference personnel when the conference personnel performs the video conference, and provides a basis for keeping the subsequent background occupation area and the background occupation proportion unchanged.
Specifically, fig. 2 shows a flowchart of an initialization process of a video conference in the method provided by the embodiment of the present invention.
In the preferred embodiment provided by the invention, the initialization processing of the video conference, the recognition of the characteristic of conference personnel, the generation of conference background images, the background occupation analysis and the recording of background occupation data specifically comprise the following steps:
step S1011, carrying out initialization guiding shooting of the video conference according to a preset initialization period, and obtaining initialization shooting data.
Step S1012, extracting a photographer image and a photographing background image from the initialized photographing data.
Step S1013, performing fuzzy feature recognition on the photographed person image, and obtaining the conference person feature.
Step S1014, integrating the shot background image and the initialized shot data, generating a conference background image, performing background occupation analysis, and recording background occupation data.
Specifically, fig. 3 shows a flowchart of conference background image generation and occupation analysis in the method provided by the embodiment of the invention.
In a preferred embodiment of the present invention, the step of synthesizing the captured background image and the initialized captured data, generating a conference background image, and performing background occupation analysis, and recording background occupation data specifically includes the following steps:
step S10141, performing main background recognition on the photographed background image, and obtaining main background features.
And step S10142, performing overall background row rendering according to the main background features, and generating a conference background image.
Step S10143, performing background occupation analysis on the initialized shooting data, and determining a background occupation area and a background occupation proportion.
Step S10144, recording background occupation data according to the background occupation area and the background occupation ratio.
Further, the method for processing the video conference further comprises the following steps:
step S102, acquiring real-time interconnection data of a mobile terminal, performing indoor positioning analysis, determining a current positioning position, and identifying a video conference state of conference personnel.
In the embodiment of the invention, real-time interconnection data of a mobile terminal are acquired, a plurality of fixed interconnection targets which are in communication connection with the mobile terminal are determined by analyzing the real-time interconnection data, signal power analysis is carried out on communication between the mobile terminal and the plurality of fixed interconnection targets, target interconnection power corresponding to the plurality of fixed interconnection targets is acquired, then target interconnection distances between the mobile terminal and the plurality of fixed interconnection targets are calculated according to the plurality of target interconnection powers, indoor positioning analysis is carried out by combining the fixed target positions of the plurality of fixed interconnection targets based on the target interconnection distances of the plurality of fixed interconnection targets, the real-time position of the mobile terminal is determined, and as a conference person carries the mobile terminal, the real-time position of the mobile terminal is consistent with the current positioning position of the conference person, the current positioning area where the current positioning position is located is matched according to preset state area information, and the video conference state of the conference person is determined according to the current positioning area.
It can be understood that, according to the multiple target interconnection powers, the target interconnection distances between the mobile terminal and the multiple fixed interconnection targets are calculated according to the following calculation formula: p=p b -10nlog(L/L b ) Wherein P is the target interconnect power, P b Is of standard power, L b For the standard distance, different fixed interconnection targets correspond to different standard powers and standard distances, L is the target interconnection distance, and n is the path loss index.
It can be appreciated that during the videoconference, the conference personnel carry a mobile terminal, and the mobile terminal maintains communication connection with a plurality of fixed interconnection targets, and the mobile terminal may be a smart phone, a smart watch, or the like.
It can be understood that the indoor positioning analysis may be to use the fixed target positions of the plurality of fixed interconnection targets as an origin, and then use the target interconnection distances of the plurality of fixed interconnection targets as radii to perform corresponding positioning circle planning, where the intersection points/intersection point connection areas of the plurality of positioning circles are real-time positions of the mobile terminal and are current positioning positions of conference personnel.
It can be understood that the state area information is information recorded by dividing the state of an indoor area of a home area of a conference person, wherein the area near a plurality of fixed interconnection targets is a fixed conference area, other areas are free conference areas, and when the conference person is in the fixed conference area, the video conference state is a fixed conference state; when the conference personnel are in the free conference area, the video conference state is the free conference state.
Specifically, fig. 4 shows a flowchart of indoor positioning analysis in the method provided by the embodiment of the invention.
In the preferred embodiment provided by the invention, the method for acquiring real-time interconnection data of the mobile terminal, performing indoor positioning analysis, determining the current positioning position, and identifying the video conference state of conference personnel specifically comprises the following steps:
step S1021, acquiring real-time interconnection data of the mobile terminal.
Step S1022, analyzing the real-time interconnection data, determining a plurality of fixed interconnection targets, and obtaining target interconnection powers of the plurality of fixed interconnection targets.
Step S1023, performing indoor positioning analysis according to the plurality of target interconnection powers to determine the current positioning position.
Step S1024, according to the preset state area information, carrying out state matching on the current positioning position, and identifying the video conference state of conference personnel.
Further, the method for processing the video conference further comprises the following steps:
and step 103, when the video conference state is a free conference state, audio following transfer of the video conference is carried out to the mobile terminal, and pickup follow-up adjustment of the video conference is carried out according to the current positioning position.
In the embodiment of the invention, when the video conference state of conference personnel is a free conference state, an audio transfer instruction is generated, at the moment, according to the audio transfer instruction, audio follow transfer of the video conference is carried out to a mobile terminal, a plurality of fixed interconnection targets do not carry out shooting and sounding of the video conference, real-time sound of the video conference is played to the conference personnel through the mobile terminal, the current pickup authority corresponding to the current positioning position is matched according to preset authority area information, and when the current pickup authority is capable of pickup, the microphone function of the mobile terminal is opened to automatically pick up the conference personnel; when the current pickup authority is not capable of picking up sound, the microphone function of the mobile terminal is closed, and the pickup of conference personnel is not carried out.
It can be understood that the rights area information is information recorded by dividing rights of an indoor area to a home area of a conference person, and different indoor areas have different pickup rights, for example: the bathroom has no sound pickup authority, and the study has sound pickup authority.
Specifically, fig. 5 shows a flowchart of pickup follow-up adjustment of a video conference in the method provided by the embodiment of the invention.
In the preferred embodiment of the present invention, when the video conference state is a free conference state, performing audio follow-up transfer of the video conference to a mobile terminal, and performing pickup follow-up adjustment of the video conference according to the current positioning position, the method specifically includes the following steps:
step S1031, when the video conference state is a free conference state, generating an audio transfer instruction.
Step S1032, according to the audio transfer instruction, audio following transfer of the video conference is carried out to the mobile terminal.
And step S1033, performing authority matching on the current positioning position according to preset authority area information, and determining the current pickup authority.
And step S1034, according to the current pickup authority, pickup follow-up adjustment of the video conference is carried out.
Further, the method for processing the video conference further comprises the following steps:
and step S104, when the video conference state is a fixed conference state, video transfer identification is carried out according to the characteristics of conference personnel, and locking adjustment of the video conference is carried out according to the conference background image and the background occupation data.
In the embodiment of the invention, when the video conference state is the fixed conference state, a fixed interconnection target which is close to a conference person is selected from a plurality of fixed interconnection targets, the fixed interconnection target is marked as the fixed conference target, the fixed conference target is controlled to carry out video shooting, fixed shooting data shot by the fixed conference target are obtained, then video transfer identification is carried out on the fixed shooting data according to the characteristics of the conference person, whether the conference person is positioned at the front side of the fixed conference target is judged, when the conference person is positioned at the front side of the fixed conference target, the conference person is judged to be positioned in the video conference, at the moment, shooting video of the video conference is processed according to conference background images and background occupation data, the occupation area and proportion of the conference person are adjusted by taking the conference background images as the background, and locking adjustment of the video conference is realized, so that the conference background can be kept unchanged when the conference person carries out the video conference in different indoor fixed interconnection targets, the background occupation area and the proportion of the conference person in the video conference are unchanged, the privacy of the conference person can be protected, and the display stability of the video conference can be improved.
Specifically, fig. 6 shows a flowchart of locking adjustment of a video conference in the method provided by the embodiment of the present invention.
In the preferred embodiment of the present invention, when the video conference state is a fixed conference state, performing video transfer identification according to the conference personnel feature, and performing locking adjustment of the video conference according to the conference background image and the background occupation data specifically includes the following steps:
step S1041, selecting and marking a fixed conference target from a plurality of fixed interconnection targets when the video conference state is a fixed conference state.
Step S1042, obtaining the fixed shooting data of the fixed conference target shooting.
Step S1043, performing video transfer identification on the fixed shooting data according to the characteristic of the conference personnel, and judging whether the conference personnel is in the video conference.
Step S1044, if the conference personnel is in the video conference, performing locking adjustment of the video conference according to the conference background image and the background occupation data.
Further, fig. 7 shows an application architecture diagram of the system provided by the embodiment of the present invention.
In another preferred embodiment of the present invention, a processing system for a video conference includes:
the initialization processing module 101 is configured to perform initialization processing of a video conference, identify characteristics of conference personnel, generate a conference background image, perform background occupation analysis, and record background occupation data.
In the embodiment of the invention, in the process that a conference person carries out a video conference through an initial fixed interconnection target, an initialization processing module 101 carries out initialization guiding shooting of the video conference according to a preset initialization period, guides the conference person to carry out mirror entering shooting and mirror non-entering shooting through the initial fixed interconnection target to obtain initialization shooting data, further extracts shooting personnel images shot by the mirror entering and shooting background images shot without the mirror entering from the initialization shooting data, carries out fuzzy feature recognition of the shooting personnel images, acquires the feature of the conference personnel, carries out main background recognition on the shooting background images, acquires the main background feature comprising main material and main color, carries out row rendering on the whole video conference background based on the main background feature, hides other objects in the video conference background, generates conference background images, carries out background occupation analysis of the conference personnel through the initialization shooting data, determines the background occupation area and the background occupation proportion of the conference personnel when carrying out the video conference, and records the corresponding background occupation data according to the background occupation area and the background occupation proportion.
Specifically, fig. 8 shows a block diagram of the initialization processing module 101 in the system according to the embodiment of the present invention.
In a preferred embodiment of the present invention, the initialization processing module 101 specifically includes:
the guide shooting unit 1011 is configured to perform initialization guide shooting of the video conference according to a preset initialization period, and acquire initialization shooting data.
An image extraction unit 1012 is used for extracting a shooting personnel image and a shooting background image from the initialized shooting data.
And a feature recognition unit 1013 configured to perform fuzzy feature recognition on the photographed person image, and obtain a conference person feature.
An occupation analysis unit 1014, configured to integrate the captured background image and the initialized captured data, generate a conference background image, perform background occupation analysis, and record background occupation data.
Further, the processing system of the video conference further includes:
the indoor positioning analysis module 102 is configured to obtain real-time interconnection data of the mobile terminal, perform indoor positioning analysis, determine a current positioning position, and identify a video conference state of conference personnel.
In the embodiment of the invention, the indoor positioning analysis module 102 obtains real-time interconnection data of the mobile terminal, analyzes the real-time interconnection data to determine a plurality of fixed interconnection targets which are in communication connection with the mobile terminal, analyzes signal power of communication between the mobile terminal and the plurality of fixed interconnection targets to obtain target interconnection power corresponding to the plurality of fixed interconnection targets, calculates target interconnection distances between the mobile terminal and the plurality of fixed interconnection targets according to the plurality of target interconnection powers, combines fixed target positions of the plurality of fixed interconnection targets based on the target interconnection distances of the plurality of fixed interconnection targets, performs indoor positioning analysis to determine the real-time position of the mobile terminal, and since the conference person carries the mobile terminal, the real-time position of the mobile terminal is consistent with the current positioning position of the conference person, further matches the current positioning area where the current positioning position is located according to preset state area information, and determines the video conference state of the conference person according to the current positioning area.
Specifically, fig. 9 shows a block diagram of the indoor positioning analysis module 102 in the system according to the embodiment of the present invention.
In a preferred embodiment of the present invention, the indoor positioning analysis module 102 specifically includes:
and the interconnection acquiring unit 1021 is configured to acquire real-time interconnection data of the mobile terminal.
The target determining unit 1022 is configured to analyze the real-time interconnection data, determine a plurality of fixed interconnection targets, and obtain target interconnection powers of the plurality of fixed interconnection targets.
And the positioning analysis unit 1023 is used for performing indoor positioning analysis according to the plurality of target interconnection powers to determine the current positioning position.
The state matching unit 1024 is configured to perform state matching on the current positioning position according to the preset state area information, and identify a video conference state of the conference person.
Further, the processing system of the video conference further includes:
and the free state processing module 103 is used for performing audio follow-up transfer of the video conference to the mobile terminal when the video conference state is the free conference state, and performing pickup follow-up adjustment of the video conference according to the current positioning position.
In the embodiment of the invention, when the video conference state of the conference personnel is a free conference state, the free state processing module 103 generates an audio transfer instruction, at this time, according to the audio transfer instruction, audio follow-up transfer of the video conference is performed to the mobile terminal, a plurality of fixed interconnection targets do not perform shooting and sounding of the video conference, but play real-time sound of the video conference to the conference personnel through the mobile terminal, and according to preset authority area information, the current pickup authority corresponding to the current positioning position is matched, and when the current pickup authority is capable of pickup, the microphone function of the mobile terminal is turned on to automatically pick up the conference personnel; when the current pickup authority is not capable of picking up sound, the microphone function of the mobile terminal is closed, and the pickup of conference personnel is not carried out.
And the fixed state processing module 104 is configured to perform video transfer identification according to the conference personnel feature when the video conference state is a fixed conference state, and perform locking adjustment of the video conference according to the conference background image and the background occupation data.
In the embodiment of the invention, when the video conference state is a fixed conference state, the fixed state processing module 104 selects a fixed interconnection target which is close to a conference person from a plurality of fixed interconnection targets, marks the fixed interconnection target as the fixed conference target, controls the fixed conference target to carry out video shooting, acquires fixed shooting data shot by the fixed conference target, carries out video transfer recognition on the fixed shooting data according to the characteristics of the conference person, judges whether the conference person is positioned at the front side of the fixed conference target, judges that the conference person is positioned in the video conference when the conference person is positioned at the front side of the fixed conference target, processes the shooting video of the video conference according to conference background images and background occupation data, adjusts the occupation area and proportion of the conference person by taking the conference background images as the background, and realizes locking adjustment of the video conference, so that the conference person can keep the background unchanged when carrying out the video conference in different indoor fixed interconnection targets, the background occupation area and proportion of the conference person in the video conference are unchanged, can protect the privacy of the conference person, and can improve the stability of video conference display.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in various embodiments may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, nor do the order in which the sub-steps or stages are performed necessarily performed in sequence, but may be performed alternately or alternately with at least a portion of the sub-steps or stages of other steps or other steps.
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
Claims (10)
1. A method of processing a video conference, the method comprising the steps of:
initializing a video conference, identifying the characteristics of conference personnel, generating a conference background image, analyzing background occupation, and recording background occupation data;
acquiring real-time interconnection data of a mobile terminal, performing indoor positioning analysis, determining a current positioning position, and identifying a video conference state of conference personnel;
when the video conference state is a free conference state, audio following transfer of the video conference is carried out to a mobile terminal, and pickup follow-up adjustment of the video conference is carried out according to the current positioning position;
and when the video conference state is a fixed conference state, video transfer identification is carried out according to the characteristics of conference personnel, and locking adjustment of the video conference is carried out according to the conference background image and the background occupation data.
2. The method for processing a video conference according to claim 1, wherein the initializing the video conference, identifying the characteristics of conference personnel, generating a conference background image, and performing background occupation analysis, and recording background occupation data specifically comprises the following steps:
according to a preset initialization period, initializing guide shooting of the video conference is carried out, and initialization shooting data are obtained;
extracting a shooting personnel image and a shooting background image from the initialized shooting data;
carrying out fuzzy feature recognition on the photographed person image to obtain conference person features;
and integrating the shooting background image and the initialized shooting data, generating a conference background image, analyzing background occupation, and recording the background occupation data.
3. The method for processing a video conference according to claim 2, wherein the step of synthesizing the photographed background image and the initialized photographed data, generating a conference background image, and performing background occupancy analysis, and recording background occupancy data specifically includes the steps of:
carrying out main body background recognition on the shooting background image to obtain main body background characteristics;
performing overall background row rendering according to the main body background characteristics to generate a conference background image;
performing background occupation analysis on the initialized shooting data, and determining a background occupation area and a background occupation proportion;
and recording background occupation data according to the background occupation area and the background occupation proportion.
4. The method for processing the video conference according to claim 1, wherein the step of obtaining real-time interconnection data of the mobile terminal, performing indoor positioning analysis, determining a current positioning position, and identifying the video conference state of conference personnel specifically comprises the following steps:
acquiring real-time interconnection data of a mobile terminal;
analyzing the real-time interconnection data, determining a plurality of fixed interconnection targets, and acquiring target interconnection power of the plurality of fixed interconnection targets;
according to the target interconnection powers, indoor positioning analysis is carried out, and the current positioning position is determined;
and carrying out state matching on the current positioning position according to preset state area information, and identifying the video conference state of conference personnel.
5. The method for processing a video conference according to claim 4, wherein the processing procedure for performing indoor positioning analysis according to the target interconnection powers, and determining the current positioning position is:
according to the target interconnection power, calculating a target interconnection distance between the mobile terminal and the fixed interconnection targets, wherein a calculation formula is as follows: p=p b -10nlog(L/L b ) Wherein P is the target interconnect power, P b Is of standard power, L b Different fixed interconnection targets correspond to different standard powers and standard distances for standard distances, L is the target interconnection distance, and n is the path loss index;
and carrying out indoor positioning analysis based on the plurality of target interconnection distances to determine the current positioning position.
6. The method for processing a video conference according to claim 1, wherein when the video conference state is a free conference state, performing audio follow-up transfer of the video conference to a mobile terminal, and performing pickup follow-up adjustment of the video conference according to the current positioning position, specifically comprises the following steps:
when the video conference state is a free conference state, generating an audio transfer instruction;
according to the audio transfer instruction, audio follow-up transfer of the video conference is carried out to the mobile terminal;
performing authority matching on the current positioning position according to preset authority area information, and determining the current pickup authority;
and according to the current pickup authority, pickup follow-up adjustment of the video conference is carried out.
7. The method for processing a video conference according to claim 4, wherein when the video conference state is a fixed conference state, performing video transfer identification according to the conference personnel feature, and performing locking adjustment of the video conference according to the conference background image and the background occupation data specifically comprises the following steps:
selecting and marking a fixed conference target from a plurality of fixed interconnection targets when the video conference state is a fixed conference state;
acquiring fixed shooting data of the fixed conference target shooting;
according to the characteristics of the conference personnel, carrying out video transfer identification on the fixed shooting data, and judging whether the conference personnel are in a video conference or not;
and if the conference personnel are in the video conference, locking and adjusting the video conference according to the conference background image and the background occupation data.
8. The processing system of the video conference is characterized by specifically comprising an initialization processing module, an indoor positioning analysis module, a free state processing module and a fixed state processing module, wherein:
the initialization processing module is used for carrying out initialization processing of the video conference, identifying the characteristics of conference personnel, generating a conference background image, carrying out background occupation analysis and recording background occupation data;
the indoor positioning analysis module is used for acquiring real-time interconnection data of the mobile terminal, carrying out indoor positioning analysis, determining the current positioning position and identifying the video conference state of conference personnel;
the free state processing module is used for carrying out audio follow-up transfer of the video conference to the mobile terminal when the video conference state is the free conference state, and carrying out pickup follow-up adjustment of the video conference according to the current positioning position;
and the fixed state processing module is used for carrying out video transfer identification according to the characteristics of the conference personnel when the video conference state is a fixed conference state, and carrying out locking adjustment of the video conference according to the conference background image and the background occupation data.
9. The video conference processing system according to claim 8, wherein the initialization processing module specifically comprises:
the guiding shooting unit is used for carrying out initialization guiding shooting of the video conference according to a preset initialization period to acquire initialization shooting data;
an image extraction unit for extracting a photographer image and a photographing background image from the initialized photographing data;
the feature recognition unit is used for carrying out fuzzy feature recognition on the photographed person image and obtaining the features of the conference person;
and the occupation analysis unit is used for synthesizing the shooting background image and the initialized shooting data, generating a conference background image, carrying out background occupation analysis and recording background occupation data.
10. The video conference processing system of claim 8, wherein the indoor positioning analysis module specifically comprises:
the interconnection acquisition unit is used for acquiring real-time interconnection data of the mobile terminal;
the target determining unit is used for analyzing the real-time interconnection data, determining a plurality of fixed interconnection targets and acquiring target interconnection power of the plurality of fixed interconnection targets;
the positioning analysis unit is used for carrying out indoor positioning analysis according to the plurality of target interconnection powers and determining the current positioning position;
and the state matching unit is used for carrying out state matching on the current positioning position according to the preset state area information and identifying the video conference state of conference personnel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311284489.5A CN117201724A (en) | 2023-10-07 | 2023-10-07 | Video conference processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311284489.5A CN117201724A (en) | 2023-10-07 | 2023-10-07 | Video conference processing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117201724A true CN117201724A (en) | 2023-12-08 |
Family
ID=88983418
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311284489.5A Pending CN117201724A (en) | 2023-10-07 | 2023-10-07 | Video conference processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117201724A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10224760A (en) * | 1997-02-03 | 1998-08-21 | Oki Electric Ind Co Ltd | Video conference method and its device |
| US20130342637A1 (en) * | 2012-06-25 | 2013-12-26 | Paul I. Felkai | Video conferencing transitions among a plurality of devices |
| CN107592492A (en) * | 2017-09-06 | 2018-01-16 | 维沃移动通信有限公司 | A kind of video flowing display methods and mobile terminal |
| CN111726559A (en) * | 2020-05-29 | 2020-09-29 | 太仓秦风广告传媒有限公司 | Image blurring processing method and device used in multimedia video conference |
| US20210218845A1 (en) * | 2021-03-26 | 2021-07-15 | Aleksander Magi | Technologies for video conferencing |
| CN113973190A (en) * | 2021-10-28 | 2022-01-25 | 联想(北京)有限公司 | Video virtual background image processing method and device and computer equipment |
| KR102467959B1 (en) * | 2021-09-13 | 2022-11-17 | 알서포트 주식회사 | Portrait positioning type remote meeting method |
| US20230117301A1 (en) * | 2021-10-14 | 2023-04-20 | Motorola Mobility Llc | Methods, Systems, and Devices for Presenting Background and Overlay Indicia in a Videoconference |
| CN116347022A (en) * | 2023-03-23 | 2023-06-27 | 四川休亚网络科技有限公司 | Teleconference system based on big data |
-
2023
- 2023-10-07 CN CN202311284489.5A patent/CN117201724A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10224760A (en) * | 1997-02-03 | 1998-08-21 | Oki Electric Ind Co Ltd | Video conference method and its device |
| US20130342637A1 (en) * | 2012-06-25 | 2013-12-26 | Paul I. Felkai | Video conferencing transitions among a plurality of devices |
| CN107592492A (en) * | 2017-09-06 | 2018-01-16 | 维沃移动通信有限公司 | A kind of video flowing display methods and mobile terminal |
| CN111726559A (en) * | 2020-05-29 | 2020-09-29 | 太仓秦风广告传媒有限公司 | Image blurring processing method and device used in multimedia video conference |
| US20210218845A1 (en) * | 2021-03-26 | 2021-07-15 | Aleksander Magi | Technologies for video conferencing |
| KR102467959B1 (en) * | 2021-09-13 | 2022-11-17 | 알서포트 주식회사 | Portrait positioning type remote meeting method |
| US20230117301A1 (en) * | 2021-10-14 | 2023-04-20 | Motorola Mobility Llc | Methods, Systems, and Devices for Presenting Background and Overlay Indicia in a Videoconference |
| CN113973190A (en) * | 2021-10-28 | 2022-01-25 | 联想(北京)有限公司 | Video virtual background image processing method and device and computer equipment |
| CN116347022A (en) * | 2023-03-23 | 2023-06-27 | 四川休亚网络科技有限公司 | Teleconference system based on big data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109313904B (en) | Video/audio processing apparatus and method, and storage medium | |
| CN103595953B (en) | A kind of method and apparatus for controlling video capture | |
| US7920158B1 (en) | Individual participant identification in shared video resources | |
| Strobel et al. | Joint audio-video object localization and tracking | |
| CN111833899B (en) | Voice detection method based on polyphonic regions, related device and storage medium | |
| GB2342802A (en) | Indexing conference content onto a timeline | |
| Donley et al. | Easycom: An augmented reality dataset to support algorithms for easy communication in noisy environments | |
| CN101682696B (en) | Portable terminal, control method for portable terminal | |
| EP1938208A1 (en) | Face annotation in streaming video | |
| EP1570649A2 (en) | Video camera | |
| CN110677734B (en) | Video synthesis method and device, electronic equipment and storage medium | |
| JP5618043B2 (en) | Audiovisual processing system, audiovisual processing method, and program | |
| Collobert et al. | Listen: A system for locating and tracking individual speakers | |
| Kapralos et al. | Audiovisual localization of multiple speakers in a video teleconferencing setting | |
| CN106060470A (en) | Video monitoring method and system | |
| US20160360150A1 (en) | Method an apparatus for isolating an active participant in a group of participants | |
| CN112689221B (en) | Recording method, recording device, electronic equipment and computer readable storage medium | |
| US20130107028A1 (en) | Microphone Device, Microphone System and Method for Controlling a Microphone Device | |
| KR102566072B1 (en) | Portrait gradual positioning type remote meeting method | |
| CN106470313A (en) | Image generation system and image generating method | |
| CN113676668A (en) | Video shooting method and device, electronic equipment and readable storage medium | |
| CN109145878B (en) | Image extraction method and device | |
| CN117201724A (en) | Video conference processing method and system | |
| EP2544093A1 (en) | Coordinated operation apparatus, coordinated operation method, coordinated operation control program and apparatus coordination system | |
| Pingali et al. | Audio-visual tracking for natural interactivity |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |