CN113824920A - Processing method and device - Google Patents

Processing method and device Download PDF

Info

Publication number
CN113824920A
CN113824920A CN202111164341.9A CN202111164341A CN113824920A CN 113824920 A CN113824920 A CN 113824920A CN 202111164341 A CN202111164341 A CN 202111164341A CN 113824920 A CN113824920 A CN 113824920A
Authority
CN
China
Prior art keywords
video stream
stream data
target
path
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111164341.9A
Other languages
Chinese (zh)
Inventor
李世林
郑焱
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN202111164341.9A priority Critical patent/CN113824920A/en
Publication of CN113824920A publication Critical patent/CN113824920A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/155Conference systems involving storage of or access to video conference sessions

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a processing method and a device, wherein the processing method is applied to first electronic equipment and comprises the steps of obtaining at least one path of video stream data under the condition that target communication connection is established between the first electronic equipment and at least one second electronic equipment, wherein the at least one path of video stream data at least comprises video stream data collected by a target camera module associated with the first electronic equipment; if the display parameters of at least one path of video stream data do not meet the corresponding output conditions, processing the at least one path of video stream data to obtain a path of target video stream data; and sending one path of target video stream data to at least one second electronic device through the target communication connection. The method and the device can improve the display quality of the target video stream data and the integrity of the target video stream data, reduce the bandwidth pressure during data transmission, further avoid the transmission delay of the target video stream data, and ensure that the target video stream data can be transmitted to the second electronic equipment in time.

Description

Processing method and device
Technical Field
The present application relates to the field of video data processing technologies, and in particular, to a processing method and apparatus.
Background
In the existing video conference, there are three ways that a user at a receiving end can watch a speaker and play a file through video applications such as Zoom, Teams, and the like: 1. a user at a sending end shares a play file signal displayed on a field screen; 2. a user at a sending end utilizes a camera to shoot a live speaker, and a high-precision camera is independently configured to shoot a play file displayed on a live screen; 3. the user at the sending end shoots a live speaker and a playing file displayed on a live screen by using a camera.
However, in the above mode 1, the receiving end user can only see the playing file, and cannot see the speaker; the cost of separately configuring the high-precision camera in the mode 2 is high, and the high-precision camera can realize the watching of the played file only by matching with operations such as content region identification, region transformation, matting, image enhancement and the like, so that the calculation amount is large, and display delay can be caused; in the mode 3, a plurality of camera devices are required to collect video stream data at different angles and transmit a plurality of paths of video stream data to a receiving end, so that the delayed transmission is caused by insufficient bandwidth during video transmission, and further the display delay is caused.
Disclosure of Invention
In a first aspect, an embodiment of the present application provides a processing method, including:
under the condition of establishing target communication connection with at least one second electronic device, obtaining at least one path of video stream data, wherein the at least one path of video stream data at least comprises video stream data collected by a target camera module associated with the first electronic device;
if the display parameters of the at least one path of video stream data do not meet the corresponding output conditions, processing the at least one path of video stream data to obtain a path of target video stream data;
and sending the target video stream data to the at least one second electronic device through the target communication connection.
In a possible implementation, the obtaining at least one path of video stream data includes:
obtaining at least one path of video stream data collected by a target camera module configured and/or externally connected by the first electronic equipment and one path of video stream data output by a display screen of the first electronic equipment; or the like, or, alternatively,
and acquiring first video stream data acquired by a first camera and second video stream data acquired by a second camera in the target camera, and fusing the first video stream data and the second video stream data to acquire at least one path of video stream data, wherein the viewing ranges of the first camera and the second camera are different.
In a possible implementation manner, the processing the at least one path of video stream data to obtain a path of target video stream data if the display parameter of the at least one path of video stream data does not satisfy the corresponding output condition includes:
if the first display parameter of the target content in the third video stream data acquired by the third camera of the target camera module does not meet the first output condition, acquiring fourth video stream data acquired by a fourth camera of the target camera module, or acquiring fifth video stream data output by a display screen of the first electronic device;
and replacing target content in the third video stream data with the fourth video stream data or the fifth video stream data to obtain the target video stream data.
In a possible implementation manner, the processing the at least one path of video stream data to obtain a path of target video stream data if the display parameter of the at least one path of video stream data does not satisfy the corresponding output condition includes:
if the relative position relation between the first target object and the second target object in sixth video stream data collected by a fifth camera of the target camera module does not meet a second output condition, obtaining seventh video stream data collected by a sixth camera of the target camera module;
replacing or overlaying the first target object or the second target object with the seventh video stream data to obtain the target video stream data, wherein the relative position relationship between the first target object and the second target object in the seventh video stream data satisfies the second output condition.
In a possible implementation manner, the processing the at least one path of video stream data to obtain a path of target video stream data if the display parameter of the at least one path of video stream data does not satisfy the corresponding output condition includes:
if the view range of eighth video stream data collected by a seventh camera of the target camera module does not meet a third output condition, acquiring ninth video stream data collected by an eighth camera of the target camera module;
and performing fusion processing on the eighth video stream data and the ninth video stream data to obtain the target video stream data.
In one possible implementation, the processing method further includes:
and obtaining the movement information of the target object, and determining a target camera from the target camera module to acquire the video stream data based on the movement information.
In one possible embodiment, the sending the one path of target video stream data to the at least one second electronic device through the target communication connection includes:
obtaining content attributes in the target video stream data, and determining display layout information of the target video stream data output to a display screen of the second electronic device based on the content attributes so as to respectively display content data with different attributes in corresponding areas of the display screen of the second electronic device.
In one possible implementation, the processing method further includes:
obtaining screen information of the second electronic device, and determining the display layout information based on the screen information and the content attribute.
In a second aspect, an embodiment of the present application further provides a processing apparatus, including:
the acquisition module is configured to acquire at least one path of video stream data under the condition of establishing target communication connection with at least one second electronic device, wherein the at least one path of video stream data at least comprises video stream data acquired by a target camera module associated with the first electronic device;
the processing module is configured to process the at least one path of video stream data to obtain a path of target video stream data if the display parameters of the at least one path of video stream data do not meet the corresponding output conditions;
a sending module configured to send the one path of target video stream data to the at least one second electronic device over the target communication connection.
In a third aspect, an embodiment of the present application further provides a storage medium, where the computer readable storage medium stores a computer program, and the computer program is executed by a processor to perform the following steps:
under the condition of establishing target communication connection with at least one second electronic device, obtaining at least one path of video stream data, wherein the at least one path of video stream data at least comprises video stream data collected by a target camera module associated with the first electronic device;
if the display parameters of the at least one path of video stream data do not meet the corresponding output conditions, processing the at least one path of video stream data to obtain a path of target video stream data;
and sending the target video stream data to the at least one second electronic device through the target communication connection.
In a fourth aspect, an embodiment of the present application further provides an electronic device, where the electronic device includes: a processor and a memory, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over a bus when an electronic device is operating, the machine-readable instructions when executed by the processor performing the steps of:
under the condition of establishing target communication connection with at least one second electronic device, obtaining at least one path of video stream data, wherein the at least one path of video stream data at least comprises video stream data collected by a target camera module associated with the first electronic device;
if the display parameters of the at least one path of video stream data do not meet the corresponding output conditions, processing the at least one path of video stream data to obtain a path of target video stream data;
and sending the target video stream data to the at least one second electronic device through the target communication connection.
In the processing method of the embodiment of the application, after at least one path of video stream data is obtained, whether the display parameter of each path of video stream data meets the corresponding output condition is determined, and under the condition that the display parameter of each path of video stream data does not meet the corresponding output condition, at least one path of video stream data is processed, such as sharpening, cutting and the like, so that one path of clear target video stream data with a reasonable display range is obtained, and the display quality of the target video stream data and the integrity of the target video stream data are improved; and then, the target video stream data is sent to the second electronic equipment, at least one path of video stream data does not need to be completely sent to the second electronic equipment, the bandwidth pressure during data transmission is reduced, the transmission delay of the target video stream data is further avoided, the target video stream data can be timely transmitted to the second electronic equipment, and the display efficiency of the second electronic equipment is ensured.
Drawings
In order to more clearly illustrate the technical solutions in the present application or the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.
FIG. 1 illustrates a flow chart of one method of processing provided herein;
fig. 2 shows a layout diagram of three cameras provided in a conference room provided by the present application;
fig. 3 is a schematic diagram illustrating a correspondence relationship between a camera and a collection area provided in the present application;
fig. 4 is a flowchart illustrating a method for processing video stream data to obtain a target video stream data according to the present application;
fig. 5 is a flow chart illustrating another method for processing video stream data to obtain a target video stream data according to the present application;
fig. 6 is a schematic diagram of target video stream data obtained by replacing target content in third video stream data with a target file according to the present application;
fig. 7 is a flow chart illustrating another method for processing video stream data to obtain a target video stream data according to the present application;
fig. 8 shows a schematic diagram of sixth video stream data provided by the present application;
fig. 9 is a schematic diagram of target video stream data obtained by replacing or overlaying the first target object or the second target object with seventh video stream data according to the present application;
fig. 10 is a flow chart illustrating another method for processing video stream data to obtain a target video stream data according to the present application;
FIG. 11 is a schematic diagram of a processing apparatus provided herein;
fig. 12 shows a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
Various aspects and features of the present application are described herein with reference to the drawings.
It will be understood that various modifications may be made to the embodiments of the present application. Accordingly, the foregoing description should not be construed as limiting, but merely as exemplifications of embodiments. Those skilled in the art will envision other modifications within the scope and spirit of the application.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the application and, together with a general description of the application given above and the detailed description of the embodiments given below, serve to explain the principles of the application.
These and other characteristics of the present application will become apparent from the following description of preferred forms of embodiment, given as non-limiting examples, with reference to the attached drawings.
It should also be understood that, although the present application has been described with reference to some specific examples, a person of skill in the art shall certainly be able to achieve many other equivalent forms of application, having the characteristics as set forth in the claims and hence all coming within the field of protection defined thereby.
The above and other aspects, features and advantages of the present application will become more apparent in view of the following detailed description when taken in conjunction with the accompanying drawings.
Specific embodiments of the present application are described hereinafter with reference to the accompanying drawings; however, it is to be understood that the disclosed embodiments are merely exemplary of the application, which can be embodied in various forms. Well-known and/or repeated functions and constructions are not described in detail to avoid obscuring the application of unnecessary or unnecessary detail. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present application in virtually any appropriately detailed structure.
The specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may each refer to one or more of the same or different embodiments in accordance with the application.
The processing method provided by the embodiment of the application is used in scenes such as video conferences, video calls, screen projection and the like, namely when the first electronic device and at least one second electronic device are in video conference connection, video call connection, screen projection connection and the like, the display quality of target video stream data transmitted to the second electronic device can be improved, the bandwidth pressure of the first electronic device during data transmission is reduced, the transmission delay of the target video stream data is further avoided, the target video stream data can be timely transmitted to the second electronic device, and the display efficiency of the second electronic device is ensured.
For the purpose of understanding the present application, the treatment methods provided herein will first be described in detail. In practical applications, the processing method in the embodiment of the present application is applied to the first electronic device, and the execution subject of the processing method may be a processor included in the first electronic device.
As shown in fig. 1, which is a flowchart of a processing method provided in an embodiment of the present application, specific steps include S101-S103.
S101, under the condition that target communication connection is established between the target communication device and at least one second electronic device, at least one path of video stream data is obtained, wherein the at least one path of video stream data at least comprises video stream data collected by a target camera module associated with the first electronic device.
In specific implementation, a communication connection between the first electronic device and the second electronic device is pre-established, where the specific connection manner includes, but is not limited to, a wired communication connection, a bluetooth communication connection, and a WIFI communication connection, for example, when the first electronic device and the second electronic device are in the same space and are in a close distance, a target communication may be established between the first electronic device and the second electronic device in the wired communication connection manner; when the first electronic device and the second electronic device are in the same space but far away from each other, target communication can be established between the first electronic device and the second electronic device in a Bluetooth communication connection mode; when the first electronic device and the second electronic device are not in the same space, target communication can be established between the first electronic device and the second electronic device in a WIFI communication connection mode.
The second electronic device is at least one, for example, in a scene of meeting video connection, the device for controlling playing of a file or content sharing is the first electronic device, the devices which are in communication connection with the first electronic device target and can participate in the meeting can be the second electronic devices, and the content may include character video content, multimedia content, screen display content, and the like acquired by the camera module.
Further, under the condition that a target communication connection is established between the target communication module and the second electronic device, at least one path of video stream data is obtained, where the at least one path of video stream data at least includes video stream data collected by a target camera module associated with the first electronic device, and the target camera module may be a camera module configured by the first electronic device itself or an external camera module of the first electronic device. Specifically, the means for obtaining at least one path of video stream data includes the following two ways:
the first method comprises the following steps: the method comprises the steps of obtaining at least one path of video stream data collected by a target camera module configured and/or externally connected with first electronic equipment, and under the scene of a video conference, collecting the environmental information in the current conference room in real time by the target camera module configured and/or externally connected with the first electronic equipment to further form at least one path of video stream data.
In addition, one path of video stream data output by the display screen of the first electronic device can be obtained, wherein the one path of video stream data output by the display screen of the first electronic device is conference data and the like which need to be displayed to the participants in the conference. Here, the display screen includes, in addition to the display screen of the first electronic device itself, an extension screen externally connected to the first electronic device, and for example, in a video conference scenario, the first electronic device may output video stream data by using the externally connected extension screen.
And the second method comprises the following steps: under the condition that a conference room is large, a plurality of cameras can be arranged in the conference room to ensure that environment information in the conference room can be clearly and comprehensively collected, at the moment, a target camera can be determined from the plurality of cameras based on a preset determination rule, first video stream data collected by a first camera in the target camera and second video stream data collected by a second camera are further obtained, the first video stream data and the second video stream data are subjected to fusion processing to obtain at least one path of video stream data, wherein the fusion processing comprises splicing, overlapping, suspending, sharpening and the like. The determination rule may be determined based on a target object, that is, a conference host or a presenter, for example, a target camera is determined based on a position of the target object, then in a process of actually determining the target camera, movement information of the target object is obtained, the target camera is determined from a target camera module to collect video stream data based on the movement information, referring to a layout diagram of three cameras set in a conference room shown in fig. 2 and a schematic diagram of correspondence between the cameras and collection areas shown in fig. 3, a camera a collects a first area in the conference room, a camera B collects a second area in the conference room, and when the target object is located in the first area, the camera a is determined as the target camera; when the target object is located in the second area, the camera B is determined to be the target camera and the like.
The viewing range of first camera and second camera is different in this application embodiment, for example the viewing range of first camera is the region that the expansion screen is located, and the viewing range of second camera is the region that the personnel of participating in are located etc. and the viewing range can be adjusted according to actual demand, and this application embodiment does not do specific limitation to this, and of course, the quantity of target camera also can be adjusted according to actual demand.
In concrete implementation, all can connect through modes such as bluetooth WIFI between the camera in the target camera module to utilize signal field intensity principle to acquire mutual positional information, establish communication simultaneously.
S102, if the display parameter of at least one path of video stream data does not meet the corresponding output condition, processing the at least one path of video stream data to obtain a path of target video stream data.
In a specific implementation, after at least one path of video stream data is obtained, the video stream data is detected to determine whether display parameters of the video stream data meet corresponding output conditions, where the output conditions include whether content data are clear, whether a target object is included, whether a viewing range meets a preset rule, whether a resolution reaches a threshold, whether a relative position between character contents meets a condition, and the like.
And if the display parameters of the video stream data are determined not to meet the corresponding output conditions, namely the content data are unclear, the target object is not included, the view range does not meet the preset rule, the resolution does not reach the threshold, the relative position between the character contents does not meet the conditions and the like, processing the video stream data to obtain a path of target video stream data. Specifically, the method for processing video stream data to obtain a path of target video stream data refers to the method steps shown in fig. 4, fig. 5, fig. 7, and fig. 10, and will not be described in detail herein.
S103, sending one path of target video stream data to at least one second electronic device through the target communication connection.
In specific implementation, after the target video stream data is obtained, one path of target video stream data is sent to at least one second electronic device through the target communication connection, so that each second electronic device is enabled to be capable of receiving the target video stream data. Specifically, content attributes in the target video stream data are obtained, and display layout information of the target video stream data output to the display screen of the second electronic device is determined based on the content attributes, so that content data with different attributes are respectively displayed in corresponding areas of the display screen of the second electronic device. The content attribute includes data content, content type, frame rate definition, and the like.
Alternatively, screen information of the second electronic device, which includes the number of screens, the size of the screens, and the like, may also be obtained in advance to determine display layout information based on the screen information and the content attribute.
For example, in the case where the second electronic device is provided with only one screen, the screen may be divided equally into two display areas, that is, a left display area and a right display area, and the content data of the first target object is set to be displayed on the left display area of the screen and the content data of the first electronic device is set to be displayed on the right display area of the screen. Of course, the left display area and the right display area may be the same or different in size, and in the case where the second electronic device includes a plurality of screens, screens corresponding to content data of different attributes are determined according to the preference and the performance of the screens.
Optionally, fig. 4 shows a flowchart of a method for processing video stream data to obtain a target video stream data, where the specific steps include S201 and S202.
S201, if the first display parameter of the target content in the third video stream data collected by the third camera of the target camera module does not meet the first output condition, obtaining fourth video stream data collected by the fourth camera of the target camera module, or obtaining fifth video stream data output by the display screen of the first electronic device.
S202, replacing the target content in the third video stream data with the fourth video stream data or the fifth video stream data to obtain target video stream data.
In concrete implementation, if when carrying out video conference, set up a main camera usually, this main camera can gather the indoor environmental information of whole meeting to the participant of feasible online can know the real-time environment in meeting room, wherein, the third camera of target camera module is main camera promptly in this application embodiment.
After the third video stream data is acquired by using the third camera, it is determined whether a first display parameter of a target content in the third video stream data meets a corresponding first output condition, where the target content is a content displayed by a display screen of the first electronic device, and of course, the display screen here may also be a display screen of the first electronic device itself and/or an extension screen externally connected to the first electronic device. At this time, the first output condition includes whether or not the resolution of the target content reaches a threshold value.
If the resolution is smaller than the threshold, determining that the first display parameter of the target content does not meet the first output condition, and obtaining fourth video stream data collected by a fourth camera of the target camera module, wherein the fourth camera is a high-precision camera, and has higher collection precision compared with other cameras in the target camera module, that is, the collected fourth video stream data is clearer, so that the target content collected by the fourth camera is used for replacing the target content in the third video stream data to obtain the target video stream data.
Optionally, after determining that the first display parameter of the target content does not satisfy the first output condition, the screen capture function of the first electronic device may also be directly started to obtain fifth video stream data output by the display screen of the first electronic device, and the target content in the third video stream data is replaced by the fifth video stream data obtained by screen capture to obtain the target video stream data.
Optionally, fig. 5 is a flowchart illustrating another method for processing video stream data to obtain a target video stream data, where the specific steps include S301 and S302.
S301, if the first display parameter of the target content in the third video stream data collected by the third camera of the target camera module does not meet the first output condition, obtaining a target file corresponding to the target content.
S302, replacing the target content in the third video stream data by the target file to obtain target video stream data.
Optionally, under the condition that it is determined that the first display parameter of the target content in the third video stream data acquired by the third camera does not satisfy the first output condition, a target file corresponding to the target content, that is, a source file displayed by the first electronic device, may also be obtained, and then the target file is used to replace the target content in the third video stream data, so as to obtain the target video stream data.
Specifically, under the condition that the target file comprises a plurality of sub-contents, searching the sub-contents which are the same as the target contents from all the sub-contents included in the target file; and then, processing the sub-content according to the attribute, such as size, position and the like, of the target content, such as zooming, moving and the like, and then replacing the target content in the third video stream data with the processed sub-content to obtain target video stream data.
As shown in fig. 6, in a case where it is determined that the first display parameter of the target content in the third video stream data does not satisfy the first output condition, the target file corresponding to the target content is directly acquired to replace the target content in the third video stream data with the target file, thereby obtaining the target video stream data to which the target content satisfying the first output condition belongs.
Optionally, fig. 7 is a flowchart illustrating another method for processing video stream data to obtain a target video stream data, where the specific steps include S401 and S402.
S401, if the relative position relation between the first target object and the second target object in sixth video stream data collected by a fifth camera of the target camera module does not meet a second output condition, seventh video stream data collected by the sixth camera of the target camera module is obtained.
S402, replacing or covering the first target object or the second target object with seventh video stream data to obtain target video stream data, wherein the relative position relation between the first target object and the second target object in the seventh video stream data meets a second output condition.
In specific implementation, the situation that the participant interacts with the conference host, such as question answering or communication, exists, at this time, the participant and the conference host need to be simultaneously displayed to the online participant, at this time, the relative position between the first target object and the second target object in the sixth video stream data acquired by the fifth camera of the target camera module, that is, the relative position between the participant interacting with the conference host and the conference host, is obtained, and whether the relative position relationship between the first target object and the second target object meets a second output condition is determined, where the second output condition is that the faces of the first target object and the second target object can be clearly displayed. Of course, the first target object and the second target object may also be two participants.
And if the relative position relation between the first target object and the second target object in the sixth video stream data collected by the fifth camera of the target camera module does not meet the second output condition, obtaining seventh video stream data collected by the sixth camera of the target camera module. And determining position information of the first target object and the second target object based on sixth video stream data, and determining a sixth camera corresponding to the first target object and the second target object based on the position information to acquire seventh video stream data, wherein the relative position relationship between the first target object and the second target object in the seventh video stream data meets a second output condition. Thereafter, the first target object or the second target object, that is, the object not exhibiting the face is replaced or overlaid with the seventh video stream data, thereby obtaining target video stream data.
Referring to fig. 8, a schematic diagram of sixth video stream data is shown, in which the relative positional relationship between the target object a and the extended screen does not satisfy the second output condition, in which the first target object or the second target object is replaced or overlaid with seventh video stream data to obtain target video stream data, and fig. 9 is a schematic diagram of target video stream data obtained by replacing or overlaying the first target object or the second target object with seventh video stream data, in which the relative positional relationship between the target object a and the extended screen satisfies the second output condition.
It should be noted that, it may also be possible to determine a camera corresponding to the first target object and a camera corresponding to the second target object, and fuse video stream data acquired by using the camera corresponding to the first target object and video stream data acquired by using the camera corresponding to the second target object to obtain video stream data in which a relative position relationship between the first target object and the second target object satisfies the second output condition, which is not specifically limited in this embodiment of the present application.
Further, the embodiment of the application also discloses a mode for determining the first target object or the second target object, and specifically, an infrared device is used for acquiring an infrared image in a conference room. The infrared device can be installed on the first electronic device and can be in communication connection with the first electronic device. After acquiring an infrared image in a conference room, determining whether all objects in the infrared image are in a preset state; the preset state is speaking, and the object in the preset state is determined as a first target object or a second target object.
Optionally, fig. 10 shows a flowchart of another method for processing video stream data to obtain a target video stream data, where the specific steps include S501 and S502.
S501, if the view range of eighth video stream data collected by a seventh camera of the target camera module does not meet a third output condition, ninth video stream data collected by an eighth camera of the target camera module is obtained.
And S502, carrying out fusion processing on the eighth video stream data and the ninth video stream data to obtain target video stream data.
In specific implementation, the space of a conference room is divided into areas in advance, and an optimal set is determined for each area, so that a camera in the set can acquire clear video stream data of the area. And, there is no repetition of the acquisition space of each camera.
And after the seventh camera of the target camera module collects the eighth video stream data, determining whether the view range of the eighth video stream data meets a third output condition, wherein the third output condition is that the target area and the target object are complete. And if the view range of the eighth video stream data does not meet the third output condition, acquiring ninth video stream data acquired by an eighth camera of the target camera module, and performing fusion processing on the eighth video stream data and the ninth video stream data to obtain target video stream data. For example, the eighth video stream data includes a part of the first electronic device, the ninth video stream data includes another part of the first electronic device, and the fusion processing is performed on the eighth video stream data and the ninth video stream data, so that the target video stream data can include the complete first electronic device.
In the processing method of the embodiment of the application, after at least one path of video stream data is obtained, whether the display parameter of each path of video stream data meets the corresponding output condition is determined, and under the condition that the display parameter of each path of video stream data does not meet the corresponding output condition, at least one path of video stream data is processed, such as sharpening, cutting and the like, so that one path of clear target video stream data with a reasonable display range is obtained, and the display quality of the target video stream data and the integrity of the target video stream data are improved; and then, the target video stream data is sent to the second electronic equipment, at least one path of video stream data does not need to be completely sent to the second electronic equipment, the bandwidth pressure during data transmission is reduced, the transmission delay of the target video stream data is further avoided, the target video stream data can be timely transmitted to the second electronic equipment, and the display efficiency of the second electronic equipment is ensured.
Based on the same inventive concept, the second aspect of the present application further provides a processing apparatus corresponding to the processing method, and since the principle of the apparatus in the present application for solving the problem is similar to the processing method described above, the implementation of the apparatus may refer to the implementation of the method, and repeated details are not repeated.
Fig. 11 shows a schematic diagram of a processing apparatus provided in an embodiment of the present application, which specifically includes:
an obtaining module 601, configured to obtain at least one piece of video stream data in a case where a target communication connection is established between the obtaining module and at least one second electronic device, where the at least one piece of video stream data at least includes video stream data collected by a target camera module associated with the first electronic device;
a processing module 602, configured to process the at least one piece of video stream data to obtain a piece of target video stream data if the display parameter of the at least one piece of video stream data does not satisfy the corresponding output condition;
a sending module 603 configured to send the one piece of target video stream data to the at least one second electronic device via the target communication connection.
In one embodiment, the obtaining module 601 is specifically configured to:
obtaining at least one path of video stream data collected by a target camera module configured and/or externally connected by the first electronic equipment and one path of video stream data output by a display screen of the first electronic equipment; or the like, or, alternatively,
and acquiring first video stream data acquired by a first camera and second video stream data acquired by a second camera in the target camera, and fusing the first video stream data and the second video stream data to acquire at least one path of video stream data, wherein the viewing ranges of the first camera and the second camera are different.
In one embodiment, the processing module 602 is specifically configured to:
if the first display parameter of the target content in the third video stream data acquired by the third camera of the target camera module does not meet the first output condition, acquiring fourth video stream data acquired by a fourth camera of the target camera module, or acquiring fifth video stream data output by a display screen of the first electronic device;
and replacing target content in the third video stream data with the fourth video stream data or the fifth video stream data to obtain the target video stream data.
In one embodiment, the processing module 602 is further configured to:
if a first display parameter of target content in third video stream data acquired by a third camera of the target camera module does not meet a first output condition, acquiring a target file corresponding to the target content;
and replacing target content in the third video stream data by using the target file to obtain the target video stream data.
In one embodiment, the processing module 602 is further configured to:
if the relative position relation between the first target object and the second target object in sixth video stream data collected by a fifth camera of the target camera module does not meet a second output condition, obtaining seventh video stream data collected by a sixth camera of the target camera module;
replacing or overlaying the first target object or the second target object with the seventh video stream data to obtain the target video stream data, wherein the relative position relationship between the first target object and the second target object in the seventh video stream data satisfies the second output condition.
In one embodiment, the processing module 602 is further configured to:
if the view range of eighth video stream data collected by a seventh camera of the target camera module does not meet a third output condition, acquiring ninth video stream data collected by an eighth camera of the target camera module;
and performing fusion processing on the eighth video stream data and the ninth video stream data to obtain the target video stream data.
In one embodiment, the method further includes a first determining module 604 configured to:
and obtaining the movement information of the target object, and determining a target camera from the target camera module to acquire the video stream data based on the movement information.
In one embodiment, the sending module 603 is further configured to:
obtaining content attributes in the target video stream data, and determining display layout information of the target video stream data output to a display screen of the second electronic device based on the content attributes so as to respectively display content data with different attributes in corresponding areas of the display screen of the second electronic device.
In one embodiment, the system further comprises a second determining module 605 configured to:
obtaining screen information of the second electronic device, and determining the display layout information based on the screen information and the content attribute.
In the processing method of the embodiment of the application, after at least one path of video stream data is obtained, whether the display parameter of each path of video stream data meets the corresponding output condition is determined, and under the condition that the display parameter of each path of video stream data does not meet the corresponding output condition, at least one path of video stream data is processed, such as sharpening, cutting and the like, so that one path of clear target video stream data with a reasonable display range is obtained, and the display quality of the target video stream data and the integrity of the target video stream data are improved; and then, the target video stream data is sent to the second electronic equipment, at least one path of video stream data does not need to be completely sent to the second electronic equipment, the bandwidth pressure during data transmission is reduced, the transmission delay of the target video stream data is further avoided, the target video stream data can be timely transmitted to the second electronic equipment, and the display efficiency of the second electronic equipment is ensured.
An embodiment of the present application further provides a storage medium, which is a computer-readable medium storing a computer program, where the computer program, when executed by a processor, implements the method provided in any embodiment of the present application, and includes the following steps S11-S13:
s11, under the condition that a target communication connection is established between the electronic device and at least one second electronic device, at least one path of video stream data is obtained, wherein the at least one path of video stream data at least comprises video stream data collected by a target camera module associated with the first electronic device;
s12, if the display parameter of the at least one path of video stream data does not meet the corresponding output condition, processing the at least one path of video stream data to obtain a path of target video stream data;
s13, sending the target video stream data to the at least one second electronic device through the target communication connection.
An embodiment of the present application further provides an electronic device, a schematic structural diagram of the electronic device may be as shown in fig. 12, where the electronic device at least includes a memory 1201 and a processor 1202, the memory 1201 stores a computer program, and the processor 1202 implements the method provided in any embodiment of the present application when executing the computer program on the memory 1201. Illustratively, the electronic device computer program steps are as follows S21-S23:
s21, under the condition that a target communication connection is established between the electronic device and at least one second electronic device, at least one path of video stream data is obtained, wherein the at least one path of video stream data at least comprises video stream data collected by a target camera module associated with the first electronic device;
s22, if the display parameter of the at least one path of video stream data does not meet the corresponding output condition, processing the at least one path of video stream data to obtain a path of target video stream data;
s23, sending the target video stream data to the at least one second electronic device through the target communication connection.
The above embodiments are only exemplary embodiments of the present application, and are not intended to limit the present application, and the protection scope of the present application is defined by the claims. Various modifications and equivalents may be made by those skilled in the art within the spirit and scope of the present application and such modifications and equivalents should also be considered to be within the scope of the present application.

Claims (10)

1. A processing method is applied to a first electronic device, and comprises the following steps:
under the condition of establishing target communication connection with at least one second electronic device, obtaining at least one path of video stream data, wherein the at least one path of video stream data at least comprises video stream data collected by a target camera module associated with the first electronic device;
if the display parameters of the at least one path of video stream data do not meet the corresponding output conditions, processing the at least one path of video stream data to obtain a path of target video stream data;
and sending the target video stream data to the at least one second electronic device through the target communication connection.
2. The processing method according to claim 1, wherein said obtaining at least one piece of video stream data comprises:
obtaining at least one path of video stream data collected by a target camera module configured and/or externally connected by the first electronic equipment and one path of video stream data output by a display screen of the first electronic equipment; or the like, or, alternatively,
and acquiring first video stream data acquired by a first camera and second video stream data acquired by a second camera in the target camera, and fusing the first video stream data and the second video stream data to acquire at least one path of video stream data, wherein the viewing ranges of the first camera and the second camera are different.
3. The processing method according to claim 1 or 2, wherein said processing the at least one path of video stream data to obtain a path of target video stream data if the display parameter of the at least one path of video stream data does not satisfy the corresponding output condition comprises:
if the first display parameter of the target content in the third video stream data acquired by the third camera of the target camera module does not meet the first output condition, acquiring fourth video stream data acquired by a fourth camera of the target camera module, or acquiring fifth video stream data output by a display screen of the first electronic device;
and replacing target content in the third video stream data with the fourth video stream data or the fifth video stream data to obtain the target video stream data.
4. The processing method according to claim 1 or 2, wherein said processing the at least one path of video stream data to obtain a path of target video stream data if the display parameter of the at least one path of video stream data does not satisfy the corresponding output condition comprises:
if a first display parameter of target content in third video stream data acquired by a third camera of the target camera module does not meet a first output condition, acquiring a target file corresponding to the target content;
and replacing target content in the third video stream data by using the target file to obtain the target video stream data.
5. The processing method according to claim 1 or 2, wherein said processing the at least one path of video stream data to obtain a path of target video stream data if the display parameter of the at least one path of video stream data does not satisfy the corresponding output condition comprises:
if the relative position relation between the first target object and the second target object in sixth video stream data collected by a fifth camera of the target camera module does not meet a second output condition, obtaining seventh video stream data collected by a sixth camera of the target camera module;
replacing or overlaying the first target object or the second target object with the seventh video stream data to obtain the target video stream data, wherein the relative position relationship between the first target object and the second target object in the seventh video stream data satisfies the second output condition.
6. The processing method according to claim 1 or 2, wherein said processing the at least one path of video stream data to obtain a path of target video stream data if the display parameter of the at least one path of video stream data does not satisfy the corresponding output condition comprises:
if the view range of eighth video stream data collected by a seventh camera of the target camera module does not meet a third output condition, acquiring ninth video stream data collected by an eighth camera of the target camera module;
and performing fusion processing on the eighth video stream data and the ninth video stream data to obtain the target video stream data.
7. The processing method of claim 2, further comprising:
and obtaining the movement information of the target object, and determining a target camera from the target camera module to acquire the video stream data based on the movement information.
8. The processing method according to any one of claims 1 to 7, wherein said sending said one path of target video stream data to said at least one second electronic device via said target communication connection comprises:
obtaining content attributes in the target video stream data, and determining display layout information of the target video stream data output to a display screen of the second electronic device based on the content attributes so as to respectively display content data with different attributes in corresponding areas of the display screen of the second electronic device.
9. The processing method of claim 8, further comprising:
obtaining screen information of the second electronic device, and determining the display layout information based on the screen information and the content attribute.
10. A processing apparatus, comprising:
the acquisition module is configured to acquire at least one path of video stream data under the condition of establishing target communication connection with at least one second electronic device, wherein the at least one path of video stream data at least comprises video stream data acquired by a target camera module associated with the first electronic device;
the processing module is configured to process the at least one path of video stream data to obtain a path of target video stream data if the display parameters of the at least one path of video stream data do not meet the corresponding output conditions;
a sending module configured to send the one path of target video stream data to the at least one second electronic device over the target communication connection.
CN202111164341.9A 2021-09-30 2021-09-30 Processing method and device Pending CN113824920A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111164341.9A CN113824920A (en) 2021-09-30 2021-09-30 Processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111164341.9A CN113824920A (en) 2021-09-30 2021-09-30 Processing method and device

Publications (1)

Publication Number Publication Date
CN113824920A true CN113824920A (en) 2021-12-21

Family

ID=78920088

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111164341.9A Pending CN113824920A (en) 2021-09-30 2021-09-30 Processing method and device

Country Status (1)

Country Link
CN (1) CN113824920A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120050458A1 (en) * 2010-08-31 2012-03-01 Cisco Technology, Inc. System and method for providing depth adaptive video conferencing
US20130050395A1 (en) * 2011-08-29 2013-02-28 DigitalOptics Corporation Europe Limited Rich Mobile Video Conferencing Solution for No Light, Low Light and Uneven Light Conditions
US20130335508A1 (en) * 2012-06-15 2013-12-19 Cisco Technology, Inc. Adaptive Switching of Views for a Video Conference that Involves a Presentation Apparatus
US20150256794A1 (en) * 2013-05-31 2015-09-10 Rakuten, Inc. Information processing apparatus, information processing method and information processing program
CN111405243A (en) * 2020-02-28 2020-07-10 北京大学(天津滨海)新一代信息技术研究院 Target monitoring method and system based on multiple cameras
CN113163214A (en) * 2020-01-22 2021-07-23 华为技术有限公司 Video processing method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120050458A1 (en) * 2010-08-31 2012-03-01 Cisco Technology, Inc. System and method for providing depth adaptive video conferencing
US20130050395A1 (en) * 2011-08-29 2013-02-28 DigitalOptics Corporation Europe Limited Rich Mobile Video Conferencing Solution for No Light, Low Light and Uneven Light Conditions
US20130335508A1 (en) * 2012-06-15 2013-12-19 Cisco Technology, Inc. Adaptive Switching of Views for a Video Conference that Involves a Presentation Apparatus
US20150256794A1 (en) * 2013-05-31 2015-09-10 Rakuten, Inc. Information processing apparatus, information processing method and information processing program
CN113163214A (en) * 2020-01-22 2021-07-23 华为技术有限公司 Video processing method and device
CN111405243A (en) * 2020-02-28 2020-07-10 北京大学(天津滨海)新一代信息技术研究院 Target monitoring method and system based on multiple cameras

Similar Documents

Publication Publication Date Title
US9473741B2 (en) Teleconference system and teleconference terminal
US9774896B2 (en) Network synchronized camera settings
US9065974B2 (en) System and method for combining a plurality of video streams generated in a videoconference
CN108154058B (en) Graphic code display and position area determination method and device
CN211296837U (en) Holographic video conference system
CN109257559A (en) A kind of image display method, device and the video conferencing system of panoramic video meeting
WO2018214746A1 (en) Video conference realization method, device and system, and computer storage medium
WO2012072008A1 (en) Method and device for superposing auxiliary information of video signal
CN108933920A (en) A kind of output of video pictures, inspection method and device
US20190373216A1 (en) Videoconferencing device and method
CN107426524A (en) A kind of method and apparatus of the Multi-Party Conference based on virtual panoramic
EP2892205A1 (en) Method and device for determining terminal to be shared and system
CN105933637A (en) Video communication method and system
CN105959614A (en) Method and system for processing video conference
CN105306872B (en) Control the methods, devices and systems of multipoint videoconference
CN114531564B (en) Processing method and electronic equipment
CN111163280B (en) Asymmetric video conference system and method thereof
WO2016192467A1 (en) Method and device for playing videos
US8717410B2 (en) Video communication method, apparatus, and system
WO2015089944A1 (en) Method and device for processing picture of video conference, and conference terminal
TW202315381A (en) Video transmission method, server, user terminal and video transmission system
CN112235510A (en) Shooting method, shooting device, electronic equipment and medium
CN113824920A (en) Processing method and device
JP6004978B2 (en) Subject image extraction device and subject image extraction / synthesis device
JP2013232830A (en) Image processing system, image processing device, image processing method, and image processing program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination