CN109862301B - Screen video sharing method and device and electronic equipment - Google Patents
Screen video sharing method and device and electronic equipment Download PDFInfo
- Publication number
- CN109862301B CN109862301B CN201910141243.XA CN201910141243A CN109862301B CN 109862301 B CN109862301 B CN 109862301B CN 201910141243 A CN201910141243 A CN 201910141243A CN 109862301 B CN109862301 B CN 109862301B
- Authority
- CN
- China
- Prior art keywords
- screen
- video
- media stream
- camera
- resource
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention provides a screen video sharing method, a screen video sharing device and electronic equipment, and relates to the technical field of video communication.
Description
Technical Field
The invention relates to the technical field of video communication, in particular to a screen video sharing method and device and electronic equipment.
Background
With the continuous development of information technology, the information exchange between different departments and different regions is gradually increased, and the network has become an important means for information transmission. The data sharing is realized through the network, more people can fully use the existing data resources, and the data resources are effectively utilized. The screen sharing is an important application in data sharing, is often used for document display, operation demonstration, cooperative work and the like in various network communication systems such as network video conferences, instant communication tools and the like, and is an important and effective supplement for interaction modes such as videos, text messages and the like.
In real-time video communication, video transmission is all video pictures collected by a camera on a user terminal such as a mobile phone terminal or a computer terminal, and at the moment, sharing of screen videos cannot be achieved. Therefore, the current video communication scheme has incomplete functions and is difficult to meet the personalized requirements of users.
Disclosure of Invention
In view of the above, the present invention provides a method, an apparatus and an electronic device for sharing a screen video, so as to implement screen video sharing during a video call, thereby improving a video call function and satisfying personalized requirements of a user.
In a first aspect, an embodiment of the present invention provides a screen video sharing method, including:
after video call connection is established, screen video resources are acquired when the screen sharing function is detected to be started;
creating a screen media stream with the screen video resource as a media source;
adding a screen video track to the screen media stream, and adding the screen media stream to the screen video track;
and sending the screen media stream in the screen video track and the camera media stream in the camera video track to a destination end through the video call connection.
With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where the step of acquiring a screen video resource when it is detected that a screen sharing function is turned on includes:
acquiring video acquisition parameters, wherein the video acquisition parameters comprise a screen area to be shared;
and acquiring the screen video resource corresponding to the screen area to be shared by calling a system API.
With reference to the first possible implementation manner of the first aspect, an embodiment of the present invention provides a second possible implementation manner of the first aspect, where the video capture parameters further include output resolution and video capture color space information;
the step of obtaining the screen video resource corresponding to the screen area to be shared comprises the following steps:
acquiring a first video resource corresponding to the screen area to be shared;
adjusting the resolution of the first video resource to the output resolution to obtain a second video resource;
and performing color space conversion on the second video resource based on the video acquisition color space information to obtain a screen video resource corresponding to the screen area to be shared.
With reference to the second possible implementation manner of the first aspect, an embodiment of the present invention provides a third possible implementation manner of the first aspect, where the method further includes:
when the click information of the mouse is detected, recording click position information;
and adding identification information to the first video resource according to the click position information.
With reference to the first aspect, an embodiment of the present invention provides a fourth possible implementation manner of the first aspect, where before the step of sending the screen media stream in the screen video track and the camera media stream in the camera video track to the destination through the video call connection, the method further includes:
and when detecting that only the screen video needs to be shared, controlling the camera to stop shooting and emptying the camera video resources currently existing in the camera video track.
With reference to the first aspect, an embodiment of the present invention provides a fifth possible implementation manner of the first aspect, where the method further includes:
when detecting that the screen media stream and the camera media stream coexist, performing communication negotiation with the destination terminal, and sending current connection information to the destination terminal, so that the destination terminal acquires screen video resources from the received screen media stream according to the connection information;
wherein the connection information comprises an identification of the respective media stream.
In a second aspect, an embodiment of the present invention further provides an on-screen video sharing apparatus, including:
the resource acquisition module is used for acquiring screen video resources when the screen sharing function is detected to be started after the video call connection is established;
the media stream creating module is used for creating a screen media stream which takes the screen video resource as a media source;
the track adding module is used for adding a screen video track to the screen media stream and adding the screen media stream to the screen video track;
and the resource sending module is used for sending the screen media stream in the screen video track and the camera media stream in the camera video track to a destination end through the video call connection.
With reference to the second aspect, an embodiment of the present invention provides a sixth possible implementation manner of the first aspect, where the resource obtaining module is further configured to:
acquiring video acquisition parameters, wherein the video acquisition parameters comprise a screen area to be shared;
and acquiring the screen video resource corresponding to the screen area to be shared by calling a system API.
In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory and a processor, where the memory stores a computer program that is executable on the processor, and the processor executes the computer program to implement the method described in the first aspect and any possible implementation manner thereof.
In a fourth aspect, embodiments of the present invention also provide a computer-readable storage medium storing machine-executable instructions that, when invoked and executed by a processor, cause the processor to implement the method of the first aspect and any possible implementation thereof.
The embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, after the connection is established in the video call, the screen media stream taking the screen video resource as the media source is created, and the screen media stream is directly added into the newly-built screen video track, so that the screen media stream coexists with the camera media stream in the original camera video track, and the screen media stream and the camera media stream can be simultaneously shared to the destination end through the video call connection, thereby improving the video call function and meeting the personalized requirements of users.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and drawings.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flowchart illustrating a screen video sharing method according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating another screen video sharing method according to an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of an on-screen video sharing apparatus according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
At present, in real-time video communication, video transmission is all video pictures collected by a camera on a user terminal such as a mobile phone terminal or a computer terminal, and at the moment, sharing of screen videos cannot be realized. Therefore, the current video communication scheme has incomplete functions and is difficult to meet the personalized requirements of users. Based on this, according to the screen video sharing method, the device and the electronic device provided in the embodiments of the present invention, after the connection is established in the video call, the screen media stream using the screen video resource as the media source is created, and the screen media stream is directly added to the newly created screen video track, so that the screen media stream coexists with the camera media stream in the original camera video track, and the screen media stream and the camera media stream can be simultaneously shared to the destination through the video call connection, thereby improving the video call function and satisfying the personalized requirements of the user.
To facilitate understanding of the present embodiment, a detailed description will be given to a screen video sharing method disclosed in the present embodiment. The method is applied to the video call process, is used for sharing the screen video in the video call process, and is specifically realized through related hardware or software. For example, the method can be implemented by using an electronic device such as a computer loaded with corresponding software, which is installed with a Windows or Mac OS system, or a mobile terminal, which can be installed with an android system or an IOS system.
Fig. 1 shows a schematic flow chart of a screen video sharing method provided in an embodiment of the present invention, where the method specifically includes the following steps:
step S101, after the video call connection is established, when the screen sharing function is detected to be opened, screen video resources are acquired.
In specific implementation, after the video call connection with the opposite terminal is established, the screen sharing function can be started by clicking the corresponding function button.
Step S102, creating a screen media stream using the screen video resource as a media source.
At this time, a new media stream is created for the screen video resource, and the media stream takes the screen video resource as a media source.
Step S103, adding a screen video track to the screen media stream, and adding the screen media stream to the screen video track.
And step S104, transmitting the screen media stream in the screen video track and the camera media stream in the camera video track to a destination end through video call connection.
Since the video call connection with the opposite end is established at present, the video call connection with the opposite end and the destination end is formed. And creating a screen media stream for the media source by the screen video resource, and transmitting the screen media stream and the camera media stream to a destination terminal together through the established video call connection.
Based on the screen sharing technology provided by the embodiment of the invention, after the connection is established in the video call, the screen media stream taking the screen video resource as the media source is created, and the screen media stream is directly added into the newly-built screen video track, so that the screen media stream coexists with the camera media stream in the original camera video track, and the screen media stream and the camera media stream can be simultaneously shared to the destination end through the video call connection, thereby improving the video call function and meeting the individual requirements of the user.
In a possible embodiment, in order to improve the operability and flexibility of video communication and further meet the personalized requirements of the user, the step of acquiring the screen video resource when the screen sharing function is detected to be turned on in step S101 includes: acquiring video acquisition parameters, wherein the video acquisition parameters comprise a screen area to be shared; and acquiring the screen video resource corresponding to the screen area to be shared by calling a system API.
The video capture parameter may be a default value, for example, a default screen area to be shared is the entire screen, or a screen area to be shared (defined by a video width and a video height) is set in a session window calling a system API (Application Programming Interface) each time a user starts a screen sharing function. The screen area to be shared may be an area designated by the user, and may be, for example, a window of a current document, a window of a website, or the like.
And acquiring screen video resources corresponding to the screen area to be shared from the bottom layer of the system by using the system API. For example, using the Windows system API of a computer, or Mac OS system API; or screen video resources are acquired from the corresponding system bottom layer by using an android system API or an IOS system API of the mobile terminal.
In order to ensure the sharing effect of the screen video and improve the transmission efficiency of the screen video resources, in a possible embodiment, the video acquisition parameters further include output resolution and video acquisition color space information, so that the acquired video resources in the to-be-shared screen region can meet the corresponding requirements of the output resolution and the video acquisition color space information. Based on this, the step of acquiring the screen video resource corresponding to the screen area to be shared includes: acquiring a first video resource corresponding to the screen area to be shared; adjusting the resolution of the first video resource to an output resolution to obtain a second video resource; and carrying out color space conversion on the second video resource based on the video acquisition color space information to obtain a screen video resource corresponding to the screen area to be shared.
In order to prevent the problem that the resolution of the acquired video resource is not matched with the resolution of the video resource in the original screen, in the embodiment of the present invention, for example, a video output resolution may be set in a session window by calling a system API, and the video output resolution may also be automatically acquired according to the screen size of the local device, so that the acquired video resource can be clearer when displayed and played at an opposite end (i.e., a destination end), and a visual effect is improved.
Since the screen video resources obtained by the API call all use RGB (red, green, blue) color spaces, the screen video resources are directly transmitted, and the data amount is large, thereby affecting the transmission rate. Therefore, in this embodiment, for example, the video capture color space information may be set in the session window calling the system API, and color space conversion may be performed. In a possible embodiment, the video acquisition color space information includes YUV (luminance and chrominance concentration) information, and the acquired video resource of the screen region to be shared is converted from an RGB color space to a YUV color space, so that the amount of transmission data can be reduced during transmission, the occupied bandwidth of transmission is reduced, and the transmission efficiency is improved.
It should be noted that, the processing sequence of the obtained video resource corresponding to the screen region to be shared is not limited, and if the output resolution can be adjusted first, color space conversion is performed; or firstly, color space conversion is carried out, and then adjustment of output resolution is carried out.
Considering that the current opposite end cannot observe the mouse clicking process in the video resource when playing the received screen video resource. In a possible embodiment, dynamic information of the mouse, such as position information at the time of mouse click, is added to the screen video asset. Based on the method, the method comprises the following steps: when the click information of the mouse is detected, recording click position information; and adding identification information to the first video resource according to the click position information. By identifying the mouse click position, for example, the current click object of the mouse can be highlighted through highlight output display, so that the user at the opposite end can be timely positioned at the click position of the mouse.
In addition, the moving coordinate of the mouse can be recorded in real time, and the moving coordinate is identified on the screen video resource, so that a user at the opposite end can observe the dynamic change of the mouse in real time. In order to meet the diversity requirements of users, the users can select a shared screen or a video resource of a camera in the video call process, for example, corresponding selection buttons can be set on the display interface of corresponding electronic equipment, and a specific video sharing type can be selected through the selection buttons. Based on this, in the embodiment of the present invention, the user may select video sharing type information, which includes any one of screen video sharing, camera video sharing, and screen and camera simultaneous sharing. And sending the corresponding video resource to the opposite terminal according to the video type information selected by the user. Which is common in the art and will not be described in detail herein.
For example, when the user selects screen video sharing, i.e., only screen video needs to be shared, a new media stream may be created directly according to the steps shown in fig. 1, only the screen media stream in the screen video track is transmitted, and the camera media stream in the camera video track is stopped from being transmitted. Based on this, step S104 further includes: and when detecting that only the screen video needs to be shared, controlling the camera to stop shooting and emptying the camera video resources currently existing in the camera video track.
For example, when the user clicks a selection button of the display interface, the video sharing type information is input, the video sharing type information is analyzed, and the video type needing to be shared is detected. When the video sharing type information is screen video sharing, only the screen video needing to be shared can be detected, shooting of the camera is stopped at the moment, and camera video resources which are not sent in the camera video track are emptied. Namely, the video track of the camera is kept empty, so that the aim of only sending the screen video is fulfilled, and only the screen video is shared.
However, in order to simplify the operation, in the implementation process, the user may select the type when the audio/video call is started, considering that a camera media stream is already created after the audio/video call connection is established, when the video sharing type information selected by the user is screen video sharing (i.e., when only screen video needs to be shared), a media source of the camera media stream may be replaced by the acquired screen video resource of the area to be shared, and then the media source is sent to the opposite terminal through the established video call connection.
In order to facilitate understanding of the embodiments of the present invention, this embodiment further provides another specific example of a screen video sharing method, and as shown in fig. 2, the screen video sharing method includes the following steps:
step S201, after the video call connection is established, when the screen sharing function is detected to be opened, screen video resources are acquired.
Step S202, obtaining and analyzing the preselected video sharing type information.
For example, after the screen sharing function is turned on, the user may input the video sharing type information through a corresponding button of the display interface.
Step S203, judging whether the screen video and the camera video need to be shared simultaneously according to the video sharing type information.
If yes, executing step S204; if not, step S207 is performed.
Step S204, creating a screen media stream using the screen video resource as a media source.
Step S205, add a screen video track to the screen media stream, and add the screen media stream to the screen video track.
And step S206, transmitting the screen media stream in the screen video track and the camera media stream in the camera video track to a destination end through video call connection.
When the user selects to perform camera video sharing and screen video sharing simultaneously, a new media stream (i.e., a screen media stream) needs to be created, and a video track (i.e., a screen video track) needs to be added to the new media stream. And then, the acquired screen video resource of the screen area to be shared is used as a media source of a new media stream, and then the new media stream is added to the screen video track. Therefore, the screen media stream and the camera media stream coexist and are transmitted through the video call connection, and the simultaneous transmission of the camera video resource and the screen video resource is realized.
Step S207, determining whether only the screen video needs to be shared according to the video sharing type information.
If yes, go to step S208; if not, step S211 is performed.
And step S208, clearing the camera video resources in the camera video track corresponding to the camera media stream.
Step S209, replace the media source corresponding to the camera media stream with the screen video resource to obtain the screen media stream.
And step S210, transmitting the screen media stream from the camera video track to a destination end through a video call connection.
That is, the media source of the camera media stream is replaced, and the camera media stream is converted into the screen media stream of which the media source is the screen video resource.
Through the manner from the step S208 to the step S210, the screen video resource is sent to the destination end by using the created camera media stream, and the video displayed at the opposite end is directly switched from the original camera video to the content of the screen video. The method does not need to create a new track, and has simple process and convenient operation.
And step S211, sending the camera media stream from the camera video track to the destination end through the video call connection.
That is, when the user does not need to share the screen, only the camera screen is sent to the destination. It should be noted that, when sharing the screen video and the camera video at the same time, since a new media stream is added, in order to ensure normal reception of the opposite end, the method further includes: when detecting that the screen media stream and the camera media stream coexist, performing communication negotiation with a destination terminal, and sending current connection information to the destination terminal so that the destination terminal acquires screen video resources from the received screen media stream according to the connection information; wherein the connection information comprises an identification of the respective media stream.
And the destination terminal classifies the received video resources according to the identification of the media stream to obtain a screen media stream and a camera media stream, and respectively displays and plays the screen media stream and the camera media stream. Finally, the destination end can receive the video collected by the camera video of the opposite end and can also obtain the data of the screen sharing video from the newly received media stream, so that the camera video and the screen video can be displayed simultaneously.
Referring to fig. 3, the above-mentioned screen video sharing method described based on the embodiment further provides a screen video sharing apparatus, including:
the resource acquisition module 11 is configured to acquire a screen video resource when it is detected that a screen sharing function is started after a video call connection is established;
a media stream creating module 12, configured to create a screen media stream using the screen video resource as a media source;
a track adding module 13, configured to add a screen video track to the screen media stream, and add the screen media stream to the screen video track;
and the resource sending module 14 is configured to send the screen media stream in the screen video track and the camera media stream in the camera video track to the destination through a video call connection.
Based on the screen sharing technology provided by the embodiment of the invention, after the connection is established in the video call, the screen media stream taking the screen video resource as the media source is created, and the screen media stream is directly added into the newly-built screen video track, so that the screen media stream coexists with the camera media stream in the original camera video track, and the screen media stream and the camera media stream can be simultaneously shared to the destination end through the video call connection, thereby improving the video call function and meeting the individual requirements of the user. Further, the resource obtaining module 11 is further configured to: acquiring video acquisition parameters, wherein the video acquisition parameters comprise a screen area to be shared; and acquiring the screen video resource corresponding to the screen area to be shared by calling a system API.
Further, the video acquisition parameters further comprise output resolution and video acquisition color space information; the resource obtaining module 11 is further configured to: acquiring a first video resource corresponding to the screen area to be shared; adjusting the resolution of the first video resource to the output resolution to obtain a second video resource; and carrying out color space conversion on the second video resource based on the video acquisition color space information to obtain the screen video resource corresponding to the screen area to be shared.
Further, the screen video sharing apparatus further includes an identifier adding module, where the identifier adding module is configured to: when the click information of the mouse is detected, recording click position information; and adding identification information to the first video resource according to the click position information.
Further, the device also comprises an emptying module, wherein the emptying module is used for: and when detecting that only the screen video needs to be shared, controlling the camera to stop shooting and emptying the camera video resources currently existing in the camera video track. Further, the screen video sharing apparatus further includes a sharing type determining module, where the sharing type determining module is configured to obtain and analyze preselected video sharing type information before the media stream creating module 12 creates a screen media stream using the screen video resource as the media source; when the sharing type determining module determines that the screen video and the camera video need to be shared simultaneously according to the video sharing type information, the media stream creating module 12 performs a step of creating a screen media stream using the screen video resource as a media source.
Further, the screen video sharing device further comprises a resource replacement module, wherein the resource replacement module is used for emptying the camera video resource in the camera video track corresponding to the camera media stream when the sharing type determining module determines that only the screen video needs to be shared according to the video sharing type information; replacing the media source corresponding to the camera media stream with the screen video resource to obtain a screen media stream; and sending the screen media stream to a destination end from the camera video track through a video call connection.
Further, the screen video sharing apparatus further includes a communication negotiation module, where the communication negotiation module is configured to: when detecting that the screen media stream and the camera media stream coexist, performing communication negotiation with the destination terminal, and sending current connection information to the destination terminal, so that the destination terminal acquires screen video resources from the received screen media stream according to the connection information; wherein the connection information comprises an identification of the respective media stream.
Referring to fig. 4, an embodiment of the present invention further provides an electronic device 100, including: a processor 40, a memory 41, a bus 42 and a communication interface 43, wherein the processor 40, the communication interface 43 and the memory 41 are connected through the bus 42; the processor 40 is arranged to execute executable modules, such as computer programs, stored in the memory 41.
The Memory 41 may include a high-speed Random Access Memory (RAM) and may also include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The communication connection between the network element of the system and at least one other network element is realized through at least one communication interface 43 (which may be wired or wireless), and the internet, a wide area network, a local network, a metropolitan area network, etc. may be used.
The bus 42 may be an ISA bus, PCI bus, EISA bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one double-headed arrow is shown in FIG. 4, but that does not indicate only one bus or one type of bus.
The memory 41 is used for storing a program, the processor 40 executes the program after receiving an execution instruction, and the method executed by the apparatus defined by the flow process disclosed in any of the foregoing embodiments of the present invention may be applied to the processor 40, or implemented by the processor 40.
The processor 40 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 40. The Processor 40 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory 41, and the processor 40 reads the information in the memory 41 and completes the steps of the method in combination with the hardware thereof.
The screen video sharing device and the electronic device provided by the embodiment of the invention have the same technical characteristics as the screen video sharing method provided by the embodiment, so that the same technical problems can be solved, and the same technical effects can be achieved.
The computer program product for performing the screen video sharing method according to the embodiment of the present invention includes a computer-readable storage medium storing a nonvolatile program code executable by a processor, where instructions included in the program code may be used to execute the method described in the foregoing method embodiment, and specific implementation may refer to the method embodiment, and will not be described herein again.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the apparatus and the electronic device described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Unless specifically stated otherwise, the relative steps, numerical expressions, and values of the components and steps set forth in these embodiments do not limit the scope of the present invention.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (8)
1. A method for on-screen video sharing, comprising:
after video call connection is established, screen video resources are acquired when the screen sharing function is detected to be started;
creating a screen media stream with the screen video resource as a media source;
adding a screen video track to the screen media stream, and adding the screen media stream to the screen video track;
sending the screen media stream in the screen video track and the camera media stream in the camera video track to a destination end through the video call connection;
the step of acquiring the screen video resource when the screen sharing function is detected to be opened comprises the following steps:
acquiring video acquisition parameters, wherein the video acquisition parameters comprise a screen area to be shared;
and acquiring the screen video resource corresponding to the screen area to be shared by calling a system API.
2. The method of claim 1, wherein the video capture parameters further comprise output resolution and video capture color space information;
the step of obtaining the screen video resource corresponding to the screen area to be shared comprises the following steps:
acquiring a first video resource corresponding to the screen area to be shared;
adjusting the resolution of the first video resource to the output resolution to obtain a second video resource;
and performing color space conversion on the second video resource based on the video acquisition color space information to obtain a screen video resource corresponding to the screen area to be shared.
3. The method of claim 2, further comprising:
when the click information of the mouse is detected, recording click position information;
and adding identification information to the first video resource according to the click position information.
4. The method of claim 1, wherein prior to the step of sending the screen media stream in the screen video track and the camera media stream in the camera video track to the destination over the video call connection, further comprising:
and when detecting that only the screen video needs to be shared, controlling the camera to stop shooting and emptying the camera video resources currently existing in the camera video track.
5. The method of claim 1, further comprising:
when detecting that the screen media stream and the camera media stream coexist, performing communication negotiation with the destination terminal, and sending current connection information to the destination terminal, so that the destination terminal acquires screen video resources from the received screen media stream according to the connection information;
wherein the connection information comprises an identification of the respective media stream.
6. An on-screen video sharing apparatus, comprising:
the resource acquisition module is used for acquiring screen video resources when the screen sharing function is detected to be started after the video call connection is established;
the media stream creating module is used for creating a screen media stream which takes the screen video resource as a media source;
the track adding module is used for adding a screen video track to the screen media stream and adding the screen media stream to the screen video track;
the resource sending module is used for sending the screen media stream in the screen video track and the camera media stream in the camera video track to a destination end through the video call connection;
the resource acquisition module is further configured to:
acquiring video acquisition parameters, wherein the video acquisition parameters comprise a screen area to be shared;
and acquiring the screen video resource corresponding to the screen area to be shared by calling a system API.
7. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any of claims 1 to 5 when executing the computer program.
8. A machine-readable storage medium having stored thereon machine-executable instructions which, when invoked and executed by a processor, cause the processor to implement the method of any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910141243.XA CN109862301B (en) | 2019-02-25 | 2019-02-25 | Screen video sharing method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910141243.XA CN109862301B (en) | 2019-02-25 | 2019-02-25 | Screen video sharing method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109862301A CN109862301A (en) | 2019-06-07 |
| CN109862301B true CN109862301B (en) | 2021-02-19 |
Family
ID=66898965
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910141243.XA Active CN109862301B (en) | 2019-02-25 | 2019-02-25 | Screen video sharing method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109862301B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114553844A (en) * | 2022-03-09 | 2022-05-27 | 润芯微科技(江苏)有限公司 | Method for sharing screen during video |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113141483B (en) * | 2020-01-17 | 2022-09-09 | 华为技术有限公司 | Screen sharing method based on video call and mobile device |
| CN113329201B (en) * | 2020-02-28 | 2022-09-02 | 华为技术有限公司 | Enhanced video call method and system, and electronic device |
| KR20210130583A (en) * | 2020-04-22 | 2021-11-01 | 라인플러스 주식회사 | Method and system for sharing content on instant messaging application |
| CN113709577B (en) * | 2020-05-21 | 2023-05-23 | 腾讯科技（深圳）有限公司 | Video session method |
| CN111970473A (en) * | 2020-08-19 | 2020-11-20 | 彩讯科技股份有限公司 | Method, device, equipment and storage medium for realizing synchronous display of double video streams |
| CN115623158A (en) * | 2020-12-18 | 2023-01-17 | 北京字跳网络技术有限公司 | Display method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101789955A (en) * | 2009-12-25 | 2010-07-28 | 宇龙计算机通信科技(深圳)有限公司 | Desktop sharing control method, device and mobile terminal |
| CN106603823A (en) * | 2016-11-28 | 2017-04-26 | 努比亚技术有限公司 | Content sharing method and device and terminal |
| CN108933965A (en) * | 2017-05-26 | 2018-12-04 | 腾讯科技（深圳）有限公司 | screen content sharing method, device and storage medium |
| CN109101209A (en) * | 2018-09-05 | 2018-12-28 | 广州维纳斯家居股份有限公司 | Smart screen sharing method, device, intelligent elevated table and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9325938B2 (en) * | 2014-03-13 | 2016-04-26 | Google Inc. | Video chat picture-in-picture |
| CN106909234A (en) * | 2015-12-23 | 2017-06-30 | 小米科技有限责任公司 | Method, control device, terminal and the device being marked to display screen |
| CN107317994B (en) * | 2017-08-24 | 2020-08-11 | 维沃移动通信有限公司 | Video call method and electronic equipment |
-
2019
- 2019-02-25 CN CN201910141243.XA patent/CN109862301B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101789955A (en) * | 2009-12-25 | 2010-07-28 | 宇龙计算机通信科技(深圳)有限公司 | Desktop sharing control method, device and mobile terminal |
| CN106603823A (en) * | 2016-11-28 | 2017-04-26 | 努比亚技术有限公司 | Content sharing method and device and terminal |
| CN108933965A (en) * | 2017-05-26 | 2018-12-04 | 腾讯科技（深圳）有限公司 | screen content sharing method, device and storage medium |
| CN109101209A (en) * | 2018-09-05 | 2018-12-28 | 广州维纳斯家居股份有限公司 | Smart screen sharing method, device, intelligent elevated table and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114553844A (en) * | 2022-03-09 | 2022-05-27 | 润芯微科技(江苏)有限公司 | Method for sharing screen during video |
| CN114553844B (en) * | 2022-03-09 | 2022-09-06 | 润芯微科技(江苏)有限公司 | Method for sharing screen during video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109862301A (en) | 2019-06-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109862301B (en) | Screen video sharing method and device and electronic equipment | |
| JP6634965B2 (en) | Communication terminal, communication system, communication control method, and program | |
| WO2015176448A1 (en) | Method and apparatus for intelligent screen splitting of terminal | |
| JP2015186127A (en) | Program and server device | |
| TW201143434A (en) | In conference display adjustments | |
| US20210019106A1 (en) | Desktop Sharing Method and Mobile Terminal | |
| CN113473214B (en) | Screen recording method and device, computing equipment and readable storage medium | |
| CN112612436A (en) | Screen projection switching method, device, equipment and storage medium | |
| CN112306607A (en) | Screenshot method and device, electronic equipment and readable storage medium | |
| JP2016031411A (en) | Radio communication system, display device and display method | |
| EP3061214B1 (en) | Method and apparatus for displaying image | |
| CN112116551A (en) | Camera shielding detection method and device, electronic equipment and storage medium | |
| JP2014225804A (en) | Program, setting information utilization system, and information processing device | |
| US10268348B2 (en) | Information processing terminal, information processing method, and information processing system | |
| JP6661915B2 (en) | Communication management system, communication system, relay device control method, and program | |
| EP2985981B1 (en) | Communication terminal and communication method | |
| JP6531391B2 (en) | Transmission management system, transmission system, relay device control method, and program | |
| CN114615458B (en) | Method and device for real-time screen closing and rapid drawing in cloud conference, storage medium and server | |
| CN112269886A (en) | Shared image acquisition method, window sharing method and shared image acquisition device | |
| CN111782100A (en) | Method, device, terminal and storage medium for previewing background picture | |
| EP3186957B1 (en) | Transmission terminal, transmission method, and non-transitory storage medium storing program | |
| CN110618975A (en) | Image sharing method and device and electronic equipment | |
| JP2016067001A (en) | Transmission management system, transmission system, management method, and program | |
| CN112165631B (en) | Media resource processing method and device, storage medium and electronic equipment | |
| CN116528043B (en) | Object marking method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |