CN113411634A - Video stream operation method and device, storage medium and electronic device - Google Patents
Video stream operation method and device, storage medium and electronic device Download PDFInfo
- Publication number
- CN113411634A CN113411634A CN202110500835.3A CN202110500835A CN113411634A CN 113411634 A CN113411634 A CN 113411634A CN 202110500835 A CN202110500835 A CN 202110500835A CN 113411634 A CN113411634 A CN 113411634A
- Authority
- CN
- China
- Prior art keywords
- video stream
- sending
- receiving
- end device
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000002452 interceptive effect Effects 0.000 claims abstract description 26
- 230000008569 process Effects 0.000 claims abstract description 16
- 230000003993 interaction Effects 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 12
- 238000006243 chemical reaction Methods 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
- H04N21/42653—Internal components of the client ; Characteristics thereof for processing graphics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses an operation method and device of a video stream, a storage medium and an electronic device, wherein the method comprises the following steps: receiving a first video stream sent by sending end equipment, wherein the first video stream is used for indicating interface display data of the sending end equipment; sending a second video stream to the receiving end equipment to instruct the receiving end equipment to play the second video stream, wherein the second video stream is determined by the first video stream, and the video format of the second video stream is adapted to the receiving end equipment; in the process of playing the second video stream by the receiving end device, forwarding an interactive event of the first target object to the second video stream to the sending end device, wherein the interactive event comprises: a first operation of a second video stream by a first target object; according to the technical scheme, the problem that in the related art, when a plurality of intelligent devices are shared, only the sending terminal device can operate the video stream and the like can be solved.
Description
Technical Field
The present invention relates to the field of communications, and in particular, to a method and an apparatus for operating a video stream, a storage medium, and an electronic apparatus.
Background
With the development of scientific technology and the development of the internet and the popularization of intelligent devices, a plurality of intelligent devices may exist in a user family, and a user needs to share content among the plurality of intelligent devices.
In the related art, a plurality of intelligent devices share content to be shared through screen projection and sharing screen mirroring. Specifically, the screen projection mode can be used for sharing the picture and the sound of the equipment to the intelligent television or the intelligent box supporting screen projection in a real-time mirror image mode; the screen sharing mode can realize the selection of a certain application or the whole desktop, the picture of the shared screen is displayed on the screens of all the participants in real time, but the screen projection and the screen sharing are unidirectional, and the device for receiving the shared content is not supported to operate the shared content.
Aiming at the problems that in the related art, when a plurality of intelligent devices are shared, only sending end equipment can operate video streams and the like, an effective solution is not provided.
Disclosure of Invention
The embodiment of the invention provides a video stream operation method and device, a storage medium and an electronic device, which are used for at least solving the problems that in the related art, when a plurality of intelligent devices are shared, only sending-end equipment can operate a video stream and the like.
According to an embodiment of the present invention, there is provided an operating method of a video stream, including: receiving a first video stream sent by sending end equipment, wherein the first video stream is used for indicating interface display data of the sending end equipment; sending a second video stream to a receiving end device to instruct the receiving end device to play the second video stream, wherein the second video stream is determined by the first video stream, and the video format of the second video stream is adapted to the receiving end device; in the process of playing the second video stream by the receiving end device, forwarding an interactive event of a first target object to the second video stream to the sending end device, where the interactive event includes: a first operation of the second video stream by a first target object; and instructing the sending end equipment to execute the first operation on the first video stream.
In one exemplary embodiment, transmitting the second video stream to the sink device includes: receiving a video acquisition request of the receiving end equipment; and responding to the video acquisition request, converting the received first video stream into the second video stream, and sending the second video stream to the receiving terminal equipment.
In one exemplary embodiment, converting the received first video stream to the second video stream includes: resolving device information of at least one of the following from the video acquisition request: the size of a display interface of the receiving terminal equipment, the length-width ratio of the display interface, the screen resolution of the display interface and the equipment type of the receiving terminal equipment; and converting the first video stream into the second video stream according to the equipment information.
In one exemplary embodiment, instructing the sending end device to perform the first operation on the first video stream includes: and under the condition that the interactive event further comprises first time corresponding to the first operation, sending the first operation and the first time to the sending end equipment so as to instruct the sending end equipment to execute the first operation and the second operation according to the sequence of the first time and the second time, wherein the second time is the time when a second target object executes the second operation on the first video stream.
In one exemplary embodiment, transmitting the second video stream to the sink device includes: verifying whether the receiving end equipment and the sending end equipment belong to the same target account; and sending a second video stream to the receiving end equipment under the condition that the receiving end equipment and the sending end equipment are determined to belong to the same target account.
In an exemplary embodiment, receiving a first video stream transmitted by a transmitting end device includes: instructing the sending end device to record a screen of a display interface of the sending end device to obtain the first video stream; and receiving a first video stream recorded by the sending end equipment and sent by the sending end equipment.
There is further provided, according to another embodiment of the present invention, an apparatus for operation of a video stream, including: the receiving module is used for receiving a first video stream sent by sending end equipment, wherein the first video stream is used for indicating interface display data of the sending end equipment; a sending module, configured to send a second video stream to a receiving end device to instruct the receiving end device to play the second video stream, where the second video stream is determined by the first video stream, and a video format of the second video stream is adapted to the receiving end device; a forwarding module, configured to forward, to the sending end device, an interaction event of a first target object to the second video stream in a process that the receiving end device plays the second video stream, where the interaction event includes: a first operation of the second video stream by a first target object; an indicating module, configured to instruct the sending-end device to execute the first operation on the first video stream.
In one exemplary embodiment, the apparatus further comprises: the receiving module is further configured to receive a video acquisition request of the receiving end device; and the conversion module is used for responding to the video acquisition request, converting the received first video stream into the second video stream and sending the second video stream to the receiving terminal equipment.
According to still another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned operation method of video streaming when running.
According to another aspect of the embodiments of the present invention, there is also provided an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the method for operating the video stream through the computer program.
In the embodiment of the invention, a first video stream sent by sending end equipment is received, wherein the first video stream is used for indicating interface display data of the sending end equipment; sending a second video stream to the receiving end equipment to instruct the receiving end equipment to play the second video stream, wherein the second video stream is determined by the first video stream, and the video format of the second video stream is adapted to the receiving end equipment; in the process of playing the second video stream by the receiving end device, forwarding an interactive event of the first target object to the second video stream to the sending end device, wherein the interactive event comprises: a first operation of a second video stream by a first target object; the method comprises the steps of indicating a sending end device to execute a first operation on a first video stream, namely outputting a second video stream at a receiving end device, forwarding the first operation of a first target object on the second video stream, and indicating the sending end device to execute the first operation on the first video stream.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a computer terminal of an operation method of a video stream according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of operation of a video stream according to an embodiment of the invention;
FIG. 3 is a schematic diagram of a method of operation of a video stream according to an embodiment of the invention;
fig. 4 is a block diagram of an apparatus for operation of a video stream according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The method provided by the embodiment of the application can be executed in a computer terminal, a mobile terminal or a similar operation device. Taking the example of running on a computer terminal, fig. 1 is a hardware structure block diagram of a computer terminal of an operation method of a video stream according to an embodiment of the present invention. As shown in fig. 1, the computer terminal may include one or more (only one shown in fig. 1) processors 102 (the processors 102 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, and in an exemplary embodiment, may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the computer terminal. For example, the computer terminal may also include more or fewer components than shown in FIG. 1, or have a different configuration with equivalent functionality to that shown in FIG. 1 or with more functionality than that shown in FIG. 1.
The memory 104 may be used to store computer programs, for example, software programs and modules of application software, such as computer programs corresponding to the operation method of the video stream in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, so as to implement the above-mentioned method. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to a computer terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal. In one example, the transmission device 106 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In this embodiment, an operation method of a video stream is provided, which is applied to the above-mentioned computer terminal, and fig. 2 is a flowchart of the operation method of the video stream according to the embodiment of the present invention, where the flowchart includes the following steps:
step S202, receiving a first video stream sent by a sending end device, wherein the first video stream is used for indicating interface display data of the sending end device;
step S204, sending a second video stream to a receiving end device to instruct the receiving end device to play the second video stream, wherein the second video stream is determined by the first video stream, and the video format of the second video stream is adapted to the receiving end device;
step S206: in the process of playing the second video stream by the receiving end device, forwarding an interactive event of a first target object to the second video stream to the sending end device, where the interactive event includes: a first operation of the second video stream by a first target object;
step S208: and instructing the sending end equipment to execute the first operation on the first video stream.
In the embodiment of the invention, a first video stream sent by sending end equipment is received, wherein the first video stream is used for indicating interface display data of the sending end equipment; sending a second video stream to the receiving end equipment to instruct the receiving end equipment to play the second video stream, wherein the second video stream is determined by the first video stream, and the video format of the second video stream is adapted to the receiving end equipment; in the process of playing the second video stream by the receiving end device, forwarding an interactive event of the first target object to the second video stream to the sending end device, wherein the interactive event comprises: a first operation of a second video stream by a first target object; the method comprises the steps of indicating a sending end device to execute a first operation on a first video stream, namely outputting a second video stream at a receiving end device, forwarding the first operation of a first target object on the second video stream, and indicating the sending end device to execute the first operation on the first video stream.
It should be noted that the interaction event in step S206 may be: voice input operation and touch screen input operation, which are not limited in the embodiments of the present invention.
In an exemplary embodiment, the manner of sending the second video stream to the sink device is as follows: receiving a video acquisition request of the receiving end equipment; and responding to the video acquisition request, converting the received first video stream into the second video stream, and sending the second video stream to the receiving terminal equipment.
It can be understood that, a receiving end device sends a video obtaining request to a server, requests the server to send a video stream to the receiving end device, and the server responds to the video obtaining request, converts a video format of a first video stream sent by a sending end device into a video format of a second video stream adapted to the receiving end device, and sends the converted second video stream to the receiving end device, it should be noted that the video format of the first video stream can be obtained by analyzing the first video stream, and the video format includes: resolution, video pixel ratio, etc., which are not limited in this embodiment of the present invention.
There are many ways to convert the received first video stream into the second video stream, and an implementation manner is provided in an embodiment of the present invention, and in an exemplary embodiment, the device information of at least one of the following is parsed from the video acquisition request: the size of a display interface of the receiving terminal equipment, the length-width ratio of the display interface, the screen resolution of the display interface and the equipment type of the receiving terminal equipment; and converting the first video stream into the second video stream according to the equipment information.
The video obtaining request sent by the receiving end device to the server includes device information of the receiving end device, where the device information may include: the size of the display interface of the receiving end device, the aspect ratio of the display interface, the screen resolution of the display interface, and the device type of the receiving end device convert the first video stream into the second video stream according to the device information of the receiving end device, for example: and if the aspect ratio of the display interface of the receiving end device is 9:4 and the screen resolution of the display interface is 1600 × 1200, converting the first video stream into a second video stream with the resolution of 1600 × 1200 and the video aspect ratio of 9: 4.
Further, in the case that the receiving-end device is only a device capable of making sound, the first video stream is converted into a second video stream, wherein the second video stream is only sound.
In an exemplary embodiment, when the interactive event further includes a first time corresponding to the first operation, both the first operation and the first time are sent to the sending-end device, so as to instruct the sending-end device to execute the first operation and the second operation according to a sequence of the first time and a second time, where the second time is a time when a second target object executes a second operation on the first video stream.
That is, the interactive event sent by the receiving end device to the server includes: the method comprises the steps that a first target object performs first operation on a second video stream, the first time corresponds to the first operation, a server sends the first operation and the first time to a sending end device, the sending end device receives the first operation, the first time, second operation of the second object on the first video stream and second time corresponding to the second operation, the sending end device sorts the first operation and the second operation according to a time sequence, the first operation is executed firstly under the condition that the first time corresponding to the first operation is prior to the second time corresponding to the second operation, and the second operation is executed firstly under the condition that the second time corresponding to the second operation is prior to the first time corresponding to the first operation; in addition, when the first time and the second time are the same, the execution order of the first operation and the second operation is determined according to the priorities of the sending end device and the receiving end device, where the priorities of the sending end device and the receiving end device may be set by a user, or may be determined by the device according to a specific situation, which is not limited in the embodiment of the present invention.
In one exemplary embodiment, transmitting the second video stream to the sink device includes: verifying whether the receiving end equipment and the sending end equipment belong to the same target account; and sending a second video stream to the receiving end equipment under the condition that the receiving end equipment and the sending end equipment are determined to belong to the same target account.
In order to ensure the accuracy of the receiving end device, after the server receives the video acquisition request sent by the receiving end device, the receiving end device is verified, and whether the receiving end device and the sending end device belong to the same target account is judged.
Further, the second video stream may be sent to the receiving end device by determining whether the network connected to the receiving end device and the network connected to the sending end device are the same network, and in a case that the network connected to the receiving end device and the network connected to the sending end device are the same network.
In an exemplary embodiment, receiving a first video stream transmitted by a transmitting end device includes: instructing the sending end device to record a screen of a display interface of the sending end device to obtain the first video stream; and receiving a first video stream recorded by the sending end equipment and sent by the sending end equipment.
It can be understood that a first video stream is obtained by recording a screen on a display interface of the sending end device, and the recorded first video stream is sent to the server.
In order to better understand the process of the operation method of the video stream, the following describes a flow of an implementation method of the operation of the video stream with reference to an alternative embodiment, but the flow is not limited to the technical solution of the embodiment of the present invention.
As shown in fig. 3, fig. 3 is a schematic diagram of an operation method of a video stream according to an embodiment of the present invention, and the specific steps are as follows:
step S301: a sending-end intelligent device (equivalent to the sending-end device in the above embodiment) records a screen of a display interface of the sending-end intelligent device to obtain a first video stream;
specifically, the intelligent device at the sending end uses a screen recording mode to record the contents of a certain application/game or the whole desktop, wherein the desktop contents at least comprise one of the following contents: pictures and sounds.
Step S302: a first video stream with low delay (less than 500 milliseconds) and high fidelity (not less than 30 frames 720p) is sent to a multi-screen interactive background server in real time, wherein the first video stream can be a local network service or a cloud server on the Internet;
step S303: one or more receiving-end intelligent devices (corresponding to the receiving-end devices in the above embodiments) pull the stream-adapted second video stream from the multi-screen interactive background server;
specifically, the multi-screen interactive background server converts the first video stream into the second video stream for one or more receiving-end intelligent devices according to the size of a display interface of the receiving-end intelligent device, the length-width ratio of the display interface, the screen resolution of the display interface and the device type of the receiving-end intelligent device.
Step S304: the receiving-end intelligent device displays the second video stream in real time (less than 500 milliseconds);
step S305: the receiving end intelligent device monitors a user interaction event, wherein the trigger time (equivalent to the first time in the embodiment) corresponding to the interaction event, a key value of a key, the relative position of a touch screen through clicking or sliding operation, a voice command and the like are monitored;
step S306: sending the interaction event to a multi-screen interaction background service in real time;
step S307: sending the interaction event to the sending end intelligent equipment in real time;
step S308: and the intelligent equipment at the sending end simulates the user to execute the interactive events in sequence according to the sequence of the event triggering time.
In the embodiment of the invention, a first video stream sent by sending end equipment is received, wherein the first video stream is used for indicating interface display data of the sending end equipment; sending a second video stream to the receiving end equipment to instruct the receiving end equipment to play the second video stream, wherein the second video stream is determined by the first video stream, and the video format of the second video stream is adapted to the receiving end equipment; in the process of playing the second video stream by the receiving end device, forwarding an interactive event of the first target object to the second video stream to the sending end device, wherein the interactive event comprises: a first operation of a second video stream by a first target object; the method comprises the steps of indicating a sending end device to execute a first operation on a first video stream, namely outputting a second video stream at a receiving end device, forwarding the first operation of a first target object on the second video stream, and indicating the sending end device to execute the first operation on the first video stream.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
FIG. 4 is a block diagram of an apparatus for operation of a video stream according to an embodiment of the present invention; as shown in fig. 4, includes:
a receiving module 42, configured to receive a first video stream sent by a sending end device, where the first video stream is used to indicate interface display data of the sending end device;
a sending module 44, configured to send a second video stream to a receiving end device to instruct the receiving end device to play the second video stream, where the second video stream is determined by the first video stream, and a video format of the second video stream is adapted to the receiving end device;
a forwarding module 46, configured to forward, to the sending end device, an interaction event of a first target object with respect to the second video stream in a process that the receiving end device plays the second video stream, where the interaction event includes: a first operation of the second video stream by a first target object;
an instructing module 48, configured to instruct the sending-end device to perform the first operation on the first video stream.
In the embodiment of the invention, a first video stream sent by sending end equipment is received, wherein the first video stream is used for indicating interface display data of the sending end equipment; sending a second video stream to the receiving end equipment to instruct the receiving end equipment to play the second video stream, wherein the second video stream is determined by the first video stream, and the video format of the second video stream is adapted to the receiving end equipment; in the process of playing the second video stream by the receiving end device, forwarding an interactive event of the first target object to the second video stream to the sending end device, wherein the interactive event comprises: a first operation of a second video stream by a first target object; the method comprises the steps of indicating a sending end device to execute a first operation on a first video stream, namely outputting a second video stream at a receiving end device, forwarding the first operation of a first target object on the second video stream, and indicating the sending end device to execute the first operation on the first video stream.
It should be noted that the interaction event may be: voice input operation and touch screen input operation, which are not limited in the embodiments of the present invention.
In an exemplary embodiment, the receiving module is further configured to receive a video acquisition request of the receiving end device; the conversion module is further configured to respond to the video acquisition request, convert the received first video stream into the second video stream, and send the second video stream to the receiving end device.
It can be understood that, a receiving end device sends a video obtaining request to a server, requests the server to send a video stream to the receiving end device, and the server responds to the video obtaining request, converts a video format of a first video stream sent by a sending end device into a video format of a second video stream adapted to the receiving end device, and sends the converted second video stream to the receiving end device, it should be noted that the video format of the first video stream can be obtained by analyzing the first video stream, and the video format includes: resolution, video pixel ratio, etc., which are not limited in this embodiment of the present invention.
In an exemplary embodiment, the receiving module is further configured to parse, from the video acquisition request, device information of at least one of: the size of a display interface of the receiving terminal equipment, the length-width ratio of the display interface, the screen resolution of the display interface and the equipment type of the receiving terminal equipment; the conversion module is further configured to convert the first video stream into the second video stream according to the device information.
The video obtaining request sent by the receiving end device to the server includes device information of the receiving end device, where the device information may include: the size of the display interface of the receiving end device, the aspect ratio of the display interface, the screen resolution of the display interface, and the device type of the receiving end device convert the first video stream into the second video stream according to the device information of the receiving end device, for example: and if the aspect ratio of the display interface of the receiving end device is 9:4 and the screen resolution of the display interface is 1600 × 1200, converting the first video stream into a second video stream with the resolution of 1600 × 1200 and the video aspect ratio of 9: 4.
Further, in the case that the receiving-end device is only a device capable of making sound, the first video stream is converted into a second video stream, wherein the second video stream is only sound.
In an exemplary embodiment, in a case that the interactive event further includes a first time corresponding to the first operation, the sending module sends both the first operation and the first time to the sending end device, so as to instruct the sending end device to execute the first operation and the second operation according to a sequence of the first time and a second time, where the second time is a time when a second target object executes a second operation on the first video stream.
That is, the interactive event sent by the receiving end device to the server includes: the method comprises the steps that a first target object performs first operation on a second video stream, the first time corresponds to the first operation, a server sends the first operation and the first time to a sending end device, the sending end device receives the first operation, the first time, second operation of the second object on the first video stream and second time corresponding to the second operation, the sending end device sorts the first operation and the second operation according to a time sequence, the first operation is executed firstly under the condition that the first time corresponding to the first operation is prior to the second time corresponding to the second operation, and the second operation is executed firstly under the condition that the second time corresponding to the second operation is prior to the first time corresponding to the first operation; in addition, when the first time and the second time are the same, the execution order of the first operation and the second operation is determined according to the priorities of the sending end device and the receiving end device, where the priorities of the sending end device and the receiving end device may be set by a user, or may be determined by the device according to a specific situation, which is not limited in the embodiment of the present invention.
In an exemplary embodiment, the above apparatus further includes: the verification module is used for verifying whether the receiving end equipment and the sending end equipment belong to the same target account or not; and sending a second video stream to the receiving end equipment under the condition that the receiving end equipment and the sending end equipment are determined to belong to the same target account.
In order to ensure the accuracy of the receiving end device, after the server receives the video acquisition request sent by the receiving end device, the receiving end device is verified, and whether the receiving end device and the sending end device belong to the same target account is judged.
Further, the second video stream may be sent to the receiving end device by determining whether the network connected to the receiving end device and the network connected to the sending end device are the same network, and in a case that the network connected to the receiving end device and the network connected to the sending end device are the same network.
In an exemplary embodiment, the mokuri is received, and the receiving end device is further configured to instruct the sending end device to record a display interface of the sending end device, so as to obtain the first video stream; and receiving a first video stream recorded by the sending end equipment and sent by the sending end equipment.
It can be understood that a first video stream is obtained by recording a screen on a display interface of the sending end device, and the recorded first video stream is sent to the server.
An embodiment of the present invention further provides a storage medium including a stored program, wherein the program executes any one of the methods described above.
Alternatively, in the present embodiment, the storage medium may be configured to store program codes for performing the following steps:
s1, receiving a first video stream sent by a sending end device, wherein the first video stream is used for indicating interface display data of the sending end device;
s2, sending a second video stream to a receiving end device to instruct the receiving end device to play the second video stream, where the second video stream is determined by the first video stream, and a video format of the second video stream is adapted to the receiving end device;
s3, in the process of playing the second video stream by the receiving end device, forwarding an interactivity event of the second video stream by a first target object to the sending end device, where the interactivity event includes: a first operation of the second video stream by a first target object;
s4, instructing the sending-end device to perform the first operation on the first video stream.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, receiving a first video stream sent by a sending end device, wherein the first video stream is used for indicating interface display data of the sending end device;
s2, sending a second video stream to a receiving end device to instruct the receiving end device to play the second video stream, where the second video stream is determined by the first video stream, and a video format of the second video stream is adapted to the receiving end device;
s3, in the process of playing the second video stream by the receiving end device, forwarding an interactivity event of the second video stream by a first target object to the sending end device, where the interactivity event includes: a first operation of the second video stream by a first target object;
s4, instructing the sending-end device to perform the first operation on the first video stream.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A method of operating a video stream, comprising:
receiving a first video stream sent by sending end equipment, wherein the first video stream is used for indicating interface display data of the sending end equipment;
sending a second video stream to a receiving end device to instruct the receiving end device to play the second video stream, wherein the second video stream is determined by the first video stream, and the video format of the second video stream is adapted to the receiving end device;
in the process of playing the second video stream by the receiving end device, forwarding an interactive event of a first target object to the second video stream to the sending end device, where the interactive event includes: a first operation of the second video stream by a first target object;
and instructing the sending end equipment to execute the first operation on the first video stream.
2. The method of claim 1, wherein transmitting the second video stream to the sink device comprises:
receiving a video acquisition request of the receiving end equipment;
and responding to the video acquisition request, converting the received first video stream into the second video stream, and sending the second video stream to the receiving terminal equipment.
3. The method of claim 2, wherein converting the received first video stream into the second video stream comprises:
resolving device information of at least one of the following from the video acquisition request: the size of a display interface of the receiving terminal equipment, the length-width ratio of the display interface, the screen resolution of the display interface and the equipment type of the receiving terminal equipment;
and converting the first video stream into the second video stream according to the equipment information.
4. The method according to claim 1, wherein instructing the sending end device to perform the first operation on the first video stream comprises:
and under the condition that the interactive event further comprises first time corresponding to the first operation, sending the first operation and the first time to the sending end equipment so as to instruct the sending end equipment to execute the first operation and the second operation according to the sequence of the first time and the second time, wherein the second time is the time when a second target object executes the second operation on the first video stream.
5. The method of claim 1, wherein transmitting the second video stream to the sink device comprises:
verifying whether the receiving end equipment and the sending end equipment belong to the same target account;
and sending a second video stream to the receiving end equipment under the condition that the receiving end equipment and the sending end equipment are determined to belong to the same target account.
6. The method of claim 1, wherein receiving the first video stream transmitted by the transmitting device comprises:
instructing the sending end device to record a screen of a display interface of the sending end device to obtain the first video stream;
and receiving a first video stream recorded by the sending end equipment and sent by the sending end equipment.
7. An apparatus for manipulation of a video stream, comprising:
the receiving module is used for receiving a first video stream sent by sending end equipment, wherein the first video stream is used for indicating interface display data of the sending end equipment;
a sending module, configured to send a second video stream to a receiving end device to instruct the receiving end device to play the second video stream, where the second video stream is determined by the first video stream, and a video format of the second video stream is adapted to the receiving end device;
a forwarding module, configured to forward, to the sending end device, an interaction event of a first target object to the second video stream in a process that the receiving end device plays the second video stream, where the interaction event includes: a first operation of the second video stream by a first target object;
an indicating module, configured to instruct the sending-end device to execute the first operation on the first video stream.
8. The apparatus of claim 7, further comprising:
the receiving module is further configured to receive a video acquisition request of the receiving end device;
and the conversion module is used for responding to the video acquisition request, converting the received first video stream into the second video stream and sending the second video stream to the receiving terminal equipment.
9. A computer-readable storage medium, comprising a stored program, wherein the program is operable to perform the method of any one of claims 1 to 6.
10. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method of any of claims 1 to 6 by means of the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110500835.3A CN113411634A (en) | 2021-05-08 | 2021-05-08 | Video stream operation method and device, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110500835.3A CN113411634A (en) | 2021-05-08 | 2021-05-08 | Video stream operation method and device, storage medium and electronic device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113411634A true CN113411634A (en) | 2021-09-17 |
Family
ID=77678279
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110500835.3A Pending CN113411634A (en) | 2021-05-08 | 2021-05-08 | Video stream operation method and device, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113411634A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170195617A1 (en) * | 2015-12-18 | 2017-07-06 | Le Holdings (Beijing) Co., Ltd. | Image processing method and electronic device |
| CN108066986A (en) * | 2017-10-26 | 2018-05-25 | 咪咕互动娱乐有限公司 | A kind of Streaming Media determines method and device and storage medium |
| CN109525802A (en) * | 2018-11-27 | 2019-03-26 | 平安科技（深圳）有限公司 | A kind of video stream transmission method and device |
| CN110368689A (en) * | 2019-07-19 | 2019-10-25 | 腾讯科技（深圳）有限公司 | Display methods, system, electronic equipment and the storage medium of interface |
| CN110662100A (en) * | 2018-06-28 | 2020-01-07 | 中兴通讯股份有限公司 | Information processing method, device and system and computer readable storage medium |
| CN112714272A (en) * | 2020-12-14 | 2021-04-27 | 深圳市鹏创软件有限公司 | Inter-device control method, terminal, and computer-readable storage medium |
-
2021
- 2021-05-08 CN CN202110500835.3A patent/CN113411634A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170195617A1 (en) * | 2015-12-18 | 2017-07-06 | Le Holdings (Beijing) Co., Ltd. | Image processing method and electronic device |
| CN108066986A (en) * | 2017-10-26 | 2018-05-25 | 咪咕互动娱乐有限公司 | A kind of Streaming Media determines method and device and storage medium |
| CN110662100A (en) * | 2018-06-28 | 2020-01-07 | 中兴通讯股份有限公司 | Information processing method, device and system and computer readable storage medium |
| CN109525802A (en) * | 2018-11-27 | 2019-03-26 | 平安科技（深圳）有限公司 | A kind of video stream transmission method and device |
| CN110368689A (en) * | 2019-07-19 | 2019-10-25 | 腾讯科技（深圳）有限公司 | Display methods, system, electronic equipment and the storage medium of interface |
| CN112714272A (en) * | 2020-12-14 | 2021-04-27 | 深圳市鹏创软件有限公司 | Inter-device control method, terminal, and computer-readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11417341B2 (en) | Method and system for processing comment information | |
| CN111010614A (en) | Method, device, server and medium for displaying live caption | |
| CN110798698B (en) | Multi-server stream pushing method, equipment and storage medium for live broadcast application program | |
| CN108632676B (en) | Image display method, image display device, storage medium and electronic device | |
| CN109561351A (en) | Network direct broadcasting back method, device and storage medium | |
| CN109982148A (en) | A kind of live broadcasting method, device, computer equipment and storage medium | |
| CN112616065B (en) | Screen image initiating method, device and system and readable storage medium | |
| CN109803151B (en) | Multimedia data stream switching method and device, storage medium and electronic device | |
| CN108124172B (en) | Cloud projection method, device and system | |
| CN110177300B (en) | Program running state monitoring method and device, electronic equipment and storage medium | |
| CN114040232B (en) | Screen projection system, screen projection method, electronic equipment and storage medium | |
| CN103491431A (en) | Method, terminal and system for audio and video sharing of digital television | |
| CN103517135A (en) | Method, system and television capable of playing MP4-format video files continuously | |
| JP2009038420A (en) | Content evaluation software and service providing system | |
| CN111818383B (en) | Video data generation method, system, device, electronic equipment and storage medium | |
| CN111131891A (en) | Audio and video playing method and device, playing equipment and system | |
| CN111107387B (en) | Video transcoding method and device and computer storage medium | |
| CN112565877A (en) | Screen projection method and system, electronic equipment and storage medium | |
| CN114257572A (en) | Data processing method and device, computer readable medium and electronic equipment | |
| CN113411634A (en) | Video stream operation method and device, storage medium and electronic device | |
| CN112565807B (en) | Method, apparatus, medium and computer program product for live broadcast in a local area network | |
| CN112235592B (en) | Live broadcast method, live broadcast processing method, device and computer equipment | |
| CN114363666A (en) | Video processing method and device and electronic equipment | |
| JP2008139977A (en) | Network system | |
| CN114143616A (en) | Target video processing method and system, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210917 |