CN112954483A - Data transmission method, system and nonvolatile storage medium - Google Patents

Data transmission method, system and nonvolatile storage medium Download PDF

Info

Publication number
CN112954483A
CN112954483A CN202110179471.3A CN202110179471A CN112954483A CN 112954483 A CN112954483 A CN 112954483A CN 202110179471 A CN202110179471 A CN 202110179471A CN 112954483 A CN112954483 A CN 112954483A
Authority
CN
China
Prior art keywords
data stream
played back
control instruction
information
sending
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110179471.3A
Other languages
Chinese (zh)
Other versions
CN112954483B (en
Inventor
程胜文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian Wanxiang Electronics Technology Co Ltd
Original Assignee
Xian Wanxiang Electronics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian Wanxiang Electronics Technology Co Ltd filed Critical Xian Wanxiang Electronics Technology Co Ltd
Priority to CN202110179471.3A priority Critical patent/CN112954483B/en
Publication of CN112954483A publication Critical patent/CN112954483A/en
Application granted granted Critical
Publication of CN112954483B publication Critical patent/CN112954483B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a data transmission method, a data transmission system and a nonvolatile storage medium. Wherein, the method comprises the following steps: responding to a first control instruction of a target object, controlling the sending end equipment to stop acquiring the multimedia data stream, and acquiring information of a first data stream to be played back cached by the sending end equipment; generating a control interface according to the information of the first data stream to be played back and displaying the control interface; and responding to a second control instruction of the target object detected on the control interface, controlling the sending end equipment to determine a second data stream to be played back, and sending the second data stream to be played back to the receiving end equipment, wherein the second data stream to be played back is determined from the first data stream to be played back according to the second control instruction. The method and the device solve the technical problem that the transmitted and displayed picture cannot be reproduced in the image transmission process, so that the user is inconvenient to use.

Description

Data transmission method, system and nonvolatile storage medium
Technical Field
The present application relates to the field of remote image transmission technologies, and in particular, to a data transmission method, a data transmission system, and a non-volatile storage medium.
Background
In order to implement remote image transmission, a source device (remote computing device) is generally connected to a sending device, where the sending device is configured to collect a desktop image of the source device, compress and encode the image, and send an obtained code stream to a receiving device in real time through a network, and the receiving device receives the code stream sent by the sending device, decodes the code stream, and sends the decoded code stream to a display device for display.
The existing image transmission system usually collects and transmits images in real time, and is suitable for some real-time video transmission scenes, such as video conferences and the like. However, in this scenario, since the video acquisition of the sending end device is real-time, the display of the receiving end device is also real-time, and there is no way to reproduce the acquired and played pictures, this approach is not convenient in some special scenarios, such as remote teaching or network training scenarios. For example, if the content spoken by the receiving end user is not clearly heard, the speaker, that is, the sending end user needs to repeat the previously spoken content again, and after the content is spoken, the sender needs to return to the current page again to continue to leave the curriculum content.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the application provides a data transmission method, a data transmission system and a nonvolatile storage medium, which are used for at least solving the technical problem that a transmitted and displayed picture cannot be reproduced in the image transmission process, so that the use of a user is inconvenient.
According to an aspect of an embodiment of the present application, there is provided a data transmission method, including: responding to a first control instruction of a target object, controlling the sending end equipment to stop acquiring the multimedia data stream, and acquiring information of a first data stream to be played back cached by the sending end equipment; generating a control interface according to the information of the first data stream to be played back and displaying the control interface; and responding to a second control instruction of the target object detected on the control interface, controlling the sending end equipment to determine a second data stream to be played back, and sending the second data stream to be played back to the receiving end equipment, wherein the second data stream to be played back is determined from the first data stream to be played back according to the second control instruction.
Optionally, before obtaining the information of the first data stream to be played back, which is cached by the sending end device, the method further includes: controlling sending end equipment to determine whether to cache the acquired multimedia data stream according to a preset data acquisition mode, and taking all cached multimedia data streams as a first data stream to be played back, wherein the data acquisition mode at least comprises one of the following modes: and (4) acquiring a cache mode while acquiring a non-cache mode.
Optionally, the obtaining information of the first data stream to be played back, which is cached by the sending end device, includes: acquiring basic information of a first data stream to be played back, wherein the basic information comprises: the duration, format, size, acquisition start time and acquisition end time of the first data stream to be played back.
Optionally, in response to a second control instruction of the target object detected on the control interface, controlling the sending-end device to determine a second data stream to be played back includes: and receiving a second control instruction of the target object, acquiring the start information and the end information of a second data stream to be played back, which are contained in the second control instruction, and controlling the sending end equipment to determine the second data stream to be played back from the first data stream to be played back according to the start information and the end information.
Optionally, after the second data stream to be played back is sent to the receiving end device, the method further includes: receiving playback completion information from the sending terminal equipment and displaying the playback completion information; and responding to a third control instruction of the target object, and controlling the sending end equipment to continue to acquire the multimedia data stream or redetermine a third data stream to be played back.
Optionally, controlling the sending-end device to continue to acquire the multimedia data stream or to re-determine the third data stream to be played back in response to a third control instruction of the target object, where the method includes: if the third control instruction indicates that playback is not needed again, controlling the sending end equipment to continue to collect the multimedia data stream; and if the third control instruction indicates that playback needs to be performed again, displaying the control interface again, acquiring the start information and the end information of a third data stream to be played back, which are contained in the third control instruction, controlling the sending end equipment to select the third data stream to be played back from the first data stream to be played back according to the start information and the end information, and sending the third data stream to the receiving end equipment.
Optionally, in the process of determining the second data stream to be played back and in the process of determining the third data stream to be played back, the sending end device is controlled to send the preset multimedia data to the receiving end device.
According to an aspect of the embodiments of the present application, there is provided another data transmission method, including: acquiring and caching multimedia data stream of a source end device to obtain a first data stream to be played back, and simultaneously sending the multimedia data stream to a receiving end device; responding to a first control instruction from the source end equipment, stopping collecting the multimedia data stream of the source end equipment, and feeding back first data stream information to be played back to the source end equipment; and responding to a second control instruction from the source end equipment, determining a second data stream to be played back from the first data stream to be played back, and sending the second data stream to the receiving end equipment.
Optionally, acquiring a multimedia data stream of a source device and caching the multimedia data stream to obtain a first data stream to be played back, including: determining whether the collected multimedia data streams are cached or not according to a preset data collection mode, and taking all the cached multimedia data streams as a first data stream to be played back, wherein the data collection mode at least comprises one of the following modes: and (4) acquiring a cache mode while acquiring a non-cache mode.
Optionally, determining a second data stream to be played back from the first data stream to be played back in response to a second control instruction from the source device, includes:
receiving a second control instruction from the source end device, acquiring start information and end information of a second data stream to be played back, which are contained in the second control instruction, and selecting the second data stream to be played back from the first data stream to be played back according to the start information and the end information.
Optionally, after determining, in response to a second control instruction from the source device, a second data stream to be played back from the first data stream to be played back, and sending the second data stream to the sink device, the method further includes: feeding back playback completion information to the source end equipment, and responding to a third control instruction from the source end equipment; if the third control instruction indicates that playback is not needed again, continuing to acquire the multimedia data stream of the source end device; and if the third control instruction indicates that playback needs to be performed again, displaying the control interface again, acquiring the starting information and the ending information of a third data stream to be played back, which are contained in the third control instruction, selecting the third data stream to be played back from the first data stream to be played back according to the starting information and the ending information, and sending the third data stream to the receiving terminal equipment.
According to another aspect of the embodiments of the present application, there is also provided a data transmission system, including: the source end device is used for providing multimedia data stream, receiving a control instruction of a target object and controlling the sending end device to execute corresponding operation; the sending end equipment is used for acquiring the multimedia data stream of the source end equipment, determining the multimedia data stream to be played back according to a control instruction from the source end equipment, and sending the multimedia data stream to the receiving end equipment; the receiving end equipment is used for receiving the multimedia data stream from the sending end equipment, decoding the multimedia data stream and transmitting the decoded multimedia data stream to the display equipment; and the display device is used for displaying the multimedia data stream from the receiving end device.
According to yet another aspect of the present application, there is provided a non-volatile storage medium including a stored program, wherein the non-volatile storage medium is controlled by a device to execute the above data transmission method when the program is executed.
In the embodiment of the application, a first control instruction responding to a target object is adopted to control sending end equipment to stop collecting multimedia data streams and obtain information of a first data stream to be played back cached by the sending end equipment; generating a control interface according to the information of the first data stream to be played back and displaying the control interface; and responding to a second control instruction of the target object detected on the control interface, controlling the sending end equipment to determine a second data stream to be played back, and sending the second data stream to be played back to the receiving end equipment, so that the aim of reproducing the transmitted and displayed picture is fulfilled, the technical effect of reproducing the transmitted and displayed picture in the image transmission process is realized, and the technical problem that the transmitted and displayed picture cannot be reproduced in the image transmission process, so that the use inconvenience of a user is caused is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic flow chart diagram of an alternative data transmission method according to an embodiment of the present application;
FIG. 2 is a schematic flow chart diagram of an alternative data transmission method according to an embodiment of the present application;
FIG. 3 is a block diagram of an alternative data transmission system according to an embodiment of the present application;
fig. 4 is a system diagram of a data transmission method according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In accordance with an embodiment of the present application, there is provided a method embodiment of a data transmission method, it should be noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer executable instructions, and that while a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than that herein.
Fig. 1 is a data transmission method according to an embodiment of the present application, as shown in fig. 1, the method includes the following steps:
step S102, responding to a first control instruction of a target object, controlling sending end equipment to stop collecting multimedia data streams, and acquiring information of a first data stream to be played back cached by the sending end equipment;
the target object may be a user at the source device, specifically, a speaker in a network video conference, or a teacher in an online live course, or a main broadcast, and the first control instruction refers to an instruction that the user requests to play back already played video and audio contents, that is, a first data stream to be played back, sent by another external input device, such as a keyboard, a mouse, a touch pad, or a voice control device;
in addition, the sending end device also buffers the duration, format, size, acquisition start time and acquisition end time of the multimedia data stream while buffering the multimedia data stream.
In some embodiments of the present application, before obtaining information of a first data stream to be played back that is cached by a sending end device, the sending end device needs to be controlled to determine whether to cache an acquired multimedia data stream according to a preset data acquisition mode, and all cached multimedia data streams are used as the first data stream to be played back, where the data acquisition mode at least includes one of: and (4) acquiring a cache mode while acquiring a non-cache mode.
Specifically, the above-mentioned mode of collecting and caching at the same time means that the sending end device caches the multimedia data locally while collecting the multimedia data, and the mode of collecting and caching only means that the multimedia data is not cached locally while collecting the multimedia data.
When the mode of caching and collecting is selected, the sending end device collects desktop images of the source end device, collects audio input from an audio input port of the source end device, collects the collected data into audio and video streams, encodes the multimedia data streams and sends the encoded multimedia data streams to the receiving end device while the multimedia data streams are cached locally, and the multimedia data streams are decoded and played by the receiving end device.
It should be noted that the source device in the present application may be an electronic product that can be connected to the internet and interact with other devices connected to the internet, such as a computer, a smart phone, a tablet computer, and a smart television.
When the mode of only collecting and not caching is selected, the sending end equipment does not automatically cache the collected multimedia data stream in the local part while collecting the collected multimedia data stream, but allows a user to send an instruction, and the sending end equipment is required to start caching the multimedia data stream at any time point in the transmission process of the multimedia data stream.
Step S104, generating a control interface according to the information of the first data stream to be played back and displaying the control interface;
the source device connected to the sending end device may generate, on the basis of basic information of a multimedia data stream in a first data stream to be played back that is locally cached by the sending end device, a control interface that facilitates content playback for a user at the source device, for example, the control interface may include a time axis, and a user of the source device may view a thumbnail of a video picture in the multimedia data stream on a time node corresponding to a position where a current cursor is located by moving the cursor on the time axis, so that the user may quickly locate a start position and an end position where the user desires to play back by moving the cursor on the time axis and viewing the thumbnail.
The implementation mode of the process is as follows: the source end equipment receives time node information sent by a user through moving a cursor on a time axis; and obtaining the picture on the corresponding time node from the sending terminal equipment, generating a thumbnail and displaying the thumbnail to the user. After determining the starting position and the ending position for playback, the user can send a control instruction for content playback to the sending-end device through the control interface, wherein the control instruction comprises the starting position information and the ending position information which are currently selected by the user for playback.
Step S106, responding to a second control instruction of the target object detected on the control interface, controlling the sending end equipment to determine a second data stream to be played back, and sending the second data stream to be played back to the receiving end equipment.
The second control instruction of the target object refers to a request that a user requests playback and watching of a video in a certain time period, which is sent by the sending end device through the receiving end device. A certain period of time means that the time at which playback of the viewed video starts and ends is known, i.e. the second control command differs from the first control command in that the second control command contains more information that tells the sending device which video piece the user wants to play back in particular, whereas the first control command just tells the sending device that playback of the video is required.
In some embodiments of the present application, in response to a second control instruction of the target object detected at the control interface, controlling the sending-end device to determine the second data stream to be played back may be implemented as follows: the method comprises the steps of firstly receiving a target object, namely a user, from a second control instruction sent by a source end device, obtaining start information and end information of a second data stream to be played back, which are contained in the second control instruction, and then controlling a sending end device to determine the second data stream to be played back from the first data stream to be played back according to the start information and the end information.
In some embodiments of the application, after sending the second data stream to be played back to the receiving end device, the source end device further needs to receive playback completion information from the sending end device and display the playback completion information, and then the sending end device responds to a third control instruction of the source end device to continue to acquire the multimedia data stream, or to re-determine a third data stream to be played back.
The third control instruction refers to a control instruction sent to the sending-end device by the user after the playback is finished. Specifically, the instruction is an instruction that the user requires the sending-end device to continue to acquire the audio/video stream or to play back again.
The third data stream to be played back refers to the audio and video stream which the user requires to play back again after the playback is finished. It should be noted that the third data stream to be played back may be different from the second data stream to be played back, that is, the user may freely select the audio/video stream that is desired to be played back again, including selecting a start point and an end point of the played audio/video stream, or selecting to play back the second data stream to be played back again.
Wherein, responding to a third control instruction of the target object, controlling the sending end device to continue to collect the multimedia data stream, or re-determining a third data stream to be played back, specifically comprising: if the third control instruction indicates that playback is not needed again, controlling the sending end equipment to continue to collect the multimedia data stream; and if the third control instruction indicates that playback needs to be performed again, displaying the control interface again, acquiring the start information and the end information of a third data stream to be played back, which are contained in the third control instruction, controlling the sending end equipment to select the third data stream to be played back from the first data stream to be played back according to the start information and the end information, and sending the third data stream to the receiving end equipment.
In some embodiments of the present application, the sending end device sends the preset multimedia data to the receiving end device in the process of determining the second data stream to be played back and in the process of determining the third data stream to be played back. That is, the transmitting end device transmits the preset multimedia data to the receiving end device during a period of time in which the content is ready to be played back. The purpose of this is: in the process that a user at a sending end selects playback content, the sending end temporarily stops image acquisition, and a receiving end device cannot receive pictures temporarily, under the condition, in order to prevent the user at the receiving end device from feeling video blocking or interruption and failure, preset multimedia data needs to be sent to the receiving end device to prompt the user at the receiving end device, and the user at the sending end selects the content to be played back.
For ease of understanding, the above steps are described below with reference to a specific example.
When a user sends a control instruction for content playback to a sending end device through a control interface, the sending end device controls the sending end device to play back audio and video streams between an initial position and an end position to each receiving end device according to initial position information and end position information for playback contained in the control instruction;
specifically, when the sending end device receives a control instruction for content playback input by a user through a control interface, the sending end device temporarily interrupts audio and video stream acquisition, simultaneously acquires information of the audio and video stream cached on the current sending end device from the sending end device, forms a control interface according to the acquired information of the audio and video stream and a preset display rule, and displays the formed control interface to the user;
in actual implementation, a user can initiate a control instruction for content playback through a specific shortcut combination key, a sending end device receiving the control instruction directly controls a receiving end device to temporarily interrupt current audio/video stream acquisition, and simultaneously notifies the receiving end device to report information of the audio/video stream to be played back to the sending end device, and after receiving the information of the audio/video stream reported by the receiving end device, the sending end device forms a display interface according to a preset display rule and displays the display interface through the source end device. The information of the audio-video stream includes but is not limited to: the time length, format and size of the audio and video stream, and the acquisition start time and acquisition end time of the audio and video stream.
It should be noted that the specific shortcut combination key can be set by the user of the source.
Specifically, after receiving a control message of a source device, a sending device reads an audio/video stream from a start position of playback until an end position of playback is finished, encodes the obtained audio/video stream, and sends the encoded audio/video stream to each receiving end.
After finishing content playback between the current starting position and the ending position, the sending end device sends a notification message of completion of playback to the source end device, and the source end device displays the notification message of completion of playback to a user through a current display interface and provides options for the user to select to continue playback or start audio and video stream acquisition; and processing according to the user's selection.
Specifically, if the user selects to continue playback, the control interface for content playback is displayed again for the user to operate; and if the user selects to start the audio and video stream acquisition, the sending end restarts the audio and video stream acquisition process, acquires the desktop image of the current source end equipment in real time, acquires the audio information input by the user through the audio input port and generates the audio and video stream. When audio and video stream collection is carried out again, if the current collection mode is a pure collection mode, the sending end does not need to locally cache the collected audio and video stream; if the current acquisition mode is an acquisition-while-storage mode, the transmitting end needs to cache the acquired audio and video stream in the local storage module.
When the user selects to continue playback, the user may directly select content to be played back before playback, or may select new content to be played back.
In the process of content playback control by a user, the acquisition at the sending end is temporarily interrupted, and the sending of the picture to the receiving end is also stopped, in this case, in order to avoid the feeling of picture interruption of the receiving end user, preferably, a system preset picture can be continuously sent to the receiving end by the sending end, and the preset picture can be any picture, for example, a reminding picture for reminding the receiving end user of currently performing content playback operation, or advertisement and other propaganda information.
In addition, as shown in fig. 4, the control instruction, the data stream, and the like described in the present application may all be transmitted between the sending end device and the receiving end device through the network.
Fig. 2 is another data transmission method according to an embodiment of the present application, as shown in fig. 2, the method includes the following steps:
step S202, collecting multimedia data stream of a source end device and caching to obtain a first data stream to be played back, and sending the multimedia data stream to a receiving end device;
in some embodiments of the present application, before acquiring a multimedia data stream of a source device and caching the multimedia data stream, and obtaining a first data stream to be played back, whether to cache the acquired multimedia data stream may be determined according to a preset data acquisition mode, and all cached multimedia data streams are used as the first data stream to be played back, where the data acquisition mode at least includes one of: and (4) acquiring a cache mode while acquiring a non-cache mode.
Specifically, the above-mentioned mode of collecting and caching at the same time refers to that multimedia data is cached locally while collecting the multimedia data, and the mode of collecting and caching only refers to that multimedia data is not cached locally while collecting the multimedia data.
When the mode of caching and collecting is selected, the sending end device collects desktop images of the source end device, collects audio input from an audio input port of the source end device, collects the collected data into audio and video streams, encodes the multimedia data streams and sends the encoded multimedia data streams to the receiving end device while the multimedia data streams are cached locally, and the multimedia data streams are decoded and played by the receiving end device.
When the mode of only collecting and not caching is selected, the sending end equipment does not automatically cache the collected multimedia data stream in the local part while collecting the collected multimedia data stream, but allows a user to send an instruction, and the sending end equipment is required to start caching the multimedia data stream at any time point in the transmission process of the multimedia data stream.
In addition, the source device buffers the multimedia data stream, and also buffers the duration, format, size, acquisition start time and acquisition end time of the multimedia data stream.
Step S204, responding to a first control instruction from the source end equipment, stopping collecting the multimedia data stream of the source end equipment, and feeding back the first data stream information to be played back to the source end equipment;
the first control instruction here refers to an instruction that the user requests to stop collecting the multimedia data stream of the source device.
Step S206, in response to the second control instruction from the source device, determines a second data stream to be played back from the first data stream to be played back, and sends the second data stream to the receiving device.
Wherein, the second control instruction refers to a requirement that a user sends out a requirement for playing back a video of a certain time period through the source device. A certain determined period of time means that the time at which the video to be played back starts and ends is known, i.e. the second control instruction differs from the first control instruction in that the second control instruction contains more information, including which video the user specifically wants to play back, whereas the first control instruction only tells that playback of the video is required.
In some embodiments of the present application, determining a second data stream to be played back from the first data stream to be played back in response to a second control instruction from the source device may be implemented by: the method comprises the steps of firstly receiving a second control instruction from a source end device, obtaining start information and end information of a second data stream to be played back, wherein the start information and the end information of the second data stream to be played back are contained in the second control instruction, and then selecting the second data stream to be played back from a first data stream to be played back according to the start information and the end information.
In some embodiments of the present application, after responding to a second control instruction from the source device, determining a second data stream to be played back from the first data stream to be played back, and sending the second data stream to the receiving device, the receiving device may also feed back playback completion information to the source device, and respond to a third control instruction from the source device; and if the third control instruction indicates that playback is not needed again, continuing to acquire the multimedia data stream of the source end device, if the third control instruction indicates that playback is needed again, displaying the control interface again, acquiring the start information and the end information of the third data stream to be played back, which are contained in the third control instruction, selecting the third data stream to be played back from the first data stream to be played back according to the start information and the end information, and sending the third data stream to the receiving end device.
Fig. 3 is a data transmission system according to an embodiment of the present application, and as shown in fig. 3, the system includes the following devices:
the source device 30 is configured to provide a multimedia data stream, receive a control instruction of a target object, and control a sending end device to execute a corresponding operation; the sending end device 32 is configured to collect a multimedia data stream of the source end device, determine a multimedia data stream to be played back according to a control instruction from the source end device, and send the multimedia data stream to the receiving end device; the receiving end device 34 is configured to receive the multimedia data stream from the sending end device, decode the multimedia data stream, and transmit the decoded multimedia data stream to the display device; a display device 36 for displaying the multimedia data stream from the receiving end device.
According to an embodiment of the present application, there is also provided a non-volatile storage medium including a stored program, wherein, when the program is executed, a device in which the non-volatile storage medium is controlled to execute the method.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present application, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims (13)

1. A method of data transmission, comprising:
responding to a first control instruction of a target object, controlling sending end equipment to stop acquiring multimedia data streams, and acquiring information of a first data stream to be played back cached by the sending end equipment;
generating a control interface according to the information of the first data stream to be played back and displaying the control interface;
and responding to a second control instruction of the target object detected on the control interface, controlling the sending end equipment to determine a second data stream to be played back, and sending the second data stream to be played back to the receiving end equipment, wherein the second data stream to be played back is determined from the first data stream to be played back according to the second control instruction.
2. The method according to claim 1, wherein before obtaining the information of the first data stream to be played back buffered by the sending end device, the method further comprises:
controlling the sending end device to determine whether to cache the acquired multimedia data stream according to a preset data acquisition mode, and taking all cached multimedia data streams as the first data stream to be played back, wherein the data acquisition mode at least comprises one of the following modes: and (4) acquiring a cache mode while acquiring a non-cache mode.
3. The method of claim 2, wherein obtaining the information of the first data stream to be played back buffered by the sending end device comprises:
acquiring basic information of the first data stream to be played back, wherein the basic information comprises: the duration, format, size, acquisition start time and acquisition end time of the first data stream to be played back.
4. The method of claim 3, wherein controlling the sender device to determine a second data stream to be played back in response to a second control command of the target object detected at the control interface comprises:
receiving the second control instruction of the target object, acquiring the start information and the end information of the second data stream to be played back, which are contained in the second control instruction, and controlling the sending end device to determine the second data stream to be played back from the first data stream to be played back according to the start information and the end information.
5. The method according to claim 1, wherein after the second data stream to be played back is transmitted to a receiving end device, the method further comprises:
receiving playback completion information from the sending terminal equipment and displaying the playback completion information;
and responding to a third control instruction of the target object, and controlling the sending end equipment to continue to acquire the multimedia data stream or to re-determine a third data stream to be played back.
6. The method of claim 5, wherein controlling the sending-end device to continue to collect the multimedia data stream or to re-determine a third data stream to be played back in response to a third control instruction of the target object comprises:
if the third control instruction indicates that playback is not needed again, controlling the sending end equipment to continue to collect the multimedia data stream;
if the third control instruction indicates that playback needs to be performed again, displaying the control interface again, acquiring start information and end information of the third data stream to be played back, which are contained in the third control instruction, controlling the sending end device to select the third data stream to be played back from the first data stream to be played back according to the start information and the end information, and sending the third data stream to the receiving end device.
7. The method according to claim 6, wherein the sending end device is controlled to send preset multimedia data to the receiving end device during the determination of the second data stream to be played back and during the determination of the third data stream to be played back.
8. A method of data transmission, comprising:
acquiring a multimedia data stream of a source end device, caching the multimedia data stream to obtain a first data stream to be played back, and sending the multimedia data stream to a receiving end device;
responding to a first control instruction from the source end equipment, stopping collecting the multimedia data stream of the source end equipment, and feeding back the first data stream information to be played back to the source end equipment;
and responding to a second control instruction from the source end equipment, determining a second data stream to be played back from the first data stream to be played back, and sending the second data stream to the receiving end equipment.
9. The method of claim 8, wherein acquiring and buffering the multimedia data stream of the source device to obtain the first data stream to be played back comprises:
determining whether the collected multimedia data stream is cached or not according to a preset data collection mode, and taking all cached multimedia data streams as the first data stream to be played back, wherein the data collection mode at least comprises one of the following modes: and (4) acquiring a cache mode while acquiring a non-cache mode.
10. The method of claim 9, wherein determining a second data stream to be played back from the first data stream to be played back in response to a second control instruction from the source device comprises:
receiving the second control instruction from the source end device, acquiring start information and end information of the second data stream to be played back, which are included in the second control instruction, and selecting the second data stream to be played back from the first data stream to be played back according to the start information and the end information.
11. The method of claim 10, wherein after determining a second data stream to be played back from the first data stream to be played back in response to a second control command from the source device, and sending the second data stream to the sink device, the method further comprises:
feeding back playback completion information to the source end equipment, and responding to a third control instruction from the source end equipment;
if the third control instruction indicates that playback is not needed again, continuing to acquire the multimedia data stream of the source end device;
if the third control instruction indicates that playback needs to be performed again, displaying the control interface again, acquiring starting information and ending information of a third data stream to be played back, which are contained in the third control instruction, selecting the third data stream to be played back from the first data stream to be played back according to the starting information and the ending information, and sending the third data stream to be played back to the receiving end device.
12. A data transmission system, comprising:
the source end device is used for providing multimedia data stream, receiving a control instruction of a target object and controlling the sending end device to execute corresponding operation;
the sending end equipment is used for acquiring the multimedia data stream of the source end equipment, determining the multimedia data stream to be played back according to a control instruction from the source end equipment, and sending the multimedia data stream to the receiving end equipment;
the receiving end equipment is used for receiving the multimedia data stream from the sending end equipment, decoding the multimedia data stream and transmitting the decoded multimedia data stream to the display equipment;
and the display equipment is used for displaying the multimedia data stream from the receiving end equipment.
13. A non-volatile storage medium, comprising a stored program, wherein when the program runs, a device in which the non-volatile storage medium is located is controlled to execute the data transmission method according to any one of claims 1 to 11.
CN202110179471.3A 2021-02-09 2021-02-09 Data transmission method, system and non-volatile storage medium Active CN112954483B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110179471.3A CN112954483B (en) 2021-02-09 2021-02-09 Data transmission method, system and non-volatile storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110179471.3A CN112954483B (en) 2021-02-09 2021-02-09 Data transmission method, system and non-volatile storage medium

Publications (2)

Publication Number Publication Date
CN112954483A true CN112954483A (en) 2021-06-11
CN112954483B CN112954483B (en) 2024-02-02

Family

ID=76244913

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110179471.3A Active CN112954483B (en) 2021-02-09 2021-02-09 Data transmission method, system and non-volatile storage medium

Country Status (1)

Country Link
CN (1) CN112954483B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070201815A1 (en) * 2006-01-06 2007-08-30 Christopher Griffin Digital video editing system
CN107046631A (en) * 2017-03-28 2017-08-15 深圳广世创科技有限公司 A kind of method and system that can be encoded 2 roads simultaneously and be demonstrated with many people's wireless session rooms of streaming media
CN108668163A (en) * 2018-05-03 2018-10-16 广州虎牙信息科技有限公司 Live play method, apparatus, computer readable storage medium and computer equipment
CN108900855A (en) * 2018-07-12 2018-11-27 腾讯科技(深圳)有限公司 live content recording method and device
CN109151594A (en) * 2018-09-27 2019-01-04 广州虎牙信息科技有限公司 Direct playing and playback video broadcasting method, device and electronic equipment
CN109842804A (en) * 2017-11-24 2019-06-04 腾讯科技(深圳)有限公司 Processing method and server, the computer storage medium of audio, video data
WO2020089582A1 (en) * 2018-10-31 2020-05-07 Sony Interactive Entertainment Inc. Apparatus and method of video playback
CN111565334A (en) * 2020-04-30 2020-08-21 广州酷狗计算机科技有限公司 Live broadcast playback method, device, terminal, server and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070201815A1 (en) * 2006-01-06 2007-08-30 Christopher Griffin Digital video editing system
CN107046631A (en) * 2017-03-28 2017-08-15 深圳广世创科技有限公司 A kind of method and system that can be encoded 2 roads simultaneously and be demonstrated with many people's wireless session rooms of streaming media
CN109842804A (en) * 2017-11-24 2019-06-04 腾讯科技(深圳)有限公司 Processing method and server, the computer storage medium of audio, video data
CN108668163A (en) * 2018-05-03 2018-10-16 广州虎牙信息科技有限公司 Live play method, apparatus, computer readable storage medium and computer equipment
CN108900855A (en) * 2018-07-12 2018-11-27 腾讯科技(深圳)有限公司 live content recording method and device
CN109151594A (en) * 2018-09-27 2019-01-04 广州虎牙信息科技有限公司 Direct playing and playback video broadcasting method, device and electronic equipment
WO2020089582A1 (en) * 2018-10-31 2020-05-07 Sony Interactive Entertainment Inc. Apparatus and method of video playback
CN111565334A (en) * 2020-04-30 2020-08-21 广州酷狗计算机科技有限公司 Live broadcast playback method, device, terminal, server and storage medium

Also Published As

Publication number Publication date
CN112954483B (en) 2024-02-02

Similar Documents

Publication Publication Date Title
US8074244B2 (en) Receiving apparatus and method
TWI523535B (en) Techniuqes to consume content and metadata
CN103190092B (en) System and method for the synchronized playback of streaming digital content
KR20150082949A (en) Method for screen mirroring and apparatus thereof
JP2006503384A (en) Multimedia content service system and method based on user preference and recording medium thereof
TW201327202A (en) Cooperative provision of personalized user functions using shared and personal devices
WO2021204139A1 (en) Video displaying method, device, equipment, and storage medium
WO2017080175A1 (en) Multi-camera used video player, playing system and playing method
JP2018521550A (en) Method, client and computer storage medium for playing video
CN108810580B (en) Media content pushing method and device
CN112055227B (en) Cloud game interaction method, system, device, storage medium and electronic equipment
CN114143600A (en) Live broadcast picture adjusting method, device, equipment and storage medium
JP2024048339A (en) Server, terminal and computer program
JP2009194767A (en) Device and method for video evaluation, and video providing device
CN112954483B (en) Data transmission method, system and non-volatile storage medium
KR102139331B1 (en) Apparatus, server, and method for playing moving picture contents
GB2331832A (en) An interactive method for editing images and their subsequent play back.
CN114051150A (en) Live broadcast method and device, electronic equipment and computer readable storage medium
CN113141480A (en) Screen recording method, device, equipment and storage medium
JP6647131B2 (en) Distribution device and program
JP2020109895A (en) Video distribution system
JP2009049510A (en) Still image extracting device, and still image extracting program
JPWO2019188485A1 (en) Information processing equipment, information processing equipment and programs
KR20190061734A (en) Apparatus and method for providing moving picture contents
JP2005295343A (en) Television broadcast complementation system, terminal, television broadcast complementation method, and computer program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant