CN112954483B - Data transmission method, system and non-volatile storage medium - Google Patents
Data transmission method, system and non-volatile storage medium Download PDFInfo
- Publication number
- CN112954483B CN112954483B CN202110179471.3A CN202110179471A CN112954483B CN 112954483 B CN112954483 B CN 112954483B CN 202110179471 A CN202110179471 A CN 202110179471A CN 112954483 B CN112954483 B CN 112954483B
- Authority
- CN
- China
- Prior art keywords
- data stream
- played back
- control instruction
- multimedia data
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000005540 biological transmission Effects 0.000 title claims abstract description 36
- 230000004044 response Effects 0.000 claims description 16
- 230000008569 process Effects 0.000 claims description 11
- 239000000872 buffer Substances 0.000 claims description 5
- 230000003139 buffering effect Effects 0.000 description 11
- 238000013480 data collection Methods 0.000 description 6
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
- H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application discloses a data transmission method, a data transmission system and a nonvolatile storage medium. Wherein the method comprises the following steps: responding to a first control instruction of the target object, controlling the sending end equipment to stop acquiring the multimedia data stream, and acquiring the information of the first data stream to be played back, which is cached by the sending end equipment; generating a control interface according to the information of the first data stream to be played back and displaying the control interface; and responding to a second control instruction of the target object detected at the control interface, controlling the transmitting end equipment to determine a second data stream to be played back, and transmitting the second data stream to be played back to the receiving end equipment, wherein the second data stream to be played back is determined from the first data stream to be played back according to the second control instruction. The method and the device solve the technical problem that the transmitted and displayed picture cannot be reproduced in the image transmission process, so that the user is inconvenient to use.
Description
Technical Field
The present invention relates to the field of remote image transmission technologies, and in particular, to a data transmission method, system, and non-volatile storage medium.
Background
In order to realize remote image transmission, a source device (remote computing device) is generally connected with a transmitting device, the transmitting device is used for collecting a desktop image of the source device, compressing and encoding the image, then sending the obtained code stream to a receiving device in real time through a network, and after receiving the code stream sent by the transmitting device, the receiving device decodes and sends the code stream to a display device for display.
The existing image transmission system generally performs real-time image acquisition and transmission, and is suitable for video transmission scenes with real-time performance, such as video conferences and the like. However, in this scenario, since the video capturing of the transmitting end device is real-time, and the display of the receiving end device is also real-time, the captured and played image is not reproduced, and in some special scenarios, such as remote teaching or network training scenarios, this approach is inconvenient. For example, if it is not clear that the content that the receiving end user talks to is heard, the presenter, that is, the sending end user, needs to repeat the previously spoken content again, and after the talkback, needs to return to the current page again to continue the rest of the course content.
In view of the above problems, no effective solution has been proposed at present.
Disclosure of Invention
The embodiment of the application provides a data transmission method, a data transmission system and a nonvolatile storage medium, which at least solve the technical problem that a user is inconvenient to use because a transmitted and displayed picture cannot be reproduced in the image transmission process.
According to an aspect of the embodiments of the present application, there is provided a data transmission method, including: responding to a first control instruction of the target object, controlling the sending end equipment to stop acquiring the multimedia data stream, and acquiring the information of the first data stream to be played back, which is cached by the sending end equipment; generating a control interface according to the information of the first data stream to be played back and displaying the control interface; and responding to a second control instruction of the target object detected at the control interface, controlling the transmitting end equipment to determine a second data stream to be played back, and transmitting the second data stream to be played back to the receiving end equipment, wherein the second data stream to be played back is determined from the first data stream to be played back according to the second control instruction.
Optionally, before acquiring the information of the first data stream to be played back, which is cached by the sending end device, the method further includes: the method comprises the steps of controlling a sending terminal device to determine whether to cache collected multimedia data streams according to a preset data collection mode, and taking all the cached multimedia data streams as a first data stream to be played back, wherein the data collection mode at least comprises one of the following steps: and a cache mode is collected while only a no-cache mode is collected.
Optionally, obtaining information of the first data stream to be played back, which is cached by the sending end device, includes: basic information of a first data stream to be played back is acquired, wherein the basic information comprises: the duration, format, size, acquisition start time and acquisition end time of the first data stream to be played back.
Optionally, in response to a second control instruction of the target object detected at the control interface, controlling the sender device to determine a second data stream to be played back, including: receiving a second control instruction of the target object, acquiring starting information and ending information of a second data stream to be played back, which are contained in the second control instruction, and controlling the transmitting end equipment to determine the second data stream to be played back from the first data stream to be played back according to the starting information and the ending information.
Optionally, after the second data stream to be played back is sent to the receiving end device, the method further includes: receiving playback completion information from the transmitting end equipment and displaying the playback completion information; and responding to a third control instruction of the target object, and controlling the sending end equipment to continuously acquire the multimedia data stream or redetermine a third data stream to be played back.
Optionally, in response to a third control instruction of the target object, controlling the sending end device to continuously collect the multimedia data stream, or redetermining a third data stream to be played back, including: if the third control instruction indicates that playback is not needed again, the sending end equipment is controlled to continuously acquire the multimedia data stream; and if the third control instruction indicates that the playback is required again, displaying the control interface again, acquiring the starting information and the ending information of the third data stream to be played back contained in the third control instruction, controlling the sending end equipment to select the third data stream to be played back from the first data stream to be played back according to the starting information and the ending information, and sending the third data stream to the receiving end equipment.
Optionally, in the process of determining the second data stream to be played back and in the process of determining the third data stream to be played back, the sending end device is controlled to send the preset multimedia data to the receiving end device.
According to an aspect of the embodiments of the present application, there is also provided another data transmission method, including: collecting and caching a multimedia data stream of a source terminal device to obtain a first data stream to be played back, and simultaneously transmitting the multimedia data stream to a receiving terminal device; responding to a first control instruction from the source equipment, stopping collecting the multimedia data stream of the source equipment, and feeding back the first data stream information to be played back to the source equipment; and responding to a second control instruction from the source end device, determining a second data stream to be played back from the first data stream to be played back, and sending the second data stream to the receiving end device.
Optionally, collecting and buffering a multimedia data stream of the source device to obtain a first data stream to be played back, including: determining whether to cache the acquired multimedia data streams according to a preset data acquisition mode, and taking all the cached multimedia data streams as a first data stream to be played back, wherein the data acquisition mode at least comprises one of the following steps: and a cache mode is collected while only a no-cache mode is collected.
Optionally, in response to a second control instruction from the source device, determining a second data stream to be played back from the first data stream to be played back includes:
and receiving a second control instruction from the source terminal equipment, acquiring starting information and ending information of a second data stream to be played back, which are contained in the second control instruction, and selecting the second data stream to be played back from the first data stream to be played back according to the starting information and the ending information.
Optionally, after determining the second data stream to be played back from the first data stream to be played back in response to the second control instruction from the source device, and sending the second data stream to the receiving device, the method further includes: feeding back playback completion information to the source device, and responding to a third control instruction from the source device; if the third control instruction indicates that playback is not needed again, continuing to acquire the multimedia data stream of the source terminal equipment; and if the third control instruction indicates that the playback is required again, displaying the control interface again, acquiring the starting information and the ending information of the third data stream to be played back contained in the third control instruction, selecting the third data stream to be played back from the first data stream to be played back according to the starting information and the ending information, and sending the third data stream to be played back to the receiving end equipment.
According to another aspect of the embodiments of the present application, there is also provided a data transmission system, including: the source terminal equipment is used for providing a multimedia data stream, receiving a control instruction of a target object and controlling the transmitting terminal equipment to execute corresponding operation; the sending end equipment is used for collecting the multimedia data stream of the source end equipment, determining the multimedia data stream to be played back according to the control instruction from the source end equipment and sending the multimedia data stream to the receiving end equipment; the receiving end equipment is used for receiving the multimedia data stream from the transmitting end equipment, decoding the multimedia data stream and transmitting the decoded multimedia data stream to the display equipment; and the display device is used for displaying the multimedia data stream from the receiving end device.
According to still another aspect of the present application, there is provided a nonvolatile storage medium including a stored program, wherein the device in which the nonvolatile storage medium is controlled to execute the above data transmission method when the program runs.
In the embodiment of the application, a first control instruction responding to a target object is adopted to control a sending end device to stop acquiring the multimedia data stream, and information of a first data stream to be played back cached by the sending end device is acquired; generating a control interface according to the information of the first data stream to be played back and displaying the control interface; and responding to a second control instruction of the target object detected at the control interface, controlling the transmitting end equipment to determine a second data stream to be played back, and transmitting the second data stream to be played back to the receiving end equipment, so that the aim of reproducing the transmitted and displayed picture is fulfilled, the technical effect of reproducing the transmitted and displayed picture in the image transmission process is fulfilled, and the technical problem that the transmitted and displayed picture cannot be reproduced in the image transmission process, and the user is inconvenient to use is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:
FIG. 1 is a flow chart of an alternative data transmission method according to an embodiment of the present application;
FIG. 2 is a flow chart of another alternative data transmission method according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of an alternative data transmission system according to an embodiment of the present application;
fig. 4 is a system schematic diagram of a data transmission manner according to an embodiment of the present application.
Detailed Description
In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Detailed Description
According to the embodiments of the present application, there is provided a method embodiment of a data transmission method, it should be noted that the steps illustrated in the flowcharts of the drawings may be performed in a computer system such as a set of computer executable instructions, and that although a logical order is illustrated in the flowcharts, in some cases the steps illustrated or described may be performed in an order different from that herein.
Fig. 1 is a data transmission method according to an embodiment of the present application, as shown in fig. 1, the method includes the following steps:
step S102, responding to a first control instruction of a target object, controlling a transmitting terminal device to stop acquiring the multimedia data stream, and acquiring information of a first data stream to be played back, which is cached by the transmitting terminal device;
the target object may be a user at a source device, specifically, a presenter in a network video conference, a teacher in an online live course, or a presenter, where the first control instruction refers to an instruction sent by the user through other external input devices, such as a keyboard, a mouse, a touch pad, or a voice control device, to request to play back video and audio content that has been played back, that is, a first data stream to be played back;
in addition, the sending end device caches the multimedia data stream and also caches the duration, format, size, acquisition starting time and acquisition ending time of the multimedia data stream.
In some embodiments of the present application, before obtaining information of a first data stream to be played back buffered by a transmitting end device, the transmitting end device needs to be controlled to determine whether to buffer the buffered multimedia data stream according to a preset data collection mode, and all buffered multimedia data streams are used as the first data stream to be played back, where the data collection mode at least includes one of the following: and a cache mode is collected while only a no-cache mode is collected.
Specifically, the above-mentioned mode of collecting and buffering at the same time refers to that the transmitting end device collects multimedia data and buffers the multimedia data locally, and the mode of collecting only no buffering refers to that the multimedia data is not buffered locally while the multimedia data is collected.
When the mode of buffering and collecting is selected, the transmitting end device collects desktop images of the source end device, collects audio input from an audio input port of the source end device, gathers collected data into audio and video streams, and encodes and transmits the multimedia data streams to the receiving end device while buffering the obtained audio and video streams, namely the multimedia data streams locally, and the receiving end device decodes and plays the encoded multimedia data streams.
It should be noted that, the source device in the present application may be a computer, a smart phone, a tablet computer, a smart television, or an electronic product that may be connected to the internet and interact with other devices connected to the internet.
When the mode of only collecting and not caching is selected, the sending end device can not automatically cache the collected multimedia data stream locally while collecting the multimedia data stream, but allows a user to send out an instruction, and at any time point in the transmission process of the multimedia data stream, the sending end device is required to start caching the multimedia data stream.
Step S104, generating a control interface according to the information of the first data stream to be played back and displaying the control interface;
the source device connected with the sending device can generate a control interface which is convenient for the user to play back the content on the basis of the basic information of the multimedia data stream in the first data stream to be played back, which is locally cached by the sending device, for example, the control interface can comprise a time axis, the user of the source device can watch the thumbnail of the video picture in the multimedia data stream on the time node corresponding to the current position of the cursor by moving the cursor on the time axis, and thus, the user can quickly position the starting position and the ending position of the user which want to play back by moving and looking at the thumbnail on the time axis.
The implementation mode of the process is as follows: the source terminal equipment receives time node information sent by a user through moving a cursor on a time axis; and acquiring pictures on the corresponding time nodes from the transmitting end equipment, generating the thumbnail and then displaying the thumbnail to a user. After the user determines the starting position and the ending position for playback, a control instruction for playing back the content can be sent to the sending end device through the control interface, wherein the control instruction comprises the starting position information and the ending position information for playing back selected by the user currently.
Step S106, the sending end device is controlled to determine a second data stream to be played back in response to the second control instruction of the target object detected at the control interface, and the second data stream to be played back is sent to the receiving end device.
The second control instruction of the target object refers to a requirement that a user requests to play back a video watched for a certain time period, which is sent by the sending end equipment through the receiving end equipment. A certain period of time refers to that the time when the video to be played back is started and ended is known, that is, the second control instruction differs from the first control instruction in that the second control instruction contains more information, which tells the sender device what video the user wants to play back in particular, and the first control instruction just tells the sender device what video to play back.
In some embodiments of the present application, in response to a second control instruction of the target object detected at the control interface, the control sender device determines the second data stream to be played back, which may be implemented by: firstly, a target object, namely a user, sends a second control instruction from a source terminal device, acquires starting information and ending information of a second data stream to be played back, which are contained in the second control instruction, and then controls a sending terminal device to determine the second data stream to be played back from the first data stream to be played back according to the starting information and the ending information.
In some embodiments of the present application, after the second data stream to be played back is sent to the receiving end device, the source end device further needs to receive playback completion information from the sending end device and display the playback completion information, and then the sending end device responds to a third control instruction of the source end device to continue to collect the multimedia data stream, or to redetermine the third data stream to be played back.
The third control instruction refers to a control instruction sent to the sending end device by the user after playback is finished. Specifically, the user requests the sender device to continue to collect the audio/video stream or play back again.
The third data stream to be played back refers to an audio/video stream that the user requires to play back again after playback is completed. It should be noted that the third data stream to be played back may be different from the second data stream to be played back, that is, the user may freely select the audio/video stream to be played back again, including selecting the start point and the end point of the audio/video stream to be played back, or selecting to play back the second data stream to be played back again.
The method for controlling the sending terminal equipment to continuously collect the multimedia data stream or re-determine the third data stream to be played back specifically includes the following steps: if the third control instruction indicates that playback is not needed again, the sending end equipment is controlled to continuously acquire the multimedia data stream; and if the third control instruction indicates that the playback is required again, displaying the control interface again, acquiring the starting information and the ending information of the third data stream to be played back contained in the third control instruction, controlling the sending end equipment to select the third data stream to be played back from the first data stream to be played back according to the starting information and the ending information, and sending the third data stream to the receiving end equipment.
In some embodiments of the present application, the transmitting device may send the preset multimedia data to the receiving device during the process of determining the second data stream to be played back and during the process of determining the third data stream to be played back. That is, the transmitting-end device transmits preset multimedia data to the receiving-end device during a period of time in which the content is ready to be played back. The purpose of this is to: in the process that the sending end user selects to play back the content, the sending end temporarily stops image acquisition, and the receiving end device can not receive the picture temporarily, in this case, in order to prevent the user of the receiving end device from having the feeling of video clip or interruption or failure, preset multimedia data needs to be sent to the receiving end device to prompt the user of the receiving end device, and the sending end user is selecting the content to be played back.
For ease of understanding, the steps described above are described below in connection with one specific example.
When a user sends a control instruction for playing back the content to the sending end equipment through a control interface, the sending end equipment controls the sending end equipment to play back the audio and video streams between the starting position and the ending position of each receiving end equipment according to the starting position information and the ending position information for playing back, which are contained in the control instruction;
specifically, when receiving a control instruction for playing back content, which is input by a user through a control interface, the transmitting end equipment temporarily interrupts audio and video stream acquisition, acquires information of an audio and video stream cached on the current transmitting end equipment from the transmitting end equipment, forms the control interface according to the acquired information of the audio and video stream and a preset display rule, and displays the formed control interface to the user;
in actual implementation, a user can initiate a control instruction for playing back content through a specific shortcut combination key, and a transmitting end device receiving the control instruction directly controls a receiving end device to temporarily interrupt current audio and video stream acquisition, and meanwhile informs the receiving end device to report information of an audio and video stream to be played back to the transmitting end device, and after receiving the information of the audio and video stream reported by the receiving end device, the transmitting end device forms a display interface according to a preset display rule and displays the display interface through a source end device. The information of the audio/video stream includes, but is not limited to: the duration, format, size, acquisition start time and acquisition end time of the audio and video stream.
It should be noted that, the specific shortcut combination key may be set by the user at the source end.
Specifically, after receiving the control message of the source device, the transmitting device starts to read the audio and video stream from the starting position for playback until the ending position is finished, encodes the obtained audio and video stream, and transmits the encoded audio and video stream to each receiving end.
After the sending end equipment finishes the content playback between the current starting position and the ending position, sending a notification message of the completion of the playback to the source end equipment, and displaying the notification message of the completion of the playback to a user through a current display interface by the source end equipment, and providing options for the user to select whether to continue the playback or start the acquisition of the audio and video streams; and processing according to the user's selection.
Specifically, if the user selects to continue playback, a control interface for content playback is displayed again for the user to operate; if the user selects to start the audio and video stream acquisition, the transmitting end restarts the audio and video stream acquisition flow, acquires the desktop image of the current source end device in real time and acquires the audio information input by the user through the audio input port, and generates an audio and video stream. When the audio and video stream is acquired again, if the current acquisition mode is a pure acquisition mode, the transmitting end does not need to locally cache the acquired audio and video stream; if the current acquisition mode is the acquisition-while-storage mode, the transmitting end needs to buffer the acquired audio and video stream in the local storage module.
When the user selects to continue playback, the content to be played back before playback may be selected directly, or new content may be selected to be played back.
In the process of content playback control by the user, the acquisition of the transmitting end is temporarily interrupted, and the transmission of the picture to the receiving end is stopped, in this case, in order to avoid the feeling of picture interruption of the receiving end user, preferably, a preset picture of the system may be continuously transmitted to the receiving end by the transmitting end, where the preset picture may be any picture, for example, may be a reminding picture for reminding the receiving end user that the content playback operation is currently being performed, or an advertisement and other propaganda information, etc.
In addition, as shown in fig. 4, the control instruction, the data stream, and the like described in the present application may be transmitted between the transmitting end device and the receiving end device through the network.
Fig. 2 is another data transmission method according to an embodiment of the present application, as shown in fig. 2, the method includes the following steps:
step S202, collecting and caching a multimedia data stream of a source terminal device to obtain a first data stream to be played back, and simultaneously transmitting the multimedia data stream to a receiving terminal device;
in some embodiments of the present application, before the multimedia data stream of the source device is collected and buffered to obtain the first data stream to be played back, whether to buffer the collected multimedia data stream is further determined according to a preset data collection mode, and all the buffered multimedia data streams are used as the first data stream to be played back, where the data collection mode at least includes one of the following: and a cache mode is collected while only a no-cache mode is collected.
Specifically, the above-mentioned mode of collecting and buffering at the same time of collecting multimedia data refers to buffering the multimedia data locally, and the mode of collecting only no buffering refers to not buffering the multimedia data locally while collecting the multimedia data.
When the mode of buffering and collecting is selected, the transmitting end device collects desktop images of the source end device, collects audio input from an audio input port of the source end device, gathers collected data into audio and video streams, and encodes and transmits the multimedia data streams to the receiving end device while buffering the obtained audio and video streams, namely the multimedia data streams locally, and the receiving end device decodes and plays the encoded multimedia data streams.
When the mode of only collecting and not caching is selected, the sending end device can not automatically cache the collected multimedia data stream locally while collecting the multimedia data stream, but allows a user to send out an instruction, and at any time point in the transmission process of the multimedia data stream, the sending end device is required to start caching the multimedia data stream.
In addition, the source device caches the multimedia data stream and also caches the duration, format, size, acquisition start time and acquisition end time of the multimedia data stream.
Step S204, responding to a first control instruction from the source equipment, stopping collecting the multimedia data stream of the source equipment, and feeding back the first data stream information to be played back to the source equipment;
the first control instruction here refers to an instruction that the user requires to stop collecting the multimedia data stream of the source device.
In step S206, in response to the second control instruction from the source device, a second data stream to be played back is determined from the first data stream to be played back, and is sent to the sink device.
The second control instruction refers to a requirement that a user requests to play back video of a certain time period, wherein the requirement is sent by the source equipment. A certain period of time refers to the time at which the video to be played back starts and ends being known, i.e. the second control instruction differs from the first control instruction in that the second control instruction contains more information, including which video the user specifically wants to play back, whereas the first control instruction only tells about the need to play back the video.
In some embodiments of the present application, in response to a second control instruction from the source device, determining a second data stream to be played back from the first data stream to be played back may be implemented by: firstly, a second control instruction from a source terminal device is received, starting information and ending information of a second data stream to be played back, which are contained in the second control instruction, are obtained, and then the second data stream to be played back is selected from the first data stream to be played back according to the starting information and the ending information.
In some embodiments of the present application, in response to a second control instruction from the source device, after determining a second data stream to be played back from the first data stream to be played back and sending the second data stream to the receiving device, playback completion information may also be fed back to the source device, and in response to a third control instruction from the source device; if the third control instruction indicates that playback is not needed again, continuing to acquire the multimedia data stream of the source terminal device, if the third control instruction indicates that playback is needed again, displaying the control interface again, acquiring the starting information and the ending information of the third data stream to be played back, which are contained in the third control instruction, selecting the third data stream to be played back from the first data stream to be played back according to the starting information and the ending information, and sending the third data stream to the receiving terminal device.
Fig. 3 is a data transmission system according to an embodiment of the present application, and as shown in fig. 3, the system includes the following devices:
the source device 30 is configured to provide a multimedia data stream, receive a control instruction of a target object, and control the transmitting device to perform a corresponding operation; the transmitting end device 32 is configured to collect a multimedia data stream of the source end device, determine a multimedia data stream to be played back according to a control instruction from the source end device, and send the multimedia data stream to the receiving end device; a receiving end device 34, configured to receive the multimedia data stream from the transmitting end device, decode the multimedia data stream, and transmit the decoded multimedia data stream to a display device; a display device 36 for displaying the multimedia data stream from the receiving end device.
According to an embodiment of the present application, there is further provided a nonvolatile storage medium including a stored program, where the device in which the nonvolatile storage medium is controlled to execute the above method when the program runs.
The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
In the foregoing embodiments of the present application, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed technology content may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, for example, may be a logic function division, and may be implemented in another manner, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application and are intended to be comprehended within the scope of the present application.
Claims (9)
1. A data transmission method, comprising:
the method comprises the steps of controlling a sending terminal device to determine whether to cache an acquired multimedia data stream according to a preset data acquisition mode, and taking the cached multimedia data stream as a first data stream to be played back, wherein the data acquisition mode comprises at least one of the following steps: a cache-while-acquisition mode, in which only a no-cache mode is acquired; when the data acquisition mode is an acquisition-only non-caching mode, after receiving an instruction sent by a user, the sending end equipment starts caching the multimedia data stream at any time point indicated by the instruction;
responding to a first control instruction of a target object, controlling a transmitting end device to stop acquiring a multimedia data stream, and acquiring information of a first data stream to be played back, which is cached by the transmitting end device;
generating a control interface according to the information of the first data stream to be played back and displaying the control interface;
and controlling the transmitting end device to determine a second data stream to be played back in response to a second control instruction of the target object detected at the control interface, and transmitting the second data stream to be played back to the receiving end device, wherein the transmitting end device is further configured to transmit preset multimedia data to the receiving end device in a process of determining the second data stream to be played back, the second data stream to be played back is determined from the first data stream to be played back according to the second control instruction, and controlling the transmitting end device to determine the second data stream to be played back in response to the second control instruction of the target object detected at the control interface includes: receiving the second control instruction of the target object, acquiring starting information and ending information of the second data stream to be played back, which are contained in the second control instruction, and controlling the sending end equipment to determine the second data stream to be played back from the first data stream to be played back according to the starting information and the ending information.
2. The method of claim 1, wherein obtaining information of the first data stream to be played back buffered by the sender device comprises:
obtaining basic information of the first data stream to be played back, wherein the basic information comprises: and the duration, format, size, acquisition starting time and acquisition ending time of the first data stream to be played back.
3. The method of claim 1, wherein after transmitting the second data stream to be played back to a receiving end device, the method further comprises:
receiving playback completion information from the sending end equipment and displaying the playback completion information;
and responding to a third control instruction of the target object, and controlling the sending end equipment to continuously acquire the multimedia data stream or redetermine a third data stream to be played back.
4. The method of claim 3, wherein controlling the sender device to continue to collect the multimedia data stream or to redefine a third data stream to be played back in response to a third control instruction of the target object comprises:
if the third control instruction indicates that playback is not needed again, the sending end equipment is controlled to continuously acquire the multimedia data stream;
and if the third control instruction indicates that the playback is required again, displaying the control interface again, acquiring the starting information and the ending information of the third data stream to be played back, which are contained in the third control instruction, controlling the sending end equipment to select the third data stream to be played back from the first data stream to be played back according to the starting information and the ending information, and sending the third data stream to be played back to the receiving end equipment.
5. The method of claim 4, wherein the transmitting-end device is controlled to transmit preset multimedia data to the receiving-end device in determining the second data stream to be played back and in determining the third data stream to be played back.
6. A data transmission method, comprising:
the method comprises the steps of collecting and caching multimedia data streams of source equipment to obtain a first data stream to be played back, simultaneously sending the multimedia data streams to receiving equipment, collecting and caching the multimedia data streams of the source equipment, and before the first data stream to be played back is obtained, the data transmission method further comprises the steps of: determining whether to cache the acquired multimedia data stream according to a preset data acquisition mode, and taking all the cached multimedia data streams as the first data stream to be played back, wherein the data acquisition mode at least comprises one of the following steps: a cache-while-acquisition mode, in which only a no-cache mode is acquired; when the data acquisition mode is an acquisition-only non-caching mode, after receiving an instruction sent by a user, the sending end equipment starts caching the multimedia data stream at any time point indicated by the instruction;
responding to a first control instruction from the source equipment, stopping collecting the multimedia data stream of the source equipment, and feeding back the first data stream information to be played back to the source equipment;
transmitting preset multimedia data to the receiving end equipment;
determining a second data stream to be played back from the first data stream to be played back in response to a second control instruction from the source device, and sending the second data stream to be played back to the receiving device, wherein determining the second data stream to be played back from the first data stream to be played back in response to the second control instruction from the source device comprises: and receiving the second control instruction from the source terminal equipment, acquiring the starting information and the ending information of the second data stream to be played back, which are contained in the second control instruction, and selecting the second data stream to be played back from the first data stream to be played back according to the starting information and the ending information.
7. The method of claim 6, wherein after determining a second data stream to be played back from the first data stream to be played back in response to a second control instruction from the source device and transmitting to the sink device, the method further comprises:
feeding back playback completion information to the source equipment, and responding to a third control instruction from the source equipment;
if the third control instruction indicates that playback is not needed again, continuing to acquire the multimedia data stream of the source terminal equipment;
and if the third control instruction indicates that the playback is required again, displaying the control interface again, acquiring the starting information and the ending information of the third data stream to be played back contained in the third control instruction, selecting the third data stream to be played back from the first data stream to be played back according to the starting information and the ending information, and sending the third data stream to be played back to the receiving end equipment.
8. A data transmission system, comprising:
the source terminal equipment is used for providing a multimedia data stream, receiving a control instruction of a target object and controlling the transmitting terminal equipment to execute corresponding operation;
the sending end device is used for collecting the multimedia data stream of the source end device, determining the multimedia data stream to be played back according to the control instruction from the source end device, and sending the multimedia data stream to the receiving end device, wherein the determining the multimedia data stream to be played back according to the control instruction from the source end device comprises: responding to a first control instruction from the source equipment, stopping collecting the multimedia data stream of the source equipment, and feeding back the first data stream information to be played back to the source equipment; receiving a second control instruction from the source terminal device, acquiring starting information and ending information of a second data stream to be played back, which are contained in the second control instruction, and selecting the second data stream to be played back from a first data stream to be played back according to the starting information and the ending information;
the sending end device is further configured to buffer the multimedia data stream to obtain a first data stream to be played back, and includes: determining whether to cache the acquired multimedia data stream according to a preset data acquisition mode, and taking all the cached multimedia data streams as the first data stream to be played back, wherein the data acquisition mode at least comprises one of the following steps: a cache-while-acquisition mode, in which only a no-cache mode is acquired; when the data acquisition mode is an acquisition-only non-caching mode, after receiving an instruction sent by a user, the sending end equipment starts caching the multimedia data stream at any time point indicated by the instruction;
the sending end device is further configured to send preset multimedia data to the receiving end device in a process of determining the second data stream to be played back;
the receiving end equipment is used for receiving the multimedia data stream from the transmitting end equipment, decoding the multimedia data stream and transmitting the decoded multimedia data stream to the display equipment;
and the display device is used for displaying the multimedia data stream from the receiving end device.
9. A non-volatile storage medium, characterized in that the non-volatile storage medium comprises a stored program, wherein the program, when run, controls a device in which the non-volatile storage medium is located to perform the data transmission method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110179471.3A CN112954483B (en) | 2021-02-09 | 2021-02-09 | Data transmission method, system and non-volatile storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110179471.3A CN112954483B (en) | 2021-02-09 | 2021-02-09 | Data transmission method, system and non-volatile storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112954483A CN112954483A (en) | 2021-06-11 |
| CN112954483B true CN112954483B (en) | 2024-02-02 |
Family
ID=76244913
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110179471.3A Active CN112954483B (en) | 2021-02-09 | 2021-02-09 | Data transmission method, system and non-volatile storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112954483B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107046631A (en) * | 2017-03-28 | 2017-08-15 | 深圳广世创科技有限公司 | A kind of method and system that can be encoded 2 roads simultaneously and be demonstrated with many people's wireless session rooms of streaming media |
| CN108668163A (en) * | 2018-05-03 | 2018-10-16 | 广州虎牙信息科技有限公司 | Live play method, apparatus, computer readable storage medium and computer equipment |
| CN108900855A (en) * | 2018-07-12 | 2018-11-27 | 腾讯科技（深圳）有限公司 | live content recording method and device |
| CN109151594A (en) * | 2018-09-27 | 2019-01-04 | 广州虎牙信息科技有限公司 | Direct playing and playback video broadcasting method, device and electronic equipment |
| CN109842804A (en) * | 2017-11-24 | 2019-06-04 | 腾讯科技（深圳）有限公司 | Processing method and server, the computer storage medium of audio, video data |
| WO2020089582A1 (en) * | 2018-10-31 | 2020-05-07 | Sony Interactive Entertainment Inc. | Apparatus and method of video playback |
| CN111565334A (en) * | 2020-04-30 | 2020-08-21 | 广州酷狗计算机科技有限公司 | Live broadcast playback method, device, terminal, server and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8228372B2 (en) * | 2006-01-06 | 2012-07-24 | Agile Sports Technologies, Inc. | Digital video editing system |
-
2021
- 2021-02-09 CN CN202110179471.3A patent/CN112954483B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107046631A (en) * | 2017-03-28 | 2017-08-15 | 深圳广世创科技有限公司 | A kind of method and system that can be encoded 2 roads simultaneously and be demonstrated with many people's wireless session rooms of streaming media |
| CN109842804A (en) * | 2017-11-24 | 2019-06-04 | 腾讯科技（深圳）有限公司 | Processing method and server, the computer storage medium of audio, video data |
| CN108668163A (en) * | 2018-05-03 | 2018-10-16 | 广州虎牙信息科技有限公司 | Live play method, apparatus, computer readable storage medium and computer equipment |
| CN108900855A (en) * | 2018-07-12 | 2018-11-27 | 腾讯科技（深圳）有限公司 | live content recording method and device |
| CN109151594A (en) * | 2018-09-27 | 2019-01-04 | 广州虎牙信息科技有限公司 | Direct playing and playback video broadcasting method, device and electronic equipment |
| WO2020089582A1 (en) * | 2018-10-31 | 2020-05-07 | Sony Interactive Entertainment Inc. | Apparatus and method of video playback |
| CN111565334A (en) * | 2020-04-30 | 2020-08-21 | 广州酷狗计算机科技有限公司 | Live broadcast playback method, device, terminal, server and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112954483A (en) | 2021-06-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9899059B2 (en) | Method of management of a multimedia program, server, terminals, signal and corresponding computer programs | |
| KR101742164B1 (en) | Facilitating placeshifting using matrix code | |
| TWI523535B (en) | Techniuqes to consume content and metadata | |
| CN103190092B (en) | System and method for the synchronized playback of streaming digital content | |
| KR20150082949A (en) | Method for screen mirroring and apparatus thereof | |
| US20100242066A1 (en) | Method of Performing Random Seek Preview for Streaming Video | |
| JPH10508171A (en) | Video on demand system | |
| CN112637661B (en) | Video stream switching method and device, computer storage medium and electronic equipment | |
| TW201327202A (en) | Cooperative provision of personalized user functions using shared and personal devices | |
| CN108810580B (en) | Media content pushing method and device | |
| CN111726657A (en) | Live video playing processing method and device and server | |
| CN113301355B (en) | Video transmission, live broadcast and playing method, equipment and storage medium | |
| CN113225585A (en) | Video definition switching method and device, electronic equipment and storage medium | |
| CN112055227B (en) | Cloud game interaction method, system, device, storage medium and electronic equipment | |
| JP5043711B2 (en) | Video evaluation apparatus and method | |
| TW200923780A (en) | System and method for remote live pause | |
| US20240107087A1 (en) | Server, terminal and non-transitory computer-readable medium | |
| JP2020524450A (en) | Transmission system for multi-channel video, control method thereof, multi-channel video reproduction method and device thereof | |
| CN112954483B (en) | Data transmission method, system and non-volatile storage medium | |
| GB2563267A (en) | Methods and systems for generating a reaction video | |
| KR102139331B1 (en) | Apparatus, server, and method for playing moving picture contents | |
| JP2020109895A (en) | Video distribution system | |
| JP2005295343A (en) | Television broadcast complementation system, terminal, television broadcast complementation method, and computer program | |
| CN113141480A (en) | Screen recording method, device, equipment and storage medium | |
| KR100499053B1 (en) | System and Method for transmitting and receiving interactive contents for low delay interactivity |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |