CN112118233B - Data transmission method, device, system and storage medium - Google Patents

Data transmission method, device, system and storage medium Download PDF

Info

Publication number
CN112118233B
CN112118233B CN202010871015.0A CN202010871015A CN112118233B CN 112118233 B CN112118233 B CN 112118233B CN 202010871015 A CN202010871015 A CN 202010871015A CN 112118233 B CN112118233 B CN 112118233B
Authority
CN
China
Prior art keywords
information
selection
display area
network flow
selection information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010871015.0A
Other languages
Chinese (zh)
Other versions
CN112118233A (en
Inventor
周肃
刘鹏
张大勇
文士杰
周清波
常俊杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Borui Weixin Technology Co ltd
Original Assignee
Beijing Borui Weixin Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Borui Weixin Technology Co ltd filed Critical Beijing Borui Weixin Technology Co ltd
Priority to CN202010871015.0A priority Critical patent/CN112118233B/en
Publication of CN112118233A publication Critical patent/CN112118233A/en
Application granted granted Critical
Publication of CN112118233B publication Critical patent/CN112118233B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/762Media network packet handling at the source 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations

Abstract

The application relates to a data transmission method, a device, a system and a storage medium, wherein the method comprises the steps of obtaining first selection information, wherein the first selection information points to window information in information source information; continuously acquiring content information in the window information; coding the continuously acquired content information to generate continuous network stream information; and sending the generated continuous network flow information through the network. The device and the system transmit data by using the method, and codes corresponding to the data transmission method are stored in a computer readable storage medium. According to the method and the device, the window content on the terminal is converted into the network stream and transmitted through the network, the dependence degree of the media fusion system on hardware is reduced, and the transmission distance of the media fusion system is increased.

Description

Data transmission method, device, system and storage medium
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data transmission method, apparatus, system, and storage medium.
Background
When the media-merging system is applied to scenes such as television stations, news centers, media and the like, a plurality of terminals are often required to be equipped for a plurality of contents to be displayed, the dependence of the method on hardware is very strong, and the transmission distance is also limited.
Disclosure of Invention
The application provides a data transmission method, a data transmission device, a data transmission system and a storage medium, window content on a terminal is converted into network stream and transmitted through a network, so that the dependence degree of a converged media system on hardware is reduced, and the transmission distance of the converged media system is increased.
The above object of the present application is achieved by the following technical solutions:
in a first aspect, the present application provides a data transmission method, including:
acquiring first selection information, wherein the first selection information points to window information in information source information;
continuously acquiring content information in the window information;
coding the continuously acquired content information to generate continuous network stream information; and
and sending the generated continuous network flow information through the network.
By adopting the technical scheme, after the window information is selected, the content information in the window information is converted into the network flow information for transmission, the network flow information is transmitted by the aid of the network equipment, the dependence degree on hardware is low, the content information can be transmitted in places with networks, and the transmission distance can be effectively increased.
In a preferred example of the first aspect, the number of the first selection information is multiple, and each first selection information points to a different window information;
and generating continuous network flow information corresponding to the window information pointed by each piece of first selection information.
By adopting the technical scheme, one information source can output a plurality of network flow information, and the dependence on hardware can be further reduced.
In a preferred example of the first aspect, the method further includes:
generating a plurality of option information according to the network flow information;
acquiring second selection information, wherein the second selection information points to option information; and
and sending out the network flow information corresponding to the option information.
By adopting the technical scheme, the generated multiple network flow information can be selectively output.
In a preferred example of the first aspect, the method further includes:
acquiring one or more pieces of display area information, wherein each piece of display area information comprises one or more pieces of sub-display area information;
acquiring third selection information, wherein the third selection information points to information of one sub-display area; and
sending the network flow information corresponding to the first selection information to display area information pointed by the third selection information;
wherein, the source of the display area information is one or more.
By adopting the technical scheme, the network flow information can be sent to the appointed display area to be displayed, and the directional transmission of the network flow information is realized.
In a preferred example of the first aspect, the method further includes:
acquiring one or more pieces of display area information, wherein each piece of display area information comprises one or more pieces of sub-display area information;
acquiring third selection information, wherein the third selection information points to information of one sub-display area; and
sending the network flow information corresponding to the second selection information to display area information pointed by third selection information;
wherein, the source of the display area information is one or more.
By adopting the technical scheme, the network flow information can be sent to the appointed display area to be displayed, and the directional transmission of the network flow information is realized.
In a preferred example of the first aspect, the states of the window information include a display state, a hidden state, an occlusion state, and a partial occlusion state.
By adopting the technical scheme, the window information and the displayed information do not need to be synchronously displayed for the same information source.
In a second aspect, the present application provides a data transmission apparatus, including:
the device comprises a first acquisition unit, a second acquisition unit and a control unit, wherein the first acquisition unit is used for acquiring first selection information, and the first selection information points to window information in information source information;
a second acquisition unit configured to continuously acquire content information in the window information;
a first encoding unit, configured to encode continuously acquired content information to generate continuous network stream information; and
and the first communication unit is used for sending the generated continuous network flow information out through the network.
By adopting the technical scheme, after the window information is selected, the content information in the window information is converted into the network flow information for transmission, the network flow information is transmitted by network equipment, the dependence degree on hardware is low, the content information can be transmitted in a place with a network, and the transmission distance can be effectively increased.
In a preferred example of the second aspect, the number of the first selection information is multiple, and each first selection information points to a different window information;
and generating continuous network flow information corresponding to the window information pointed by each piece of first selection information.
By adopting the technical scheme, one information source can output a plurality of network flow information, and the dependence on hardware can be further reduced.
In a preferred example of the second aspect, the method further includes:
a first generating unit, configured to generate a plurality of option information according to the network flow information;
the third acquisition unit is used for acquiring second selection information, and the second selection information points to one option information; and
and a second communication unit for sending out the network flow information corresponding to the option information.
By adopting the technical scheme, the generated multiple network flow information can be selectively output.
In a preferred example of the second aspect, the method further includes:
the fourth acquisition unit is used for acquiring one or more pieces of display area information, and each piece of display area information comprises one or more pieces of sub-display area information;
a fifth obtaining unit, configured to obtain third selection information, where the third selection information points to information of one sub-display area; and
the third communication unit is used for sending the network flow information corresponding to the first selection information to the display area information pointed by the third selection information;
wherein, the source of the display area information is one or more.
By adopting the technical scheme, the network flow information can be sent to the appointed display area to be displayed, and the directional transmission of the network flow information is realized.
In a preferred example of the second aspect, the method further includes:
the fourth acquisition unit is used for acquiring one or more pieces of display area information, and each piece of display area information comprises one or more pieces of sub-display area information;
a fifth obtaining unit, configured to obtain third selection information, where the third selection information points to information of one sub-display area; and
the fourth communication unit is used for sending the network flow information corresponding to the second selection information to the display area information pointed by the third selection information;
wherein, the source of the display area information is one or more.
By adopting the technical scheme, the network flow information can be sent to the appointed display area to be displayed, and the directional transmission of the network flow information is realized.
In a preferred example of the second aspect, the states of the window information include a display state, a hidden state, an occlusion state, and a partial occlusion state.
By adopting the technical scheme, the window information and the displayed information do not need to be synchronously displayed for the same information source.
In a third aspect, the present application provides a display content identification system, the system comprising:
one or more memories for storing instructions; and
one or more processors configured to invoke and execute the instructions from the memory to perform any of the data transmission methods as described in the first aspect and the preferred examples of the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium comprising:
a program for performing any of the data transmission methods as described in the first aspect and the preferred examples of the first aspect when the program is run by a processor.
In a fifth aspect, the present application provides a computer program product comprising program instructions for performing any of the display content recognition methods described in the first aspect and the preferred examples of the first aspect when the program instructions are executed by a computing device.
In a sixth aspect, the present application provides a system on a chip comprising a processor configured to perform the functions recited in the above aspects, such as generating, receiving, sending, or processing data and/or information recited in the above methods.
In one possible design, the system-on-chip further includes a memory for storing necessary program instructions and data. The chip system may be formed by a chip, or may include a chip and other discrete devices. The processor and the memory may be decoupled, disposed on different devices, connected in a wired or wireless manner, or coupled on the same device.
Drawings
Fig. 1 is a schematic diagram of a framework of an existing converged media system according to an embodiment of the present application.
Fig. 2 is a schematic diagram of an operation of a method according to an embodiment of the present application.
Fig. 3 is a schematic diagram of an operation of a remote transmission according to an embodiment of the present application.
Fig. 4 is a schematic diagram of an arrangement in use according to an embodiment of the present application.
Fig. 5 is a schematic view of another arrangement provided in the embodiments of the present application in use.
Fig. 6 is a schematic projection diagram of network flow information according to an embodiment of the present application.
Fig. 7 is a schematic projection diagram of another network flow information provided in an embodiment of the present application.
Fig. 8 is a schematic display diagram of window information according to an embodiment of the present application.
Fig. 9 is a schematic diagram of network flow information output according to option information according to an embodiment of the present application.
Fig. 10 is a schematic process diagram of network flow information during projection according to an embodiment of the present application.
Detailed Description
The technical solution of the present application will be described in further detail below with reference to the accompanying drawings.
First, the terms involved will be explained.
Referring to fig. 1, a media-merging system, in a simpler structure, may be understood as being composed of a screen and a plurality of terminals, where a display area on the screen may be divided into a plurality of sub-display areas, each sub-display area may be capable of displaying independently, and displayed content is provided by a terminal, and generally, each terminal provides display content for a sub-display area on a screen.
The network flow refers to data flow transmitted by means of a network, network transmission data are transmitted by means of network cables, switches, local area network equipment, servers and the like, data exchange is performed between hardware by means of network cables or wireless networks, the hardware cost is low, the transmission range is large, and the influence of space limitation is very small.
At present, most terminals used in a media-oriented system are computers, the output of a computer to a screen depends on a display card, regardless of an integrated display card or an independent display card, generally, one display card is generally only equipped with one interface, and the interface needs to output through a VGA line, an HDMI line or a DP line, and the like, so that the hardware cost of the method is high, and the transmission distance is also limited by hardware, for example:
ten display areas are divided on one screen, ten terminals need to be equipped, a data line (VGA line, HDMI line or DP line, etc.) needs to be connected between each terminal and the screen, and when the distance between the terminal and the screen is long, the length of the data line is increased.
It should be understood that each terminal is expensive, and as the number of terminals increases, the use cost increases, and even if a plurality of video cards are installed on one terminal (the number of installed video cards is very limited), the use cost increases, which leads to the rise of the final use cost.
It should also be understood that the price of VGA line, HDMI line or DP line is relatively high, for example, a ten meter HDMI line, which is sold at about one hundred yuan, and the price will rise with the increase of definition requirement, but the network line with the same length is less than ten yuan, and the transmission bandwidth can meet the requirement of high definition.
In addition, from the viewpoint of later use cost, excessive hardware inevitably brings extra management cost, and maintenance, replacement and the like of the hardware are not small burdens.
According to the technical scheme shown in the embodiment of the application, the display content is transmitted to the screen in a mode of converting the display content into the network stream, dependence on multiple terminals, a display card, special wires (VGA wires, HDMI wires or DP wires and the like) and the like can be eliminated, and the transmission distance can be increased.
Referring to fig. 2, a data transmission method disclosed in the embodiment of the present application includes the following steps:
s101, acquiring first selection information, wherein the first selection information points to window information in information source information;
s102, continuously acquiring content information in the window information;
s103, coding the continuously acquired content information to generate continuous network stream information; and
and S104, sending the generated continuous network flow information through the network.
Specifically, in step S101, a certain window information can be obtained through the first selection information, where the window information is derived from a source information corresponding to a terminal capable of providing the window information.
In step S102, content information in the acquired window information is continuously captured to form continuous content information, and it should be understood that, for a window, the displayed content may be static or dynamic, but from the viewpoint of time, the displayed content should be continuous regardless of whether static or dynamic.
In some possible implementations, the window may be a browser window, a player window, or an office software window, among others.
In step S103, the continuously acquired content information is encoded to generate continuous network stream information, and the encoding is used to prepare for a subsequent transmission process.
It should be understood that the content information cannot be directly transmitted, for example, optical signals are transmitted through optical fibers, analog signals are transmitted through network cables, and signals are transmitted through wireless network cards by using electromagnetic waves, so that the continuously acquired content information needs to be encoded, that is, converted from one form or format to another form or format, so as to meet the subsequent transmission requirements.
The content in step S104 is to send out the generated continuous network stream information, and as for the sending form, the specific selection may be performed according to the actual use environment through a wired network or a wireless network.
The virtual environment is that data are transmitted between the terminal and the screen in a network cable mode, and the display card and the special data cable are directly abandoned in the connection mode, so that the connection mode is obvious, the dependence degree on hardware is lower, the erection is more convenient, and the hardware cost is lower. Referring to fig. 3, if the wireless network is used for the erection, the dependence on hardware can be further reduced, and meanwhile, the transmission distance is also increased, and even the remote transmission can be realized.
In addition, the network transmission is less limited by distance, the terminal can be projected on the screen in a remote network mode, and the terminal and the screen can be arranged at will in a place which can be covered by the network, so that the limitation of space is avoided.
In another usage scenario, for example, fast deployment is required, for an original converged media system, a connection line needs to be established between each terminal and a screen, and a connection between the terminals and the screen needs to be point-to-point, but if a network is used for transmission, for the terminals, referring to fig. 4 and 5, a router or a splitter or the like can be used as a relay to aggregate data and then transmit the aggregated data to the screen in a unified manner, instead of requiring separate data transmission with the screen, which is more flexible.
In the process of arrangement, the network cable can be manufactured at any time even according to the using length, and if the wireless network mode is used for transmission, the flexibility of arrangement can be further improved.
Referring to fig. 6 and fig. 7, as a specific embodiment of the data transmission method provided by the application, the following steps are added:
s301, acquiring one or more pieces of display area information, wherein each piece of display area information comprises one or more pieces of sub-display area information;
s302, third selection information is obtained, and the third selection information points to information of one sub-display area; and
s303, sending the network flow information corresponding to the first selection information to display area information pointed by the third selection information;
wherein, the source of the display area information is one or more.
The content in steps S301 to S303 is to transmit the generated network flow information to any display area to be displayed, so that the network flow information can be directionally transmitted.
Specifically, in step S301, one or more pieces of display area information are obtained, each piece of display area information includes one or more pieces of sub-display area information, and the source of the display area information may be one or more.
It should be understood that the display area is provided by the screen, and if there are multiple screens in an application scene at the same time, the screens can be accessed at the same time to control the displayed content.
It should also be understood that for a block of a screen, its display area may be divided, for example, into NxN blocks of display areas.
The content in step S302 is to obtain third selection information, where the third selection information points to one sub-display area information, and the sub-display area information may point to any one of the sub-display area information obtained in step S301.
Then, in step S303, the network flow information corresponding to the first selection information is sent to the display area information pointed by the third selection information, so that the generated network flow information is directionally transmitted, and the generated network flow can be sent to the display area on any screen connected to the terminal.
As a specific embodiment of the data transmission method, the state of the window information in step S101 is expanded, and may be a display state, a hidden state, a blocking state, or a partial blocking state.
It should be understood that most of the existing projection methods use a point-to-point method, that is, what content is displayed on the terminal and what content is displayed on the projected screen, but this method will limit the terminal in this usage environment and cannot perform other tasks.
For a window, the states of the window in the terminal are various, and may be a display state (the window is maximized or can be fully seen in a display area on the terminal), a hidden state (minimized), an occlusion state (located behind other display windows), a partial occlusion state (a partial area is located behind other display windows), and the like, which may exist, and if the acquisition of the display content is adjusted to a certain window, the window may be released for the terminal.
Specifically, for a window, when it is in the working state, the content displayed is determined, and only depending on the window can be seen, that is, even if the window is not displayed in the display area, the window is in the working state, and the content is still output to the outside, and only the window is not seen by the person in front of the screen.
For a terminal, the display content of the window is processed by the display card and then sent to the display for display, that is, the terminal has a transmission path, and if the content is directly obtained from the path, what state the window is in is not important any more.
It should be understood that, in the existing implementation, one terminal generally provides one picture information, which can be understood as that one terminal can only provide one signal, and when more signals are needed, the number of terminals is increased.
Therefore, as a specific embodiment of the data transmission method provided by the application, please refer to fig. 8, the number of the first selection information is increased, each of the first selection information points to a different window information, and for each of the window information pointed by the first selection information, the corresponding continuous network flow information is generated, so that for one terminal, a plurality of display contents can be provided at the same time.
Specifically, after the number of the first selection information is increased, for one terminal, a plurality of signals can be provided at the same time, and because a network transmission mode is adopted, multiple signals can be transmitted within an allowable range of a transmission bandwidth without being limited by the fact that only one signal can be transmitted through a data line (a VGA line, an HDMI line, a DP line, or the like).
Further, for the window information to which the first selection information points, the state may be any one of a display state, a hidden state, an occlusion state, or a partial occlusion state, and the content of the window information is already stated in the text, and is not described herein again.
In a possible use environment, for a terminal, ten windows may exist in a display area of the terminal at the same time, and for the ten windows, ten pieces of network flow information may be output at the same time.
The plurality of windows displayed on the terminal are also in various states, and the generation of the network flow information can be completed as long as the windows exist, and the windows are not necessarily displayed in the display area.
In a possible implementation manner, for a plurality of generated network flow information, one allocation software may be added, for example, the number of generated network flow information is nine, and the nine network flow information may be allocated to nine large screens or one display area on one large screen or several different display areas on different screens.
Referring to fig. 9, as a specific embodiment of the data transmission method, the following steps are added:
s201, generating a plurality of option information according to the network flow information;
s202, second selection information is obtained, and the second selection information points to option information; and
s203, sending out the network flow information corresponding to the option information.
The contents of steps S201 to S203 are that the generated plurality of network flow information are selectively output, and for example, the plurality of network flow information that can be output can be controlled in a selected manner.
Specifically, in step S201, a plurality of option information is generated according to the generated network flow information, and these option information may be located in an independent display area, for example, the number of the generated network flow information is nine, and the number of the corresponding option information is also nine, which are in one-to-one correspondence and associated.
In step S202, a second selection information is obtained, where the second selection information points to one of the option information, which may be one of the nine option information appearing in step S201.
Next, in step S203, the network flow information corresponding to the option information selected in step S202 is sent out, so that the selective output of the network flow information is realized, and it is possible for the operator to directly select the corresponding option information to output which option information is desired to be output.
For example, in a certain display area, the display area is in a display state when the network flow information is output, and is in a non-display state when the output is stopped.
For another example, for a certain display area that needs to be switched to display, switching of display contents may be implemented by changing the output network stream information.
It should be understood that when a second selection message is obtained, the network flow message corresponding to the selection message is in the output state, and then when a second selection message is obtained again, the network flow message corresponding to the selection message may also be adjusted to the output stop state.
Referring to fig. 10, as a specific embodiment of the data transmission method, the following steps are added:
s501, acquiring one or more pieces of display area information, wherein each piece of display area information comprises one or more pieces of sub-display area information;
s502, third selection information is obtained, and the third selection information points to information of one sub-display area; and
s503, sending the network flow information corresponding to the second selection information to the display area information pointed by the third selection information;
wherein, the source of the display area information is one or more.
The content in steps S501 to S503 is to transmit the generated network flow information to any display area to be displayed, so that the network flow information can be directionally transmitted.
Specifically, in step S501, one or more pieces of display area information are obtained, each piece of display area information includes one or more pieces of sub-display area information, and the source of the display area information may be one or more.
The content in step S502 is to obtain third selection information, where the third selection information points to one piece of sub-display area information, and the sub-display area information may point to any piece of sub-display area information obtained in step S501.
Next, in step S503, the network flow information corresponding to the second selection information is sent to the display area information pointed by the third selection information, so that the generated network flow information is directionally transmitted, and the generated network flow can be sent to the display area on any screen connected to the terminal.
The embodiment of the present application further discloses a data transmission device, including:
the device comprises a first acquisition unit, a second acquisition unit and a control unit, wherein the first acquisition unit is used for acquiring first selection information, and the first selection information points to window information in information source information;
a second acquisition unit configured to continuously acquire content information in the window information;
a first encoding unit, configured to encode continuously acquired content information to generate continuous network stream information; and
and the first communication unit is used for sending the generated continuous network flow information out through the network.
In one example, the units in any of the above apparatus may be one or more integrated circuits configured to implement the above method, for example: one or more Application Specific Integrated Circuits (ASICs), or one or more Digital Signal Processors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), or a combination of at least two of these integrated circuit forms. As another example, when a unit in a device may be implemented in the form of a processing element scheduler, the processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of invoking programs. As another example, these units may be integrated together and implemented in the form of a system-on-a-chip (SOC).
Furthermore, the number of the first selection information is multiple, and each first selection information points to different window information;
and generating continuous network flow information corresponding to the window information pointed by each piece of first selection information.
Further, a first generating unit is added for generating a plurality of option information according to the network flow information;
the third acquisition unit is used for acquiring second selection information, and the second selection information points to one option information; and
and a second communication unit for sending out the network flow information corresponding to the option information.
Further, a fourth acquiring unit is added for acquiring one or more pieces of display area information, wherein each piece of display area information comprises one or more pieces of sub-display area information;
a fifth obtaining unit, configured to obtain third selection information, where the third selection information points to information of one sub-display area; and
the third communication unit is used for sending the network flow information corresponding to the first selection information to the display area information pointed by the third selection information;
wherein, the source of the display area information is one or more.
Further, a fourth acquiring unit is added for acquiring one or more display area information, wherein each display area information comprises one or more sub-display area information;
a fifth obtaining unit, configured to obtain third selection information, where the third selection information points to information of one sub-display area; and
the fourth communication unit is used for sending the network flow information corresponding to the second selection information to the display area information pointed by the third selection information;
wherein, the source of the display area information is one or more.
Further, the states of the window information include a display state, a hidden state, an occlusion state, and a partial occlusion state.
The embodiment of the present application further discloses a display content recognition system, which includes:
one or more memories for storing instructions; and
one or more processors configured to retrieve and execute the instructions from the memory to perform a data transfer method as described above.
Various objects such as various messages/information/devices/network elements/systems/devices/actions/operations/procedures/concepts may be named in the present application, it is to be understood that these specific names do not constitute limitations on related objects, and the named names may vary according to circumstances, contexts, or usage habits, and the understanding of the technical meaning of the technical terms in the present application should be mainly determined by the functions and technical effects embodied/performed in the technical solutions.
It can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It should also be understood that, in various embodiments of the present application, first, second, etc. are used merely to indicate that a plurality of objects are different. For example, the first time window and the second time window are merely to show different time windows. And should not have any influence on the time window itself, and the above-mentioned first, second, etc. should not impose any limitation on the embodiments of the present application.
It is also to be understood that, in various embodiments of the present application, unless otherwise specified or conflicting in logic, terms and/or descriptions between different embodiments are consistent and may be mutually referenced, and technical features in different embodiments may be combined to form a new embodiment according to their inherent logical relationship.
It will be appreciated that the memory in the embodiments of the subject application can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory.
The non-volatile memory may be ROM, programmable Read Only Memory (PROM), erasable Programmable Read Only Memory (EPROM), electrically Erasable Programmable Read Only Memory (EEPROM), or flash memory.
Volatile memory can be RAM, which acts as external cache memory. There are many different types of RAM, such as Static Random Access Memory (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synclink DRAM (SLDRAM), and direct memory bus RAM.
The processor mentioned in any of the above may be a CPU, a microprocessor, an ASIC, or one or more integrated circuits for controlling the execution of the program of the method for transmitting feedback information. The processing unit and the storage unit may be decoupled, and are respectively disposed on different physical devices, and are connected in a wired or wireless manner to implement respective functions of the processing unit and the storage unit, so as to support the system chip to implement various functions in the foregoing embodiments. Alternatively, the processing unit and the memory may be coupled to the same device.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a computer-readable storage medium, which includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned computer-readable storage media comprise: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The embodiments of the present invention are preferred embodiments of the present application, and the scope of protection of the present application is not limited by the embodiments, so: all equivalent changes made according to the structure, shape and principle of the present application shall be covered by the protection scope of the present application.

Claims (6)

1. A method of data transmission, comprising:
acquiring first selection information, wherein the first selection information points to window information in information source information;
continuously acquiring content information in the window information;
coding the continuously acquired content information to generate continuous network stream information; and
sending the generated continuous network flow information through a network;
generating a plurality of option information according to the network flow information;
acquiring second selection information, wherein the second selection information points to option information; and
sending out the network flow information corresponding to the option information;
the number of the first selection information is multiple, and each first selection information points to different window information;
for each window information pointed by the first selection information, generating continuous network flow information corresponding to the window information;
acquiring one or more pieces of display area information, wherein each piece of display area information comprises one or more pieces of sub-display area information;
acquiring third selection information, wherein the third selection information points to information of one sub-display area; and
sending the network flow information corresponding to the second selection information to display area information pointed by third selection information;
wherein, the source of the display area information is one or more;
and when a second selection information is obtained, the network flow information corresponding to the selection information is in an output state, and when a second selection information is obtained again, the network flow information corresponding to the selection information can also be adjusted to a state of stopping output.
2. A data transmission method according to claim 1, further comprising:
acquiring one or more pieces of display area information, wherein each piece of display area information comprises one or more pieces of sub-display area information;
acquiring third selection information, wherein the third selection information points to information of one sub-display area; and
sending the network flow information corresponding to the first selection information to display area information pointed by the third selection information;
wherein, the source of the display area information is one or more.
3. A data transmission method according to claim 1, characterized in that: the states of the window information include a display state, a hidden state, a shielding state and a partial shielding state.
4. A data transmission apparatus, comprising:
the device comprises a first acquisition unit, a second acquisition unit and a control unit, wherein the first acquisition unit is used for acquiring first selection information, and the first selection information points to window information in information source information;
a second acquisition unit configured to continuously acquire content information in the window information;
a first encoding unit, configured to encode continuously acquired content information to generate continuous network stream information; and
the first communication unit is used for sending the generated continuous network flow information out through a network;
a first generating unit, configured to generate multiple option information according to the network flow information;
the third acquisition unit is used for acquiring second selection information, and the second selection information points to one option information; and
a second communication unit for sending out the network flow information corresponding to the option information;
the number of the first selection information is multiple, and each first selection information points to different window information;
for each window information pointed by the first selection information, generating continuous network flow information corresponding to the window information;
the fourth acquisition unit is used for acquiring one or more pieces of display area information, and each piece of display area information comprises one or more pieces of sub-display area information;
a fifth obtaining unit, configured to obtain third selection information, where the third selection information points to information of one sub-display area; and
the fourth communication unit is used for sending the network flow information corresponding to the second selection information to the display area information pointed by the third selection information;
wherein, the source of the display area information is one or more;
and when a second selection message is obtained, the network flow message corresponding to the selection message is in an output state, and when a second selection message is obtained again, the network flow message corresponding to the selection message can be adjusted to a state of stopping outputting.
5. A data transmission system, the system comprising:
one or more memories for storing instructions; and
one or more processors configured to retrieve and execute the instructions from the memory, and to perform a data transfer method according to any one of claims 1 to 3.
6. A computer-readable storage medium, the computer-readable storage medium comprising:
program for performing a data transmission method as claimed in any one of claims 1 to 3 when said program is run by a processor.
CN202010871015.0A 2020-08-26 2020-08-26 Data transmission method, device, system and storage medium Active CN112118233B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010871015.0A CN112118233B (en) 2020-08-26 2020-08-26 Data transmission method, device, system and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010871015.0A CN112118233B (en) 2020-08-26 2020-08-26 Data transmission method, device, system and storage medium

Publications (2)

Publication Number Publication Date
CN112118233A CN112118233A (en) 2020-12-22
CN112118233B true CN112118233B (en) 2022-12-06

Family

ID=73805143

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010871015.0A Active CN112118233B (en) 2020-08-26 2020-08-26 Data transmission method, device, system and storage medium

Country Status (1)

Country Link
CN (1) CN112118233B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111404882A (en) * 2020-03-02 2020-07-10 广州华多网络科技有限公司 Media stream processing method and device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2476136B (en) * 2010-07-20 2012-08-01 Starbucks Hk Ltd Improvements to providing multimedia content to a user
KR101952682B1 (en) * 2012-04-23 2019-02-27 엘지전자 주식회사 Mobile terminal and method for controlling thereof
CN205507741U (en) * 2016-03-29 2016-08-24 北京博睿维讯科技有限公司 Image is analyzed unit and is had concatenation controller of this unit
CN106101176B (en) * 2016-05-27 2019-04-12 成都索贝数码科技股份有限公司 One kind is integrated to melt media cloud production delivery system and method
CN109656495A (en) * 2017-10-12 2019-04-19 阿里巴巴集团控股有限公司 The display methods and device of Mosaic screen, terminal
CN110740363B (en) * 2019-10-25 2022-11-18 华为终端有限公司 Screen projection method and system and electronic equipment

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111404882A (en) * 2020-03-02 2020-07-10 广州华多网络科技有限公司 Media stream processing method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"大屏幕显示墙信源调度的创新应用";郭戈;《广播电视信息》;20150615(第06期);第18-20页 *

Also Published As

Publication number Publication date
CN112118233A (en) 2020-12-22

Similar Documents

Publication Publication Date Title
CN107509052B (en) Double-current video conference method, device, electronic equipment and system
US20110066971A1 (en) Method and apparatus for providing application interface portions on peripheral computing devices
KR101634134B1 (en) System, method, and computer program product for decompression of block compressed images
KR20080103929A (en) Encoding multi-media signals
CN104540012A (en) Method, device and terminal for content sharing
US9906626B2 (en) Resource demand-based network page generation
CN105207886A (en) Instant messaging (IM) message sending and display methods, IM message sending and display devices, and IM message system
CN103399649A (en) Data processing method based on K virtual machine (KVM) and KVM transmitting device
CN112118233B (en) Data transmission method, device, system and storage medium
CN104737618A (en) Guide service method and device applied to same
CN111971673A (en) System and method for redirecting audio and video data streams in a display-server computing system
CN116260722A (en) Network equipment configuration synchronization method and synchronization system
CN115567754A (en) Video playing method, device, equipment and storage medium
EP3755119B1 (en) Message processing method and electronic device supporting the same
CN114092362A (en) Panoramic picture loading method and device
KR20180039730A (en) Modification of graphic command tokens
CN116661790B (en) Cross-platform rendering method and device and electronic equipment
CN113099126B (en) Image transmission method and device, electronic equipment and storage medium
WO2024020896A1 (en) Field-device control method, field device, mobile device and storage medium
CN116506323A (en) Method and device for testing message conversion, electronic equipment and readable storage medium
CN117251125A (en) Display control method, device, equipment and storage medium
CN117221565A (en) VGTP-based image display method and device under high delay, medium and electronic equipment
JP2024509837A (en) Method, apparatus and program for signaling occlude-free regions in 360 video conferencing
CN116193096A (en) Panoramic video streaming interaction method, system and meta universe based on virtual reality
CN117676265A (en) Method and system for monitoring bandwidth occupancy rate of image traffic

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant