CN108989314A - A kind of Transmitting Data Stream, processing method and processing device - Google Patents
A kind of Transmitting Data Stream, processing method and processing device Download PDFInfo
- Publication number
- CN108989314A CN108989314A CN201810803187.7A CN201810803187A CN108989314A CN 108989314 A CN108989314 A CN 108989314A CN 201810803187 A CN201810803187 A CN 201810803187A CN 108989314 A CN108989314 A CN 108989314A
- Authority
- CN
- China
- Prior art keywords
- data
- stream
- attribute information
- label
- transmission channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/04—Protocols for data compression, e.g. ROHC
Abstract
The embodiment of the present invention provides a kind of Transmitting Data Stream, processing method and processing device.Method includes: the multiple stream datas to be transmitted of acquisition and corresponding attribute information, the attribute information include label；The stream data of same label is packaged, the corresponding data encapsulation package of each label is obtained；All data encapsulation packages are sent to data processing end by the data transmission channel constructed in advance.Device is for executing the above method.The embodiment of the present invention is packaged by the stream data to same label, then multiple data encapsulation packages after encapsulation are transmitted by a data transmission channel, due to the public data transmission channel of multiple data encapsulation packages, the multiplexing of data transmission channel is realized, to improve the utilization rate of data transmission channel.
Description
Technical field
The present invention relates to data communication technology fields, in particular to a kind of Transmitting Data Stream, processing method and dress
It sets.
Background technique
Result collection system can support the data of magnanimity to transmit, and especially streaming collection of log data system can be real-time
Record all kinds of user behaviors, system status information etc. it is various be transferred in data lake, be applied to the every aspect of internet.
In the prior art, usually using Apache Kafka and AWS Kinesis Stream as most common streaming day
Will collection kit is collected daily record data.When using Apache Kafka or AWS Kinesis Stream, need pre-
The label of streaming daily record data is first configured, and constructs a data transmission channel for the streaming daily record data of each label, and
The available resources that default size is reserved for channel are generally required since the data volume of streaming daily record data has fluctuation according to every
The wave crest data volume of a kind of streaming daily record data carries out assessing reserved resource, and reserved several times capacity is as the slow of burst flow
Punching.
Since the fluctuation pattern of the streaming daily record data of all kinds of labels is not consistent, to do maximum for every class label
The reserved resource of amount, so that the wasting of resources of streaming result collection system is caused, so that the resource benefit in data transmission channel
It is relatively low with rate.
Summary of the invention
In view of this, the embodiment of the present invention is designed to provide a kind of Transmitting Data Stream, processing method and processing device, with
Solve above-mentioned technical problem.
In a first aspect, the embodiment of the invention provides a kind of Transmitting Data Stream methods, comprising:
Multiple stream datas to be transmitted and corresponding attribute information are obtained, the attribute information includes label；
The stream data of same label is packaged, the corresponding data encapsulation package of each label is obtained；
All data encapsulation packages are sent to data processing end by the data transmission channel constructed in advance.
Further, before obtaining multiple stream datas to be transmitted and corresponding attribute information, the method is also wrapped
It includes:
A data transmission channel is constructed, the available resources of default size are reserved in the data transmission channel.
Further, after obtaining the corresponding data encapsulation package of each label, the method, further includes:
Each data encapsulation package is compressed.
Second aspect, the embodiment of the invention provides a kind of stream data processing methods, comprising:
Receive the multiple data encapsulation packages transmitted by a data transmission channel, wherein the data encapsulation package includes
Multiple stream datas and corresponding attribute information, the attribute information include label；
Unpacking processing is carried out to corresponding data encapsulation package according to the label, obtains the corresponding institute of the data encapsulation package
State attribute information and the stream data.
Further, the attribute information further includes processing mode；Correspondingly, corresponding obtaining the data encapsulation package
After the attribute information and the stream data, the method, further includes:
The stream data is handled according to the processing mode.
The third aspect, the embodiment of the invention provides a kind of Transmitting Data Stream devices, comprising:
Module is obtained, for obtaining multiple stream datas to be transmitted and corresponding attribute information, the attribute information packet
Include label；
Package module is packaged for the stream data to same label, obtains the corresponding data of each label
Encapsulation package；
Transmission module sends all data encapsulation packages for a data transmission channel by constructing in advance
To data processing end.
Further, described device, further includes:
Channel constructs module, for constructing a data transmission channel, reserves in the data transmission channel pre-
If the available resources of size.
Further, described device, further includes:
Compression module, for being compressed to each data encapsulation package.
Fourth aspect, the embodiment of the present invention provide a kind of stream data processing unit, comprising:
Receiving module, for receiving the multiple data encapsulation packages for passing through a data transmission channel and transmitting, wherein the number
It include multiple stream datas and corresponding attribute information according to encapsulation package, the attribute information includes the label；
It unpacks module and obtains the data for carrying out unpacking processing to corresponding data encapsulation package according to the label
The corresponding attribute information of encapsulation package and the stream data.
Further, described device, the attribute information further include processing mode；Correspondingly, further include:
Processing module, for being handled according to the processing mode the stream data.
5th aspect, the embodiment of the present invention provide a kind of electronic equipment, comprising: processor, memory and bus, wherein
The processor and the memory complete mutual communication by the bus；
The memory is stored with the program instruction that can be executed by the processor, and the processor calls described program to refer to
Enable the method and step for being able to carry out first aspect.
6th aspect, the embodiment of the present invention provide a kind of non-transient computer readable storage medium, comprising:
The non-transient computer readable storage medium stores computer instruction, and the computer instruction makes the computer
Execute the method and step of first aspect.
7th aspect, the embodiment of the present invention provide a kind of electronic equipment, comprising: processor, memory and bus, wherein
The processor and the memory complete mutual communication by the bus；
The memory is stored with the program instruction that can be executed by the processor, and the processor calls described program to refer to
Enable the method and step for being able to carry out second aspect.
Eighth aspect, the embodiment of the present invention provide a kind of non-transient computer readable storage medium, comprising:
The non-transient computer readable storage medium stores computer instruction, and the computer instruction makes the computer
Execute the method and step of second aspect.
The embodiment of the present invention is packaged by the stream data to same label, then seals multiple data after encapsulation
Dress packet is transmitted by a data transmission channel, due to the public data transmission channel of multiple data encapsulation packages, is realized
The multiplexing of data transmission channel, to improve the utilization rate of data transmission channel.
Other features and advantages of the present invention will be illustrated in subsequent specification, also, partly be become from specification
It is clear that by implementing understanding of the embodiment of the present invention.The objectives and other advantages of the invention can be by written theory
Specifically noted structure is achieved and obtained in bright book, claims and attached drawing.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached
Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair
The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this
A little attached drawings obtain other relevant attached drawings.
Fig. 1 is a kind of Transmitting Data Stream method flow schematic diagram provided in an embodiment of the present invention；
Fig. 2 is a kind of stream data processing method flow diagram provided in an embodiment of the present invention；
Fig. 3 is Transmitting Data Stream logical architecture figure provided in an embodiment of the present invention；
Fig. 4 is a kind of Transmitting Data Stream apparatus structure schematic diagram provided in an embodiment of the present invention；
Fig. 5 is a kind of stream data processing device structure diagram provided in an embodiment of the present invention；
Fig. 6 is the structural block diagram of electronic equipment provided in an embodiment of the present invention；
Fig. 7 is the structural block diagram of electronic equipment provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with attached drawing in the embodiment of the present invention, technical solution in the embodiment of the present invention carries out clear, complete
Ground description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Usually exist
The component of the embodiment of the present invention described and illustrated in attached drawing can be arranged and be designed with a variety of different configurations herein.Cause
This, is not intended to limit claimed invention to the detailed description of the embodiment of the present invention provided in the accompanying drawings below
Range, but it is merely representative of selected embodiment of the invention.Based on the embodiment of the present invention, those skilled in the art are not doing
Every other embodiment obtained under the premise of creative work out, shall fall within the protection scope of the present invention.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, does not then need that it is further defined and explained in subsequent attached drawing.Meanwhile of the invention
In description, term " first ", " second " etc. are only used for distinguishing description, are not understood to indicate or imply relative importance.
Fig. 1 is a kind of Transmitting Data Stream method flow schematic diagram provided in an embodiment of the present invention, as shown in Figure 1, the party
Method, comprising:
Step 101: obtaining multiple stream datas to be transmitted and corresponding attribute information, the attribute information includes mark
Label.
In the specific implementation process, when system can generate many data informations in the process of running, it is with daily record data
Example can be improved its treatment effeciency by way of streaming to carry out transmission process to daily record data.Therefore, device obtains first
Multiple stream datas to be transmitted and the corresponding attribute information of each stream data.Wherein, attribute information may include streaming
The label of data, the label are used to indicate the type of stream data, it should be noted that in multiple stream datas to be transmitted
In, can be indicated with different labels there are many type, can also include in attribute information data flow to information,
Processing mode etc., the present invention is not especially limit this.
Step 102: the stream data of same label being packaged, the corresponding data encapsulation of each label is obtained
Packet.
In the specific implementation process, the identical stream data of label is packaged, this is because different types of stream
Its transmission mode may be different in transmission for formula data, therefore for the ease of transmission, will belong to same category of stream data envelope
A data encapsulation package is dressed up to be transmitted.
Step 103: all data encapsulation packages are sent to by number by the data transmission channel constructed in advance
According to processing end.
In the specific implementation process, data transmission is written by streaming tool SDK in packaged data encapsulation package to lead to
It in road, is transmitted by data transmission channel, is transmitted to data processing end, so that data processing end is receiving multiple data
Each data encapsulation package is unpacked according to label after encapsulation package, obtains the stream data in data encapsulation package, it is then right
Each stream data performs corresponding processing.It should be noted that data transmission channel constructs in advance.Wherein, streaming work
Having SDK can be AWS SDK.
The embodiment of the present invention is packaged by the stream data to same label, then seals multiple data after encapsulation
Dress packet is transmitted by a data transmission channel, due to the public data transmission channel of multiple data encapsulation packages, is realized
The multiplexing of data transmission channel, to improve the utilization rate of data transmission channel.
On the basis of the above embodiments, before obtaining multiple stream datas to be transmitted and corresponding attribute information,
The method, further includes:
A data transmission channel is constructed, the available resources of default size are reserved in the data transmission channel.
In the specific implementation process, before streaming data is transmitted, need to construct a data transmission channel,
And the available resources of default size are reserved in the data transmission channel, wherein how much specifically reserve can root for available resources
It is determined according to the wave crest data volume of experience or the loss data for being actually subjected to transmission.Due to only establishing a data transmission channel,
All types of stream datas, which all pass through this data transmission channel, to be transmitted, and the multiplexing of data transmission channel is realized, and
The available resources come are reserved in data transmission channel can also use for all stream datas, improve data transmission channel
Utilization rate.
On the basis of the above embodiments, after obtaining the corresponding data encapsulation package of each label, the method,
Further include:
Each data encapsulation package is compressed.
In the specific implementation process, to each after streaming data is packaged to obtain multiple data encapsulation packages
Data encapsulation package is compressed, so that occupying less resource when being transmitted using data transmission channel.
Fig. 2 is a kind of stream data processing method flow diagram provided in an embodiment of the present invention, as shown in Fig. 2, the party
Method, comprising:
Step 201: receiving the multiple data encapsulation packages transmitted by a data transmission channel, wherein the data envelope
Dress packet includes multiple stream datas and corresponding attribute information, and the attribute information includes the label；
In the specific implementation process, data processing equipment receives what data transmission device was transmitted by data transmission channel
Multiple data encapsulation packages, it should be noted that include multiple stream datas and each streaming in a data encapsulation package
The corresponding attribute information of data, and can also include the corresponding label of each stream data in attribute information, it also may include place
Reason mode and flow to information.
Step 202: unpacking processing being carried out to corresponding data encapsulation package according to the label, obtains the data encapsulation package
The corresponding stream data and the attribute information.
In the specific implementation process, data encapsulation package is carried out at unpacking according to the label of each data encapsulation package
Reason, obtains the stream data and the corresponding attribute information of stream data in each data encapsulation package.
The embodiment of the present invention is by receiving the multiple data encapsulation packages transmitted from a data transmission channel, data encapsulation
It is different to wrap corresponding label, unpacking processing is carried out to each data encapsulation package, obtains corresponding stream data, due to by same
One data transmission channel transmits the different data encapsulation package of multiple labels, rather than by the stream data of a label with one
Data transmission channel is transmitted, to reduce the quantity of building data transmission channel in advance, while being improved and being passed to data
The utilization rate in defeated channel.
On the basis of the above embodiments, the attribute information further includes processing mode；Correspondingly, obtaining the data
After the corresponding attribute information of encapsulation package and the stream data, the method, further includes:
The stream data is handled according to the processing mode.
In the specific implementation process, due to the corresponding stream data of all labels all use the same data transmission channel into
Row transmission, and different stream datas needs to carry out it different processing, therefore, the corresponding category of available each stream data
Property information, include wherein processing method in attribute information, therefore, can be carried out according to the corresponding processing mode of each stream data
Corresponding processing.For example, processing mode is that the stream data is stored in the first data pool.Certainly, processing mode may be
Other, the present invention is not especially limit this.
Fig. 3 is Transmitting Data Stream logical architecture figure provided in an embodiment of the present invention, as shown in figure 3, the logical architecture packet
Include data sending terminal, data processing end and data transmission channel kinesis stream.Wherein, data sending terminal includes business
Layer, acquisition additional information layer and binary system package layer；Data processing end includes flow data process layer, parsing additional information layer and two
System solution covering.Operation layer obtains the stream data in operation system, and it is corresponding to obtain stream data by acquisition additional information layer
Attribute information, binary system package layer streaming data and attribute information be packaged, and obtains data encapsulation package, encapsulates data
Packet is transmitted to data processing end by a data transmission channel, and the binary system solution covering in data processing end is to data encapsulation package
Unpacking processing is carried out, then the attribute information of each stream data is parsed using parsing additional information layer, finally utilizes stream
Data analysis layer is handled according to attribute information.
The embodiment of the present invention is packaged by the stream data to same label, then seals multiple data after encapsulation
Dress packet is transmitted by a data transmission channel, due to the public data transmission channel of multiple data encapsulation packages, is realized
The multiplexing of data transmission channel, to improve the utilization rate of data transmission channel.
Fig. 4 is a kind of Transmitting Data Stream apparatus structure schematic diagram provided in an embodiment of the present invention, as shown in figure 4, the dress
Set includes: to obtain module 401, package module 402 and transmission module 403, wherein
Module 401 is obtained for obtaining multiple stream datas to be transmitted and corresponding attribute information, the attribute information
Including label；Package module 402 obtains the corresponding number of each label for being packaged to the stream data of same label
According to encapsulation package；Transmission module 403 is used for a data transmission channel by constructing in advance for all data encapsulation packages
It is sent to data processing end.
On the basis of the above embodiments, described device, further includes:
Channel constructs module, for constructing a data transmission channel, reserves in the data transmission channel pre-
If the available resources of size.
On the basis of the above embodiments, described device, further includes:
Compression module, for being compressed to each data encapsulation package.
It is apparent to those skilled in the art that for convenience and simplicity of description, the device of foregoing description
Specific work process, no longer can excessively be repeated herein with reference to the corresponding process in preceding method.
In conclusion the embodiment of the present invention is packaged by the stream data to same label, it then will be after encapsulation
Multiple data encapsulation packages are transmitted by a data transmission channel, due to the public data transmission of multiple data encapsulation packages
Channel, realizes the multiplexing of data transmission channel, to improve the utilization rate of data transmission channel.
Fig. 5 is a kind of stream data processing device structure diagram provided in an embodiment of the present invention, as shown in figure 5, the dress
Set includes: receiving module 501 and unpacking module 502, wherein
Receiving module 501 is used to receive the multiple data encapsulation packages transmitted by a data transmission channel, wherein described
Data encapsulation package includes multiple stream datas and corresponding attribute information, and the attribute information includes the label；Unpack module
502, for carrying out unpacking processing to corresponding data encapsulation package according to the label, obtain the corresponding institute of the data encapsulation package
State attribute information and the stream data.
On the basis of the above embodiments, the attribute information further includes processing mode；Correspondingly, described device, is also wrapped
It includes:
Processing module, for being handled according to the processing mode the stream data.
It is apparent to those skilled in the art that for convenience and simplicity of description, the device of foregoing description
Specific work process, no longer can excessively be repeated herein with reference to the corresponding process in preceding method.
In conclusion the embodiment of the present invention is by receiving multiple data encapsulation from a data transmission channel transmission
Packet, the corresponding label of data encapsulation package is different, carries out unpacking processing to each data encapsulation package, obtains corresponding streaming number
According to due to transmitting the different data encapsulation package of multiple labels by the same data transmission channel, rather than by label
Stream data is transmitted with a data transmission channel, to improve the utilization rate to data transmission channel.
The present embodiment discloses a kind of computer program product, and the computer program product includes being stored in non-transient calculating
Computer program on machine readable storage medium storing program for executing, the computer program include program instruction, when described program instruction is calculated
When machine executes, computer is able to carry out method provided by above-mentioned each method embodiment, for example, obtains multiple to be transmitted
Stream data and corresponding attribute information, the attribute information include label；The stream data of same label is packaged, is obtained
Obtain the corresponding data encapsulation package of each label；By a data transmission channel constructing in advance by all data
Encapsulation package is sent to data processing end.
The present embodiment provides a kind of non-transient computer readable storage medium, the non-transient computer readable storage medium
Computer instruction is stored, the computer instruction makes the computer execute method provided by above-mentioned each method embodiment, example
It such as include: that obtain multiple stream datas to be transmitted and corresponding attribute information, the attribute information include label；To same mark
The stream data of label is packaged, and obtains the corresponding data encapsulation package of each label；Pass through the data constructed in advance
All data encapsulation packages are sent to data processing end by transmission channel.
The present embodiment discloses a kind of computer program product, and the computer program product includes being stored in non-transient calculating
Computer program on machine readable storage medium storing program for executing, the computer program include program instruction, when described program instruction is calculated
When machine executes, computer is able to carry out method provided by above-mentioned each method embodiment, for example, receives and passes through a data
Multiple data encapsulation packages of transmission channel transmission, wherein the data encapsulation package includes multiple stream datas and corresponding attribute
Information, the attribute information include the label；Unpacking processing is carried out to corresponding data encapsulation package according to the label, is obtained
The corresponding attribute information of data encapsulation package and the stream data.
The present embodiment provides a kind of non-transient computer readable storage medium, the non-transient computer readable storage medium
Computer instruction is stored, the computer instruction makes the computer execute method provided by above-mentioned each method embodiment, example
It such as include: the multiple data encapsulation packages for receiving and being transmitted by a data transmission channel, wherein the data encapsulation package includes more
A stream data and corresponding attribute information, the attribute information include the label；According to the label to corresponding data
Encapsulation package carries out unpacking processing, obtains the corresponding attribute information of the data encapsulation package and the stream data.
Fig. 6 is please referred to, Fig. 6 is the structural block diagram of electronic equipment provided in an embodiment of the present invention.Electronic equipment may include
Transmitting Data Stream device 601, memory 602, storage control 603, processor 604, Peripheral Interface 605, input and output list
First 606, audio unit 607, display unit 608.
The memory 602, storage control 603, processor 604, Peripheral Interface 605, input-output unit 606, sound
Frequency unit 607, each element of display unit 608 are directly or indirectly electrically connected between each other, to realize the transmission or friendship of data
Mutually.It is electrically connected for example, these elements can be realized between each other by one or more communication bus or signal wire.The streaming
Data transmission device 601 includes that at least one can be stored in the memory 602 in the form of software or firmware (firmware)
In or the software function module that is solidificated in the operating system (operating system, OS) of Transmitting Data Stream device 601.
The processor 604 is used to execute the executable module stored in memory 602, such as Transmitting Data Stream device 601 includes
Software function module or computer program.
Wherein, memory 602 may be, but not limited to, random access memory (Random Access Memory,
RAM), read-only memory (Read Only Memory, ROM), programmable read only memory (Programmable Read-Only
Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only Memory, EPROM),
Electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only Memory, EEPROM) etc..
Wherein, memory 602 is for storing program, and the processor 604 executes described program after receiving and executing instruction, aforementioned
Method performed by the server that the stream process that any embodiment of the embodiment of the present invention discloses defines can be applied to processor 604
In, or realized by processor 604.
Processor 604 can be a kind of IC chip, the processing capacity with signal.Above-mentioned processor 604 can
To be general processor, including central processing unit (Central Processing Unit, abbreviation CPU), network processing unit
(Network Processor, abbreviation NP) etc.；Can also be digital signal processor (DSP), specific integrated circuit (ASIC),
Ready-made programmable gate array (FPGA) either other programmable logic device, discrete gate or transistor logic, discrete hard
Part component.It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present invention.General processor
It can be microprocessor or the processor 604 be also possible to any conventional processor etc..
Various input/output devices are couple processor 604 and memory 602 by the Peripheral Interface 605.Some
In embodiment, Peripheral Interface 605, processor 604 and storage control 603 can be realized in one single chip.Other one
In a little examples, they can be realized by independent chip respectively.
Input-output unit 606 realizes user and the server (or local terminal) for being supplied to user input data
Interaction.The input-output unit 606 may be, but not limited to, mouse and keyboard etc..
Audio unit 607 provides a user audio interface, may include one or more microphones, one or more raises
Sound device and voicefrequency circuit.
Display unit 608 provides an interactive interface (such as user interface) between the electronic equipment and user
Or it is referred to for display image data to user.In the present embodiment, the display unit 608 can be liquid crystal display or touching
Control display.It can be the touching of the capacitance type touch control screen or resistance-type of support single-point and multi-point touch operation if touch control display
Control screen etc..Single-point and multi-point touch operation is supported to refer to that touch control display can sense on the touch control display one or more
The touch control operation generated simultaneously at a position, and the touch control operation that this is sensed transfers to processor 604 to be calculated and handled.
Various input/output devices are couple processor 604 and memory 602 by the Peripheral Interface 605.Some
In embodiment, Peripheral Interface 605, processor 604 and storage control 603 can be realized in one single chip.Other one
In a little examples, they can be realized by independent chip respectively.
Input-output unit 606 is used to be supplied to the interaction that user input data realizes user and processing terminal.It is described defeated
Entering output unit 606 may be, but not limited to, mouse and keyboard etc..
It is appreciated that structure shown in fig. 6 is only to illustrate, the electronic equipment may also include it is more than shown in Fig. 6 or
The less component of person, or with the configuration different from shown in Fig. 6.Each component shown in Fig. 6 can using hardware, software or
A combination thereof is realized.
Fig. 7 is please referred to, Fig. 7 is the structural block diagram of electronic equipment provided in an embodiment of the present invention.Electronic equipment may include
Stream data processing unit 701, memory 702, storage control 703, processor 704, Peripheral Interface 705, input and output list
First 706, audio unit 707, display unit 708.
The memory 702, storage control 703, processor 704, Peripheral Interface 705, input-output unit 706, sound
Frequency unit 707, each element of display unit 708 are directly or indirectly electrically connected between each other, to realize the transmission or friendship of data
Mutually.It is electrically connected for example, these elements can be realized between each other by one or more communication bus or signal wire.The streaming
Data processing equipment 701 includes that at least one can be stored in the memory 702 in the form of software or firmware (firmware)
In or the software function module that is solidificated in the operating system (operating system, OS) of stream data processing unit 701.
The processor 704 is used to execute the executable module stored in memory 702, such as stream data processing unit 701 includes
Software function module or computer program.
Wherein, memory 702 may be, but not limited to, random access memory (Random Access Memory,
RAM), read-only memory (Read Only Memory, ROM), programmable read only memory (Programmable Read-Only
Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only Memory, EPROM),
Electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only Memory, EEPROM) etc..
Wherein, memory 702 is for storing program, and the processor 704 executes described program after receiving and executing instruction, aforementioned
Method performed by the server that the stream process that any embodiment of the embodiment of the present invention discloses defines can be applied to processor 704
In, or realized by processor 704.
Processor 704 can be a kind of IC chip, the processing capacity with signal.Above-mentioned processor 704 can
To be general processor, including central processing unit (Central Processing Unit, abbreviation CPU), network processing unit
(Network Processor, abbreviation NP) etc.；Can also be digital signal processor (DSP), specific integrated circuit (ASIC),
Ready-made programmable gate array (FPGA) either other programmable logic device, discrete gate or transistor logic, discrete hard
Part component.It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present invention.General processor
It can be microprocessor or the processor 704 be also possible to any conventional processor etc..
Various input/output devices are couple processor 704 and memory 702 by the Peripheral Interface 705.Some
In embodiment, Peripheral Interface 705, processor 704 and storage control 703 can be realized in one single chip.Other one
In a little examples, they can be realized by independent chip respectively.
Input-output unit 706 realizes user and the server (or local terminal) for being supplied to user input data
Interaction.The input-output unit 706 may be, but not limited to, mouse and keyboard etc..
Audio unit 707 provides a user audio interface, may include one or more microphones, one or more raises
Sound device and voicefrequency circuit.
Display unit 708 provides an interactive interface (such as user interface) between the electronic equipment and user
Or it is referred to for display image data to user.In the present embodiment, the display unit 708 can be liquid crystal display or touching
Control display.It can be the touching of the capacitance type touch control screen or resistance-type of support single-point and multi-point touch operation if touch control display
Control screen etc..Single-point and multi-point touch operation is supported to refer to that touch control display can sense on the touch control display one or more
The touch control operation generated simultaneously at a position, and the touch control operation that this is sensed transfers to processor 704 to be calculated and handled.
Various input/output devices are couple processor 704 and memory 702 by the Peripheral Interface 705.Some
In embodiment, Peripheral Interface 705, processor 704 and storage control 703 can be realized in one single chip.Other one
In a little examples, they can be realized by independent chip respectively.
Input-output unit 706 is used to be supplied to the interaction that user input data realizes user and processing terminal.It is described defeated
Entering output unit 706 may be, but not limited to, mouse and keyboard etc..
It is appreciated that structure shown in Fig. 7 is only to illustrate, the electronic equipment may also include it is more than shown in Fig. 7 or
The less component of person, or with the configuration different from shown in Fig. 7.Each component shown in fig. 7 can using hardware, software or
A combination thereof is realized.
In several embodiments provided herein, it should be understood that disclosed device and method can also pass through
Other modes are realized.The apparatus embodiments described above are merely exemplary, for example, flow chart and block diagram in attached drawing
Show the device of multiple embodiments according to the present invention, the architectural framework in the cards of method and computer program product,
Function and operation.In this regard, each box in flowchart or block diagram can represent the one of a module, section or code
Part, a part of the module, section or code, which includes that one or more is for implementing the specified logical function, to be held
Row instruction.It should also be noted that function marked in the box can also be to be different from some implementations as replacement
The sequence marked in attached drawing occurs.For example, two continuous boxes can actually be basically executed in parallel, they are sometimes
It can execute in the opposite order, this depends on the function involved.It is also noted that every in block diagram and or flow chart
The combination of box in a box and block diagram and or flow chart can use the dedicated base for executing defined function or movement
It realizes, or can realize using a combination of dedicated hardware and computer instructions in the system of hardware.
In addition, each functional module in each embodiment of the present invention can integrate one independent portion of formation together
Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module
It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.
And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field
For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair
Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.It should also be noted that similar label and letter exist
Similar terms are indicated in following attached drawing, therefore, once being defined in a certain Xiang Yi attached drawing, are then not required in subsequent attached drawing
It is further defined and explained.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
Claims (10)
1. a kind of Transmitting Data Stream method characterized by comprising
Multiple stream datas to be transmitted and corresponding attribute information are obtained, the attribute information includes label；
The stream data of same label is packaged, the corresponding data encapsulation package of each label is obtained；
All data encapsulation packages are sent to data processing end by the data transmission channel constructed in advance.
2. the method according to claim 1, wherein obtaining multiple stream datas to be transmitted and corresponding category
Before property information, the method, further includes:
A data transmission channel is constructed, the available resources of default size are reserved in the data transmission channel.
3. the method according to claim 1, wherein obtain the corresponding data encapsulation package of each label it
Afterwards, the method, further includes:
Each data encapsulation package is compressed.
4. a kind of stream data processing method characterized by comprising
Receive the multiple data encapsulation packages transmitted by a data transmission channel, wherein the data encapsulation package includes multiple
Stream data and corresponding attribute information, the attribute information include label；
Unpacking processing is carried out to corresponding data encapsulation package according to the label, obtains the corresponding category of the data encapsulation package
Property information and the stream data.
5. according to the method described in claim 4, it is characterized in that, the attribute information further includes processing mode；Correspondingly,
After obtaining the corresponding attribute information of the data encapsulation package and the stream data, the method, further includes:
The stream data is handled according to the processing mode.
6. a kind of Transmitting Data Stream device characterized by comprising
Module is obtained, for obtaining multiple stream datas to be transmitted and corresponding attribute information, the attribute information includes mark
Label；
Package module is packaged for the stream data to same label, obtains the corresponding data encapsulation of each label
Packet；
All data encapsulation packages are sent to number for a data transmission channel by constructing in advance by transmission module
According to processing end.
7. device according to claim 6, which is characterized in that described device, further includes:
Channel constructs module, for constructing a data transmission channel, reserves in the data transmission channel default big
Small available resources.
8. device according to claim 6, which is characterized in that described device, further includes:
Compression module, for being compressed to each data encapsulation package.
9. a kind of stream data processing unit characterized by comprising
Receiving module, for receiving the multiple data encapsulation packages for passing through a data transmission channel and transmitting, wherein the data envelope
Dress packet includes multiple stream datas and corresponding attribute information, and the attribute information includes label；
Module is unpacked, for carrying out unpacking processing to corresponding data encapsulation package according to the label, obtains the data encapsulation
Wrap the corresponding attribute information and the stream data.
10. device according to claim 9, which is characterized in that the attribute information further includes processing mode；Correspondingly,
Described device, further includes:
Processing module, for being handled according to the processing mode the stream data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810803187.7A CN108989314A (en) | 2018-07-20 | 2018-07-20 | A kind of Transmitting Data Stream, processing method and processing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810803187.7A CN108989314A (en) | 2018-07-20 | 2018-07-20 | A kind of Transmitting Data Stream, processing method and processing device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108989314A true CN108989314A (en) | 2018-12-11 |
Family
ID=64550044
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810803187.7A Pending CN108989314A (en) | 2018-07-20 | 2018-07-20 | A kind of Transmitting Data Stream, processing method and processing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108989314A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023020503A1 (en) * | 2021-08-19 | 2023-02-23 | Oppo广东移动通信有限公司 | Image processing chip, method, application processing chip, and electronic device |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101631128A (en) * | 2009-08-19 | 2010-01-20 | 中兴通讯股份有限公司 | Method and device for transmitting stream media data |
| CN102420872A (en) * | 2011-12-06 | 2012-04-18 | 公安部交通管理科学研究所 | Hyper text transfer protocol (HTTP)-data-stream-based transmission management framework |
| CN102595199A (en) * | 2011-01-11 | 2012-07-18 | 中兴通讯股份有限公司 | Streaming media packet packaging and transmitting method, and streaming media processing device |
| CN102611719A (en) * | 2011-01-21 | 2012-07-25 | 汽车零部件研究及发展中心有限公司 | Vehicle-mounted MOST (Media Oriented Systems Transport) network system |
| CN103179162A (en) * | 2011-12-23 | 2013-06-26 | 阿里巴巴集团控股有限公司 | Method and system for outputting log |
| CN103401934A (en) * | 2013-08-06 | 2013-11-20 | 广州唯品会信息科技有限公司 | Method and system for acquiring log data |
| CN103617287A (en) * | 2013-12-12 | 2014-03-05 | 用友软件股份有限公司 | Log management method and device in distributed environment |
| US8788817B1 (en) * | 2011-09-30 | 2014-07-22 | Emc Corporation | Methods and apparatus for secure and reliable transmission of messages over a silent alarm channel |
| CN104424144A (en) * | 2013-08-21 | 2015-03-18 | 展讯通信（上海）有限公司 | Log data processing system and processing method |
| CN104601489A (en) * | 2015-02-02 | 2015-05-06 | 迈普通信技术股份有限公司 | Log block transmitting method and apparatus |
| CN105872579A (en) * | 2015-12-23 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Streaming media live broadcast method, releasing terminal, client and system |
| CN106095965A (en) * | 2016-06-17 | 2016-11-09 | 上海智臻智能网络科技股份有限公司 | A kind of data processing method and device |
| WO2016187967A1 (en) * | 2015-05-28 | 2016-12-01 | 中兴通讯股份有限公司 | Method and apparatus for realizing log transmission |
| CN108197233A (en) * | 2017-12-29 | 2018-06-22 | 飞狐信息技术（天津）有限公司 | A kind of data managing method, middleware and data management system |
-
2018
- 2018-07-20 CN CN201810803187.7A patent/CN108989314A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101631128A (en) * | 2009-08-19 | 2010-01-20 | 中兴通讯股份有限公司 | Method and device for transmitting stream media data |
| CN102595199A (en) * | 2011-01-11 | 2012-07-18 | 中兴通讯股份有限公司 | Streaming media packet packaging and transmitting method, and streaming media processing device |
| CN102611719A (en) * | 2011-01-21 | 2012-07-25 | 汽车零部件研究及发展中心有限公司 | Vehicle-mounted MOST (Media Oriented Systems Transport) network system |
| US8788817B1 (en) * | 2011-09-30 | 2014-07-22 | Emc Corporation | Methods and apparatus for secure and reliable transmission of messages over a silent alarm channel |
| CN102420872A (en) * | 2011-12-06 | 2012-04-18 | 公安部交通管理科学研究所 | Hyper text transfer protocol (HTTP)-data-stream-based transmission management framework |
| CN103179162A (en) * | 2011-12-23 | 2013-06-26 | 阿里巴巴集团控股有限公司 | Method and system for outputting log |
| CN103401934A (en) * | 2013-08-06 | 2013-11-20 | 广州唯品会信息科技有限公司 | Method and system for acquiring log data |
| CN104424144A (en) * | 2013-08-21 | 2015-03-18 | 展讯通信（上海）有限公司 | Log data processing system and processing method |
| CN103617287A (en) * | 2013-12-12 | 2014-03-05 | 用友软件股份有限公司 | Log management method and device in distributed environment |
| CN104601489A (en) * | 2015-02-02 | 2015-05-06 | 迈普通信技术股份有限公司 | Log block transmitting method and apparatus |
| WO2016187967A1 (en) * | 2015-05-28 | 2016-12-01 | 中兴通讯股份有限公司 | Method and apparatus for realizing log transmission |
| CN105872579A (en) * | 2015-12-23 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Streaming media live broadcast method, releasing terminal, client and system |
| CN106095965A (en) * | 2016-06-17 | 2016-11-09 | 上海智臻智能网络科技股份有限公司 | A kind of data processing method and device |
| CN108197233A (en) * | 2017-12-29 | 2018-06-22 | 飞狐信息技术（天津）有限公司 | A kind of data managing method, middleware and data management system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023020503A1 (en) * | 2021-08-19 | 2023-02-23 | Oppo广东移动通信有限公司 | Image processing chip, method, application processing chip, and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106302008B (en) | Data-updating method and device | |
| CN107133174A (en) | Test case code automatically generating device and method | |
| CN108280119A (en) | Page generation method, device and user terminal | |
| CN108038212B (en) | Data interaction method, device, system, equipment and storage medium | |
| CN109873735A (en) | Performance test methods, device and the computer equipment of the H5 page | |
| CN108900434A (en) | Data collection distribution method and device | |
| CN104253842B (en) | Method, apparatus, terminal and the server of synchronous terminal mirror image | |
| CN103246606B (en) | The performance test methods of ESB platform and system | |
| CN107357726A (en) | A kind of application compatibility method of testing and device | |
| CN109756568A (en) | Processing method, equipment and the computer readable storage medium of file | |
| CN104639423A (en) | Information interaction method, information interaction device and terminals | |
| CN104679627A (en) | Testing method and device | |
| CN103488696B (en) | CPE service inquiry method, apparatus and system, ACS and CPE | |
| CN104679391B (en) | The icon display method and device of intelligent watch | |
| CN106649342A (en) | Data processing method and apparatus in data acquisition platform | |
| CN107102950A (en) | A kind of applied program testing method and device | |
| CN109446648A (en) | Service of simulation method for building up and device | |
| CN102904918A (en) | Method and system for processing display of network media information | |
| CN108197002A (en) | Mobile equipment is without burying point data statistical method, system, terminal and medium | |
| CN108989314A (en) | A kind of Transmitting Data Stream, processing method and processing device | |
| CN108205487A (en) | A kind of method, apparatus and user terminal for monitoring browser performance | |
| CN108388616A (en) | Transacter, method, system and computer readable storage medium | |
| CN109561048B (en) | Communication management method and device | |
| CN104954280B (en) | A kind of data message processing method and device | |
| Iglesias et al. | Enabling powerful GUIs in ISOBUS networks by transparent data compression |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181211 |