CN108153803A - A kind of data capture method, device and electronic equipment - Google Patents
A kind of data capture method, device and electronic equipment Download PDFInfo
- Publication number
- CN108153803A CN108153803A CN201711143069.XA CN201711143069A CN108153803A CN 108153803 A CN108153803 A CN 108153803A CN 201711143069 A CN201711143069 A CN 201711143069A CN 108153803 A CN108153803 A CN 108153803A
- Authority
- CN
- China
- Prior art keywords
- data
- live broadcast
- broadcast service
- class
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
Abstract
An embodiment of the present invention provides a kind of data capture method, device and electronic equipment, wherein, method includes：Receive live broadcast service request；Live broadcast service request is converted into logical description sentence；According to the logical description sentence, the live broadcast service is obtained from the database preserved and asks requested business datum, wherein, database real-time reception simultaneously preserves the initial data that multiple service nodes generate.Data capture method, device and the electronic equipment provided through the embodiment of the present invention, can reduce the time overhead in data acquisition.
Description
Technical field
The present invention relates to technical field of data processing, more particularly to a kind of data capture method, device and electronic equipment.
Background technology
With the development of business, more and more live broadcast service requests need to expire from server-side acquisition more piece point data
Foot, for example, the data of multiple service systems.
In existing method, to be asked for the live broadcast service of client, server-side calls the data that multiple service nodes generate,
And the data of multiple service nodes are combined, and then the live broadcast service for obtaining meeting client asks requested data.
However, inventor has found in the implementation of the present invention, at least there are the following problems for the prior art：
Data is called to need repeatedly to call and be combined the data of multiple service nodes from multiple service nodes,
The excessive time can be occupied so that time overhead is bigger in data acquisition.
Invention content
The embodiment of the present invention is designed to provide a kind of data capture method, device and electronic equipment, to reduce data
Time overhead in acquisition process.Specific technical solution is as follows：
In a first aspect, an embodiment of the present invention provides a kind of data capture method, including：
Receive live broadcast service request；
Live broadcast service request is converted into logical description sentence；
According to the logical description sentence, the live broadcast service is obtained from the database preserved and asks requested industry
Business data, wherein, the database real-time reception simultaneously preserves the initial data that multiple service nodes generate.
Optionally, the step of initial data being preserved to the database, including：
The initial data is obtained, the initial data includes：Text class data, video class data and audio class number
According to；
Determine the type of the initial data, the type includes：Text class, video class and audio class；
According to the difference of each original data type, type label, the type mark are added to each initial data
Label include：Text class label, video class label and audio class label；
According to the difference of the type label, initial data classification is preserved into the database.
Optionally, according to the logical description sentence, the live broadcast service request institute is obtained from the database preserved
The step of business datum of request, including：
According to the logical description sentence, the classification belonging to business datum to be obtained is determined, the classification includes：Text
Class, video class and audio class；
According to the classification, in the initial data for corresponding to classification from the database preserved, the live broadcast service is obtained
Ask requested business datum.
Optionally, the reception live broadcast service request includes：
Receive the live broadcast service request that client is sent；
It obtains from the database preserved after the live broadcast service asks requested business datum described, also wraps
It includes：
The business datum is sent to the client.
Optionally, the database includes Couchbase, described that live broadcast service request is converted to logical description language
The step of sentence, including：
By relationship description language N1QL, the live broadcast service request is analyzed, live broadcast service request is converted to and is patrolled
Collect descriptive statement.
Second aspect, an embodiment of the present invention provides a kind of data acquisition facility, including：
Receiving module, for receiving live broadcast service request；
Modular converter, for live broadcast service request to be converted to logical description sentence；
First acquisition module, for according to the logical description sentence, the live streaming to be obtained from the database preserved
The requested business datum of service request, wherein, the database real-time reception simultaneously preserves the original of multiple service nodes generations
Data.
Optionally, described device further includes：
Second acquisition module, for obtaining the initial data, the initial data includes：Text class data, video class
Data and audio related data；
Determining module, for determining the type of the initial data, the type includes：Text class, video class and sound
Frequency class；
For the difference according to each original data type, type mark is added to each initial data for add module
Label, the type label include：Text class label, video class label and audio class label；
For the difference according to the type label, initial data classification is preserved to the data for preserving module
In library.
Optionally, first acquisition module, including：
Determination sub-module, it is described for according to the logical description sentence, determining the classification belonging to business datum to be obtained
Classification includes：Text class, video class and audio class；
Acquisition submodule, for according to the classification, in the initial data for corresponding to classification from the database preserved, obtaining
The live broadcast service is taken to ask requested business datum.
Optionally, the receiving module, the live broadcast service sent specifically for receiving client are asked；
Described device further includes：
Sending module, for the business datum to be sent to the client.
Optionally, the database includes Couchbase, the modular converter, specifically for passing through relationship description language
N1QL, analyzes the live broadcast service request, and live broadcast service request is converted to logical description sentence.
The third aspect, an embodiment of the present invention provides a kind of electronic equipment, including processor, communication interface, memory and
Communication bus, wherein, processor, communication interface, memory completes mutual communication by communication bus；
Memory, for storing computer program；
Processor during for performing the program stored on memory, realizes the method and step described in first aspect.
At the another aspect that the present invention is implemented, a kind of computer readable storage medium is additionally provided, it is described computer-readable
Instruction is stored in storage medium, when run on a computer so that computer performs the side described in above-mentioned first aspect
Method step.
At the another aspect that the present invention is implemented, the embodiment of the present invention additionally provides a kind of computer program production comprising instruction
Product, when run on a computer so that computer performs the method and step described in above-mentioned first aspect.
Data capture method provided in an embodiment of the present invention, device and electronic equipment, are asked corresponding by live broadcast service
Logical description sentence directly gets live broadcast service from database and asks requested business datum, it is no longer necessary to receive
After being asked to live broadcast service, repeatedly called from multiple service nodes and be combined the data called.So drop
Time overhead in low data acquisition；Meanwhile it in the live broadcast service request stringenter to time requirement, improves
Real-time.In addition, for being only that parameter has differences the request of equivalent type live broadcast service, without repeatedly call, combining
Process reduces the wasting of resources.Certainly, it implements any of the products of the present invention or method must be not necessarily required to reach described above simultaneously
All advantages.
Description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described.
Fig. 1 is a kind of flow chart of data capture method provided in an embodiment of the present invention；
Fig. 2 is to preserve initial data to the flow chart of database in the embodiment of the present invention；
Fig. 3 is another flow chart of data capture method provided in an embodiment of the present invention；
Fig. 4 is the flow chart of specific embodiment provided in an embodiment of the present invention；
Fig. 5 is the structure diagram of data acquisition facility provided in an embodiment of the present invention；
Fig. 6 is the structure diagram of electronic equipment provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is described.
With the development of business, more and more service requests need to meet from server-side acquisition more piece point data.
So for service request, server-side calls data from multiple and different service systems, then obtained data will be called to carry out
Combination obtains the requested data of service request.But data are called from multiple service systems and are combined data
So that time overhead is too big.And some service requests are stringenter to time requirement, for example, video class live broadcast service etc..
In addition, there are objective laws for the service request of different clients, server-side is within certain a period of time for certain one kind
Business, such as：Different clients are returned to for same live streaming, i.e., different users is identical data.But because not
With client in the parameter of identical service request there may be difference, although the data finally returned that are identical,
Be directed to the service request of each client, server-side is required for repeatedly being called, then by the data obtained after calling into
Row combination can just obtain the data for meeting client traffic request, in this way, causing the repetitive operation of server-side, on the one hand make
The expense of time is excessive into data acquisition；On the other hand, the waste of resource is also resulted in.
In order to reduce the waste of the expense and resource of time in data acquisition, preferably meet service request, originally
Inventive embodiments provide a kind of data capture method, mainly in live broadcast service.Pass through the multiple service nodes of real-time reception
The initial data of generation, and the initial data is preserved into database；After live broadcast service request is received, the live streaming is analyzed
Live broadcast service request is converted to logical description sentence, and then according to logical description sentence, from the number preserved by service request
Requested business datum is asked according to the live broadcast service is obtained in library.In this way, by logical description sentence, the relationship of data is used
Structure assembles being described property of data so that can disposably obtain live broadcast service according to logical description sentence and ask
The business datum asked reduces the time overhead in data acquisition；It is also possible to reduce the waste to resource.
An embodiment of the present invention provides a kind of data capture method, as shown in Figure 1, including：
S101 receives live broadcast service request.
Method provided in an embodiment of the present invention can be applied to electronic equipment.Specifically, the electronic equipment can be desk-top
Computer, portable computer, intelligent mobile terminal etc..
Live broadcast service request is converted to logical description sentence by S102.
Similar to the process of programming, live broadcast service request is converted to logical description sentence by analysis live broadcast service request.
Specifically, can live broadcast service request be converted to by logical description sentence to realize by programming language etc..
S103 according to logical description sentence, the live broadcast service is obtained from the database preserved and asks requested industry
Business data, wherein, database real-time reception simultaneously preserves the initial data that multiple service nodes generate.
The initial data that multiple service nodes generate is preserved into database in real time.For example, table can be passed through
Form preserves the initial data for coming from multiple service nodes into database, as shown in table 1 below.Can also specifically it pass through
The corresponding IP of service node (Internet Protocol, the network transmission protocol) address etc. identifies different service nodes.
Table 1
In addition, live broadcast service is in real time, historical data will not generate too much influence to current live broadcast service.So
In practical application process, the initial data generated in preset time period can be only preserved in database, it will be in preset time
The initial data of preservation before section is removed in real time.For example, preserving the initial data generated in nearest 3 days, will be preserved before 3 days
Initial data be purged.The problems such as so, it is possible that the continuous increase of initial data is avoided to cause database space insufficient.
The mode that data are preserved in database is identical with the rule of used logical description sentence.In this way, according to live streaming
The corresponding logical description sentence of service request can obtain the live broadcast service from the database preserved and ask requested industry
Business data.Specifically, corresponding logical description sentence is asked by live broadcast service, which is asked into requested data
Being described property assembles, in this way, can directly get live broadcast service request institute after the assembling of being described property from database
The business datum of request.
For example, specifically live broadcast service is asked, corresponding logical description sentence is local query=after converting
String.format (' select cache_name.*from cache_name where data.x=%s'..'and
data.entry.a>=%s000and data.entry.b<=%s000'..'and data.entry.c>=%
s000and data.entry.c<=%s000order by data.entry.c desc limit 1', lc, ngx_now_
Low_3, ngx_now, ngx_now, ngx_now_hight_3), perform the inquiry of N1QL sentences：Local value, err=
client:Query (query), the value so got are that live broadcast service asks requested business datum.
Data capture method provided in an embodiment of the present invention asks corresponding logical description sentence, directly by live broadcast service
It connects and the requested business datum of live broadcast service request is got from database, it is no longer necessary to receive live broadcast service request
Afterwards, it is repeatedly called from multiple service nodes and is combined the data called.So reduce data acquisition mistake
Time overhead in journey.
In a kind of optional embodiment of the embodiment of the present invention, database can include Couchbase.Relationship can be passed through
Description language N1QL, analysis live broadcast service request ask the live broadcast service to be converted to the logical description sentence of N1QL expressions.
N1QL is that SQL (Structured Query Language, structured query language) is introduced document data bank
Query language, N1QL can to do not meet first normal form data model JSON (JavaScript Object Notation,
JavaScript object representation) it is operated, N1QL can expand traditional SQL to JSON the operation of table and row etc..
In data capture method provided in an embodiment of the present invention, live broadcast service request is converted to by logical description by N1QL
Sentence can realize the descriptive assembling to data, reduce the time overhead in data acquisition and the wasting of resources, and
Because traditional SQL can expand the operation of table and row etc. the complication, various that JSON, can so support data by N1QL
Change.Meanwhile be combined N1QL and Couchbase, the service access number similar to live broadcast service request etc. is effectively reduced,
Improve real-time.
In a kind of optional embodiment of the embodiment of the present invention, as shown in Fig. 2, preserving initial data to the step of database
Suddenly, including：
S201 obtains initial data.
Initial data can include：Text class data, video class data and audio related data etc..
S202 determines the type of initial data.
The type of initial data can include：Text class, video class and audio class etc..
For example, when initial data is text class data, the type for determining initial data is text class；When initial data be regarding
Frequency class data, the type for determining initial data are video class；When initial data is audio related data, the type of initial data is determined
For audio class.
According to the difference of each original data type, type label is added to each initial data by S203.
Type label can include：Text class label, video class label and audio class label etc..
The type for the initial data that service node generates is possible to different, in order to sort data into guarantor in the database
It deposits, different types of initial data can be directed to, add different type labels.For example, when the type for determining initial data is
Text class adds text class label to the initial data；When determining that the type of initial data for video class, adds the initial data
Add video class label；When determining the type of initial data as audio class, audio class label is added to initial data.
According to the difference of type label, initial data classification is preserved into database by S204.
Specifically, initial data can be preserved into database according to form as shown in Table 2, wherein, the class in table 2
Type label 1, type label 2, type label 3 can be text class label, video class label or audio class label etc..
Table 2
In a kind of optional embodiment of the embodiment of the present invention, according to logical description sentence, from the database preserved
The step of live broadcast service asks requested business datum is obtained, as shown in figure 3, including：
S301 according to logical description sentence, determines the classification belonging to business datum to be obtained.
Classification belonging to business datum to be obtained is it can be appreciated that the type of business datum to be obtained.Classification can wrap
It includes：Text class, video class and audio class etc..
The corresponding live broadcast service of the logical description sentence represented in analysis logical description sentence asks requested data
Affiliated classification.For example, asking corresponding logical description sentence for live broadcast service, determine that live broadcast service asks requested number
According to namely business datum to be obtained belonging to classification for video class data, audio related data etc..
S302, according to the category, in the initial data for corresponding to classification from the database preserved, obtaining live broadcast service please
Seek requested business datum.
According to the classification belonging to business datum to be obtained, directly matched with the classification in database, it specifically can be with
It is matched with type label, in corresponding to the initial data of classification in the database preserved, obtains live broadcast service request institute
The business datum of request.
For example, when it is the 1 corresponding type of type label in table 2 to determine the classification belonging to business datum to be obtained, first
1 corresponding data of all types label are determined in the database, for example, initial data 1；Then it is corresponded to again from type label 1
Data in obtain the live broadcast service and ask requested business datum.
In this way, according to the classification of data, required data are rapidly found, without all numbers preserved from database
The requested matched initial data of business datum is asked with live broadcast service according to middle lookup, improves the speed of data acquisition
Rate.
The embodiment of the present invention additionally provides specific embodiment, as shown in Figure 4.
The data of generation are sent to acquisition data module by multiple service nodes in real time, which is initial data,
Multiple service nodes can include infrastructure service node, other service nodes etc..Data module is obtained to lead to the data got
It crosses data-pushing module to be sent in database Couchbase, data can be according to type, space size in Couchbase
Deng saving as the first data, second data etc. respectively.It is, of course, also possible to it saves the data in multiple Couchbase.It is so real
Now the data of multiple service nodes are preserved in the database in real time.
Client sends live broadcast service request to server-side, and server-side receives live broadcast service request, analyzes the live streaming
Live broadcast service request is converted to the logical description sentence of N1QL expressions by service request.Specifically, the front end machine of server-side
Nginx, by relationship description language N1QL, live broadcast service request is converted to N1QL expressions by analysis live broadcast service request
Logical description sentence.Then, according to logical description sentence, the live broadcast service is obtained from the database preserved and is asked
Business datum.Finally, the business datum got is sent to client.
In data capture method provided in an embodiment of the present invention, the data that multiple service nodes generate are stored in number in real time
According in library, server-side is converted to live broadcast service request corresponding after the live broadcast service request of client transmission is received
Logical description sentence according to logical description sentence, the live broadcast service is directly acquired from database and asks requested business number
According to can realize the descriptive assembling to data, reduce the time overhead in data acquisition.
An embodiment of the present invention provides a kind of data acquisition facility, as shown in figure 5, including：
Receiving module 501, for receiving live broadcast service request；
Modular converter 502, for live broadcast service request to be converted to logical description sentence；
First acquisition module 503, for according to logical description sentence, obtaining live broadcast service from the database preserved please
Requested business datum is sought, wherein, database real-time reception simultaneously preserves the initial data that multiple service nodes generate.
Data acquisition facility provided in an embodiment of the present invention asks corresponding logical description sentence, directly by live broadcast service
It connects and the requested business datum of live broadcast service request is got from database, it is no longer necessary to receive live broadcast service request
Afterwards, it is repeatedly called from multiple service nodes and is combined the data called.So reduce data acquisition mistake
Time overhead in journey.
Optionally, which further includes：
Second acquisition module, for obtaining the initial data, the initial data includes：Text class data, video class
Data and audio related data；
Determining module, for determining the type of the initial data, the type includes：Text class, video class and sound
Frequency class；
For the difference according to each original data type, type label, the class are added to each initial data for add module
Type label includes：Text class label, video class label and audio class label；
For the difference according to type label, initial data classification is preserved into database for preserving module.
Optionally, the first acquisition module 503, including：
Determination sub-module, for according to logical description sentence, determining the classification belonging to business datum to be obtained, the classification
Including：Text class, video class and audio class；
Acquisition submodule, for according to the classification, in the initial data for corresponding to classification from the database preserved, obtaining
Cut-off broadcasts the requested business datum of service request.
Optionally, receiving module 501, the live broadcast service sent specifically for receiving client are asked；
The device, further includes：
Sending module, for business datum to be sent to client.
Optionally, database include Couchbase, modular converter 502, specifically for passing through relationship description language N1QL,
Live broadcast service request is analyzed, live broadcast service request is converted into logical description sentence.
It should be noted that the data acquisition facility of the embodiment of the present invention is the device using above-mentioned data capture method,
Then all embodiments of above-mentioned data capture method are suitable for the device, and can reach the same or similar advantageous effect.
The embodiment of the present invention additionally provides a kind of electronic equipment, as shown in fig. 6, including processor 601, communication interface 602,
Memory 603 and communication bus 604, wherein, processor 601, communication interface 602, memory 603 is complete by communication bus 604
Into mutual communication,
Memory 603, for storing computer program；
Processor 601 during for performing the program stored on memory 603, realizes the side of above-mentioned data capture method
Method step.
The communication bus that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral Component
Interconnect, abbreviation PCI) bus or expanding the industrial standard structure (Extended Industry Standard
Architecture, abbreviation EISA) bus etc..The communication bus can be divided into address bus, data/address bus, controlling bus etc..
For ease of representing, only represented in figure with a thick line, it is not intended that an only bus or a type of bus.
Communication interface is for the communication between above-mentioned electronic equipment and other equipment.
Memory can include random access memory (Random Access Memory, abbreviation RAM), can also include
Nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.Optionally, memory may be used also
To be at least one storage device for being located remotely from aforementioned processor.
Above-mentioned processor can be general processor, including central processing unit (Central Processing Unit,
Abbreviation CPU), network processing unit (Network Processor, abbreviation NP) etc.；It can also be digital signal processor
(Digital Signal Processing, abbreviation DSP), application-specific integrated circuit (Application Specific
Integrated Circuit, abbreviation ASIC), field programmable gate array (Field-Programmable Gate Array,
Abbreviation FPGA) either other programmable logic device, discrete gate or transistor logic, discrete hardware components.
Electronic equipment provided in an embodiment of the present invention asks corresponding logical description sentence by live broadcast service, directly from
Live broadcast service is got in database and asks requested business datum, it is no longer necessary to after live broadcast service request is received, from
It is repeatedly called in multiple service nodes and is combined the data called.So reduce in data acquisition
Time overhead.
In another embodiment provided by the invention, a kind of computer readable storage medium is additionally provided, which can
It reads to be stored with instruction in storage medium, when run on a computer so that computer performs any institute in above-described embodiment
The data capture method stated.
Computer readable storage medium provided in an embodiment of the present invention asks corresponding logical description language by live broadcast service
Sentence directly gets live broadcast service from database and asks requested business datum, it is no longer necessary to receive live broadcast service
After request, repeatedly called from multiple service nodes and be combined the data called.So data are reduced to obtain
Time overhead during taking.
In another embodiment provided by the invention, a kind of computer program product for including instruction is additionally provided, when it
When running on computers so that computer performs any data capture method in above-described embodiment.
Computer program product provided in an embodiment of the present invention asks corresponding logical description sentence by live broadcast service,
Live broadcast service is directly got from database and asks requested business datum, it is no longer necessary to receive live broadcast service request
Afterwards, it is repeatedly called from multiple service nodes and is combined the data called.So reduce data acquisition mistake
Time overhead in journey.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or its arbitrary combination real
It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer program
Product includes one or more computer instructions.When loading on computers and performing the computer program instructions, all or
It partly generates according to the flow or function described in the embodiment of the present invention.The computer can be all-purpose computer, special meter
Calculation machine, computer network or other programmable devices.The computer instruction can be stored in computer readable storage medium
In or from a computer readable storage medium to another computer readable storage medium transmit, for example, the computer
Instruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data center
User's line (DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer, server or
Data center is transmitted.The computer readable storage medium can be any usable medium that computer can access or
It is the data storage devices such as server, the data center integrated comprising one or more usable mediums.The usable medium can be with
It is magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid state disk
Solid State Disk (SSD)) etc..
It should be noted that herein, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any this practical relationship or sequence.Moreover, term " comprising ", "comprising" or its any other variant are intended to
Non-exclusive inclusion, so that process, method, article or equipment including a series of elements not only will including those
Element, but also including other elements that are not explicitly listed or further include as this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
Also there are other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is described using relevant mode, identical similar portion between each embodiment
Point just to refer each other, and the highlights of each of the examples are difference from other examples.Especially for system reality
For applying example, since it is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method
Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention
It is interior.
Claims (11)
1. a kind of data capture method, which is characterized in that including：
Receive live broadcast service request；
Live broadcast service request is converted into logical description sentence；
According to the logical description sentence, the live broadcast service is obtained from the database preserved and asks requested business number
According to, wherein, the database real-time reception simultaneously preserves the initial data that multiple service nodes generate.
2. according to the method described in claim 1, it is characterized in that, the initial data is preserved to the step of the database
Suddenly, including：
The initial data is obtained, the initial data includes：Text class data, video class data and audio related data；
Determine the type of the initial data, the type includes：Text class, video class and audio class；
According to the difference of each original data type, type label, the type label packet are added to each initial data
It includes：Text class label, video class label and audio class label；
According to the difference of the type label, initial data classification is preserved into the database.
3. according to the method described in claim 2, it is characterized in that, according to the logical description sentence, from the data preserved
The step of live broadcast service asks requested business datum is obtained in library, including：
According to the logical description sentence, the classification belonging to business datum to be obtained is determined, the classification includes：Text class regards
Frequency class and audio class；
According to the classification, in the initial data for corresponding to classification from the database preserved, the live broadcast service request is obtained
Requested business datum.
4. according to the method described in claim 1, it is characterized in that, the reception live broadcast service request includes：
Receive the live broadcast service request that client is sent；
It obtains after the live broadcast service asks requested business datum, further includes from the database preserved described：
The business datum is sent to the client.
5. method according to any one of claims 1 to 4, which is characterized in that the database includes Couchbase, institute
The step of live broadcast service request is converted into logical description sentence is stated, including：
By relationship description language N1QL, the live broadcast service request is analyzed, live broadcast service request is converted to logic retouches
Predicate sentence.
6. a kind of data acquisition facility, which is characterized in that including：
Receiving module, for receiving live broadcast service request；
Modular converter, for live broadcast service request to be converted to logical description sentence；
First acquisition module, for according to the logical description sentence, the live broadcast service to be obtained from the database preserved
Requested business datum is asked, wherein, the database real-time reception simultaneously preserves the initial data that multiple service nodes generate.
7. device according to claim 6, which is characterized in that described device further includes：
Second acquisition module, for obtaining the initial data, the initial data includes：Text class data, video class data
And audio related data；
Determining module, for determining the type of the initial data, the type includes：Text class, video class and audio class；
For the difference according to each original data type, type label, institute are added to each initial data for add module
Type label is stated to include：Text class label, video class label and audio class label；
For the difference according to the type label, initial data classification is preserved into the database for preserving module.
8. device according to claim 7, which is characterized in that first acquisition module, including：
Determination sub-module, for according to the logical description sentence, determining the classification belonging to business datum to be obtained, the classification
Including：Text class, video class and audio class；
Acquisition submodule, for according to the classification, in the initial data for corresponding to classification from the database preserved, obtaining institute
It states live broadcast service and asks requested business datum.
9. device according to claim 6, which is characterized in that the receiving module is sent specifically for receiving client
Live broadcast service request；
Described device further includes：
Sending module, for the business datum to be sent to the client.
10. according to claim 6 to 9 any one of them device, which is characterized in that the database includes Couchbase, institute
Modular converter is stated, specifically for passing through relationship description language N1QL, the live broadcast service request is analyzed, the live broadcast service is asked
It asks and is converted to logical description sentence.
11. a kind of electronic equipment, which is characterized in that including processor, communication interface, memory and communication bus, wherein, processing
Device, communication interface, memory complete mutual communication by communication bus；
Memory, for storing computer program；
Processor during for performing the program stored on memory, realizes any method and steps of claim 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711143069.XA CN108153803B (en) | 2017-11-17 | 2017-11-17 | Data acquisition method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711143069.XA CN108153803B (en) | 2017-11-17 | 2017-11-17 | Data acquisition method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108153803A true CN108153803A (en) | 2018-06-12 |
| CN108153803B CN108153803B (en) | 2021-04-02 |
Family
ID=62467974
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711143069.XA Active CN108153803B (en) | 2017-11-17 | 2017-11-17 | Data acquisition method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108153803B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109064806A (en) * | 2018-09-26 | 2018-12-21 | 北京奇艺世纪科技有限公司 | A kind of video system with instructional function, implementation method and electronic equipment |
| CN109241157A (en) * | 2018-08-02 | 2019-01-18 | 中央电视台 | Data calling method, device, communication equipment and storage medium |
| CN110032608A (en) * | 2019-04-22 | 2019-07-19 | 江苏满运软件科技有限公司 | Information assemble method, device, storage medium and the electronic equipment of system data |
| CN110866107A (en) * | 2019-10-12 | 2020-03-06 | 浙江大搜车软件技术有限公司 | Method and device for generating material corpus, computer equipment and storage medium |
| CN111680108A (en) * | 2019-03-11 | 2020-09-18 | 杭州海康威视数字技术股份有限公司 | Data storage method and device and data acquisition method and device |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102572215A (en) * | 2011-12-14 | 2012-07-11 | 深圳市贝尔信智能系统有限公司 | City-class visual video analysis method and server |
| CN104301773A (en) * | 2014-09-28 | 2015-01-21 | 四川长虹电器股份有限公司 | Method for making network broadcast channel playing and DTV channel playing compatible |
| CN104935949A (en) * | 2015-06-18 | 2015-09-23 | 深圳市茁壮网络股份有限公司 | Method, device and system for downloading live broadcast video data |
| CN105338026A (en) * | 2014-07-24 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Data resource acquisition method, device and system |
| CN105451096A (en) * | 2015-12-02 | 2016-03-30 | 北京暴风科技股份有限公司 | Webcast system and webcast method |
| CN105847398A (en) * | 2016-04-25 | 2016-08-10 | 乐视控股（北京）有限公司 | Business scheduling method, scheduling server and business server |
| CN105898372A (en) * | 2015-12-15 | 2016-08-24 | 乐视云计算有限公司 | Live video to video-on-demand method and system |
| CN106303553A (en) * | 2016-08-25 | 2017-01-04 | 安徽协创物联网技术有限公司 | A kind of network direct broadcasting plateform system |
| CN106534978A (en) * | 2016-10-14 | 2017-03-22 | 乐视控股（北京）有限公司 | Live program state updating method and device |
| CN106951573A (en) * | 2017-04-27 | 2017-07-14 | 努比亚技术有限公司 | A kind of living broadcast interactive data load method, server and computer-readable medium |
| US20170228600A1 (en) * | 2014-11-14 | 2017-08-10 | Clipmine, Inc. | Analysis of video game videos for information extraction, content labeling, smart video editing/creation and highlights generation |
| CN107071506A (en) * | 2017-03-17 | 2017-08-18 | 武汉斗鱼网络科技有限公司 | A kind of method and system for pushing barrage |
-
2017
- 2017-11-17 CN CN201711143069.XA patent/CN108153803B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102572215A (en) * | 2011-12-14 | 2012-07-11 | 深圳市贝尔信智能系统有限公司 | City-class visual video analysis method and server |
| CN105338026A (en) * | 2014-07-24 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Data resource acquisition method, device and system |
| CN104301773A (en) * | 2014-09-28 | 2015-01-21 | 四川长虹电器股份有限公司 | Method for making network broadcast channel playing and DTV channel playing compatible |
| US20170228600A1 (en) * | 2014-11-14 | 2017-08-10 | Clipmine, Inc. | Analysis of video game videos for information extraction, content labeling, smart video editing/creation and highlights generation |
| CN104935949A (en) * | 2015-06-18 | 2015-09-23 | 深圳市茁壮网络股份有限公司 | Method, device and system for downloading live broadcast video data |
| CN105451096A (en) * | 2015-12-02 | 2016-03-30 | 北京暴风科技股份有限公司 | Webcast system and webcast method |
| CN105898372A (en) * | 2015-12-15 | 2016-08-24 | 乐视云计算有限公司 | Live video to video-on-demand method and system |
| CN105847398A (en) * | 2016-04-25 | 2016-08-10 | 乐视控股（北京）有限公司 | Business scheduling method, scheduling server and business server |
| CN106303553A (en) * | 2016-08-25 | 2017-01-04 | 安徽协创物联网技术有限公司 | A kind of network direct broadcasting plateform system |
| CN106534978A (en) * | 2016-10-14 | 2017-03-22 | 乐视控股（北京）有限公司 | Live program state updating method and device |
| CN107071506A (en) * | 2017-03-17 | 2017-08-18 | 武汉斗鱼网络科技有限公司 | A kind of method and system for pushing barrage |
| CN106951573A (en) * | 2017-04-27 | 2017-07-14 | 努比亚技术有限公司 | A kind of living broadcast interactive data load method, server and computer-readable medium |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109241157A (en) * | 2018-08-02 | 2019-01-18 | 中央电视台 | Data calling method, device, communication equipment and storage medium |
| CN109064806A (en) * | 2018-09-26 | 2018-12-21 | 北京奇艺世纪科技有限公司 | A kind of video system with instructional function, implementation method and electronic equipment |
| CN111680108A (en) * | 2019-03-11 | 2020-09-18 | 杭州海康威视数字技术股份有限公司 | Data storage method and device and data acquisition method and device |
| CN111680108B (en) * | 2019-03-11 | 2023-11-03 | 杭州海康威视数字技术股份有限公司 | Data storage method and device and data acquisition method and device |
| CN110032608A (en) * | 2019-04-22 | 2019-07-19 | 江苏满运软件科技有限公司 | Information assemble method, device, storage medium and the electronic equipment of system data |
| CN110032608B (en) * | 2019-04-22 | 2022-09-06 | 江苏满运软件科技有限公司 | System data information assembling method and device, storage medium and electronic equipment |
| CN110866107A (en) * | 2019-10-12 | 2020-03-06 | 浙江大搜车软件技术有限公司 | Method and device for generating material corpus, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108153803B (en) | 2021-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108153803A (en) | A kind of data capture method, device and electronic equipment | |
| CN110247784B (en) | Method and device for determining network topology structure | |
| CN103534988A (en) | Publish and subscribe messaging method and apparatus | |
| US11695623B2 (en) | Method and apparatus for binding network card in multi-network card server, and electronic device and storage medium | |
| CN111026982A (en) | Intelligent contract processing method, computer equipment and storage medium | |
| CN114285781B (en) | SRV6 service flow statistics method, device, electronic equipment and medium | |
| WO2021023149A1 (en) | Method and apparatus for dynamically returning message | |
| US20190370293A1 (en) | Method and apparatus for processing information | |
| US11381630B2 (en) | Transmitting data over a network in representational state transfer (REST) applications | |
| CN114138325A (en) | Gray scale publishing method and device | |
| CN108322772A (en) | A kind of video file processing method, device and electronic equipment | |
| CN112417016A (en) | Data exchange method, system, equipment and storage medium | |
| CN108259576B (en) | Software and hardware real-time information transmission system and method | |
| US10572500B2 (en) | Feeding networks of message brokers with compound data elaborated by dynamic sources | |
| CN114490718A (en) | Data output method, data output device, electronic equipment and computer readable medium | |
| CN110928693B (en) | Computing equipment and resource allocation method | |
| CN109814916B (en) | IVR flow configuration method, device, storage medium and server | |
| CN105915584A (en) | Business request method based on proxy server and system | |
| CN113760343A (en) | Method and device for processing service request | |
| CN113779018A (en) | Data processing method and device | |
| CN113691462B (en) | Response method and device of Internet group management protocol | |
| CN115250254B (en) | Netflow message distribution processing method and device | |
| US20200128103A1 (en) | Methods, network node and client device for acquisition and delivery of resources in a communications network | |
| CN116600031B (en) | Message processing method, device, equipment and storage medium | |
| CN115996203B (en) | Network traffic domain division method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |