CN104468653A - Distributed news gathering, mixing and releasing method - Google Patents
Distributed news gathering, mixing and releasing method Download PDFInfo
- Publication number
- CN104468653A CN104468653A CN201310424461.7A CN201310424461A CN104468653A CN 104468653 A CN104468653 A CN 104468653A CN 201310424461 A CN201310424461 A CN 201310424461A CN 104468653 A CN104468653 A CN 104468653A
- Authority
- CN
- China
- Prior art keywords
- news
- task
- program
- computer
- client computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a distributed news gathering, mixing and releasing method. According to the method, at least one task role program is assigned to each client computer registering with a server computer by means of the server computer. Three task role programs can be assigned at most simultaneously in order that each client computer can independently execute different operation tasks in the charge of each installed task role program, so that the operational demand of the server computer is dispersed, and the consumption of the operational resources of the server computer is lowered. Moreover, a task group can be established flexibly, and different task targets are dispersedly and continuously processed through online client computers (group), so that distributed gathering of news information is realized. Moreover, news information is screened, mixed and aggregated into a plurality of classified news aggregation seeds according to a news mixing rule, and the news aggregation seeds are released to an Internet platform in the form of a read-only file, so that a user can subscribe through a website address.
Description
Technical field
The invention relates to a kind of method of channel of releasing news, relating to one especially can reach distributed capture, mixes take and the method for channel of again releasing news via information.
Background technology
At present generally common " with the NEWSERADER of servo computer end implementation and polymerizer " (server-side news reader and aggregator) all with single or multiple stage servo computer according to the news channel (news channel) of lane database, such as: Simple Syndication (RSS/ATOM) network address or community page (social network page) unique identifier (ID), thoroughly by HTTP(Hypertext Transport Protocol), to obtain the news list that this news channel is issued, and the part information of every then news (news item), such as: news author, the news publication time.Subscribe to this then news channel when user has, namely can pass through servo computer and read this then news list of news channel and the part information of news.Now for the improvement of subscription service quality or servo computer usefulness, thus constantly novel technology is proposed.
As TaiWan, China patent disclose " continue in a network a little and the request scheduling system of differentiated services quality and method thereof be provided " of No. 200635282 disclose, it is by complete for the scheduling mechanism network relay point be implemented between the client terminal and application servo computer of end user (End User), therefore under the prerequisite not changing client terminal and application servo computer, existing Internet service pattern can be followed to realize real differentiated services.
" managing the method for the process group of a distributed computer environment; system and program product " as No. 501064th, TaiWan, China patent announcement disclosed, it is at distributed computer environment, its groups of clients becomes the processing mode of group, in addition client is also only merely send request to servo computer, when being mainly used in client-side management failure, can pass through the management that client is replied in synchronous process.
As TaiWan, China patent disclose " by service model and the Dynamical Deployment to the system and method for distributed network architecture " of No. 200614071 disclose, it is for providing registration service, describes (Service Descriptions) for deployment services.With (i.e. one (state) description of serving of any narrative descriptive language, as a state network service) set up a new service describing after, describe provider (Description Provider) and start registration service in service container (Service Container), the term of execution, allow the registration of new service describing (namely disposing), and must not restart service container.
As No. I353525th, TaiWan, China patent announcement " apparatus, system and method from master control for grid system resource " disclose, it is for providing the trigger event (trigger event) of monitoring module for monitoring grid arithmetic system.Policy module is for one of a plurality of system policy of access.One Operation control parameter of one system resource of the corresponding grid arithmetic system of each in these a plurality of system policy, and provide adjustment module to supply according to one of a plurality of system policy, and respond an identification trigger event, thus by monitoring module and adjustment module in order to manage independently.
As Chinese patent disclose " for user role, situation and the function and back-up system mixes the device skins taken " of No. 102164172 disclose, it is for providing the system of the information interface of this user applicable, mix by user role, situation and function and take the combination of different communication mode, to provide the information interface being applicable to user.
As Chinese patent disclose No. 1984144 " be convenient to cooperation place in transmit secure content integrate method and system " institute disclose, its be provided in cooperation place place secure content integrate can be provided as RSS be fed to.User can receive the content in the cooperation place of being filtered by the user certificate of checking, and user has certificate in the content of reading in place that cooperates therefore to allow user only to check.
But, above-described technology all do not provide how to reduce servo computer build cost, and be all Peer to Peer Architecture (peer-to-peer architecture), although have the advantage of the servo computer not needing a dependence centralized management because of the framework of " with the NEWSERADER of servo computer end implementation and polymerizer ".But it is higher to build cost based on the servo computer group under this framework, and more difficult on setting and managing, between point with point, the situation of data sharing also makes the Information Security between servo computer lower.
Based on above-mentioned problem, the invention provides a kind of distributed capture, mix and take the method with channel of releasing news, it is based on distributed principal and subordinate's computing architecture, assigns role's task of client computer and the computing of discrete servo device computer, builds cost with what reduce servo computer.
Summary of the invention
Main purpose of the present invention, be to provide a kind of based on distributed principal and subordinate's computing architecture, its mode of assigning through client computer (group) task role, reach dispersion treatment server operation task, use the loss reducing servo computer calculation resources, and be able to gather news information dispersedly, constantly through online client computer (group), and according to a news mix take rule produce news information polymerization demand with improve give a news briefing benefit a kind of distributed capture, mix take the method with channel of releasing news.
Secondary objective of the present invention, be that providing a kind of can reach distributing server computing demand through client computer (group) with low cost in a large number, in a distributed manner, continuous schedule complete that news information is collected, news information mix take polymerization and news Aggreagation seed and issue a kind of distributed capture, mixed take the method with channel of releasing news.
For achieving the above object, disclosed method comprises the following steps:
(A) client computer is registered through network entry one servo computer.
(B) servo computer is according to the hardware usefulness of this client computer, assigns at least one task role program installation file and gives this client computer and perform installation.
Wherein, servo computer can be detected and the hardware usefulness (cpu instruction cycle and RAM size etc.) of client computer according to this registration, assigns suitable task role program installation file and gives this client computer and perform installation; This task role program is a news collection analyzer (News Collector) program or is a news feeds generator (News Seed Builder) program or is a news feeds arrangement device (News Seed Deployer) program; Servo computer can be assigned at most three described task role program installation files simultaneously and be given this client computer and perform installation, makes this client computer be performed three different task role programs, to carry out different task computings simultaneously.
(C) this client computer is when this servo computer online at every turn, and namely driving in the lump should (a bit) mounted task role program.
(D) wherein, if this client computer has installed the task role program of this news collection analyzer (News Collector), namely obtain one first work through this program to this servo computer and perform value, to calculate and to distribute the system resource needed for this client computer Processing tasks, obtain a first task object listing according to this first work execution value to this servo computer again and carry out task process, and the data handled well is back to this servo computer, this servo computer is by the data of those passbacks of process, to produce one second task object list.
(E) wherein, if this client computer has installed the task role program of this news feeds generator (News Seed Builder), namely obtain one second work through this program to this servo computer and perform value, to calculate and to distribute the memory size needed for this client computer Processing tasks, obtain one second task object list according to this second work execution value to this servo computer again and carry out task process, and the data handled well is back to this servo computer, this servo computer is by the data of those passbacks of process, to produce one the 3rd task object list.
(F) wherein, if this client computer has installed the task role program of this news feeds arrangement device (News Seed Deployer), namely obtain one the 3rd work through this program to this servo computer and perform value, to calculate and to distribute the memory size needed for this client computer Processing tasks, perform value according to the 3rd work again to obtain one the 3rd task object list to this servo computer and carry out task process, and subscribe on data publication to Internet platform after process for user.
Wherein in step (D) or step (E) or step (F), the task role program more comprised through this execution obtains one first to servo computer, second or the 3rd working period values, make this client computer when performing those different task role programs, those task role programs can respectively according to this first, second or the 3rd working period values time setting, when the task processing time reach this first, second or the 3rd working period values time setting time, again this servo computer that leads obtains a new job and performs value and a new working period values, restart new tasks carrying again, so, the situation that the client computer group that servo computer can perform same task role program according to other execute the task and the suitable work of dynamic assignment perform value and a new working period values to this client computer, when making this task role routine processes task, efficiency improves, and it is more reasonable to make the Memory Allocation of this client computer and cpu resource use.
In addition, the content of first, second, third described task object list is made up of Simple Syndication (RSS) read-only file or Simple Syndication (RSS) form network address or community page identifier or one of them form of news feeds; The wherein content of this first task object listing, mainly the news channel be made up of Simple Syndication (RSS) network address or community page identifier given tacit consent to of a plural section, makes this news collection analyzer (News Collector) task role program in step (D) can be directly linked to all news informations that those network address remove to collect those news channel.
And after the news data that collection is returned is back to servo computer by news collection analyzer (News Collector) task role program, servo computer then those primary news data reassembles into one second task object list, and pays news feeds generator (News Seed Builder) the task role program reading giving step (E).After this news feeds generator (News Seed Builder) task role program obtains this second task object list, rule is taken through a news is mixed, primary news information in second task object list is aggregated into a plurality of useful news feeds (News Seed) ribbon table, it is comparison news publication time or to define keyword to screen relevant news that this news mixes the execution mode taking rule, and then mix the related news aggregation information after taking out screening, and this news feeds (News Seed) ribbon table is back to servo computer.
Namely servo computer is used and those news feeds (News Seed) form is reassembled into one the 3rd task object list, task role program for the news feeds arrangement device (News Seed Deployer) of serving as step (F) reads, after the task role program of this news feeds arrangement device (News Seed Deployer) obtains the 3rd task object list, just by its Content Transformation for meeting the read-only file of Simple Syndication (RSS) form, and be distributed on Internet platform with archives form and subscribe to through network address for user.
The beneficial effect implementing the present invention's generation is: the mode that the present invention assigns through client computer (group) task role, dispersion treatment server operation task can be reached, use the loss reducing servo computer calculation resources, it can reach a large amount of through client computer (group) distributing server computing demand with low cost, the present invention more can reach elasticity and build task group (each client computer all can install one or several different task role program simultaneously, to perform the computing of different task demand, this client computer can according to the resource requirement of other work of itself, or servo computer can according to demand assignment, and make this client computer can delete mounted task role program laying equal stress on the new task role program of newly downloaded installation), and be able to through online client computer (group) dispersedly, complete news information constantly to collect, news information mixes the target of taking polymerization and the issue of news Aggreagation seed.
Accompanying drawing explanation
Fig. 1: it is the system architecture schematic diagram of a preferred embodiment of the present invention;
Fig. 2: it is the task group schematic diagram of a preferred embodiment of the present invention;
Fig. 3: it is the calcspar of a preferred embodiment of the present invention;
Fig. 4: it is the schematic diagram of the measures of effectiveness of a preferred embodiment of the present invention; And
Fig. 5: it is the sequential chart of a preferred embodiment of the present invention.
[figure number is to as directed]
2 client computer groups
10 servo computers
12 databases
14 monitoring computers
20 client computers
22 news collection analyzer programs
24 news feeds generator program
26 news feeds arrangement device programs
30 internets
32 news websites
34 community websites
40 Virtual Private Networks
50 Internet platform
52 subscriber's computers
Internet internet
G1 news collection analyzer task group
G2 news feeds generator task group
G3 news feeds arrangement has a high regard for business group
L1 first task object listing
The list of L2 second task object
L3 the 3rd task object list
T1 first sequential
T2 second sequential
T3 the 3rd sequential
T4 the 4th sequential
T5 the 5th sequential
T6 the 6th sequential
T7 the 7th sequential
T8 the 8th sequential
T9 the 9th sequential
Embodiment
In order to make architectural feature of the present invention and effect of reaching have a better understanding and awareness, spy's preferred embodiment and coordinate detailed description, is described as follows:
Distributed capture of the present invention, mixed taking is registered for all logining servo computer by each client computer with the method for channel of releasing news, and in time registering, servo computer can according to the hardware usefulness (cpu instruction cycle and RAM size etc.) proposing this client computer registered, assign one or several different task role program to give this this client computer and perform installation, this task role program is a news collection analyzer (News Collector) program or is a news feeds generator (News Seed Builder) program or is a news feeds arrangement device (News Seed Deployer) program, each task role program all independently can perform the mode of the computing of affiliated mission requirements, different computing demands is disperseed to different client computers with dispersion treatment server operation task by servo computer, use the loss reducing servo computer calculation resources, more can reach the object that elasticity builds task group, be able to through online client computer (group) dispersedly, complete news information constantly to collect, news information mixes the target of taking polymerization and the issue of news Aggreagation seed.Be described in detail as follows:
Refer to Fig. 1, it is the schematic diagram of the system architecture of a preferred embodiment of the present invention.As shown in the figure, for distributed capture of the present invention, mix and take the system architecture applied with the method for releasing news, it comprises client computer group 2 and a servo computer 10.Wherein this client computer group 2 has at least one client computer 20, it can perform at least one task role program, task role program package is containing news collection analyzer (News Collector) program 22, news feeds generator (News Seed Builder) program and news feeds arrangement device (News Seed Deployer) program program 26, and the present embodiment performs news collection analyzer program 22, news feeds generator program and news feeds arrangement device program as an example with client computer.In addition, system architecture of the present invention more comprises database 12, supervisory computer 14.
News collection analyzer program 22 performed by client computer 20, news feeds generator program 24 and news feeds arrangement device program 26 are connected to servo computer 10, the present embodiment is with news collection analyzer program 22, a news feeds generator program 24 and news feeds arrangement device program 26 corresponding first task object listing L1 respectively, one second task object list L2 and the 3rd task object list L3, and client computer 20 is when online servo computer 10, these three task role programs, i.e. news collection analyzer program 22, news feeds generator program 24 and news feeds arrangement device program 26 can and servo computer 10 interactive and independent separately and do not affect and performs affiliated task each other.In addition, this monitoring computer 14 connects servo computer 10, channel in the database 12 that ALARA Principle servo computer 10 connects, news or news feeds data, this news feeds arrangement device (News Seed Deployer) program 26 is through a Virtual Private Network (Virtual Privacy Network, VPN) connect at least one Internet platform 50, at least one subscriber's computer 52 is linked to this Internet platform 50 through an internet 30.
This servo computer 10 is after the appointment mandate obtaining each client computer, namely assign role's task of each client computer by assigning mandate, this role's task agent is containing news collection analyzer (News Collector), news feeds generator (News Seed Builder) and news feeds arrangement device (News Seed Deployer).
This news collection analyzer program 22 is the read requests proposing first task object listing L1 to this servo computer 10 in time performing, to read this first task object listing L1 in database 12 that this servo computer 10 connects, this news collection analyzer program 22 is the plural network address comprised according to first task object listing L1, the present embodiment is using a news website 32 and a community website 34 as the citing of source of news, therefore news collection analyzer program 22 is linked to news website 32 or community website 34 through an internet 30, to collect the plural news information that those network address are published, this news collection analyzer program 22 is sent to this servo computer 10 after collection completes, this servo computer 10 is correspondence establishment one second task object list L2 according to those news informations collected by this news collection analyzer program 22, and be stored in this database 12.
In addition, when the news information collected by this news collection analyzer program 22 be in Simple Syndication (RSS) perhaps community page message contents or general webpage contained news information time, collected news information can be converted to the form of news feeds by this news collection analyzer program 22, so that subsequent treatment.
The present embodiment with single news collection analyzer program 22 as an example, but the present invention is not limited thereto, the present invention more can utilize plural news collection analyzer program 22 to form role's task group of a news collection analysis, and the plural news collection analyzer program 22 namely performed by plural platform client computer 20 forms role's task group.
This news feeds generator program 24 proposes the request of reading this second task object list L2 to this servo computer 10 in time performing, this the second task object list L2 is read with the database 12 connected to this servo computer 10, this news feeds generator program 24 can mix according at least one news and take scattered news information in the list of Rules Filtering second task object and aggregate into a plurality of useful news feeds (News Seed) ribbon table by this, it is with the comparison news publication time or to define keyword to screen relevant news that this news mixes the execution mode taking rule, and then mix the relevant polymerization news information after taking out screening, and this news feeds (News Seed) ribbon table is back to servo computer, namely servo computer is used and those news feeds (News Seed) form is reassembled into one the 3rd task object list L3, read for news feeds arrangement device program 26.
The present embodiment is with single news feeds generator program 24 as an example, but the present invention is not limited thereto, the present invention more can utilize this news feeds generator program 24 of plural platform to form role's task group of a news feeds generation, and the plural news feeds generator program 24 namely performed by plural platform client computer 20 forms role's task group.
This news feeds arrangement device program 26 is the request sending a reading the 3rd task object list L3 to this servo computer 10 in time performing, to read the 3rd task object list L3 stored by this database 12 that this servo computer 10 connects, after obtaining the 3rd task object list, be a read-only file meeting Simple Syndication (RSS) form by its Content Transformation, and be distributed on Internet platform 50 with website form and subscribe to through subscriber's computer 52 for user.
The present embodiment is with single news feeds arrangement device program 26 as an example, but the present invention is not limited thereto, the present invention more can utilize plural news feeds arrangement device program 26 to form role's task group of a news feeds arrangement device, and the plural news feeds arrangement device program 26 namely performed by plural platform client computer 20 forms role's task group.
The content of above-described this first, second, third task object list L1, L2, L3 is made up of Simple Syndication (RSS) read-only file or Simple Syndication (RSS) form network address or community page identifier or a news feeds form wherein.
By the above, known N platform client computer 20, N number of news collection analyzer program 22 and N number of news feeds generator program 24 and N number of news feeds arrangement device program 26 may be installed, and each task role program is all independent separately and does not affect task belonging to execution each other, so N number of news collection analyzer program 22 that N platform client computer 20 is installed, it forms the task group of a news collection analyzer, this task group is specially in the task role work of process news collection analyzer, and the task handled by news collection analyzer program 22 of every platform client computer 20 is neither same, corresponding task is indicated by first task object listing L1 acquired during client computer 20 online servo computer 10.In like manner, N number of news feeds generator program 24 that N platform client computer 20 is installed, also the task group of news feeds generator can be formed, to process different news feeds generator tasks, it indicates corresponding task by the second task object list L2 acquired during client computer 20 online servo computer 10; And, N number of news feeds arrangement device program 26 that N platform client computer 20 is installed, also the task group of news feeds arrangement device can be formed, have a high regard for business to process different news feeds arrangements, it indicates corresponding task by the 3rd task object list L3 acquired during client computer 20 online servo computer 10.
As shown in Figure 2, the client computer group 2 of the present embodiment comprises 4 client computers 20 for example, four client computers 20 install three task role programs respectively, namely 4 client computers 20 have installed 4 news collection analyzer programs 22 and 4 news feeds generator program 24 and 4 news feeds arrangement device programs 26, thus form news collection analyzer task group G1, news feeds generator task group G2 and news feeds arrangement and have a high regard for business group G3.Task object list L1-L3 acquired during client computer 20 online servo computer 10 indicates corresponding task.
And, because servo computer 10 is when all client computers 20 are registered, the quantity (group size) of each task role program can be determined according to fixed task object quantity, so elasticity can be reached build task group, be able to through online client computer (group) dispersedly, process different task objects constantly, and reach distributed capture news information, and mix according to a news and take rule and carry out news information screening and mixed taking aggregates into the good news Aggreagation seed of a plurality of classification, and by be distributed on Internet platform with read-only file form and carry out the object of subscribing to through network address for user.
Again please refer to Fig. 1, Fig. 2 and Fig. 3, it is the schematic diagram of the system architecture of a preferred embodiment of the present invention, the schematic diagram of task group and calcspar.As shown in the figure, clear disclose distributed capture of the present invention, mixedly take the method with channel of releasing news, be through role's task of assigning client computer, to reach dispersion treatment server operation task, use the loss reducing servo computer calculation resources, and reach elasticity and build task group, make that whole framework is able to complete that news information is collected dispersedly, constantly through online client computer (group), news information mixes the target of taking polymerization and news Aggreagation seed and issuing.Be described in detail as follows:
Prior in client-action C1, each client computer 20 of a client computer group 2 is logined to servo computer 10, to register, afterwards in servo driver end action S1, servo computer 10, in the present embodiment, preferably, this servo computer 10 is more utilized automatically to obtain a hardware information of each client computer 20 and assess a computer performance ratings information of each client computer 20, the work obtaining each client computer 20 with calculating performs value, in addition, the present embodiment, preferably, calculating obtains a working period values of each client computer more by this, therefore, servo computer 10 is the installation archives that each client computer 20 assigns this role's task program according to the hardware usefulness of each client computer 20, this role's task program is included as a news collection analyzer (News Collector) program 22, one news feeds generator (News Seed Builder) program 24 and a news feeds arrangement (News Seed Deployer) program 26.
Then in client-action C2, the client computer 20 having installed news collection analyzer program 22 obtains the work execution value of corresponding role's task, preferably, the present embodiment has installed the client computer 20 of news collection analyzer program 22 more in client-action C3, obtains the first working period values of corresponding role's task, afterwards, be connected in client-action C4, client computer 20 performs news collection analyzer program 22, and be connected in client-action C5 and read first task object listing L1, now, news collection analyzer program 22 performs value according to the work of client computer corresponding to it 20, and obtain a first task object listing L1 to the database 12 that this servo computer 10 connects, this first task object listing L1 comprises plural network address, when the client computer 20 performing news collection analysis role task program 22 obtains this first task object listing L1, servo computer 10 will be denoted as the content of this first task object listing L1 the state of locked (Locked), to avoid being repeated to obtain identical first task object listing L1 and Repeated-Role task by other client computers 20 performing news collection analyzer programs 22, and cause the wasting of resources situation of reprocessing same task.
Accept above-mentioned, when the client computer 20 performing news collection analyzer program 22 processes task in this first task object listing L1 and after result is back to servo computer 10, servo computer 10 will be denoted as the task definition of this first task object listing L1 the state of non-locking (Unlocked), again performs for other client computers 20 performing news collection analyzer programs 22 can obtain the task definition of this first task object listing L1 again role's task that news collection analyzes; Afterwards in client-action C6, this news collection analyzer program 22 is utilized to perform role's task of news collection analyzer according to its work execution value and first task object listing L1, namely those network address of linking in first task object listing L1 of this news collection analyzer program 22 are online, be back to servo computer 10 with the news information of collecting on the website corresponding to those network address, continue and perform server action S2.In addition, in client-action C2 in client-action C6, client computer group 2 more can utilize plural platform client computer 20 to perform this news collection analyzer program 22, to carry out role's task of news collection analysis, and forms role's task group of a news collection analysis.
In client-action C6, this news collection analyzer program 22 can perhaps community page message contents or the contained news information of general webpage all return to this servo computer 10 by the Simple Syndication (RSS) of all collections, connection server action S2, servo computer 10 namely can correspondence establishment one second task object list L2, and the client computer for subsequent installation news feeds generator program 24 reads.
Moreover, in client-action C2 in client-action C6, whether this news collection analyzer program 22 further arrives one first working period values according to a task processing time of role's task of newsgathering analyzer, judge whether to repeat client-action C2 to client-action C6, when this news collection analyzer program 22 reaches first working period values in a task processing time of newsgathering analyzer program, continue client-action C2, when this news collection analyzer program 22 does not reach this first working period values in this task processing time of newsgathering analyzer program 22, news collection analyzer program 22 enters the state of wait, until when the time reaches the first working period values, continue client-action C2.
In client-action C7, the client computer 20 having installed news feeds generator program 24 obtains the work execution value of corresponding role's task, preferably, the present embodiment has installed the client computer 20 of news feeds generator program 24 more in client-action C8, obtains the second working period values of corresponding role's task, afterwards, be connected in client-action C9, client computer 20 performs news feeds generator program 24, and the second task object list L2 in client-action C10 stored by reading database 12, when the client computer 20 performing this news feeds generator program 24 obtains this second task object list L2, servo computer 10 will be denoted as the content of this second task object list L2 the state of locked (Locked), obtain to avoid the client computer 20 being performed news feeds generator program 24 by other, and cause other to perform the wasting of resources situation of the client computer 20 reprocessing same task of news feeds generator program 24.
Accept above-mentioned, when the client computer 20 performing news feeds generator program processes task in this second task object list L2 and after result is back to servo computer 10, servo computer 10 will be denoted as the content of this second object listing L2 the state of non-locking (Unlocked), again performs role's task of news feeds generator program for other client computers 20 performing news feeds generator program 24 can obtain the task definition of this second task object list L2 again.In addition, in client-action C7 to C11, client computer group more can utilize plural platform client computer 20 to perform news feeds generator program 24, to form role's task group that a news feeds produces.
Then in client-action C11, this news feeds generator (News Seed Builder) program 24 is utilized to carry out screening and mix take those news informations according to the mixed rule of taking of a news, to set up at least one news feeds (News Seed) and to be sent to this servo computer 10, be connected in server action S3, this servo computer 10 correspondence produces one the 3rd task object list L3, moreover, in client-action C11, this second client computer 22 further judges whether a task processing time of role's task of news feeds generator arrives one second working period values, when this news feeds generator program 24 reaches second working period values in a task processing time of role's task of news feeds generator, continue client-action C7, when this news feeds generator program 24 does not reach this second working period values in this task processing time of role's task of news feeds generator, news feeds generator program 24 enters the state of wait, until when the time reaches the second working period values, continue client-action C7.
Then, the client computer 20 having installed news feeds arrangement device program 26 in client-action C12 obtains the work execution value of corresponding role's task, preferably, the present embodiment has installed the client computer 20 of news feeds arrangement device program 26 more in client-action C13, obtains the 3rd working period values of corresponding role's task; Afterwards, be connected in client-action C14 client computer 20 and perform news feeds arrangement device program 26, and the 3rd task object list L3 in client-action C15 stored by reading database 12, utilize the 3rd client computer 20 to perform news feeds arrangement device program 26, obtain the 3rd task object list L3 with the database 12 linked to this servo computer 10; When the client computer 20 performing news feeds arrangement device program 26 obtains the 3rd task object list L3, servo computer 10 will be denoted as the content of the 3rd task object list L3 the state of locked (Locked), to avoid the 3rd client computer 20 being performed news feeds arrangement device program 26 by other to obtain, and cause the wasting of resources situation of reprocessing same task.
When this news feeds arrangement device (News Seed Deployer) program 26 processes task in the 3rd task object list L3 and after result being returned back the database 12 of servo computer 10, this servo computer 10 will be denoted as the content of the 3rd object listing L3 the state of non-locking (Unlocked), again performs role's task of news feeds arrangement device program for other client computers 20 performing news feeds arrangement device programs 26 can obtain the task definition of this 3rd task object list L3 again.In addition, in client-action C12 to C16, client computer group 2 more can utilize plural platform client computer 20 to perform news feeds arrangement program 26, to form role's task group of a news feeds arrangement.
In client-action C16, utilize this news feeds arrangement device (News Seed Deployer) program 26 read this news feeds according to the 3rd task object list L3 and produce the read-only file that meets Simple Syndication (RSS) form, and this read-only file is published at least one Internet platform 50, in client-action C16, the client computer 20 performing this news feeds arrangement device program 26 further judges whether a task processing time of news feeds arrangement device program arrives one the 3rd working period values, when a task processing time of this news feeds arrangement device program 26 reaches the 3rd working period values, continue client-action C12, when the 3rd client computer does not reach the 3rd working period values in this task processing time of role's task of news feeds arrangement, news feeds arrangement device program 26 enters the state of wait, until when the time reaches the 3rd working period values, continue client-action C12.In Internet platform action S4, Internet platform 50 provides the subscription service of Simple Syndication (RSS) read-only file.
The content of above-described this first, second, third task object list L1, L2, L3 is made up of Simple Syndication (RSS) read-only file or Simple Syndication (RSS) form network address or community page identifier or a news feeds form wherein.Moreover, above-described each task object list is with single list as an example, but the present invention is not limited thereto, can add in the database 12 connected in this servo computer 10 according to system requirements, namely, the database 12 that this servo computer 10 connects can enumerate a plurality of this first, second, third task object list L1, L2, L3, and each client computer 20 for client computer group 2 obtains.In addition, above-described task role program is for separating according to the role's task classification performed by it, but the present invention more can be same client computer and perform different task role program under different sequential, when online servo computer 10, these three task role programs will be interactive and independent separately and do not affect task belonging to execution each other with servo computer 10.Each client computer 20 more can according to other working resource demands of itself, and mounted all task role programs or wherein several task role program can be removed, each client computer 20 is when online servo computer 10 next time, servo computer 10 detecting is set up this online client computer 20 and is not installed task role program or its hardware usefulness when also having other system resource can perform other task role programs, the meeting automatic hardware usefulness according to this client computer again, and again assign one or several suitable task role program and give and set up this online client computer 20 and reinstall, to execute the task in the task group adding task role program.。
By the above, known N platform client computer 20, N number of news collection analyzer program 22 and N number of news feeds generator program 24 and N number of news feeds arrangement device program 26 may be installed, with the client-action C1-C16 of correspondence, and each task role program is all independent separately and does not affect task belonging to execution each other, so N number of news collection analyzer program 22 that N platform client computer 20 is installed, it forms the task group of a news collection analyzer, this task group is specially in the task role work of process news collection analyzer, and the task handled by news collection analyzer program 22 of every platform client computer 20 is neither same, corresponding task is indicated by first task object listing L1 acquired during client computer 20 online servo computer 10.In like manner, N number of news feeds generator program 24 that N platform client computer 20 is installed, also the task group of news feeds generator can be formed, to process different news feeds generator tasks, it indicates corresponding task by the second task object list L2 acquired during client computer 20 online servo computer 10; And, N number of news feeds arrangement device program 26 that N platform client computer 20 is installed, also the task group of news feeds arrangement device can be formed, have a high regard for business to process different news feeds arrangements, it indicates corresponding task by the 3rd task object list L3 acquired during client computer 20 online servo computer 10.
And, because servo computer 10 is when all client computers 20 are registered, the quantity (group size) of each task role program can be determined according to fixed task object quantity, so elasticity can be reached build task group, be able to through online client computer (group) dispersedly, process different task objects constantly, and reach distributed capture news information, and mix according to a news and take rule and carry out news information screening and mixed taking aggregates into the good news Aggreagation seed of a plurality of classification, and by be distributed on Internet platform with read-only file form and carry out the object of subscribing to through network address for user.
See also Fig. 1 and Fig. 4, it is the schematic diagram of system architecture and the schematic diagram of measures of effectiveness of a preferred embodiment of the present invention.This servo computer 10 of the present invention is after the registration of each client computer 20, automatically the hardware information of each client computer 20 can be obtained, the present embodiment i.e. this servo computer 10 obtains the hardware information of client computer 20 automatically, to assess the computer performance ratings information of client computer 20, perform value with the work obtaining each client computer 20, and assess the working period values that each client computer 20 performs this news collection analyzer program 22, this news feeds generator program 24 and this news feeds arrangement device program 26.
As shown in Figure 3, it is automatically obtaining the computer performance ratings information of this news collection analyzer program 22 of hardware information later evaluation of this news collection analyzer program 22 with this servo computer 10, such as: the usefulness class parameters such as system effectiveness (System rate), processor efficiency mark, internal memory usefulness mark, drawing usefulness mark, film coding usefulness mark, film usefulness mark, hard disk usefulness mark, servo computer 10 by this calculating obtain news collection analyzer program 22 in the work of corresponding role's task and perform value and working period values.
See also Fig. 1 and Fig. 4, it is schematic diagram and the sequential chart of the system architecture of a preferred embodiment of the present invention.As shown in the figure, method and system of the present invention is in time operating, first sequential T1 is that news collection analyzer program 22 is registered to obtain corresponding work execution value and working period values to servo computer 10, second sequential T2 is the first task object listing L1 that news collection analyzer program 22 reads servo computer 10, the 3rd sequential T3 is that collected all news informations are sent to this servo computer 10 by news collection analyzer program 22.
Continue above-mentioned, 4th sequential T4 is that news feeds generator program 24 reads corresponding work execution value and working period values to servo computer 10, 5th sequential T5 is that news feeds generator program 24 reads the second task object list L2, the news feeds that it produces for news feeds generator (News Seed Builder) program 24 by the 6th sequential T6 is sent to servo computer 10, 7th sequential T7 is that news feeds arrangement device (News Seed Deployer) program 26 reads corresponding work execution value and working period values to servo computer 10, 8th sequential T8 is that news feeds arrangement device program 26 reads the 3rd task object list L3, 9th sequential T9 is that Simple Syndication (RSS) read-only file is distributed to and is positioned on the Internet platform 50 of internet Internet by news feeds arrangement device program 26, for subscription.
In sum, the present invention is a kind of distributed capture, mix and take the method and system with channel of releasing news, it is by each client computer of a client computer group, in order to servo computer of arranging in pairs or groups, role's task is assigned in client computer to provide, thus form that distributed news is mixed takes service architecture, dispersion treatment server operation task can be reached, use the loss reducing servo computer calculation resources, can reach in a large number through the demand of client computer (group) distributing server computing with low cost, and reach the object that elasticity builds task group, be able to through online client computer (group) dispersedly, complete news information constantly to collect, news information mixes the target of taking polymerization and the issue of news Aggreagation seed.Internet platform is deposited in, thus a large amount of usefulness loss reducing outside hypertext transfer protocol requests and Internet platform 50 is caused by Simple Syndication (RSS) read-only file.Meanwhile, servo computer can control those client computers by locking task object list and not repeat same role's task, to raise the efficiency in time assigning role's task.
Above is only preferred embodiment of the present invention, not be used for limiting scope of the invention process, all equalizations of doing according to shape, structure, feature and the spirit described in the claims in the present invention scope change and modify, and all should be included in right of the present invention.
Claims (6)
1. distributed capture, mixed to take and a method of releasing news, it is characterized in that, its step comprises:
(A) client computer is registered through network entry one servo computer;
(B) this servo computer is according to the hardware usefulness of this client computer, the installation file of assigning at least one task role program is given this client computer and is performed installation, and wherein this task role program is a news collection analyzer program or is a news feeds generator program or is a news feeds arrangement device program;
(C) this client computer is when this servo computer online at every turn, namely drives mounted task role program in the lump;
(D) wherein, if this client computer has installed the task role program of this news collection analyzer (News Collector), namely obtain one first work through this program to this servo computer and perform value, to calculate and to distribute the system resource needed for this client computer Processing tasks, obtain a first task object listing according to this first work execution value to this servo computer again and carry out task process, and the data handled well is back to this servo computer, this servo computer is by the data of those passbacks of process, to produce one second task object list,
(E) wherein, if this client computer has installed the task role program of this news feeds generator (News Seed Builder), namely obtain one second work through this program to this servo computer and perform value, to calculate and to distribute the memory size needed for this client computer Processing tasks, obtain one second task object list according to this second work execution value to this servo computer again and carry out task process, and the data handled well is back to this servo computer, this servo computer is by the data of those passbacks of process, to produce one the 3rd task object list,
(F) wherein, if this client computer has installed the task role program of this news feeds arrangement device (News Seed Deployer), namely obtain one the 3rd work through this program to this servo computer and perform value, to calculate and to distribute the memory size needed for this client computer Processing tasks, perform value according to the 3rd work again to obtain one the 3rd task object list to this servo computer and carry out task process, and subscribe on data publication to Internet platform after process for user.
2. the method for claim 1, is characterized in that, wherein more comprises in step (D):
(D1) the task role program through this news collection analyzer obtains one first working period values to this servo computer;
(D2) this client computer is according to the setting of this first working period values, when the task processing time reaches this first working period values, re-starts (D) step.
3. the method for claim 1, is characterized in that, wherein more comprises in step (E):
(E1) the task role program through this news feeds generator obtains one second working period values to this servo computer;
(E2) this client computer is according to the setting of this second working period values, when the task processing time reaches this second working period values, re-starts (E) step.
4. the method for claim 1, is characterized in that, wherein more comprises in step (F):
(F1) the task role program through this news feeds arrangement device obtains one the 3rd working period values to this servo computer;
(F2) this client computer is according to the setting of the 3rd working period values, when the task processing time reaches the 3rd working period values, re-starts (F) step.
5. the method for claim 1, it is characterized in that, the content of wherein this first, second, third task object list is made up of Simple Syndication read-only file or Simple Syndication form network address or community page identifier or a news feeds form wherein.
6. the method for claim 1, is characterized in that, wherein in step (B), this servo computer can be assigned three task role program installation files simultaneously and be given this client computer and perform installation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310424461.7A CN104468653A (en) | 2013-09-17 | 2013-09-17 | Distributed news gathering, mixing and releasing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310424461.7A CN104468653A (en) | 2013-09-17 | 2013-09-17 | Distributed news gathering, mixing and releasing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104468653A true CN104468653A (en) | 2015-03-25 |
Family
ID=52914021
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310424461.7A Pending CN104468653A (en) | 2013-09-17 | 2013-09-17 | Distributed news gathering, mixing and releasing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104468653A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080021906A1 (en) * | 2000-02-22 | 2008-01-24 | Harvey Lunenfeld | Metasearching by Sending a Plurality of Queries to a Plurality of Servers |
| CN101370024A (en) * | 2007-08-15 | 2009-02-18 | 北京灵图软件技术有限公司 | Distributed information collection method and system |
| TW201112687A (en) * | 2008-10-21 | 2011-04-01 | Yahoo Inc | Network aggregator |
| CN102073683A (en) * | 2010-12-22 | 2011-05-25 | 四川大学 | Distributed real-time news information acquisition system |
-
2013
- 2013-09-17 CN CN201310424461.7A patent/CN104468653A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080021906A1 (en) * | 2000-02-22 | 2008-01-24 | Harvey Lunenfeld | Metasearching by Sending a Plurality of Queries to a Plurality of Servers |
| CN101370024A (en) * | 2007-08-15 | 2009-02-18 | 北京灵图软件技术有限公司 | Distributed information collection method and system |
| TW201112687A (en) * | 2008-10-21 | 2011-04-01 | Yahoo Inc | Network aggregator |
| CN102073683A (en) * | 2010-12-22 | 2011-05-25 | 四川大学 | Distributed real-time news information acquisition system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Ning et al. | Blockchain-enabled intelligent transportation systems: a distributed crowdsensing framework | |
| CN105635283A (en) | Organization and management and using method and system for cloud manufacturing service | |
| CN107241319B (en) | Distributed network crawler system based on VPN and scheduling method | |
| CN108304473B (en) | Data transmission method and system between data sources | |
| CN110738454A (en) | enterprise management platform system | |
| CN103346974A (en) | Controlling method of service process and network device | |
| CN103645909A (en) | Handling method and device for timed task | |
| CN105072118A (en) | Login management system and method for call center seat | |
| CN105786611A (en) | Method and device for task scheduling of distributed cluster | |
| CN109257422B (en) | Method for reconstructing perception network information | |
| Cao et al. | Towards tenant demand-aware bandwidth allocation strategy in cloud datacenter | |
| CN105100277A (en) | Software inspection method, device and system | |
| CN106059801A (en) | Virtual machine credible evidence collection method and virtual machine credible evidence collection device based on cloud computing platform network | |
| CN111783053A (en) | Interactive unified big data programming computing platform | |
| CN101515863A (en) | Network data acquiring method, acquisition machine and acquisition system | |
| CN1487435A (en) | Operation process distributing system and method | |
| CN113296959A (en) | Service processing method and device based on AOP functional component and computer equipment | |
| CN115941426B (en) | Multi-service resource collaboration method, system and computer equipment | |
| CN102541539B (en) | Method for designing intelligent panel of supply chain based on M2M (Machine to Machine) | |
| CN104468653A (en) | Distributed news gathering, mixing and releasing method | |
| CN109493251B (en) | Electric power wireless public network monitoring system | |
| CN111913784A (en) | Task scheduling method and device, network element and storage medium | |
| TW201507411A (en) | Method of distributed collection, mashup and issuance of news | |
| CN114385541A (en) | Intelligent manufacturing-oriented OPC UA aggregation server and design method thereof | |
| Gao et al. | A dispatching-rule-based task scheduling policy for MapReduce with multi-type jobs in heterogeneous environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150325 |