WO2012016782A1 - Automatic traffic generation for a faring system - Google Patents
Automatic traffic generation for a faring system Download PDFInfo
- Publication number
- WO2012016782A1 WO2012016782A1 PCT/EP2011/061459 EP2011061459W WO2012016782A1 WO 2012016782 A1 WO2012016782 A1 WO 2012016782A1 EP 2011061459 W EP2011061459 W EP 2011061459W WO 2012016782 A1 WO2012016782 A1 WO 2012016782A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- traffic
- rules
- request
- facility
- modified
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
- G06F11/3414—Workload generation, e.g. scripts, playback
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Z—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS, NOT OTHERWISE PROVIDED FOR
- G16Z99/00—Subject matter not provided for in other main groups of this subclass
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/02—Reservations, e.g. for tickets, services or events
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/02—Reservations, e.g. for tickets, services or events
- G06Q10/028—Reservations, e.g. for tickets, services or events for seating or spaces in a venue
- G06Q10/0283—Reservations, e.g. for tickets, services or events for seating or spaces in a venue for travel seating
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0611—Request for offers or quotes
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/865—Monitoring of software
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/875—Monitoring of systems including the internet
Definitions
- the exemplary embodiments of this invention relate generally to faring systems and, more specifically, relate to the generation of pseudo-traffic (shadow traffic) for evaluating faring system modifications/enhancements.
- the various exemplary embodiments can be used in an on-line system providing travel-related products to customers.
- a system which is able to compute and return fare quotes based on criteria requested by customers such as cheapest fares which apply for a destination, and best fares around a given date.
- Customers communicate with the transactional faring system, also referred to herein as a faring system, by means of transactions, i.e., a question (request for fare quote) followed by an answer (computed fare quote).
- Fare shopping servers i.e., a question (request for fare quote) followed by an answer (computed fare quote).
- Fare shopping servers are transactional servers which implement the products provided by the faring system. These servers are in charge of computing responses to queries made by the customer. There are two kinds of fare shopping servers: those dedicated to production, those dedicated to staging.
- the production is an operational facility (a computer system) where computations take place in order to return answers to the queries made by customers.
- Staging is a relatively small and dedicated part of the faring system where a new product can be "validated" before being publicly made available to customers.
- a part of the traffic i.e., requests from customers
- the responses to this duplicated traffic (referred to as the shadow traffic) are not returned to customers.
- the exem plary em bod i ments of th is i nvention pertain most particu larly to a transactional faring system whose purpose is to compute and return the best fare quotes based on criteria requested by customers: e.g., cheapest flights for a given destination and date, best flight fares around a given date, etc. These services are treated via fare shopping servers and accessed at a high rate (e.g., 90 million transactions per day).
- Forecast changes in the faring system are preceded by operational validations to ensure that the system can cope with the expected additional resource consumption (e.g., CPU, memory, database, network and other resources).
- Operational validations are implemented by means of shadow traffic. That is to say, a part of the incoming customer traffic is duplicated from the production facility, without customer awareness. This duplicated, shadow traffic is then forwarded to a phantom operational facility referred to as the staging facility intended to test evolutions in the faring system. The effect of this shadow traffic run on the staging facility is then monitored and analyzed, while the original traffic is processed in a normal fashion by the production facility and returned to customers in a normal manner.
- one such possible technique would be to activate the evolution to one client at a time.
- the evolution e.g., new product, new market
- the faring system would be provided by the faring system and enabled only for a few clients in a first phase. It can be expected that the total resources consumed for processing the new service will have a limited impact on the overall production facility, and this cost can be analyzed precisely for creating accurate capacity planning.
- Another possible technique would be to generate traffic from pre-recorded existing traffic. That is, one might record existing customer traffic for a given period of time and then transform this recorded traffic off-line (e.g., from disk) to make it appear as traffic that will target the new product. The transformed traffic can then be replayed manually while monitoring the resources consumed by the processing of the new service on the pre-recorded and transformed traffic.
- replaying pre-generated traffic does not offer sufficient diversity, especially when the validation needs to be run over a long period of time.
- a converter unit can be put in front of the real servers to modify the contents of incoming requests, for example, for enabling new features (i.e. new options) of a product provided by the faring system. No off-line storage need be involved in this process.
- Another approach would be to copying all the incoming requests from customers and use them on an adjacent server. This way, only realistic traffic is used without bothering the customers.
- the exemplary embodiments provide a method performed by a faring system having a production facility comprising at least one fare shopping server, a staging facility comprising at least one fare shopping server, and an entry point for conducting bi-directional communications with customers.
- the method is characterized as comprising, in response to receiving a transaction from a customer, sending the transaction to the fare shopping server of the production facility for processing and also to a traffic generation subsystem that forms a part of the staging facility; selectively modifying the received transaction at the traffic generation subsystem in accordance with at least one rule to create at least one modified transaction; and sending the at least one modified transaction to the fare shopping server of the staging facility for processing.
- the exemplary embodiments provide a faring system that comprises a production facility comprising at least one fare shopping server, a staging facility comprising at least one fare shopping server, and an entry point for conducting bi-directional communications with customers.
- the faring system is characterized in that it further comprises a database storing transformation rules and a traffic generation subsystem configured to receive a transaction via the entry point from a customer, to determine if the received transaction is one suitable for use in generating simulation data for the fare shopping server and, if so, to modify the received transaction in accordance with at least one rule retrieved from the database to create at least one modified transaction, and to send the at least one modified transaction to the fare shopping server of the staging facility for processing.
- the exemplary embodiments provide a faring system that comprises production facility means having at least one fare shopping server means, staging facility means comprising at least one fare shopping server means, and entry point means for conducting bi-directional communications with customers including receiving transactions from customers and sending received transactions to said fare shopping server means of the production facility means for processing and for sending the received transactions to said staging facility means as shadow transactions.
- the faring system comprises means for selectively modifying a shadow transaction received from said entry point means at the staging facility means in accordance with at least one rule obtained from a rules database to create at least one modified shadow transaction.
- the rules database comprises at least a set of transformation rules and a set of execution rules.
- the faring system is further characterized as comprising means for sending the at least one modified shadowed transaction to the fare shopping server means of the staging facility means to be processed for evaluating a potential new or modified functionality of the faring system.
- the exemplary embodiments provide a faring system that comprises production facility means having at least one fare shopping server means, staging facility means comprising at least one fare shopping server means, and entry point means for conducting bi-directional communications with a customer.
- the faring system comprises means for determining if a received customer transaction (request) is one suitable for use in generating simulation data for the fare shopping server means; means for modifying a suitable customer transaction received from said entry point means at the staging facility means in accordance with at least one rule obtained from a rules database to create at least one modified transaction.
- the rules database comprises at least a set of transformation rules and a set of execution rules.
- the faring system is further comprising means for sending the at least one modified transaction to the fare shopping server means of the staging facility means to be processed, and means for sending to the customer a result of the processed modified transaction for use by the customer in evaluating a potential new or modified functionality of the customer.
- Figure 1 shows a faring system that is constructed and operated in accordance with the exemplary embodiments of this invention to include a traffic generation subsystem and a transformation rules database.
- Figure 2 is a logic flow diagram that illustrates the operation of the traffic generation subsystem of Figure 1 when transforming a given TXN A into at least one TXN B .
- Figure 3 shows an increase in a maximum number of recommendations.
- Figure 4 illustrates various steps which occur in the traffic generation subsystem of Figure 1 during the generation of the new (transformed) shadow traffic.
- Figure 5 shows an increase in a number of requested flights from a first transaction to a second, modified transaction.
- Figure 6 illustrates various steps which occur in the traffic generation subsystem of Figure 1 during the generation of the new (transformed) shadow traffic in accordance with the example of Figure 5.
- Figure 7 shows the faring system that is constructed and operated in accordance with the exemplary embodiments of this invention to include the traffic generation subsystem and the transformation rules database when operated to return information to client for use by the client in characterizing a new product.
- the present invention describes a novel system that interacts with a transactional faring system in order to generate any desired traffic from existing traffic coming from the faring system's operational facility.
- the exemplary embodiments of this invention provide an autonomous system based on a generic framework whose purpose is to transform incoming traffic to resemble new traffic and send it to staging facility fare shopping servers.
- the framework is driven by a dedicated knowledge database to determine how to transform the incoming transactions and how to populate new fields present in the generated transactions (e.g., possible valuations of fields, inter-relation between field values, etc.).
- the system adapts its transformations per market depending on the incoming shadow transaction that it receives.
- the system can rely on plug-ins for business transformations when ad-hoc generation is required (e.g., complex or domain-specific data manipulation).
- Real-time traffic transformation allows the system to generate diversified transactions continuously, and thus to provide a high level of confidence in the measurements of resource consumption performed during operational validations.
- the system has the ability to generate as much traffic as is necessary, whatever the amount of incoming traffic happens to be.
- the system does not impact the production client operations since it operates on shadow traffic, and does not need direct customer intervention to operate. Further, the system throttles traffic generation automatically for operational stability (e.g., to preserve external production systems connected to the staging facility).
- the use of the exemplary embodiments of this invention also provides a number of business-related advantages.
- the generic transformation framework enables the generation of traffic suitable for simulating a broad variety of situations (e.g., stress test, endurance, robustness, capacity, limits).
- the generated traffic can be used to test the limits or the corner cases of new products, something which in practicality cannot be achieved with real customer traffic.
- the accuracy of generated traffic improves the confidence in the metrics gathered during operational validations, which is an important factor when considering the accuracy of capacity planning.
- the reduced dependency on customers also aids in improving the time to market of new products deployed in the faring system.
- the automatically generated traffic reduces the time spent in performing operational validations, thereby reducing cost.
- the use of the exemplary embodiments of this invention aids in maintaining the operational quality of production facility for daily operations, while reducing the risk of inducing instability during the introduction of new customers or new products in the faring system.
- the use of the exemplary embodiments of this invention also enables customers to perform their own capacity planning to monitor the impact of new products on their own operational facility.
- exemplary embodiments of this invention can use a generic traffic transformation approach rather than relying on manual transformations. That is, the system generates traffic, based on business transformation rules stored in a knowledge database, and is capable of accommodating plural traffic transformations at one time. This provides a versatile traffic simulator suitable for a broad variety of operational validations. The system alleviates the need to design a new traffic transformer manually each time an operational validation must be performed, thereby reducing the cost of operational validations as compared to maintaining a manually-derived, hand- written traffic transformer.
- the exemplary embodiments provide real time and accurate traffic generation that greatly improves operational validations.
- the traffic generation is performed on live traffic, and can thus provide day-long operation. This approach allows reproducing all of the traffic behaviours that are typically seen in production, such as changes in transactions per second, as well as transaction stress peaks at specific times during the day.
- the pace of sending and the relevance of the generated traffic make the use of this invention very effective at extensively testing new products (e.g., limit behaviours and corner cases).
- the use of the exemplary embodiments enables the faring system to be extensively and realistically stress tested.
- the exemplary embodiments also operate in a transparent manner with respect to production, and are transparent to customers, as transactions are generated from shadow traffic without impacting production performance.
- the system of this invention does not return data to production.
- the system is also transparent to staging fare shopping servers as it acts as a standalone interposition server between shadow traffic and staging fare shopping servers.
- the fare shopping servers are not aware that they receive generated traffic and do not need to be modified to handle the received traffic.
- the system can also throttle or suspend the generation of traffic in the event that it sends too much generated traffic to the staging fare shopping servers, or in the event that the generated traffic results in some technical problem.
- the staging faring system needs to contact external production facilities (e.g. customer booking flights availability servers) mitigation of the effect of too much generated traffic is achieved.
- FIG 1 for showing a faring system 10 that is constructed and operated in accordance with the exemplary embodiments of this invention.
- the faring system 10 includes a production facility or system 12 containing fare shopping servers 14 and a staging facility or system 16 also containing fare shopping servers 18.
- the production facility 12 and the staging facility 16 are communicatively coupled to an entry point 20 through which customers 22 gain access to the faring system 10, and through which they receive responses to queries.
- the entry point 20 provides real traffic (TXN A ) received from the customers 22 to the fare shopping servers 14 of the production facility 12.
- TXN A real traffic received from the customers 22 to the fare shopping servers 14 of the production facility 12.
- the staging facility 16 further includes a traffic generation server or subsystem 24 coupled with a database 26 storing various business transformations and other information used by the traffic generation subsystem 24 during operation of the traffic generation subsystem 24.
- the exemplary embodiments of this invention thus include as one aspect thereof the new traffic generation subsystem 24 in the faring system 10.
- the faring system 10 provides several products served by the fare shopping servers 14.
- the faring system 10 is basically duplicated in two facilities.
- the first facility is the production facility 12, which is responsible for processing production requests coming from customers 22.
- the second facility is the staging facility 16, essentially a private facility used during operational validations for staging new services, new markets, etc.
- FIG 1 the production faring facility 12 is shown serving a request from a customer 22 which is targeting product A by issuing the TXN A . It can be assumed that certain operational validations are on-going to stage a new product B which is going to be made available in the production facility 12. In order to stage this service, some traffic TXN B must be available to the fare shopping servers of the staging facility 16. This traffic TXN B is generated by the traffic generation subsystem 24.
- the entry point 20 makes a copy of this request (shadowed TXN A ) and routes it to the traffic generation subsystem 24 in the staging facility 16.
- the traffic generation subsystem 24 generates a new request TXN B and sends a collateral transaction (via entry point 20) to the staging fare shopping servers 18 for further monitoring.
- the customer 22 receives the response it expects from TXN A , without being impacted by the ongoing operational validation being performed by the staging facility 16.
- the traffic generation subsystem 24 which implements the invention is preferably configured to listen and respond to any kind of transaction defined in the faring system 10, and to thus to be able to receive any input traffic.
- the traffic generation subsystem 24 operates to selectively transform a given TXN A into one or more (at least one) TXN B .
- the generation of this pseudo-traffic follows a technique driven by transformations, also referred to herein as business transformations, stored in the dedicated database 26.
- the traffic generation subsystem 24 checks by using an input filter whether the incoming TXN A can be used as a source of traffic for the on-going operational validation. If not, the TXN A is dropped (ignored) and is th us not transformed into at least one TXN B .
- the traffic generation subsystem 24 fetches from the business transformations database 26 a list of transformation rules 26A that should be applied to generate new traffic.
- the transformation rules 26A can include, as non-limiting examples, values rules, distribution rules and relation rules. If no transformation rule is found to apply, the transaction is dropped.
- the traffic generation subsystem 24 checks execution rules 26B that should apply for the generated traffic (e.g., number of transactions to generate from the input, the sending pace, etc.) As shown in Figure 2, the execution rules 26B can include, for example, throttling rules and looping rules.
- the traffic generation subsystem 24 then applies, at Block 2D, the applicable transformation rule(s) 26A to generate one TXN B , and at Block 2F sends the generated TXN B to the fare shopping servers 18 for processing (via the entry point 20). Note that this process can be recursive, and can be repeated until the amount of traffic indicated by the execution rules 26B is reached. This recursion is depicted in Figure 2 by the Blocks 2E and 2G.
- the traffic generation subsystem 24 thus generates traffic by applying the series of transformation rules 26A and execution rules 26B.
- the applicable rules 26A, 26B are stored in the dedicated database 26.
- the database 26 can be populated manually depending on the needs of the operational validation .
- a particular transformation rule 26A specifies: the type of input it applies to, a set of rules to apply in order to generate a new output (TXN B ), and a name of (or some other type of reference to) one or more of the execution rules 26B.
- Some rules can express a simple data mapping, e.g., that the values of fields from TXN A are copied to fields in TXN B .
- Other rules can express how to provide a value to new fields in TXN B.
- These rules which can be referred to as the valuation rules, define a list of fields (e.g., carrier, market, city, etc.) which will be inserted in the generated requests, along with a list of values which can be generated for each field.
- a valuation rule can specify to add a city field with either NYC or PAR as the possible values.
- Distribution rules specify the frequency at which values are generated for a field. In accordance with the example above, one exemplary distribution rule could generate the value PAR 60% of the time, and NYC 40% of the time.
- Relation rules specify how a field valuation affects the valuation of other fields. Relation rules can be used, for example, to model semantic dependencies between fields, or to blacklist (prohibit) certain combinations of valuations.
- an ad-hoc transformation can be performed using a plug-in. This can be useful when the generation logic depends on, for example, some specific complex business constraints (e.g. generation based on geographic constraints).
- An execution rule 26B specifies looping and traffic regulation for the traffic generated from an input transaction. Looping rules specify how many transactions to generate from an input TXN. This can be useful in a case where the real production traffic is not available in sufficient quantity for the needs of the operational validation. In this case then it can be specified to generate n TXN B from a single TXN A , where n can be equal to one or greater than one.
- Another type of execution rule 26B are regulation rules that define how to send the generated traffic, for instance the frequency of sending in TPS (transactions per second).
- the sending function auto-regulates itself to send less traffic if the generated traffic yields too many technical errors (for instance, too many transaction time outs are generated)
- a first use case example concerns increasing the number of flight recommendations returned to a customer.
- the customer 22 has access to a product A which returns the least expensive flights for a given journey (departure plus destination) on a given date and operated by a given carrier.
- the faring system 10 returns recommendations for the least expensive flights which match the customer criteria.
- the traffic generation subsystem 24 can be configured with the following transformation rules (stored in the database 26): one valuation rule which determines the range of flight recommendations number requested by the customer; one distribution rule that specifies that the recommendation values are generated randomly; and one relation rule that specifies that if the input traffic requests more recommendations than the generated output, keep the largest number of recommendations.
- Blocks 4A and 4B are basically identical to Blocks 2A and 2B of Figure 2. In this case traffic captured from the production facility is transmitted to the traffic generation subsystem 24.
- the input filter (Block 4A) only retains the traffic related to product A.
- the valuation rule is updated manually to change the range of flight recommendations number (first [100,300], then [200 ,400] , then [300 ,500] , etc. ) u nti l a new acceptable val ue for "maxi mu m recommendations" is determined.
- This incremental approach aids in determining the limits of the faring system 10, something which would have been difficult or impossible to achieve if one were to rely on the use of only real production traffic.
- a second exemplary use case concerns generating complex itineraries for a specific carrier.
- a Japanese customer which currently uses Product B will soon use a new product B' provided by the faring system 10.
- the customer 22 will request fare quotes for a journey comprising "complex itineraries", such as the least expensive fares for journeys involving at least four flights (domestic or international) over a given date range.
- complex itineraries such as the least expensive fares for journeys involving at least four flights (domestic or international) over a given date range.
- the customer traffic targeting product B only contains domestic requests composed of, at most, two flights.
- the traffic generation subsystem 24 is configured to process transactions from this Japanese client only.
- the traffic generation subsystem 24 applies the following rules (see also Figure 5 and Figure 6).
- a semantic relation specifies that inserted flights must be chosen such that all flights remain consecutive in the flight request (as depicted in Figure 5).
- a second relation rule whatever the number of flight segments present in the original request (either one or two), there must be four flight segments in the generated request.
- FIG. 6 illustrates the various steps which occur in the traffic generation subsystem 24 during the generation of the new traffic ( ⁇ ⁇ ') from the production traffic TXN B .
- the Blocks 6A, 6B and 6C are substantially the same as Blocks 2A, 2B and 2C, respectively, of Figure 2.
- Traffic headed to the production facility 12 is captured (i.e., duplicated) by the entry point 20 and is transmitted to the traffic generation subsystem 24, and only traffic related to product B (TXN B ) is kept. That is, traffic which does not correspond to the Japanese client (and to product B) is simply dropped. Requests are processed according to the valuation rules in Block 6D, and the new traffic ( ⁇ ⁇ ') is sent to the staging facility fare shopping servers 18. The newly-generated transactions are dropped before being sent if the amount of generated traffic per second exceeds the limit imposed by the execution rule related to throttling (10 TPS in this example).
- a third exemplary use case concerns performing operational validation on client facilities.
- an airline referred to herein as a client 22'
- This service makes use of a new product X of the faring system 10.
- the client desires to test its own service (for new product X) before opening it in production.
- the client does not wish to perform its operational validation manually, and needs an existing source of traffic to simulate the new traffic and to verify the operational stability of the client's Web infrastructure.
- the client 22' sends traffic (e.g., pre-recorded traffic transactions, duplicated traffic and/or traffic obtained by the client 22' by whatever means) that is directed to the traffic generation subsystem 24 (TXN W ).
- traffic e.g., pre-recorded traffic transactions, duplicated traffic and/or traffic obtained by the client 22' by whatever means
- TXN W traffic generation subsystem 24
- This traffic is transformed in accordance with business transformations stored in database 26 into traffic TXN X that is supplied to the staging system fare shopping servers 18.
- the business transformations are selected to implement transaction messages that pertain to the new service to be launched by the airline client 22'.
- the output of the fare shopping servers 1 8 is subsequently returned as TXN X traffic to the airline client 22', thereby enabling the client 22' to test its Web infrastructure prior to the actual launch of the new service in conjunction with the faring system 10. That is, the traffic generation subsystem 24 generates the relevant transactions and passes them to the staging system fare shopping servers 18 for processing. The responses from the fare shopping servers 18 are forwarded to the client 22', who is then able to process the data and perform its own operational validation.
- the various blocks shown in Figures 2, 4 and 6 can represent operations carried out in response to the execution of computer program instructions by one or more data processors that form a part of the traffic generation subsystem 24, in cooperation with the knowledge model (transformation rules, execution rules) stored in the business transformations database 26.
- These computer program instructions are considered to be stored in or on some suitable computer-readable medium, such as fixed or removable d isk and/or fixed or removable semicond uctor memory or memories, which form a part of the traffic generation subsystem 24.
- the various blocks shown in Figures 2, 4 and 6 can be viewed as interconnected hardware elements that are configured to carry out the specified functions in cooperation with the knowledge model (transformation rules, execution rules) stored in the business transformations database 26.
- the various blocks shown in Figures 2, 4 and 6 can be viewed as being a combination of computer program instructions and interconnected hardware elements.
- each of the production facility 12, staging facility 16 and fare shopping servers 14 and 18 can each be implemented using one or co-located or distributed data processing platforms executing computer program code. In some embodiments all of this functionality may be implemented on a single data processing platform.
- the various names used for the described system components are not intended to be limiting in any respect, as these various system components may be identified by any suitable names.
- the traffic generation subsystem 24 could be referred to, without a loss of generality, as a traffic emulation unit or as a shadow traffic transformation system, as two non-limiting examples.
- the use of the exemplary embodiments is not limited to only airline reservation-related purposes, but can be used for making other types of reservations (e.g., train, bus, automobile, hotel, etc.)
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Computer Hardware Design (AREA)
- Development Economics (AREA)
- Tourism & Hospitality (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Operations Research (AREA)
- Human Resources & Organizations (AREA)
- Entrepreneurship & Innovation (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Mathematical Physics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Devices For Checking Fares Or Tickets At Control Points (AREA)
- Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
- Computer And Data Communications (AREA)
- Debugging And Monitoring (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
Claims
Priority Applications (8)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| AU2011287868A AU2011287868B2 (en) | 2010-08-02 | 2011-07-07 | Automatic traffic generation for a faring system |
| CA2807181A CA2807181C (en) | 2010-08-02 | 2011-07-07 | Automatic traffic generation for a faring system |
| SG2013007307A SG187645A1 (en) | 2010-08-02 | 2011-07-07 | Automatic traffic generation for a faring system |
| BR112013002278A BR112013002278A2 (en) | 2010-08-02 | 2011-07-07 | method for generating simulation data performed by a computer pass system and computer computer pass system |
| JP2013522172A JP6005044B2 (en) | 2010-08-02 | 2011-07-07 | Automatic traffic generation for fairing systems |
| KR1020137005607A KR101639108B1 (en) | 2010-08-02 | 2011-07-07 | Automatic traffic generation for a faring system |
| CN201180044925.0A CN103119617B (en) | 2010-08-02 | 2011-07-07 | The automatic flow of ticketing system produces |
| ZA2013/00887A ZA201300887B (en) | 2010-08-02 | 2013-02-01 | Automatic traffic generation for a faring system |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP10305855A EP2416284A1 (en) | 2010-08-02 | 2010-08-02 | Automatic traffic generation for a faring system |
| EP10305855.8 | 2010-08-02 | ||
| US12/924,058 US9129051B2 (en) | 2010-08-02 | 2010-09-20 | Automatic traffic generation for a faring system |
| US12/924,058 | 2010-09-20 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2012016782A1 true WO2012016782A1 (en) | 2012-02-09 |
Family
ID=42830272
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2011/061459 Ceased WO2012016782A1 (en) | 2010-08-02 | 2011-07-07 | Automatic traffic generation for a faring system |
Country Status (11)
| Country | Link |
|---|---|
| US (1) | US9129051B2 (en) |
| EP (1) | EP2416284A1 (en) |
| JP (2) | JP6005044B2 (en) |
| KR (1) | KR101639108B1 (en) |
| CN (1) | CN103119617B (en) |
| AU (1) | AU2011287868B2 (en) |
| BR (1) | BR112013002278A2 (en) |
| CA (1) | CA2807181C (en) |
| SG (1) | SG187645A1 (en) |
| WO (1) | WO2012016782A1 (en) |
| ZA (1) | ZA201300887B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10581756B2 (en) * | 2014-09-09 | 2020-03-03 | Microsoft Technology Licensing, Llc | Nonintrusive dynamically-scalable network load generation |
| US20180077227A1 (en) * | 2016-08-24 | 2018-03-15 | Oleg Yeshaya RYABOY | High Volume Traffic Handling for Ordering High Demand Products |
| JP6647725B2 (en) * | 2017-01-31 | 2020-02-14 | 日本電信電話株式会社 | Traffic generation device and traffic generation method |
| EP3379429A1 (en) * | 2017-03-22 | 2018-09-26 | Siemens Aktiengesellschaft | A method for retrieving a recommendation from a knowledge database of a ticketing system |
| CN108090784B (en) * | 2017-11-28 | 2021-04-30 | 口碑(上海)信息技术有限公司 | Marketing activity simulation verification method and device |
| US10901874B2 (en) * | 2018-05-18 | 2021-01-26 | Sony Interactive Entertainment LLC | Shadow testing |
| JP7812271B2 (en) * | 2022-03-31 | 2026-02-09 | 本田技研工業株式会社 | Airline Reservation System |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1999001819A1 (en) * | 1997-07-01 | 1999-01-14 | Progress Software Corporation | Testing and debugging tool for network applications |
| GB2399196A (en) * | 2003-02-28 | 2004-09-08 | Sun Microsystems Inc | Automating and recording Web applications |
| GB2417865A (en) * | 2004-09-03 | 2006-03-08 | Marconi Comm Ltd | Monitoring and modifying communications between end nodes at an intermediate node |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020143587A1 (en) * | 2001-04-02 | 2002-10-03 | Microsoft Corporation | Optimized system and method for finding best fares |
| JP4461777B2 (en) * | 2003-11-14 | 2010-05-12 | 日本電気株式会社 | Transaction processing system and method, and program |
| DE102004017309A1 (en) * | 2004-04-06 | 2005-11-10 | Francotyp-Postalia Ag & Co. Kg | Method and arrangement for carrying out transactions |
| US8255281B2 (en) * | 2006-06-07 | 2012-08-28 | T-Mobile Usa, Inc. | Service management system that enables subscriber-driven changes to service plans |
| KR20080001424A (en) * | 2006-06-29 | 2008-01-03 | 주식회사 케이티 | Internet unauthorized payment prevention system and method |
| US8126783B2 (en) * | 2006-10-06 | 2012-02-28 | Sabre Inc. | Rule-based shopping |
| JP4860422B2 (en) * | 2006-10-13 | 2012-01-25 | 新日本製鐵株式会社 | Test support apparatus, test support method, computer program, and storage medium |
| KR20080081597A (en) * | 2007-03-06 | 2008-09-10 | 주식회사 케이티 | Web topi service providing system, gateway, server and method |
| EP2079044A1 (en) * | 2008-01-14 | 2009-07-15 | Amadeus S.A.S. | Multi-travel aggregator |
| WO2009105459A2 (en) | 2008-02-18 | 2009-08-27 | Ita Software, Inc. | Methods and systems to test airline information systems |
| EP2172885A1 (en) * | 2008-09-30 | 2010-04-07 | Amadeus S.A.S. | Method and system for simulating and optimizing revenue from service fees in or relating to online service processes |
-
2010
- 2010-08-02 EP EP10305855A patent/EP2416284A1/en not_active Ceased
- 2010-09-20 US US12/924,058 patent/US9129051B2/en active Active
-
2011
- 2011-07-07 CA CA2807181A patent/CA2807181C/en active Active
- 2011-07-07 BR BR112013002278A patent/BR112013002278A2/en not_active IP Right Cessation
- 2011-07-07 KR KR1020137005607A patent/KR101639108B1/en not_active Expired - Fee Related
- 2011-07-07 CN CN201180044925.0A patent/CN103119617B/en active Active
- 2011-07-07 WO PCT/EP2011/061459 patent/WO2012016782A1/en not_active Ceased
- 2011-07-07 SG SG2013007307A patent/SG187645A1/en unknown
- 2011-07-07 AU AU2011287868A patent/AU2011287868B2/en not_active Ceased
- 2011-07-07 JP JP2013522172A patent/JP6005044B2/en active Active
-
2013
- 2013-02-01 ZA ZA2013/00887A patent/ZA201300887B/en unknown
-
2016
- 2016-06-08 JP JP2016114449A patent/JP6200039B2/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1999001819A1 (en) * | 1997-07-01 | 1999-01-14 | Progress Software Corporation | Testing and debugging tool for network applications |
| GB2399196A (en) * | 2003-02-28 | 2004-09-08 | Sun Microsystems Inc | Automating and recording Web applications |
| GB2417865A (en) * | 2004-09-03 | 2006-03-08 | Marconi Comm Ltd | Monitoring and modifying communications between end nodes at an intermediate node |
Non-Patent Citations (2)
| Title |
|---|
| KANT K ET AL: "Geist: a generator for e-commerce & internet server traffic", PERFORMANCE ANALYSIS OF SYSTEMS AND SOFTWARE, 2001. ISPASS. 2001 IEEE INTERNATIONAL SYMPOSIUM ON NOV. 4-6, 2001, PISCATAWAY, NJ, USA,IEEE, 4 November 2001 (2001-11-04), pages 49 - 56, XP010583888, ISBN: 978-0-7695-7230-7 * |
| RUFFO G ET AL: "WALTy: a user behavior tailored tool for evaluating web application performance", NETWORK COMPUTING AND APPLICATIONS, 2004. (NCA 2004). PROCEEDINGS. THI RD IEEE INTERNATIONAL SYMPOSIUM ON BOSTON, MA, USA AUG. 30 - SEPT. 1, 2004, PISCATAWAY, NJ, USA,IEEE, 30 August 2004 (2004-08-30), pages 77 - 86, XP010736739, ISBN: 978-0-7695-2242-5, DOI: DOI:10.1109/NCA.2004.1347765 * |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20130138190A (en) | 2013-12-18 |
| AU2011287868B2 (en) | 2016-08-11 |
| SG187645A1 (en) | 2013-03-28 |
| CA2807181C (en) | 2018-03-27 |
| EP2416284A1 (en) | 2012-02-08 |
| JP6005044B2 (en) | 2016-10-12 |
| ZA201300887B (en) | 2014-04-30 |
| CA2807181A1 (en) | 2012-02-09 |
| US9129051B2 (en) | 2015-09-08 |
| KR101639108B1 (en) | 2016-07-12 |
| CN103119617A (en) | 2013-05-22 |
| AU2011287868A1 (en) | 2013-02-14 |
| CN103119617B (en) | 2016-08-03 |
| US20120030057A1 (en) | 2012-02-02 |
| JP2013534337A (en) | 2013-09-02 |
| JP6200039B2 (en) | 2017-09-20 |
| JP2016192219A (en) | 2016-11-10 |
| BR112013002278A2 (en) | 2016-05-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2011287868B2 (en) | Automatic traffic generation for a faring system | |
| Fu | Scheduling dial-a-ride paratransit under time-varying, stochastic congestion | |
| Ulmer | Anticipation versus reactive reoptimization for dynamic vehicle routing with stochastic requests | |
| Peer et al. | Long‐Run Versus Short‐Run Perspectives On Consumer Scheduling: Evidence From A Revealed‐Preference Experiment Among Peak‐Hour Road Commuters | |
| Brunato et al. | Combining intelligent heuristics with simulators in hotel revenue management | |
| Rose et al. | Demand for taxi services: new elasticity evidence | |
| Yan et al. | Inter-school bus scheduling under stochastic travel times | |
| Kawamoto et al. | Market efficiency among futures with different maturities: Evidence from the crude oil futures market | |
| Hess et al. | Some lessons in stated choice survey design | |
| Liu et al. | Are the queueing systems in practice random or uncertain? Evidence from online car-hailing data in Beijing | |
| Cheranchery et al. | Improving ridership and reducing subsidy for premium bus service in Kolkata Metro City | |
| Mattock et al. | The Dynamic Retention Model for Air Force Officers: New Estimates and Policy Simulations of the Aviator Continuation Pay Program | |
| US20200364628A1 (en) | Parallel versioning and multi-variate testing | |
| CN109150757A (en) | A kind of advertising resource processing method, device and electronic equipment | |
| Lang et al. | Establishing an extendable benchmarking framework for e-fulfillment | |
| WO2010037779A1 (en) | A method and system for simulating and optimizing revenue from service fees in or relating to online service processes | |
| Sutejo et al. | Evaluation of SPBE Management Domain of Tangerang City Government Based on Regulation of the Minister of PAN-RB Number 59 of 2020 | |
| Rosario et al. | Impact of transfers on elementary education expenditure and measuring equalisation transfers to Indian States | |
| Abdul Ghani et al. | Analysis of MCLP, Q‐MALP, and MQ‐MALP with Travel Time Uncertainty Using Monte Carlo Simulation | |
| Das et al. | Valuing travel attributes of rural feeder service to bus stop: Comparison of different logit model specifications | |
| Arcari et al. | Performance-Driven Analysis for an Adaptive Car-Navigation Service on HPC Systems | |
| Ariyanto et al. | Performance Analysis of Mobile Learning Systems on Cloud Computing Using Load Testing Methods | |
| Bharti et al. | Modeling travel time of car with varying demand on an urban midblock section | |
| Rodríguez-García et al. | The Nature and the Policy Added Value of EU Integrated Urban Initiatives: Research Issues and Strategies | |
| Kesur | Improving precision and reducing runtime of microscopic traffic simulators through stratified sampling |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WWE | Wipo information: entry into national phase |
Ref document number: 201180044925.0 Country of ref document: CN |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11735409 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2807181 Country of ref document: CA |
|
| ENP | Entry into the national phase |
Ref document number: 2013522172 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2011287868 Country of ref document: AU Date of ref document: 20110707 Kind code of ref document: A |
|
| ENP | Entry into the national phase |
Ref document number: 20137005607 Country of ref document: KR Kind code of ref document: A |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 11735409 Country of ref document: EP Kind code of ref document: A1 |
|
| REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112013002278 Country of ref document: BR |
|
| ENP | Entry into the national phase |
Ref document number: 112013002278 Country of ref document: BR Kind code of ref document: A2 Effective date: 20130130 |