JP2019133598A - Verification system and program - Google Patents

Abstract

To provide a verification system capable of shortening time of verification processing while securing identity of behavior of an old and a new systems.SOLUTION: A verification system 10 compares and verifies processing results of an old and a new systems at a time of system revision, and comprises: classification means 42 for classifying an input telegram message acquired from a real environment into a plurality of time zones using a recording time in accordance with a plurality of time zones in which behavior of a system switches; reproduction telegram message storage means 56 for storing the input telegram message in a classified state; and input means 43 for inputting an input telegram message in a time zone corresponding to a virtual time of the classified input telegram message stored in a reproduction telegram message storage means 56 relative to a new system under a test environment set at the virtual time different from a real time according to the plurality of time zones.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a verification system and a program for executing a process for comparing and verifying the processing results of a new system and an old system in order to test the operation of the new system at the time of system renewal. It can be used when renewing an order processing system for placing an order with a market system.

  In general, there are systems that handle various tasks, but many of them perform tasks by cooperation of a plurality of systems (a plurality of computers), not a single system. For example, in a system that handles securities / financial operations such as buying and selling of financial products such as stocks, an order reception server that accepts customer orders entered via client terminals via a network such as the Internet, an order processing system that is a mainframe, and securities Market systems such as exchange systems are linked.

  When renewing a part of a plurality of systems linked in this way, the system constituting the renewal part transmits and receives a message to and from the peripheral system. Since there is a message input from the system and a message output to the peripheral system, the operation of the new system after the update is verified in a state including cooperation with such a peripheral system. If there are several peripheral systems, verification is performed in consideration of cooperation with each peripheral system.

  At this time, in the system renewal, the new system should basically behave in the same way as the old system under the same conditions, and in order to guarantee the conditions, an individual combination test is performed, It is necessary to check the behavior, but if there is a leak in the test case, an unexpected system failure may occur.

  In order to solve this, a message actually generated in the production environment of the old system is acquired from log information etc., and a message reproduced in the test environment based on it is also input to the new system and output as a result The verification process using the method of confirming that the same behavior is confirmed by comparing the electronic message and the database with the old and new systems and confirming that there is no difference between them.

  In addition, when the actual data acquired from the old system in the production environment is reproduced in the test environment in this way and verified by introducing it into the new system, it takes a lot of time for the test time As a system for solving this problem, a test apparatus that adjusts data input time is known (see Patent Document 1). In this test apparatus, test data information (corresponding to a reproduction telegram) is obtained by request input history information (corresponding to log information of an input telegram) and access history information to a production system (corresponding to the old system in the description of the present invention). When the access times of the first test data that is created and updated access and the second test data that is updated access overlap, the request input time of the second test data (corresponding to the input timing of the input message) is The test data information is updated so as to be delayed by a predetermined time, and the test data included in the updated test data information is input to the test system (corresponding to the new system). At this time, when a plurality of test data included in the updated test data information is input to the test system and an access failure occurs, the request input time of the test data in which the access failure occurs is delayed.

JP 2011-86083 A

  As mentioned above, the method of reproducing the actual data acquired from the old system in the production environment in the test environment and inputting it into the new system for verification is frequently used. Occurs.

  As a first problem, when the reproduction of one day is performed over one day, when there are a large number of days to be reproduced, the number of days is generated accordingly. In this case, even if the message of the day is simply compressed in time and put into the new system, it will not be reproduced correctly. This is because the system may behave differently when a telegram generated during the night time is inserted in the daytime. For example, in the case of a stock order processing system, if 15:30 to 18:00 is an order reception stop time zone, and an order message is inserted during that time zone, an error in the order reception stop time zone will occur. In return, if a message is inserted outside the time period, the order message will be accepted normally.

  In the case of the stock order processing system as in the above example, the difference in system behavior in each time zone is mainly caused by the relationship with the market system, but more generally, the behavior of the system in each time zone is Differences occur not only in relation to peripheral systems such as market systems, but also in cases where they are based on laws and regulations or various regulations and guidance, in accordance with arrangements of companies and organizations, in relation to power supply, etc. This can occur for various reasons. Therefore, the same problem as the first problem described above occurs not only in the case of renewal of a system configured to perform data linkage with a peripheral system, but also in the case of renewal of a system that performs business processing independently. obtain. For this reason, the present invention mainly performs verification processing when a part of a series of systems that perform data linkage is renewed. However, the present invention is not limited to this, and the system performs business processing independently. It is also possible to execute a verification process in the case of renewing.

  As a second issue, the reproduction test needs to be repeated not only once, but many times on the same day, but there are a lot of preparatory work such as preparation of input telegrams and maintenance of data in the system. Therefore, the procedure until one operation is performed becomes complicated.

  As a third problem, when there are a plurality of input paths of input messages, the output messages may not match unless all of the input paths are reproduced in the same order as they were generated. For example, in the case of a stock order processing system, there are an order message input path from an order reception server connected to a client terminal to which an order input operation is performed and a network, and an input path of a notification message from a market system. In addition, in the case of an order processing system that accepts conditional orders such as stop limit order, dual limit order, continuous order, etc., input a conditional order ordering message from a conditional success / failure monitoring server that monitors the success / failure of the condition There is also a route.

  As a fourth problem, if there is a part where the specifications are changed between the old and new systems for the part related to system renewal, the actual input message obtained from the production environment is simply input to the new system under the test environment In addition, the response messages of the old and new systems cannot be simply compared. Note that the specification change here does not mean a change in the hardware specification that contributes to improving the performance of the system. Yes, but that doesn't mean that.) It means changing the structure (format or definition) of a database or message. For example, regarding the market, “1 = Tokyo” and “2 = Osaka” were used in the old system, whereas “1 = Osaka” and “2 = Tokyo” were used in the new system. In the old system, “1 = ordering” and “2 = contracted”, whereas in the new system, “1 = contracted” and “2 = ordering”, the definitions are reversed. It is a case where it moves or shifts

  Therefore, it is desired to develop a verification system that can solve the first problem in the sense of reducing the processing time required for the test. In addition, it is more convenient if the second to fourth problems can be solved.

  Note that the test apparatus described in Patent Document 1 described above performs a process of delaying the request input time, and thus it can be said that the data input time is adjusted, but the first as described above. -It does not solve the fourth problem.

  An object of the present invention is to provide a verification system and a program that can shorten the verification processing time while ensuring the same behavior of the old and new systems.

The present invention is a verification system for executing a process of comparing and verifying the processing results of the new system and the old system in order to test the operation of the new system at the time of system renewal,
Production message storage means for storing the input message acquired from the old system in the production environment together with the recording time in the production environment;
Processing to classify incoming messages stored in the actual incoming message storage means into multiple time zones using the recording time in accordance with multiple time zones when the system behavior switches in common for both the new system and the old system A classification means for performing
Reproduced message storage means for storing the input messages classified by the classification means in a classified state;
For the new system in the test environment where the system time is set to a virtual time different from the actual time according to multiple time zones, among the input messages after classification stored in the reproduced message storage means, the new system It is characterized by comprising a means for executing, for each of a plurality of time periods, a process for inputting an input message in a time period corresponding to the set virtual time via a communication line.

  Here, in the “input means”, “according to the time zone…” as in “a state in which the system time is set to a virtual time different from the actual time according to a plurality of time zones”, and “to the virtual time” The reason why “the time zone corresponding to...” As in the “input message of the corresponding time zone” is as follows. That is, normally, the system time should be set to the start time of each time zone, which is the simplest processing, but the input time of the input message is a desired time zone (virtual time zone that proceeds in the new system) Therefore, a time other than the start time of each time zone may be set as the system time. For example, in the time zone of 6:00 to 8:00, it is normal to set the start time 6:00 of the time zone, but the input message to be put in the time zone by 8:00 On the assumption that the process of (1) is completed (the input timing of the input message to the new system is considerably compressed in terms of time, so the process in the time period is completed in a time length considerably shorter than 2 hours). For example, a virtual time (time after 6:00) such as 6:00 or 7:00 may be set. On the contrary, for example, it is possible to set a virtual time (time before 6:00) such as 5:59. In this case, after setting the virtual time, the input message is set after a certain time. If, for example, a virtual time of 5:59 is set and the input message is started after being set for one minute, the input message is input after 6:00. Therefore, the processing is performed within the time zone 6:00 to 8:00, and an appropriate system behavior can be obtained. However, if there is no necessity or advantage for shifting, setting the start time of each time zone as the system time may be simple as processing.

  In addition, the “system time” in which the virtual time is set usually means the time held by the computer, but a control program for managing time is separately operated, and various business programs of the new system are If it is configured to perform business processing with reference to the time managed by the control program, it may be the time managed by the control program, in short, the time acquired by various business programs, It is only necessary that the virtual time can be set.

  In such a verification system of the present invention, input messages used for reproduction in a test environment are classified into a plurality of time zones, and each of the plurality of time zones is a system for a new system under the test environment. With the time set to the virtual time, the process to input the input message in the time zone corresponding to the virtual time to the new system is executed, so even if the input message input timing (input interval) is compressed, When viewed at the virtual time that is progressing in the new system, the input message will be input to the new system at the time to be input. Behavior that reproduces the processing executed in the production environment) can be obtained.

  For this reason, it is not necessary to carry out the reproduction of the day over one day, and the reproduction of the day can be executed in a short time by compressing the input timing (input interval) of the input message to the new system. It is possible to shorten the processing time.

  In addition, even when there are a large number of days to be reproduced, the number of days required for the test is generated for the same number of days as the production environment by compressing the input timing (input interval) of the input message to the new system beyond the day. It is possible to avoid this, and it is possible to shorten the time for the verification process, thereby achieving the object.

  <Configuration for Linking Transmission Processing of Virtual Time Setting Command with Input Processing of Input Message in Time Zone Corresponding to Virtual Time>

  In addition, in the verification system described above, it is only necessary to set a virtual time corresponding to the time zone before the input message for a certain time zone is input to the new system. May be executed at a timing determined by manual judgment, or may be executed through manual operation. However, in order to effectively reduce the verification processing time while saving labor, the following configuration is desirable.

That is, in the verification system described above,
The input means is
A virtual time setting command for setting the system time to a virtual time different from the actual time according to a plurality of time zones is transmitted to the new system under the test environment via the communication line, and then the virtual time is set. Executes the process of sending the input message in the time zone corresponding to the time to the new system via the communication line. At this time, the process for transmitting the virtual time setting command and the time zone corresponding to the virtual time It is desirable that the input message input process is repeated alternately for a plurality of time zones.

  In this way, when the processing for transmitting the virtual time setting command and the input processing of the input message in the time zone corresponding to the virtual time are linked and automated, the virtual time setting command It is not necessary to manually manage the transmission timing and the input start timing of input messages in the time zone corresponding to the virtual time. ) And the compression of the input timing (input interval) of the input message can be more reliably performed. That is, since the compression of the input timing (input interval) of each input message within the same time zone can be realized even if the input start timing is managed manually, the effect of compression input can be obtained. By automating the setting of such virtual time (system time) and the start of input, the time interval between the input start timing of a certain time zone and the input start timing of the next time zone is more reliably reduced. Therefore, it is possible to more reliably realize the compression input across a plurality of time zones. In addition, automation of reproduction enables nighttime reproduction tests. This effect becomes more prominent when the same day is reproduced many times, or when a plurality of days (a plurality of days in the production environment) are reproduced.

  <Configuration for renewing an order processing system that accepts customer orders and places orders on the market system>

In the verification system described above,
The new and old systems that are subject to system renewal are order processing systems that accept customer orders and place orders with market systems.
The time zone is the time zone set for sending and receiving messages with the market system.
The input message includes an order message containing cases of new orders, order corrections, and order cancellations entered by customers or their agents, and notification messages from the market system,
Classification means
A configuration in which input messages classified into a plurality of time zones are further grouped for each customer, and processing for storing the input messages in the reproduced message storage means in a state classified into time zones and grouped for each customer And
The input means is
For each of multiple time zones, a configuration is adopted in which input messages grouped for each customer are input to the new system in groups for each customer while maintaining the order of input messages within the same customer. be able to.

  Here, in the “notification message from the market system”, when another system (for example, a market connection system) is interposed between the old and new system subject to system renewal and the market system, the other A notification message from the system is included.

  In this way, when the order processing system is configured to be renewed, for each of a plurality of time zones, the input messages grouped for each customer are grouped for each customer while maintaining the order of the input messages within the same customer. Since it is introduced into the new system in units, the production environment can be reproduced appropriately. That is, in the order processing system, there are order messages including cases of new orders, order corrections, and order cancellations, and notification messages from the market system, so the input messages are classified by time zone. In addition, even if the virtual time is set as the system time, if the order of input messages within the same customer is not maintained as the production environment, the new system will reproduce the desired behavior (processing in the production environment). However, it is possible to avoid the occurrence of such a problem. For example, in the production environment, when the order of new order message, correction order message, and contract notification message are input, the order of correction order message and contract notification message is switched in the test environment. If this is the case, the processing result will be different, but such a situation can be avoided.

  <Configuration for Predetermining Input Route Preferentially when There are Multiple Input Routes for Input Message and Recording Time for Multiple Input Routes is the Same Time>

In the case where the order processing system described above is renewed,
In addition to the order message and notification message, the input message includes a conditional order order message that is input when the condition is satisfied for a conditional order that needs to be monitored for the timing of ordering to the market system.
Classification means
When grouping input messages for each customer in multiple time periods, for input messages that have the same recording time in the production environment, order messages, conditional ordering messages, and notification messages are listed in this order. In accordance with a predetermined priority order, it is desirable that the input messages are arranged so that the input messages with the highest priority are input in order to the new system under the test environment.

  In this way, when the input path to be prioritized when the recording times for a plurality of input paths become the same time is configured in advance, the situation that occurred in the production environment can be correctly reproduced, It is possible to obtain a desired behavior (behavior that correctly reproduces processing in a production environment) in the system. In other words, even if the recording time in the production environment for multiple input paths is the same time, the actual processing in the production environment has a time difference that is less than the minimum increment of the recording time. In some cases, there may be an order. If the order of these processes is reversed, an error will occur and the new system may not be able to obtain the desired behavior (behavior that reproduces the process in the production environment). However, it is possible to avoid such a problem. For example, even if the log recording time for the correction order message input and the log recording time for the correction completion notification message input are the same time, the former processing is actually faster, If these are reversed, it is possible to avoid such a situation because a correction completion notification is received even though the order has not been corrected. In addition, when the recording times of a plurality of input paths are recording times on different computers, the step size of the minimum unit of the recording time may be different between computers. Problems can arise.

  <Configuration when there is a difference in the format or definition of the input message between the new system and the old system due to system renewal>

In the verification system described above,
It is provided with a difference storage means for input for storing a difference in format or definition of input messages between the new system and the old system accompanying the system renewal,
The input means is
Using the difference in the format or definition of the input message stored in the input difference storage means, the classified input message stored in the reproduced message storage means is converted into the format or definition for the new system, and then the new system It is good also as a structure which performs the process thrown into.

  In this way, using the difference in the format or definition of the input message stored in the input difference storage means, the input message is converted into the format or definition for the new system by the input means and then input to the new system. In this case, even if there is a difference in the format or definition of the input message between the old and new systems, an input message to be input to the new system under the test environment is automatically created using the input message acquired from the production environment. Therefore, preparation work for the verification process is facilitated, and labor saving can be achieved.

  <Invention of program>

  The program of the present invention is for causing a computer to function as the verification system described above.

  The above-mentioned program or a part thereof is, for example, a magneto-optical disk (MO), a compact disk (CD), a digital versatile disk (DVD), a flexible disk (FD), a magnetic tape, or a read-only memory (ROM). Recorded on recording media such as electrically erasable and rewritable read only memory (EEPROM), flash memory, random access memory (RAM), hard disk drive (HDD), solid state drive (SSD), flash disk, etc. Can be stored, distributed, etc., and transmitted using a transmission medium such as a wired network such as LAN, MAN, WAN, Internet, Intranet, Extranet, or a wireless communication network, or a combination thereof. You It is possible, also, it can be delivered by placing the carrier. Furthermore, the above program may be a part of another program, or may be recorded on a recording medium together with a separate program.

  As described above, according to the present invention, input messages used for reproduction in a test environment are classified into a plurality of time zones, and for each of the plurality of time zones, a new system under the test environment is classified. With the system time set to the virtual time, the processing to input the input message in the time zone corresponding to the virtual time to the new system is executed, so the verification process can be performed while ensuring the same behavior of the old and new systems. There is an effect that the time can be reduced.

1 is an overall configuration diagram of a verification system according to an embodiment of the present invention. The block diagram of the old system under the production environment used as the object of the system renewal in the said embodiment. The block diagram of the new system under the test environment used as the object of the system renewal in the said embodiment. Explanatory drawing of the preparation method of the input message | telegram thrown into the new system under the test environment of the said embodiment. Explanatory drawing of the injection method of the input message to the new system under the test environment of the embodiment. The figure of the flowchart which shows the flow of the verification process by the verification system of the said embodiment.

  An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 shows the overall configuration of the verification system 10 of the present embodiment. 2 and 3 show the configurations of the old system under the production environment and the new system under the test environment, which are the targets of the system renewal. FIG. 4 and FIG. 5 are explanatory diagrams of a creation method and a throwing method of a throwing message to be thrown into a new system under a test environment. Further, FIG. 6 shows a flowchart of the verification process by the verification system 10.

  <Outline of configuration of verification system 10: FIG. 1>

  In FIG. 1, a verification system 10 is a system that executes a process of comparing and verifying the processing results of a new system and an old system in order to test the operation of the new system at the time of system renewal. It is composed of a computer. The verification system 10 obtains actual data from the old system under the production environment, and uses the data to reproduce the processing contents (system operation) executed in the production environment in the new system under the test environment. The operation of the new system is checked by comparing and verifying the processing results of the new and old systems.

  In the verification system 10, for example, one or a plurality of servers and a person-in-charge terminal (client) operated by a person in charge of the verification process may be a communication line (an internal network such as an in-house LAN or an intranet, the Internet, etc. A wide range of external networks, or a dedicated line), and may be configured by connecting with an input means such as a mouse or a keyboard operated by a person in charge of the verification process and a display means such as a liquid crystal display. You may comprise by one computer.

  The verification system 10 includes a production environment information collection unit 20, a test environment information collection unit 30, a production data reflection unit 40, a masking unit 41, a classification unit 42, an input unit 43, and a condition success / failure monitoring server stub. 44, a market stub 45, order data verification means 46, and response message verification means 47.

  Each of these means 20, 30, 40 to 43, 46, 47 and each stub 44, 45 are a central processing unit (CPU) provided inside the computer main body constituting the verification system 10, and the operation of this CPU Implemented by one or more programs that define the procedure. The details of these means 20, 30, 40 to 43, 46, 47 and the stubs 44, 45 will be described later.

  Further, the verification system 10 includes a production input message storage unit 50, a production response message storage unit 51, a business start time production data storage unit 52, a business end point production data storage unit 53, and a test response message storage unit 54. , A job end point test data storage means 55, a reproduced message storage means 56, an input difference storage means 57, an order data verification difference storage means 58, and a response message verification difference storage means 59.

  Each of these storage means 50 to 59 is suitably realized by, for example, a hard disk drive (HDD), a solid state drive (SSD), or the like, but if it does not cause a problem in storage capacity or access speed, for example, Other recording media such as DVD, CD, MO, and magnetic tape may be employed. Further, the data storage format of each of the storage means 50 to 59 may be a database or a file format such as a flat file. The details of each of these storage means 50 to 59 will be described later.

  <Outline of the configuration of the old system in the production environment and its peripheral systems, and the flow of a series of business processing by these systems: FIG. 2>

  In this embodiment, the system renewal target (that is, the verification processing target) is, as an example, a stock order processing system as shown in FIG. Therefore, the verification system 10 of the present embodiment performs a comparison verification of the processing results of the old and new systems related to the renewal of the order processing system that accepts stock trading orders by customers and places orders on the stock market. Test to see if the system works properly.

  The target system for verification processing by the verification system of the present invention (target system for system renewal) is not limited to the stock order processing system, but is an order processing system that handles trading orders for financial products other than stocks. Further, it is not limited to a securities / financial system, and therefore is not limited to an order processing system for placing an order on the market. However, in the case of an order processing system for placing an order on the market, there is at least an input route from the customer side and an input route from the market side for the input route of the input message to the order processing system. Therefore, the effect of the present invention can be obtained more remarkably.

  In FIG. 2, the stock order processing system subject to verification processing by the verification system 10 is a portion surrounded by an alternate long and short dash line in FIG. 2, and includes an order receiving system 60 and an order management system 70. Yes. These systems 60 and 70 are so-called mainframes (host computers) each composed of a large general-purpose computer. In addition, you may comprise these systems 60 and 70 by one main frame. In the present embodiment, as an example, it is assumed that, among these systems 60, 70, system renewal is performed for the order receiving system 60, and the order management system 70 has no renewal portion. However, in this embodiment, the entire order processing system including the order management system 70 (that is, the combined state of the order reception system 60 and the order management system 70) is regarded as a new and old system to be compared and verified. Therefore, in this embodiment, the verification system 10 sets the input data to the order processing system (the combined state of the systems 60 and 70) as “input message” and outputs from the order processing system (the combined state of the systems 60 and 70). Data is assumed to be a “response message”. If input / output data for the order receiving system 60 which is a renewal part can be collected, only the order receiving system 60 except for the order management system 70 may be regarded as an old and new system to be compared and verified. In that case, since the input data to the order reception system 60 is regarded as “input message” and the output data from the order reception system 60 is regarded as “response message”, the order management system 70 without the renewal part is It is treated as a peripheral system placed outside the new and old systems to be compared and verified. More generally speaking, the range from which to where in a series of systems that perform a certain business is subject to comparative verification by the verification system of the present invention is determined on a case-by-case basis for ease of data collection. In short, it is only necessary to select and determine the comparison verification target so that the renewal portion is included.

  An order receiving server 90 is provided on the upstream side of the order receiving system 60. The order reception server 90 is a web application server connected to a customer terminal (not shown) operated by a customer via the Internet, and customer order data (customer identification) transmitted from the customer terminal via the Internet. Information, brand, trading category, quantity, unit price, market, etc.). Further, the order reception server 90 transmits from a representative terminal (not shown) operated by an input representative (salesperson or operator) via a network (internal network such as an in-house LAN or an intranet or the Internet). Processing for receiving incoming customer order data may be executed.

  When the order reception server 90 receives the customer order data transmitted from the customer terminal or the agent terminal via the network by the order reception means 91, the order reception server 90 automatically assigns an order number to the order and receives an order message (customer identification). Information, order number, brand, trade classification, quantity, unit price, market, etc.) are transmitted to the order reception system 60 via the communication line. This order message (a message transmitted from the order reception server 90 to the order reception system 60) is an input message input to the order processing system to be compared and verified. Note that the order number finally transmitted to the market is a number automatically given by the order management system 70 and is not a number given by a system upstream from the order management system 70, but is given by each system. Since the numbers are associated with each other, in this embodiment, for convenience of explanation, the numbers given in each system are unified with the order numbers transmitted to the market.

  In the order reception system 60, when an order message that is an input message is received, the log information is stored in the order log storage means 65. This log information includes the recording time (year / month / day, hour / minute / second) of the order message.

  The order receiving means 61 stores the contents of the received order message in the order data storage means 64 and an order response message indicating that the order has been received (customer identification information, order number, brand, trading category, quantity, Including the unit price, market, etc.) to the order receiving server 90 via the communication line. This order response message (a message transmitted from the order reception system 60 to the order reception server 90) is a response message that is output from the order processing system to be compared and verified. In the order reception system 60, when an order response message is transmitted, the log information is stored in the order response log storage means 66. This log information includes the recording time (year / month / day, hour / minute / second) of the order response message.

  Further, the order receiving means 61 needs to monitor the success / failure of the condition when the order of the received order message is a conditional order such as a stop limit order, dual limit order, continuous order, etc. Since it is not possible to place an order directly to a customer, a conditional order message (including customer identification information, order number, brand, trading category, quantity, conditional unit price, market, etc.) must be specified via a communication line. It transmits to the success / failure monitoring server 100. This conditional order message (a message transmitted from the order reception system 60 to the condition success / failure monitoring server 100) is a response message that is output to the outside from the comparison processing target order processing system. In the order reception system 60, when a conditional order message is transmitted, the log information is stored in the conditional order log storage means 67. This log information includes the recording time (year / month / day, hour / minute / second) of the conditional order message.

  In the conditional success / failure monitoring server 100, the conditional order receiving unit 101 receives the conditional order message, and stores the content of the received conditional order message in the conditional order data storage unit 103. Then, the conditional ordering means 102 is the market price information (stock price information in the present embodiment) of the financial product acquired from the market price information providing system 110 (information vendor system, another system in the company, or the market system 130). Is used to monitor the success or failure of the condition for each conditional order stored in the conditional order data storage means 103, and the condition stored in the conditional order data storage means 103 for the conditional order that satisfies the condition. Using conditional order data, a conditional order ordering message (including customer identification information, order number, brand, trading category, quantity, unit price, market, etc.) is created and sent to the order reception system 60 via a communication line. Send. This conditional order ordering message (a message transmitted from the conditional success / failure monitoring server 100 to the order receiving system 60) is an input message that is input to the order processing system to be compared and verified.

  In the order receiving system 60, when a conditional order ordering message that is an input message is received, the log information is stored in the conditional ordering order log storage unit 68. This log information includes the recording time (year / month / day, hour / minute / second) of the conditional ordering message. Then, the conditional order receiving unit 62 stores the contents of the received conditional order ordering message in the order data storage unit 64.

  The various master storage means 63 stores, for example, customer information (customer account number, password, address, name, telephone number, etc.), brand information, etc., and the order receiving means 61 and the conditional order receiving means 62. Referenced when necessary in processing.

  In the order management system 70, the ordering means 71 uses the order data stored in the order data storage means 64 to place an ordering message (customer identification information, order number, brand, trading category, quantity for ordering in the market). , The unit price, the market, etc.) are created and transmitted to the market connection system 120 via the communication line, and the contents of the ordering message are stored in the ordering data storage means 73. This order message (a message transmitted from the order management system 70 to the market connection system 120) is a response message that goes out from the order processing system to be compared and verified. In the order management system 70, when an ordering message is transmitted, the log information is stored in the ordering log storage means 74. This log information includes the recording time (year / month / day, hour / minute / second) of the ordering message.

  The market connection system 120 executes management processing of transmission / reception of electronic messages with the market system 130 including detection of abnormality of connection with the market system 130. This market connection system 120 sends the ordering messages placed in the ordering queue in the order received from the order management system 70 to the market system 130 via the communication line in that order. The market connection system 120 is a system installed by a financial institution such as a securities company. However, in explaining the present invention (in order to understand the function of the verification system 10), the market connection system 120 may be regarded as a market side system. Good.

  When the market system 130 receives the order message as a response message, the market system 130 transmits a notification message (including customer identification information, order number, etc.) corresponding to the order message to the market connection system 120 via the communication line. To do. For example, when viewed from the upstream side, when the input message from the order reception server 90 is a new order message, a correction order message, or a cancellation order message, the order management system 70 responds to these input messages. As a response message, a new ordering message, a correction ordering message, and a canceling ordering message are transmitted to the market system 130 via the market connection system 120. Therefore, the market system 130 sends an order reception notification message and a correction message. A completion notification message and a cancellation completion notification message are respectively transmitted to the market connection system 120 via the communication line.

  In addition, when the customer's order is executed in the market, the market system 130 includes a notification message (including customer identification information, order number, brand, trading category, contract amount, contract unit price, market, etc.). It transmits to the market connection system 120 via a communication line.

  The market connection system 120 receives the notification message transmitted from the market system 130, and transmits the received notification message to the order management system 70 via the communication line. This notification message (a message transmitted from the market connection system 120 to the order management system 70) is an input message that is input to the order processing system to be compared and verified.

  In the order management system 70, when a notification message that is an input message is received, the log information is stored in the notification log storage means 75. This log information includes the recording time (year / month / day, hour / minute / second) of the notification message.

  In the order management system 70, the contract processing means 72 executes an update process of the order data stored in the order data storage means 73 according to the contents of the received notification message. For example, when a contract notification message is received, a contract constant amount, a contract unit price, and the like are stored, and processing for changing the status indicating the order status from “in order” to “contract completed” is executed. The order data stored in the order data storage means 64 of the order receiving system 60 is also updated using the contract information.

  <Configuration of new system under test environment and placement relationship with verification system 10: FIG. 3>

  In FIG. 3, the order processing system, which is a new system under the test environment, includes an order receiving system 80 and an order management system 70 as indicated by a one-dot chain line in FIG. 3. Of these, the renewal portion is only the order receiving system 80, and the order management system 70 is not renewed and is the same as that in the production environment of FIG. Therefore, the order receiving system 60 constituting the old system under the production environment in FIG. 2 is merely changed to the order receiving system 80 constituting the new system under the test environment in FIG. The means 81 and 82 and the storage means 83 to 88 constituting the order receiving system 80 of the new system correspond to the means 61 and 62 and the storage means 63 to 68 constituting the order receiving system 60 of the old system. Yes.

  In the test environment of FIG. 3, the order reception server 90 and the condition success / failure monitoring server 100 of FIG. 2 are located upstream of the order processing system (the combined state of the order reception system 80 and the order management system 70), which is a new system. Instead, the input unit 43 of the verification system 10 and the stub 44 for the condition success / failure monitoring server are arranged, and the input unit 43 of the verification system 10 instead of the market connection system 120 and the market system 130 of FIG. And a market stub 45 is arranged.

  <Details of Configuration of Verification System 10: FIGS. 1 and 3>

  In FIG. 1, the production environment information collection unit 20 performs a process of collecting data necessary for the verification process from the production environment. The production input message acquisition unit 21, the production response message acquisition unit 22, and the job start time point The system includes a production data acquisition unit 23 and a work end time production data acquisition unit 24.

  The actual input message acquisition means 21 is stored in the order message (input message) log information and the conditional order order log storage means 68 stored in the order log storage means 65 of the old system under the production environment (see FIG. 2). Log information of the conditional ordering message (input message) and the log information of the notification message (input message) stored in the notification log storage means 75, and the acquired log information (including the recording time of the message data) )) Is stored in the actual input message storage means 50.

  The production response message acquisition unit 22 stores the log information of the order response message (response message) stored in the order response log storage unit 66 of the old system (see FIG. 2) in the production environment, and stores it in the conditional order log storage unit 67. The log information of the conditional order message (response message) and the log information of the order message (response message) stored in the order log storage means 74 are acquired, and the acquired log information (including the recording time of the message data) is acquired. )) Is stored in the actual response message storage means 51.

  The production data acquisition means 23 at the time of business start is stored in various master information (customer information, etc.) stored in the various master storage means 63 at the time of business start of the old system (see FIG. 2) in the production environment. Stored order data (including customer identification information, order number, brand, trade classification, quantity, unit price, market, status indicating order status, etc.) and order data stored in the order data storage means 73 (order data) And the process of storing the acquired data in the actual data storage means 52 at the start of work. Note that order data and order data at the start of business may be acquired, for example, when there is still data that occurred at night at the start of business, and such conditions are reflected in the test environment. This is because it is necessary to start the verification process later.

  The production data acquisition means 24 at the time of business completion is the order data stored in the order data storage means 64 at the time of business completion of the old system (see FIG. 2) in the production environment and the order data stored in the order data storage means 73. , And the process of storing the acquired data in the actual data storage means 53 at the end of the job is executed.

  The test environment information collection unit 30 performs processing for collecting data necessary for verification processing from the test environment, and includes a test response message acquisition unit 31 and a work end point test data acquisition unit 32. Yes.

  The test response message acquisition unit 31 stores the order response message (response message) log information stored in the order response log storage unit 86 of the new system under the test environment (see FIG. 3) and the conditional order log storage unit 87. The log information of the stored conditional order message (response message) is acquired, and processing for storing the acquired log information in the test response message storage unit 54 is executed. 1 and 3, the market stub 45 converts the order number from the number in the test environment to the number in the production environment, and includes an ordering message (the order number converted into the number in the production environment). .) Is stored in the test response message storage unit 54, the test response message acquisition unit 31 acquires the log information of the order message (response message) stored in the order log storage unit 74. The order number is converted from the number in the test environment to the number in the production environment using the association information of the two environment numbers stored in the reproduced message storage means 56, and the order message (the number in the production environment is changed to the number in the production environment). (Including the converted order number) may be stored in the test response message storage means 54.

  The work end time test data acquisition means 32 is the order data stored in the order data storage means 84 at the time of the work end of the new system under the test environment (see FIG. 3) and the order data stored in the order data storage means 73. And the process of storing the acquired data in the work end point test data storage means 55 is executed.

  The production data reflecting means 40 reflects the production environment data at the start of the work on the new system under the test environment (see FIG. 3), so that the situation at the start of the production environment work in the new system under the test environment. Is performed, and various master information (customer information, etc.), order data, and order data stored in the production data storage means 52 at the time of starting work are stored in the various master storage means 83, order in the test environment. Processing to be stored in the data storage means 84 and the order data storage means 73 is executed.

  The masking unit 41 includes personal information such as a personal identification number in the log information of the input message (order message, conditional ordering message, and notification message) stored in the actual input message storage unit 50. Performs processing for replacing the personal information with alternative information. In the present embodiment, the customer identification information is not regarded as personal information, and is therefore used as it is as the configuration data of the reproduced message.

  As shown in FIG. 4, the classifying unit 42 processes the input messages (order message, conditional ordering message, and notification message) of a plurality of input paths stored in the actual input message storage unit 50 by the masking unit 41. Later, using the recording time, the input messages are arranged and integrated in the order of input, and the behavior of the system to be compared and verified (in this embodiment, the order processing system) is switched for the integrated input messages of the plurality of input paths. In accordance with a plurality of time zones, a process of classifying into a plurality of time zones using recording times and storing the input telegrams after the classification in the reproduced message storage means 56 is executed.

  Here, in the present embodiment, as an example, the plurality of time zones are the time zones that are set in advance in relation to the market system 130 (see FIG. 2) because the order processing system is a target for comparison and verification. These plural time zones are the new order processing system (order receiving system 80 and order management system 70 in FIG. 3) and the old order processing system (order receiving system 60 and order management system in FIG. 2). 70). The reason why the time zone classification processing is performed in this manner is that the behavior of the system is different in each time zone, so that the same behavior as the production environment is reproduced in the test environment, and the two are compared and verified.

  More specifically, the plurality of time zones are, for example, “before market launch” time zone (1) = 6: 00 to 8:00, and “after market launch” time zone (2) = 8: 00 ~ 9: 00, the time zone of the "front" (3) = 9: 00 to 11:30, the time zone of the "place" (4) = 11:30 to 12:05, Time zone (5) = 12: 05 to 12:30, “later” time zone (6) = 12: 30 to 15:30, and “stop reception” time zone (7) = 15: 30 to 18 0:00 and the time zone of “next day order” (8) = 18: 00 to 27:00.

  In addition, when reproducing an input message for a plurality of consecutive days instead of reproducing an input message for only one day, the time zone for one day (1), (2) ... (8), the time zone for the next day ( As shown in 1), (2)... (8), and the time zone (1), (2). Therefore, for example, even in the same time zone (1), if the dates are different, they are classified separately.

  In this embodiment, as shown in FIG. 4, the classification means 42 further converts the input messages (order message, conditional ordering message, and notification message) classified into a plurality of time zones into customer identification information ( Grouping is performed for each customer using an account number or the like, and the process of storing the input message in the reproduced message storage means 56 is performed in a state where it is classified into time zones and grouped for each customer. Therefore, in the reproduced message storage means 56, for the time zone (1), the group of input messages of the customer A in the time zone (1), the group of input messages of the customer B in the time zone (1), the time zone (1 ) Of customer C's input message group, ... is stored. The same applies to the other time zones (2) to (8), and there is a group of customers A, B, C,... In each time zone. And in each group for every time zone and every customer, only the input message of the same customer about the same time zone will be in the state arranged according to the order of recording time.

  In this way, even for input messages in the same time zone, the processing of grouping by customer and grouping for each customer has order messages for new orders, corrections, and cancellations for the same customer. This is to avoid such a situation because the processing results will be different if the order of input is not maintained. In other words, as long as the order of input messages within the same customer is maintained (contextual relationship), even if the order of input messages between different customers is disrupted within the same time period, the verification process requires Since there is no impact, group by customer.

  In general, the order of the customer who placed the order in the market first is prioritized and executed, so if the order of input messages between different customers is changed, the processing in the market will be different and different processing will be performed. The result will be obtained. However, the verification system 10 according to the present embodiment does not perform verification including the processing of the market system 130 (such verification is substantially difficult because the state of the board in the market is reproduced). The processing of the market system 130 corresponds to processing performed outside the order processing system to be compared and verified. Therefore, the processing result of the market system 130 is related to the verification process in the form of a notification message (input message) from the market system 130, and this notification message acquires actual data from the production environment. Even if the input order of input messages between different customers is changed, the verification process is not affected.

  Furthermore, when the classification means 42 groups input messages (order message, conditional order message, and notification message) for each customer for each of a plurality of time zones, the recording time in the production environment becomes the same time. The ordering messages, conditional ordering messages, and notification messages are sent to the new system under the test environment in order of the order of priority. Execute the process to arrange the input messages as shown.

  In this way, priorities are given to the input paths of input messages, even if the recording time is the same time, there may be a time difference in input in the actual processing in the production environment. This is to avoid such a situation because the processing results may differ if the order of insertion is not maintained. For example, if there is no stagnation in the ordering queue of the market connection system 120 and the reply from the market system 130 is performed smoothly, input from a plurality of input paths is performed with a time difference less than the minimum increment of the recording time. There can be.

  Specifically, in the order relationship between the order message and the conditional order ordering message, for example, after the order message of a new order that is a conditional order is actually input, the conditional order ordering message is input. However, the order may be reversed, and there may be a case where the conditional success / failure monitoring server 100 issues an ordering instruction to the market when the conditional order condition is satisfied, even though the customer does not issue a new conditional order. So to avoid such a situation.

  In addition, in the order relationship between the order message and the notification message, for example, in fact, after the order message for a new order is inserted, the notification message for order reception or the notification message for execution is input. In order to avoid such a situation, there may be a case where there is a notice of order acceptance or a notice of execution from the market even though the order is reversed and no new order has been issued from the customer.

  Furthermore, in the order relationship between the conditional ordering message and the notification message, for example, after the conditional ordering message is actually input, the order reception notification message or the contract notification message is input. However, the order is reversed, and there is no order receipt command from the market to the market when the conditional success / failure monitoring server 100 establishes the condition for the conditional order, but there is a notice of order acceptance or a notice of execution from the market. This is to avoid such a situation.

  The input means 43 is stored in the reproduced message storage means 56 for a new system (see FIG. 3) under a test environment in which the system time is set to a virtual time different from the actual time according to a plurality of time zones. Of the input messages after classification, a process of inputting, via a communication line, an input message in a time zone corresponding to a virtual time set in the new system is executed for each of a plurality of time zones. Note that the process of setting the system time of the new system to the virtual time may be performed manually, but in this embodiment, it is automatically set by the input means 43.

  More specifically, as shown in FIG. 5, the input unit 43 sets the system time to a virtual time different from the actual time according to a plurality of time zones for the new system under the test environment (see FIG. 3). After transmitting a virtual time setting command for transmission via the communication line, a process of inputting a time-sent message corresponding to the virtual time to the new system via the communication line is executed. At this time, since the input messages in each time zone are grouped for each customer, the input means 43 sets the input messages grouped for each customer for each customer while maintaining the order of the input messages in the same customer. Execute the process that is introduced to the new system in groups. Then, the input unit 43 alternately repeats the transmission process of such a virtual time setting command and the input process of the input message in the time period corresponding to the virtual time for a plurality of time periods.

  Specifically, as shown in FIG. 5, the input unit 43 includes a parent driver and a driver for each customer (a customer A driver, a customer B driver, a customer C driver,...). ing.

  The parent driver sends a virtual time 6:00 (time zone) corresponding to the time zone (1) to each of the order reception system 80 and the order management system 70 (see FIG. 3) constituting the new order processing system. After sending the setting command of (1) start time) via the communication line, each customer's input message of the time zone (1) corresponding to the virtual time 6:00 is sent to the driver for each customer. Executes processing to issue a group submission command. Then, in other time zones (2) to (8), the process of transmitting the virtual time setting command to the new system and the process of the input command to the driver for each customer are repeated. .

  When a driver for each customer receives an input message for the time zone (1) from the parent driver, the customer's time group (1) for the input message group is sent to the new system via the communication line. Execute the process. Similarly, in the other time zones (2) to (8), when receiving the input command from the parent driver, the group of input messages of each customer for the time zone related to the command is transmitted via the communication line. And execute the process to be input to the new system.

  The input unit 43 executes a process of inputting the input message stored in the reproduced message storage unit 56. Regarding the input of the notification message, the reproduction message storage unit 56 uses the production environment number for the order number. The input process is not executed until the process of updating the association between the test environment number and the test environment number is performed. That is, when the notification means 43 inputs the notification message to the new system (see FIG. 3), the order automatically added in the test environment, not the notification message including the order number automatically assigned in the production environment. A notification message including a number is input. The update process of information related to the notification message stored in the reproduced message storage means 56 (addition process of the association information between the production environment number and the test environment number with respect to the order number) is performed as described later. 45.

  Further, when there is a difference in the configuration (format or definition) of the input message between the new and old systems, the input means 43 uses the difference information of the input message format or definition stored in the input difference storage means 57, and After the classified input message stored in the reproduced message storage means 56 is converted into a format or definition for the new system, a process for inputting it into the new system is executed.

  The conditional success / failure monitoring server stub 44 performs a substitute process for the conditional success / failure monitoring server 100 (see FIG. 2), and receives a conditional order message transmitted from the order receiving system 80 via a communication line. Execute the process.

  The market stub 45 performs processing in place of the market system 130 (see FIG. 2), but also executes processing for associating the production environment number and the test environment number with respect to the order number. That is, when the order management system 70 transmits an ordering message to the market, the order management system 70 automatically assigns and transmits the order number. However, the order management system 70 under the test environment responds to the ordering message (response message) to be reproduced. Since the same order number as the order management system 70 in the production environment is not given, the market stub 45 receives an ordering message including the order number given in the test environment from the order management system 70. At this time, the market stub 45 executes processing for identifying the order message of which order from the information (customer identification information, brand, quantity, unit price, etc.) other than the order number for the received order message. The reproduction message storage means 56 stores association information between the order number of the production environment for the specified order and the order number of the test environment included in the received order message. Thereby, since the notification message stored in the reproduction message storage means 56 is acquired from the production environment, it is a notification message including the order number given in the production environment, but the order number given in the test environment and Is added, the input means 43 can create a notification message including the order number of the test environment and input it to the new system.

  Further, the market stub 45 converts the received ordering message (including the test environment order number) into an ordering message (including the production environment order number) after storing the above association, and stores the test response message. Processing to be stored in the means 54 is also executed. Note that the processing for storing the order message (including the production environment order number) in the test response message storage means 54 is performed by the test response message acquisition means 31 in the order message stored in the order log storage means 74 (test environment order). The log information (including the number) may be converted.

  The order data verification means 46 includes the order data and order data of the old system (see FIG. 2) stored in the actual data storage means 53 at the end of work and the new system (see FIG. 2) stored in the test data storage means 55 at the end of work. 3), the verification data for confirming whether or not the operation of the old and new systems is the same is executed. At this time, when the order data and the configuration (format or definition) of the order data are different between the old and new systems, the order data verifying unit 46 converts the order data using the difference information stored in the order data verifying difference storing unit 58. After performing the process to unify the format or definition, the comparison verification process is executed.

  The response message verification unit 47 stores the response message (order response message, conditional order message, order message) of the old system (see FIG. 2) stored in the actual response message storage unit 51 and the test response message storage unit 54. A verification process is performed to check whether the old and new systems are the same by comparing the response messages (order response message, conditional order message, order message) of the new system (see Fig. 3). It is. At this time, if the response message configuration (format or definition) is different between the old and new systems, the response message verification unit 47 performs conversion processing using the difference information stored in the response message verification difference storage unit 59. The verification or verification process is executed after unifying the format or definition.

  The production input message storage means 50 is a log information (record of each message in the production environment) of the introduction message (order message, conditional ordering message, notification message) acquired from the old system (see FIG. 2) in the production environment. Including the time). Since the notification message is acquired from the production environment, it includes the order number assigned in the production environment.

  The production response message storage means 51 is a log information (record of each message in the production environment) of the response message (order response message, conditional order message, ordering message) acquired from the old system (see FIG. 2) in the production environment. Including the time). Since the ordering message is acquired from the production environment, it includes the order number assigned in the production environment.

  The production data storage means 52 at the time of business start includes various master information (customer information, etc.) at the time of business start of the old system (see FIG. 2) in the production environment, and order data (customer identification information) stored in the order data storage means 64. , Order number, brand, trading category, quantity, unit price, market, status indicating order status, etc.), and order data stored in the order data storage means 73 (contents similar to order data) It is.

  The business data storage means 53 at the time of business completion is the order data (customer identification information, order number, brand, trade classification, etc.) stored in the order data storage means 64 at the time of business completion of the old system (see FIG. 2) in the production environment. And the order data (similar contents to the order data) stored in the order data storage means 73 are stored.

  The test response message storage means 54 stores log information of response messages (order response message, conditional order message, order message) acquired from the new system (see FIG. 3) under the test environment. However, although the order message created in the test environment includes the order number of the test environment automatically given by the order management system 70, in this embodiment, the response of the old and new systems by the response message verification unit 47 is included. As preparation for performing the comparison verification processing of the electronic message, the ordering electronic message including the order number after the conversion from the test environment number to the production environment number by the market stub 45 is stored in the test response message storage unit 54. Has been.

  In addition, when the order message including the order number of the test environment is stored in the test response message storage unit 54 and the response message of the new and old systems is compared and verified, the response message verification unit 47 stores the order message in the reproduction message storage unit 56. The order number may be converted from the test environment number to the production environment number using the stored association information. Further, since the order log storage means 74 (see FIG. 3) of the new system under the test environment stores the order message log information including the order number of the test environment, the test response message acquisition means 31 stores this log information. The order number may be converted from the test environment number to the production environment number using the association information acquired and stored in the reproduced message storage means 56 and stored in the test response message storage means 54, or The order message (test) stored in the order log storage unit 74 (see FIG. 3) by the test response message acquisition unit 31 on the premise that the response number verification unit 47 performs order number conversion processing at the time of comparison verification. Log information (including the order number of the environment) may be obtained and stored in the test response message storage means 54 without performing the order number conversion process.

  The work end time test data storage means 55 is the order data (customer identification information, order number, brand, trade classification) stored in the order data storage means 84 at the work end time of the new system under test environment (see FIG. 3). And the order data (similar contents to the order data) stored in the order data storage means 73 are stored.

  As shown in FIG. 4, the reproduced message storage means 56 is an input message (order message, conditional order order message, notification message) that is classified for each time zone by the classification means 42 and grouped for each customer. Is memorized. Specifically, in the reproduced message storage means 56, as the input message of the time zone (1), the group of the input message of the customer A in the time zone (1) and the group of the input message of the customer B in the time zone (1). , A group of input messages of the customer C in the time zone (1),... Are stored, and a group of input messages of the customer A in the time zone (2) is stored as the input message of the time zone (2). The group of input messages of customer B, the group of input messages of customer C in time zone (2), ... are stored, the same applies to time zones (3) to (7), and the input of time zone (8) As a message, a group of input messages of customer A in time slot (8), a group of input messages of customer B in time slot (8), a group of input messages of customer C in time slot (8), are stored. Yes.

  The input difference storage means 57 stores difference information of the configuration (format or definition) of input messages between the new system and the old system accompanying system renewal. The difference information of the structure (format or definition) of the input message is, for example, “1 = Tokyo” and “2 = Osaka” in the old system for the market, but “1 = Osaka” in the new system. , “2 = Tokyo”.

  The order data verification difference storage means 58 stores the order data between the new system and the old system associated with the system renewal and the difference information of the data holding management configuration (format or definition) of the order data. The difference information here is the difference information of the database or file configuration that is held and managed in the system. For example, the order status is “1 = in order” and “2 = contracted” in the old system. In contrast, in the new system, “1 = confirmed”, “2 = in order”, and the like.

  The response message verification difference storage means 59 stores difference information of the structure (format or definition) of the response message between the new system and the old system that accompanies the system renewal. The difference information of the structure (format or definition) of the response message is the same as the difference information in the case of the input message.

  <Flow of Verification Processing by Verification System 10: FIG. 6>

  In this embodiment, the verification process is performed by the verification system 10 as follows.

  In FIG. 6, first, the production environment information collecting means 20 obtains various kinds of information necessary for the verification process from the order processing system (the order reception system 60 and the order management system 70 in FIG. 2) which is the old system under the production environment. Collect (step S1).

  Specifically, the log information of the order message (input message) stored in the order log storage means 65 of the old system under the production environment (see FIG. 2), the conditional order order log storage by the production input message acquisition means 21. The log information of the conditional ordering message (input message) stored in the means 68 and the log information of the notification message (input message) stored in the notification log storage means 75 are acquired, and each acquired log information (message data) Is recorded in the actual input message storage means 50.

  In addition, the production response message acquisition unit 22 causes the order response message (response message) log information stored in the order response log storage unit 66 of the old system under the production environment (see FIG. 2), the conditional order log storage unit 67. Log information of the conditional order message (response message) stored in the log information and the log information of the order message (response message) stored in the order log storage means 74, and the acquired log information (recording time of the message data) Is stored in the actual response message storage means 51.

  Further, the production data acquisition means 23 at the time of starting the work causes various master information (customer information, etc.) stored in the various master storage means 63 at the time of starting the work of the old system (see FIG. 2) under the production environment, order data storage means. The order data stored in 64 and the order data stored in the order data storage unit 73 are acquired, and the acquired data is stored in the actual data storage unit 52 at the start of business.

  Further, the order data stored in the order data storage unit 64 at the time of business end of the old system under the production environment (see FIG. 2) and the order data storage unit 73 stored by the production data acquisition unit 24 at the time of business end. Order data is acquired, and the acquired data is stored in the production data storage means 53 at the end of the job.

  Next, the production data reflecting means 40 reflects the production environment data at the start of the work on the new system under the test environment (see FIG. 3), thereby starting the production environment work in the new system under the test environment. A process of reproducing the situation at the time is executed (step S2 in FIG. 6).

  Specifically, the production data reflecting means 40 converts various master information (customer information, etc.), order data, and order data stored in the production data storage means 52 at the time of starting business into a new system under a test environment. The data are stored in various master storage means 83, order data storage means 84, and order data storage means 73 in the processing system (order receiving system 80 and order management system 70 in FIG. 3), respectively.

  Subsequently, a preparation process of input messages (order message, conditional order message and notification message) to be reproduced in the new system under the test environment (see FIG. 3) is executed (step S3 in FIG. 6).

  Specifically, first, the personal information such as a personal identification number is included in the log information of the input message (order message, conditional ordering message and notification message) stored in the actual input message storage means 50 by the masking means 41. If information is included, a process of replacing the personal information with alternative information is executed.

  Then, as shown in FIG. 4, the classification means 42 records the input messages (order message, conditional ordering message, and notification message) of a plurality of input routes after the processing by the masking means 41, and the recording time. The input messages of a plurality of input routes that are integrated and arranged in the order of input messages are integrated into a plurality of time zones when the behavior of the system to be compared and verified (the order processing system in this embodiment) is switched. In addition, it is classified into a plurality of time zones using the recording time (in this embodiment, as an example, eight time zones (1) to (8) predetermined for transmission / reception with the market system 130). Classification), and further, grouped for each customer using customer identification information (account number, etc.). Then, the input message is stored in the reproduction message storage unit 56 in a state where the message is classified into time zones and grouped for each customer.

  As a result, the reproduced message storage means 56 stores the message group of customer A in time zone (1), the group of message messages in customer B in time zone (1), and the message of customer C in time zone (1). , ..., a group of input messages of customer A in time slot (8), a group of input messages of customer B in time slot (8), a group of input messages of customer C in time slot (8), and so on. It will be in the state.

  And in the group of each customer's input message in each time zone (in each group), only the same customer's input messages for the same time zone are arranged according to the order of the recording time. Become. At this time, if there is an input message at the same time for each recording time in each group, the classification means 42 performs an order message, a conditional ordering message, and a notification message according to a predetermined priority order in this order. The input messages are arranged such that the input messages with the highest priority are input to the new system under the test environment in order.

  In the example of FIG. 4, for the input message group of the customer A in the time zone (3), the order message for the new order, the notification message for order reception, the correction order message, the correction completion notification message, and the contract notification message They are arranged in order, and are stored in the reproduction message storage means 56 so as to be inserted into the new system in this order. Here, the order message of the new order and the notification message of the order reception have the same recording time, but the order message of the new order comes first according to the priority order of the input path. The correction order message and the correction completion notification message have the same recording time, but the correction order message is first in accordance with the priority of the input path.

  In addition, the group of input messages of customer B in time period (3) is arranged in the order of a new order order message, an order reception notification message, a cancellation order message, and a cancellation completion notification message. Is stored in the reproduced message storage means 56 so as to be inserted into

  Note that the order message of the new order for customer B is earlier than the order message for customer A's correction, but after the group of customer A's input message is inserted, the group of customer B's input message is If they are input, their input order will be reversed. However, if the input order of input messages within the same customer is not changed, the processing contents in the new system will not change, and the verification process will not be affected.

  Thereafter, as shown in FIG. 5, the input means 43 changes the system time of the new system under the test environment (see FIG. 3) from the actual time according to the plurality of time zones (1) to (8). Among the input messages stored in the reproduced message storage means 56 in a state classified into each time zone and grouped for each customer after performing the process of setting the system time to a virtual time. The input message in the time zone corresponding to the virtual time set in the new system is input to the new system via the communication line. And such a process is performed about each of several time slot | zones (1)-(8) (step S4 of FIG. 6).

  At this time, if there is a difference in the configuration (format or definition) of the input message between the new and old systems, the input message is updated using the difference information of the input message format or definition stored in the input difference storage means 57. Convert to a system format or definition before launching into the new system.

  More specifically, as shown in FIG. 5, the parent driver of the input unit 43 gives time to each of the order reception system 80 and the order management system 70 (see FIG. 3) constituting the order processing system as a new system. After sending the setting command of the virtual time 6:00 corresponding to the band (1) (in this embodiment, the start time of the time band (1) as an example) via the communication line, the input unit For each of the 43 customer drivers (customer A driver, customer B driver, customer C driver,...), Each customer in the time zone (1) corresponding to the virtual time 6:00 Sends the input command of the input message group. Then, when the driver for each customer receives the input command for the input message in the time zone (1) from the parent driver, the driver of the customer's time zone (1) in charge of his / her customer is sent via the communication line. And put it into the new system. In FIG. 5, the customers A, B, and C are input in this order, but the input order between these customers is arbitrary. For example, the customers C, B, and A may be input in the reverse order. As long as the order of input within the same customer is maintained, there is no restriction on the order of input between different customers.

  Subsequently, a virtual driver corresponding to the time zone (2) is sent to each of the order reception system 80 and the order management system 70 (see FIG. 3) constituting the new order processing system by the parent driver of the input means 43. After sending the setting command of time 8:00 (in this embodiment, the start time of time zone (2) as an example) via the communication line, the driver (customer A , A customer B driver, a customer C driver,...), Each customer's input message group input command in the time zone (2) corresponding to the virtual time 8:00. put out. Then, when the driver for each customer receives the input command for the input message in the time zone (2) from the parent driver, the group of the input messages in the time zone (2) of the customer in charge is transmitted via the communication line. And put it into the new system.

  Similarly, for the time zones (3) to (8), the parent driver of the input means 43 transmits a virtual time setting command to each of the order reception system 80 and the order management system 70 (see FIG. 3); The process of the input command for the driver for each customer of the input means 43 is repeated. When the driver for each customer receives an input message for each time slot from the parent driver, the input message for the customer's responsible time zone (time zone related to the input instruction from the parent driver) Will be introduced to the new system via a communication line.

  Also, the input means 43 creates a notification message including the order number of the test environment instead of the notification message including the order number of the production environment acquired from the production environment, and inputs the notification message to the new system. Therefore, the market stub 45 associates the production environment number with the test environment number for the order number associated with the notification message, and the reproduction message storage means 56 performs an update process for adding the association information. After that, the input process is executed. That is, when an order message or a conditional order order message (both input messages) are input to the new system, an order message (including the order number given by the order management system 70 in a test environment) is sent as a response message to the input messages. The market stub 45 receives the order message (including the test environment order number) output from the new system, and the market stub 45 receives the test environment number and the production number for the order number. Since the association process with the environment number is performed and the update process for adding the association information to the reproduced message storage unit 56 is performed, the input unit 43 includes the notification message (including the order number of the test environment) at that timing. ) Into the new system.

  Note that the virtual time set as the system time of the new system and the actual time that is the timing for setting the virtual time as the system time of the new system are completely irrelevant. For example, the time for setting the system time of the new system as the virtual time at 9:00, which is the start time of time zone (3) = 9: 00 to 11:30, may be any time in the actual time. 13:00 and so on. If the actual time is 13:00 and the virtual time 9:00 is set, if the actual time is 13:05, the system time of the new system is 9:05. It will be in progress. However, before the actual time becomes 13:05, the input message insertion process for the time period (3) is completed, and the input message input process for the next time period (4) can be started. The system time of the new system will be significantly different. For example, when the actual time is set to 13:04 and the next time zone (4) = 11: 30 to 12:05 start time 11:30 is set as the virtual system time as the system time of the new system Then, if the actual time is in progress at 13:05, the system time of the new system is in progress at 11:31. That is, since the time zone is switched in the new system, the system time of the new system is no longer in progress at 9:05 in the time zone (3), but is 11 in the next time zone (4). : 31 is in progress. As described above, since the system time of the new system advances rapidly by switching the time zone with respect to the progress of the actual time, the processing time required for verification can be shortened. Within each time zone, the actual time advance rate and the system time advance rate of the new system are of course the same, but the new system is If you look at it, it means that the speed of progress will be faster. And the above is an explanation from the viewpoint that the speed of the system time of the new system can be apparently increased by switching the time zone, but in order to achieve this, switching the time zone in the first place Therefore, it is essential to compress the following input timing.

  That is, the input process of each input message in the test environment by the input unit 43 is executed at a timing compressed from the recording time of each input message in the log in the production environment. For example, since the input process of each input message in the production environment in the time zone (3) = 9: 00 to 11:30 is recorded at the actual time, it naturally takes two and a half hours, but the test environment Then, this can be compressed and the input process of each input message can be completed in a considerably short time. For example, if it is possible to finish the input processing for all input messages in the time zone (3) within 4 minutes, the start time of the time zone (3) = 9: 00 to 11:30 is 9:00. Is set as the system time of the new system as a virtual time, and the input process is started immediately after that, the input process is completed when the system time of the new system reaches 9:04. Therefore, for each input message that has been input in the production environment over two and a half hours due to the compression of the input timing, the input process can be completed in a much shorter time than two and a half hours in the test environment. Early switching to the next time zone (4) is possible, and the processing time required for verification can be shortened by such compression of the input timing and repeated time zone switching.

  In addition, as described above, the injection process can be completed in a considerably short time for each input message in each time zone by compression of the input timing, so the virtual time set as the system time of the new system is It does not have to be the start time of each time zone. For example, if it is possible to finish the input processing for all input messages in the time zone (3) within 4 minutes, the start time of the time zone (3) = 9: 00 to 11:30 is 9:00. Instead, for example, 10:00 may be set as the system time of the new system as a virtual time. Even in this case, when the system time of the new system becomes 10:04, all the time zones (3) Since the input message input process has been completed and all input processes are within the range of the time zone (3), the system behavior is set to the 9:00 start time as a virtual time. Same as the case.

  In addition, as described above, since the injection timing is compressed, even if the start time of each time zone is set to the system time of the new system and the injection starts, the input of each input message in the production environment And the input time of each input message in the test environment (the system time of the new system, that is, the virtual time progressing in the new system) do not match. For example, in the case of time zone (3), an input message that was input at 9:00 (actual time) in the production environment is input at just 9:00 (system time of the new system) in the test environment. However, there is no coincidence for messages sent at other times. Here, it is explained that the recording time (real time) in the production environment does not match the input time by the system time (virtual time) of the new system in the test environment. As described above, the time is completely unrelated to these (it may be any time).

  After the input process is completed, the test environment information collecting means 30 causes the order processing system (the order reception system 80 and the order management system 70 in FIG. 3), which are new systems under the test environment, to perform various processes required for the verification process. Is collected (step S5 in FIG. 6).

  Specifically, the test response message acquisition unit 31 stores the log information of the order response message (response message) stored in the order response log storage unit 86 of the new system under the test environment (see FIG. 3), and the conditional order. The log information of the conditional order message (response message) stored in the log storage unit 87 is acquired, and the acquired log information is stored in the test response message storage unit 54. 1 and 3, the order number is converted from the number under the test environment to the number under the production environment by the market stub 45, and the order message (the order number after the conversion into the number under the production environment is included). .) Is stored in the test response message storage unit 54, but the test response message acquisition unit 31 acquires log information of the order message (response message) stored in the order log storage unit 74. The order number is converted from the number in the test environment to the number in the production environment using the association information of the two environment numbers stored in the reproduced message storage means 56, and the order message (the number in the production environment is changed to the number in the production environment). Including the converted order number) may be stored in the test response message storage means 54.

  Further, the order data stored in the order data storage means 84 at the time of business end of the new system under the test environment (see FIG. 3) and the order data storage means 73 stored by the test data acquisition means 32 at the business end time. Order data is acquired, and the acquired data is stored in the work end point test data storage means 55.

  Subsequently, the order data verification unit 46 and the response message verification unit 47 compare the processing results of the new and old systems, and execute verification processing to check whether the operation of the old and new systems is the same (step S6 in FIG. 6).

  Specifically, the order data verification means 46 stores the order data and order data of the old system (see FIG. 2) stored in the business end time production data storage means 53 and the work end time test data storage means 55. By comparing the order data and order data of the new system (see FIG. 3), it is confirmed whether or not the operation of the old and new systems is the same. At this time, if the order data and the configuration (format or definition) of the order data are different between the new and old systems, the order data verification means 46 converts the difference using the difference information stored in the order data verification difference storage means 58. After performing the process to unify the format or definition, the comparison verification process is executed.

  Further, the response message verification means 47 causes the response message (order response message, conditional order message, order message) of the old system (see FIG. 2) stored in the actual response message storage means 51 and the test response message storage means 54. Is compared with the response messages (order response message, conditional order message, order message) stored in the new system (see FIG. 3) to confirm whether the operation of the old and new systems is the same. At this time, if the structure (format or definition) of the response message is different between the old and new systems, the response message verification unit 47 performs conversion processing using the difference information stored in the response message verification difference storage unit 59. The verification or verification process is executed after unifying the format or definition.

  <Effect of this embodiment>

  According to this embodiment, there are the following effects. That is, the verification system 10 classifies input messages used for reproduction in the test environment into a plurality of time zones by the classification unit 42, and uses the input unit 43 for each of the plurality of time zones in the test environment. With the system time for the new system set to the virtual time, the input message in the time zone corresponding to the virtual time is input to the new system. ), But if you look at the virtual time that is progressing in the new system, the input message will be input to the new system at the time to be input, Appropriate behavior for the input message (behavior that reproduces processing executed in the production environment) can be obtained.

  For this reason, it is not necessary to perform the reproduction of the day over one day, and the reproduction of the day can be executed in a short time by compressing the input timing (input interval) of the input message to the new system. Thus, it is possible to shorten the time for the verification process.

  In addition, even when there are a large number of days to be reproduced, the number of days required for the test is generated for the same number of days as the production environment by compressing the input timing (input interval) of the input message to the new system beyond the day. Can be avoided, and the verification processing time can be shortened.

  In addition, the input unit 43 is configured to automatically repeat the transmission process of the virtual time setting command and the input process of the input message in the time zone corresponding to the virtual time and automatically repeat the process (see FIG. 5), compared with the case of manually managing the transmission timing of the virtual time setting command and the input start timing of the input message in the time zone corresponding to the virtual time. It is possible to reduce the load and reduce the number of personnel required for the reproduction test), and it is possible to more reliably compress the input timing (injection interval) of the input message across multiple time zones. Processing time can be shortened effectively. In addition, automation of reproduction enables nighttime reproduction tests. This effect can be obtained more significantly when the same day is reproduced many times or when a plurality of days (a plurality of days in the production environment) are reproduced.

  Further, the classification means 42 is configured to classify each input message of a plurality of input routes by time zone and group by customer (see FIG. 4), and the input means 43 is classified by time zone. In addition, since the input messages grouped for each customer are input to the new system in groups for each customer while maintaining the order of the input messages within the same customer (see Fig. 5), the production environment is Can be reproduced properly. That is, in the order processing system, there are order messages including cases of new orders, order corrections, and order cancellations, and notification messages from the market system 130 as input messages, so the input messages are classified by time zone. And even if the virtual time is set as the system time, if the order of input messages within the same customer is not maintained as the production environment, the new system will perform the desired behavior (the processing in the production environment). (Reproducible behavior) may not be obtained, but the occurrence of such a problem can be avoided. For example, if the order was corrected after the order was corrected in the production environment, the order was not corrected if the order of the correction order message and the notification message in the test environment was switched in the test environment. The contract notification in the corrected state will be received, but such a situation can be avoided.

  Then, the classification means 42 is configured to arrange each input message according to a predetermined priority order of the input routes when the recording times for the plurality of input routes become the same time, and thus occurs in the production environment. The new system can reproduce the desired situation, and the desired behavior (behavior that correctly reproduces the processing in the production environment) can be obtained with the new system. In other words, even if the recording times in the production environment for a plurality of input paths are the same time, there is a time difference in the actual processing in the production environment, and there may be an order. If it is reversed, the new system may not achieve the desired behavior (behavior that reproduces the processing in the production environment), such as an error, but such problems can be avoided. .

  Further, since the verification system 10 includes the input difference storage unit 57, the input unit 43 uses the input message format or definition difference information stored in the input difference storage unit 57 to reproduce the message. The input message stored in the storage means 56 can be input to the new system after being converted into a format or definition for the new system. Therefore, even when there is a difference in the format or definition of the input message between the old and new systems, the input message to be input to the new system under the test environment is automatically created using the input message acquired from the production environment. Therefore, the preparatory work for the verification process can be easily performed, and labor saving can be achieved.

  Furthermore, since the verification system 10 includes the order data verification difference storage means 58 and the response message verification difference storage means 59, after completing the input message input processing for reproducing the production environment under the test environment, The order data verification unit 46 and the response message verification unit 47 also perform the verification process for comparing the processing results of the old and new systems for the order data, the order data, and the response message. If there is a difference in format or definition between the old and new systems, the comparison verification process can be executed after performing automatic conversion in consideration of the difference. For this reason, verification work can be easily performed even at the stage of comparative verification, and labor saving can be achieved.

  <Deformation form>

  Note that the present invention is not limited to the above-described embodiment, and modifications and the like within a scope where the object of the present invention can be achieved are included in the present invention.

  For example, in the embodiment, the comparison verification target by the verification system 10 is, as an example, a stock order processing system. However, the comparison verification target by the verification system of the present invention is limited to the stock order processing system. It may be an order processing system for financial products other than stocks, and is not limited to an order processing system for placing orders on the market. In short, a system in which the behavior of the system changes depending on the time of day. If so, the present invention can be applied. However, the effect of the present invention can be obtained more remarkably if the system involves a market and thereby forms a plurality of input paths.

  In the embodiment, the input unit 43 includes a setting command transmission process for setting the system time of the new system to a virtual time, and a process for inputting each input message in a time zone corresponding to the virtual time. Are linked and automatically repeated (see Fig. 5), but the person manages the transmission timing of the virtual time setting command and the input start timing of the input message in each time zone, and each process It is good also as a structure which starts by manual operation. However, if these processes are linked and automatically repeated, the labor can be saved and the time required for the verification process can be further reduced.

  As described above, the verification system and program of the present invention are suitable for use in, for example, renewing an order processing system that accepts customer orders and places orders with a market system.

DESCRIPTION OF SYMBOLS 10 Verification system 42 Classification means 43 Input means 50 Production input message memory means 56 Reproduction message memory means 57 Difference memory means for input 60 Order reception system which constitutes a part of order processing system which is an old system 70 Part of order processing system Order management system that is a part common to both the new system and the old system 80 Order reception system that constitutes a part of the order processing system that is the new system

Claims (6)

A verification system that performs a process of comparing and verifying the processing results of the new system and the old system in order to test the operation of the new system at the time of system renewal,
Production message storage means for storing the input message acquired from the old system in the production environment together with the recording time in the production environment;
In accordance with a plurality of time zones in which the behavior of the system is switched in common to both the new system and the old system, the input message stored in the actual input message storage means is converted into the plurality of time zones using the recording time. A classifying means for executing a process of classifying into
Reproduced message storage means for storing the input messages classified by the classification means in a classified state;
Among the input messages after classification stored in the reproduced message storage means for a new system under a test environment in which the system time is set to a virtual time different from the actual time according to the plurality of time zones, Input means for executing, via a communication line, the input message of the time zone corresponding to the virtual time set in a new system for each of the plurality of time zones; Verification system. The input means includes
For a new system under a test environment, after transmitting a virtual time setting command for setting the system time to a virtual time different from the actual time according to the plurality of time zones, A process of inputting the input message in the time zone corresponding to the virtual time to the new system via a communication line is performed, and at this time, the transmission process of the virtual time setting command and the virtual time 2. The verification system according to claim 1, wherein the input message transmission process in the corresponding time zone is alternately repeated for a plurality of the time zones. The new system and the old system subject to the system renewal are order processing systems that accept customer orders and place orders on the market system,
The time zone is a time zone determined for sending and receiving messages with the market system,
The input message includes an order message including a case of a new order input by a customer or an input agent thereof, an order correction, and an order cancellation, and a notification message from the market system,
The classification means includes
The input messages classified into a plurality of the time zones are further grouped for each customer, and the input messages are stored in the reproduced message storage means in a state classified into the time zones and grouped for each customer. It is configured to execute processing,
The input means includes
For each of the plurality of time zones, the process of inputting the input messages grouped for each customer into the new system in groups for each customer while maintaining the order of the input messages within the same customer is executed. The verification system according to claim 1, wherein the verification system is configured. In addition to the order message and the notification message, the input message includes a conditional order order message that is input when a condition is satisfied for a conditional order that needs to monitor the timing of ordering to the market system. Included,
The classification means includes
When grouping the input message for each customer for each of the plurality of time zones, for the input message whose recording time in the production environment is the same time, the order message, the conditional ordering message, In accordance with the priority order determined in advance in the order of the notification messages, the input messages are arranged so that the input messages with the highest priority are sequentially input to the new system under the test environment. The verification system according to claim 3. A difference storage unit for input that stores a difference in the format or definition of the input message between the new system and the old system associated with the system update;
The input means includes
Using the difference in format or definition of the input message stored in the input difference storage means, the classified input message stored in the reproduced message storage means is converted into a format or definition for a new system. The verification system according to claim 1, wherein the verification system is configured to execute processing to be input to the new system.   The program for functioning a computer as a verification system in any one of Claims 1-5.

Images