WO2009107174A1 - 組み込みシステムにおける自動再現試験装置および自動再現試験方法 - Google Patents
組み込みシステムにおける自動再現試験装置および自動再現試験方法 Download PDFInfo
- Publication number
- WO2009107174A1 WO2009107174A1 PCT/JP2008/003096 JP2008003096W WO2009107174A1 WO 2009107174 A1 WO2009107174 A1 WO 2009107174A1 JP 2008003096 W JP2008003096 W JP 2008003096W WO 2009107174 A1 WO2009107174 A1 WO 2009107174A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- reproduction test
- embedded system
- reproduction
- automatic
- external
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/26—Functional testing
- G06F11/27—Built-in tests
Definitions
- the present invention relates to an automatic reproduction test apparatus and an automatic reproduction test method in an embedded system (Embedded System), which is used as a general term for electronic devices incorporating a processor for the purpose of realizing a specific function.
- an embedded system Embedded System
- a central control device having a display monitor, an operation panel (for example, a touch panel) such as buttons and dials, a car navigation function, an AV (Audio Visual) function, a telephone function, an air conditioner, a door
- an operation panel for example, a touch panel
- buttons and dials such as buttons and dials
- a car navigation function such as buttons and dials
- AV Audio Visual
- the above-mentioned test of a built-in system such as a conventional on-board information device is basically performed manually by various operations such as a benchmark test in which a dedicated device for simulating various peripheral functions of a vehicle or the like is connected. It was confirmed that there were no inconveniences or problems.
- a test in a conventional embedded system such as a vehicle-mounted information device has been performed by a method such as a manual operation or a method of reproducing an operation based on an operation history.
- the reproduction test based only on the operation history is not sufficient as test content, and various parts such as doors, engines, wheels, and transmissions connected to the outside of the central control device.
- the behavior varies greatly depending on the state of external equipment such as an air conditioner. For example, in a traveling state in which the wheels are rotating, the operation of the car navigation function is restricted or changed in order to ensure the safety of the operator.
- an ECU electronic control unit
- a change in the state of the external device greatly affects the behavior of the system, such as displaying the state on a monitor.
- the external device and the centralized control device normally operate asynchronously, and the navigation function, AV function, etc. operate asynchronously with respect to the internal state of the centralized control device. It is not always possible to reproduce the same behavior simply by reproducing. In addition, for example, sudden fluctuations in voltage, etc., are not always reproduced in a single reproduction test. Therefore, there is a difficulty in the reliability of failure analysis and reproduction tests performed at the time of failure occurrence, and efficiency It was bad.
- the present invention has been made in order to solve the above-described problems.
- An automatic reproduction test in an embedded system capable of improving the reproducibility and ensuring an efficient reproduction test in order to ensure the reliability of a complicated embedded system.
- An object is to provide an apparatus.
- an automatic reproduction test apparatus in an embedded system is an automatic reproduction test apparatus in an embedded system to which an external device is connected, and includes an operation event of the embedded system and an external connection device.
- An automatic reproduction test method for an embedded system is an automatic reproduction test method for an embedded system to which an external device is connected, which is used in an automatic reproduction test apparatus having at least a history storage unit.
- An operation event and an event including a change in the state of the external device are stored in the history storage unit in time series, and the content stored in the history storage unit is read based on an external reproduction instruction, and the read
- the system state of the embedded system is reproduced according to the contents, and the reproduction test of the embedded system is repeatedly executed a predetermined number of times.
- an automatic reproduction test apparatus and an automatic reproduction test method in an embedded system which can improve the reproducibility in order to ensure the reliability of a complicated embedded system and can perform an efficient reproduction test. it can.
- FIG. 1 is a block diagram showing an internal configuration of an automatic reproduction test apparatus in an embedded system according to Embodiment 1 of the present invention.
- the automatic reproduction test apparatus in the embedded system includes an embedded apparatus 1, a reproduction test apparatus 2, and an external storage medium 3.
- an in-vehicle information device is illustrated as the embedded device 1.
- the in-vehicle information device 1 includes a function execution unit 11 that executes various functions such as a navigation function, an audio function, a video function, a telephone function, and is connected to the external device 10 via an external state I / F (interface) 12.
- the external device 10 is an ECU (electronic control unit) to which various vehicle parts such as a door, an engine, wheels, a transmission, a vehicle speed sensor, and the like are connected.
- serial communication such as a CAN (Control Area Network) bus 4 or the like. It is connected to the external state I / F 12 via a line.
- the state information of the external device 10 captured by communication via the external state I / F 12 is collected by the external state collection unit 13 and stored as an external state history 201 in the information storage unit 20 together with time information.
- the operation panel 14 is connected to the operation history collection unit 16 via the operation I / F 15, and operation commands generated when the user operates the operation panel 14 are collected by the operation history collection unit 16, and time information At the same time, the operation history 202 is stored in the information storage unit 20.
- the function execution unit 11 is connected to the internal state collection unit 17, and the internal state such as an internal register value that changes as the function execution unit 11 executes various functions is stored in the information storage unit 20 as the internal state history 203.
- the external state history 201 and the operation history 202 are stored in time series in association with each other.
- the information storage unit 20 is configured by, for example, a ring buffer or a RAM, and when the in-vehicle information device 1 is operating, an external state history 201 and an internal state history 203 are stored in addition to the operation history 202.
- an external storage medium 3 constituted by, for example, a detachable memory card or HD (Hard-Disc).
- the reproduction test apparatus 2 is configured by, for example, a PC (Personal Computer) or the like, and the PC mounts the external storage medium 3 in a memory slot in the apparatus to store the external state history stored in the external storage medium 3.
- 201, the internal state history 203, the operation history 202, and the like are read, information simulated by these logs is generated, the system state of the in-vehicle information device 1 is restored on the PC, the operation is reproduced, and a reproduction test is performed.
- a PC Personal Computer
- the information storage unit 20 of the in-vehicle information device 1 performs a reproduction test as “history storage means for storing the operation event of the embedded system and the event including the state change of the external device in time series” according to claim 1.
- the apparatus 2 reads the content stored in the history storage unit based on an external reproduction instruction according to claim 1, reproduces the system state of the embedded system according to the read content, and Each of these functions as a reproduction test means for repeatedly executing the reproduction test of a predetermined number of times. Details will be described later.
- FIG. 2 is a block diagram showing a functional development of the internal configuration of the reproduction test apparatus 2 shown in FIG. 2, the reproduction test apparatus 2 includes an operation interface unit 21, a CAN bus interface unit 22, a UI (User Interface) management unit 23, a script editing unit 24, a script storage unit 25, and a reproduction.
- the test control unit 26 and the log acquisition unit 27 are configured.
- the operation interface unit 21 serves as an interface with the operation panel 14 of the in-vehicle information device 1, and the CAN bus interface serves as an interface with each vehicle part, and communicates between the in-vehicle information device 1 and the reproduction test apparatus 2.
- the UI management unit 23 manages a user interface with an input / output device (here, a keyboard and a display device) connected to the reproduction test apparatus 2, captures a keyboard operation input by the user, and outputs it to the script editing unit 24.
- the script editing result by the script editing unit 24 is displayed.
- a user instruction regarding the activation of the reproduction test control unit 26 is taken in and delivered to the reproduction test control unit 26, and the result of the reproduction test by the reproduction test control unit 26 is displayed.
- the script editing unit 24 edits the reproduction test procedure stored in advance in the script storage unit 25 and changes the reproduction procedure or parameter stored in the script storage unit 25 in accordance with a user instruction coming via the UI management unit 23. To do.
- parameters an interval time of a repeated reproduction test, an operation button press, an event time interval related to an external state change, and the like are assumed.
- the reproduction test control unit 26 is based on various logs (external state history 201, operation history 202, internal state history 203) acquired from the in-vehicle information device 1 based on a reproduction instruction that arrives via the UI management unit 23. And the reproduction test of the in-vehicle information device 1 is repeatedly executed a predetermined number of times according to the procedure of the reproduction test stored in the script storage unit 25.
- the reproduction test control unit 26 can instruct the in-vehicle information device 1 to re-collect information related to the state change immediately before via the CAN bus interface 22 when a specific event such as the occurrence of a failure is reproduced.
- the reproduction test control unit 26 can also convert the procedure in which the procedure of the reproduction test is defined into text and hold it (script converter), and perform the reproduction test through editing performed by the script editing unit 24.
- the log acquisition unit 27 acquires logs such as the external state history 201, the operation history 202, and the internal state history 203 from the external storage medium 3 such as a memory card inserted in a slot (not shown) during the automatic reproduction test. Is supplied to the reproduction test control unit 26.
- FIG. 3 is a flowchart showing the operation of the automatic reproduction test apparatus in the embedded system according to Embodiment 1 of the present invention.
- the operation of the reproduction test apparatus 2 in the penetration system according to Embodiment 1 of the present invention shown in FIGS. 1 and 2 will be described in detail with reference to the flowchart of FIG.
- the in-vehicle information device 1 includes an external state history 201, an operation history 202, and an internal state history 203 through the external state collection unit 13, the operation history collection unit 16, and the internal state collection unit 17 at a certain timing during system operation.
- Various logs are acquired and stored in the information storage unit 20, and are copied to the external storage medium 3 such as a memory card by a user operation or at a timing when a predetermined amount is stored.
- the copied log (memory card) is inserted into a card slot of the reproduction test apparatus 2 constituted by a PC or the like, and a reproduction test start operation from a user by an input / output device (not shown) connected to the reproduction test apparatus 2 ( The reproduction test shown in the flowchart in FIG. 3 is started after waiting for the reproduction instruction.
- the reproduction test control unit 26 detects a reproduction test start operation (reproduction instruction) by the user via the UI management unit 23, first, the reproduction test control unit 26 sets 0 to a variable i (register i) (step 1 ST301), subsequently, variable rep. The number N of repeated reproduction tests is set to end (step ST302).
- the variable i and rep. “end” is a register used in the program.
- the reproduction test control unit 26 determines whether or not the variable i has reached the number N of repeated reproduction tests (step ST303). If the variable i has not been reached (step ST303 “NO”), the reproduction test control unit 26 stores the variable i in the external storage medium 3. The various logs thus read are read via the log acquisition unit 27 (step ST304), and the reproduction test is started (step ST305).
- the reproduction test procedure follows the test script stored in the script storage unit 25, and the reproduction test control unit 26 first determines the command and repetition period defined in each line of the test script, the number of repetitions, and the like.
- the test is performed while reproducing the system state of the in-vehicle information device 1 based on the read various logs. Characteristically, as the log is acquired along with the time information about the state change and event of the external device 10 in addition to the operation history, the in-vehicle information about the state change and event of the external device 10 while synchronizing with the operation history This can be reflected in the restoration of the system state of the device 1, and a repeated reproduction test is performed based on this log.
- the reproduction test control unit 26 includes the external device 10 via the CAN bus interface unit 22 and the CAN bus 4.
- the in-vehicle information device 1 is instructed to re-collect a detailed log regarding the last state change (step ST307).
- the reproduction test is performed again (step ST305), and when the same event occurs again, it becomes possible to analyze the problem in more detail.
- the collected detailed log can be recorded.
- the reproduction test control unit 26 updates the variable i by 1 (step ST308), and repeatedly executes the log reading and the reproduction test after step ST303 (steps ST303 to ST308).
- This repeated reproduction test is performed using the variable rep. It is repeatedly executed N times as set in end. In this way, for example, an event that does not appear by a single replay attempt, such as voltage fluctuation, is configured so that a replay test can be performed while restoring the system state repeatedly, enabling a more accurate and advanced replay test. become.
- step ST303 “YES” the reproduction control test unit 26 displays the fact on the input / output device via the UI management unit 23, and does the user need to change parameters? Display a message asking whether or not to prompt the intention.
- the reproduction test described above is performed according to a fixed number of times and a fixed repetition interval, and the reproduction test control unit 26 determines that the user needs to change these parameters ("YES" in step ST309).
- a change parameter that is sometimes input is captured (step ST310), and the script is edited via the script editing unit 24. As a result, the script stored in the script storage unit 25 is updated. Then, the reproduction test control unit 26 performs the above-described repeated reproduction test again according to the script updated and stored in the script storage unit 25.
- reproduction adjustment is performed by adjusting the time between events and changing the repetitive interval time within a minute range, and this makes it possible to realize highly accurate reproduction by repetitive testing. .
- the state change or event of the external device 10 is recorded as a log, and is synchronized with the operation history.
- the state change and event of the device 10 reproducible, it is possible to perform a highly accurate reproduction test in which the state change does not depend only on the user operation.
- FIG. FIG. 4 is a block diagram showing an internal configuration of the automatic reproduction test apparatus in the embedded system according to Embodiment 2 of the present invention.
- the difference from the first embodiment shown in FIG. 1 is that in the first embodiment, the reproduction test apparatus 2 is externally connected to the embedded system (vehicle-mounted information device 1), whereas the reproduction test apparatus 2 has the difference.
- the function is built in the embedded system. By taking such a form, an automatic reproduction test can be performed without preparing the reproduction test apparatus 2 separately.
- the reproduction test unit 30 is added to the in-vehicle information device 1 as an embedded system, and the reproduction test unit 30 is directly connected to the information storage unit 20 via the internal bus 31.
- the recording medium 3 becomes unnecessary.
- the structure of the reproduction test unit 30 is shown in FIG.
- the difference in configuration from the first embodiment shown in FIG. 2 is that a log transfer control unit 28 and a mode determination unit 29 are added to the configuration of the reproduction test apparatus 2 shown in FIG.
- the log transfer control unit 28 acquires a log made up of the external state history 201, the operation history 202, and the internal state history 203 stored in the information storage unit 20 and passes it to the reproduction test control unit 26 via the internal bus 31.
- the mode determination unit 29 determines whether the in-vehicle information device 1 is in the operation mode or the reproduction test mode, and controls the log acquisition process by the function execution unit 11 or the automatic reproduction test process by the reproduction test unit 30. To do.
- the operation interface unit 21 is connected to the operation I / F 15 shown in FIG. 1, and the CAN bus interface unit 22 is The external state I / F 12 shown in FIG.
- the other configuration is the same as that of the first embodiment shown in FIG.
- FIG. 6 is a flowchart showing the operation of the automatic reproduction test apparatus in the embedded system according to Embodiment 2 of the present invention.
- the operation of the automatic reproduction test apparatus in the embedded system according to Embodiment 2 of the present invention shown in FIGS. 4 and 5 will be described in detail with reference to the flowchart of FIG.
- the in-vehicle information device 1 collects an external state based on the mode determination result by the mode determination unit 29, for example, when the mode determination unit 29 indicates the operation mode (step ST501 “operation”).
- Unit 13, operation history collection unit 16, and internal state collection unit 17 are activated, and external state collection unit 13, operation history collection unit 16, and internal state collection unit 17
- the storage unit 20 stores the external state history 201, the operation history 202, and the internal state history 203 in the respective areas (step ST502). Then, the information storage unit 20 transfers these logs to the reproduction test unit 30 via the internal bus 31 at a timing when a certain amount is stored (step ST503 “YES”) (step ST504).
- step ST501 reproduction test
- step ST501 reproduction test
- the variable i is set to 0 (step ST511)
- the variable rep The number N of repeated reproduction tests is set to end (step ST512).
- the reproduction test control unit 26 determines whether or not the variable i has reached the number N of repeated reproduction tests (step ST513). If the variable i has not been reached (step ST513 "NO"), the log transfer control unit 28 is set. Various logs coming through the network are read (step ST514), and a reproduction test is started (step ST515).
- the reproduction test since the reproduction test records the state change or event of the external device 10 in addition to the operation history as a log, it is reflected in the system state of the in-vehicle information device 1 in synchronization with the operation history. It is carried out by restoring.
- step ST516 “YES” When a specific event such as a failure is detected during the above-described reproduction test (step ST516 “YES”), the reproduction test control unit 26 transmits the external device 10 via the external state I / F 12 and the operation I / F 15. And the operation panel 14 are instructed to re-collect logs related to the last state change (step ST517). The reproduction test is performed again based on the collected log (step ST515).
- the reproduction test control unit 26 updates the variable i by 1 (step ST518), and after step ST513, reads the log and repeatedly executes the reproduction test (steps ST513 to ST518). This repeated reproduction test is performed using the variable rep. It is repeatedly executed N times set to end.
- step ST513 “YES”) the reproduction test control unit 26 displays the fact on an externally connected input / output device via the UI management unit 23, and changes parameters to the user. A message for inquiring about whether or not it is necessary is displayed to prompt the intention.
- the above-described reproduction test is performed according to the fixed number of times and the interval, and the reproduction test control unit 26 changes the parameter input when the user determines that the parameter needs to be changed (step ST519 “YES”). (Step ST520) and repeat the reproduction test again.
- an automatic reproduction test can be performed without preparing a separate reproduction test apparatus, and an external recording medium 3 such as a memory card can be used.
- an external recording medium 3 such as a memory card
- the reproducibility is improved by a repetitive reproduction test using a log including the internal and external state histories in addition to the operation history, and parameters relating to changes in the number of repetitions, fluctuations in the time interval of each event, etc. Flexible repeated reproduction test is possible by adjustment. Furthermore, by holding the above-mentioned various logs in a text format and enabling editing, a more flexible reproduction test can be performed while reducing the burden on the user.
- the functions of the reproduction test apparatus 2 or the reproduction test unit 30 of the first embodiment and the second embodiment described above may be realized entirely by software, or at least a part thereof may be realized by hardware. Also good.
- the reproduction test control unit 26 reads the content stored in the history storage unit based on an external reproduction instruction, reproduces the internal state of the embedded system according to the read content, and Data processing for repeatedly executing the reproduction test a predetermined number of times may be realized on a computer by one or a plurality of programs, or at least a part thereof may be realized by hardware.
- the automatic reproduction test method in the embedded system of the present invention is, for example, an embedded system to which an external device 10 is connected, which is used in an automatic reproduction test apparatus having at least a history storage means (information storage unit 20) in FIG. 6 is an automatic reproduction test method in (vehicle-mounted information device 1), for example, in the flowchart of FIG. 6, the operation event of the embedded system and the event including the state change of the external device are stored in the history storage means in time series. Reading the contents stored in the history storage means based on an external reproduction instruction, reproducing the internal state of the embedded system according to the read contents, and Steps of repeatedly executing the reproduction test a predetermined number of times (ST511 to ST 20), and it has a.
- an efficient test can be performed to ensure the reliability of a complicated embedded system.
- a reproduction test is automatically performed by a script to check the content of the modification, and the script modified so far
- the halation test is performed in all cases, and when halation occurs (other faults that are not directly related due to the occurrence of a fault), the repair is performed again and the automatic reproduction test is performed.
- the automatic reproduction test apparatus and automatic reproduction test method in the embedded system of the present invention have various functions such as car navigation, audio, video, camera, telephone, air conditioner control function, etc., and various external devices are connected via a network or the like.
- an embedded system such as an in-vehicle information device that is configured in a complicated manner, it is possible to perform efficient failure analysis and reproduction test. For this reason, it becomes possible to efficiently develop and test equipment with the same embedded system, which contributes to shortening the development period and improving the reliability of the product.
- the present invention can perform efficient failure analysis and reproducibility tests, and can be widely applied to devices and embedded systems having various functions.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
- Test And Diagnosis Of Digital Computers (AREA)
Abstract
Description
しかしながら、限られた資源(表示手段や音声出力手段)を共有する等の理由から、全ての機能が完全に独立して実現されるわけではなく、各機能間で相互通信を行いながら各機能を実現しているのが現状である。このため、組み込みシステム分野では、複雑なシステムを信頼性高く実現するソフトウェアの方式や、信頼性を確保するために効率的に試験を行うソフトウェアの開発が最重要設計事項になっている。
しかしながら、車載情報機器等の複雑な組み込みシステムでは、操作履歴のみによる再現試験では試験内容として不十分であり、集中制御装置の外部に接続された、ドア、エンジン、車輪、変速機等の各種パーツや、エアコン等、外部機器の状態等によって挙動が大きく変化する。例えば、車輪が回転している走行状態にあっては、操作者の安全を確保するためにカーナビゲーション機能の操作を制約し、あるいは変更を要する。また、エンジン等の不調をECU(電子制御装置)によって検知した場合は、その状態をモニタに表示する等、外部機器の状態の変化がシステムの挙動に大きく影響する。
実施の形態1.
図1は、この発明の実施の形態1に係る組み込みシステムにおける自動再現試験装置の内部構成を示すブロック図である。
車載情報機器1は、ナビゲーション機能、オーディオ機能、ビデオ機能、電話機能他の各種機能を実行する機能実行部11を備え、外部状態I/F(インタフェース)12を介して外部機器10に接続される。外部機器10は、ここでは、ドア、エンジン、車輪、変速機、車速センサ等の各種車両パーツが接続されるECU(電子制御ユニット)とし、例えば、CAN(Control Area Network)バス4等のシリアル通信ライン経由で外部状態I/F12に接続される。
また、機能実行部11は、内部状態収集部17に接続され、機能実行部11による各種機能実行に伴い変化する内部レジスタ値等の内部状態は、情報蓄積部20に内部状態履歴203として、上記した外部状態履歴201、操作履歴202のそれぞれと関連付けて時系列に蓄積される。
UI管理部23は、再現試験装置2に接続される入出力装置(ここでは、キーボードと表示装置とする)とのユーザインタフェースを司り、ユーザによるキーボードの操作入力を取り込んでスクリプト編集部24へ出力し、スクリプト編集部24によるスクリプト編集結果を表示する。また、再現試験制御部26の起動等に関するユーザ指示を取り込んで再現試験制御部26に引渡し、また、再現試験制御部26による再現試験の結果等を表示する。
再現試験制御部26は、障害発生等特定のイベントの再現を契機に、車載情報機器1に対しCANバスインタフェース22を介して直前における状態変化に関する情報の再収集指示を行うことができる。再現試験制御部26はまた、再現試験の手順が定義された手順をテキストに変換して保持し(スクリプトコンバータ)、スクリプト編集部24により行なわれる編集を経て再現試験を行なうことも可能である。
以下、図3のフローチャートを参照しながら図1、図2に示すこの発明の実施の形態1に係るみ込みシステムにおける再現試験装置2の動作について詳細に説明する。
コピーされたログ(メモリカード)は、PC等で構成される再現試験装置2のカードスロットに装着され、再現試験装置2に接続される不図示の入出力装置によるユーザからの再現試験開始操作(再現指示)を待って図3にフローチャートで示す再現試験が開始される。
続いて、再現試験制御部26は、変数iが繰り返し再現試験回数Nに到達したか否かを判定し(ステップST303)、未到達の場合(ステップST303“NO”)、外部記憶媒体3に記憶された各種ログを、ログ取得部27を介して読み取り(ステップST304)、再現試験を開始する(ステップST305)。
特徴的には、ログとして、操作履歴に加え外部機器10の状態変化やイベント等について時間情報とともに取得されているため、操作履歴と同期を取りながら外部機器10の状態変化やイベントについても車載情報機器1のシステム状態の復元に反映することができ、このログに基づき繰り返し再現試験を行うことにある。
ここで再収集された詳細ログに基づき、再度再現試験が行なわれ(ステップST305)、このことにより、再度同じイベントが発生した場合には、その問題をより詳細に解析することが可能になるとともに、収集した詳細ログを記録することができる。
このように、例えば、電圧変動等、一回の再現試行だけでは出現しないイベントに対し、繰り返しシステム状態を復元しながら再現試験が可能となるように構成したため、より正確で高度な再現試験が可能になる。
上記した再現試験は、固定された回数、ならびに固定された繰り返しインターバルにしたがい行なわれるものであり、再現試験制御部26は、ユーザがこれらのパラメータを変更要(ステップST309“YES”)と判断したときに入力される変更パラメータを取り込み(ステップST310)、スクリプト編集部24を介してスクリプトの編集を行なう。このことにより、スクリプト記憶部25に記憶されたスクリプトを更新する。そして、再現試験制御部26は、スクリプト記憶部25に更新記憶されたスクリプトにしたがい、再度、上記した繰り返し再現試験を行なう。
また、1回の再現試験だけでは出現不可能なイベントに対し(開発フェーズの後半では一般的にこのような場合が多い)繰り返し状態を復元しながら再現試験を行うことで、複雑な組み込みシステムにおいてもより精度の高い再現試験が可能になる。
更に、繰り返し再現試験での再現を促すために、各イベント間の時間調整や、繰り返し毎にインターバル時間を変化させることによる再現性誘導を実現し、このことにより、複雑な組み込みシステムの信頼性を確保するために効率的な試験が可能になる。すなわち、ログ収集時の微妙なタイミング誤差や、再現時の誤差などにより、単一の再現だけでは出現しないような場合においても、繰り返し状態を復元しながら再現試験が可能になるため、再現性の精度が向上する。
図4は、この発明の実施形態2に係る組み込みシステムにおける自動再現試験装置の内部構成を示すブロック図である。
図1に示す実施の形態1との差異は、実施の形態1では、再現試験装置2が組み込みシステム(車載情報機器1)に外部接続される形態としたのに対し、再現試験装置2が有する機能を組み込みシステムに内蔵する形態としたことにある。このような形態をとることで再現試験装置2を別に用意することなく自動再現試験が可能になる。
再現試験部30は、図5にその構成が機能展開され示されている。図2に示す実施の形態1との構成上の差異は、図2に示す再現試験装置2が有する構成に、ログ転送制御部28と、モード判定部29が付加されたことにある。ログ転送制御部28は、情報蓄積部20に蓄積された外部状態履歴201、操作履歴202、内部状態履歴203からなるログを取得して内部バス31を介して再現試験制御部26に引き渡す。モード判定部29は、車載情報機器1が稼動モードにあるか、再現試験モードにあるか否かを判定して機能実行部11によるログ取得処理、あるいは再現試験部30による自動再現試験処理を制御する。
以下、図6のフローチャートを参照しながら図4、図5に示すこの発明の実施の形態2に係る組み込みシステムにおける自動再現試験装置の動作について詳細に説明する。
そして、情報蓄積部20は、一定量蓄積されたタイミングで(ステップST503“YES”)、これらログを内部バス31経由で再現試験部30に転送する(ステップST504)。
続いて、再現試験制御部26は、変数iが繰り返し再現試験回数Nに到達したか否かを判定し(ステップST513)、未到達の場合(ステップST513“NO”)、ログ転送制御部28を介して到来する各種ログを読み取り(ステップST514)、再現試験を開始する(ステップST515)。上記のように、再現試験は、操作履歴に加えて外部機器10の状態変化やイベント等についてもログとして記録されているため、操作履歴と同期を取りながら車載情報機器1のシステム状態に反映させて復元することにより実施される。
上記により再現試験が1回終了すると、再現試験制御部26は、変数iを+1更新して(ステップST518)、ステップST513以降、ログの読み取り、再現試験を繰り返し実行する(ステップST513~ST518)。この繰り返し再現試験は、変数rep.endに設定したN回繰り返し実行される。
また、実施の形態1同様、操作履歴に加え、内外の状態履歴を含むログを用いた繰り返し再現試験により再現性の向上がはかれ、繰り返し回数の変更、各イベントの時間間隔のゆれ等に関するパラメータ調整により柔軟な繰り返し再現試験が可能である。更に、上記した各種ログをテキスト形式にて保持し、編集を可能とすることでユーザの負担を軽減しながらより柔軟な再現試験が可能となる。
なお、この発明の組み込みシステムにおける自動再現試験装置および自動再現試験方法によれば、例えば、障害改修時、スクリプトにより自動で再現試験を行って改修内容の確認を行い、これまでに改修されたスクリプトにより全てのケースでのハレーション試験を行い、ハレーション発生時(ある障害の発生により直接関係しない他の障害が発生)、再度改修を行い、自動再現試験を行う。このとき、蓄積されたログとスクリプトに基づき、自動再現試験によって改修パターンとハレーション発生パターンとの相関を演算(テキスト比較)により求め、この相関の抽出により、改修パターンに基づく試験項目の決定を行なうことで、限られた時間内に効率の良い自動再現試験が可能になる。
Claims (7)
- 外部機器が接続された組み込みシステムにおける自動再現試験装置であって、
前記組み込みシステムの操作イベント、および前記外部機器の状態変化を含むイベントを時系列に蓄積する履歴蓄積手段と、
外部からの再現指示に基づき前記履歴蓄積手段に蓄積された内容を読み出し、前記読み出された内容にしたがい前記組み込みシステムのシステム状態を再現し、前記組み込みシステムの再現試験を所定回数繰り返し実行する再現試験手段と、
を備えたことを特徴とする組み込みシステムにおける自動再現試験装置。 - 前記再現試験手段は、
前記再現試験の結果に基づき、ユーザインタフェース経由で到来する要求にしたがい、前記再現試験の繰り返し回数を含むパラメータの調整を行うことを特徴とする請求項1記載の組み込みシステムにおける自動再現試験装置。 - 前記再現試験手段は、
特定のイベントの再現を契機に、前記組み込みシステムに対して直前における状態変化に関する情報の再収集指示を行うことを特徴とする請求項1記載の組み込みシステムにおける自動再現試験装置。 - 前記再現試験手段は、
前記再現試験が定義された手順をテキスト形式に変換して保持し、ユーザインタフェースを用いて編集を行い、前記編集した手順にしたがい前記再現試験を行なうことを特徴とする請求項1記載の組み込みシステムにおける自動再現試験装置。 - 前記履歴蓄積手段に蓄積された内容は、
前記組み込みシステムに接続された外部記憶媒体に転送され、前記外部記憶媒体を介して前記再現試験手段に転送されることを特徴とする請求項1記載の組み込みシステムにおける自動再現試験装置。 - 前記履歴蓄積手段に蓄積された内容は、
前記組み込みシステムが有する内部バス経由で前記再現試験手段に転送されることを特徴とする請求項1記載の組み込みシステムにおける自動再現試験装置。 - 少なくとも履歴蓄積手段を備えた自動再現試験装置に用いられる、外部機器が接続された組み込みシステムの自動再現試験方法であって、
前記組み込みシステムの操作イベント、および前記外部機器の状態変化を含むイベントを前記履歴蓄積手段に時系列に蓄積するステップと、
外部からの再現指示に基づき前記履歴蓄積手段に蓄積された内容を読み出し、前記読み出された内容にしたがい前記組み込みシステムのシステム状態を再現し、前記組み込みシステムの再現試験を所定回数繰り返し実行するステップと、
を有することを特徴とする組み込みシステムにおける自動再現試験方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/747,150 US20100262864A1 (en) | 2008-02-26 | 2008-10-29 | Automatic reproduction test device and automatic reproduction test method in embedded system |
JP2010500458A JPWO2009107174A1 (ja) | 2008-02-26 | 2008-10-29 | 組み込みシステムにおける自動再現試験装置および自動再現試験方法 |
CN2008801207083A CN101896888A (zh) | 2008-02-26 | 2008-10-29 | 嵌入式系统中的自动再现测试装置及自动再现测试方法 |
DE112008003732T DE112008003732T5 (de) | 2008-02-26 | 2008-10-29 | Automatische Reproduktionstest-Vorrichtung und automatisches Reproduktionstest-Verfahren in einem eingebetteten System |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008-044553 | 2008-02-26 | ||
JP2008044553 | 2008-02-26 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2009107174A1 true WO2009107174A1 (ja) | 2009-09-03 |
Family
ID=41015588
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2008/003096 WO2009107174A1 (ja) | 2008-02-26 | 2008-10-29 | 組み込みシステムにおける自動再現試験装置および自動再現試験方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20100262864A1 (ja) |
JP (1) | JPWO2009107174A1 (ja) |
CN (1) | CN101896888A (ja) |
DE (1) | DE112008003732T5 (ja) |
WO (1) | WO2009107174A1 (ja) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011154656A (ja) * | 2010-01-28 | 2011-08-11 | Fujitsu Frontech Ltd | 試験装置、試験システム及び試験方法 |
JP2011232867A (ja) * | 2010-04-26 | 2011-11-17 | Ricoh Co Ltd | 動作解析装置、情報処理装置、動作解析方法及び動作解析プログラム |
JP2012108773A (ja) * | 2010-11-18 | 2012-06-07 | Mitsubishi Electric Corp | ソフトウェア自動試験装置及びソフトウェア自動試験方法 |
JP6271103B1 (ja) * | 2017-02-22 | 2018-01-31 | 三菱電機株式会社 | 制御装置及び制御方法 |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2011016327A1 (ja) * | 2009-08-07 | 2011-02-10 | 株式会社日立製作所 | 計算機システム、プログラム及びシミュレーションに使用する計算資源を割り当てる方法 |
TW201133003A (en) * | 2010-03-31 | 2011-10-01 | Wistron Corp | Testing device and testing method |
CN102095448B (zh) * | 2010-12-08 | 2012-07-18 | 天泽信息产业股份有限公司 | 车载信息终端生产线自动测试系统及其测试方法 |
CN102033806B (zh) * | 2010-12-14 | 2012-07-25 | 北京航空航天大学 | 一种实时嵌入式软件可靠性测试数据生成方法 |
TW201314442A (zh) * | 2011-09-30 | 2013-04-01 | Askey Technology Jiangsu Ltd | 手持式電子產品的讀寫測試方法 |
CN103455416B (zh) * | 2013-07-18 | 2016-04-27 | 北京航空航天大学 | 一种基于占用Android系统智能设备内存和CPU的压力测试方法 |
CN105527945B (zh) * | 2015-12-10 | 2018-04-17 | 北京航星科技有限公司 | 实现智能健康穿戴设备的快速批量生产、检测与设备信息记录的系统及方法 |
FR3045881B1 (fr) * | 2015-12-18 | 2018-12-07 | Airbus Slc Sas | Procede de verification de fonctionnalites d'un logiciel destine a etre embarque dans un composant cryptographique, systeme |
CN106919495B (zh) * | 2015-12-25 | 2020-11-20 | 比亚迪股份有限公司 | 用于车辆的can总线日志文件获取装置、系统和车辆 |
DE102017208192A1 (de) * | 2017-05-16 | 2018-11-22 | Robert Bosch Gmbh | Recheneinheit und Betriebsverfahren für eine Recheneinheit |
CN110554939A (zh) * | 2019-08-01 | 2019-12-10 | 深圳亿智时代科技有限公司 | 一种调试嵌入式设备的方法、系统及终端 |
CN111290945B (zh) * | 2020-01-17 | 2023-07-14 | 惠州市德赛西威汽车电子股份有限公司 | 车载应用设备对外接存储设备的兼容性测试系统与方法 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0850555A (ja) * | 1994-08-08 | 1996-02-20 | Matsushita Electric Ind Co Ltd | 障害解析装置及び障害検出装置 |
JP2004056604A (ja) * | 2002-07-23 | 2004-02-19 | Fujitsu Ltd | ネットワーク運用監視装置 |
JP2007052734A (ja) * | 2005-08-19 | 2007-03-01 | Sony Corp | テストシステム、テスト装置、及びテスト方法 |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0950555A (ja) * | 1995-08-04 | 1997-02-18 | Sophia Co Ltd | 遊技情報媒体 |
JP4178605B2 (ja) | 1998-07-30 | 2008-11-12 | ヤマハ株式会社 | カラオケ装置およびカラオケ装置の操作再現システム |
-
2008
- 2008-10-29 DE DE112008003732T patent/DE112008003732T5/de not_active Withdrawn
- 2008-10-29 WO PCT/JP2008/003096 patent/WO2009107174A1/ja active Application Filing
- 2008-10-29 JP JP2010500458A patent/JPWO2009107174A1/ja active Pending
- 2008-10-29 US US12/747,150 patent/US20100262864A1/en not_active Abandoned
- 2008-10-29 CN CN2008801207083A patent/CN101896888A/zh active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0850555A (ja) * | 1994-08-08 | 1996-02-20 | Matsushita Electric Ind Co Ltd | 障害解析装置及び障害検出装置 |
JP2004056604A (ja) * | 2002-07-23 | 2004-02-19 | Fujitsu Ltd | ネットワーク運用監視装置 |
JP2007052734A (ja) * | 2005-08-19 | 2007-03-01 | Sony Corp | テストシステム、テスト装置、及びテスト方法 |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011154656A (ja) * | 2010-01-28 | 2011-08-11 | Fujitsu Frontech Ltd | 試験装置、試験システム及び試験方法 |
JP2011232867A (ja) * | 2010-04-26 | 2011-11-17 | Ricoh Co Ltd | 動作解析装置、情報処理装置、動作解析方法及び動作解析プログラム |
JP2012108773A (ja) * | 2010-11-18 | 2012-06-07 | Mitsubishi Electric Corp | ソフトウェア自動試験装置及びソフトウェア自動試験方法 |
JP6271103B1 (ja) * | 2017-02-22 | 2018-01-31 | 三菱電機株式会社 | 制御装置及び制御方法 |
Also Published As
Publication number | Publication date |
---|---|
CN101896888A (zh) | 2010-11-24 |
DE112008003732T5 (de) | 2011-01-27 |
JPWO2009107174A1 (ja) | 2011-06-30 |
US20100262864A1 (en) | 2010-10-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2009107174A1 (ja) | 組み込みシステムにおける自動再現試験装置および自動再現試験方法 | |
JP5336507B2 (ja) | データの同期取得及び同期再生のためのシステム、制御装置及び方法 | |
CN110221983B (zh) | 测试方法、装置、计算机可读存储介质和计算机设备 | |
US8296007B2 (en) | Embedded vehicle data recording tools for vehicle servicing | |
JP4295775B2 (ja) | Guiテスト支援システム及びテスト支援用アプリケーションプログラム | |
WO2007061241A1 (en) | Error test method for mobile communication terminals | |
JP5320872B2 (ja) | 画像処理装置、情報処理装置、ソフトウェア動作テスト方法、ソフトウェア動作テストプログラム、及びそのプログラムを記録した記録媒体 | |
KR101460860B1 (ko) | 상태 기반의 테스트 시나리오 모델을 이용한 gui 테스트 장치 및 방법 | |
CN112612697A (zh) | 一种基于字节码技术的软件缺陷测试定位方法及系统 | |
CN110837467B (zh) | 软件测试方法、装置以及系统 | |
JP4672532B2 (ja) | オペレータ擬似システムおよびオペレータ擬似方法 | |
CN112423121A (zh) | 视频测试文件生成方法、装置及播放器测试方法、装置 | |
CN107357701B (zh) | 一种分布式场景下sas信号测试方法及装置 | |
JP2006219092A (ja) | 車両故障診断システム、車両故障診断方法、及び車両用故障診断装置 | |
JP2000215082A (ja) | 分散オブジェクト環境のプレイバックテスト方式 | |
JP3206096B2 (ja) | 入力データ処理装置 | |
CN111190806B (zh) | 一种语音交互设备的日志处理方法和装置 | |
JP5591072B2 (ja) | ソフトウェア自動試験装置及びソフトウェア自動試験方法 | |
JP3389745B2 (ja) | プログラムの性能測定装置と方法 | |
CN113138966A (zh) | 一种复现起爆操作场景的方法、装置、存储介质及设备 | |
CN109362015A (zh) | 音量测试方法、控制端设备、存储介质及音量测试系统 | |
JP7356778B2 (ja) | プログラマブルロジックコントローラ用プログラム作成支援装置 | |
JP5610146B2 (ja) | データ解析支援方法、データ解析支援プログラム及びデータ解析支援システム | |
JP2002312198A (ja) | プログラムテスト支援装置 | |
JP2003114834A (ja) | Usbデバイス評価システム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200880120708.3 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 08872803 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2010500458 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12747150 Country of ref document: US |
|
RET | De translation (de og part 6b) |
Ref document number: 112008003732 Country of ref document: DE Date of ref document: 20110127 Kind code of ref document: P |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 08872803 Country of ref document: EP Kind code of ref document: A1 |