JP6518309B1 - Driving condition reproduction system - Google Patents

Abstract

[Problem] To provide a system that is useful for identifying the location and cause of abnormal noise. A traveling state reproduction system 1 includes a vehicle data acquisition unit that acquires vehicle data representing a traveling state of a vehicle 5, and a sound collecting a sound generated during traveling of the vehicle 5 with a microphone to generate sound data. A recording unit for recording recording data including sound data generated by the sound collection unit and vehicle data acquired by the vehicle data acquisition unit; and a reproduction unit for reproducing sound data included in the recording data, When reproducing the sound data, the unit can reproduce the vehicle data in synchronization. [Selected figure] Figure 1

Description

  The present invention relates to a system for reproducing the traveling state of a vehicle and providing the maintenance work for the vehicle.

  In a vehicle, the generation of engine noise, road noise generated in response to rolling of a tire, and wind noise is inevitable. Since the sound heard by the occupants is a factor that greatly affects the comfort, at the development site of the vehicle, research for reducing these sounds and research for adjusting the sound quality to be comfortable for the occupants are actively conducted. It is

  On the other hand, in a vehicle manufactured by properly assembling a large number of parts, noise may be generated due to various causes such as a defect in an assembling process, a design defect, and a secular change. Abnormal noise occurs due to some cause, but often occurs as a precursor before a driving problem becomes apparent. If the cause of the abnormal noise can be found early, it will be possible to cope with the symptoms before they become severe.

  Therefore, conventionally, the type of abnormal noise that may be generated in the vehicle by executing the remote failure diagnosis program is presented to the user, and the user is allowed to select abnormal noise close to that actually generated, thereby realizing failure diagnosis. A system to be attempted has been proposed (see, for example, Patent Document 1 below). Furthermore, in this system, the user can select abnormal noise generation status such as "when the engine is turned on", "when the engine is turned off", and "always during traveling" to associate the abnormal noise with the running state. Devices are used to assist in fault diagnosis.

Japanese Patent Laid-Open No. 2002-331884

  However, the conventional system has the following problems. That is, there is a possibility that the understanding of the traveling state when the abnormal noise occurs is insufficient, and the accuracy of the failure diagnosis can not be sufficiently secured.

  The present invention has been made in view of the above-mentioned conventional problems, and is an invention which is intended to provide a system which is useful for identifying the location and cause of abnormal noise.

The present invention relates to a vehicle data acquisition unit that acquires vehicle data representing a traveling state of a vehicle;
A sound collection unit that collects sound generated while the vehicle is traveling with a microphone to generate sound data;
A recording unit that records recording data including sound data generated by the sound collection unit and vehicle data acquired by the vehicle data acquisition unit;
A reproduction unit capable of reproducing sound data included in the recording data in synchronization with the vehicle data ;
A trigger condition setting unit capable of setting a plurality of trigger conditions with respect to the sound data or the vehicle data;
And a trigger signal generation unit that generates a trigger signal that triggers recording of the sound data and the vehicle data in response to the establishment of all types of trigger conditions among the plurality of types of trigger conditions.
The recording unit temporarily records temporarily stored data including the sound data and the vehicle data over a predetermined period in the past regardless of the presence or absence of the trigger signal.
When the trigger signal is generated, generation of the trigger signal occurs at a point when transitioning from a state where the number of satisfaction of the trigger condition is less than a predetermined number less than all types to a state where the predetermined number of trigger conditions is satisfied The driving state reproduction system executes a process of cutting out the recording data with the time immediately before the time being as the head of the recording period .

  The traveling state reproduction system of the present invention can reproduce vehicle data in synchronization when reproducing sound data. According to such synchronous reproduction, it becomes easy to comprehend vehicle data when a sound is generated, and it becomes easy to confirm in which traveling state a sound is generated. For example, if a mechanic or the like who is familiar with the maintenance of the vehicle confirms the traveling state at the time of abnormal noise generation, it becomes easy to identify the location and cause of the sound generation.

  As described above, the driving state reproduction system of the present invention is a system of excellent characteristics that is useful for identifying the location and cause of the sound during driving.

FIG. 1 is a configuration diagram of a driving state reproduction system in a first embodiment. FIG. 2 is a block diagram of a smartphone according to the first embodiment. The front view of the (a) start screen which a smart phone in Example 1 displays, (b) standby screen. FIG. 7 is an explanatory diagram of print data trimming processing in the first embodiment. The front view of the data list screen which a smart phone in Example 1 displays. FIG. 7 is an explanatory diagram of synchronous reproduction of recording data in the first embodiment. FIG. 7 is a front view of the display screen of the smartphone during synchronized reproduction of recorded data in the first embodiment. FIG. 7 is an illustration of a binaural microphone in the first embodiment. FIG. 7 is an explanatory diagram of a sound collection method by the binaural microphone in the first embodiment. FIG. 8 is an explanatory diagram of a setting method of trigger conditions in the second embodiment. Explanatory drawing of the trigger condition in Example 2. FIG. FIG. 14 is an explanatory diagram of automatic recording in Embodiment 2. FIG. 10 is a configuration diagram of a driving state reproduction system in a third embodiment. Explanatory drawing of the noise generation location in Example 4, and the production | generation method of a cause. FIG. 14 is an explanatory diagram of a procedure of storing recording data in a database according to a fourth embodiment.

  Vehicle data in the present invention includes engine rotational speed, accelerator opening, coolant temperature, intake temperature, absolute pressure of intake manifold, steering angle of steering, speed (vehicle speed), selection gear in transmission, vehicle position, outside temperature, There are various types of information used to control the vehicle, such as yaw rate and acceleration. Furthermore, it is also possible to acquire a captured image of the vehicle interior or outside used for driving support control such as automatic driving or warning, a distance image by a distance measuring sensor such as a laser radar, or the like as vehicle data.

  It is also possible to use a terminal device as a vehicle data acquisition unit that acquires vehicle data. A captured image by a camera included in the terminal device, measurement data by a sensor such as a magnetic sensor or an acceleration sensor, or the like may be acquired as vehicle data. As a terminal device, besides a dedicated device, a multifunctional mobile phone (smart phone) may be used. As a vehicle data acquisition unit, it is a multifunctional mobile phone that has various communication functions in addition to cameras and sensors, has a data storage area, and can realize various functions by installing application programs. It can be used conveniently.

Embodiments of the present invention will be specifically described using the following examples.
Example 1
This example is an example of the running state reproduction system 1 using the smartphone 10. This content is demonstrated using FIGS. 1-9.
As shown in FIG. 1, the traveling state reproduction system 1 according to the present embodiment is a sound collecting unit that collects sound while the vehicle 5 is traveling to generate sound data, and a vehicle data acquisition unit that acquires vehicle data representing the traveling state of the vehicle 5. A recording unit that records sound data from the sound collection unit and vehicle data acquired by the vehicle data acquisition unit, and a reproduction unit that synchronously reproduces the sound data and the vehicle data recorded by the recording unit. In particular, in the present example, the sound collection unit, the vehicle data acquisition unit, the recording unit, and the reproduction unit are realized using the function of the smartphone 10.

First, the configuration of the vehicle 5 and the configuration of the traveling state reproduction system 1 of this example will be described with reference to the system configuration diagram of FIG. 1.
The vehicle 5 is provided with an ECU (Engine Control Unit) 51 for each control target such as engine control, transmission control, and brake control. Each ECU 51 is connected to a CAN (Controller Area Network), which is an example of a communication network used to control the vehicle 5, and data (vehicle data) exchanged between the ECUs 51 is centrally managed by a central GW (GateWay) 52. It is done.

  Connected to the central GW 52 is an OBD (On-Board Diagnostics) connector 53 for realizing a self-diagnosis function. By connecting a communication cable (not shown) or the communication adapter 19 to the OBD connector 53, various vehicle data handled by the ECU 51 of the vehicle 5 can be output to the outside. In this example, a communication adapter 19 capable of short distance wireless communication such as Bluetooth (registered trademark) is used as an example of a network device, and external output of vehicle data by wireless communication is possible.

  As shown in FIGS. 1 and 2, the smartphone 10 forming the running state reproduction system 1 includes a ROM (Read Only Memory), a RAM (Random Access Memory), and an I / O (Input / Output) besides a central processing unit (CPU). Are built around a one-chip microcomputer 101 mounted on one IC (Integrated Circuit) chip. Programs such as BIOS (Basic Input Output System) are stored in a memory area of the ROM. The memory area of the RAM is used as a work area for temporarily storing various data.

  The microcomputer 101 includes a liquid crystal display 122 capable of touch operation, a camera 123, a speaker 124, a microphone 125 constituting a sound collecting unit, a 3D magnetic sensor 126, an acceleration sensor 127, GPS for positioning (GPS (Global Positioning System, Global Positioning) System unit 128, a wireless communication circuit 129, and a memory circuit including a flash ROM 102 which is a rewritable memory means are connected. The memory area of the flash ROM 102 is used as a data storage area for storing various data.

On the display screen (see FIG. 3; reference numeral 100) of the liquid crystal display 122, a transparent touch screen sheet 121 for enabling an operation with a fingertip, a touch pen or the like is stacked. The smartphone 10 can perform a touch operation, a flick operation, and the like with a fingertip on the display screen 100.
As the wireless communication circuit 129, a communication circuit for connecting to a cellular phone network, a communication circuit corresponding to near field communication such as Bluetooth (registered trademark) or Wi-Fi, and the like are provided.

The smartphone 10 forming the traveling state reproduction system 1 realizes the following functions (1) to (5) by the microcomputer 101 executing the installed dedicated application program.
(1) Sound Collection Unit The microphone 125 provided in the smartphone 10 functions as a sound collection unit, and converts the sound generated while the vehicle 5 is traveling into an electric signal. Furthermore, this electrical signal is converted into digital sound data by A / D conversion processing.

(2) Vehicle Data Acquisition Unit The smartphone 10 as a vehicle data acquisition unit acquires various vehicle data exchanged between the ECUs 51 of the vehicle 5 via the communication adapter 19 connected to the OBD connector 53 on the vehicle 5 side. Do. Every time the smartphone 10 transmits a request signal to the central GW 52 on the vehicle 5 side, vehicle data is returned.

  The vehicle data acquired from the vehicle 5 side includes engine rotation speed, vehicle speed, accelerator opening degree, coolant temperature, intake air temperature, absolute pressure of intake manifold, engine start time (continuous operation time after engine start), yaw rate, etc. There is ECU information. Furthermore, in addition to the vehicle data acquired from the vehicle 5 side, there is also vehicle data that can be acquired by the smartphone 10 itself. The vehicle data acquired by the smartphone 10 itself includes, for example, position information (vehicle position) by positioning of the GPS unit 128, direction information by the 3D magnetic sensor 126, an image captured by the (built-in) camera 123, and the like. For example, if the smartphone 10 is attached to a dashboard or the like so that the camera 123 faces forward, acquisition of a forward image (video) as vehicle data becomes possible. In addition, it is also possible to acquire a captured image of the drive recorder as vehicle data.

(3) Recording Unit The smartphone 10 as a recording unit records, in the memory area of the flash ROM 102, recording data including sound data and vehicle data. The recording unit links the common synchronization signal to record the sound data and the vehicle data so that the sound data and the vehicle data can be synchronously reproduced. As the synchronization signal, for example, a time code representing a time or an elapsed time can be used.

(4) Reproduction Unit The smartphone 10 as a reproduction unit reproduces sound data and vehicle data included in the recording data. The sound data in the recorded data is output via the built-in speaker 124 or earphone via D / A conversion processing. Vehicle data can be selectively displayed on the display screen 100 of the liquid crystal display 122. At the time of reproduction of the recording data, reproduction of the sound data and display of the vehicle data are executed synchronously by using a synchronization signal such as a time code included in the recording data.

(5) Trigger Signal Generation Unit The smartphone 10 as a trigger signal generation unit generates a trigger signal in response to a predetermined touch operation on the display screen 100 of the liquid crystal display 122. In the smartphone 10, recording of sound data and vehicle data is performed according to the trigger signal.

  Next, (1) system operation and (2) system operation regarding the traveling state reproduction system 1 configured using the smartphone 10 as described above will be described.

(1) System Operation When the dedicated application program is started, the control of the microcomputer 101 displays the start screen of FIG. 3A in which the start button 111 is disposed at the center. When the start button 111 is touch-operated, the screen is switched to the standby screen shown in FIG. 6B, and is switched to the standby mode, which is a preparation state for storing sound data and vehicle data as recording data.

  On the standby screen under the standby mode, as shown in FIG. 3B, a graph area 112 for displaying an acoustic wave form by the microphone 125, a recording button 113 and the like are arranged. The recording button 113 is an operation button for recording sound data and vehicle data as recording data. For example, by operating the recording button 113 when abnormal noise occurs in the standby mode, it is possible to save sound data of abnormal noise and vehicle data representing a traveling state as recording data.

  In the standby mode, an operation (temporary storage operation) of writing sound data from the microphone 125, vehicle data such as engine rotational speed and position information, etc. into the work area of the RAM is performed. The data written to the work area is, for example, temporary storage data of sound data and vehicle data over the past 10 minutes. The old sound data and vehicle data at the point of recording exceeding the past 10 minutes are rewritten with new data as needed and sequentially erased. In the time chart of FIG. 4 for explaining the write operation of temporary storage data to the work area, the point of time of the touch operation on the start button 111 (FIG. 3A) corresponds to the start point. At this start point, the temporary save operation is started, and the mode is shifted to the standby mode. The time chart in FIG. 4 is (1) sound data (noise), (2) vehicle data such as vehicle speed and engine speed (vehicle condition), (3) vehicle position data (traveling route), (4) The simultaneous recording operation of the captured image (video) at the time of traveling is illustrated.

  When a touch operation on the recording button 113 is performed on the standby screen of FIG. 3B, the smartphone 10 generates a trigger signal indicating that. In response to the trigger signal, the microcomputer 101 sets, as an end point of the temporary storage operation to the work area as described above, a point 30 seconds after the trigger signal is generated (FIG. 4). Thereafter, when the time reaches this end point, the microcomputer 101 stops the operation of writing temporary storage data to the work area (temporary storage operation).

  The microcomputer 101 executes trimming processing for cutting out recording data for a predetermined recording period (FIG. 4) for temporarily stored data such as sound data written in the work area. In this example, based on the generation time of the trigger signal corresponding to the operation of the recording button 113 (operation time in FIG. 4), the time when 30 seconds have passed in the future with the time 1 minute back to the past as the starting point The recording period to be the end point is set. The end point of this recording period is the point in time when it coincides with the end point of the above-mentioned temporary storage operation.

  The microcomputer 101 writes the recording data cut out by the trimming processing in the memory area of the flash ROM 102, and switches and displays a data list screen (FIG. 5) on which the recording data is displayed in a list. In the data list screen, the recorded data can be selectively reproduced by a touch operation on any of the display fields.

  When any display field in the data list screen (FIG. 5) is touch-operated, the microcomputer 101 reads out the corresponding recording data from the flash ROM 102, and executes the reproduction processing of the recording data as shown in FIG. In reproduction processing of recorded data, after reproduction of sound data is started in synchronization with vehicle data, sound data is reproduced in synchronization with vehicle data while repeating synchronization processing every 5 seconds. The time chart in FIG. 6 is (1) sound data (noise), (2) vehicle data such as vehicle speed and engine speed (vehicle condition), (3) vehicle position data (traveling route), (4) The synchronous reproduction of the captured image (video) at the time of traveling is illustrated.

  During reproduction of recorded data, a reproduction screen illustrated in FIG. 7 is displayed on the display screen 100 of the liquid crystal display 122 in synchronization with the reproduction of sound data by the output from the speaker 124. The reproduction screen 100 illustrated in the figure is a vertical display screen, and is configured centering on the graphic area 13 in the upper stage and the data area 14 in the lower stage. At the top of the graphic area 13, four graphic selection buttons 131 to 134 are arranged in a horizontal row. At the bottom of the data area 14, in addition to a stop button, a play button, a back button for rewinding, and a next button for fast forwarding, a control area in which an elapsed time display is arranged is disposed.

  The graphic selection buttons 131 to 134 are operation buttons for selectively setting contents to be displayed in the graphic area 13. As graphic selection buttons, the map button 131 for displaying a route map, the waveform button 132 for displaying a sound waveform, the graph button 133 for displaying a graph of ECU information (vehicle data), and the moving image button 134 for displaying a captured image One is placed. FIG. 7A is a reproduction screen when the map button 131 is selected, and FIGS. 7B, 7C, and 7D correspond to the waveform button 132, the graph button 133, and the moving image button 134, respectively. ing.

  For example, in the case of the reproduction screen 100 of FIG. 7A when the map button 131 for displaying the route map is operated, it is possible to specify the position of the vehicle 5 when abnormal noise or the like occurs. Further, for example, in the case of the reproduction screen 100 of FIG. 7D, it is possible to grasp the traveling environment when abnormal noise or the like occurs.

(2) System Operation The traveling state reproduction system 1 of this example is used, for example, in the service department of a vehicle dealer. For example, when the vehicle user consults on the occurrence of abnormal noise, it is preferable to lend the smartphone 10 with a dedicated application program installed to the user. Thereafter, if the smart phone 10 having the recorded data of the abnormal noise saved is collected, a mechanic or the like of the service department can confirm the abnormal noise and the occurrence information thereof by reproducing the recorded data, and can study the cause and the countermeasure. Moreover, if it is the recording data by which sound data and vehicle data were synchronized recorded, it is also possible to perform an analysis process in a vehicle maker.

  It is also possible to use a stereo microphone such as the binaural microphone 15 of FIG. 8 that imitates the human head as an external microphone. If an external microphone such as the binaural microphone 15 is installed in the passenger compartment to collect sound, omnidirectional recording can be performed as shown in FIG. In other words, the sound data is so specified as to be able to specify the position of the sound source (location of sound generation) relative to the installation position of the microphone (binaural microphone 15) and the direction of the sound source relative to the direction of directivity of the microphone. It can record. Then, by using stereo headphones or stereo speakers when reproducing sound data, it becomes possible to reproduce the sound field in the vehicle compartment, and it is possible to reproduce the sound field which can grasp the position and direction of the sound source by reproducing the sound data. . If the sound field in the passenger compartment can be reproduced, it will be easy to specify the position and orientation of the sound source.

  For example, if a mechanic or the like gets on the vehicle 5 and listens to the reproduced sound, the sound field in the passenger compartment can be reproduced, and the sense of reality is increased, so that it is easier to specify the position and orientation of the sound source. It is preferable that a listener such as a mechanic listens to the reproduced sound at the same position and in the same head direction as the binaural microphone 15 used for recording. In this case, the sound source in the sound field can be precisely matched to the actual abnormal noise generation location, and it becomes easier to grasp the abnormal noise generation location.

  Also, as a function of an application that operates on the smartphone 10, a function as a sound collection condition setting unit that sets a sound collection condition including an installation position of a microphone and an orientation of directivity, and a position of a listener and an orientation of a listener's head It is also possible to provide a function as a listening condition setting unit for setting a listening condition including. It is also possible to apply signal processing to sound data according to the set sound collection conditions and listening conditions so that the sound field representing the original position and orientation of the sound source can be reproduced regardless of the listener's position and head orientation. . If the sound field in the vehicle compartment is reproduced in this way, the position of the sound source in the sound field can be precisely adjusted with respect to the actual place where the abnormal noise occurs regardless of the position of the listener who checks the reproduced sound and the head direction. It can match.

  In this example, 10 minutes is set as a temporary storage period of temporary storage data under the standby mode. Further, as a recording period of the recording data, a period of one minute before and 30 seconds after the trigger signal generation time is set. The length of time of these periods can be changed as appropriate.

(Example 2)
The traveling state reproduction system 1 of this example is an example of a system provided with an automatic generation function of a trigger signal based on the first embodiment. The contents will be described with reference to FIGS. 10 to 12.
In the configuration of this example, as a function of an application operating on the smartphone 10, a setting function of trigger conditions and an automatic recording function of automatically executing recording of sound data and vehicle data when the trigger conditions are satisfied are added.

  In the trigger condition setting screen of FIG. 10, various trigger conditions such as volume, vehicle speed, engine rotation speed, outside air temperature, vehicle position (location)... Can be set (trigger condition setting unit). As a trigger condition, not only one type but a plurality of types of trigger conditions can be set in combination. The trigger conditions such as volume and vehicle speed can be set, for example, by numerical input, selection of a range of values prepared in advance, or the like. As for the vehicle position, in addition to setting a range on the displayed map, it is possible to set a predetermined range centered on the input specific address or intersection. In addition, the same figure illustrates the procedure of selecting the vehicle speed on the screen on the left side and setting the speed range on the screen on the right side.

  For example, the recording operation when five types of trigger conditions of conditions 1 to 5 are set as shown in FIG. 11 will be described with reference to the time chart of FIG. 12 showing the operation of the operation period from the start of operation to the end of operation. . Arrows attached to each trigger condition in FIG. 12 indicate the establishment period of the trigger condition. Then, as shown in the figure, in the smart phone 10, the trigger signal is automatically generated when all the trigger conditions of the conditions 1 to 5 are satisfied simultaneously, and the automatic recording of recording data including sound data and vehicle data is automatically performed. Recording is performed.

  The operation of this automatic recording will be described in detail. After the application is activated by the smartphone 10, when the start button on the start screen is touch-operated, the standby mode similar to that of the first embodiment is entered. In this standby mode, sound data from the microphone 125, vehicle data such as engine rotational speed and position information, etc. are temporarily stored in the work area of the RAM.

  In the standby mode, a trigger signal is generated when all of the conditions 1 to 5 (FIGS. 11 and 12) are satisfied, and in response to the trigger signal, the trimming process is performed to cut out the recording data from the temporary storage data of the work area. To be executed. The recording period which is a cutting out period of the recording data by the trimming process is different from the recording period of the first embodiment. In the first embodiment, the recording period is set to a predetermined time before and after the generation time of the trimming signal as a reference time. On the other hand, in the present example, a period in which a state in which four or more trigger conditions of the five conditions are simultaneously satisfied, including the generation time of the trigger signal, is set as the recording period.

  The start point of the recording period is the closest point before the generation of the trigger signal among the points in time when the simultaneously established trigger conditions shift from less than four conditions to four or more conditions. On the other hand, the end point of the recording period is the closest time point after the generation of the trigger signal among the time points when the simultaneously established trigger conditions shift from four or more conditions to less than four conditions.

  In the operation period illustrated in FIG. 12, a period A in which all five conditions among the five trigger conditions are satisfied, and a period α in which four or more conditions and less than five conditions are satisfied are set as the recording periods. Then, when the end of the recording period is reached and the recording period is determined, that is, when the trigger condition being simultaneously established shifts from four conditions or more to less than four conditions for the first time after generation of the trigger signal, The trimming process of cutting out the recording data from the temporary storage data is executed, and the recording data is automatically recorded in the flash ROM 102.

  According to the traveling state reproduction system configured as described above, abnormal noise and the like can be recorded without missing when a preset trigger condition is satisfied. For example, according to the contents of consultation of the vehicle user regarding abnormal noise, a mechanic or the like may predict the occurrence cause or the like of the abnormal noise, and the trigger condition may be set based on the prediction.

  However, a trigger condition set based on, for example, prediction or experience of a mechanic or the like is not necessarily correct. Therefore, in the traveling state reproduction system of this embodiment, the above period α is set for the purpose of including the traveling period of the recording data even in the traveling state where some of the trigger conditions are not satisfied. By setting the period α corresponding to the traveling state in which some trigger conditions are out, it is possible to reduce the dropout of vehicle data useful for identifying the cause of abnormal noise and the like. In this example, four periods corresponding to (total number of conditions−1) are established as the period α, and a period in which one trigger condition is out is illustrated. (Total number of conditions-2) may be set as the reference of the period α, and the period α in which one or two trigger conditions are out may be adopted. Thus, the reference of the period α can be changed as appropriate.

It is also possible to set the trigger condition not only for the trigger condition for vehicle data but also for the sound generated from the vehicle in motion. For example, a threshold may be set for the frequency, wavelength, volume, etc. of the sound, and exceeding the threshold may be set as the trigger condition.
The other configurations and operational effects are the same as in the first embodiment.

(Example 3)
In this example, based on the traveling state reproduction system 1 according to the first embodiment or the second embodiment, an example in which a server device 21 managing recording data and a terminal device 22 for browsing recording data managed by the server device 21 are added. It is. The contents will be described with reference to FIG.

  The traveling state reproduction system 1 of this example is a system configured using a public communication line such as the Internet as shown in FIG. In the running state reproduction system 1, the smartphone 10 for acquiring the recording data, the server device 21 as an upload (transmission) destination of the recording data, the terminal device 22 for reproducing the recording data distributed from the server device 21, etc. It is configured.

  First, based on the smartphone 10 of the first or second embodiment, the smartphone 10 of the present embodiment adds a function of associating a specific terminal device 22 by application setting, a function of automatically uploading recording data to the server device 21, etc. ing. In the application setting, a terminal ID which is an identification number of a specific terminal device 22 can be set. For example, when lending out the smartphone 10 in the service department of the vehicle dealer, it is preferable to set the terminal ID of the terminal device 22 installed in the department or the like to the smartphone 10 for lending.

  When the smartphone 10 in the traveling state reproduction system 1 acquires the recording data, the smartphone 10 automatically uploads the recording data to the server device 21. At that time, the smartphone 10 associates the terminal ID set in advance in the application setting with the recording data. Therefore, on the server device 21 side, when the recording data is received from the smartphone 10, the lending source terminal device 22 of the smartphone 10 can be specified by referring to the linked terminal ID.

  The server device 21 converts the recording data received from the smartphone 10 into a database and manages the database, and distributes the recording data to the terminal device 22 specified as described above. For example, in the service department of the vehicle dealer, the recorded data recorded by the lent smartphone 10 can be acquired at near real time timing and can be browsed by the terminal device 22.

  In addition to the above-described terminal ID, for example, it is also possible to set the identification ID of the service representative by application setting. In this case, the terminal device 22 that has received the distribution of the recording data or the server device 21 that has received the uploading of the recording data can call the service representative by a notification e-mail or the like.

With the driving state reproduction system configured as described above, for example, it becomes easy to check recorded data in the service department or the like of a vehicle dealer, and it becomes possible to implement measures against abnormal noise quickly. Since the service department side can quickly confirm whether or not recording data such as abnormal noise can be acquired, the lending period of the smartphone 10 or the like can be shortened, and efficiency can be improved.
The other configurations and operational effects are the same as in the first or second embodiment.

(Example 4)
The present example is an example in which the configuration of the server apparatus is changed based on the traveling state reproduction system 1 of the third embodiment. The contents will be described with reference to FIGS. 14 and 15.
In the database provided in the server apparatus 21 (FIG. 13) of this example, the traveling state types are classified according to the numerical range to which the vehicle data such as the vehicle speed and engine speed belong and are classified and recorded for each traveling state type. Data is stored (stored). Further, each record data stored in the database is associated with finding information such as the location of the abnormal noise (position of the sound source) and the cause.

  When the smartphone 10 uploads the recorded data, the server device 21 refers to the vehicle data included in the received new recorded data (referred to as unclassified data) as shown in FIG. Identify the state type (classification process). Also, analysis processing is performed on sound data included in the unclassified data to generate analysis results such as frequency and sound pressure level (analysis processing). Then, the server device 21 analyzes the result (frequency, sound pressure level, etc.) of the sound data from among the past recorded data (called stored data) stored in the traveling state type to which the unclassified data is classified. Search for stored data with the highest degree of similarity (search processing, data search unit).

  In the running state reproduction system 1 of the present example, the finding information linked to the stored data retrieved in this way is treated as a diagnosis result representing the location and cause of abnormal noise related to unclassified data (diagnosis (diagnosis) Department). Then, when storing the unclassified data in the database as shown in FIG. 15, the server device 21 links the finding information based on the diagnosis result to the unclassified data. If data such as abnormal noise itself and vehicle conditions at the time of abnormal noise are made into a database and accumulated in large quantities, it can be a useful information source at the time of vehicle repair or inspection at a vehicle dealer. Furthermore, such a database can be a very useful source of information at the time of design changes such as minor changes at vehicle manufacturers.

  When the recording data is received from the smartphone 10, the server device 21 may be configured to return a diagnosis result. In this case, the processing on the smartphone 10 enables tying of the diagnosis result to the recorded data. For example, even if a vehicle dealer or the like who has not introduced the terminal device 22 for browsing the recorded data, browsing of the diagnosis result becomes possible when the recorded data is reproduced by the returned smartphone 10.

  In addition, about classification processing of a run state classification about record data, search processing of record data to approximate, analysis processing of sound data, etc., it is good to raise accuracy by machine learning etc. by artificial intelligence. Furthermore, it is also possible to apply artificial intelligence approaches such as machine learning to the recorded data etc. stored in the database to learn the location and cause of abnormal noise. If this learning result is used, failure diagnosis based on the type of abnormal noise, vehicle data at the time of abnormal noise occurrence, etc. becomes possible.

  For example, when the smartphone 10 accesses a site provided by the server device 21, the server device 21 executes the above-mentioned artificial intelligence arithmetic processing on the recorded data stored in the smartphone 10, and the generation location and cause of abnormal noise It is also good to diagnose. In this case, it is possible to display on the display screen 100 of the smartphone 10 the location, the cause and the like of the abnormal noise.

It is also possible to search a plurality of stored data having a high degree of approximation of the result of the analysis process relating to sound data by the above search process, and generate a diagnosis result based on a plurality of pieces of finding information linked to these. For example, it is also possible to classify occurrence locations and causes of abnormal noise in a plurality of pieces of finding information, and to count frequencies for each classification. As the diagnosis result of the unclassified data, it is also preferable to adopt the occurrence place where the frequency is the highest.
The other configurations and operational effects are the same as in the third embodiment.

  Although the specific examples of the present invention have been described in detail as in the examples, the specific examples only disclose an example of the technology included in the claims. It goes without saying that the scope of the claims should not be interpreted limitedly by the configuration, numerical values and the like of the specific example. The claims encompass variously modified, changed or appropriately combined techniques using the known techniques and the knowledge of those skilled in the art.

DESCRIPTION OF SYMBOLS 1 driving state reproduction system 10 smart phone 100 display screen 101 microcomputer 122 liquid crystal display 123 camera 124 speaker 125 microphone 19 communication adapter (network apparatus)
21 server device 22 terminal device 5 vehicle 51 ECU
52 Central GW
53 OBD connector

Claims (7)

A vehicle data acquisition unit that acquires vehicle data representing a traveling state of the vehicle;
A sound collection unit that collects sound generated while the vehicle is traveling with a microphone to generate sound data;
A recording unit that records recording data including sound data generated by the sound collection unit and vehicle data acquired by the vehicle data acquisition unit;
A reproduction unit capable of reproducing sound data included in the recording data in synchronization with the vehicle data;
A trigger condition setting unit capable of setting a plurality of trigger conditions with respect to the sound data or the vehicle data;
And a trigger signal generation unit that generates a trigger signal that triggers recording of the sound data and the vehicle data in response to the establishment of all types of trigger conditions among the plurality of types of trigger conditions.
The recording unit, the over the past predetermined period regardless of the presence or absence of the trigger signal, temporarily records the temporary storage data and a said sound data the vehicle data,
When the trigger signal is generated, generation of the trigger signal occurs at a point when transitioning from a state where the number of satisfaction of the trigger condition is less than a predetermined number less than all types to a state where the predetermined number of trigger conditions is satisfied A driving state reproduction system that executes processing of cutting out recording data with the point immediately before the point as the beginning of the recording period.   The recording unit according to claim 1, wherein the recording unit performs the period A in which all types of the trigger conditions are satisfied, and the period α in which the number of occurrences of the trigger conditions is equal to or more than the predetermined number and less than the number of all types A driving condition reproduction system set in the recording period of recording data. A server device and a plurality of terminal devices connected to a communication line according to claim 1 or 2,
A terminal ID for uniquely identifying any one of the plurality of terminal devices can be set as data to be associated with the recording data recorded by the recording unit,
The recording data recorded by the recording unit is transmitted to the server apparatus via a communication line in a state where the set terminal ID is linked.
The traveling state reproduction system according to claim 1, wherein the server device distributes the recording data to a terminal device related to the terminal ID among the plurality of terminal devices when acquiring the recording data to which the terminal ID is linked. In Claim 3, in addition to the terminal ID, any one of a plurality of persons using a terminal device related to the terminal ID is uniquely identified as data to be linked to the recording data recorded by the recording unit. It is possible to set the identification ID to identify,
The driving | running | working state reproduction system which transmits the notification mail addressed to the person who concerns on the said identification ID, when the said server apparatus or the said terminal device acquires the recording data with which the said identification ID was associated.   The vehicle data acquisition unit according to any one of claims 1 to 4, wherein the vehicle data acquisition unit is connected to a communication network for controlling the vehicle, and acquires vehicle data used for controlling the vehicle via the communication network. Driving condition reproduction system including the device. In any one of claims 1 to 5, a sound collection condition setting unit for setting a sound collection condition including an installation position of the microphone and an orientation of directivity, and a position of a listener who listens to a reproduction sound by the reproduction unit. And a listening condition setting unit for setting a listening condition including the direction of the head;
The recording unit records sound data so that the position and the direction of the sound source can be identified based on the installation position of the microphone and the direction of the directivity.
The traveling state reproduction system according to claim 1, wherein the reproduction unit reproduces the sound data according to the sound collection condition and the listening condition so that the original position and orientation of the sound source can be reproduced regardless of the position and head direction of the listener.   The database according to any one of claims 1 to 6, wherein finding information including at least one of a sound generation point and a cause is linked to store a recording data, and new recording data is generated. A data search unit that searches past record data that approximates with reference to a database, and sound information related to the new record data based on finding information linked to the past record data searched by the data search unit And a diagnostic unit that generates a diagnostic result including at least one of an occurrence place and a cause.