JP7447578B2 - Information processing device, information processing method and program - Google Patents

Description

The present invention relates to an information processing device, an information processing method, and a program.

Patent Document 1 discloses that while driving on a road, a thermal infrared camera 3 and a visible light camera 4 photograph the paved surface, a vibration sensor 5 detects vibrations of the vehicle according to the condition of the paved surface, and a running sound detection section 6 detects the sound generated as the vehicle runs, a water permeability detection unit 7 detects the water permeability of the pavement, and an IC tag communication unit 8 collects detection information from sensors placed in advance around the road. An inspection vehicle 1 is disclosed in which the shape of a paved surface is collected by a paved surface measuring section 9.

An object of the present invention is to provide an information processing device, an information processing method, and a program that can efficiently and accurately determine abnormalities in a target part.

The information processing device according to the present invention includes a detection information acquisition unit that acquires detection information of a physical quantity that changes when a moving body moves while contacting a target portion, and an image information acquisition unit that acquires image information of the target portion. an acquisition unit, model information indicating normal data or abnormal data, possibility information indicating a possibility of abnormality in the target portion determined based on the detection information, the image information , and a moving distance or movement of the moving body. A plurality of pieces of movement information indicating time are displayed on the display unit, and possibility information of each of the plurality of pieces of possibility information and the plurality of images are displayed in association with each piece of movement information of the plurality of pieces of movement information. a display control unit that displays image information of each piece of information on the display unit; a reception unit that receives an input of the part of the movement information in the plurality of pieces of movement information; and the part of the movement information that is received by the reception unit. and a storage control unit that stores and updates the model information based on the detection information associated with the movement information .

According to the present invention, it is possible to provide an information processing device, an information processing method, and a program that can efficiently and accurately determine abnormalities in a target portion.

1 is a diagram showing an example of a system configuration of an abnormality detection system according to an embodiment of the present invention. FIG. 1 is a diagram showing a vehicle according to the present embodiment. FIG. 1 is a diagram illustrating an example of a hardware configuration of an information processing device. 1 is a diagram illustrating an example of a hardware configuration of a vehicle control device. FIG. 1 is a diagram showing an example of a functional configuration of an abnormality detection system according to the present embodiment. FIG. 3 is a diagram illustrating an example of a detailed functional configuration of a signal processing section according to the present embodiment. It is a sequence diagram which shows an example of the storage process of the detection signal in the abnormality detection system based on this embodiment. FIG. 2 is a conceptual diagram showing an example of a condition information management table according to the present embodiment. 5 is a flowchart illustrating an example of signal processing for a detection signal in the information processing apparatus according to the present embodiment. (a) is a diagram showing an example of a spectrogram of a detection signal during normal operation, and (b) is a diagram showing an example of a spectrogram of a detection signal when an abnormality occurs. FIG. 3 is a conceptual diagram showing an example of a detection signal management table according to the present embodiment. 7 is a flowchart illustrating an example of processing for image information in the information processing apparatus according to the present embodiment. FIG. 3 is a conceptual diagram showing an example of an image information management table according to the present embodiment. 7 is a flowchart illustrating an example of score display processing and model information storage processing in the information processing apparatus according to the present embodiment. FIG. 3 is a diagram showing an example of an output signal selection screen displayed on the information processing device according to the present embodiment. 7 is a flowchart illustrating an example of display selection processing in the information processing apparatus according to the present embodiment. FIG. 3 is a diagram illustrating an example of a display selection screen displayed on the information processing device according to the present embodiment. FIG. 3 is a diagram showing an example of image information displayed on a display selection screen according to the present embodiment. FIG. 3 is a conceptual diagram showing an example of a model information management table according to the present embodiment. It is a figure which shows an example of the display selection screen displayed on the information processing apparatus based on the 1st modification of this embodiment. FIG. 7 is a diagram illustrating an example of image information displayed on a display selection screen according to a first modification. It is a figure which shows an example of the display selection screen displayed on the information processing apparatus based on the 2nd modification of this embodiment. It is a figure showing the railroad vehicle concerning the 3rd modification of this embodiment. FIG. 7 is a conceptual diagram showing an example of a condition information management table according to a third modification. It is a figure showing an example of a display selection screen displayed on an information processing device concerning a 3rd modification. It is a figure showing the railroad vehicle concerning the 4th modification of this embodiment. It is a conceptual diagram which shows an example of the condition information management table based on the 4th modification. It is a figure showing an example of a display selection screen displayed on an information processing device concerning a 4th modification.

Hereinafter, embodiments for carrying out the invention will be described with reference to the drawings. In addition, in the description of the drawings, the same elements are given the same reference numerals, and overlapping description will be omitted.

●System Configuration FIG. 1 is a diagram showing an example of the system configuration of an abnormality detection system according to an embodiment of the present invention.

The abnormality detection system 1A according to this embodiment includes a vehicle 70 and an information processing system 5. The information processing system 5 includes a detection device 30, an imaging device 40, and an information processing device 10.

The vehicle 70 is an example of a moving body that moves while contacting a target portion such as a road surface. The detection device 30 detects a physical quantity that changes as the vehicle 70 moves while contacting the road surface. The imaging device 40 is an example of an imaging unit that captures a moving image or a still image of a target portion such as a road surface.

The abnormality detection system 1A may include a plurality of vehicles 70, a plurality of detection devices 30 corresponding to the plurality of vehicles 70, and a plurality of imaging devices 40.

The information processing device 10 is a diagnostic device that is communicably connected to the vehicle 70 and diagnoses abnormalities in a target portion such as a road surface. The information processing device 10 may be a general-purpose PC (Personal Computer) in which a dedicated software program is installed. Further, the information processing device 10 may be configured by a single computer or may be configured by a plurality of computers.

The information processing device 10 and the vehicle 70 may be connected in any connection form. For example, the information processing device 10 and the vehicle 70 may be connected by a dedicated connection line, a wired network such as a wired LAN (Local Area Network), or a wireless network.

The detection device 30 detects a physical quantity such as vibration or sound emitted when tires installed on the vehicle 70 come into contact with a road surface or the like while the vehicle 70 is moving, and converts information about the detected physical quantity into a detection signal (sensor data). This is a sensor that outputs data to the information processing device 10. The detection device 30 is configured with, for example, a microphone, a vibration sensor, an acceleration sensor, an AE sensor, or the like, and detects, for example, a change in a physical quantity such as vibration or sound.

These detection means are installed near the tire. The installation method includes fixing with screws, fixing with magnets, bonding with adhesive, or installing by drilling holes and embedding them there. Note that the number of detection devices 30 may be arbitrary. Further, a plurality of detection devices 30 that detect the same physical quantity may be provided, or a plurality of detection devices 30 that detect mutually different physical quantities may be provided.

Here, between the information processing device 10 and the detection device 30, several types of filters for filtering the output signal from the detection device 30, or filter selection means for selecting a filter may be provided as necessary.

FIG. 2 is a diagram showing a vehicle according to this embodiment. The vehicle 70 includes a control device 70A, tires 50, and a detection device 30. The vehicle 70 also includes a first imaging device 40A arranged to take an image of the road surface R on the side in the traveling direction of the vehicle 70, and a first imaging device 40A arranged so as to take an image of the road surface R behind the vehicle 70 from the vertical direction. 2 imaging devices 40B. The tire 50 is an example of a moving member that moves while contacting a target portion such as a road surface R.

The detection device 30 may be provided in the vehicle 70 in advance, or may be attached to the vehicle 70 later.

●Hardware Configuration Next, the hardware configuration of the information processing device 10 and the vehicle 70 in this embodiment will be explained using FIGS. 3 and 4. Note that the hardware configurations shown in FIGS. 3 and 4 may have the same configuration in each embodiment, and components may be added or deleted as necessary.

Hardware Configuration of Information Processing Apparatus FIG. 3 is a diagram illustrating an example of the hardware configuration of the information processing apparatus according to the present embodiment.

The information processing device 10 is constructed by a computer, and as shown in FIG. 4 , an HDD (Hard Disk Drive) controller 105, a display I/F 106, and a communication I/F 107.

Among these, the CPU 101 controls the overall operation of the information processing device 10 . The ROM 102 stores programs used to drive the CPU 101, such as IPL (Initial Program Loader). RAM 103 is used as a work area for CPU 101. The HD 104 stores various data such as programs. The HDD controller 105 controls reading and writing of various data to the HD 104 under the control of the CPU 101. The display I/F 106 is a circuit that displays images on the display 106a. The display 106a is a type of display section such as a liquid crystal or organic EL display that displays an image of a subject, various icons, and the like. Communication I/F 107 is an interface used for communication with external devices such as vehicle 70. The communication I/F 107 is, for example, a NIC (Network Interface Card) compatible with TCP (Transmission Control Protocol)/IP (Internet Protocol).

The information processing device 10 also includes a sensor I/F 108, a sound input/output I/F 109, an input I/F 110, a media I/F 111, and a DVD-RW (Digital Versatile Disk Rewritable) drive 112.

The sensor I/F 108 is an interface that receives a detection signal via the sensor amplifier 302 included in the detection device 30. The sound input/output I/F 109 is a circuit that processes input/output of sound signals between the speaker 109a and the microphone 109b under the control of the CPU 101. The input I/F 110 is an interface for connecting a predetermined input means to the information processing device 10. . The keyboard 110a is a type of input means that includes a plurality of keys for inputting characters, numbers, various instructions, and the like. The mouse 110b is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. A touch panel or the like may be used as an input means instead of the keyboard 708a and mouse 708b. The media I/F 111 controls reading or writing (storage) of data to a recording medium 111a such as a flash memory. The DVD-RW drive 112 controls reading and writing of various data to and from a DVD-RW 112a, which is an example of a removable recording medium. Note that it is not limited to DVD-RW, but may be DVD-R or the like. Further, the DVD-RW drive 112 may be a Blu-ray drive that controls reading and writing of various data on a Blu-ray disc.

The information processing device 10 also includes a bus line 113. The bus line 113 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 101.

Note that recording media such as HDs and CD-ROMs in which the above programs are stored can be provided domestically or internationally as program products.

Vehicle Hardware Configuration FIG. 4 is a diagram showing an example of the hardware configuration of the vehicle control device according to the present embodiment.

As shown in FIG. 4, the control device 70A includes a CPU 701, a ROM 702, a RAM 703, a display I/F 704, a communication I/F 705, a drive circuit 706, a sound output I/F 707, an input I/F 708, and a sensor I/F 709. ing.

Among these, the CPU 701 controls the entire operation of the control device 70A. The ROM 702 stores programs used to drive the CPU 701 such as IPL. RAM 703 is used as a work area for CPU 701. The display I/F 704 is a circuit that displays an image on the display 704a. The display 704a is a type of display unit such as a liquid crystal or organic EL display that displays an image of a subject, various icons, and the like.

The communication I/F 705 is an interface used for communication with an external device such as the information processing device 10. The communication I/F 705 is, for example, a NIC compatible with TCP/IP.

The drive circuit 706 is a circuit that controls the drive of the motor 706a. Motor 706a drives tire 50.

The sound output I/F 707 is a circuit that processes the output of sound signals between the speaker 707a and the microphone 707b under the control of the CPU 701. The input I/F 708 is an interface for connecting a predetermined input means to the control device 70A. The keyboard 708a is a type of input means that includes a plurality of keys for inputting characters, numerical values, various instructions, and the like. The mouse 708b is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. A touch panel or the like may be used as an input means instead of the keyboard 708a and mouse 708b.

The control device 70A also includes a bus line 710. The bus line 710 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 701.

Furthermore, the detection device 30 includes a sensor 301 and a sensor amplifier 302, and detects physical quantities such as vibration or sound that change as the vehicle 70 moves while contacting the road surface R. As described above, the sensor 301 detects a physical quantity such as vibration or sound generated when the tires 50 of the vehicle 70 and the road surface R come into contact with each other while the vehicle 70 is moving. The sensor 301 also acquires a detection signal (sensor data) based on information on the detected physical quantity. The sensor 301 is, for example, a microphone, a vibration sensor, an acceleration sensor, an AE sensor, or the like. The sensor amplifier 302 adjusts the detection sensitivity of the sensor 301 and outputs a detection signal detected by the sensor 301.

●Functional Configuration FIG. 5 is a diagram showing an example of the functional configuration of the abnormality detection system according to this embodiment.

〇Functional configuration of information processing device〇 First, the functional configuration of the information processing device 10 will be explained. The functions realized by the information processing device 10 include a transmitting/receiving section 11, a detection device communication section 12, a reception section 13, a display control section 14, a sound control section 15, a generation section 16, a signal processing section 17, a selection section 18, and a judgment section. 21, a storage/readout section 19, an imaging device control section 41, and a storage section 1000.

The transmitting/receiving unit 11 has a function of transmitting and receiving various data (or information) to and from an external device such as the vehicle 70. The transmitter/receiver 11 receives, for example, processing information (driving information) related to the current operation of the vehicle 70. The transmitting/receiving unit 11 is mainly realized by the communication I/F 107 shown in FIG. 3, a program executed by the CPU 101, and the like. The transmitting/receiving unit 11 is an example of a processing information acquisition unit.

The detection device communication unit 12 has a function of performing data communication with the detection device 30. The detection device communication unit 12 receives, for example, a detection signal (sensor data) related to a physical quantity detected by the detection device 30. The detection device communication unit 12 is mainly realized by a program executed by the CPU 101 shown in FIG. 3. The detection device communication unit 12 is an example of a detection information acquisition unit that acquires detection information. Further, the detection signal received by the detection device communication unit 12 is an example of detection information related to a physical quantity that changes as the vehicle 70 moves while contacting the road surface R.

The receiving unit 13 has a function of receiving user input through input means such as the keyboard 110a shown in FIG. 3. For example, the receiving unit 13 receives selection of an output item in response to an input on the output signal selection screen 200 (see FIG. 15). The reception unit 13 is mainly realized by a program executed by the CPU 101 shown in FIG. 3.

The display control unit 14 has a function of displaying various screens on the display 106a shown in FIG. 3. For example, the display control unit 14 causes the display 106a to display an output signal selection screen 200 (see FIG. 15). Specifically, the display control unit 14, for example, starts and executes a software application that runs on the OS, thereby at least including HTML (HyperText Markup Language), CSS (Cascading Style Sheets), or JAVA SCRIPT (registered trademark). ), etc. Download the WebAPP (Web Application) including Then, the display control unit 14 displays various image data generated by the Web APP on the display 106a. The display control unit 14 is configured to display HTML including data in, for example, XML (Extensible Markup Language), JSON (JavaScript Object Notation), or SOAP (Simple Object Access Protocol) format. 5 is displayed on the display 106a. The display control unit 14 is mainly realized by the display I/F 106 shown in FIG. 3, a program executed by the CPU 101, and the like.

The sound control section 15 has a function of outputting a sound signal from the speaker 109a shown in FIG. 3. The sound control unit 15 sets a detection signal to be output from the speaker 109a, and causes the set detection signal to be acoustically output from the speaker 109a. The sound control unit 15 is mainly realized by the sound input/output I/F 109 shown in FIG. 3, a program executed by the CPU 101, and the like.

The generation unit 16 has a function of generating various image data to be displayed on the display 106a. The generation unit 16 generates, for example, image data related to the output signal selection screen 200 (see FIG. 15) to be displayed on the display 106a. For example, the generation unit 16 renders the data stored in the storage unit 1000 and generates image data for displaying the rendered data. Rendering is a process of interpreting data written in a language for web page description (HTML, CSS, XML, etc.) and calculating the arrangement of characters, image data, etc. that are actually displayed on the screen. Further, when the processing information is received by the transmitting/receiving section 11, the generating section 16 generates a condition ID for identifying condition information including the received processing information. The generation unit 16 is mainly realized by a program executed by the CPU 101 shown in FIG. 3.

The signal processing unit 17 has a function of performing signal processing on the detection signal received by the detection device communication unit 12. A detailed explanation of the signal processing section 17 will be given later. The signal processing unit 17 is mainly realized by a program executed by the CPU 101 shown in FIG. 3.

The selection unit 18 has a function of selecting a detection signal to be outputted as a sound based on a signal output request from a user. The selection unit 18 selects, for example, a detection signal stored in association with condition information corresponding to output item data included in the signal output request received by the reception unit 13. The selection unit 18 is mainly realized by a program executed by the CPU 101 shown in FIG. 3.

The judgment unit 21 is mainly realized by the processing of the CPU 101 shown in FIG. 3, and has a function of making various judgments. The determining unit 21 calculates, for example, a difference between signal data related to the plurality of detection signals selected by the selecting unit 18. The determining unit 21 is an example of an abnormality determining unit.

The imaging device control unit 41 has a function of communicating control signals and image data with the imaging devices 40 including the first imaging device 40A and the second imaging device 40B. For example, the imaging device control unit 41 transmits an imaging start signal to the imaging device 40. Further, the imaging device control unit 41 is an example of an image information acquisition unit that acquires image information of the road surface R, and receives, for example, image information of a moving image or a still image of the road surface R captured by the imaging device 40. The imaging device control unit 41 is mainly realized by a program or the like executed by the CPU 101 shown in FIG. 3.

The storage/reading unit 19 has a function of storing various data in the storage unit 1000 or reading various data from the storage unit 1000. The storage/reading unit 19 is mainly realized by a program or the like executed by the CPU 101 shown in FIG. The storage unit 1000 is mainly realized by the ROM 102, HD 104, and recording medium 111a shown in FIG.

Furthermore, in the storage unit 1000, a condition information management DB 1001, a detection signal management DB 1003, a model information management DB 1005, and an image information management DB 1007 are constructed. Among these, the condition information management DB 1001 is composed of a condition information management table, which will be described later. The detection signal management DB 1003 is composed of a detection signal management table, which will be described later. The model information management DB 1005 is composed of a model information management table, which will be described later. The image information management DB 1007 is composed of an image information management table, which will be described later. The storage/readout section 19 is an example of a storage control section.

〇Functional configuration of the detection device〇 Next, the functional configuration of the detection device 30 will be explained. The functions realized by the detection device 30 include a device connection section 31 and a detection signal acquisition section 32.

The device connection unit 31 has a function of transmitting the detection signal acquired by the detection signal acquisition unit 32 to the information processing device 10. The device connection section 31 is mainly realized by the sensor amplifier 302 shown in FIG.

The detection signal acquisition unit 32 has a function of detecting a physical quantity such as vibration or sound that changes as the vehicle 70 moves while contacting the road surface R, and acquiring information on the physical quantity as a detection signal. The detection signal acquisition unit 32 is mainly realized by the sensor 301 shown in FIG. The detection signal acquisition unit 32 detects vibrations or sounds generated when the tires 50 of the vehicle 70 and the road surface R come into contact with each other while the vehicle 70 is moving, and acquires information on the detected physical quantity as detection information (sensor data). do. For example, when cracks or the like occur in the road surface R, the sound generated when the tires 50 and the road surface R come into contact changes. Therefore, the detection signal acquisition unit 32 detects acoustic data using a sensor 301 such as a microphone, and transmits a detection signal related to the detected acoustic data to the information processing device 10 via the device connection unit 31. The detection signal acquisition unit 32 is mainly realized by the sensor 301 shown in FIG.

〇Functional configuration of vehicle〇 Next, the functions realized by the control device 70A of the vehicle 70 are a transmitting/receiving section 71, a main control section 72, a drive control section 73, a driving section 74, a setting section 75, a reception section 76, and a display control section. section 77 and sound control section 78.

The transmitting/receiving unit 71 has a function of transmitting and receiving various data (or information) with an external device such as the information processing device 10. The transmitting/receiving unit 71 transmits processing information related to the current operation of the vehicle 70 to the information processing device 10. The transmitting/receiving unit 71 is mainly realized by the communication I/F 705 shown in FIG. 4, a program executed by the CPU 701, and the like.

The main control section 72 generates and outputs control data for controlling the operation of the drive section 74. Further, the main control unit 72 outputs processing information related to the operation of the vehicle 70 to the transmitting/receiving unit 71. The main control unit 72, for example, sequentially transmits information corresponding to the current operation of the vehicle 70 to the information processing device 10 via the transmitting/receiving unit 71. When the vehicle 70 travels, the main control unit 72 appropriately changes the type of drive unit 74 to be driven or the drive state (rotation number, rotation speed, etc.) of the drive unit 74. Each time the main control unit 72 changes the type of operation, it sequentially transmits information corresponding to the changed type of operation to the information processing device 10 via the transmitting/receiving unit 71. The main control unit 72 is mainly realized by a program or the like executed by the CPU 701 shown in FIG.

The drive control section 73 has a function of controlling the drive section 74 based on the control data obtained by the main control section 72. The drive control section 73 is realized, for example, by a drive circuit 706 shown in FIG. 4. The drive control unit 73 is mainly realized by the drive circuit 706 shown in FIG. 4, a program executed by the CPU 701, and the like.

The drive unit 74 is a function that is subject to drive control by the drive control unit 73. The drive unit 74 drives the tire 50 under the control of the drive control unit 73. The drive unit 74 is an actuator whose drive is controlled by the drive control unit 73, and is mainly realized by a motor 706a shown in FIG. 4 or the like. Note that the drive unit 74 may be any actuator that is used for driving the vehicle 70 and is subject to control. Further, two or more driving units 74 may be provided.

The setting unit 75 has a function of setting condition information corresponding to the current operation of the vehicle 70. The setting unit 75 is mainly realized by a program executed by the CPU 701 shown in FIG. 4.

The receiving unit 76 has a function of receiving user input through input means such as the keyboard 708a shown in FIG. 4. For example, the receiving unit 76 receives selection of an output item in response to an input on the output signal selection screen 200 (see FIG. 15) displayed on the display 704a. The receiving unit 76 is mainly realized by the input I/F 708 shown in FIG. 4, a program executed by the CPU 701, and the like.

The display control unit 77 has a function of displaying various screen information on the display 704a shown in FIG. 4. The display control unit 77 displays, for example, the output signal selection screen 200 (see FIG. 15) on the display 704a. The display control unit 77 is mainly realized by the display I/F 704 shown in FIG. 4, a program executed by the CPU 701, and the like.

The sound control unit 78 is realized by instructions from the CPU 701 shown in FIG. 4, and has a function of outputting a sound signal from the speaker 707a. The sound control unit 78 sets a detection signal to be output from the speaker 707a, and causes the set detection signal to be acoustically output from the speaker 707a. The sound control unit 78 is mainly realized by the sound output I/F 707 shown in FIG. 4, a program executed by the CPU 701, and the like.

FIG. 6 is a diagram showing an example of a detailed functional configuration of the signal processing section according to the present embodiment. The signal processing section 17 shown in FIG. 6 includes an amplification processing section 171, an A/D conversion section 172, a feature amount extraction section 173, a D/A conversion section 174, and a score calculation section 175.

The amplification processing section 171 has a function of performing amplification processing on the detection signal received by the detection device communication section 12. The amplification processing unit 171, for example, amplifies the analog signal received by the detection device communication unit 12 to an arbitrary size. Further, the amplification processing section 171 amplifies, for example, the digital signal converted by the A/D conversion section 172 to an arbitrary size.

The A/D conversion section 172 has a function of converting the analog signal amplified by the amplification processing section 171 into a digital signal.

The feature amount extracting unit 173 has a function of extracting a feature amount (feature information) indicating the characteristics of the detection signal received by the detection device communication unit 12. The feature amount may be any information as long as it indicates the feature of the detection signal. For example, when the detection signal is acoustic data, the feature extraction unit 173 may extract energy, frequency spectrum, time, MFCC (Mel frequency cepstral coefficient), etc. as the feature.

The D/A converter 174 has a function of converting the digital signal amplified by the amplification processor 171 into an analog signal.

The score calculation unit 175 calculates a score as an example of possibility information indicating the possibility of an abnormality in the road surface R from the feature amount (for example, frequency spectrum) of the detection signal extracted by the feature amount extraction unit 173. The score calculation unit 175 is an example of a possibility information determination unit that determines possibility information indicating the possibility of an abnormality in the road surface R.

〇Storage Processing of Detection Signals〇 FIG. 7 is a sequence diagram showing an example of storage processing of detection signals in the abnormality detection system according to the present embodiment.

In step S11, the transmitting/receiving unit 71 of the control device 70A transmits processing information regarding the current operation of the vehicle 70 to the information processing device 10 that constitutes the information processing system 5. Specifically, the setting unit 75 of the control device 70A sets processing information indicating specific travel details when the vehicle 70 starts traveling. The processing information is information determined for each type of operation of the vehicle 70, as described above. Then, the transmitting/receiving unit 71 transmits the processing information set by the setting unit 75 to the information processing device 10. Thereby, the transmitting/receiving unit 11 of the information processing device 10 receives the processing information transmitted from the control device 70A (an example of a processing information acquisition step).

In step S12, the generating unit 16 of the information processing device 10 generates a condition ID for identifying condition information including the processing information received by the transmitting/receiving unit 11.

Then, in step S13, the storage/reading unit 19 stores and manages the condition ID generated by the generation unit 16 and the condition information associated with the processing information received by the transmission/reception unit 11 in the condition information management DB 1001. (An example of a memory control step). At this time, the storage/reading unit 19 also stores and manages a related ID assigned to processing information indicating a related process in the condition information management DB 1001. The condition information management DB 1001 stores and manages processing information indicating the details of specific driving processing executed by the vehicle 70 in association with each condition ID in a condition information management table.

In step S14, the detection signal acquisition unit 32 of the detection device 30 constituting the information processing system 5 detects a physical quantity such as vibration or sound generated by the travel of the vehicle 70. Here, the detection signal acquisition unit 32 detects the sound generated by the running of the vehicle 70, and acquires a detection signal (acoustic signal) related to the detected sound.

In step S15, the device connection unit 31 of the detection device 30 transmits the detection signal acquired in step S14 to the information processing device 10. Thereby, the detection device communication unit 12 of the information processing device 10 receives the detection signal transmitted from the detection device 30 (an example of a detection information acquisition step).

In step S16, the signal processing unit 17 of the information processing device 10 performs signal processing on the detection signal received by the detection device communication unit 12.

In step S17, the storage/reading unit 19 of the information processing device 10 stores the signal data processed by the signal processing unit 17 in the detection signal management DB 1003 in association with the processing information transmitted from the control device 70A ( (Example of memory control step). The information processing device 10 uses the travel time data included in the processing information received in step S11, the signal data related to the detection signal received in step S15, and the signal processing unit 17 for each condition ID generated in step S12. The processed signal data (frequency data, score data) and the processing information data included in the processing information received in step S11 are stored and managed in a detected signal management table in association with each other. The information processing device 10 may store and manage travel distance data instead of travel time data.

That is, the storage/reading unit 19 stores each feature amount (frequency data) of the plurality of feature amounts in the detection signal management DB 1003 in association with each processing information of the plurality of processing information transmitted from the control device 70A. let

Condition Information Management Table FIG. 8 is a conceptual diagram showing an example of the condition information management table according to this embodiment. In the storage unit 1000 shown in FIG. 5, the condition information management DB 1001 described in step S13 of FIG. 7 is configured by a condition information management table as shown in FIG.

The condition information management table shown in FIG. 8 is for managing processing information related to the operation of the vehicle 70 for each operation performed by the vehicle 70. The condition information management table stores and manages condition information in which processing information is associated with each condition ID. The condition ID is identification information for identifying condition information including processing information. The processing information is information determined for each type of operation of the vehicle 70. As shown in FIG. 8, the processing information includes information such as the name of the road on which the vehicle 70 travels, the type of pavement material of the road surface R on which the vehicle 70 travels, and the type of material of the tires 50 of the vehicle 70. The type of paving material of the road surface R is an example of the type of target part, and the type of material of the tire 50 is an example of the type of moving member.

The items included in the processing information further include information indicating the user's operation history information for the vehicle 70, the travel start date and time, the travel time (an example of the travel time of the vehicle 70), and the travel speed of the vehicle 70. Good too. Furthermore, the travel distance (an example of the travel distance of the vehicle 70) may be included, or the travel distance may be included instead of the travel time. Travel information including travel time or travel distance is an example of movement information.

The condition information management table further stores and manages associated IDs for identifying related operations (processes) among the operations performed by the vehicle 70. The same related ID is assigned to processing information indicating related processing among the processing information included in the condition information management table. In the example of FIG. 8, the same related ID "R001" is assigned to the processing information identified by the condition ID "A000001" and the condition ID "A00003." Here, the related process to which the related ID is assigned is, for example, a process in which the paving material and tire type are the same, but the road name is different.

Next, the processing of the detection signal by the signal processing section 17, which corresponds to step S16 in FIG. 7, will be explained using FIGS. 9 and 10.

FIG. 9 is a flowchart illustrating an example of signal processing for a detection signal in the information processing apparatus according to the present embodiment.

First, in step S151, when a detection signal is received (acquired) by the detection device communication unit 12, the information processing device 10 moves the process to step S152. On the other hand, the information processing device 10 repeats the process of step S151 until the detection device communication unit 12 receives (acquires) the detection signal.

In step S152, the amplification processing unit 171 of the signal processing unit 17 performs amplification processing on the detection signal received (acquired) by the detection device communication unit 12, and amplifies the detection signal to an arbitrary magnitude. In step S153, the A/D conversion section 172 of the signal processing section 17 converts the analog signal amplified by the amplification processing section 171 into a digital signal.

In step S154, the feature amount extraction section 173 of the signal processing section 17 performs a process of extracting feature amounts (feature information) indicating the characteristics of the digital signal converted by the A/D conversion section 172 (in the feature amount extraction step). One case). Specifically, the feature extraction unit 173 extracts the frequency spectrum included in the digital signal converted by the A/D conversion unit 172.

In step S155, the score calculation unit 175 of the signal processing unit 17 calculates a score indicating the possibility of an abnormality in the road surface R from the feature amount (for example, frequency spectrum) of the detection signal extracted by the feature amount extraction unit 173.

Specifically, the score calculation unit 175 calculates the likelihood indicating the likelihood that the feature information of the detection information is normal, based on the model of the feature information indicating normal data stored in the model information management DB 1005 of the storage unit 1000. It is calculated using information, and the reciprocal of the likelihood is calculated as a score.

The score calculation unit 175 may calculate the score by ranking it in stages, or may calculate it using binary values of 0 and 1. Further, the score calculation unit 175 may accumulate the calculated scores.

In addition, the score calculation unit 175 calculates the likelihood indicating the likelihood that the feature information of the detection information is abnormal as a score using the model information of the feature information indicating abnormal data stored in the model information management DB 1005. You may.

Here, the frequency components of the detection signal detected while the vehicle 70 is running, which corresponds to step S154 in FIG. 9, will be explained.

10(a) shows a spectrogram of a detection signal detected when the vehicle 70 runs on a normal road surface R, and FIG. 10(b) shows a spectrogram of a detection signal detected when the vehicle 70 runs on a road surface R where an abnormality This shows a spectrogram of the detection signal detected when driving on the road. As shown in FIG. 10(b), when an abnormality occurs on the road surface R, a frequency component appears around 30000 Hz.

In the score calculation step shown in step S155 of FIG. 9, for example, if the spectrogram shown in FIG. Depending on how much frequency components around 30,000 Hz are included, a score is calculated as a likelihood indicating the likelihood that the spectrogram of the detection signal is abnormal.

Detection Signal Management Table FIG. 11 is a conceptual diagram showing an example of the detection signal management table according to this embodiment. In the storage unit 1000, the detection signal management DB 1003 described in step S17 of FIG. 7 is configured by a detection signal management table as shown in FIG.

The detection signal management table shown in FIG. 11 is for managing the detection signals transmitted from the detection device 30 in association with the processing information transmitted from the control device 70A of the vehicle 70. The detection signal management table includes, for each condition ID, travel time data transmitted from the control device 70A, detection signals, frequency data extracted by the feature extraction unit 173, score data calculated by the score calculation unit 175, and control. Processing information data for each running time transmitted from the device 70A is stored and managed in association with each other. The condition ID is identification information for identifying condition information included in the condition information management table shown in FIG. 8. As a result, for each condition ID, signal data (detection signal) is stored in association with related data (processed signal data (frequency data, score data), running time data, and processed information data for each running time). . Instead of the travel time data and the processing information data for each travel time, the detection signal management table may store and manage travel distance data and processing information data for each travel distance.

FIG. 12 is a flowchart illustrating an example of processing for image information in the information processing apparatus according to the present embodiment.

The information processing device 10 includes an imaging device 40 that captures an image of the road surface R, but there is a problem in terms of efficiency when determining abnormalities in the road surface R based on image information.

That is, in order to determine abnormality based on image information, it is necessary to store a huge amount of image information including normal images, and image processing for determining abnormality takes an enormous amount of time.

On the other hand, if the frequency of imaging by the imaging device 40 is lowered in order to improve the efficiency of abnormality determination based on image information, there is a risk that images showing important abnormal conditions cannot be obtained, and the accuracy of abnormality determination decreases.

In view of the above problems, the present embodiment aims to provide an information processing device 10 that can efficiently and accurately determine abnormalities in the road surface R.

The imaging device control unit 41 of the information processing device 10 determines whether the score calculated by the score calculation unit 175 is greater than or equal to a threshold value (step S21).

If the imaging device control unit 41 determines in step S21 that it is equal to or greater than the threshold value, it transmits an imaging start signal to the imaging device 40 to start imaging (step S22, an example of an imaging control step). That is, the imaging device control unit 41 controls the imaging device 40 based on the score calculated based on the detection signal. On the other hand, if the imaging device control unit 41 determines in step S21 that it is less than the threshold, it ends the process.

Note that the information processing device 10 causes the imaging device 40 to start imaging at a timing independent of the score calculated by the score calculation unit 175, and the imaging device control unit 41 controls the imaging device 40 when the score calculated by the score calculation unit 175 is equal to or higher than the threshold value. , the timing of transmitting an imaging end signal to the imaging device 40 to end imaging may be delayed.

Following step S22, the imaging device control unit 41 acquires image data of a moving image or a still image captured by the imaging device 40 from the imaging device 40 (step S23, an example of an image information acquisition step).

The storage/reading unit 19 of the information processing device 10 associates the image data of the moving image or still image acquired by the imaging device control unit 41 with the processing information transmitted from the control device 70A of the vehicle 70, and stores the image data in the detection signal management DB 1003. (Step S24).

The information processing device 10 stores the image data of the moving image or still image in the image information management table in association with the travel time included in the processing information received in step S11 for each condition ID generated in step S12 shown in FIG. be stored and managed. The information processing device 10 may store and manage travel distance data instead of travel time data.

The score calculation unit 175 of the signal processing unit 17 of the information processing device 10 uses the image data of the moving image or still image acquired by the imaging device control unit 41 as an example of second possibility information indicating the possibility of an abnormality in the road surface R. A second score is calculated (step S25).

Specifically, the score calculation unit 175 calculates a likelihood indicating the likelihood that the image data is normal using model information indicating normal data stored in the model information management DB 1005 of the storage unit 1000. , the reciprocal of the likelihood is calculated as the second score.

The score calculation unit 175 may calculate the second score by ranking it in stages, or may calculate it using binary values of 0 and 1.

The score calculation unit 175 may also calculate a likelihood indicating the likelihood that the image data is abnormal as a second score using model information indicating abnormal data stored in the model information management DB 1005. good.

The determination unit 21 of the information processing device 10 determines whether the second score calculated by the score calculation unit 175 is equal to or greater than the threshold (step S26), and if determined to be equal to or greater than the threshold, determines that the road surface R is abnormal ( Step S27). That is, the determination unit 21 determines whether the road surface R is abnormal based on the score and a second score indicating the possibility of abnormality in the road surface R determined based on the image information.

When the information processing device 10 determines that the road surface R is abnormal, it outputs a display or sound warning using the display 106a, the speaker 109a, or the like.

As described above, the information processing device 10 includes the imaging device control unit 41 that acquires image information of the road surface R captured by the imaging device 40, and the imaging device control unit 41 controls the imaging device 40 based on the detection signal. control.

Thereby, the information processing device 10 can determine the timing for acquiring the image information of the road surface R based on the detection signal, and therefore can efficiently acquire the image information of the road surface R.

The imaging device control unit 41 controls the imaging device 40 based on a score indicating the possibility of an abnormality in the road surface R determined based on the detection signal.

Thereby, the information processing device 10 can efficiently acquire image information of the road surface R when there is a high possibility that the road surface R is abnormal based on the score.

The information processing device 10 includes a determination unit 21 that determines whether there is an abnormality in the road surface R based on the score and image information. Specifically, the determination unit 21 determines whether the road surface R is abnormal based on the score and a second score indicating the possibility of abnormality in the road surface R determined based on the image information.

As described above, the information processing device 10 can efficiently and accurately determine the abnormality of the road surface R.

FIG. 13 is a conceptual diagram showing an example of an image information management table according to this embodiment.

In the storage unit 1000, the image information management DB 1007 described with reference to FIG. 5 is configured by an image information management table as shown in FIG.

The image information management table shown in FIG. 13 is for managing image data of moving images or still images acquired by the imaging device control unit 41.

In the image information management table, travel time data and image data of moving images or still images transmitted from the control device 70A of the vehicle 70 are stored and managed in association with each other for each condition ID. The condition ID is identification information for identifying condition information included in the condition information management table shown in FIG. 8. The image information management table may store and manage travel distance data instead of travel time data.

Here, the detection signal management table shown in FIG. 11 contains signal data (detection signal), related data (processed signal data (frequency data, score data), travel time data, and travel time data for each condition ID. The condition ID stored and managed by the detection signal management table is the same as the condition ID stored and managed by the image information management table.

Therefore, the information processing device 10 combines the detection signal management table shown in FIG. 11 and the image information management table shown in FIG. signal) and related data (processed signal data (frequency data, score data), travel time data, and processing information data for each travel time) are stored in association with each other.

〇Signal data display processing and model information storage processing〇 FIG. 14 is a flowchart illustrating an example of score display processing and model information storage processing in the information processing apparatus according to the present embodiment.

In step S31, the display control unit 14 of the information processing device 10 displays the output signal selection screen 200 on the display 106a. Specifically, the display control unit 14 displays the output signal selection screen 200 when the receiving unit 13 receives an input on a predetermined input screen displayed on the display 106a.

In step S32, when the user inputs an output item, the receiving unit 13 receives a signal selection request including the inputted output item data.

In step S33, the information processing device 10 executes score display processing and selection processing of signal data to be stored as model information based on the output item data accepted by the reception unit 13 (an example of a selection step).

In step S34, the storage/reading unit 19 stores the selected signal data as model information in the model information management DB 1005.

FIG. 15 is a diagram showing an example of an output signal selection screen displayed on the information processing device according to the present embodiment.

FIG. 15 is a diagram showing an example of an output signal selection screen displayed on the information processing device, corresponding to step S31 and step S32 of the flowchart shown in FIG. 14. The output signal selection screen 200 shown in FIG. 15 is a display screen for allowing the user to select the score to be displayed and the signal data to be stored as model information. The output signal selection screen 200 includes an output item selection area 210 for specifying the score to be displayed and a detection signal to be stored as model information, a "VIEW" button 225 for displaying the score, and a "VIEW" button 225 to press to cancel the process. A "CANCEL" button 203 is included.

Here, data of various items included in the processing information can be selected in the output item selection area 210. The output item selection area 210 includes, for example, a road selection area 211 in which a road can be selected, a pavement material selection area 212 in which a paving material can be selected, and a tire selection area 213 in which a tire 50 can be selected. In the example of FIG. 15, the receiving unit 13 receives data such as road; "R101", paving material; "asphalt", and tire; "A" as output item data. Note that the items corresponding to each selection area included in the output item selection area 210 are not limited to these, and may be added and changed as appropriate depending on the items indicated in the processing information.

Then, by pressing the "VIEW" button 225 shown in FIG. 15, display processing is performed on the signal data selected in the output item selection area 210.

In FIGS. 14 and 15 described above, an example has been described in which the information processing device 10 displays the output signal selection screen 200 and the user selects the detection signal to be output. The configuration may be such that the screen 200 is displayed and the user selects the detection signal to be output.

FIG. 16 is a flowchart illustrating an example of display selection processing in the information processing apparatus according to the present embodiment. FIG. 16 is a flowchart showing an example of display selection processing corresponding to step S33 in the flowchart shown in FIG.

In step S331, the selection unit 18 selects the processing information corresponding to the output item data accepted in step S32 shown in FIG. 14 from among the processing information stored in the condition information management table shown in FIG. Specifically, the storage/reading unit 19 reads the condition information management table from the condition information management DB 1001. Then, the selection unit 18 selects condition information including processing information corresponding to the output item data accepted by the reception unit 13 from among the condition information included in the read condition information management table. In this case, the selection unit 18 selects, for example, condition information with the condition ID "A000001" which is processing information corresponding to the output item data input to the output item selection area 210 shown in FIG. 15.

In step S332, the selection unit 18 selects a signal associated with the same condition ID as the condition ID associated with the processing information selected in step S331 among the data stored in the detection signal management table shown in FIG. Select data and related data. Specifically, the storage/reading unit 19 reads the detection signal management table from the detection signal management DB 1003. Then, the selection unit 18 selects signal data and related data associated with the condition ID included in the selected condition information from among the data included in the read detection signal management table. In this case, the selection unit 18 selects, for example, the signal data and related data associated with the condition ID “A000001”.

In step S333, the selection unit 18 selects an image associated with the same condition ID as the condition ID associated with the processing information selected in step S331, from among the data stored in the image information management table shown in FIG. Select data. Specifically, the storage/reading unit 19 reads the image information management table from the image information management DB 1007. Then, the selection unit 18 selects image data associated with the condition ID included in the selected condition information from among the data included in the read image information management table. In this case, the selection unit 18 selects, for example, image data associated with condition ID; "A000001".

In step S334, the display control unit 14 of the information processing device 10 displays the information display selection screen 250 on the display 106a. Then, the display control unit 14 displays the signal data and related data selected in step S332, and the image data selected in step S333 on the information display selection screen 250 in association with each other via the condition ID.

In step S335, when the user selects a section on the information display selection screen 250, the reception unit 13 accepts the selection of the section (an example of a reception step).

In step S336, the selection unit 18 selects the signal data and related data related to the section selected in step S335 from among the signal data and related data selected in step S332.

FIG. 17 is a diagram illustrating an example of an information display selection screen displayed on the information processing apparatus according to the present embodiment. FIG. 18 is a diagram showing an example of image information displayed on the display selection screen according to this embodiment.

FIG. 17 is a diagram illustrating an example of an information display selection screen displayed on the information processing device, corresponding to step S334 and step S335 of the flowchart illustrated in FIG. 16. The information display selection screen 250 shown in FIG. 17 is a display screen for displaying the score of the detection signal related to the signal data selected by the selection unit 18 and for selecting a specific section of the detection signal.

The user can check the possibility of an abnormality in the road surface R by checking the score displayed on the information display selection screen 250, but in order to actually determine that there is an abnormality, it is necessary to visually check the road surface R. However, there was a problem with the accuracy of abnormality judgment.

In order to visually confirm the road surface R, image data of the vehicle 70 is displayed on the information display selection screen 250, but it is difficult to visually confirm image data indicating an abnormality from among a large amount of image data. It is. Therefore, it is conceivable that the information processing device 10 processes the image data to determine the abnormality, but in this case, it would be necessary to store a huge amount of image information, and it would take an enormous amount of time to determine the abnormality by image processing. Therefore, there are issues in terms of efficiency.

In view of the above problems, the present embodiment aims to provide an information processing device 10 that can efficiently and accurately determine abnormalities in the road surface R. .

On the information display selection screen 250, travel time data related to the related data selected by the selection unit 18 is displayed in order of travel time so that the user can confirm it.

Further, the information display selection screen 250 includes a frequency spectrogram as an example of a feature amount related to the related data selected by the selection unit 18, score data, and user operation history data as an example of processing information data for each running time. , are displayed in a continuous manner for the user to confirm in association with the travel time data. Further, the image data A is displayed in a state that the user can check in association with the maximum score.

That is, the display control unit 14 displays a plurality of running times, frequency spectra, operation history information, and scores on the information display selection screen 250 of the display 106a, and also displays a plurality of running times, frequency spectra, operation history information, and scores in association with each of the plurality of running times. Each of the frequency spectra, each of the plurality of operation history information, each of the plurality of scores, and image information are displayed on the information display selection screen 250 (an example of a display step). In the example of FIG. 17, the display control unit 14 connects a plurality of scores and displays them as a line graph, and displays image information in association with the position in the horizontal axis direction of the line graph indicating the plurality of scores. There is.

Furthermore, the display control unit 14 causes the information display selection screen 250 to display image information in association with the local maximum score among the plurality of scores. Here, the local maximum score is a score that is equal to or greater than the threshold described in step S21 of FIG.

Furthermore, the information display selection screen 250 includes an input area 222 for inputting a travel time section as a specific section, an "OK" button 251 to be pressed when performing section selection processing, and an "OK" button 251 to press when performing section selection processing. A "CANCEL" button 253 that is pressed is included.

As shown in FIG. 17, among the scores for running times 1001 to 1250, the scores increase after running time 1230, and the score near running time 1250 is the highest.

Here, the image data A of the road surface R is displayed on the information display selection screen 250 in association with the score, and the user can select the image data A of the road surface R corresponding to the maximum score around the travel time of 1250. It can be confirmed.

In the example of FIG. 17, the image data of the road surface R includes more cracks than usual, so the user can determine that the cause of the high score is the cracks.

That is, by checking the score and the image information associated with the score, it is possible to accurately determine the abnormality of the road surface R.

Note that the image data may be displayed not only in association with the maximum score, but also in association with all of the scores equal to or greater than the threshold described in step S21 of FIG. 12. In that case, displaying all the image data at the same time would make the screen cluttered, so of the image data associated with each of the multiple scores, only the image data associated with the score selected with the mouse etc. should be displayed. is preferred. Furthermore, when the change in score is large, image data may be displayed in association with the score before the change, after the change, or before and after the change.

Furthermore, using FIG. 17, an example will be shown in which normal data is selected from data of running times 1001 to 1250. Looking at the scores as an example of score data, it can be seen that the values are low for running times 1001 to 1230. If the system automatically sets ``a portion with a small score is normal'' or ``a cycle with a young cycle (for example, 1001 to 1105) is normal,'' this section can be selected as normal data.

However, when looking at the frequency data for the section of running time 1001 to 1230, it can be seen that noise is present in the low range. On the other hand, when looking at the frequency data for the section of running time 1105 to 1207, it can be seen that there is no low-frequency noise as in the section of running time 1001 to 1230.

Therefore, the user can appropriately determine that the data for the section of travel time 1001-1230, which is part of the travel time 1001-1230, is more suitable as normal data than the data for the section of travel time 1001-1230.

Furthermore, looking at the user operation history for the section of travel time 1001 to 1230, it can be seen that the user is driving in a special mode, for example, repeating frequent speed changes. It can be seen that the above-mentioned low-frequency noise occurs in the section where the special mode operation is performed. From this, it can be determined that the section in which the special mode operation is performed is not suitable for selecting normal data. Therefore, the user can more appropriately determine that the travel times 1105 to 1207 during which the special mode driving is not performed are suitable as normal data.

Then, when the user inputs "1105-1207" into the input area 222 and presses the "OK" button 251, the reception unit 13 accepts the selection of "travel time 1105-1207". As a result, the detection signal or frequency spectrum corresponding to the "travel times 1105 to 1207", which are part of the travel times 1001 to 1230, can be appropriately set as normal data.

Further, since the information "Traveling time 1105 to 1207" received by the reception unit 13 is displayed in the input area 222, the user can confirm the information displayed in the input area 222 and read "Travel time 1105 to 1207". 1207'' can be reliably set as normal data.

In the above explanation, when "1105 to 1207" is entered in the input area 222 and the "OK" button 251 is pressed, the reception unit 13 accepts the selection of "travel time 1105 to 1207", but for example, By selecting the "Running time 1105 to 1207" portion of the displayed frequency data, score, and user operation history with a mouse or the like and pressing the "OK" button 251, the reception unit 13 selects the "Running time 1105 to 1207" part and presses the "OK" button 251. 1105 to 1207” may be accepted.

As described above, the information processing device 10 performs display control to display the score indicating the possibility of abnormality of the road surface R determined based on the detection signal and the image information in association with each other on the information display selection screen 250 of the display 106a. A section 14 is provided.

Thereby, by checking the image information in association with the score, the user can judge abnormalities in the road surface R with higher accuracy than when checking only the score. Furthermore, the user can more efficiently determine abnormalities in the road surface R than when checking only image information. That is, the user can efficiently and accurately determine the abnormality of the road surface R using the information processing device 10 according to the present embodiment.

The display control unit 14 displays a plurality of frequency spectra of the detection signal on the information display selection screen 250, and selects each frequency spectrum of the plurality of frequency spectra for information display in association with each of the plurality of travel times. It is displayed on the screen 250.

As a result, the user can check the travel time of the plurality of travel times, the frequency spectrum of the plurality of frequency spectra, and the image information in association with the respective scores of the plurality of scores. Abnormalities in the road surface R can be determined efficiently and accurately for each score.

The display control unit 14 displays a plurality of pieces of operation history information on the information display selection screen 250, and selects each piece of operation history information for information display in association with each of the plurality of running times. It is displayed on the screen 250.

As a result, the user can check the driving time of each of the plurality of driving times, the operation history information of each of the plurality of operation history information, and the image information in association with each score of the plurality of scores. Abnormalities in the road surface R can be efficiently and accurately determined for each of the plurality of scores.

The information processing device 10 includes a reception unit 13 that receives input of some of the plurality of running times.

Thereby, the user can input a portion of the plurality of running times after confirming the score and the image information associated with the score on the display 106a. Therefore, each frequency spectrum of a plurality of frequency spectra corresponding to each of a part of a plurality of travel times can be appropriately set as normal data or abnormal data.

The information processing device 10 causes the display control unit 14 to display some of the travel times accepted by the reception unit 13 on the information display selection screen 250. This allows the user to check the inputted part of the plurality of travel times, so that the frequency spectra of the plurality of frequency spectra corresponding to the respective travel times of the part of the plurality of travel times are displayed as normal data. Or it can be reliably set as abnormal data.

Further, as described above, the information processing device 10 includes the display control unit 14 that displays image information on the information display selection screen 250 of the display 106a, and as described with reference to FIG. The imaging device control unit 41 controls the imaging device 40 based on the detection signal.

Thereby, the information processing device 10 can determine the timing for acquiring the image information of the road surface R based on the detection signal, and therefore can efficiently acquire the image information of the road surface R. Furthermore, by checking the image information on the information display selection screen 250, the user can accurately determine the abnormality of the road surface R. That is, the user can efficiently and accurately determine the abnormality of the road surface R using the information processing device 10 according to the present embodiment.

The imaging device control unit 41 controls the imaging device 40 based on a score indicating the possibility of an abnormality in the road surface R determined based on the detection signal.

Thereby, the information processing device 10 can efficiently acquire image information of the road surface R when there is a high possibility that the road surface R is abnormal based on the score.

The display control unit 14 causes the score to be displayed on the information display selection screen 250. Thereby, the user can accurately determine the abnormality of the road surface R by checking the score and image information on the information display selection screen 250.

The display control unit 14 causes the information display selection screen 250 to display image information in association with the score. Thereby, the user can accurately determine the abnormality of the road surface R by correlating and confirming the score and the image information on the information display selection screen 250.

FIG. 19 is a conceptual diagram showing an example of a model information management table according to this embodiment. In the storage unit 1000, as explained in step S34 of FIG. 14, a model information management DB 1005 is constructed, which is constituted by a model information management table as shown in FIG.

In the model information management table, a plurality of traveling time data, detection signals, frequency data, and score data are stored and managed in association with each other for each related ID by the storage/reading unit 19.

Then, the storage/reading unit 19 stores and updates the detection signal and frequency data associated with each of the travel times of some of the travel times accepted by the reception unit 13. .

In the example of FIG. 19, as the model information of the related ID "R001", the travel time data accepted by the reception unit 13 described in FIG. , score data is stored and managed in association with each other. Thereby, the detection signal, frequency data, and score data corresponding to the running times 1105 to 1207, which are part of the running times 1001 to 1230, can be appropriately stored as normal data.

Note that the model information management table may store and manage a plurality of detection signals, frequency data, and score data in chronological order in association with each other for each related ID, without storing the running time data. Also, without storing frequency data and score data in the model information management table, the processes of step S154 and step S155 in FIG. 9 are performed again based on the detection signal stored in the model information management table, and the frequency Data may be extracted and score data may be calculated.

As described above, the information processing device 10 stores the frequency spectra of the plurality of frequency spectra associated with the respective travel times of some of the plurality of travel times accepted by the reception unit 13 in the storage unit 1000. A storage/readout unit 19 for storing information is provided.

Thereby, each of the frequency spectra of the plurality of frequency spectra corresponding to each of the plurality of travel times can be appropriately stored as normal data or abnormal data.

As described in FIG. 9, the information processing device 10 determines the score based on the plurality of frequency spectra stored in the storage unit 1000 and the frequency spectrum indicating the characteristics of the detection signal acquired by the detection device communication unit 12. A score calculation unit 175 is provided.

Here, as described with reference to FIG. 19, since the plurality of frequency spectra stored in the storage unit 1000 are updated, the information processing device 10 cannot accurately determine the score indicating the possibility of an abnormality in the road surface R. can.

FIG. 20 is a diagram illustrating an example of an information display selection screen displayed on the information processing apparatus according to the first modification of the present embodiment. FIG. 21 is a diagram illustrating an example of image information displayed on the display selection screen according to the first modification of the present embodiment.

Similar to FIG. 17, on the information display selection screen 250, a plurality of frequency spectrograms, score data, and user operation history data are displayed in a continuous manner for the user to confirm in association with running time data. There is. Further, the image data is displayed in association with the local maximum score so that the user can confirm it. In the example of FIG. 20, since there are two local maximum values of scores, image data A and B are displayed in association with the respective scores of the two local maximum values. Further, image data A and B are image data A1 and B1 of the road surface R on the traveling direction side of the vehicle 70 captured by the first imaging device 40A, and image data A1 and B1 of the road surface R on the traveling direction side of the vehicle 70 captured by the second imaging device 40B, and image data of the vehicle captured from the vertical direction by the second imaging device 40B. It includes image data A2 and B2 of the road surface R behind 70.

That is, the display control unit 14 displays a plurality of scores and image information on the information display selection screen 250 of the display 106a, and also displays image information of each of the plurality of image information in association with each of the plurality of scores. The information is displayed on the information display selection screen 250.

FIG. 20 shows an example in which abnormal data is selected from data of running times 801 to 900. Looking at the score as an example of score data, it can be seen that the values near running time 840 and after running time 865 are high. If the system automatically sets "parts with high scores as normal", these two sections can be selected as abnormal data.

However, when looking at the frequency data immediately before the running time 840, it can be seen that the data is temporarily interrupted. Furthermore, it can be seen that around the running time of 840, the frequency data has the same values as usual. In other words, since the score indicating the change in frequency data has increased due to the frequency data being interrupted, it is considered that there is a low possibility that an abnormality in the road surface R has occurred.

On the other hand, after the running time of 865, looking at the frequency data, it was found that abnormal vibrations were present in the low range, and it is highly likely that some kind of abnormality had occurred in the road surface R. From this, the user can appropriately determine that the data of running times 865 to 900, which are part of the running times 801 to 900, are more suitable as abnormal data than the data around running time 840.

Furthermore, when looking at the user operation history immediately before the running time 840, it can be seen that the power was turned from OFF to ON. The reason why the score is high immediately after this is considered to be due to the influence of warm-up operation. On the other hand, after running time 865, even though there is no evidence of any particular operation by the user, the frequency data shows abnormal vibrations in the low range, and it is highly likely that some abnormality has occurred in the road surface R. From this, the user can more appropriately determine that the data for the running times 865-900, which is a part of the running times 801-900, is more suitable as abnormal data than the data around the running time 840.

Then, the user can check the state of the road surface R shown in the image data corresponding to the maximum score around the travel time 840 and the state of the road surface R shown in the image data corresponding to the maximum score after the travel time 865. By comparing, it can be confirmed from the image data that the data of running times 865-900, which is a part of running times 801-900, is suitable as abnormal data.

That is, by checking the score and the image information associated with the score, it is possible to accurately determine the abnormality of the road surface R.

Although FIG. 20 describes an example using travel time, the same applies to the case where travel distance is used instead of travel time.

As described above, the display control unit 14 displays a plurality of scores and image information on the information display selection screen 250, and also displays image information of each of the plurality of image information in association with each score of the plurality of scores. is displayed on the information display selection screen 250.

As a result, the user can check the image information of the plurality of image information in association with each score of the plurality of scores, thereby accurately detecting abnormalities in the road surface R for each of the plurality of scores. can be judged.

The display control unit 14 displays a plurality of running times on the information display selection screen 250, and also displays scores of each of the plurality of scores and each of the plurality of image information in association with each of the plurality of running times. The image information is displayed on the information display selection screen 250.

As a result, the user can check the running time of each of the plurality of running times and the image information of each of the plurality of image information in association with the score of each of the plurality of scores. Abnormalities in the road surface R can be accurately determined for each score.

FIG. 22 is a diagram illustrating an example of an information display selection screen displayed on the information processing apparatus according to the second modification of the present embodiment.

On the information display selection screen 250, a plurality of score data are continuously displayed in association with running time data so that the user can confirm them. Also, similar to FIG. 1920, image data A and B are displayed in association with the respective scores of the two local maximum values, and the image data A and B are imaged by the first imaging device 40A. image data A1, B1 of the road surface R on the traveling direction side of the vehicle 70, and image data A2, B2 of the road surface R behind the vehicle 70, imaged from the vertical direction by the second imaging device 40B.

FIG. 22 shows an example in which a plurality of abnormal data are selected from travel times 801 to 900.
Looking at the scores as an example of score data, it can be seen that the scores are high in two places between the running times of 801 and 900. If the system automatically sets "parts with high scores as normal", these two sections can be selected as abnormal data.

However, by comparing the image data corresponding to the scores at these two locations, it may be possible to determine that they have completely different trends. In this case, if these two different pieces of abnormal data are referred to as abnormality 1 and abnormality 2, the user can judge each as separate abnormal data.

In FIG. 22, an example using travel time has been described, but the same applies to the case where travel distance is used instead of travel time.

FIG. 23 is a diagram showing a railway vehicle according to a third modification of the present embodiment.

The railway vehicle 70R is a modification of the vehicle 70 shown in FIG. 2, and includes a control device 70A, wheels 50w, a detection device 30, and an imaging device 40 arranged to image the track r.

The railway vehicle 70R is an example of a moving body that moves while contacting the track r, which is an example of a target section. The wheels 50w are an example of a moving member that moves while contacting the track r. The detection device 30 detects a physical quantity that changes as the wheels 50w of the railway vehicle 70R move while contacting the track r. The imaging device 40 is an example of an imaging unit that captures a moving or still image of the track r.

FIG. 24 is a conceptual diagram showing an example of a condition information management table according to the third modification.

In the storage unit 1000 shown in FIG. 5, the condition information management DB 1001 described in step S13 of FIG. 7 is configured by a condition information management table as shown in FIG.

The condition information management table shown in FIG. 24 is for managing processing information related to the operation of the railway vehicle 70R for each operation performed by the railway vehicle 70R. The condition information management table stores and manages condition information in which processing information is associated with each condition ID. The condition ID is identification information for identifying condition information including processing information. The processing information is information determined for each type of operation of the railway vehicle 70R. As shown in FIG. 24, the processing information includes information such as the name of the route on which the railway vehicle 70R runs, the type of material etc. of the track r on which the railway vehicle 70R travels, and the type of wheel 50w such as the material of the railway vehicle 70R. included. The type of material etc. of the track r is an example of the type of the target part, and the type of material etc. of the wheels 50w is an example of the type of the moving member.

The items included in the processing information further include information indicating the user's operation history information for the railway vehicle 70R, the travel start date and time, the traveling time (an example of the travel time of the railway vehicle 70R), and the traveling speed of the railway vehicle 70R. It may be Furthermore, the travel distance (an example of the travel distance of the railway vehicle 70R) may be included, or the travel distance may be included instead of the travel time. Travel information including travel time or travel distance is an example of movement information.

The condition information management table further stores and manages associated IDs for identifying related operations (processes) among the operations performed by the railway vehicle 70R. The same related ID is assigned to processing information indicating related processing among the processing information included in the condition information management table. In the example of FIG. 24, the same related ID "R001" is assigned to the processing information identified by the condition ID "A000001" and the condition ID "A00003." Here, the related process to which the related ID is assigned is, for example, a process in which the track type and wheel type are the same, but the route name is different.

FIG. 25 is a diagram illustrating an example of a display selection screen displayed on the information processing device according to the third modification.

FIG. 25 is a diagram illustrating an example of an information display selection screen displayed on the information processing device, corresponding to step S334 and step S335 of the flowchart illustrated in FIG. 16. The information display selection screen 250 shown in FIG. 25 is a display screen for displaying the score of the detection signal related to the signal data selected by the selection unit 18 and for selecting a specific section of the detection signal.

On the information display selection screen 250, travel time data related to the related data selected by the selection unit 18 is displayed in order of travel time so that the user can confirm it.

Further, the information display selection screen 250 includes a frequency spectrogram as an example of a feature amount related to the related data selected by the selection unit 18, score data, and user operation history data as an example of processing information data for each running time. , are displayed in a continuous manner for the user to confirm in association with the travel time data. Further, the image data A of the track r is displayed in a manner that allows the user to check the image data in association with the maximum score.

That is, the display control unit 14 causes a plurality of running times, frequency spectra, operation history information, and scores to be displayed on the information display selection screen 250 of the display 106a, and also displays a plurality of running times in association with each of the plurality of running times. Each of the frequency spectra, each of the plurality of operation history information, each of the plurality of scores, and image information are displayed on the information display selection screen 250 (an example of a display step).

Further, the display control unit 14 displays image information on the information display selection screen 250 in association with the maximum score among the plurality of scores. Here, the local maximum score is a score that is equal to or greater than the threshold described in step S21 of FIG.

Furthermore, the information display selection screen 250 includes an input area 222 for inputting a travel time section as a specific section, an "OK" button 251 to be pressed when performing section selection processing, and an "OK" button 251 to press when performing section selection processing. A "CANCEL" button 253 that is pressed is included.

As described above, the information processing device 10 performs display control to display the score indicating the possibility of abnormality of the track r determined based on the detection signal and the image information in association with each other on the information display selection screen 250 of the display 106a. A section 14 is provided.

Thereby, by checking the image information in association with the score, the user can judge the abnormality of the track r with higher accuracy than when checking only the score. Furthermore, the user can more efficiently determine the abnormality of the line r than when checking only image information. That is, the user can efficiently and accurately determine the abnormality of the line r using the information processing device 10 according to the present embodiment.

FIG. 26 is a diagram showing a railway vehicle according to a fourth modification of the present embodiment.

A railway vehicle 70R shown in FIG. 26 is a modification of the railway vehicle 70R shown in FIG. 23, and includes a control device 70A, a pantograph 50P, a detection device 30, and an imaging device 40 arranged to take an image of the overhead wire W.

The railway vehicle 70R is an example of a moving body that moves while contacting the overhead wire W, which is an example of a target part. The pantograph 50P is an example of a moving member that moves while contacting the overhead wire W. The detection device 30 detects a physical quantity that changes as the pantograph 50P of the railway vehicle 70R moves while contacting the overhead wire W. The imaging device 40 is an example of an imaging unit that captures a moving image or a still image of the overhead wire W.

FIG. 27 is a conceptual diagram showing an example of a condition information management table according to the fourth modification.

In the storage unit 1000 shown in FIG. 5, the condition information management DB 1001 described in step S13 of FIG. 7 is configured by a condition information management table as shown in FIG.

The condition information management table shown in FIG. 27 is for managing processing information related to the operation of the railway vehicle 70R for each operation performed by the railway vehicle 70R. The condition information management table stores and manages condition information in which processing information is associated with each condition ID. The condition ID is identification information for identifying condition information including processing information. The processing information is information determined for each type of operation of the railway vehicle 70R. As shown in FIG. 24, the processing information includes the name of the route on which the railway vehicle 70R runs, the type of material of the overhead wire W, and the information of the type of material of the pantograph 50P of the railway vehicle 70R. The type of material etc. of the overhead wire W is an example of the type of the target part, and the type of material etc. of the pantograph 50P is an example of the type of the moving member.

The items included in the processing information further include information indicating the user's operation history information for the railway vehicle 70R, the travel start date and time, the traveling time (an example of the travel time of the railway vehicle 70R), and the traveling speed of the railway vehicle 70R. It may be Furthermore, the travel distance (an example of the travel distance of the railway vehicle 70R) may be included, or the travel distance may be included instead of the travel time. Travel information including travel time or travel distance is an example of movement information.

The condition information management table further stores and manages associated IDs for identifying related operations (processes) among the operations performed by the railway vehicle 70R. The same related ID is assigned to processing information indicating related processing among the processing information included in the condition information management table. In the example of FIG. 27, the same related ID "R001" is assigned to the processing information identified by the condition ID "A000001" and the condition ID "A00003." Here, the related process to which the related ID is assigned is, for example, a process in which the overhead wire type and the pantograph type are the same, but the route names are different.

FIG. 28 is a diagram illustrating an example of a display selection screen displayed on the information processing device according to the fourth modification.

FIG. 28 is a diagram showing an example of an information display selection screen displayed on the information processing device, corresponding to steps S334 and S335 of the flowchart shown in FIG. 16. The information display selection screen 250 shown in FIG. 28 is a display screen for displaying the score of the detection signal related to the signal data selected by the selection unit 18 and for selecting a specific section of the detection signal.

On the information display selection screen 250, travel time data related to the related data selected by the selection unit 18 is displayed in order of travel time so that the user can confirm it.

Further, the information display selection screen 250 includes a frequency spectrogram as an example of a feature amount related to the related data selected by the selection unit 18, score data, and user operation history data as an example of processing information data for each running time. , are displayed in a continuous manner for the user to confirm in association with the travel time data. Further, the image data A of the overhead wire W is displayed in a state that can be confirmed by the user in association with the maximum score.

That is, the display control unit 14 displays a plurality of running times, frequency spectra, operation history information, and scores on the information display selection screen 250 of the display 106a, and also displays a plurality of running times, frequency spectra, operation history information, and scores in association with each of the plurality of running times. Each of the frequency spectra, each of the plurality of operation history information, each of the plurality of scores, and image information are displayed on the information display selection screen 250 (an example of a display step).

Further, the display control unit 14 displays image information on the information display selection screen 250 in association with the maximum score among the plurality of scores. Here, the local maximum score is a score that is equal to or greater than the threshold described in step S21 of FIG. 12.

Furthermore, the information display selection screen 250 includes an input area 222 for inputting a travel time section as a specific section, an "OK" button 251 to be pressed when performing section selection processing, and an "OK" button 251 to press when performing section selection processing. A "CANCEL" button 253 that is pressed is included.

As described above, the information processing device 10 associates the score indicating the possibility of abnormality of the overhead wire W determined based on the detection signal with the image information of the overhead wire W, and displays the image information on the information display selection screen 250 of the display 106a. A display control unit 14 is provided.

Thereby, by checking the image information in association with the score, the user can determine abnormalities in the overhead wire W with higher accuracy than when checking only the score. Furthermore, the user can more efficiently determine abnormalities in the overhead wire W than when checking only image information. That is, the user can efficiently and accurately determine the abnormality of the overhead wire W using the information processing device 10 according to the present embodiment.

●Summary●
As described above, in the information processing device 10 according to an embodiment of the present invention, moving objects such as the vehicle 70 and the railway vehicle 70R move while being in contact with target parts such as the road surface R, the track r, and the overhead wire W. A detection device communication unit 12 (an example of a detection information acquisition unit) that acquires a detection signal (an example of detection information) of a physical quantity that changes due to (an example of an acquisition unit), a score (an example of possibility information) indicating the possibility of an abnormality in the road surface R, etc. determined based on the detection signal, and image information are displayed in association with each other on the display 106a (an example of a display unit). A display control unit 14 is provided.

Thereby, by checking the image information in association with the score, the user can judge abnormalities in the road surface R and the like with higher accuracy than when checking only the score. Furthermore, the user can more efficiently determine abnormalities in the road surface radius, etc., than when checking only image information. That is, the user can efficiently and accurately determine abnormalities in the road surface R and the like using the information processing device 10 according to the present embodiment.

The display control unit 14 causes the display 106a to display a plurality of scores and image information, and causes the display 106a to display image information of each of the plurality of image information in association with each score of the plurality of scores.

As a result, the user can efficiently detect abnormalities such as road surface R for each score of the plurality of scores by checking the image information of the plurality of image information in association with each score of the plurality of scores. Able to make accurate and accurate judgments.

The display control unit 14 causes the display 106a to display a plurality of travel information (an example of travel information) indicating a travel distance (an example of a travel distance) or a travel time (an example of a travel time) of the vehicle 70, etc., and displays a plurality of travel information. The scores of each of the plurality of scores and the image information of each of the plurality of image information are displayed on the display 106a in association with each of the driving information.

As a result, the user can check each of the plurality of driving information and the image information of the plurality of image information in association with each of the plurality of scores. Abnormalities such as road surface radius can be determined efficiently and accurately for each score.

The display control unit 14 causes the display 106a to display a plurality of frequency spectra of the detection signal (an example of characteristic information indicating characteristics of the detection information), and also displays a plurality of frequency spectra in association with each of the plurality of driving information. The display 106a displays the respective frequency spectra.

With this, the user can associate each of the plurality of driving information with the respective score of the plurality of scores, each of the plurality of driving information, each of the plurality of frequency spectra, and each of the plurality of image information. By checking, abnormalities in the road surface R, etc. can be determined with high accuracy for each of the plurality of scores.

The information processing device 10 further includes a transmitting/receiving unit 11 (an example of a processing information acquisition unit) that acquires operation history information (an example of processing information related to the operation of a moving object) indicating a user's operation history with respect to the vehicle 70 etc., The display control unit 14 causes the display 106a to display a plurality of pieces of operation history information, and causes the display 106a to display each piece of operation history information in association with each piece of travel information.

As a result, the user can associate each of the plurality of driving information with each of the plurality of scores, the respective driving information of the plurality of driving information, the respective operation history information of the plurality of operation history information, and the image of each of the plurality of image information. By checking the information, it is possible to efficiently and accurately determine abnormalities in the road surface R and the like for each of the plurality of scores.

The information processing device 10 includes a reception unit 13 that receives an input of some of the plurality of pieces of driving information.

Thereby, the user can input a portion of the plurality of running information after confirming the score and the image information associated with the score on the display 106a. Therefore, each detection signal or frequency spectrum of a plurality of detection signals or frequency spectra corresponding to each of the travel information of some of the plurality of travel information can be appropriately set as normal data or abnormal data.

The information processing device 10 causes the display control unit 14 to display some of the plurality of travel information received by the reception unit 13 on the display 106a. As a result, the user can confirm some of the inputted plurality of driving information, so that the user can check the plurality of detection signals or each detection signal of the frequency spectrum corresponding to each of the plurality of driving information. Alternatively, the frequency spectrum can be reliably set as normal data or abnormal data.

The information processing device 10 includes a storage/reading unit that stores, in the storage unit 1000, each frequency spectrum of a plurality of frequency spectra associated with each of the travel information of a part of the plurality of travel information received by the reception unit 13. 19 (an example of a storage control unit).

Thereby, each of the frequency spectra of the plurality of frequency spectra corresponding to each of the driving operation information of some of the plurality of driving information can be appropriately stored as normal data or abnormal data.

The information processing device 10 includes a score calculation unit 175 (score determination unit) that determines a score based on a plurality of frequency spectra stored in the storage unit 1000 and a frequency spectrum indicating the characteristics of the detection signal acquired by the detection device communication unit 12. part).

Thereby, the information processing device 10 can accurately determine a score indicating the possibility of an abnormality in the road surface R or the like.

●Supplement●
Note that the functions of each embodiment can be realized by a computer-executable program written in a legacy programming language such as assembler, C, C++, C#, Java (registered trademark), or an object-oriented programming language. A program for performing the functions of can be distributed over telecommunications lines.

In addition, programs for executing the functions of each embodiment are stored in ROM, EEPROM (Electrically Erasable Programmable Read-Only Memory), and EPROM (Erasable Programmable Read-Only Memory). , flash memory, flexible disk, CD (Compact Disc) Store and distribute in device-readable recording media such as ROM, CD-RW (Re-Writable), DVD-ROM, DVD-RAM, DVD-RW, Blu-ray disc, SD card, MO (Magneto-Optical disc), etc. You can also do it.

Furthermore, part or all of the functions of each embodiment can be implemented on a programmable device (PD) such as an FPGA (Field Programmable Gate Array), or can be implemented as an ASIC. circuit configuration data (bitstream data) to be downloaded to the PD in order to implement the functions on the PD, HDL (Hardware Description Language) for generating the circuit configuration data, VHDL (Very High Speed Integrated Circuits Hardware Description) tion language), It can be distributed on a recording medium as data written in Verilog-HDL or the like.

Although an information processing device, an information processing method, and a program according to an embodiment of the present invention have been described so far, the present invention is not limited to the above-mentioned embodiment, and includes additions, changes, and Modifications such as deletion can be made within the range that can be conceived by those skilled in the art, and any embodiment is included within the scope of the present invention as long as the functions and effects of the present invention are achieved.

1A, 1C Anomaly detection system 5 Information processing system 10 Information processing device 11 Transmission/reception unit (an example of a processing information acquisition unit)
12 Detection device communication section (an example of detection information acquisition section)
18 Selection unit 19 Storage/reading unit (an example of a storage control unit)
21 Judgment unit (an example of an abnormality judgment unit)
30 Detection device 40 Imaging device (an example of an imaging unit)
41 Imaging device control unit (an example of an image information acquisition unit)
70 Vehicle (an example of a moving object)
70R Railway vehicle (an example of a moving object)
R Road surface (an example of the target part)
r Railway line (an example of the target part)
W Overhead line (an example of the target part)
106a Display (an example of a display section)
173 Feature extraction unit 175 Score calculation unit (an example of possibility information determination unit)
200 Output signal selection screen 250 Information display selection screen 1000 Storage section

Patent No. 5014464

Claims (10)

a detection information acquisition unit that acquires detection information of a physical quantity that changes when a moving object moves while contacting the target part;
an image information acquisition unit that acquires image information of the target part;
Model information indicating normal data or abnormal data, possibility information indicating the possibility of abnormality in the target portion determined based on the detection information, the image information , and movement indicating the travel distance or travel time of the moving object. information and each of the plurality of image information are displayed on the display unit, and the possibility information of each of the plurality of possibility information and each of the plurality of image information are displayed in association with the movement information of each of the plurality of movement information. a display control unit that causes the display unit to display image information ;
a reception unit that receives input of part of the movement information among the plurality of pieces of movement information;
a storage control unit that stores and updates the model information based on the detection information associated with the part of the movement information received by the reception unit;
An information processing device equipped with The display control unit causes the display unit to display a plurality of characteristic information indicating characteristics of the detected information, and
The information processing apparatus according to claim 1 , wherein characteristic information of each of the plurality of characteristic information is displayed on the display unit in association with movement information of each of the plurality of movement information. The feature information includes a frequency spectrum of the detection information,
The information processing apparatus according to claim 2 , wherein the display control unit causes the display unit to display each frequency spectrum of the plurality of frequency spectra in association with each movement information of the plurality of movement information. further comprising a processing information acquisition unit that acquires processing information related to the operation of the mobile body,
The display control section further causes the display section to display a plurality of the processing information, and displays each processing information of the plurality of processing information on the display section in association with the movement information of each of the plurality of movement information. The information processing device according to claim 2 or 3 , wherein the information processing device displays the information on the screen. The processing information includes operation history information indicating a user's operation history with respect to the mobile object,
The display control unit displays a plurality of pieces of operation history information on the display unit, and displays each piece of operation history information in association with each movement information of the plurality of pieces of movement information. 5. The information processing device according to claim 4 , wherein the information processing device is displayed on the screen. The display control section includes:
The information processing apparatus according to any one of claims 1 to 5 , wherein the plurality of pieces of movement information of the part received by the reception unit are displayed on the display unit. The storage control unit includes:
Any one of claims 1 to 6, wherein characteristic information indicating characteristics of the detected information associated with movement information of each of the plurality of movement information received by the reception unit is stored in a storage unit. The information processing device described in section . Claim: further comprising a possibility information determining unit that determines the possibility information based on the characteristic information stored in the storage unit and characteristic information indicating characteristics of the detection information acquired by the detection information acquisition unit . 7. The information processing device according to 7 . a detection information acquisition step of acquiring detection information of a physical quantity that changes as the moving object moves while contacting the target part;
an image information acquisition step of acquiring image information of the target part;
Model information indicating normal data or abnormal data, possibility information indicating the possibility of abnormality in the target portion determined based on the detection information, the image information , and movement indicating the travel distance or travel time of the moving object. information and each of the plurality of image information are displayed on the display unit, and the possibility information of each of the plurality of possibility information and each of the plurality of image information are displayed in association with the movement information of each of the plurality of movement information. a display step of displaying image information on the display unit;
a reception step of accepting an input of part of the movement information among the plurality of pieces of movement information;
a memory updating step of storing and updating the model information based on the detection information associated with the part of the movement information accepted in the accepting step;
An information processing method with to the computer ,
a detection information acquisition step of acquiring detection information of a physical quantity that changes as the moving object moves while contacting the target part;
an image information acquisition step of acquiring image information of the target part;
Model information indicating normal data or abnormal data, possibility information indicating the possibility of abnormality in the target portion determined based on the detection information, the image information, and movement indicating the travel distance or travel time of the moving object. information and each of the plurality of image information are displayed on the display unit, and the possibility information of each of the plurality of possibility information and each of the plurality of image information are displayed in association with the movement information of each of the plurality of movement information. a display step of displaying image information on the display unit;
a reception step of accepting an input of part of the movement information among the plurality of pieces of movement information;
a memory updating step of storing and updating the model information based on the detection information associated with the part of the movement information accepted in the accepting step;
A program to run.

Images