JP2022045502A - Information processing device, method for controlling the same, and control program for the same - Google Patents

Abstract

To provide an information processing device for supporting appropriate judgment in management by further reducing a burden of a manager at the time of remotely monitoring operation of a vehicle in a vehicle operation management system.SOLUTION: An information processing device related to an operation management system for managing an operation state of a vehicle includes: a storage unit for storing warning conditions for issuing an alarm for each of a plurality of parameters related to operation of the vehicle; a generation unit for classifying the plurality of parameters into each type of the parameter to generate display information to display it on one screen in a display mode in accordance with a state of the plurality of parameters; and a receiving unit for receiving the plurality of parameters related to operation of the vehicle from the vehicle. The generation unit generates display information for changing the display mode of the parameter in the screen relative to parameters satisfying the alarm conditions among the plurality of parameters received by the receiving unit to display it.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing device, a control method of the information processing device, and a control program of the information processing device, and more particularly, an information processing device related to an operation management system for managing the operation of a vehicle, a control method of the information processing device, and information. Regarding the control program of the processing device.

With the spread of self-driving vehicles in recent years, the development of an operation management system that remotely manages the operation of these self-driving vehicles is also underway. For example, Patent Document 1 discloses a server or the like for reducing the load on the management side in the operation management system.

Japanese Patent No. 6705996

The manager of the self-driving vehicle monitors various items (parameters) related to the operation of the vehicle in order to operate the vehicle safely, and if a problem should occur in the vehicle, promptly and appropriately deal with the problem. There is a need.

INDUSTRIAL APPLICABILITY The present invention further reduces the burden on the administrator when remotely monitoring the operation of a vehicle in a vehicle operation management system, and controls an information processing device and an information processing device to support appropriate judgment in management. A method and a control program for an information processing device are provided.

The information processing device according to the operation management system for managing the operation status of the vehicle according to the embodiment of the present invention includes a storage unit for storing warning conditions for issuing a warning for each of a plurality of parameters related to the operation of the vehicle, and a plurality of storage units. Parameters are divided according to the type of parameter, and a generator that generates display information to be displayed on one screen in a display mode according to the state of multiple parameters, and a plurality of parameters related to vehicle operation from the vehicle. A receiving unit and a receiving unit are provided, and the generating unit generates display information for displaying a parameter that satisfies the warning condition among a plurality of parameters received by the receiving unit by changing the display mode of the parameter on one screen. ..

In the information processing apparatus according to the embodiment of the present invention, the generation unit divides a plurality of parameters into a first parameter related to the automatic driving function of the vehicle and a second parameter related to the operating state of the vehicle, and sets the first parameter. Display information for displaying one screen including an area for displaying collectively and an area for displaying the second parameter collectively may be generated.

In the information processing apparatus according to the embodiment of the present invention, when one screen is divided into two in the vertical direction, the generation unit displays the first parameter on the left side of the one screen and faces the one screen. You may generate display information to display at least the second parameter on the right side.

In the information processing apparatus according to the embodiment of the present invention, the generation unit generates display information indicating the state of the parameter according to the type of color, and displays the parameter satisfying the warning condition by changing the color on one screen. Information may be generated.

In the information processing apparatus according to the embodiment of the present invention, the storage unit further stores the priority regarding the likelihood of occurrence of a warning condition for a plurality of parameters, and the generation unit further stores the plurality of parameters classified for each type of parameter. In the category, display information may be generated to be displayed from the upper side on one screen in descending order of priority.

In the information processing apparatus according to the embodiment of the present invention, the generation unit may make the parameter to be displayed on one screen different from the plurality of parameters according to the type of the vehicle.

In the information processing apparatus according to the embodiment of the present invention, the receiving unit is at least one of the outside or the inside of the vehicle, which is captured by a camera installed in the vehicle as one of a plurality of parameters related to the operation of the vehicle. The image of the above may be received, and the generation unit may generate display information for displaying one screen including at least a section for displaying the image.

In the information processing apparatus according to the embodiment of the present invention, the receiving unit receives a plurality of parameters related to the operation of the vehicle from the plurality of vehicles, and the generating unit displays one screen for each of the plurality of vehicles. Information may be generated.

The control method of the information processing device according to the operation management system for managing the operation status of the vehicle according to the embodiment of the present invention is a warning condition for the information processing device to issue a warning for each of a plurality of parameters related to the operation of the vehicle. A step of storing information, a step of dividing a plurality of parameters according to the type of the parameter, and a step of generating display information to be displayed on one screen in a display mode according to the state of the plurality of parameters. A step of receiving a plurality of parameters related to operation, and a step of generating display information for displaying a parameter that satisfies a warning condition among a plurality of parameters received in the receiving step by changing the display mode of the parameter on one screen. And execute.

The control program of the information processing device according to the operation management system for managing the operation status of the vehicle according to the embodiment of the present invention is a warning condition for issuing a warning to the information processing device for each of a plurality of parameters related to the operation of the vehicle. A storage function that stores information processing, a generation function that divides the status of multiple parameters by parameter type, and a generation function that generates display information to be displayed on one screen in a display mode according to the status of multiple parameters, and a vehicle. From, the reception function that receives a plurality of parameters related to the operation of the vehicle is realized, and the generation function is a display mode of the parameters on one screen for the parameters that satisfy the warning condition among the plurality of parameters received by the reception function. Generates display information to be displayed by changing.

According to the present invention, in the vehicle operation management system, an information processing device or the like for further reducing the burden on the administrator when remotely monitoring the operation of the vehicle and supporting appropriate judgment in management is provided. be able to.

It is a schematic diagram of the operation management system configuration by one Embodiment of this invention. It is an example of the functional block diagram of the information processing apparatus (server) according to one Embodiment of this invention. It is an example of the functional block diagram of the vehicle by one Embodiment of this invention. It is an example of a table regarding warning conditions according to one embodiment of the present invention. It is a schematic diagram of the management screen displayed on the display device by one Embodiment of this invention. This is an example of a management screen displayed on a display device according to an embodiment of the present invention. This is an example of a management screen displayed on a display device according to an embodiment of the present invention. It is an example of the flowchart of the control method of the information processing apparatus which concerns on the operation management system by one Embodiment of this invention.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

<System configuration>
FIG. 1 is a schematic diagram of an operation management system configuration according to an embodiment of the present invention. The operation management system 600 is a system for remotely managing and monitoring the operation status of the vehicle 200, and includes at least the vehicles 200A to 200C, a server (information processing device) 100, and a display device 170. The server 100 is an information processing device on the operation management side of the vehicle, and transmits / receives information to / from a plurality of vehicles 200A to 200C via the network 500. Although only one server 100 is shown in FIG. 1, the number of servers 100 is not limited to this, and a plurality of servers may exist. Further, the server 100 may be a distributed server system that cooperates by communicating via a network, or may be a so-called cloud server. That is, the server 100 is not limited to a physical server, but also includes a virtual server.

The display device 170 functions as a display unit and an input reception unit of the server 100. The display device 170 accepts an input operation from the manager (monitorer) 400 of the operation management system 600 that remotely monitors the vehicle, and presents various information to the manager 400. Although the display device 170 is shown by a monitor and a keyboard in the figure, it may be a terminal device such as a tablet or a smartphone, a large monitor, and a predetermined input device.

Vehicles 200A to 200C are vehicles that can be operated by automatic driving, and a bus will be described as an example in the following description. The vehicle 200 (200C) may be manually driven by an occupant 300 (300C) as needed, or may not require an occupant or a driver. The "automatic driving" means a driving in which the engine, the brake, and the steering are automatically controlled without the driver performing the driving operation. "Manual operation" means an operation in which the driver performs engine control (accelerator pedal operation), brake control (brake pedal operation), and steering control (steering wheel operation). In FIG. 1, only three buses are shown as vehicles, but it goes without saying that a plurality of vehicles may exist. When there is no particular need to distinguish, the vehicles 200A to 200C and the occupant 300C are simply referred to as the vehicle 200 and the occupant 300.

The network 500 may include a wireless network or a wired network, and specifically, a wireless LAN (WLAN), a wide area network (WAN), ISDNs (integrated service digital networks), and a CDMA (code division). Multiple access), wireless LANs, LTE (long term evolution), LTE-Advanced, 4th generation communication (4G), 5th generation communication (5G), 6th generation communication (6G) and later mobile communication systems, etc. .. The network 500 is not limited to these examples, and the network 500 is not limited to these examples, for example, a public switched telephone network (PSTN), a bluetooth (Bluetooth (registered trademark)), an optical line, an ADSL (Asymmetric Digital Subscriber LINE) line, and a satellite. It may be a communication network or the like. Further, the network 500 may be a combination of these.

<Server>
FIG. 2 is a block diagram of a server 100 according to an embodiment of the present invention. The server 100 includes a control unit 110, a communication unit 120, an input / output unit 130, and a storage unit 190. The control unit 110 may typically be a central processing unit (CPU). The control unit 110 may execute the functions and methods shown in each embodiment by reading the program stored in the storage unit 190 and executing the code or instruction included in the read program. The control unit 110 also includes an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), a microprocessor (microprocessor), a processor core (processor core), a multiprocessor (multiprocessor), an ASIC (Application-Specific Integrated Circuit), and an FPGA. (Field Programmable Gate Array) and the like may be included. The control unit 110 realizes each process disclosed in each embodiment by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)) or the like. May be good. Further, these circuits may be realized by one or a plurality of integrated circuits, and a plurality of processes shown in each embodiment may be realized by one integrated circuit. In addition, LSI may be referred to as VLSI, super LSI, ultra LSI, or the like depending on the degree of integration.

The control unit 110 includes a communication control unit 111, an input / output control unit 112, a generation unit 113, and a determination unit 114. The communication control unit 111 controls the communication by the communication unit 120 with the external device via the network 500. The communication unit 120 includes a reception unit 121 and a transmission unit 122, and transmits / receives information (data) to / from the vehicle 200 via the network 500. For example, the receiving unit 121 receives a plurality of parameters related to the operation of the vehicle from the vehicle 200. Here, the "parameter related to the operation of the vehicle" is a parameter capable of grasping the state of the vehicle. Here, in the present embodiment, an existing general vehicle on which the driver is boarded and driven is referred to as an "existing vehicle", not a vehicle capable of automatic driving. Then, the parameter related to the operation of the vehicle may be a parameter related to the operating state of the vehicle similar to the existing vehicle, and may be a parameter indicating the state of the engine, the motor, the brake, and the like. Parameters related to the operating state of the vehicle are, for example, vehicle speed, acceleration, vehicle interior temperature, door open / closed state, mileage, number of passengers, sales, engine speed, cooling water temperature, handle operation amount, fuel balance. The amount, the charge rate of the fuel cell in the case of an electric vehicle, and the like may be included. Further, the parameter relating to the operation of the vehicle may be a parameter relating to the automatic driving function. The parameter related to the automatic driving function is a parameter related to the function added to the software for controlling the driving of the vehicle, which is necessary for realizing the automatic driving. The parameters related to the automatic driving function are, for example, parameters indicating the state of a GPS signal reception level for self-position estimation, a collision prevention sensor, a sensor for obstacle detection, a camera provided outside the vehicle, and the like. The parameters related to the operation of the vehicle are not necessarily classified into the above-mentioned two types of parameters. Other examples of vehicle operation parameters may include information about passengers in the vehicle, which can be acquired, for example, by images from an imager provided in the vehicle, to assist in getting on and off wheelchairs, crutches, strollers, etc. The presence or absence of required passengers may be included.

The generation unit 113 classifies a plurality of parameters received by the reception unit 121 according to the type of the parameter, and generates display information to be displayed on one screen in a display mode according to the state of the parameter. The "parameter state" is whether the value or content of the parameter is "normal" or "abnormal", but may indicate a state other than this. Further, the generation unit 113 generates display information for displaying the parameters satisfying the warning conditions described later by changing the display mode of the parameters on one screen. A screen including a parameter display mode will be described later.

The input / output control unit 112 controls the input / output of information via a wired or wireless connection with an external device via the input / output unit 130. For example, the input / output unit 130 includes an input unit 131 and an output unit 132, and performs input / output of information to / from the display device 170 via wired or wireless. For example, the output unit 132 outputs the display information generated by the generation unit 113 to the display device 170. Further, the input unit 131 receives the information output from the display device 170.

The display device 170 includes an input receiving unit 171 and a display unit 172. The input receiving unit 171 receives a control instruction of the vehicle 200 by an input operation by the administrator 400 in a predetermined input device such as a keyboard. The control instruction received by the input reception unit 171 is transmitted to the vehicle 200 by the communication control unit 111.

The display unit 172 causes a predetermined display device such as a display to display a display screen based on the display information received from the server 100. The display device 170 may include a speaker (not shown). Although the generation unit 113 is shown in the server 100, the generation unit may be provided in the display device 170 to distribute the load on the generation of the display information. The input receiving unit 171 may be realized by any one of all kinds of devices capable of receiving an input from a user and transmitting information related to the input to the control unit 110, or a combination thereof. The input receiving unit 171 may include, for example, a hardware key such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera, and a microphone. The display unit 172 may display a screen based on the processing result processed by the control unit 110. The display unit 172 may include, for example, a touch panel or the like.

The determination unit 114 determines whether or not there is a parameter satisfying the warning condition among the plurality of parameters received by 1121. Here, the warning condition is a condition in which it can be determined that the parameter related to the operation of the vehicle is in a state where the administrator 400 should be warned in the operation of the vehicle 200. The state to be warned to the administrator 400 is, for example, a malfunction / abnormality of the vehicle, a malfunction of the automatic driving function, or the like.

The storage unit 190 stores various programs and various data required for the server 100 to operate. The storage unit 190 stores warning conditions for issuing a warning for each of a plurality of parameters related to the operation of the vehicle. The storage unit 190 may include, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. Further, the storage unit 190 may include a memory (RAM (Random Access Memory), ROM (Read Only Memory), etc.) that provides a work area for the control unit 110.

FIG. 4 shows an example of the warning condition table 191 stored in the storage unit 190. The warning condition table 191 stores the parameter status, the warning condition, and the priority in association with the parameter received from the vehicle 200. For example, the parameter "automatic vehicle control" is associated with four states of "0: normal 1: automatic departure control failure 2: automatic stop control failure 3: automatic route control failure", and the warning condition is other than "0". ". That is, when the value of the parameter "automatic vehicle control" received from the vehicle 200 is "2", the determination unit 150 of the server 100 determines that the parameter "automatic vehicle control" satisfies the warning condition. Further, the determination unit 150 determines that the parameter "speed" satisfies the warning condition when the parameter "speed" is "OO km / h or more". The priority will be described later. Here, the figure is an example, and the parameters related to the operation of the vehicle are not limited to those shown in the warning condition table 191 and other information may be stored. For example, as the above-mentioned malfunction of the vehicle, a warning condition that can warn of "fuel decrease", "engine speed excess", etc. may be stored. This may be, for example, that the value from the fuel sensor provided in the vehicle 200 is equal to or less than a predetermined threshold value, and that the engine speed is equal to or greater than a predetermined threshold value. Further, as the above-mentioned malfunction of the automatic driving function, a warning condition capable of warning of "error of communication module" and "damage of vehicle camera" may be stored. This may be, for example, that the data from the vehicle 200 is not received and that the video data from the image pickup unit of the vehicle 200 is not input. Other conditions that should be warned may include information on detection of falling objects on the road, poor physical condition of passengers, traffic jam information, road construction that may affect the operation of vehicles, construction of road equipment, etc. ..

The storage unit 190 is typically realized by various recording media such as an HDD, SSD, and flash memory, and has a function of storing various programs and various data required for operating the server 100. The storage unit 190 stores the above-mentioned warning condition table 191. The warning condition table 191 may be stored in a separate storage device different from the server 100, and the determination unit 150 may read the determination conditions from the storage device.

<Vehicle>
FIG. 3 is a block diagram of a vehicle 200 according to an embodiment of the present invention. The vehicle 200 includes a driving control unit 220, an in-vehicle and service control unit 250. These control units may be typically realized by an electronic control unit (ECU). Here, the operation control unit 220 controls the operation and running of the vehicle 200. The vehicle interior and service control unit 250 controls the vehicle interior environment. In this way, by separating the functional unit that controls the running of the vehicle 200 and the functional unit that controls the environment inside the vehicle, safety is ensured and it is easy to identify the cause when an abnormality is detected. Or, the division of responsibilities can be clarified.

The operation control unit 220 includes an information acquisition unit 221, a driving force output device control unit (engine / motor ECU) 222, a brake control unit (brake ECU) 223, and a steering control unit (steering ECU) 224. The information acquisition unit 221 is connected to a position information acquisition unit 201, a vehicle speed sensor 202, an acceleration sensor 203, an angular velocity sensor 204, a steering angle sensor 205, a distance measurement sensor 206, and an external image pickup unit 207, and is acquired by these sensors and functional units. Get the measured value.

The position information acquisition unit 201 acquires the position information of the current position of the vehicle 200 by using, for example, GNSS (Global Navigation Satellite System). Further, the position information acquisition unit 201 is a sensor that detects a three-dimensional angular velocity and acceleration, and may include, for example, an IMU (inertial measurement unit). The vehicle speed sensor 202 detects the speed of the vehicle 200. The acceleration sensor 203 detects the acceleration of the vehicle 200. The angular velocity sensor 204 detects the rotational angular velocity (yaw rate) of the vehicle 200. The steering angle sensor 205 detects the steering angle (steering wheel steering angle) of the vehicle 200. The range-finding sensor 206 is a sensor that detects the presence or absence of an object (vehicle, obstacle, pedestrian, etc.) around the front of the vehicle 200, the distance between the vehicle 200 and the object, the position of the object, and the like, and LiDAR (light detection). and ranging), millimeter-wave radar, ultrasonic sensor, etc. may be used. The distance measuring sensor 206 may be provided not only in front of the vehicle 200 but also in the left and right rear. The vehicle exterior image pickup unit 207 is, for example, a camera (monocular camera, stereo camera, multi-camera, etc.), and is provided on a plurality of front, rear, left, and right sides of the vehicle to photograph the outside of the vehicle 200. The object to be photographed by the external image pickup unit 207 may be information necessary for automatic driving, such as a lane and an obstacle. The data captured by the external image pickup unit 207 may be a moving image or a still image.

The vehicle 200 further includes a driving force output device (engine / motor) 231, a brake device 232, and a steering device 233. The driving force output device control unit 222 controls the driving force output device 231. The brake control unit 223 controls the brake device 232. The steering control unit 224 controls the steering device 234. The operation control unit 220 sets the vehicle 200 as a preset operation route based on the current position, vehicle speed, steering angle, moving image outside the vehicle, presence / absence of obstacles, etc. of the vehicle 200 acquired from the various sensors described above. Move or stop with. The operation control unit 220 generates a control signal for moving / stopping the vehicle 200 on the route, and outputs the control signal to the driving force output device control unit 222, the brake control unit 223, and the steering control unit 224. The driving force output device control unit 222, the brake control unit 223, and the steering control unit 224 control the driving force output device 231, the brake device 232, and the steering device 233, respectively, based on the control signals. It should be noted that existing technology may be used for the control of automatic operation.

The vehicle interior and the service control unit 250 include a communication control unit 251 and an information acquisition unit 252. The information acquisition unit 252 controls various devices provided in the vehicle 200 and acquires information from the various devices. For example, the information acquisition unit 252 acquires the data captured by the vehicle exterior image pickup unit 209. The vehicle exterior image pickup unit 209 is, for example, a camera, which is provided, for example, on the front, rear, left, and right outside the vehicle 200, and captures a moving image of the outside of the vehicle. The moving image data captured by the vehicle exterior imaging unit 209 is transmitted to the server 100 by the communication control unit 251. The moving image data transmitted to the server 100 is displayed on the display device 170 and used for remote monitoring by the observer.

In addition, the information acquisition unit 252 acquires the data captured by the in-vehicle image pickup unit 210. The vehicle interior image pickup unit 210 is, for example, a camera, which is provided at a plurality of doors at the entrance / exit door of the vehicle, a place where the inside of the vehicle can be glanced, and the like, and photographs the inside of the vehicle 200. The data captured by the in-vehicle image pickup unit 210 may be a moving image or a still image. Further, for example, the vehicle interior of the vehicle 200 may be provided with a speaker, a microphone, a display, etc. (not shown) in addition to the vehicle interior image pickup unit 210 as various devices. The speaker outputs guidance such as a stop and a fare, a warning voice at the time of abnormality, and the like in the vehicle 200. The microphone records voice inside and outside the vehicle. The display displays information on the above-mentioned stops, fares, etc., warning messages in the event of an abnormality, and the like. The information acquisition unit 252 acquires information output by each device from each of the above-mentioned devices in the vehicle. The vehicle interior and the service control unit 250 transmit various acquired information to the operation management system 600, that is, to the server 100. It should be noted that these various types of information may be transmitted at predetermined time intervals, and may be transmitted, for example, every second. Further, the vehicle interior and the service control unit 250 control the various devices described above based on the control instructions transmitted from the server 100.

Further, the information acquisition unit 252 may acquire the measured values acquired by various sensors from the sensor group 260 provided in the vehicle. The sensor group 260 may be, for example, a motion sensor, an exhalation sensor, a temperature sensor, a heat sensor, a smoke sensor, or the like, but is not limited thereto.

The communication control unit 251 controls communication (information exchange) between the vehicle 200 and the server 100 via the network 500 by the communication I / F (interface) 208. Further, the communication control unit 251 may control communication between the vehicles 200 and communication between the roadside unit installed on the road and the vehicle 200. The communication control unit 251 transmits the various data acquired by the information acquisition units 221,252 described above to the server 100 as "a plurality of parameters related to the operation of the vehicle".

The storage unit 270 is typically realized by various recording media such as HDD (Hard Disc Drive), SSD (Solid State Drive), and flash memory, and can store various programs and data required for operating the vehicle 200. It has a function to store (store). Further, the storage unit 270 may store a moving image taken by the vehicle exterior image pickup unit 209 and the vehicle interior image pickup unit 210. Further, the storage unit 270 may temporarily store the above-mentioned parameters related to the operation of the vehicle 200 before transmitting them to the server 100.

<Management screen>
Here, one screen (management screen) displayed on the display device 170 based on the display information generated by the generation unit 113 will be described with reference to FIGS. 5 to 8. The management screen is a screen that the administrator 400 pays attention to when remotely monitoring the vehicle 200, and is displayed based on the display information generated by the generation unit 113 of the server 100. The figure is an example, and the present invention is not limited to this.

FIG. 5 is a schematic view of the management screen 10 according to the embodiment of the present invention. The management screen 10 includes a list 11 of vehicles associated with the manager 400 as vehicles to be managed by the manager 400. The list 11 of vehicles may be in a list format or may be displayed separately by an icon. Information about the vehicle selected in the vehicle list 11 (“01 HOGE” in the example of the figure) is displayed on the display device 170. The tab 12 allows the administrator 400 to select the type of information to be displayed on the management screen 10. In the example of the figure, it is a screen example of "vehicle details". The first parameter list 13 displays parameters related to the automatic operation function. In the example of FIG. 5, four main parameters, "obstacle detection", "self-position estimation", "automatic control", and "communication", are displayed as the first parameters, and "air conditioner" and "rack temperature" are displayed. Is displayed as a sub. The second parameter list 14 displays parameters related to the operation of the vehicle. In the example of FIG. 5, four main parameters, "engine / motor", "power train", "brake", and "energy", are displayed as the second parameters, and "door" and "outside temperature" are sub. It is displayed. Like the existing vehicle, the meter 15 visually displays the operating state of the vehicle 200, and in the example of FIG. 5, includes a speedometer, a direction indicator, a gear, remaining fuel, a mileage, and the like. ..

The status label 16 displays the status of the parameters (first parameter and second parameter) related to the operation of the vehicle. The status label 16 indicates whether or not the parameter is normal depending on the type of the color. In the example of the figure, the diagonal status label 16 is normal, and the black status label 16A has a defect. It may indicate that the condition (abnormality) is occurring. The color of the status label 16 may be any color as long as it is visible that a defect has occurred. For example, the normal state is shown in green and the defective state is shown in red. You may. The determination unit 150 of the server 100 determines whether or not there is a parameter satisfying the warning condition among the plurality of parameters received by the reception unit 121, and the generation unit 113 determines the parameter display mode for the parameter satisfying the warning condition. Generates display information to be displayed by changing. The output unit 132 changes the color of the status label 16 based on the display information generated by the generation unit 113. That is, the parameter whose status label 16 was green is changed to red.

The generation unit 113 may generate display information that changes the state of the parameter that satisfies the warning condition in the meter 15. For example, in the case of FIG. 5, when the determination unit 150 determines that the speed of the vehicle 200 satisfies the warning condition, the generation unit 113 may change the color of the speed label 17. Further, the management screen 10 may include a command list 18 for remotely controlling the vehicle 200, or may include a list 19 of camera images outside / inside the vehicle.

As described above, according to one embodiment of the present invention, a plurality of parameters relating to the operation of the vehicle 200 are classified according to the type of the parameter and displayed on one screen. Then, on one screen, the parameters satisfying the warning condition for issuing a warning are changed from the normal display mode and displayed in different modes. Therefore, the administrator 400 can immediately confirm that the defect has occurred and can quickly grasp which type the parameter in which the defect has occurred is classified. This makes it possible to support the administrator 400 in determining the action to be taken when a problem occurs.

Further, according to one embodiment of the present invention, the generation unit 113 divides a plurality of parameters into a first parameter related to the automatic driving function of the vehicle and a second parameter related to the operating state of the vehicle, and the first parameter. Display information for displaying one screen including an area for displaying all together and an area for displaying the second parameter collectively is generated. As a result, the administrator 400 can easily grasp whether the parameter in which the problem has occurred is related to the automatic driving function or the vehicle itself. Here, when a problem occurs in the parameter related to the automatic driving function, the contact point to be contacted by the manager 400 is, for example, the occupant 300 of the vehicle 200. On the other hand, if there is a problem with the parameters related to the operation of the vehicle, for example, the manufacturer of the vehicle is requested for support. By classifying the parameters in this way, the administrator 400 can immediately determine the target to be contacted according to the type of the parameter in which the problem has occurred.

Further, according to one embodiment of the present invention, display information indicating the state of the parameter is generated depending on the type of color, and the color on one screen is changed and displayed for the parameter satisfying the warning condition. Therefore, the manager 400 can immediately determine what is the parameter in which the vehicle malfunction occurs.

The storage unit 190 may further store the priority regarding the likelihood of occurrence of a warning condition for a plurality of parameters. With reference to FIG. 4, the priority may be further associated and stored in the parameter. The susceptibility to a warning condition means the susceptibility to a state to be warned. The priority may be set in advance by the administrator 400, or may be set by a learning unit (not shown) according to the control instruction of the administrator 400. The generation unit 113 may generate display information for displaying a plurality of parameters classified for each type of parameter from the upper side on one screen in descending order of priority in the classification. In the example of the management screen 10 of FIG. 5, "obstacle detection" is likely to occur in the first parameter list 13, and "engine / motor" malfunction is likely to occur in the second parameter list 14. ..

As described above, according to the embodiment of the present invention, among the plurality of parameters classified by type, the parameter in which a defect is likely to occur is displayed on the upper side on the management screen. As a human habit, the line of sight goes from top to bottom, so that the administrator 400 can be made to pay attention to the parameters that are likely to cause problems.

The generation unit 113 may generate display information so that the parameters to be displayed on one screen among the plurality of parameters are different depending on the type of vehicle. This makes it possible to provide a flexible operation management system 600 according to the type of vehicle. In the case of FIG. 5, the "air conditioner" is classified in the first parameter list 13 relating to the automatic driving function, but the "air conditioner" may be classified into the second parameter list 14 relating to the operation of the vehicle. However, the control board for automatic operation tends to be heated, and the rack on which the control board is placed needs to be cooled. Therefore, when a problem occurs in the parameters related to the automatic operation function, if heat is the cause, the administrator 400 determines the possibility of insufficient cooling by classifying the "air conditioner" into the first parameter list 13. be able to.

Further, according to one embodiment of the present invention, the receiving unit 121 is an external or internal image of the vehicle 200 as one of a plurality of parameters relating to the operation of the vehicle 200, which is captured by a camera installed in the vehicle 200. Upon receiving at least one of the images in the above, the generation unit 113 may generate display information for displaying one screen including at least a section for displaying the image. As a result, a list 19 of camera images inside / outside the vehicle is displayed. By doing so, when the state of the parameter changes, the manager 400 can confirm the state inside or outside the vehicle, which helps to determine the cause of the change in the state of the parameter, that is, the cause of the defect.

Further, according to one embodiment of the present invention, the receiving unit 121 receives a plurality of parameters relating to the operation of the vehicle from the plurality of vehicles 200A to 200C, and the generating unit 113 receives each of the plurality of vehicles 200A to 200C. Display information for displaying one screen may be generated. As a result, the management screen 10 can be displayed for the vehicle list 11 and the vehicle selected from the vehicle list 11, and the operation management system 600 with high usability can be provided.

The management screen 10 in FIG. 5 is an example, and the present invention is not limited thereto. For example, as in the management screen 20 of FIG. 6, a vehicle list display area 21, an in-vehicle / outside image display area 22, a parameter display area 23 related to an automatic driving function, a parameter display area 24 related to vehicle operation, and various command display areas 25 are displayed. If it is included, it is included in the scope of the present invention.

Further, as shown in the management screen 30 of FIG. 7, if it includes at least a parameter display area 31 related to the automatic driving function and a parameter display area 32 related to the operating state of the vehicle, it is included in the category of the present invention. According to one embodiment of the present invention, as shown in FIGS. 6 and 7, when one screen is divided into two in the vertical direction, the generation unit 113 is the first on the left side when facing the one screen. Display information may be generated that displays the parameters and at least displays the second parameter on the right side of one screen. Since humans have a habit of running their eyes from the upper left to the lower right, by displaying the parameters related to the automatic driving function on the left side as shown in FIG. 7, the administrator 400 is informed about the parameters related to the automatic driving function. Can be visually recognized.

Next, the control method of the server 100 described above will be described with reference to the drawings. FIG. 8 is an example of a flowchart of the control method by the server 100. First, a warning condition for issuing a warning is stored in a predetermined storage unit for each of a plurality of parameters related to the operation of the vehicle (step S11). The generation unit 113 classifies a plurality of parameters according to the type of the parameter, and generates display information to be displayed on one screen in a display mode according to the state of the parameter (step S12). Then, the receiving unit 121 receives a plurality of parameters related to the operation of the vehicle from the vehicle 200 (step S13). Here, the parameters related to the operation of the vehicle may be transmitted from the vehicle 200 at regular intervals (for example, every 15 minutes) by collecting the parameters before that, or may be transmitted one by one (for example, every minute). good. When transmitted at regular intervals, the parameters are temporarily stored in the storage unit 270 of the vehicle 200. The determination unit 150 determines whether or not there is a parameter satisfying the warning condition (step S14). When there is a parameter satisfying the warning condition (YES in step S13), the generation unit 113 generates display information for the parameter satisfying the warning condition by changing the display mode of the parameter on one screen (step S15). .. Then, the output unit 132 outputs the display information to the display device 170 for displaying one screen (step S16). When there is no parameter satisfying the warning condition (NO in step S13), the output unit 132 outputs the received display information by the plurality of parameters to the display device for displaying one screen (step S17).

Although the present invention has been described with reference to the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and modifications based on the present disclosure. Therefore, it should be noted that these modifications and modifications are included in the scope of the present invention. For example, the functions included in each means, each step, etc. can be rearranged so as not to be logically inconsistent, and a plurality of means, steps, etc. can be combined or divided into one. .. Further, the configurations shown in the above embodiments may be appropriately combined. For example, the functions described separately as the server 100, the vehicle 200, or the display device 170 may be performed only by the server 100. Further, each component described as being provided in the server 100 may be distributed and realized by a plurality of information processing devices.

Further, in the above example, the parameters satisfying the warning condition are represented by the change in the color of the status label 16. However, parameters satisfying the warning condition may be blinked or enlarged. Further, when the parameter cannot be received from the vehicle 200 due to a defect, the parameter displayed on the management screen may be displayed in gray. This makes it possible to notify the user that the parameter has not been received. It should be noted that there may be two or more parameters satisfying the warning condition at the same time. In that case, it goes without saying that the color of the status label 16 of those two or more parameters is changed and displayed. Further, the color of the status label 16 may be determined to be, for example, red, blue, yellow, light blue, or the like, depending on the content of the defect.

In the above description, it has been described that the judgment of the warning condition is performed by the server 100. However, the determination of the warning condition may be performed by the operation control unit 220 of the vehicle 200. Then, based on the determination result in the vehicle 200, only the parameters satisfying the warning conditions and the video may be transmitted to the server 100.

Further, the warning conditions may differ depending on the traveling environment of the vehicle 200. For example, different warning conditions are set according to the place where the vehicle 200 is traveling (residential area, building area, etc.), road conditions (congestion, road width, road surface condition, etc.), and weather conditions (typhoon, strong wind, rainfall, etc.). May be done.

Further, the warning condition table may be updated by providing the vehicle 200 with artificial intelligence (AI) to learn the parts that satisfy the warning condition while the vehicle is running. This makes it possible to provide safe driving that is more in line with the driving environment.

Further, in the above description, the bus has been described as a vehicle. However, as a vehicle, the present invention can be applied to a truck, a taxi, a container for carrying luggage, and the like.

Further, although one embodiment of the invention according to the present invention has been described, it goes without saying that the present invention is not limited to this. For example, the various information described above to be stored in the storage unit 190 of the server 100 may be stored in an external memory different from the server 100 or in the cloud, or may be stored in either storage unit. May be. Further, the display screen is an example, and more information may be displayed or less information may be displayed.

Each functional unit of the server 100 and the vehicle 200 may be realized by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)) or the like. It may be realized by software using a CPU (Central Processing Unit). Further, each functional unit may be realized by one or a plurality of integrated circuits, and the functions of the plurality of functional units may be realized by one integrated circuit. Further, the server 100 described above may be realized by a plurality of server computers, or may be realized by calling an external platform or the like by an API (Application Programming Interface) or the like depending on the function.

When each functional part of the server 100 is realized by software, the server 100 has a CPU that executes an instruction of a program that is software that realizes each function, and the above program and various data are readablely recorded by a computer (or CPU). It is equipped with a ROM (Read Only Memory) or a storage device (these are referred to as "recording media"), a RAM (Random Access Memory) for expanding the above program, and the like. Then, the object of the present invention is achieved by the computer (or CPU) reading the program from the recording medium and executing the program. That is, the server 100 according to the present invention functions as each of the above-mentioned components by executing the program loaded on the RAM by the CPU. As the recording medium, a “non-temporary tangible medium”, for example, a semiconductor memory, a programmable logic circuit, or the like can be used. Further, the program may be supplied to the computer via an arbitrary transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the above program is embodied by electronic transmission.

The above program is, for example, a script language such as ActionScript, JavaScript (registered trademark), Python, Ruby, C language, C ++, C #, Objective-C, Swift, Java (registered trademark) and other object-oriented programming languages. It can be implemented using a markup language such as HTML5. Further, the description of "section, module, unit" in the claims may be read as "means" or "circuit". For example, the receiving unit can be read as a receiving means or a receiving circuit.

100 Information processing equipment (server)
200A-200C Vehicle 300 Crew 400 Manager (monitor)
500 Network 600 Operation management system 110 Control unit 111 Communication control unit 112 Input / output control unit 113 Generation unit 114 Judgment unit 120 Communication unit 121 Reception unit 122 Transmission unit 130 Input / output unit 131 Input unit 132 Output unit 170 Display device 171 Input reception unit 172 Display unit 190 Storage unit 191 Warning condition table 201 Position information acquisition unit 202 Vehicle speed sensor 203 Acceleration sensor 204 Angle speed sensor 205 Steering angle sensor 207 Distance measurement sensor 208 Communication I / F
209 External image pickup unit 210 Vehicle interior image pickup unit 220 Driving control unit 221 Information acquisition unit 222 Driving force output device control unit 223 Brake control unit 224 Steering control unit 231 Driving force output device 232 Brake device 233 Steering device 240 Storage unit 250 Vehicle interior and service control Unit 251 Communication control unit 252 Vehicle interior control unit 260 Sensor group 270 Storage unit 10 Management screen 11 Vehicle list 12 Tab 13 First parameter list 14 Second parameter list 15 Meter 16, 16A Status label 17 Speed label 18 Command list 19 Inside / outside the vehicle Camera image list 20, 30 Management screen 21 Vehicle list display area 22 Inside / outside image display area 23, 31 Parameter display area related to automatic driving function 24, 32 Parameter display area related to vehicle operation 25 Various command areas

Claims (10)

An information processing device related to an operation management system that manages the operation status of vehicles.
A storage unit that stores warning conditions for issuing a warning for each of the plurality of parameters related to the operation of the vehicle.
A generation unit that divides the plurality of parameters according to the type of the parameter and generates display information to be displayed on one screen in a display mode according to the state of the plurality of parameters.
A receiving unit that receives the plurality of parameters related to the operation of the vehicle from the vehicle, and
Equipped with
The generation unit generates display information for changing the display mode of the parameters on the one screen for the parameters satisfying the warning condition among the plurality of parameters received by the reception unit.
Information processing equipment. The generation unit divides the plurality of parameters into a first parameter related to the automatic driving function of the vehicle and a second parameter related to the operating state of the vehicle, and displays the first parameter collectively. Generate display information for displaying the one screen including the area for displaying the second parameter collectively.
The information processing apparatus according to claim 1. When the one screen is divided into two in the vertical direction, the generation unit displays the first parameter on the left side of the one screen and the second parameter on the right side of the one screen. Generate display information to display at least
The information processing apparatus according to claim 2. The generation unit generates the display information indicating the state of the parameter according to the type of color, and generates display information for displaying the parameter satisfying the warning condition by changing the color on the one screen.
The information processing apparatus according to any one of claims 1 to 3. The storage unit further stores the priority regarding the likelihood of occurrence of the warning condition for the plurality of parameters.
The generation unit generates display information for displaying the plurality of parameters classified according to the type of the parameter from the upper side on the one screen in the order of higher priority in the classification.
The information processing apparatus according to any one of claims 1 to 4. The generation unit makes the parameter to be displayed on the one screen different from the plurality of parameters according to the type of the vehicle.
The information processing apparatus according to any one of claims 1 to 5. The receiving unit receives at least one image of the outside or the inside of the vehicle captured by a camera installed in the vehicle as one of a plurality of parameters relating to the operation of the vehicle.
The generation unit generates display information for displaying the one screen including at least a section for displaying the image.
The information processing apparatus according to any one of claims 1 to 6, wherein the information processing apparatus is characterized. The receiving unit receives a plurality of parameters related to the operation of the vehicle from the plurality of vehicles, and receives the plurality of parameters.
The generation unit generates display information for displaying the one screen for each of the plurality of vehicles.
The information processing apparatus according to any one of claims 1 to 7. The information processing device related to the operation management system that manages the operation status of the vehicle
A step of storing a warning condition for issuing a warning in a predetermined storage unit for each of a plurality of parameters related to the operation of the vehicle, and a step of storing the warning condition.
A step of dividing the plurality of parameters according to the type of the parameter and generating display information to be displayed on one screen with a display target according to the state of the plurality of parameters.
A step of receiving the plurality of parameters relating to the operation of the vehicle from the vehicle, and
Among the plurality of parameters received in the receiving step, for the parameter satisfying the warning condition, a step of generating display information for changing the display mode of the parameter on the one screen and displaying the parameter.
How to control the information processing device. For information processing equipment related to the operation management system that manages the operation status of vehicles,
A storage function for storing warning conditions for issuing a warning for each of a plurality of parameters related to the operation of the vehicle in a predetermined storage unit, and
A generation function that divides the plurality of parameters according to the type of the parameter and generates display information to be displayed on one screen with a display target according to the state of the plurality of parameters.
A reception function for receiving the plurality of parameters related to the operation of the vehicle from the vehicle, and
Among the plurality of parameters received by the reception function, display information for changing the display target of the parameter on the one screen is generated for the parameter satisfying the warning condition.
Information processing device control program.

Images