JP2021174470A - Server device - Google Patents

Abstract

To make it possible to more efficiently identify a defect detected when a vehicle is running.SOLUTION: While a server device comprises a communication unit and a control unit that transmits/receives information to/from another device via the communication unit, the control unit receives from a vehicle, positional information for indicating a position when a predetermined event is detected while the vehicle is running, and the control unit transmits the positional information to a terminal device for output by the terminal device after the vehicle has finished running.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to a server device.

There is known a technique for collecting information indicating a vehicle defect and using it for vehicle inspection. For example, Patent Document 1 discloses a system in which data on a vehicle defect is sent from an in-vehicle device to a center and data on the defect is acquired from the center at the time of vehicle inspection.

Japanese Unexamined Patent Publication No. 2005-219717

There is room for efficiency in the work of identifying defects detected when the vehicle is running.

In the following, a server device or the like that can more efficiently identify a defect detected when the vehicle is running will be disclosed.

The server device in the present disclosure includes a communication unit and a control unit that transmits / receives information to and from other devices via the communication unit, and the control unit detects a predetermined event while the vehicle is traveling. The position information indicating the position of is received from the vehicle, and the position information is sent to the terminal device in order to be output by the terminal device after the vehicle has finished traveling.

According to the server device and the like in the present disclosure, it is possible to more efficiently identify a defect detected when the vehicle is running.

It is a figure which shows the configuration example of an information processing system. It is a figure which shows the configuration example of a server apparatus. It is a figure which shows the configuration example of a terminal device. It is a figure which shows the configuration example of a vehicle. It is a sequence diagram which shows the operation example of an information processing system. It is a figure which shows the output example of a terminal device. It is a sequence diagram which shows the operation example of an information processing system.

Hereinafter, embodiments will be described.

FIG. 1 is a diagram showing a configuration example of an information processing system according to an embodiment. The information processing system 1 includes, for example, a server device 10, a terminal device 12, and a vehicle 13 that are connected to each other via a network 11 so as to be able to communicate with each other. The server device 10 is a computer. The terminal device 12 is, for example, a portable information terminal device such as a smartphone or a tablet terminal device, but may be a personal computer. The vehicle 13 is a passenger car, a multipurpose vehicle, or the like having a control / communication function. The network 11 is, for example, the Internet, but includes an ad hoc network, a LAN, a MAN (Metropolitan Area Network), another network, or a combination thereof. The number of each component of the information processing system 1 may be larger than that shown here.

When the vehicle 13 travels at a specific point, various defects such as abnormal noise, offensive odor, and vibration may be detected by the occupant. For example, when abnormal vibration is generated by passing through unevenness of the road surface, abnormal noise or odor is generated during acceleration / deceleration, steering, or sudden braking to avoid obstacles. When inspecting and repairing a defect after the vehicle 13 has finished traveling, it is necessary to reproduce and identify the defect itself. In order to reproduce the defect, it is convenient for the vehicle 13 to travel again at the point where the defect is detected. For that purpose, it is necessary to identify the point where the defect is detected. The information processing system 1 supports identifying a point where a defect can be detected by an occupant when the vehicle 13 is traveling, and contributes to efficient identification of the defect.

In the information processing system 1, the vehicle 13 sends position information indicating a position when a predetermined event is detected during traveling to the server device 10. The predetermined event is the motion state of the vehicle 13 or the behavior of the occupant of the vehicle 13 which may suggest the detection of the defect by the occupant. The server device 10 sends the position information received from the vehicle 13 to the terminal device 12 for output by the terminal device 12 after the vehicle 13 has finished traveling. The worker who inspects and maintains the vehicle 13 can identify a point for reproducing the defect by the output of the terminal device 12 without tracing the entire traveling history of the vehicle 13. That is, the defect can be identified more efficiently.

FIG. 2 shows a configuration example of the server device 10. The server device 10 has a communication unit 20, a storage unit 21, and a control unit 22. The server device 10 may execute the operation in the present embodiment by communicating with and cooperating with another server device having an equivalent configuration.

The communication unit 20 has one or more communication modules corresponding to a wired or wireless LAN standard for connecting to the network 11. In the present embodiment, the server device 10 is connected to the network 11 via the communication unit 20 and performs information communication with another device via the network 11.

The storage unit 21 has, for example, a semiconductor memory, a magnetic memory, an optical memory, or the like. The storage unit 21 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 21 stores arbitrary information, control / processing programs, and the like used for the operation of the server device 10.

The control unit 22 has, for example, one or more general-purpose processors such as a CPU (Central Processing Unit), or one or more dedicated processors specialized for a specific process. Alternatively, the control unit 22 may have one or more dedicated circuits such as FPGA (Field-Programmable Gate Array) and ASIC (Application Specific Integrated Circuit). The control unit 22 comprehensively controls the operation of the server device 10 by operating according to a control / processing program or operating according to an operation procedure implemented as a circuit. Then, the control unit 22 transmits and receives various information to and from the terminal device 12 and the vehicle 13 via the communication unit 20, and executes the operation according to the present embodiment.

FIG. 3 shows a configuration example of the terminal device 12. The terminal device 12 is an information terminal device such as a smartphone, a tablet terminal device, or a personal computer. The terminal device 12 includes an input / output unit 30, a communication unit 31, a storage unit 32, and a control unit 33.

The input / output unit 30 has an input interface that detects the user's input and sends the input information to the control unit 33. Such an input interface may include, for example, a physical key, a capacitive key, a touch screen integrally provided with a panel display, various pointing devices, a microphone that accepts voice input, a camera that captures a captured image or an image code, and the like. It is an input interface. Further, the input / output unit 30 has an output interface that outputs information generated by the control unit 33 or received from another device to the user. Such an output interface is an arbitrary output interface including, for example, an external or built-in display that outputs information as an image / video, a speaker that outputs information as audio, or a connection interface with an external output device.

The communication unit 31 has a communication module corresponding to a wired or wireless LAN standard, a module corresponding to a mobile communication standard such as 4G (4th Generation) and 5G (5th Generation), and the like. The terminal device 12 is connected to the network 11 by the communication unit 31 via a nearby router device or a mobile communication base station, and performs information communication with another device via the network 11.

The storage unit 32 has, for example, a semiconductor memory, a magnetic memory, an optical memory, or the like. The storage unit 32 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 32 stores arbitrary information, control / processing programs, and the like used for the operation of the terminal device 12.

The control unit 33 has, for example, one or more general-purpose processors such as a CPU and an MPU (Micro Processing Unit), or one or more dedicated processors specialized for a specific process. Alternatively, the control unit 33 may have one or more dedicated circuits such as FPGA and ASIC. The control unit 33 comprehensively controls the operation of the terminal device 12 by operating according to a control / processing program or operating according to an operation procedure implemented as a circuit. Then, the control unit 33 transmits and receives various information to and from the server device 10 and the like via the communication unit 31, and executes the operation according to the present embodiment.

FIG. 4 shows a configuration example of the control device 40 mounted on the vehicle 13. The control device 40 includes a communication unit 41, a positioning unit 42, an input / output unit 43, an imaging unit 44, a detection unit 45, a storage unit 46, and a control unit 47. The control device 40 is, for example, a navigation device, a mobile phone, a smartphone, a tablet, or a PC. The vehicle 13 may be driven by the driver, or the driving may be automated at an arbitrary level. The level of automation is, for example, one of Level 1 to Level 5 in the SAE (Society of Automotive Engineers) leveling.

The communication unit 41 includes one or more communication interfaces. The communication interface is an interface compatible with mobile communication standards such as LTE, 4G, or 5G. The communication unit 41 receives the information used for the operation of the control device 40, and transmits the information obtained by the operation of the control device 40. The control device 40 is connected to the network 11 by the communication unit 41 via a base station for mobile communication, and performs information communication with another device via the network 11.

The positioning unit 42 includes one or more GNSS receivers. GNSS includes, for example, at least one of GPS, QZSS, GLONASS, and Galileo. The positioning unit 42 acquires the position information of the vehicle 13.

The input / output unit 43 includes one or more input interfaces and one or more output interfaces. The input interface is, for example, a physical key, a capacitive key, a pointing device, a touch screen integrated with a display, or a microphone that accepts voice input. The output interface is, for example, a display or a speaker. The display is, for example, an LCD or an organic EL display. The input / output unit 43 accepts an operation for inputting information used for the operation of the control device 40, sends the input information to the control unit 47, and outputs information obtained by the operation of the control device 40.

The image pickup unit 44 includes one or more cameras and a control circuit thereof provided at a position where the surroundings of the vehicle 13 or the interior of the vehicle can be photographed. The camera included in the image pickup unit 44 may be a monocular camera or a stereo camera. The imaging unit 44 images the surroundings of the vehicle 13 or the interior of the vehicle at arbitrary time intervals, and sends the captured images to the control unit 47. Further, the captured image may be associated with voice information around the vehicle 13 or in the vehicle interior acquired from the input interface of the input / output unit 43.

The detection unit 45 has sensors for detecting the motion state of the vehicle 13. The sensors include, for example, sensors that detect motion states such as vehicle speed, acceleration, steering angle, inclination, and braking operation of the vehicle 13. The detection unit 45 detects the information indicating the motion state of the vehicle 13 by the sensors and sends it to the control unit 47.

The storage unit 46 includes one or more semiconductor memories, one or more magnetic memories, one or more optical memories, or a combination of at least two of them. The semiconductor memory is, for example, RAM or ROM. The RAM is, for example, SRAM or DRAM. The ROM is, for example, an EEPROM. The storage unit 46 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 46 stores the information used for the operation of the control device 40 and the information obtained by the operation of the control device 40.

The control unit 47 has one or more general-purpose processors such as a CPU and an MPU, or one or more dedicated processors specialized for a specific process. Alternatively, the control unit 47 may have one or more dedicated circuits such as FPGA and ASIC. The control unit 47 comprehensively controls the operations of the control device 40 and the vehicle 13 by operating according to a control / processing program or operating according to an operation procedure implemented as a circuit. Then, the control unit 47 sends and receives various information to and from the server device 10 via the communication unit 41, and executes the operation according to the present embodiment.

FIG. 5 is a sequence diagram showing an operation example of the information processing system 1. FIG. 5 shows an operation procedure of the cooperative operation by the server device 10, the terminal device 12, and the vehicle 13. The procedure of FIG. 5 is executed from the running of the vehicle 13 to the post-running.

In step S500, the vehicle 13 sends the position information to the server device 10. The control unit 47 of the vehicle 13 sends the current position of the vehicle 13 acquired from the positioning unit 42 to the server device 10 via the communication unit 41. The control unit 22 of the server device 10 receives the position information via the communication unit 20. Step S500 is repeated at arbitrary time intervals (eg, intervals of a few milliseconds to a few seconds).

In step S502, the vehicle 13 sends the event information in the vehicle 13 to the server device 10. The event information is, for example, information indicating a motion state such as vibration, acceleration / deceleration, steering angle, and braking operation of the vehicle 13 detected by the detection unit 45 of the vehicle 13. Further, the event information may include input by the occupant of the vehicle 13 to the input / output unit 43. For example, when the occupant detects an event such as vibration, abnormal noise, or odor that is suspected to be a malfunction of the vehicle 13, the occupant inputs to the input / output unit 43 to notify the detection. The input / output unit 43 may have, for example, a dedicated button or the like for the occupant to perform such an input. The control unit 47 of the vehicle 13 sends the event information to the server device 10 via the communication unit 41. The control unit 22 of the server device 10 receives event information via the communication unit 20.

In step S504, the vehicle 13 sends the captured image to the server device 10. The control unit 47 of the vehicle 13 sends the captured image of the surroundings of the vehicle 13 or the interior of the vehicle captured by the imaging unit 44 to the server device 10 via the communication unit 41. The control unit 22 of the server device 10 receives the captured image via the communication unit 20. Step S504 is repeated at arbitrary time intervals (eg, intervals of a few milliseconds to a few seconds).

In step S506, the server device 10 detects a predetermined event from the event information and determines whether or not to send the position information of the vehicle 13 or the like to the terminal device 12. For example, the control unit 22 of the server device 10 detects a predetermined event from the event information of the vehicle 13. The control unit 22 determines that the position information or the like is transmitted when the predetermined event is detected, and determines that the position information or the like is not transmitted when the predetermined event is not detected. The predetermined event is, for example, a vibration exceeding an arbitrary reference amplitude that suggests that the vehicle 13 has passed the unevenness of the road surface, or an arbitrary that suggests a sudden change of direction of the vehicle 13 to avoid an obstacle. Acceleration / deceleration, steering, or tilting that exceeds the standard of, or braking operation that suggests sudden braking. Alternatively, the predetermined event is an input by the occupant indicating the detection of the event suspected of being defective. Alternatively, the behavior of the occupant who is suspected of having a problem detected by the control unit 22 of the server device 10 from the captured image sent from the vehicle 13 is also included in the predetermined event. Such behavior is, for example, a suspicious display or gesture that the occupant indicates by suspecting some kind of malfunction. Such facial expressions or gestures are stored in the storage unit 21 in advance. The control unit 22 detects the behavior of the occupant suspected of having a problem by performing image recognition / matching processing on the captured image. Alternatively, the captured image is accompanied by voice information recorded at the same time, and the control unit 22 detects a predetermined event by detecting from the voice information a word that is stored in the storage unit 21 in advance and is suspected of having a problem. You may. The control unit 22 stores the position information, the time, and the captured image when a predetermined event is detected in the storage unit 21. The control unit 22 may acquire the time by its own timekeeping function, or may acquire the time from the time stamp sent from the vehicle 13 together with the event information or the captured image.

The control unit 22 can determine the transmission of the position information or the like to the terminal device 12 on condition that one or more of the above-mentioned predetermined events are detected. By setting the detection of two or more predetermined events as a condition, the accuracy of detection can be further improved.

If it is determined in step S506 that the position information or the like is to be transmitted, in step S508, the server device 10 sends the position information, the time, and the captured image when a predetermined event of the vehicle 13 is detected to the terminal device 12. The control unit 22 of the server device 10 sends the position information, the time, and the captured image stored in the storage unit 21 when a predetermined event is detected to the terminal device 12 via the communication unit 20. The control unit 33 of the terminal device 12 receives position information and the like via the communication unit 31.

After the traveling of the vehicle 13 is completed, in step S510, the terminal device 12 outputs the position information, the time, and the captured image of the vehicle 13. For example, when the vehicle 13 moves to the inspection / maintenance facility at the end of traveling and undergoes inspection / maintenance by a worker, step S510 is executed. For example, in response to the operation input of the worker, the control unit 33 of the terminal device 12 outputs the position information, the time, and the captured image by the input / output unit 30 and presents them to the worker. For example, as shown in FIG. 6, the terminal device 12 displays the position information and the time display 62 mapped on the map 61 on the display screen 60. Further, the terminal device 12 displays the captured image 63 at that point in response to, for example, a user's tap on the display 62.

The terminal device 12 does not present the position information or the like in the entire traveling of the vehicle 13, but presents the position information or the like when a predetermined event suspected to be a malfunction is detected to the worker. Therefore, the worker can easily identify the point where the reproduction of the defect should be confirmed by the position information. In addition, by displaying the time together, for example, the worker can identify whether the time zone in which the problem occurs is daytime or nighttime. Identifying the time zone contributes to the worker's more specific inference of the possibility of failure. For example, it is possible to infer that the driver's reaction to an obstacle on the road or a passerby is delayed due to a decrease in visibility at night, resulting in sudden steering, sudden braking, and abnormal noise. Alternatively, by visually recognizing the surrounding environment from the captured image, the worker can grasp, for example, the presence of unevenness on the road surface, obstacles on the road, etc. before going to the site.

In the procedure of FIG. 5, step S508 may be executed each time the control unit 22 of the server device 10 detects a predetermined event, or may be executed once, for example, after the vehicle 13 has finished traveling. Every time the control unit 22 detects a predetermined event, the position information or the like is stored in the storage unit 21, and the terminal device 12 requests the position information or the like from the server device 10 in response to the input of the worker to the terminal device 12. By doing so, a combination of one or more position information stored in the storage unit 21 and the captured image may be sent to the terminal device 12.

FIG. 7 shows a procedure in a modified example of the present embodiment. The procedure of FIG. 7 is different from that of FIG. 5 in that step S700 is executed instead of step S506 in FIG. 5 and step S502 is omitted. Other steps are the same as in FIG.

In step S700, the control device 40 of the vehicle 13 detects a predetermined state and determines transmission of position information and the like before transmitting the event information to the server device 10. Then, the position information and the captured image when the predetermined state is detected are sent to the server device 10. According to such a modification, the processing load of the server device 10 can be reduced as compared with the case where the server device 10 sequentially sends the position information and the event information and the server device 10 detects a predetermined event.

As described above, according to the present embodiment, it is possible to grasp the point for reproducing the defect. That is, the defect can be identified more efficiently.

In the above-described embodiment, the processing / control program that defines the operation of the terminal device 12 and the control device 40 is stored in the storage unit 21 of the server device 10 or the storage unit of another server device, and is stored via the network 11. It may be downloaded to a device, or it may be stored in a portable, non-transient recording / storage medium that can be read by each device, and each device may read from the medium.

Although the embodiments have been described above based on the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and modifications based on the present disclosure. It should be noted, therefore, that these modifications and modifications are within the scope of this disclosure. For example, the functions included in each means, each step, etc. can be rearranged so as not to be logically inconsistent, and a plurality of means, steps, etc. can be combined or divided into one. ..

The above is summarized as follows.

[Appendix 1]
With the communication department
It has a control unit that sends and receives information to and from other devices via the communication unit.
The control unit
Receives position information from the vehicle indicating the position when a predetermined event is detected while the vehicle is running, and sends the position information to the terminal device for output by the terminal device after the vehicle has finished running.
Server device.

[Appendix 2]
In Appendix 1,
The control unit associates the time when the predetermined event is detected with the position information and sends it to the terminal device.
Server device.

[Appendix 3]
In Appendix 1 or 2,
The control unit receives an image captured around the vehicle or inside the vehicle when the predetermined event is detected from the vehicle, and sends the captured image to the terminal device in association with the position information.
Server device.

[Appendix 4]
In Appendix 3,
The predetermined event includes a predetermined behavior of the occupant of the vehicle detected from the captured image.
Server device.

[Appendix 5]
In any of Appendix 1-4,
The predetermined event includes a predetermined motion state of the vehicle.
Server device.

[Appendix 6]
In any of Appendix 1-5,
The predetermined event includes an operation input by the occupant of the vehicle.
Server device.

[Appendix 7]
Including the server device and vehicle according to any one of Supplementary Notes 1 to 6.
Information processing system.

[Appendix 8]
A vehicle control device having a communication unit and a control unit for transmitting and receiving information to and from other devices via the communication unit.
The control unit sends position information indicating a position when a predetermined event is detected while the vehicle is running to the server device, and the position information is output from the server device by the terminal device after the running of the vehicle is completed. Is sent to the terminal device
Control device.

[Appendix 9]
In Appendix 8,
The control unit sends the time when the predetermined event is detected to the server device, and the time is associated with the position information and sent from the server device to the terminal device.
Control device.

[Appendix 10]
In Appendix 8 or 9,
The control unit sends an image captured around the vehicle or inside the vehicle when the predetermined event is detected to the server device, and the captured image is associated with the position information from the server device to the terminal. Sent to the device,
Control device.

[Appendix 11]
In Appendix 10,
The predetermined event includes a predetermined behavior of the occupant of the vehicle detected from the captured image.
Control device.

[Appendix 12]
In any of Appendix 8-11,
The predetermined event includes a predetermined motion state of the vehicle.
Control device.

[Appendix 13]
In Appendix 12,
The predetermined event includes an operation input by the occupant of the vehicle.
Control device.

[Appendix 14]
The control device according to any one of Supplementary note 8 to 13 is provided.
vehicle.

[Appendix 15]
It is an operation method of an information processing system having a server device and a vehicle that send and receive information to each other.
The vehicle sends position information indicating a position when a predetermined event is detected during traveling to the server device.
The server device sends the position information to the terminal device for output by the terminal device after the vehicle has finished traveling.
How it works.

[Appendix 16]
In Appendix 15,
The server device sends the time when the predetermined event is detected to the terminal device in association with the position information.
How it works.

[Appendix 17]
In Appendix 15 or 16,
The vehicle sends an image captured around the vehicle or inside the vehicle when the predetermined event is detected to the server device.
The server device sends the captured image to the terminal device in association with the position information.
How it works.

[Appendix 18]
In Appendix 17,
The predetermined event includes a predetermined behavior of the occupant of the vehicle detected from the captured image.
How it works.

[Appendix 19]
In any of Appendix 15-18,
The predetermined event includes a predetermined motion state of the vehicle.
How it works.

[Appendix 20]
In claim 19.
The predetermined event includes an operation input by the occupant of the vehicle.
How it works.

1 Information processing system 10 Server device 11 Network 12 Terminal device 13 Vehicle 20, 31, 41 Communication unit 21, 32, 46 Storage unit 22, 33, 47 Control unit 30, 43 Input / output unit 42 Positioning unit 44 Imaging unit 45 Detection unit

Claims (1)

With the communication department
It has a control unit that sends and receives information to and from other devices via the communication unit.
The control unit
Receives position information from the vehicle indicating the position when a predetermined event is detected while the vehicle is running, and sends the position information to the terminal device for output by the terminal device after the vehicle has finished running.
Server device.

Images