JP2017111762A - Information processing apparatus, information processing system, and information processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To accelerate the speed of analysis on a plurality of photographed images of the surroundings of a movable body photographed from the movable body.SOLUTION: An information processing apparatus 10 comprises: an image acquisition part 18A; a specification part 18G; and an analysis part 18H. The image acquisition part 18A acquires photographed images P of the surroundings of a vehicle (movable body). The specification part 18G specifies a photographed image to be processed on the basis of travel state information indicating the travel state of the vehicle (movable body) during photographing of the photographed images. The analysis part 18H analyzes the photographed image specified to be processed.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an information processing apparatus, an information processing system, and an information processing program.

  A system for analyzing a photographed image photographed by an in-vehicle camera and assisting a driver using the analysis result is known.

  For example, Patent Document 1 discloses a system that analyzes a moving image captured by an in-vehicle camera and reflects information indicating a dangerous location on a road on a map using the analysis result.

  However, in the conventional technique, it may take time to analyze a plurality of captured images.

  The present invention has been made in view of the above, and an information processing apparatus, an information processing system, and an information processing capable of realizing an increase in analysis speed for a plurality of captured images taken around a moving object. The purpose is to provide a program.

  In order to solve the above-described problems and achieve the object, an information processing apparatus of the present invention includes an image acquisition unit that acquires a captured image around a moving body, and a traveling state of the moving body at the time of capturing the captured image. And a analyzing unit that analyzes the captured image specified as the processing target.

  According to the present invention, there is an effect that it is possible to increase the analysis speed for a plurality of captured images taken around a moving body.

FIG. 1 is an explanatory diagram of the overall configuration of the information processing system according to the embodiment. FIG. 2 is an example of an overall configuration diagram of the information processing system. FIG. 3 is a block diagram illustrating an example of a functional configuration of the information processing apparatus. FIG. 4 is a schematic diagram illustrating an example of a captured image. FIG. 5 is a schematic diagram illustrating an example of a plurality of captured images. FIG. 6 is a schematic diagram illustrating an example of a captured image area. FIG. 7 is a schematic diagram illustrating an example of a captured image area. FIG. 8 is an explanatory diagram illustrating an example of a speed sign detection process. FIG. 9 is an explanatory diagram illustrating an example of a signal detection process. FIG. 10 is an explanatory diagram illustrating an example of a lane boundary detection process. FIG. 11 is an example of a functional block diagram of the server device. FIG. 12 is a flowchart illustrating an example of the analysis processing procedure. FIG. 13 is a flowchart illustrating an example of the procedure of the map data update process. FIG. 14 is a flowchart illustrating an example of the procedure of the map image display process. FIG. 15 is a flowchart illustrating an example of the procedure of the management process. FIG. 16 is a block diagram illustrating an example of a functional configuration of an information processing apparatus according to a modification. FIG. 17 is a block diagram illustrating a hardware configuration example.

  Hereinafter, embodiments of an information processing apparatus, an information processing system, and an information processing program will be described in detail with reference to the accompanying drawings.

  FIG. 1 is an explanatory diagram of the overall configuration of the information processing system 1 according to the present embodiment. The information processing system 1 includes an information processing device 10 and a server device 40. The information processing apparatus 10 and the server apparatus 40 are connected via a network 21 so as to be able to exchange data and signals.

  The information processing apparatus 10 is mounted on a moving body, for example. A moving body is an object that can move in real space by self-running or towing. The moving body is, for example, a vehicle, an airplane, a train, a carriage, or the like. In the present embodiment, a case where the moving body is the vehicle 20 will be described as an example. That is, in the present embodiment, an example in which the information processing apparatus 10 is mounted on the vehicle 20 will be described.

  An imaging unit 12 is mounted on the vehicle 20. The photographing unit 12 obtains a photographed image obtained by photographing the periphery of the vehicle 20. The imaging unit 12 is, for example, a known video camera or digital camera. In the present embodiment, the photographing unit 12 can photograph a plurality of photographed images (that is, a plurality of frames) by continuously photographing the periphery of the vehicle 20. The imaging unit 12 may be configured integrally with the information processing apparatus 10 or may be configured separately from the information processing apparatus 10.

  The information processing apparatus 10 analyzes a captured image around the vehicle 20. That is, the information processing apparatus 10 analyzes the captured image obtained by the imaging unit 12 that captures the periphery of the vehicle 20.

  In the present embodiment, a case where the information processing apparatus 10 analyzes a captured image and detects a detection target 30 included in the captured image will be described as an example. The analysis content by the information processing apparatus 10 is not limited to the detection of the detection target 30. Further, the information processing apparatus 10 may be configured to include the imaging unit 12 or may be configured to include the imaging unit 12 as a separate body.

  The detection object 30 is an object to be detected by the information processing apparatus 10. The detection object 30 may be one type or a plurality of types. Further, the type of the detection target 30 can be arbitrarily set and changed by a user operation instruction or the like.

  In the present embodiment, a case where the detection target 30 is at least one of the traffic light 30B and the sign 30D will be described as an example. The sign 30 </ b> D may be written on the road R, or may be written or displayed on a sign board installed on the road R. In the present embodiment, the case where the sign 30D includes the speed sign 30A described or displayed on the sign board installed on the road R and the lane boundary line 30C described on the road R will be described as an example. .

  Note that the information processing system 1 may include a plurality of information processing apparatuses 10. FIG. 2 is an example of an overall configuration diagram of an information processing system 1 including a plurality of information processing apparatuses 10. As illustrated in FIG. 2, the information processing system 1 includes a plurality of information processing apparatuses 10 (information processing apparatuses 10-1 to 10-N (N is an integer equal to or greater than 2)). Also good. Then, each of the plurality of information processing apparatuses 10 may be configured to be mounted on different vehicles 20.

  Hereinafter, a case where the information processing system 1 has a configuration including a plurality of information processing apparatuses 10 (information processing apparatuses 10-1 to 10-N) will be described. The plurality of information processing apparatuses 10 (information processing apparatuses 10-1 to 10 -N) and the server apparatus 40 are connected via a network 21 so as to be able to exchange data and signals. In addition, when each of the plurality of information processing apparatuses 10 (information processing apparatus 10-1 to information processing apparatus 10-N) is described generically, the information processing apparatus 10 will be simply referred to.

  Next, a functional configuration of the information processing apparatus 10 will be described. FIG. 3 is a block diagram illustrating an example of a functional configuration of the information processing apparatus 10.

  The information processing apparatus 10 includes an imaging unit 12, a GPS (Global Positioning System) sensor 14, an acceleration sensor 16, a storage unit 15, a UI (user interface) unit 17, and a control unit 18. The imaging unit 12, the GPS sensor 14, the acceleration sensor 16, the storage unit 15, and the UI unit 17 are connected to the control unit 18 so as to be able to exchange data and signals. Moreover, the control part 18 is connected to the vehicle control part 22 mounted in the vehicle 20 so that data and a signal can be exchanged.

  The photographing unit 12 photographs the vicinity of the vehicle 20. As described above, the imaging unit 12 may be configured separately from the information processing apparatus 10. In the present embodiment, the photographing unit 12 continuously photographs the periphery of the vehicle 20 over time, and sequentially outputs each captured image obtained by the photographing to the control unit 18 in the photographing order.

  The GPS sensor 14 detects the current position of the vehicle 20. The GPS sensor 14 outputs the detected position information to the control unit 18. The acceleration sensor 16 detects the acceleration of the vehicle 20 on which the information processing apparatus 10 is mounted. Then, acceleration information indicating the acceleration is output to the control unit 18.

  The vehicle control unit 22 is mounted on the vehicle 20 and controls traveling of the vehicle 20. In the present embodiment, the vehicle control unit 22 outputs travel information of the vehicle 20 to the control unit 18. The travel information includes, for example, speed information indicating the travel speed of the vehicle 20, angle information indicating the steering angle of the vehicle 20, acceleration information indicating the acceleration of the vehicle 20, and a brake operation indicating that the vehicle 20 has decelerated in response to the brake operation. Information, etc. Note that the control unit 18 may acquire acceleration information from the acceleration sensor 16.

  The storage unit 15 stores various data. In the present embodiment, the storage unit 15 stores map data 15A and the like. The map data 15 </ b> A is map image data displayed on the UI unit 17 when the vehicle 20 is traveling.

  The UI unit 17 includes both an input function for receiving an operation instruction from a user and a display function for displaying various images. The UI unit 17 is, for example, an LCD (Liquid Crystal Display) with a touch panel. Note that the input function and the display function in the UI unit 17 may be configured separately.

  The control unit 18 controls the information processing apparatus 10. The control unit 18 includes an image acquisition unit 18A, a traveling state acquisition unit 18B, a setting unit 18C, a calculation unit 18D, a change unit 18E, a reception unit 18F, a specification unit 18G, a calculation unit 18M, and an analysis unit. 18H, post-processing unit 18I, transmission unit 18J, display control unit 18K, and reception unit 18L.

  Image acquisition unit 18A, traveling state acquisition unit 18B, setting unit 18C, calculation unit 18D, change unit 18E, reception unit 18F, identification unit 18G, calculation unit 18M, analysis unit 18H, post-processing unit 18I, transmission unit 18J, display control Part or all of the unit 18K and the receiving unit 18L may be realized by causing a processing device such as a CPU (Central Processing Unit) to execute a program, that is, by software, IC (Integrated Circuit), or the like. It may be realized by hardware, or may be realized by using software and hardware together.

  The image acquisition unit 18A acquires a captured image around the vehicle 20. FIG. 4 is a schematic diagram illustrating an example of the captured image P. FIG. 4 shows an example of a captured image P that includes a speed sign 30A, a traffic light 30B, and a lane boundary line 30C.

  Returning to FIG. 3, the image acquisition unit 18 </ b> A acquires a captured image P captured by the imaging unit 12 mounted on the vehicle 20, for example. In the present embodiment, the image acquisition unit 18A acquires the captured image P from the imaging unit 12. Specifically, the photographing unit 12 outputs the photographed captured images P sequentially to the image acquisition unit 18A in the order of photographing. The image acquisition unit 18A sequentially acquires the captured images P from the imaging unit 12. Then, the image acquisition unit 18A sequentially outputs the captured images P acquired from the imaging unit 12 to the specifying unit 18G.

  The traveling state acquisition unit 18B acquires traveling state information indicating the traveling state of the vehicle 20 when the captured image P is captured. Specifically, the running state acquisition unit 18B indicates the running state at the same timing as each shooting timing of the shot image P as the running state information corresponding to each of the shot images P acquired by the image acquisition unit 18A. Get information.

  The traveling state information includes speed information indicating the moving speed of the vehicle 20, acceleration information indicating the acceleration of the vehicle 20, position information indicating the position of the vehicle 20, brake operation information indicating that the vehicle 20 has decelerated in response to the brake operation, And at least one of angle information indicating the steering angle of the vehicle 20. The driving state acquisition unit 18B acquires the driving state information at the same timing as the shooting timing of the captured image P acquired by the image acquisition unit 18A from the GPS sensor 14, the acceleration sensor 16, and the vehicle control unit 22. Then, the traveling state acquisition unit 18B outputs the acquired traveling state information to the specifying unit 18G.

  The identifying unit 18G identifies the captured image P to be processed among the plurality of captured images P acquired by the image acquiring unit 18A. The identifying unit 18G identifies the captured image P to be processed based on the traveling state information corresponding to each captured image P acquired by the traveling state acquiring unit 18B.

  For example, the specifying unit 18G specifies, as a processing target, the captured images P for each acquisition interval corresponding to the running state information for the plurality of captured images P acquired in time series acquired by the image acquiring unit 18A.

  The acquisition interval is set by the setting unit 18C. The setting unit 18C sets an acquisition interval for acquiring the photographed image P from the plurality of photographed images P photographed in time series according to the traveling state information. Then, the specifying unit 18G may specify, as a processing target, the captured images P for each set acquisition interval from a plurality of captured images P continuously captured in time series.

  For example, the setting unit 18C sets the acquisition interval using the following method. For example, the setting unit 18C includes a calculation unit 18D.

  The calculation unit 18D calculates the weight value of the traveling state based on the traveling state information. The weight value is a value representing the importance of the traveling state represented by the traveling state information. In the present embodiment, the calculation unit 18D calculates a higher weight value as the traveling state has a higher importance in a predetermined post-process using an analysis result obtained by the analysis unit 18H described later.

  Post-processing is processing performed using the analysis result of the captured image P by the analysis unit 18H, and is executed by the post-processing unit 18I in the present embodiment. In the present embodiment, post-processing unit 18I calculates an evaluation value for the traveling state of vehicle 20 (details will be described later).

  For example, the driving state information includes acceleration information of the vehicle 20, position information of the vehicle 20, brake operation information indicating that the vehicle 20 has decelerated in response to a brake operation, and angle information indicating the steering angle of the vehicle 20. Assume that Further, it is assumed that the brake operation information indicates a speed that is decelerated according to the brake operation.

  In this case, the calculation unit 18D calculates a solution of a predetermined nonlinear function or linear function using acceleration information, position information, brake operation information, and angle information as a weight value.

  Specifically, for example, the calculation unit 18D calculates the weight value W using the following equation (1).

  W = a * k1 + v * k2 + xy * k3 + brk * k4 + str * k5 Formula (1)

  In formula (1), W represents a weight value. a, v, xy, brk, and str represent acceleration information, speed information, position information, brake operation information, and angle information, respectively. k1, k2, k3, k4, and k5 are predetermined coefficients.

  Note that the formula for calculating the weight value W is not limited to the function represented by the formula (1).

  Then, the setting unit 18C sets a shorter acquisition interval as the weight value W calculated by the calculation unit 18D is higher than a predetermined threshold value. When the weight value W is less than or equal to the threshold value, the acquisition interval may be a predetermined reference acquisition interval. For this reason, as the weight value W is higher than the threshold, a shorter acquisition interval is set with respect to the reference acquisition interval.

  For this reason, the setting unit 18C sets a shorter acquisition interval as the traveling state of the vehicle 20 at the photographing timing of the captured image P indicates a traveling state having a higher importance in the post-processing.

  Specifically, for example, the acquisition interval can be set shorter as the acceleration change is larger. For example, the acquisition interval can be set shorter as the speed is higher. Further, for example, the acquisition interval can be set shorter as the steering angle indicated by the angle information is larger. In addition, the acquisition interval can be set shorter as the degree of deceleration by the brake operation is larger.

  The setting unit 18C may use a predetermined value as the threshold value. Further, this threshold value may be changeable. When the threshold value can be changed, the control unit 18 preferably includes a changing unit 18E and a receiving unit 18F.

  The reception unit 18F receives reception information. The reception information includes user identification information (hereinafter referred to as user ID) of a user who drives the vehicle 20, instruction information indicating a threshold change instruction, or processing time information indicating a target processing time. In the present embodiment, the reception unit 18F receives reception information from the UI unit 17.

  For example, the user inputs the user ID by operating the UI unit 17. The receiving unit 18F receives the user ID from the UI unit 17 and thereby receives the reception information including the user ID. The reception unit 18F may receive a user ID from the vehicle control unit 22. The information processing apparatus 10 may be provided with a slot for inserting an ID card for identifying the user. In this case, the reception unit 18F may receive reception information including the user ID by acquiring the user ID with the inserted ID card.

  For example, the user inputs instruction information indicating an instruction to change the threshold value by operating the UI unit 17. The reception unit 18F receives the instruction information from the UI unit 17 and thereby receives the reception information including the instruction information indicating the change instruction. Further, for example, the user operates the UI unit 17 to input processing time information indicating a target processing time required for the analysis processing by the analysis unit 18H. Then, the reception unit 18F receives processing time information including the target processing time from the UI unit 17.

  The change unit 18E changes the threshold according to the reception information received by the reception unit 18F. Specifically, when the reception information includes instruction information indicating a threshold change instruction, the changing unit 18E changes the threshold used by the setting unit 18C to the changed threshold indicated by the instruction information.

  Further, when the reception information includes a user ID, for example, the changing unit 18E performs the following processing. For example, the changing unit 18E stores in the storage unit 15 a user ID and a threshold set in advance for the user identified by the user ID. Then, the changing unit 18E changes the threshold used by the setting unit 18C to a threshold corresponding to the user ID included in the reception information.

  When the reception information includes processing time information, the changing unit 18E changes the threshold used by the setting unit 18C so that the analysis by the analyzing unit 18H is completed within the target processing time indicated by the processing time information.

  Then, the setting unit 18C may set a shorter acquisition interval as the weight value W calculated from the traveling state information is higher than the threshold value changed by the changing unit 18E.

  Next, the specifying unit 18G will be described. The specifying unit 18G specifies the captured image P to be processed based on the traveling state information indicating the traveling state of the vehicle 20 at the time of capturing the captured image P. In the present embodiment, the specifying unit 18G specifies the captured images P for each acquisition interval set by the setting unit 18C as processing targets from a plurality of captured images P that are continuously captured in time series.

FIG. 5 is a schematic diagram illustrating an example of a plurality of captured images P acquired by the image capturing unit 12 and acquired by the image acquisition unit 18A. As illustrated in FIG. 5, the image acquisition unit 18A sequentially acquires a plurality of captured images P (captured images P ₁ to P _n ) captured in time series. The specifying unit 18G specifies the captured image P to be processed from among the plurality of captured images P (captured images P ₁ to P _n ).

For example, in the present embodiment, the specifying unit 18G specifies the captured image P for each acquisition interval set by the setting unit 18C as a processing target. For example, it is assumed that the plurality of captured images P (captured images P ₁ to P _n ) illustrated in FIG. 5 are captured images P captured continuously every second. Then, it is assumed that the acquisition interval set by the setting unit 18C is 2 seconds. In this case, the specifying unit 18G specifies the captured image P (for example, the captured image P ₁ , the captured image P ₃ , and the captured image P ₅ ) corresponding to each capturing timing every 2 seconds as a processing target.

  Then, the specifying unit 18G sequentially outputs the captured image P specified as the processing target to the analyzing unit 18H.

  The analysis unit 18H analyzes the captured image P specified as a processing target by the specifying unit 18G. For this reason, the analysis unit 18H analyzes the captured image P specified by the specifying unit 18G among all the plurality of captured images P acquired by the image acquisition unit 18A.

  In the present embodiment, the analysis unit 18H analyzes the captured image P and detects the detection target 30 included in the captured image P. Moreover, in this Embodiment, the analysis part 18H demonstrates the form which detects the speed indicator 30A, the traffic light 30B, and the lane boundary line 30C which are contained in the picked-up image P as an example.

  The specifying unit 18G may further specify a captured image area that is a partial area in the captured image P specified as the processing target based on the traveling state information. In this case, the analysis unit 18H may analyze the specified captured image region in the captured image P specified as the processing target.

  The captured image region in the captured image P may be a region having a preset position and range, or may be a region including the detection target 30 to be detected by the post-processing unit 18I. In the present embodiment, as an example, a case will be described in which the specifying unit 18G specifies a region including the detection target 30 to be detected by the post-processing unit 18I as a captured image region.

  6 and 7 are schematic diagrams illustrating an example of the captured image region 32. FIG. As illustrated in FIG. 6, the specifying unit 18G includes, in the captured image P, a captured image region 32 (captured image region) including each of the target speed indicator 30A, the traffic light 30B, and the lane boundary line 30C to be detected by the post-processing unit 18I. 32A, the captured image area 32B, and the captured image area 32C). Further, as illustrated in FIG. 7, the specifying unit 18 </ b> G specifies a captured image region 32 that includes a detection target 30 to be detected by the post-processing unit 18 </ b> I in the captured image P.

  Note that the number and size of the captured image areas 32 specified by the specifying unit 18G may be a predetermined number and size, or may be a size and number corresponding to the running state. That is, it is preferable that the specification unit 18G specifies the size and number of the captured image regions 32 based on the running state information in the captured image P specified as the processing target.

  Specifically, the specifying unit 18G preferably includes a calculating unit 18M. The calculation unit 18M calculates the weight value W of the traveling state based on the traveling state information. Note that the calculation unit 18M may calculate the weight value W in the same manner as the calculation unit 18D.

  The specifying unit 18G preferably specifies a larger captured image region 32 or a larger number of captured image regions 32 as the weight value W is higher than a predetermined threshold value. This threshold is the same as the threshold used by the setting unit 18C. For this reason, this threshold value can be changed by the changing unit 18E.

  For this reason, in the specific part 18G, as the traveling state of the vehicle 20 at the photographing timing of the captured image P indicates a traveling state having a higher importance in the post-processing, a larger number of captured image regions 32 in the captured image P, Alternatively, a wider captured image area 32 is specified. The specifying unit 18G may specify a larger and wider captured image region 32 as the weight value W is higher than the threshold value.

  Next, analysis processing by the analysis unit 18H will be described in detail. The analysis unit 18H analyzes the captured image P specified as a processing target by the specifying unit 18G. In addition, when the specifying unit 18G specifies the processing target captured image area 32 in the captured image P, the analysis unit 18H analyzes the specified captured image area 32.

  In the present embodiment, as an example, the analysis unit 18H analyzes the captured image P (or captured image region 32) specified as a processing target, and uses a sign 30D (speed sign 30A, traffic light 30B) or lane used in Japan. A case where the boundary line 30C is detected will be described. However, the detection object 30 to be detected by the analysis unit 18H is not limited to the object used in Japan, and may be an object used in other countries. Further, the target detected by the analysis unit 18H by the analysis is not limited to the detection target 30.

  The analysis unit 18H may detect the detection target 30 from the captured image P specified as the processing target using a known method.

  For example, the analysis unit 18H detects the speed indicator 30A by performing the following detection process.

  FIG. 8 is an explanatory diagram illustrating an example of the detection process of the speed indicator 30A by the analysis unit 18H. For example, the analysis unit 18H performs image processing suitable for the detection processing of the speed indicator 30A, such as distortion correction processing, filtering processing, and gray scale conversion processing, on the captured image P (see FIG. 4). Then, the analysis unit 18H extracts a partial area PA, which is a partial area including the speed indicator 30A, from the captured image P after image processing (see FIG. 8A). In the example shown in FIG. 8A, the upper half area in the captured image P is extracted as the partial area PA.

  Next, the analysis unit 18H performs primary matching. The analysis unit 18H performs primary matching by comparing the feature points of the partial area PA with the feature points of the speed mark 30A to be detected. The feature point of the speed indicator 30A to be detected may be stored in advance. A known matching method may be used for the primary matching.

  Next, the analysis unit 18H extracts, as a partial region PC, a region in which the similarity with the speed indicator 30A is determined to be greater than or equal to the first threshold value by primary matching in the partial region PA (FIG. 8B )reference). The first threshold value may be determined in advance.

  Next, the analysis unit 18H performs secondary matching for the partial region PC. The analysis unit 18H performs secondary matching by comparing the feature points of the partial region PC with the feature points of the speed indicator 30A. A known matching method may be used for the secondary matching.

  Then, the analysis unit 18H includes, in the captured image P, when there is a region in which the similarity with the speed indicator 30A is determined to be equal to or higher than the second threshold value that is higher than the first threshold value in the partial region PC. It is detected when the speed indicator 30A is included. In addition, when the analysis unit 18H detects that the speed indicator 30A is included, the analysis unit 18H performs a known character recognition process on the speed indicator 30A included in the partial area PC. Thereby, the analysis unit 18H detects the rule information indicating the content of the traffic rule represented by the speed sign 30A. In the example illustrated in FIG. 8, the analysis unit 18H detects the speed limit information “40” as rule information indicating the content of the traffic rule.

  Thereby, the analysis unit 18H detects the speed sign 30A in the captured image P and the rule information (for example, speed limit information) indicating the contents of the traffic rule represented by the speed sign 30A. If the analysis unit 18H detects the speed indicator 30A from the captured image P, the analysis unit 18H includes information indicating that the speed indicator 30A is present, and rule information (for example, speed limit information) indicating the content of the traffic rule indicated by the speed indicator 30A. The detection result information including the object information and the position information is transmitted to the server device 40 via the transmission unit 18J.

  The detection process of the speed marker 30A performed by the analysis unit 18H is not limited to such a process, and a known method can be used. When the specifying unit 18G specifies the captured image region 32 that is a partial region of the captured image P as a processing target, the analysis unit 18H may detect the speed indicator 30A for the captured image region 32.

  Next, an example of detection processing in which the analysis unit 18H detects the traffic light 30B will be described.

  FIG. 9 is an explanatory diagram illustrating an example of detection processing of the traffic light 30B by the analysis unit 18H. For example, the case where the analysis unit 18H analyzes the captured image P illustrated in FIG. 9 will be described as an example.

  For example, the analysis unit 18H extracts the signal pixel region B of the traffic light 30B included in the captured image P. The signal pixel area B is an area indicating the signal color currently indicated by the traffic light 30B.

  A known method may be used to detect the signal pixel region B. For example, the analysis unit 18H converts the image data of the captured image P represented by the (R, G, B) color space into the (Y, U, V) color space using a known method. Then, the pixel value of each pixel represented by the (Y, U, V) color space of each pixel after conversion coincides with a range of pixel values of any one of a red signal, a blue signal, and a yellow signal stored in advance. The pixel area is detected as a signal pixel area B.

  Note that the analysis unit 18H may detect a narrower range than the actual region indicating the signal color as the signal pixel region B. That is, a pixel that should be extracted as the signal pixel region B may not be extracted due to noise or the like. In other words, the analysis unit 18H may detect a signal pixel region B ′ that is narrower than the signal pixel region B.

  Therefore, the analysis unit 18H performs expansion processing for expanding the detected signal pixel region B '. As a result, the analysis unit 18H expands the signal pixel region B ′ to obtain the signal pixel region B. Specifically, the analysis unit 18H obtains, as the signal pixel region B, the signal pixel region B ′ and one or a plurality of pixels continuous from the outer periphery to the outer periphery of the signal pixel region B ′.

  Next, the analysis unit 18H performs shape recognition processing of the extracted signal pixel region B. For example, the analysis unit 18H determines whether or not a predetermined shape (circular in the present embodiment) of the signal pixel region B can be extracted from the signal pixel region B by performing Hough conversion on the signal pixel region B. To do. If it can be extracted, the analysis unit 18H detects that the traffic light 30B is included in the captured image P. On the other hand, when the extraction cannot be performed, the analysis unit 18H detects that the traffic light 30B is not included in the captured image P. When the analyzing unit 18H detects that the traffic light 30B is included in the captured image P, the analyzing unit 18H detects the signal color by determining the color indicated by each pixel constituting the signal pixel region B.

  Accordingly, the analysis unit 18H detects the traffic light 30B in the captured image P and the signal color indicated by the traffic light 30B. When detecting the traffic light 30B from the captured image P, the analysis unit 18H includes detection target information including information indicating the presence of the traffic light 30B, signal color information indicating the signal color indicated by the traffic light 30B, and position information. The detected detection result information is transmitted to the server device 40 via the transmission unit 18J.

  The detection process of the traffic light 30B performed by the analysis unit 18H is not limited to such a process, and a known method can be used. In addition, when the specifying unit 18G specifies the captured image region 32, which is a partial region of the captured image P, as the processing target, the analysis unit 18H may detect the traffic light 30B for the captured image region 32.

  Next, an example of detection processing in which the analysis unit 18H detects the lane boundary line 30C will be described.

  FIG. 10 is an explanatory diagram showing an example of the detection process of the lane boundary line 30C by the analysis unit 18H. For example, the case where the analysis unit 18H analyzes the captured image P illustrated in FIG. 10 will be described as an example. The case where the captured image P shown in FIG. 10 includes a lane boundary line 30C1 and a lane boundary line 30C2 as the lane boundary line 30C will be described.

  In the present embodiment, analysis unit 18H detects whether or not lane boundary line 30C is included in captured image P and the number of lane boundary lines 30C.

  First, the analysis unit 18H sets a region of interest (ROI) region PD as a region to be subjected to image analysis for detecting the lane boundary line 30C from the captured image P (see FIG. 10A). In the example illustrated in FIG. 10A, the analysis unit 18H has illustrated an example in which the region below the horizontal line H included in the captured image P is set as the ROI region PD.

  Next, the analysis unit 18H performs a noise reduction process for reducing noise in the ROI region PD (see FIG. 10B). The noise in the ROI area PD is, for example, random noise. In the example shown in FIG. 10B, the analysis unit 18H applies an IIR-LPF (Infinite Impulse Response Low Pass Filter) from the center of the captured image P to the left and right. Thereby, the analysis unit 18H generates a blurred image in which noise in the ROI region PD is reduced.

  Next, the analysis unit 18H performs edge search processing using the generated blurred image (see FIG. 10C). As shown in FIG. 10C, the analysis unit 18H includes, as a candidate point 31a for the lane boundary line 30C1 and a candidate point 31b for the lane boundary line 30C2, in the left-right direction from the center of the blurred image of the ROI region PD. A pixel indicating an edge exceeding a predetermined third threshold is searched.

  Next, the analysis unit 18H performs detection processing of the lane boundary line 30C using each of the plurality of candidate points 31a and the plurality of candidate points 31b. Specifically, the analysis unit 18H detects the linear lane boundary line 30C1 by performing a probabilistic Hough transform using the plurality of candidate points 31a. Similarly, the analysis unit 18H detects the linear lane boundary line 30C2 by performing the probabilistic Hough transform using the plurality of candidate points 31b.

  FIG. 10D is a diagram illustrating an example of the detected lane boundary line 30 </ b> C <b> 1 included in the captured image P.

  When detecting the lane boundary line 30C in the captured image P, the analysis unit 18H determines the number of lane boundary lines 30C included in the captured image P and the position of the lane boundary line 30C included in the captured image P at the P. Also detect. The analysis unit 18H detects the number of lane boundary lines 30C by counting the number of detected lane boundary lines 30C. On the other hand, when the lane boundary line 30C is not detected, the analysis unit 18H detects that the lane boundary line 30C is not included in the captured image P.

  Accordingly, the analysis unit 18H detects the lane boundary line 30C in the captured image P, the number of lane boundary lines 30C, and the position of the lane boundary line 30C in the captured image P. When the analysis unit 18H detects the lane boundary line 30C from the captured image P, the information indicating the presence of the lane boundary line 30C, the information indicating the number of the lane boundary lines 30C, and the position of the lane boundary line 30C in the captured image P are obtained. The detection result information including the detection target information including the information to be displayed and the position information is transmitted to the server device 40 via the transmission unit 18J.

  In addition, the detection process of the lane boundary line 30C performed by the analysis unit 18H is not limited to such a process, and a known method can be used. Further, when the identifying unit 18G identifies the captured image region 32 that is a partial region of the captured image P as a processing target, the analysis unit 18H may detect the lane boundary line 30C for the captured image region 32. Good.

  Returning to FIG. 3, the description will be continued. Next, the post-processing unit 18I will be described. The post-processing unit 18I performs post-processing using the analysis result of the captured image P by the analysis unit 18H. In the present embodiment, post-processing unit 18I calculates an evaluation value for the traveling state of vehicle 20 using the analysis result of captured image P by analysis unit 18H.

  Specifically, the post-processing unit 18I evaluates the traveling state of the vehicle 20 when the captured image P specified as the processing target is captured based on the detection target information, which is the analysis result of the analyzing unit 18H. Is calculated.

  The evaluation value for the driving state is, for example, dangerous driving information indicating a degree regarded as dangerous driving (dangerous driving degree), safe driving information indicating whether the driving is in accordance with a traffic rule represented by a road sign, or the like. is there. Note that the evaluation values for the running state are not limited to these.

  In the present embodiment, the post-processing unit 18I acquires travel state information corresponding to the shooting timing of the captured image P to be post-processed from the travel state acquisition unit 18B.

  Then, the post-processing unit 18I calculates an evaluation value for the traveling state using the detection target information of the detection target 30 included in the captured image P and the traveling state information at the time of capturing the captured image P. .

  In the present embodiment, the post-processing unit 18I will be described as an example where dangerous driving information is calculated as an evaluation value.

  When the captured image P includes the speed indicator 30A, the post-processing unit 18I reads the detection target information of the speed indicator 30A detected from the captured image P. Then, the post-processing unit 18I reads rule information (for example, speed limit information) indicating the contents of the traffic rule indicated by the speed indicator 30A, which is indicated in the detection target information. In the present embodiment, it is assumed that post-processing unit 18I has read the speed rule information.

  In this case, the post-processing unit 18I determines whether or not the speed information indicating the traveling speed of the vehicle 20 at the same timing as the capturing timing of the captured image P in the traveling state information exceeds the speed indicated by the speed regulation information. Determine whether. If the speed is exceeded, the post-processing unit 18I calculates dangerous driving information (evaluation value) indicating a higher value as the degree of speed excess is higher. Note that when the speed information indicating the traveling speed of the vehicle 20 is equal to or lower than the speed indicated by the speed rule information, the post-processing unit 18I may not calculate the dangerous driving information.

  Then, the post-processing unit 18I registers the dangerous driving information in the map data 15A stored in the storage unit 15. Specifically, the post-processing unit 18I includes, as additional information added to the map data 15A, position information indicating the shooting position of the shot image P, calculated dangerous driving information, detection target information of the speed indicator 30A, Register in association with.

  When the post-processing unit 18I calculates an evaluation value (dangerous driving information in the present embodiment), the transmission unit 18J transmits determination result information indicating the determination result of the dangerous driving degree by the post-processing unit 18I to the server device 40. Send. The determination result information includes dangerous driving information, position information indicating the shooting position of the shot image P, and a user ID of a user driving the vehicle 20.

  Next, a case where the captured image P includes the traffic light 30B will be described. When the captured image P includes the traffic light 30B, the post-processing unit 18I reads the detection target information of the traffic signal 30B detected from the captured image P. Then, the post-processing unit 18I determines whether or not the signal color indicating the color of the traffic light 30B indicated in the detection target information is red. When the signal color is red, it means “stop driving” in Japanese traffic rules. In addition, what is necessary is just to adjust this determination suitably according to the traffic rule of each country.

  Then, it is assumed that the post-processing unit 18I determines that the signal color indicating the color of the traffic light 30B is red. In this case, the post-processing unit 18I determines that the speed information indicating the traveling speed of the vehicle 20 at the same timing as the capturing timing of the captured image P in the traveling state information exceeds the speed indicating the traveling stop (for example, 0 km per hour). Whether or not is indicated. In addition, the speed which shows driving | running | working stop is not limited to 0 km / h, Arbitrary speeds can be set. In addition, the travel stop may be determined using a speed indicating the travel stop and a period during which the speed is continued.

  Then, the post-processing unit 18I calculates the dangerous driving information indicating a higher value as the degree of the excess of the speed exceeding the speed indicating the stoppage of travel is higher. Note that when the speed information indicating the travel speed of the vehicle 20 is a speed indicating the travel stop, the post-processing unit 18I does not calculate the dangerous driving information.

  Then, the post-processing unit 18I registers the dangerous driving information in the map data 15A stored in the storage unit 15. Specifically, the post-processing unit 18I includes, as additional information added to the map data 15A, position information indicating the shooting position of the captured image P, calculated dangerous driving information, and detection target information of the traffic light 30B. Register in association.

  When the post-processing unit 18I calculates an evaluation value (dangerous driving information in the present embodiment), the transmission unit 18J transmits determination result information indicating the determination result of the dangerous driving degree by the post-processing unit 18I to the server device 40. Send. In this case, the determination result information includes dangerous driving information, position information indicating a shooting position of the shot image P, and a user ID of a user driving the vehicle 20.

  Next, a case where the captured image P includes a lane boundary line 30C will be described. When the captured image P includes a lane boundary line 30C, the post-processing unit 18I reads detection object information of the lane boundary line 30C detected from the captured image P. Then, the post-processing unit 18I reads the number of lane boundary lines 30C and the position of the lane boundary line 30C in the captured image P indicated in the detection target information.

  The post-processing unit 18I calculates dangerous driving information when the number of lane boundary lines 30C indicates that the number of lane boundary lines 30C is two or more lanes on one side. Note that the post-processing unit 18I does not have to calculate the dangerous driving information when the number of lane boundary lines 30C indicates one lane on one side.

  Then, when the post-processing unit 18I indicates that the number of lane boundary lines 30C is two or more lanes on one side, the shooting timing of the captured image P in the position of the lane boundary line 30C in the captured image P and the traveling state information From the angle information indicating the steering angle of the vehicle 20, the acceleration information detected by the acceleration sensor 16, and the speed information of the vehicle 20 at the same timing, it is determined whether or not a sudden lane change has been made.

  For example, the post-processing unit 18I considers that a lane change has been made for each of the change in the position of the lane boundary line 30C from the position of the lane boundary line 30C in the previously detected captured image P, the angle information, the acceleration information, and the speed information. A third threshold is predetermined. Then, the post-processing unit 18I has a third threshold value corresponding to at least one of the change in the position of the lane boundary line 30C from the position of the lane boundary line 30C in the captured image P detected last time, the angle information, the acceleration information, and the speed information. As the value exceeds the value, dangerous driving information indicating a higher value is calculated. The third threshold value may be determined in advance as a value for determining that a sudden lane change has been made. If the change in the position of the lane boundary 30C from the position of the lane boundary 30C in the previously detected captured image P, the angle information, the acceleration information, and the speed information are all less than the corresponding third threshold value, the post-processing unit 18I may not calculate dangerous driving information.

  Then, the post-processing unit 18I registers the dangerous driving information in the map data 15A stored in the storage unit 15. Specifically, the post-processing unit 18I includes, as additional information to be added to the map data 15A, position information indicating the shooting position of the shot image P, calculated dangerous driving information, and detection target object information on the lane boundary line 30C. Are registered in association with each other.

  When the post-processing unit 18I calculates an evaluation value (dangerous driving information in the present embodiment), the transmission unit 18J transmits determination result information indicating the determination result of the dangerous driving degree by the post-processing unit 18I to the server device 40. Send. In this case, the determination result information includes dangerous driving information, position information indicating the shooting position of the shot image P, detection target information of the lane boundary 30C, and a user ID of the user who drives the vehicle 20.

  The evaluation value calculation method by the post-processing unit 18I is not limited to the above method.

  Next, the server device 40 will be described. FIG. 11 is an example of a functional block diagram of the server device 40.

  The server device 40 includes a communication unit 42, a storage unit 44, an evaluation unit 46, an update unit 48, and an analysis / post-processing unit 49. The communication unit 42 communicates with each of the one or more information processing apparatuses 10. In the present embodiment, the communication unit 42 receives the detection result of the detection target 30 from the information processing apparatus 10. That is, the communication unit 42 receives detection result information including detection target information indicating the detection target 30 detected by the information processing apparatus 10 and position information indicating the shooting position of the captured image P used for detection. Receive from processing device 10.

  When receiving the detection result information, the communication unit 42 outputs the detection result information to the update unit 48. The update unit 48 associates the position information and the detection target object information included in the detection result information and registers them in the detected management information 44 </ b> A of the storage unit 44.

  The detected management information 44A is information in which position information is associated with detected object information indicating the detected object 30 detected at the photographing position indicated by the position information. In the detected management information 44A, detection object information detected in each of the plurality of vehicles 20 is registered for each position information.

  When the detection object 30 indicated in the detection object information corresponding to the position information included in the newly received detection result information is not registered in the detected management information 44A, the update unit 48 detects the newly received detection The object information is registered in the detected management information 44A in association with the position information.

  Then, the update unit 48 manages all the detection object information corresponding to the position information and the position information corresponding to the detection object information newly registered in the detected management information 44A, which is managed by the server device 40. To the information processing apparatus 10 mounted on each of the vehicles 20. On the information processing device 10 side, the detection object information and the position information received from the server device 40 may be registered in the map data 15A in each information processing device 10.

  In addition, the communication unit 42 receives determination result information indicating a determination result of an evaluation value such as a dangerous driving degree from the information processing apparatus 10. In this Embodiment, the communication part 42 receives the determination result information which shows the determination result of a dangerous driving degree from the information processing apparatus 10 as an evaluation value. As described above, the determination result information includes dangerous driving information, position information indicating the shooting position of the shot image P, and a user ID.

  Upon receiving the determination result information, the communication unit 42 outputs the determination result information to the update unit 48. The update unit 48 associates the position information included in the determination result information, the dangerous driving information, and the user ID, and registers them in the user management information 44B in the storage unit 44. The user management information 44B is data in which a user ID, dangerous driving information, and position information are associated with each other.

  The update unit 48 then manages all the vehicles 20 managed by the server device 40 with the dangerous driving information corresponding to the position information and the position information corresponding to the dangerous driving information newly registered in the user management information 44B. Are transmitted to the information processing apparatus 10 mounted on each. On the information processing device 10 side, the dangerous driving information and the position information received from the server device 40 may be registered in the map data 15A in each information processing device 10.

  The evaluation unit 46 reads the dangerous driving information registered in the user management information 44B for each corresponding user ID. And the evaluation part 46 calculates a driving | operation evaluation value of a user from corresponding dangerous driving information for every user identified by user ID. For example, the lower the driving evaluation value is calculated as the degree of dangerous driving (dangerous driving) indicated by the dangerous driving information is higher.

  The evaluation unit 46 may calculate a driving evaluation value for each of a plurality of items. The item is, for example, a temporary stop, a traffic light 30B, or the like. The driving evaluation value corresponding to the temporary stop may be, for example, a value obtained by dividing the number of times the traffic rule “temporary stop” represented by the speed sign 30A is divided by the total number of times the speed sign 30A indicating the temporary stop is detected. .

  And the evaluation part 46 matches the calculated driving | operation evaluation value and user ID, and transmits to an external apparatus etc. via the communication part 42. FIG. The external device is installed, for example, in an engine that executes various processes using the operation evaluation value. For example, the external device is installed in an insurance company or the like.

  When the communication unit 42 receives from the information processing apparatus 10 the captured image P, timing information indicating the capturing timing of the captured image P, and traveling state information indicating a traveling state at the same timing as the capturing timing. There is. In this case, the communication unit 42 outputs the captured image P, timing information, and running state information to the analysis / post-processing unit 49.

  The analysis / post-processing unit 49 has functions corresponding to the specifying unit 18G, the analysis unit 18H, and the post-processing unit 18I in the information processing apparatus 10.

  That is, the analysis / post-processing unit 49 specifies the processing target captured image P using the corresponding traveling state information for the captured image P received by the communication unit 42 in the same manner as the specifying unit 18G. Then, the analysis / post-processing unit 49 analyzes the identified captured image P in the same manner as the analysis unit 18H, and detects the detection target 30. Then, the analysis / post-processing unit 49 may output detection result information indicating the detection result to the evaluation unit 46.

  Further, the analysis / post-processing unit 49 performs post-processing in the same manner as the post-processing unit 18I using the detection result, and calculates an evaluation value (dangerous driving information) of the traveling state. Then, the analysis / post-processing unit 49 may output determination result information including the calculated evaluation value (dangerous driving information) to the updating unit 48.

  As described above, the server device 40 is provided with the analysis / post-processing unit 49, so that on the server device 40 side, the specification processing by the specification unit 18G of the information processing device 10, the analysis processing by the analysis unit 18H, and the post-processing Post-processing by the processing unit 18I may be executed.

  Next, an example of a procedure of analysis processing executed by the information processing apparatus 10 according to the present embodiment will be described. FIG. 12 is a flowchart illustrating an example of a procedure of analysis processing executed by the information processing apparatus 10.

  First, the image acquisition unit 18A acquires the captured image P for one frame from the imaging unit 12 (step S100). Next, the traveling state acquisition unit 18B acquires traveling state information indicating the traveling state at the same timing as the capturing timing of the captured image P acquired in step S100 (step S102).

  Next, the calculation unit 18D of the setting unit 18C calculates the weight value W using the traveling state information acquired in Step S102 (Step S104). Next, the setting unit 18C sets an acquisition interval for acquiring the captured images P from the plurality of captured images P captured in time series from the weight value W calculated in Step S104 (Step S106).

  Next, the specifying unit 18G determines whether or not the captured image P acquired by the image acquisition unit 18A in step S100 is a processing target (step S108). In step S108, the identifying unit 18G captures the captured image P acquired in step S100 at a capturing timing that is separated from the capturing timing of the captured image P previously identified as the processing target by the acquisition interval set in step S106. It is determined whether or not the captured image P. Based on this determination, the determination in step S108 is performed.

  If a negative determination is made in step S108 (step S108: No), the process proceeds to step S150 described later. On the other hand, if an affirmative determination is made in step S108 (step S108: Yes), the process proceeds to step S110. In step S110, the specifying unit 18G specifies the captured image P acquired in step S100 as a processing target (step S110).

  By the processing from step S100 to step S110, the specifying unit 18G specifies, as a processing target, the captured images P for each acquisition interval set in step S106 from the plurality of captured images P that are continuously captured in time series. .

  In step S112, the specifying unit 18G determines whether or not to further specify the captured image area 32, which is a partial area of the captured image P specified in step S110, as a processing target (step S112). For example, the specifying unit 18G stores in advance specifying information indicating whether or not a part of the area is specified. And specific part 18G should just perform judgment of Step S112 according to this specific information.

  If a negative determination is made in step S112 (step S112: No), the process proceeds to step S114. In step S114, the captured image P specified in step S110 and the running state information acquired in step S102 corresponding to the captured image P are transmitted to the server device 40 (step S114). At this time, the user ID of the user driving the vehicle 20 on which the information processing apparatus 10 is mounted and the identification information (camera ID) of the photographing unit 12 mounted on the vehicle 20 are also sent to the server apparatus 40. You may send it.

  By the processing in step S114, the analysis processing performed by the analysis unit 18H of the information processing device 10 and the post-processing performed by the post-processing unit 18I can also be executed on the server device 40 side. On the server device 40 side, analysis processing and post-processing can be executed for each photographing unit 12 identified by the camera ID. For this reason, the server device 40 can also perform analysis processing and post-processing according to the mounting angle of the imaging unit 12 and the like. The server device 40 can also execute analysis processing and post-processing for each user identified by the user ID.

  Next, the analysis unit 18H analyzes the captured image P specified in step S110 and detects the detection target 30 (step S116). Then, the process proceeds to step S124.

  On the other hand, if an affirmative determination is made in step S112 (step S112: Yes), the process proceeds to step S118. In step S118, the specifying unit 18G specifies the captured image region 32 in the captured image P specified in step S110 (step S118).

  Next, the specifying unit 18G transmits the captured image area 32 specified in step S118 and the running state information acquired in step S102 corresponding to the captured image P including the captured image area 32 to the server device 40 ( Step S120).

  Through the process of step S120, the server apparatus 40 can execute the analysis process performed by the analysis unit 18H of the information processing apparatus 10 and the post-process performed by the post-processing unit 18I. In addition, the captured image area 32 used in the analysis and post-processing of the captured image P is selectively transmitted to the server device 40. For this reason, it is possible to reduce the amount of data transmitted to the server device 40 and the data transmission speed.

  Next, the analysis unit 18H analyzes the captured image area 32 specified in step S118, and detects the detection target 30 included in the captured image area 32 (step S122). Then, the process proceeds to step S124.

  In step S124, the post-processing unit 18I acquires the detection target information of the detection target 30 detected in step S116 or step S122 in the captured image P specified in step S110 (step S124).

  Note that the post-processing unit 18I has already stored in the storage unit 15 detection object information corresponding to position information (that is, position information indicating the shooting position) corresponding to the shooting timing of the shot image P identified in step S110. In the case where there is, it may be a form in which the processing of step S116 and step S122 is not performed. In this case, the post-processing unit 18I may acquire the detection target information by reading the detection target information corresponding to the position information from the storage unit 15. By this process, the detection process can be omitted for the detection target 30 that has been detected in the past.

  Next, the post-processing unit 18I determines whether or not the traffic light 30B has been detected from the captured image P identified in step S100 (step S126). The post-processing unit 18I determines in step S126 by determining whether or not the detection target information acquired in step S124 includes detection target information indicating the traffic light 30B.

  If a negative determination is made in step S126 (step S126: No), the process proceeds to step S134 described later. If a positive determination is made in step S126 (step S126: Yes), the process proceeds to step S128.

  In step S128, the post-processing unit 18I determines whether or not the driving is dangerous (step S128). For example, the post-processing unit 18I is information indicating that the signal color information of the traffic light 30B indicated in the detection target information indicates red, and the speed information indicating the traveling speed of the vehicle 20 included in the traveling information indicates a speed indicating stop of traveling. By determining whether or not it exceeds, the determination in step S128 is performed. If a negative determination is made in step S128 (step S128: No), the process proceeds to step S134 described later.

  If an affirmative determination is made in step S128 (step S128: Yes), the post-processing unit 18I calculates dangerous driving information (step S129), positional information indicating the shooting position of the captured image P specified in step S110, and the calculated danger. Additional information including the driving information and the detection object information of the traffic light 30B is registered in the map data 15A (step S130).

  Next, the post-processing unit 18I transmits determination result information including dangerous driving information, position information indicating the shooting position of the shot image P, and a user ID of a user driving the vehicle 20 to the server device 40. (Step S132).

  Next, the post-processing unit 18I determines whether or not the lane boundary line 30C is detected from the captured image P specified in step S110 (step S134). The post-processing unit 18I includes information indicating the presence of the lane boundary line 30C in the detection target information acquired in step S124, and information indicating the number of lane boundary lines 30C indicating two or more lanes on one side. It is determined whether or not it is included. Thereby, the post-processing unit 18I performs the determination in step S134.

  If a negative determination is made in step S134 (step S134: No), the process proceeds to step S142 described later. If an affirmative determination is made in step S134 (step S134: Yes), the process proceeds to step S136.

  In step S136, the post-processing unit 18I determines whether or not the driving is dangerous (step S136). For example, the post-processing unit 18I determines that at least one of the change in the position of the lane boundary line 30C from the position of the lane boundary line 30C in the previously detected captured image P, the angle information, the acceleration information, and the speed information is a sudden lane change. By determining whether or not the value exceeds the threshold used for determination, the determination in step S136 is performed.

  If a negative determination is made in step S136 (step S136: No), the process proceeds to step S142 described later. If an affirmative determination is made in step S136 (step S136: Yes), the process proceeds to step S137.

  In step S137, the post-processing unit 18I calculates dangerous driving information (step S137), and uses the positional information indicating the shooting position of the shot image P specified in step S110, the calculated dangerous driving information, and the lane boundary line 30C. Additional information including the detected object information to be shown is registered in the map data 15A (step S138).

  Next, the post-processing unit 18I obtains determination result information including the dangerous driving information registered in step S138, the positional information indicating the shooting position of the captured image P, and the user ID of the user who drives the vehicle 20, as a server. It transmits to the apparatus 40 (step S140).

  Next, the post-processing unit 18I determines whether or not the speed indicator 30A has been detected at the photographing position of the photographed image P identified at step S110 (step S142). The post-processing unit 18I determines whether or not the detection target information acquired in step S124 includes information indicating the presence of the speed indicator 30A. Thereby, the post-processing unit 18I performs the determination in step S142.

  If a negative determination is made in step S142 (step S142: No), the process proceeds to step S150 described later. If an affirmative determination is made in step S142 (step S142: Yes), the process proceeds to step S144.

  In step S144, the post-processing unit 18I determines whether or not it is a dangerous driving (step S144). For example, the post-processing unit 18I indicates that the speed information indicating the traveling speed of the vehicle 20 at the same timing as the shooting timing of the captured image P specified in step S110 is represented by the speed rule 30A detected from the captured image P. Determine whether the speed indicated by the information is exceeded. Thereby, the post-processing unit 18I performs the determination in step S144.

  If a negative determination is made in step S144 (step S144: No), the process proceeds to step S150. On the other hand, if a positive determination is made in step S144 (step S144: Yes), the process proceeds to step S145.

  In step S145, the post-processing unit 18I calculates dangerous driving information (step S145). Next, the post-processing unit 18I includes additional information including position information indicating the shooting position of the shot image P identified in step S110, calculated dangerous driving information, and detection target information indicating the speed indicator 30A. Registration in the map data 15A (step S146).

  Next, the post-processing unit 18I receives the determination result information including the dangerous driving information registered in step S146, the position information indicating the shooting position of the shot image P, and the user ID of the user who drives the vehicle 20, as a server. It transmits to the apparatus 40 (step S148).

  Next, the control unit 18 determines whether or not to end the analysis process (step S150). For example, the control unit 18 determines whether or not an end instruction indicating the end of the analysis process has been received from the UI unit 17, thereby determining step S <b> 150. Note that the control unit 18 may perform the determination in step S150 by determining whether or not the signal indicating the engine stop of the information processing apparatus 10 on which the information processing apparatus 10 is mounted is received from the vehicle control unit 22.

  If a negative determination is made in step S150 (step S150: No), the process returns to step S100. On the other hand, if an affirmative determination is made in step S150 (step S150: Yes), this routine ends.

  As described above, the information processing apparatus 10 analyzes the captured image P specified as the processing target based on the traveling state information by the specifying unit 18G among all the captured images P captured by the capturing unit 12. .

  For this reason, the information processing apparatus 10 according to the present embodiment can increase the analysis speed of the captured image P.

  In addition, when the speed information shown in the driving state information indicates a speed that is equal to or higher than a predetermined speed for a predetermined time or longer, the processes in steps S126 to S132 may be omitted. For example, in the case of a Japanese road R, there is a high possibility that the traffic light 30B is not installed on a road that travels at 80 km / h or more (for example, an expressway). Similarly, when the speed information indicated in the running state information indicates a speed that is equal to or higher than a certain speed for a predetermined time or more, the detection process of the sign 30D that indicates a temporary stop may be omitted.

  Further, when the speed information indicated in the running state information indicates a speed that is lower than a predetermined speed (for example, 20 km to 30 km per hour) for a predetermined time or longer, the processes in steps S142 to S147 may be omitted. For example, if the vehicle is traveling at a speed that does not violate an obvious traffic rule (for example, 20 km / h), it is unlikely that the vehicle is determined to be a dangerous driving such as a speed violation.

  When the travel region of the vehicle 20 on which the information processing apparatus 10 is mounted is in a predetermined range, the type of the detection target 30 that may be detected within the range is stored in the storage unit 15 in advance. It may be left. In the processing of step S116 and step S122, the analysis unit 18H may detect the type of detection object 30 stored in the storage unit 15 from the captured image P or the captured image region 32.

  Next, an interrupt process procedure performed by the control unit 18 will be described. The control unit 18 performs interrupt processing (map data update processing, map image display processing) shown in FIGS. 13 and 14 during execution of the analysis processing shown in FIG.

  FIG. 13 is a flowchart illustrating an example of the procedure of the map data update process.

  First, the receiving unit 18L determines whether or not the position information and the detection target information are received from the server device 40 (step S400).

  If an affirmative determination is made in step S400 (step S400: Yes), the process proceeds to step S402. In step S402, the receiving unit 18L registers the position information and detection target information received in step S400 as additional information in the map data 15A (step S402). Then, this routine ends.

  On the other hand, if a negative determination is made in step S400 (step S400: No), the process proceeds to step S404. In step S404, the receiving unit 18L determines whether position information and dangerous driving information are received from the server device 40 (step S404). If a positive determination is made in step S404 (step S404: Yes), the process proceeds to step S406. In step S406, the position information and dangerous driving information received in step S404 are registered in the map data 15A as additional information (step S406). Then, this routine ends. On the other hand, when a negative determination is made in step S404 (step S404: No), this routine is terminated.

  Next, an example of the procedure of map image display processing, which is one of interrupt processing, will be described. FIG. 14 is a flowchart illustrating an example of the procedure of the map image display process. First, the display control unit 18K acquires the current position information of the vehicle 20 from the GPS sensor 14 via the traveling state acquisition unit 18B (step S300).

  Next, the display control unit 18K reads the map data 15A from the storage unit 15 (step S302). Then, the display control unit 18K reads additional information corresponding to each of the position information acquired in step S300 and the position information within a predetermined range including the position indicated by the position information from the storage unit 15 ( Step S304). As described above, the additional information includes the position information and the detection target information of the detection target 30.

  The display control unit 18K superimposes an image indicating the detection target 30 or dangerous driving information included in the corresponding additional information on the position corresponding to the position information in the map image of the map data 15A read in step S302, The information is displayed on the UI unit 17 (step S306). For this reason, by visually recognizing the UI unit 17, the user can easily confirm the current position on the map and the location where the detection target 30 or the dangerous driving occurs, which is present around the current position.

  Next, the control unit 18 determines whether or not to end this routine (step S308). For example, the control unit 18 determines whether or not the stop signal indicating the engine stop of the information processing apparatus 10 has been received from the vehicle control unit 22, thereby determining step S <b> 308. If a negative determination is made in step S308 (step S308: No), the process returns to step S300. On the other hand, if an affirmative determination is made in step S308 (step S308: Yes), this routine ends.

  Next, management processing executed by the server device 40 will be described. FIG. 15 is a flowchart illustrating an example of a procedure of management processing executed by the server device 40.

  First, the communication unit 42 determines whether or not detection result information has been received from the information processing apparatus 10 (step S500). If an affirmative determination is made in step S500 (step S500: Yes), the process proceeds to step S502.

  In step S502, the update unit 48 determines whether or not the detection target 30 indicated in the detection target information corresponding to the position information included in the detection result information received in step S500 is unregistered in the detected management information 44A. Is determined (step S502). If it is determined that the registration has been completed (step S502: No), this routine ends. On the other hand, if it is determined that it is not registered (step S502: Yes), the process proceeds to step S504.

  In step S504, the update unit 48 registers the detected object information and the position information included in the detection result information received in step S500 in association with the detected management information 44A (step S504).

  Then, the update unit 48 manages all the detection object information corresponding to the position information and the position information corresponding to the detection object information newly registered in the detected management information 44A, which is managed by the server device 40. The information is transmitted to the information processing apparatus 10 mounted on each of the vehicles 20 via the communication unit 42 (step S506). Then, this routine ends.

  On the other hand, if a negative determination is made in step S500 (step S500: No), the process proceeds to step S508. In step S <b> 508, the communication unit 42 determines whether determination result information has been received from the information processing apparatus 10. If an affirmative determination is made in step S508 (step S508: Yes), the process proceeds to step S510.

  In step S510, the update unit 48 associates the position information, the dangerous driving information, and the user ID included in the determination result information received in step S508 and registers them in the user management information 44B in the storage unit 44 ( Step S510).

  Next, in the update unit 48, the server device 40 manages the dangerous driving information corresponding to the position information and the position information corresponding to the dangerous driving information newly registered in the user management information 44B in step S510. It transmits via the communication part 42 to the information processing apparatus 10 mounted in each of all the vehicles 20 (step S512).

  Next, the evaluation unit 46 reads the dangerous driving information registered in the user management information 44B for each corresponding user ID. Then, for each user identified by the user ID, the evaluation unit 46 calculates the user's driving evaluation value from the corresponding dangerous driving information (step S514).

  Next, the evaluation unit 46 transmits the driving evaluation result including the driving evaluation value calculated in step S514 and the user ID to an external device or the like via the communication unit 42 (step S516). Then, this routine ends.

  On the other hand, if a negative determination is made in step S508 (step S508: No), the process proceeds to step S518. In step S518, the communication unit 42 determines whether the captured image P and the running state information are received from the information processing apparatus 10 (step S518). In step S518, the captured image area 32 of the captured image P may be received instead of the captured image P.

  If a negative determination is made in step S518 (step S518: No), this routine ends. On the other hand, if an affirmative determination is made in step S518 (step S518: Yes), the process proceeds to step S520.

  In step S520, the analysis / post-processing unit 49 performs a specifying process for specifying the captured image P received in step S518 as a processing target (step S520). The process of step S520 is the same as that of step S110 (see FIG. 12). Next, the analysis / post-processing unit 49 performs an analysis process on the captured image P (or the captured image region 32) identified in step S110 (step S522). The process of step S522 is the same as the process of step S116 and step S122 (see FIG. 12).

  Next, the analysis / post-processing unit 49 executes registration / transmission processing (step S524). The process of step S524 is the same as that of step S502 to step S506. Next, the analysis / post-processing unit 49 performs post-processing (step S526). The process of step S526 is the same as that of step S124 to step S146 (note that the processes of step S132 and step S140 are not performed).

  Next, the analysis / post-processing unit 49 executes registration / evaluation / transmission processing (step S528). The process of step S528 is the same as that of step S508 to step S516. Then, this routine ends.

  In addition, you may perform the process of step S514-step S516 regularly for every predetermined period (for example, every several months etc.).

  The server device 40 may be configured not to perform the process of step S502. In this case, if an affirmative determination is made in step S500 (step S500: Yes), the process may proceed to step S504. In step S504, the update unit 48 determines that the detection object 30 of the same type as the detection object 30 corresponding to the position information included in the detection result information received in step S500 is equal to or greater than a predetermined threshold value. It is determined whether or not it is already registered in the detected management information 44A. And the update part 48 determines with the detection reliability of the detection target 30 being high, when the detection target 30 of the number more than this threshold value is registered. And when it determines with a detection reliability being high, you may perform the process of step S504 and the process of step S506. High detection reliability means that there is a high probability that the detection object 30 exists at the photographing position indicated by the position information.

  By this processing, it is possible to suppress the detection object information of the detection object 30 that is erroneously detected by the information processing apparatus 10 from being distributed to other information processing apparatuses 10.

  In addition, when the update unit 48 determines that the detection reliability is high (higher than a certain threshold), the driving evaluation value in step S514 may be calculated. When the update unit 48 determines that the detection reliability is low (lower than a certain threshold value), the evaluation unit 46 sets the driving evaluation value calculated in the process of step S514 to a high driving evaluation value (evaluation is low). You may correct | amend so that it may become.

  Further, the evaluation unit 46 may calculate the evaluation value reliability of the driving evaluation value calculated in the process of step S514. And the evaluation part 46 may correct | amend the driving | running evaluation value calculated by step S514, when evaluation value reliability is lower than a predetermined value. In addition, what is necessary is just to calculate evaluation value reliability from following formula (2), for example.

  Evaluation value reliability = α × average value of detection reliability of detection object 30 + β × total number of times detection object 30 is detected Formula (2)

  In equation (2), α and β are parameters for determining which of the average value of the detection reliability of the detection target 30 and the total number of times of detection of the detection target 30 are to be emphasized, and are set in advance. That's fine.

  In addition, when the evaluation value reliability of the driving evaluation value calculated in the process of step S514 is lower than a predetermined value, the evaluation unit 46 drives the same user for the item corresponding to the driving evaluation value. The driving evaluation value may be calculated again by adding dangerous driving information received from the information processing apparatus 10 mounted on the vehicle 20.

  In addition, when the evaluation unit 46 transmits the operation evaluation result to the external device or the like in step S516, the operation including information instructing to hide items whose evaluation value reliability is lower than a predetermined value. The evaluation result may be transmitted. In addition, when the evaluation unit 46 transmits the operation evaluation result to an external device or the like in step S516, for an item whose evaluation value reliability is lower than a predetermined value, information indicating that the evaluation value reliability is low is also added. The driving evaluation result including information instructing to be displayed may be transmitted.

  As described above, the information processing apparatus 10 according to the present embodiment includes the image acquisition unit 18A, the specification unit 18G, and the analysis unit 18H. The image acquisition unit 18A acquires a captured image P around the vehicle 20 (moving body). The specifying unit 18G specifies the captured image P to be processed based on the traveling state information indicating the traveling state of the vehicle 20 (moving body) at the time of capturing the captured image P. The analysis unit 18H analyzes the captured image P specified as the processing target.

  As described above, in the information processing apparatus 10 according to the present embodiment, the analysis unit 18H identifies the captured image P to be processed according to the traveling state information, and analyzes the identified captured image P.

  Therefore, in the information processing apparatus 10 according to the present embodiment, it is possible to increase the analysis speed for a plurality of captured images P around the moving body imaged by the moving body (vehicle 20).

  The traveling state information includes speed information indicating the moving speed of the vehicle 20 (moving body), acceleration information indicating the acceleration of the vehicle 20 (moving body), position information indicating the position of the vehicle 20 (moving body), and the vehicle 20 ( It is preferable to include at least one of brake operation information indicating that the moving body has decelerated in response to the brake operation and angle information indicating the steering angle of the vehicle 20 (moving body).

  Further, the information processing apparatus 10 can include a setting unit 18C (first setting unit). The setting unit 18C (first setting unit) sets an acquisition interval for acquiring the photographed image P from the plurality of photographed images P photographed in time series according to the traveling state information. The specifying unit 18G can specify, as a processing target, a captured image P for each set acquisition interval from a plurality of captured images P captured continuously in time series.

  The setting unit 18C (first setting unit) can include a calculation unit 18D (first calculation unit). The calculation unit 18D (first calculation unit) is a travel state having a high degree of importance in a predetermined post-process using an analysis result by the analysis unit 18H as the weight value W of the travel state based on the travel state information. The higher the weight value W is calculated. The setting unit 18C (first setting unit) preferably sets a shorter acquisition interval as the weight value W is higher than a predetermined threshold.

  The specifying unit 18G may further specify a part of the captured image area 32 in the captured image P specified as the processing target based on the running state information. In this case, it is preferable that the analysis unit 18H analyzes the captured image P by analyzing the specified captured image region 32.

  Further, it is preferable that the specifying unit 18G specifies the size and number of the captured image areas 32 based on the running state information in the captured image P specified as the processing target. Furthermore, the specifying unit 18G preferably includes a calculation unit 18M (third calculation unit). Based on the traveling state information, the calculating unit 18M calculates a higher weight value W as the traveling state weight value W, the higher the importance is in the traveling state in the post-processing using the analysis result by the analyzing unit 18H. The specifying unit 18G preferably specifies a larger captured image region 32 or a larger number of captured image regions 32 as the weight value W is higher than a predetermined threshold value.

  Further, the information processing apparatus 10 can include a receiving unit 18F and a changing unit 18E. The reception unit 18F receives reception information including a user ID (user identification information) of a user driving the vehicle 20 (moving body), instruction information indicating an instruction to change the threshold, or processing time information indicating a target processing time. Accept. The changing unit 18E can change the threshold according to the reception information.

<Modification 1>
In the above-described embodiment, the specifying unit 18G processes the captured images P for each acquisition interval according to the driving state information for the plurality of captured images P captured in time series acquired by the image acquiring unit 18A. The form specified as the object has been described as an example.

  However, the specifying unit 18G only needs to specify the captured image P to be processed based on the traveling state information, and is not limited to the form of specifying the captured image P for each acquisition interval according to the traveling state information.

  For example, the specifying unit 18G may specify the number of processed images P to be processed as a processing target according to the traveling state information.

  In this case, the setting unit 18C (second setting unit) may set the number of processed sheets according to the traveling state information instead of the acquisition interval. Then, the specifying unit 18G may specify the set number of processed images P as a processing target from a plurality of the captured images P continuously captured in time series.

  In this case, the setting unit 18C preferably sets the number of processed sheets using, for example, the following method. For example, the calculation unit 18D of the setting unit 18C calculates the weight value W of the traveling state based on the traveling state information in the same manner as in the above embodiment. The weight value W and the calculation method of the weight value W are the same as in the above embodiment.

  Then, the setting unit 18C may set a larger number of processed sheets as the weight value W calculated by the calculation unit 18D is higher than a predetermined threshold value. If the weight value W is less than or equal to the threshold value, the number of processed sheets may be a predetermined reference number of processed sheets. For this reason, as the weight value W is higher than the threshold value, a larger number of processed sheets is set with respect to the reference number of processed sheets.

  For this reason, the setting unit 18C sets a larger number of processed sheets as the traveling state of the vehicle 20 at the photographing timing of the captured image P indicates a traveling state having a higher importance in the post-processing.

  Note that the threshold used by the setting unit 18C for setting the number of processed sheets may be changed by the changing unit 18E, as in the above embodiment.

  As described above, the setting unit 18C sets the number of processed images according to the traveling state information, so that the specifying unit 18G can specify the number of processed images P according to the traveling state as a processing target.

In this case, for example, as illustrated in FIG. 5, it is assumed that the image acquisition unit 18A sequentially acquires a plurality of captured images P (captured images P ₁ to P _n ) captured in time series. Specifying unit 18G, among these plurality of captured images P (photographed images _{P 1} ~ photographic image _{P n),} taking the set number of processed sheets (e.g. three) images P (photographed images _{P 1} ~ photographed image _{P 3} ) May be specified as the captured image P to be processed.

  Thus, in this modification, the information processing apparatus 10 includes the setting unit 18C (second setting unit). The setting unit 18C sets the number of processed sheets according to the traveling state information. In this case, the specifying unit 18G can specify a set number of captured images P as a processing target from a plurality of captured images P that are continuously captured in time series.

  For this reason, also in the information processing apparatus 10 of this modification, the effect similar to the said embodiment is acquired.

  Further, the setting unit 18C (second setting unit) is a driving state having a higher importance in the post-processing using the analysis result by the analyzing unit 18H as the weight value W of the driving state based on the driving state information. A calculation unit 18D (second calculation unit) that calculates a high weight value W can be included. Then, the setting unit 18C (second setting unit) can set a larger number of processed sheets as the weight value W is higher than a predetermined threshold value.

<Modification 2>
In the above embodiment, the configuration in which the information processing apparatus 10 is mounted on the vehicle 20 has been described. However, the information processing apparatus 10 may be configured separately from the vehicle 20 and not mounted on the vehicle 20.

  In this case, a plurality of photographed images P photographed by the photographing unit 12 mounted on the vehicle 20, position information indicating the photographing position, traveling state information, and photographing timing corresponding to each photographing timing of each photographed image P. The captured image group data in which the timing information indicating is stored in advance may be stored in a known storage medium (for example, a memory card) or the storage unit 15 in advance.

  Then, the information processing apparatus 10 may perform analysis processing for each of the captured images P included in the captured image group data in the same manner as the control unit 18.

  FIG. 16 is a block diagram illustrating an example of a functional configuration of the information processing apparatus 10A according to the present modification.

  The information processing apparatus 10 </ b> A includes a storage unit 13, a UI unit 17, and a control unit 19. The storage unit 13 and the UI unit 17 are connected to the control unit 19 so as to be able to exchange data and signals.

  The storage unit 13 may be a known hard disk drive or a known storage medium (such as a memory card) that can be removed and carried. In the present embodiment, the storage unit 13 stores captured image group data 13A.

  The photographed image group data 13A associates the photographed image P, the photographing timing information indicating the photographing timing of the photographed image P, and the traveling state information indicating the traveling state of the vehicle 20 at the same timing as the photographing timing of the photographed image P. It is a thing. The photographed image group data 13A includes a plurality of photographed images P photographed in time series.

  The control unit 19 includes an image acquisition unit 17A, a traveling state acquisition unit 17B, a setting unit 18C, a calculation unit 18D, a change unit 18E, a reception unit 18F, a specification unit 17G, an analysis unit 18H, and a transmission unit. 18J, a calculation unit 17M, and a post-processing unit 18I. Image acquisition unit 17A, travel state acquisition unit 17B, setting unit 18C, calculation unit 18D, change unit 18E, reception unit 18F, identification unit 17G, analysis unit 18H, transmission unit 18J, calculation unit 17M, and post-processing unit 18I For example, the unit or all may cause a processing device such as a CPU to execute a program, that is, may be realized by software, may be realized by hardware such as an IC, or a combination of software and hardware. May be realized.

  The control unit 19 includes an image acquisition unit 17A, a travel state acquisition unit 17B, and a specification unit 17G instead of the image acquisition unit 18A, the travel state acquisition unit 18B, and the specification unit 18G. The control unit 19 does not include the receiving unit 18L and the display control unit 18K in the control unit 18. Except for this point, the control unit 19 has the same configuration as the control unit 18.

  The image acquisition unit 17A acquires a captured image P around the vehicle 20. In the present embodiment, the image acquisition unit 17A reads the captured images P sequentially from the captured image group data 13A stored in the storage unit 13 in the order of capturing timing (for example, in descending order). Then, the image acquisition unit 17A sequentially outputs the read captured images P to the specifying unit 17G.

  That is, the image acquisition unit 17A is the same as the image acquisition unit 18A of the above embodiment except that the captured image P is read from the captured image group data 13A of the storage unit 13 instead of the capturing unit 12.

  The traveling state acquisition unit 17B acquires traveling state information indicating the traveling state of the vehicle 20 when the captured image P is captured. Specifically, the traveling state acquisition unit 17B reads traveling state information corresponding to each of the captured images P acquired by the image acquisition unit 17A from the captured image group data 13A of the storage unit 13. By this reading, the traveling state acquisition unit 17B acquires traveling state information. Then, traveling state acquisition unit 17B outputs the acquired traveling state information to traveling state acquisition unit 17B and setting unit 18C.

  That is, the travel state acquisition unit 17B is the above embodiment except that the travel state information is read from the captured image group data 13A of the storage unit 13 instead of the GPS sensors 14 and 16 and the vehicle control unit 22 (see FIG. 3). This is the same as the traveling state acquisition unit 18B.

  The identifying unit 17G identifies the captured image P to be processed among the plurality of captured images P acquired by the image acquiring unit 17A. The identification unit 17G identifies the captured image P to be processed based on the traveling state information corresponding to each captured image P acquired by the traveling state acquisition unit 17B. The specifying unit 17G replaces the image acquisition unit 18A and the traveling state acquisition unit 18B with the exception of acquiring the captured image P and the traveling state information from each of the image acquisition unit 17A and the traveling state acquisition unit 17B. It is the same as the specific part 18G of the form.

  For this reason, the specifying unit 17G specifies the captured image P in the same manner as the specifying unit 18G. The analysis unit 18H, the post-processing unit 18I, and the transmission unit 18J are the same as the analysis unit 18H, the post-processing unit 18I, and the transmission unit 18J of the above embodiment.

  As described above, the information processing apparatus 10A may specify the processing target captured image P from the captured image P acquired from the captured image group data 13A based on the running state information. An effect similar to that of the information processing apparatus 10 of the above-described embodiment can be obtained for the information processing apparatus 10A of the present modification.

  Further, in this modification, since the captured image P specified by the specifying unit 17G may be read from the storage unit 13 and used for the analysis processing, the time for reading data from the storage unit 13 can be shortened.

  Next, hardware configurations of the information processing apparatus 10, the information processing apparatus 10A, and the server apparatus 40 according to the above-described embodiments and modifications will be described. FIG. 17 is a block diagram illustrating a hardware configuration example of the information processing apparatus 10, the information processing apparatus 10 </ b> A, and the server apparatus 40 according to the embodiment and the modification.

  The information processing apparatus 10, the information processing apparatus 10A, and the server apparatus 40 according to the above-described embodiment and modification examples include an output unit 80, an I / F unit 82, an input unit 94, a CPU 86, a ROM (Read Only Memory) 88, and a RAM. (Random Access Memory) 90, HDD 92, and the like are connected to each other by a bus 96 and have a hardware configuration using a normal computer.

  The CPU 86 is an arithmetic device that controls processing executed by each of the information processing apparatus 10, the information processing apparatus 10 </ b> A, and the server apparatus 40 according to the above-described embodiments and modifications. The RAM 90 stores data necessary for various processes by the CPU 86. The ROM 88 stores a program for realizing various processes by the CPU 86 and the like. The HDD 92 stores data stored in the storage unit 15, the storage unit 44, and the storage unit 13 described above. The I / F unit 82 is an interface for transmitting and receiving data to and from other devices. The output unit 80 corresponds to the display function of the UI unit 17 described above. The input unit 94 corresponds to the input function of the UI unit 17 described above.

  Programs for executing the various processes executed by the information processing apparatus 10, the information processing apparatus 10A, and the server apparatus 40 according to the above-described embodiment and modification are provided by being incorporated in advance in the ROM 88 or the like.

  Note that the programs executed by the information processing apparatus 10, the information processing apparatus 10A, and the server apparatus 40 in the above-described embodiments and modifications are files in a format that can be installed in these apparatuses or in an executable format, and are CD- You may comprise so that it may record and provide on computer-readable recording media, such as ROM, a flexible disk (FD), CD-R, DVD (Digital Versatile Disk).

  Further, the programs executed by the information processing apparatus 10, the information processing apparatus 10A, and the server apparatus 40 according to the above-described embodiments and modifications are stored on a computer connected to a network such as the Internet and downloaded via the network. You may comprise so that it may provide. In addition, the program for executing the above-described processes in the information processing apparatus 10, the analysis apparatus 10A, and the server apparatus 40 according to the embodiment and the modification is configured to be provided or distributed via a network such as the Internet. May be.

  In the program for executing the various processes executed by the information processing device 10, the information processing device 10A, and the server device 40 in the embodiment and the modification, the above-described units are generated on the main storage device. It is like that.

  Various information stored in the HDD 92 may be stored in an external device. In this case, the external device and the CPU 86 may be connected via a network or the like.

  Although the embodiment and the modification of the present invention have been described above, the embodiment and the modification are presented as examples, and are not intended to limit the scope of the invention. The novel embodiments and modifications can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. This embodiment and its modifications are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 Information processing system 10, 10A Information processing apparatus 18A Image acquisition part 18B Traveling state acquisition part 18C Setting part 18D Calculation part 18E Change part 18F Reception part 18G Identification part 18H Analysis part 18I Post-processing part 18J Transmission part 18M Calculation part 18L Reception part 40 Server device

JP 2007-047914 A

Claims (12)

An image acquisition unit for acquiring a captured image around the moving object;
A specifying unit for specifying the captured image to be processed based on traveling state information indicating a traveling state of the moving body at the time of capturing the captured image;
An analysis unit for analyzing the captured image specified as a processing target;
An information processing apparatus comprising:   The traveling state information includes speed information indicating the moving speed of the moving body, acceleration information indicating the acceleration of the moving body, position information indicating the position of the moving body, and that the moving body has decelerated in response to a brake operation. The information processing apparatus according to claim 1, comprising at least one of brake operation information to be displayed and angle information to indicate a steering angle of the moving body. A first setting unit that sets an acquisition interval for acquiring the captured image from the plurality of captured images captured in time series according to the running state information;
The specific part is:
The information processing apparatus according to claim 1 or 2, wherein the photographed image at each set acquisition interval is specified as a processing target from the plurality of photographed images continuously photographed in time series. The first setting unit includes:
Based on the travel state information, a first weight value that is higher as the travel state is more important in a predetermined post-process using a result of analysis by the analysis unit as a weight value of the travel state is calculated. Including the calculation part of
The information processing apparatus according to claim 3, wherein the acquisition interval is set shorter as the weight value is higher than a predetermined threshold. A second setting unit for setting the number of processed sheets according to the running state information;
The specific part is:
The information processing apparatus according to claim 1, wherein the set number of the captured images is specified as a processing target from a plurality of the captured images continuously captured in time series. The second setting unit includes:
Based on the running state information, a second calculating unit that calculates the weight value that is higher as the running state is more important in post-processing using the analysis result of the analyzing unit as the weight value of the running state Including
The information processing apparatus according to claim 5, wherein a larger number of the processed sheets is set as the weight value is higher than a predetermined threshold value. The specific part is:
Based on the running state information, further specify a part of the captured image area in the captured image specified as a processing target,
The information processing apparatus according to claim 1, wherein the analysis unit analyzes the captured image by analyzing the specified captured image region. The specific part is:
The information processing apparatus according to claim 7, wherein the captured image area having a size and a number based on the running state information in the captured image specified as a processing target is specified. The specific part is:
A third calculation unit that calculates the weight value that is higher as the travel state is more important in the post-processing using the analysis result by the analysis unit as the weight value of the travel state based on the travel state information Including
The information processing apparatus according to claim 8, wherein the higher the weight value is than a predetermined threshold, the larger the captured image area or the larger number of the captured image areas are specified. A reception unit that receives reception information including user identification information of a user who drives the mobile body, instruction information indicating an instruction to change the threshold, or processing time information indicating a target processing time;
A changing unit that changes the threshold according to the reception information;
An information processing apparatus according to any one of claims 4, 6, and 9. An information processing system comprising an information processing device and a server device that communicates with the information processing device,
The information processing apparatus includes:
An image acquisition unit for acquiring a captured image around the moving object;
A specifying unit for specifying the captured image to be processed based on traveling state information indicating a traveling state of the moving body at the time of capturing the captured image;
A transmission unit that transmits the captured image specified as the processing target to the server device;
An analysis unit for analyzing the captured image specified as a processing target;
An information processing system comprising: Obtaining a captured image of the periphery of the moving object;
Identifying the captured image to be processed based on traveling state information indicating a traveling state of the moving body at the time of capturing the captured image;
Analyzing the captured image identified as a processing target;
Processing program for causing a computer to execute.

Images