JP6994996B2 - Traffic route judgment system - Google Patents

Description

The present invention relates to a passage determination system for determining the state of a passage.

Patent Document 1 discloses that the degree of fatigue damage of a bridge is obtained by measuring the number of vehicles passing through the bridge by vehicle weight. It is said that a strain sensor provided on the bridge is used to identify the vehicle.

Japanese Unexamined Patent Publication No. 2004-44116

In the method described in Patent Document 1, it is necessary to install a strain sensor on the bridge in order to discriminate the vehicle, which requires a large amount of labor and cost. In addition, the strain sensor cannot always properly discriminate the vehicle, and there is a possibility that the state of the bridge cannot be properly discriminated.

The present invention has been made in view of the above, and an object of the present invention is to provide a passage determination system that enables easy and appropriate determination of the state of a passage such as a bridge.

In order to achieve the above object, the passage determination system according to the present invention has an image acquisition unit that acquires an image of an object passing on the passage, and an object that passes from the image acquired by the image acquisition unit. An object identification unit that specifies the type of the object, a determination unit that determines the state of the passage based on the type of the object specified by the object identification unit, and an object specified by the object identification unit when passing on the passage. The determination unit includes a vibration acquisition unit that acquires information indicating the vibration of the passage, and the determination unit is indicated by the information acquired by the vibration acquisition unit according to the type of the object specified by the object identification unit. The state of the passage is determined by comparing the vibrations at different timings when objects of the same type are passing. The object identification unit identifies the speed of a passing object from the image acquired by the image acquisition unit, and the determination unit determines the state of the passage based on the speed of the object specified by the object identification unit. .. Alternatively, the determination unit acquires information indicating the environment related to the passage when the object specified by the object identification unit passes on the passage, and the state of the passage is based on the information indicating the environment. To judge.

In the passage determination system according to the present invention, an object passing on the passage is specified from the image, and the state of the passage is determined based on the specified object. Therefore, according to the passage determination system according to the present invention, it is possible to easily and appropriately determine the state of the passage such as a bridge.

In the present invention, an object passing on the passage is specified from the image, and the state of the passage is determined based on the specified object. Therefore, according to the present invention, it is possible to easily and appropriately determine the state of a passage such as a bridge.

It is a figure which shows the structure of the passage determination system which concerns on embodiment of this invention. It is a figure which shows typically the determination of the vehicle type of the vehicle passing through a passage. It is a figure which shows the example of an image database. It is a figure which shows typically the example of the moving image which copied the passage | determination target, and the division into an element. It is an example of the graph of the vibration data of the passage. This is an example of a graph obtained by Fourier transforming vibration data. It is a flowchart which shows the process executed by the passage determination system which concerns on embodiment of this invention. It is a figure which shows the hardware configuration of the server included in the passage determination system which concerns on embodiment of this invention.

Hereinafter, embodiments of the passage determination system according to the present invention will be described in detail together with the drawings. In the description of the drawings, the same elements are designated by the same reference numerals, and duplicate description will be omitted.

FIG. 1 shows a passage determination system 1 according to the present embodiment. As shown in FIG. 1, the passage determination system 1 includes a camera 10 and a server 20. The passage determination system 1 is a system for determining the state of the passage. The passage to be determined is a bridge or a road through which a vehicle such as an automobile passes. The state of the passage to be determined is, for example, whether or not an abnormality has occurred in the passage (for example, deterioration has occurred). Alternatively, the state of the passage to be determined is a deterioration state (deterioration degree) of the passage, a sound condition (health degree) of the passage, or the like. The result of the determination by the passage determination system 1 is used, for example, for determination of reinforcement or repair of the passage. In the passage determination system 1, the server 20 determines the state of the passage using the image captured by the camera 10.

Subsequently, the configurations of the camera 10 and the server 20 included in the passage determination system 1 will be described. The camera 10 is an imaging device that captures an object such as a vehicle passing through a passage to be determined and acquires a moving image. The camera 10 is fixedly installed in advance at a position where the object can be imaged. As the camera 10, a well-known camera capable of taking an image at a resolution that can be used for processing by the server 20 described later can be used. The camera 10 and the server 20 can send and receive information to and from each other. The camera 10 images the passage path at a preset frame rate (fps) and transmits the captured moving image to the server 20.

Further, the camera 10 may capture a moving image for detecting the vibration of the passage. The moving image may be the same as the moving image obtained by capturing an object passing through the passage, or may be another moving image. In the case of different moving images, a camera 10 is provided for each moving image. The camera 10 that captures a moving image for detecting the vibration of the passage path is fixedly installed at a position where the passage path can be imaged in advance. The moving image for detecting the vibration of the passage is taken at the same timing as the moving image of an object such as a vehicle passing through the passage. The camera 10 also transmits the moving image to the server 20.

As shown in FIG. 1, the server 20 is functionally configured to include an image acquisition unit 21, an object identification unit 22, a vibration acquisition unit 23, a determination unit 24, and an output unit 25.

The image acquisition unit 21 is a functional unit that acquires an image of an object passing on the passage. The image acquisition unit 21 receives a moving image transmitted from the camera 10 and acquires the image. The image acquisition unit 21 outputs the acquired moving image (image) to the object identification unit 22 and the vibration acquisition unit 23.

The object identification unit 22 is a functional unit that identifies an object passing on the passage from the image acquired by the image acquisition unit 21. The object identification unit 22 specifies the speed of a passing object from the image acquired by the image acquisition unit 21.

The object identification unit 22 inputs a moving image from the image acquisition unit 21. For example, the object identification unit 22 identifies the vehicle type of a vehicle such as an automobile passing on the passage as an object passing on the passage. The object identification unit 22 identifies the vehicle type of the vehicle from a frame (image) of a preset timing in the moving image. The vehicle type can be specified by using a well-known method such as pattern recognition. FIG. 2 schematically shows an example of a method for specifying a vehicle type.

The object identification unit 22 stores an image database in advance. The image database is a database that stores an image of a vehicle, which is used to extract a portion in which a vehicle is shown from an image input from the image acquisition unit 21. The object identification unit 22 extracts a portion of the vehicle from the image input from the image acquisition unit 21 from the image stored in the cascade classifier and the image database stored in advance.

The object identification unit 22 stores the vehicle database in advance. The vehicle database is a database that stores images of vehicles used to identify a vehicle type from the above-extracted partial images. An example of a vehicle database is shown in FIG. As shown in FIG. 3, the vehicle database stores images of vehicles for each vehicle type. Further, in the vehicle database, information indicating the weight of the vehicle may be stored in association with each vehicle type.

The object identification unit 22 identifies the vehicle type from the extracted partial image from the cascade classifier stored in advance (different from the cascade classifier for extracting the above partial image) and the image stored in the vehicle database. ..

Further, the object specifying unit 22 specifies the speed of the vehicle for which the vehicle type has been specified. The object identification unit 22 calculates the pixel displacement of the vehicle from each frame (image) constituting the moving image by optical flow. The object identification unit 22 calculates the displacement amount of the vehicle in the real space from the calculated pixel displacement and the preset or calculated distance per pixel in the real space. The object identification unit 22 calculates the speed of the vehicle from the calculated displacement amount of the vehicle and the frame rate of the moving image. It should be noted that the specification (calculation) of the vehicle speed from the moving image does not necessarily have to be performed by the above method, but may be performed by any conventional method. The object identification unit 22 outputs information indicating the vehicle type and speed of the specified vehicle to the determination unit 24.

The vibration acquisition unit 23 is a functional unit that acquires information indicating vibration of the passage when the object specified by the object identification unit 22 passes on the passage. The vibration acquisition unit 23 acquires a moving image of the passage, and detects the vibration of the passage from the acquired moving image.

The vibration acquisition unit 23 inputs and acquires a moving image in which the passage path for detecting the vibration of the passage path is captured from the image acquisition unit 21. The vibration acquisition unit 23 detects the displacement in sub-pixel units from the moving image by a conventional technique such as POC (Phase Only Correlation), and detects the vibration of the passage. For example, the vibration acquisition unit 23 detects vibration as follows.

The vibration acquisition unit 23 divides the acquired moving image as shown in FIG. 4 into individual frames (images) constituting the moving image. The vibration acquisition unit 23 extracts (divides into partial images) partial images (phase images) of a plurality of regions at preset positions from individual frames. In this embodiment, each region is referred to as an element E. The size of the element E is preset. The position of the element E is the position where the passage is shown in the moving image. The position of the element E is, for example, set in advance by the user of the passage determination system 1 and stored in the vibration acquisition unit 23. Alternatively, the vibration acquisition unit 23 may detect the position where the passage is shown in the moving image and set the detected position as the position of the element E.

The vibration acquisition unit 23 calculates the positional deviation of the same (positional) element E between the front and rear frames with sub-pixel accuracy. The time difference Δt between the preceding and following frames is the reciprocal of the frame rate (fps) (Δt = 1 / fps). The vibration acquisition unit 23 calculates the positional deviation in the y direction of the moving image, for example, when determining the state of the bridge. This is because the deterioration of the bridge proceeds in response to vibration in the vertical direction (vertical direction). The vibration acquisition unit 23 calculates the positional deviation (displacement y) between the front and rear frames for each element from the moving image as the vibration of the passage. The vibration data obtained from the moving image by the vibration acquisition unit 23 is the data of the element i and the displacement y for each time (time) t as shown in FIG. The vibration acquisition unit 23 outputs the obtained vibration data to the determination unit 24.

The information indicating the vibration of the passage acquired by the vibration acquisition unit 23 and the information indicating the object (vehicle type, etc.) specified by the object identification unit 22 are associated with each other. The association is performed so that the vibration of the passage is the vibration of the passage when the specified object passes on the passage. Specifically, the vibration detected (specified) from the image (moving image) captured at the same timing is associated with the object. Further, in the above example, vibrations at a plurality of points (elements) of the passage are detected, but the vibrations at a plurality of points do not have to be detected, and vibrations at one place may be detected.

The determination unit 24 is a functional unit that determines the state of the passage based on the object specified by the object identification unit 22. The determination unit 24 determines the state of the passage based on the speed of the object specified by the object identification unit 22. The determination unit 24 determines the state of the passage by comparing the vibrations at different timings indicated by the information acquired by the vibration acquisition unit 23 according to the object specified by the object identification unit 22.

The vibration of the passage due to the passage of a vehicle or the like depends on the deterioration of the passage. Therefore, by comparing the vibrations of the passages in time series, it is possible to grasp the state of deterioration of the passages and the like. However, on the other hand, the vibration of the passage is dependent on the passing vehicle or the like. For example, the vibration of the passage differs depending on whether a heavy vehicle passes through or a light vehicle passes through. In that case, even if these vibrations are compared, it is not possible to properly grasp the state such as deterioration of the passage. In this embodiment, the vibrations to be compared with each other are appropriate for the object specified by the object identification unit 22.

As described above, the determination by the determination unit 24 is performed based on the vibration of the passage at different timings. Therefore, the object identification unit 22 identifies the object from the moving images captured at a plurality of different timings, and the vibration acquisition unit 23 detects the vibration of the passage. The determination unit 24 inputs information on the object and vibration specified from the moving image captured at each timing from the object identification unit 22 and the vibration acquisition unit 23.

The determination unit 24 determines, for example, the state of the passage by comparing the vibrations when vehicles of the same vehicle type are passing. The determination unit 24 determines the state by comparing the natural frequencies at different timings, for example. The determination unit 24 Fourier transforms the vibration data (displacement y data for each time (time) t) input from the vibration acquisition unit 23 for each timing. By the Fourier transform, the vibration data becomes the intensity (power) data for each frequency (Hz) as shown in FIG. The determination unit 24 calculates (detects) the natural frequency (predominant frequency) from the vibration data obtained by the Fourier transform. The natural frequency is, for example, the lowest frequency among the frequencies at which the intensity reaches the maximum value. It is generally said that when a bridge deteriorates, its natural frequency decreases. The determination unit 24 calculates the natural frequency of the moving images captured at a plurality of timings as shown in FIG. 5, and when the natural frequency is lower than the preset threshold value, the passage is deteriorated. Judge. When the vibration of the passage is detected for each element, it may be determined for each element (location).

For example, the determination unit 24 divides the speed of the vehicle at regular intervals and compares the vibrations when vehicles of the same vehicle type are passing in the same speed range to determine the state of the passage. May be. Further, for example, the determination unit 24 divides the weight of the vehicle at regular intervals and compares the vibrations when a vehicle having the same range of weight is passing instead of the vehicle type to determine the state of the passage. It may be determined.

Further, the determination unit 24 acquires information indicating the environment related to the passage when the object specified by the object identification unit 22 passes on the passage, and is also based on the information indicating the environment (external information). Therefore, the state of the passage may be determined. As the information indicating the environment, for example, the weather or the air temperature at the place of the passage at the timing when the vibration is detected is used. This information may be acquired by providing a sensor for the passage route, or may be acquired from an external server or the like for weather forecast information. Weather and temperature can also affect the vibration of the passage. The determination unit 24 may determine the state of the passage by comparing the vibrations in the case of the same weather or the same range of temperature in addition to the vehicle type, etc., based on the acquired information indicating the environment. good.

The determination unit 24 outputs information indicating the determination result, for example, information indicating whether or not the passage has deteriorated, to the output unit 25.

The output unit 25 is a functional unit that outputs information indicating a determination result of the state of the passage by the determination unit 24. The output unit 25 transmits, for example, the information to a terminal connected to the server 20 and displays the information. The output by the output unit 25 is referred to by, for example, the user of the passage determination system 1, and is used for determination of reinforcement or repair of the passage as described above. The output by the output unit 25 may be performed on a device other than the above, or may be performed in a form other than the above. The above is the configuration of the passage determination system 1.

Subsequently, using the flowchart of FIG. 7, a process executed by the passage determination system 1 according to the present embodiment (operation method performed by the passage determination system 1) will be described. First, the camera 10 takes an image of the passage to be determined and the vehicle passing through the passage, and acquires a moving image (S01). The captured moving image is transmitted from the camera 10 to the server 20. In the server 20, a moving image is acquired by the image acquisition unit 21. Subsequently, the object identification unit 22 identifies the vehicle type, speed, and the like of the vehicle from the moving image (S02). Further, the vibration acquisition unit 23 detects the vibration of the passage from the moving image (S03). Imaging (S02), identification of vehicle type (S02), and detection of vibration of a passage (S03) are performed at a plurality of different timings.

Subsequently, the determination unit 24 compares the vibrations at different timings according to the specified vehicle type and the like, and determines the state of the passage (S04). Subsequently, the output unit 25 outputs information indicating the determination result of the state of the passage by the determination unit 24 (S05). The above is the process executed by the passage determination system 1 according to the present embodiment.

In the present embodiment, an object such as a vehicle passing on the passage is specified from the image, and the state of the passage is determined based on the specified object. Therefore, even if the strain sensor or the like is not provided in the passage path, the determination can be made according to the object passing through the passage path. In addition, the object can be specified more appropriately than in the case of using a strain sensor or the like. Therefore, according to the present embodiment, it is possible to easily and appropriately determine the state of a passage such as a bridge.

Further, as in the present embodiment, the passage route may be determined based on the speed. As described above, the speed of a vehicle or the like passing through the passage also affects the vibration of the passage. Therefore, according to this configuration, it is possible to more appropriately determine the state of the passage. However, it is not always necessary to use the speed to determine the passage route.

Further, as in the present embodiment, information indicating the vibration of the passage may be acquired, and the vibration may be compared according to the specified object to determine the state of the passage. According to this configuration, it is possible to make an appropriate determination using the vibration of the passage. However, in the present invention, the vehicle may be specified and determined from the image, and the determination using vibration does not necessarily have to be performed.

Further, when the determination is made by vibration as in the present embodiment, the vibration may be detected from the moving image. According to this configuration, it can be performed from the moving image captured including the identification of the object, and the state of the passage can be easily and appropriately determined. However, the vibration is not necessarily detected by a moving image, but may be detected by a vibration sensor or the like provided in the passageway.

Further, as in the present embodiment, the passage route may be determined based on the information indicating the environment such as the weather or the temperature. As mentioned above, the environment such as weather or temperature also affects the vibration of the passage. Therefore, according to this configuration, it is possible to more appropriately determine the state of the passage. However, it is not always necessary to use information indicating the environment for determining the passage route.

In the present embodiment, the camera 10 captures and acquires a moving image, but when only the vehicle type is specified from the image, it is not always necessary to acquire the moving image, and the image is acquired. May be done.

Further, since the passage determination system according to the present invention only needs to be able to acquire an image or a moving image, it may be configured to be able to acquire a moving image from other than the passage determination system. For example, if the server 20 according to the present embodiment is configured to be able to acquire an image or a moving image from the camera 10 (other than the passage determination system), even if the passage determination system is configured only by the server 20. good.

Further, in the present embodiment, the example of the object passing through the passage is a vehicle such as an automobile, but the object may be a vehicle other than the automobile or an object other than the vehicle (for example, a person). For example, the state of the passage may be determined according to the number of passersby instead of the vehicle type of the above-mentioned vehicle. Further, the passage to be determined may be a track on which a train or the like passes. In this case, the object passing through the passage may be a vehicle such as a train.

The block diagram used in the description of the above embodiment shows a block of functional units. These functional blocks (components) are realized by any combination of hardware and / or software. Further, the means for realizing each functional block is not particularly limited. That is, each functional block may be realized by one physically and / or logically coupled device, or directly and / or indirectly by two or more physically and / or logically separated devices. (For example, wired and / or wireless) may be connected and realized by these plurality of devices.

For example, the server 20 in one embodiment of the present invention may function as a computer that processes the server 20 in the present embodiment. FIG. 8 is a diagram showing an example of the hardware configuration of the server 20 according to the present embodiment. The server 20 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

In the following description, the word "device" can be read as a circuit, a device, a unit, or the like. The hardware configuration of the server 20 may be configured to include one or more of the devices shown in the figure, or may be configured not to include some of the devices.

For each function in the server 20, by loading predetermined software (program) on hardware such as the processor 1001 and the memory 1002, the processor 1001 performs an operation, and the communication device 1004 communicates with the memory 1002 and the storage 1003. It is realized by controlling the reading and / or writing of data.

Processor 1001 operates, for example, an operating system to control the entire computer. The processor 1001 may be composed of a central processing unit (CPU) including an interface with a peripheral device, a control device, an arithmetic unit, a register, and the like. For example, each function of the server 20 may be realized by the processor 1001.

Further, the processor 1001 reads a program (program code), a software module and data from the storage 1003 and / or the communication device 1004 into the memory 1002, and executes various processes according to these. As the program, a program that causes a computer to execute at least a part of the operations described in the above-described embodiment is used. For example, each function of the server 20 may be realized by a control program stored in the memory 1002 and operated by the processor 1001. Although it has been described that the various processes described above are executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. Processor 1001 may be mounted on one or more chips. The program may be transmitted from the network via a telecommunication line.

The memory 1002 is a computer-readable recording medium, and is composed of at least one such as a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and a RAM (Random Access Memory). May be done. The memory 1002 may be referred to as a register, a cache, a main memory (main storage device), or the like. The memory 1002 can store a program (program code), a software module, or the like that can be executed to carry out the method according to the embodiment of the present invention.

The storage 1003 is a computer-readable recording medium, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, an optical magnetic disk (for example, a compact disk, a digital versatile disk, a Blu-ray). It may consist of at least one (registered trademark) disk), smart card, flash memory (eg, card, stick, key drive), floppy (registered trademark) disk, magnetic strip, and the like. The storage 1003 may be referred to as an auxiliary storage device. The storage medium described above may be, for example, a database, server or other suitable medium containing memory 1002 and / or storage 1003.

The communication device 1004 is hardware (transmission / reception device) for communicating between computers via a wired and / or wireless network, and is also referred to as, for example, a network device, a network controller, a network card, a communication module, or the like. For example, each function of the server 20 may be realized by the communication device 1004.

The input device 1005 is an input device (for example, a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that receives an input from the outside. The output device 1006 is an output device (for example, a display, a speaker, an LED lamp, etc.) that outputs to the outside. The input device 1005 and the output device 1006 may have an integrated configuration (for example, a touch panel).

Further, each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be composed of a single bus or may be composed of different buses between the devices.

Further, the server 20 includes hardware such as a microprocessor, a digital signal processor (DSP: Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). The hardware may implement some or all of each functional block. For example, the processor 1001 may be implemented on at least one of these hardware.

Although the present embodiment has been described in detail above, it is clear to those skilled in the art that the present embodiment is not limited to the embodiments described in the present specification. This embodiment can be implemented as an amendment or modification without departing from the spirit and scope of the present invention as determined by the description of the scope of claims. Therefore, the description herein is for purposes of illustration only and has no limiting implications for this embodiment.

The notification of information is not limited to the embodiments / embodiments described herein, and may be performed by other methods. For example, information notification includes physical layer signaling (eg, DCI (Downlink Control Information), UCI (Uplink Control Information)), higher layer signaling (eg, RRC (Radio Resource Control) signaling, MAC (Medium Access Control) signaling, etc. It may be carried out by broadcast information (MIB (Master Information Block), SIB (System Information Block)), other signals, or a combination thereof. Further, the RRC signaling may be referred to as an RRC message, and may be, for example, an RRC Connection Setup message, an RRC Connection Reconfiguration message, or the like.

The processing procedures, sequences, flowcharts, and the like of each aspect / embodiment described in the present specification may be rearranged in order as long as there is no contradiction. For example, the methods described herein present elements of various steps in an exemplary order and are not limited to the particular order presented.

The input / output information and the like may be stored in a specific place (for example, a memory) or may be managed by a management table. Information to be input / output may be overwritten, updated, or added. The output information and the like may be deleted. The input information or the like may be transmitted to another device.

The determination may be made by a value represented by one bit (0 or 1), by a true / false value (Boolean: true or false), or by comparing numerical values (for example, a predetermined value). It may be done by comparison with the value).

Each aspect / embodiment described in the present specification may be used alone, in combination, or may be switched and used according to the execution. Further, the notification of predetermined information (for example, the notification of "being X") is not limited to the explicit one, but is performed implicitly (for example, the notification of the predetermined information is not performed). May be good.

Software, whether called software, firmware, middleware, microcode, hardware description language, or other names, is an instruction, instruction set, code, code segment, program code, program, subprogram, software module. , Applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, features, etc. should be broadly interpreted.

Further, software, instructions, and the like may be transmitted and received via a transmission medium. For example, the software may use wired technology such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL) and / or wireless technology such as infrared, wireless and microwave to website, server, or other. When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission medium.

The information, signals, etc. described herein may be represented using any of a variety of different techniques. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description are voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these. It may be represented by a combination of.

The terms described herein and / or the terms necessary for understanding the present specification may be replaced with terms having the same or similar meanings.

The terms "system" and "network" used herein are used interchangeably.

Further, the information, parameters, etc. described in the present specification may be represented by an absolute value, a relative value from a predetermined value, or another corresponding information. ..

The names used for the parameters mentioned above are not limited in any way. Further, mathematical formulas and the like using these parameters may differ from those expressly disclosed herein.

The terms "determining" and "determining" as used herein may include a wide variety of actions. "Judgment" and "decision" are, for example, judgment, calculation, computing, processing, deriving, investigating, looking up (eg, table). , Searching in a database or another data structure), ascertaining can be considered as a "judgment" or "decision". Also, "judgment" and "decision" are receiving (for example, receiving information), transmitting (for example, transmitting information), input (input), output (output), and access. It may include (for example, accessing data in memory) to be regarded as "judgment" or "decision". In addition, "judgment" and "decision" are considered to be "judgment" and "decision" when the things such as solving, selecting, choosing, establishing, and comparing are regarded as "judgment" and "decision". Can include. That is, "judgment" and "decision" may include considering some action as "judgment" and "decision".

The terms "connected", "coupled", or any variation thereof, mean any direct or indirect connection or connection between two or more elements and each other. It can include the presence of one or more intermediate elements between two "connected" or "combined" elements. The connection or connection between the elements may be physical, logical, or a combination thereof. As used herein, the two elements are by using one or more wires, cables and / or printed electrical connections, and, as some non-limiting and non-comprehensive examples, radio frequencies. By using electromagnetic energies such as electromagnetic energies with wavelengths in the region, microwave region and light (both visible and invisible) regions, they can be considered to be "connected" or "coupled" to each other.

The phrase "based on" as used herein does not mean "based on" unless otherwise stated. In other words, the statement "based on" means both "based only" and "at least based on".

As used herein by designations such as "first", "second", etc., any reference to that element does not generally limit the quantity or order of those elements. These designations can be used herein as a convenient way to distinguish between two or more elements. Therefore, references to the first and second elements do not mean that only two elements can be adopted there, or that the first element must somehow precede the second element.

As long as "include", "including", and variations thereof are used herein or within the scope of the claims, these terms are similar to the term "comprising". In addition, it is intended to be inclusive. Moreover, the term "or" as used herein or in the claims is intended to be non-exclusive.

In the present specification, a plurality of devices shall be included unless the device has only one device apparently in context or technically. The entire disclosure is intended to include more than one, unless the context clearly indicates the singular.

1 ... Traffic path determination system, 10 ... Camera, 20 ... Server, 21 ... Image acquisition unit, 22 ... Object identification unit, 23 ... Vibration acquisition unit, 24 ... Judgment unit, 25 ... Output unit, 1001 ... Processor, 1002 ... Memory , 1003 ... Storage, 1004 ... Communication device, 1005 ... Input device, 1006 ... Output device, 1007 ... Bus.

Claims (3)

An image acquisition unit that acquires an image of an object passing on a passageway, and an image acquisition unit.
From the image acquired by the image acquisition unit, the object identification unit that specifies the type of the passing object and the object identification unit.
A determination unit that determines the state of the passage based on the type of the object specified by the object identification unit, and a determination unit.
A vibration acquisition unit that acquires information indicating vibration of the passage when an object specified by the object identification portion passes on the passage, and a vibration acquisition unit.
Equipped with
The determination unit vibrates at different timings when an object of the same type is passing, which is indicated by the information acquired by the vibration acquisition unit, according to the type of the object specified by the object identification unit. To determine the condition of the passage ,
The object identification unit identifies the speed of a passing object from the image acquired by the image acquisition unit.
The determination unit is a passage determination system that determines the state of the passage based on the speed of the object specified by the object identification unit . An image acquisition unit that acquires an image of an object passing on a passageway, and an image acquisition unit.
From the image acquired by the image acquisition unit, the object identification unit that specifies the type of the passing object and the object identification unit.
A determination unit that determines the state of the passage based on the type of the object specified by the object identification unit, and a determination unit.
A vibration acquisition unit that acquires information indicating vibration of the passage when an object specified by the object identification portion passes on the passage, and a vibration acquisition unit.
Equipped with
The determination unit vibrates at different timings when an object of the same type is passing, which is indicated by the information acquired by the vibration acquisition unit, according to the type of the object specified by the object identification unit. To determine the condition of the passage ,
The determination unit acquires information indicating the environment related to the passage when the object specified by the object identification unit passes on the passage, and based on the information indicating the environment, the passage. Traffic route judgment system that judges the state of . The passage determination system according to claim 1 or 2, wherein the vibration acquisition unit acquires a moving image of the passage and detects the vibration of the passage from the acquired moving image.

Images