JP7228476B2 - region determination device - Google Patents

Description

The present invention relates to an area determination device.

Patent Literature 1 describes a measuring device that measures the movement of a structure such as a bridge girder. This measurement device includes an imaging unit that captures images of a plurality of grid patterns provided on a structure at predetermined time intervals, and a displacement of the grid pattern between two points in time based on a plurality of image data showing the grid pattern. and a processing unit for calculating.

JP 2015-141151 A

In the apparatus as described above, the displacement of the structure is detected based on the change in the position of the grid pattern between two points in time. It is necessary and burdens the workers. Therefore, it is required to detect the displacement of each area of the structure without using the grid pattern. However, in this case, it is necessary for the operator to set a measurement area for detecting the displacement of the structure in the image showing the structure.

An object of one aspect of the present invention is to provide an area determination device capable of determining a measurement area suitable for detecting displacement of a structure.

An area determination device according to one aspect of the present invention includes an acquisition unit that acquires an image of a structure, and sets a plurality of areas including at least part of the structure in the image acquired by the acquisition unit. a setting unit, a deriving unit for deriving an index indicating ease of detection of relative positional displacement in an image for each of the plurality of regions set by the setting unit, and based on the index derived by the deriving unit and a determination unit that determines a candidate for the measurement area used for measuring the displacement of the structure.

In this region determination device, an index indicating the ease of detection of positional deviation is derived for each of a plurality of regions set within an image. This index can be an index of whether or not it is easy to detect the displacement of the structure in the region between the images with different time axes. Based on such an index, candidates for the measurement area used for measuring the displacement of the structure are determined, so it is possible to determine a measurement area suitable for detecting the displacement of the structure. Therefore, the time required to determine the measurement area can be shortened.

One aspect of the present invention can provide an area determination device capable of determining a measurement area suitable for detecting displacement of a structure.

It is a block diagram which shows the structure of the area|region determination apparatus which concerns on an example. It is a figure which shows typically the example which images a structure and sets a candidate area|region in the imaged image. 9 is a flowchart showing an example of processing by a derivation unit; . It is a figure which shows typically an example of the process by a derivation|leading-out part. It is a figure which shows typically an example of the process by a derivation|leading-out part. It is a figure which shows typically an example of the process by a derivation|leading-out part. It is a figure which shows an example of the data derived|led-out by a derivation|leading-out part. It is a flowchart which shows an example of the process by an area|region determination apparatus. . It is a figure which shows the hardware constitutions of the area|region determination apparatus which concerns on embodiment of this invention.

Hereinafter, an embodiment of the area determining device according to the present invention will be described in detail with reference to the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and overlapping descriptions are omitted.

FIG. 1 shows an area determination support system including an area determination device according to this embodiment. FIG. 2 is a diagram schematically showing an example of capturing an image of a structure (bridge) and setting candidate regions in the captured image. A region determination support system 1 shown in FIG. 1 includes an imaging device 10 and a region determination device 20 . The region determination support system 1 is a system that presents regions that are candidates for measurement regions and supports the determination of measurement regions. The measurement region is a region to be measured when measuring the amount of displacement of the structure based on the moving image, and is a region of interest (ROI) in the structure.

Structures whose displacement amounts are to be measured are, for example, bridges, steel towers, utility poles, buildings, and the like. In one example of measuring the amount of displacement of a structure, the amount of displacement of the structure within the measurement area is calculated based on a moving image of the structure. The amount of displacement may be the amount of movement of the position of the structure over time within a plane that intersects the one direction when the structure is viewed from the one direction. By measuring the amount of displacement of the structure, for example, the state of the structure can be determined. The state of the structure to be determined may be, for example, whether or not there is an abnormality (for example, deterioration) in the structure. In such displacement measurement, a moving image is used to determine the state of a structure.

Next, configurations of the imaging device 10 and the region determination device 20 included in the region determination support system 1 will be described. The imaging device 10 images the target structure 2 and acquires the image of the structure 2 as data. An example of the imaging device 10 may be a known camera capable of capturing a moving image with a resolution that can be used to determine the state of the structure 2 . The imaging device 10 is fixedly installed in advance at a position where the structure 2 can be imaged. The imaging device 10 and the region determining device 20 can transmit and receive information to and from each other. The imaging device 10 as an example captures an image of the structure 2 at a preset frame rate (fps) and transmits data of the captured moving image to the area determination device 20 .

The region determination device 20 is functionally configured to include an acquisition unit 21 , a setting unit 22 , a derivation unit 23 and a determination unit 25 . The acquisition unit 21 is a functional unit that acquires the image 3 . The acquisition unit 21 acquires an image 3 of the whole or part of the structure 2 . In one example, the image 3 acquired by the acquisition unit 21 is a still image having a rectangular image area defined by image width and image height. In this embodiment, the acquisition unit 21 receives a moving image captured by the imaging device 10 from the imaging device 10 . The acquisition unit 21 acquires a still image of the structure 2 based on the received moving image. For example, the acquisition unit 21 may acquire a still image by acquiring any one frame that constitutes a moving image of the structure 2 . In this case, for example, one initial frame of the moving image may be acquired. Further, the acquiring unit 21 may acquire a still image by averaging moving images of the structure 2 in the time direction. When a moving image is averaged in the time direction, a still image is generated by averaging a plurality of frames constituting the moving image, so image noise can be reduced. Acquisition unit 21 outputs the acquired still image to setting unit 22 .

The setting unit 22 is a functional unit that sets a plurality of candidate regions 4 including at least part of the structure 2 in the image 3 acquired by the acquisition unit 21 . The candidate area 4 is an area that can be a candidate for the measurement area in displacement measurement of the structure 2 based on the moving image. The setting unit 22 of the present embodiment acquires the image 3 of the structure 2 from the acquisition unit 21 . The setting unit 22 sets a plurality of candidate regions 4 within the acquired image 3 . For example, the setting unit 22 may detect, as the candidate area 4, an area in the image 3 in which an object may be recognized by using an object area detection method such as BING (Binarized Normed Gradients for Objectness Estimation). good. In addition, the setting unit 22 uses a recognition model constructed using a group of images for machine learning specialized for structures, structural elements, etc., to identify areas in the image 3 where an object can be recognized as a candidate. It may be detected as region 4. Furthermore, the setting unit 22 may generate a plurality of points at random positions in the image 3 and set an area of a specified size centering on these points as the candidate area 4 .

The candidate area 4 set by the setting unit 22 may have a rectangular shape with a width along the image width direction and a height along the image height direction. The candidate area 4 can be specified by data including center coordinates, width, and height. Each candidate region 4 may be given a region index for distinguishing between regions. In FIG. 2, the candidate area 4 set by the setting unit 22 is shown in the image 3 as a bounding box. In one example, the image 3 on which the bounding box is superimposed may be output to a monitor or the like. In this case, the position and the like of the candidate area 4 set in the image 3 by the user can be confirmed. At this time, if a bounding box that does not contain any structure is set in the image 3, the candidate area indicated by the bounding box may be deleted by the user's operation.

The derivation unit 23 is a functional unit that derives an index indicating the ease of detection of relative displacement in the image 3 for each of the plurality of candidate regions 4 set by the setting unit 22 . In the following description, the index is called a displacement determination easiness degree. It should be noted that the displacement is a partial displacement (fluctuation) of the structure 2 caused by vibration or the like. A displacement can be detected as a partial misalignment of the structure within the frame of the image 3 . In the moving image of the structure 2 in which the positions are partially displaced due to vibration or the like, the positions of the regions set in the same part of the structure 2 may be displaced between different frames. Therefore, the displacement of the structure 2 can be measured (estimated) based on the detection of this positional deviation. That is, the easiness of detecting the positional deviation in the image 3 can be an index indicating the easiness of measuring the displacement of the structure 2 in the moving image.

FIG. 3 is a flowchart showing an example of processing by the derivation unit 23. As shown in FIG. FIG. 3 shows processing for one candidate area 4 set by the setting unit 22 . 4, 5 and 6 are diagrams for explaining the flow chart of FIG. FIG. 4 schematically illustrates the process by which the autocorrelation function generated for each extended candidate region is compared with the ideal autocorrelation function. FIG. 5 schematically shows how the candidate area is expanded. FIG. 6 is a diagram for explaining the process of evaluating a candidate area based on the relationship between the size (w, h) of the candidate area and the degree of ease of displacement determination ζ. FIG. 6 shows a graph schematically showing the relationship between the size (w, h) of the candidate region and the degree of ease of displacement determination ζ.

In one example of processing, the derivation unit 23 calculates the autocorrelation function I(w, h) of the image within the candidate region 4A set within the image 3 by the setting unit 22 (step S11). Note that w means the width of the candidate area, and h means the height of the candidate area. For example, the autocorrelation function may be a so-called phase-only correlation function. In one example, the derivation unit 23 extracts the phase component of the image within the candidate region and calculates the autocorrelation function (power spectrum) of the extracted phase component. Note that the autocorrelation function is a two-dimensional autocorrelation function calculated by mutually shifting the same phase images in the width direction and the height direction (see FIG. 4). In the autocorrelation function of FIG. 4, the degree of correlation between phase images is plotted against the amount of shift in the width direction (w) and height direction (h). The correlation between the phase images is highest near the center where the amount of displacement in the width direction (w) and height direction (h) is zero.

Subsequently, the deriving unit 23 calculates the degree of ease of displacement determination ζ (step S12). In one example, the displacement determination easiness ζ is expressed by the following equation using the Frobenius norm, where I _ideal is the theoretical value of the autocorrelation function, that is, the ideal autocorrelation function.
ζ _i =||I(w,h)−I _ideal || _F

That is, the displacement determination easiness ζ in one example can be indicated as the magnitude of the error between the calculated autocorrelation function I(w,h) and the ideal autocorrelation function _Iideal . Therefore, when the calculated autocorrelation function I(w,h) is close to the ideal autocorrelation function I _ideal and the mutual error is small, the displacement is easy to detect, and the displacement determination easiness ζ becomes small. Note that the theoretical value I _ideal of the autocorrelation function may be, for example, a sinc function. For example, the theoretical value I _ideal of the autocorrelation function is generated according to the size (w, h) of the candidate region for which the degree of ease of displacement determination ζ is to be calculated. With such a theoretical value I _ideal of the autocorrelation function, there is a correlation peak only near the center where the displacement in the width direction (w) and height direction (h) is zero, and the width direction (w) and height Correlation fluctuates less and is smoother in the periphery where the amount of deviation in the direction (h) is large.

Subsequently, the derivation unit 23 expands the candidate area 4A (step S13). For example, the derivation unit 23 expands the size (width and height) of the bounding box that determines the candidate area 4A by a predetermined size. FIG. 5 is a diagram schematically showing how the candidate area is extended. In FIG. 5, the candidate area 4A set by the setting unit 22 is indicated by a solid line, and images of the candidate areas 4B and 4C obtained by expanding the candidate area 4A are indicated by a broken line and a dashed line, respectively. A candidate area 4C indicated by a dashed line is an example of a candidate area obtained by further expanding the candidate area 4B indicated by a dashed line. As shown in FIG. 5, the original candidate area 4A and the expanded candidate areas 4B and 4C have the same center position and differ only in width and height.

Subsequently, the derivation unit 23 determines whether or not the size of the expanded candidate region 4 exceeds a preset reference value (step S14). If it is determined in step S14 that the size of the candidate region 4 does not exceed the reference value, the derivation unit 23 repeats the processing from step S11 until the size of the candidate region 4 exceeds the reference value in step S13. In this embodiment, the area determination device 20 determines a measurement area used for displacement measurement for detecting anomalies in the structure 2 . When measuring the displacement of the structure 2, if the size of the measurement area is small, the area of interest can be finely set, so that variations in fine portions of the structure can be captured. On the other hand, when the size of the measurement region is large, the scale width of the width w and height h of the autocorrelation function becomes fine, so the position of the correlation peak (magnitude of variation) can be measured with fine numerical values. The derivation unit 23 of the present embodiment determines a predetermined reference value for the size of the candidate region 4, and calculates the displacement determination easiness degree ζ while expanding the candidate region 4 within the range of the reference value. By providing a reference value in this way, a suitable measurement area that is neither too large nor too small can be generated.

Reference values may be set for the width and height, for example. In that case, it may be determined that the size of the candidate area exceeds the reference value when either one of the width and height of the candidate area exceeds the reference value. Alternatively, it may be determined that the size of the candidate area exceeds the reference value when both the width and height of the candidate area exceed the reference value. In the latter case, when only one of the width and height exceeds the reference value, both the width and height may be expanded in the next step S13, or only the other of the width and height may be expanded. good.

If it is determined in step S14 that the size of the extended candidate region 4 exceeds the reference value, the deriving unit 23 selects the candidate regions having different sizes generated in step S13, and determines the degree of ease of displacement determination ζ. Those with high evaluations are stored as measurement area candidates (step S15). When the displacement determination easiness .zeta. is calculated using the Frobenius norm as described above, as shown in FIG. 6, the displacement determination easiness .zeta., which is highly evaluated and suitable for displacement measurement, takes a minimal value. Therefore, the width w _i and the height h _i that minimize the displacement determination easiness ζ are associated with the center positions of the candidate regions and stored as measurement region candidates. Viewed from another aspect, the processing from step S11 to step S15 can also be said to be processing for determining the size of the candidate region 4 so as to maximize the evaluation of the degree of ease of displacement determination ζ. In one example, for a plurality of displacement determination easiness degrees ζ calculated by repeating the processing from step S11 to step S14, the following function is used to select a candidate region with the highest evaluation of the displacement determination easiness degree ζ. Such widths w _i and heights h _i may be derived.
w _i , _hi = argmin ζ _i (w, h)

The derivation unit 23 performs the processing from step S11 to step S15 for all of the plurality of candidate regions 4 set by the setting unit 22, and derives measurement region candidates. Information about candidates for measurement regions may be stored as a table, for example. FIG. 7 is a diagram showing an example of data derived by the derivation unit 23. As shown in FIG. A plurality of candidate areas 4 are stored so as to be identifiable by respective area indexes i. In each region index i, information about the candidate region 4 (x, y), size (width w, height h), and displacement determination easiness ζ are linked to each other and stored. ing. The center position may be, for example, coordinates based on pixels in the frame, and may be indicated as the x-coordinate in the width direction and the y-coordinate in the height direction. Also, the size (width w, height h) may be determined based on the number of pixels of the candidate area.

The determination unit 25 is a functional unit that determines the measurement region to be presented to the user based on the displacement determination easiness ζ derived by the derivation unit 23 . As described above, in one example, the derivation unit 23 stores measurement region candidates as a table. The determination unit 25 extracts measurement region candidates from the table based on the evaluation of the displacement determination easiness degree ζ. For example, a predetermined number of candidates may be presented in descending order of evaluation of the degree of ease of displacement determination ζ, that is, in order of decreasing value of the degree of ease of displacement determination ζ. The user may check the determined measurement area candidates and decide whether or not to use them as actual measurement areas.

Next, an example of processing executed by the area determination device 20 will be described with reference to FIG. First, the imaging device 10 captures an image of the structure 2 whose state is to be determined to obtain a moving image. In one example, the entire structure 2 is imaged so that all locations for determining the state are captured. The captured moving image is transmitted from the imaging device 10 to the area determination device 20 . In the area determination device 20, the image information is acquired by the acquisition unit 21 based on the information of the moving image (S21). Subsequently, a plurality of candidate regions 4 are set in the image 3 of the structure 2 by the setting unit 22 (S22). Subsequently, for each candidate region 4 that has been set, the derivation unit 23 derives the optimum candidate region that is a candidate for the measurement region and the degree of ease of displacement determination ζ of the candidate region (S23). That is, while changing the size of each set candidate region 4, the displacement determination easiness degree ζ is calculated, and the candidate region 4 when the minimum displacement determination easiness degree ζ is obtained is used as a candidate for the measurement region. is derived together with the degree ζ. Subsequently, the determination unit 25 determines a predetermined number of candidate regions 4 as measurement regions in descending order of evaluation of the degree of ease of displacement determination ζ (S24). Then, the position (x, y), the size (w, h), and the degree of ease of displacement determination ζ for each of the plurality of determined measurement regions are output (S25). After the measurement area is determined in this way, based on the moving image captured by the imaging device 10, the displacement of the measurement area is detected in sub-pixel units by a conventional technique such as the phase-only correlation method, and the structure is determined. Vibration can be detected at multiple locations on the object 2 .

As described above, in this embodiment, the displacement determination ease degree ζ is derived for each of the plurality of candidate regions 4 set within the acquired image 3 . This displacement determination easiness degree ζ can be an index of whether or not it is easy to detect the displacement of the structure 2 in the candidate region 4 between frames with different time axes forming the moving image. By determining candidates for the measurement region used for measuring the displacement of the structure 2 based on the degree of ease of displacement determination ζ, it is possible to determine a measurement region suitable for detecting the displacement of the structure 2 . Therefore, the time required to determine the measurement area can be shortened. In addition, the amount of calculation can be reduced compared to the method of exhaustively searching for an area suitable for the measurement area in the image 3 .

In addition, the displacement determination easiness ζ is derived based on the autocorrelation function I(w, h) for the candidate region 4 . With this configuration, it is possible to easily generate an index that appropriately reflects the ease of detection of the positional deviation of the candidate region 4 within the frame.

Further, the degree of ease of displacement determination ζ is derived based on the error between the autocorrelation function I(w,h) and the autocorrelation model formula I _ideal . With this configuration, it is possible to easily determine, as the measurement area, a candidate area that has an autocorrelation function close to the autocorrelation model formula and in which displacement can be easily detected.

While changing the size of the candidate region 4, the deriving unit 23 derives the displacement determination ease degree ζ for each region whose size has changed. With this configuration, it is possible to easily determine the candidate area 4 having a size suitable for detecting the displacement of the structure 2 at the center position (x, y) where the candidate area 4 is set. In the above-described embodiment, an example is shown in which the width and height of the candidate area are expanded by a predetermined amount. The size may vary.

In addition, in the present embodiment, along with the determined position and size of the measurement region, the degree of ease of displacement determination ζ is output. In a configuration in which the displacement determination easiness .zeta. is output in this way, the displacement determination easiness .zeta. can be the reliability of the measurement region. That is, when the displacement amount of the structure 2 is detected based on a plurality of determined measurement areas, it is used as an indicator of how reliable the displacement amount calculated for each measurement area is. degree ζ can be utilized.

It should be noted that the block diagrams used in the description of the above embodiments show blocks in units of functions. These functional blocks (components) are realized by any combination of at least one of hardware and software. Also, the method of implementing each functional block is not particularly limited. That is, each functional block may be implemented using one device that is physically or logically coupled, or directly or indirectly using two or more devices that are physically or logically separated (e.g. , wired, wireless, etc.) and may be implemented using these multiple devices. A functional block may be implemented by combining software in the one device or the plurality of devices.

Functions include judging, determining, determining, calculating, calculating, processing, deriving, investigating, searching, checking, receiving, transmitting, outputting, accessing, resolving, selecting, choosing, establishing, comparing, assuming, expecting, assuming, Broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, assigning, etc. can't For example, a functional block (component) that makes transmission work is called a transmitting unit or a transmitter. In either case, as described above, the implementation method is not particularly limited.

For example, the region determining device 20 according to an embodiment of the present disclosure may function as a computer that performs information processing of the present disclosure. FIG. 9 is a diagram showing an example of a hardware configuration of the area determining device 20 according to an embodiment of the present disclosure. The area determination device 20 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

Note that in the following description, the term "apparatus" can be read as a circuit, device, unit, or the like. The hardware configuration of the area determination device 20 may be configured to include one or more of each device shown in the figure, or may be configured without some of the devices.

Each function of the area determining device 20 is performed by causing the processor 1001 to perform calculations, controlling communication by the communication device 1004, and controlling the It is realized by controlling at least one of data reading and writing in 1002 and storage 1003 .

The processor 1001, for example, operates an operating system to control the entire computer. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic device, registers, and the like. For example, the region determination device 20 described above may be implemented by the processor 1001 .

The processor 1001 also reads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 to the memory 1002, and executes various processes according to these. As the program, a program that causes a computer to execute at least part of the operations described in the above embodiments is used. For example, the region determining device 20 may be implemented by a control program stored in the memory 1002 and running on the processor 1001 . Although it has been explained that the above-described various processes are executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. FIG. Processor 1001 may be implemented by one or more chips. Note that the program may be transmitted from a network via an electric communication line.

The memory 1002 is a computer-readable recording medium, and is composed of at least one of, for example, ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), and RAM (Random Access Memory). may be The memory 1002 may also be called a register, cache, main memory (main storage device), or the like. The memory 1002 can store executable programs (program code), software modules, etc. for performing information processing according to an embodiment of the present disclosure.

The storage 1003 is a computer-readable recording medium, for example, an optical disc such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disc, a magneto-optical disc (for example, a compact disc, a digital versatile disc, a Blu-ray disk), smart card, flash memory (eg, card, stick, key drive), floppy disk, magnetic strip, and/or the like. Storage 1003 may also be called an auxiliary storage device. The storage medium included in the area determination device 20 may be, for example, a database including at least one of the memory 1002 and the storage 1003, a server, or other suitable medium.

The communication device 1004 is hardware (transmitting/receiving device) for communicating between computers via at least one of a wired network and a wireless network, and is also called a network device, a network controller, a network card, a communication module, or the like.

The input device 1005 is an input device (for example, keyboard, mouse, microphone, switch, button, sensor, etc.) that receives input from the outside. The output device 1006 is an output device (eg, display, speaker, LED lamp, etc.) that outputs to the outside. Note that the input device 1005 and the output device 1006 may be integrated (for example, a touch panel).

Devices such as the processor 1001 and the memory 1002 are connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between devices.

Further, the area determination device 20 includes hardware such as a microprocessor, a digital signal processor (DSP), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). , and part or all of each functional block may be implemented by the hardware. For example, processor 1001 may be implemented using at least one of these pieces of hardware.

The processing procedures, sequences, flowcharts, etc. of each aspect/embodiment described in this disclosure may be rearranged as long as there is no contradiction. For example, the methods described in this disclosure present elements of the various steps using a sample order, and are not limited to the specific order presented.

Input/output information and the like may be stored in a specific location (for example, memory), or may be managed using a management table. Input/output information and the like can be overwritten, updated, or appended. The output information and the like may be deleted. The entered information and the like may be transmitted to another device.

The determination may be made by a value represented by one bit (0 or 1), by a true/false value (Boolean: true or false), or by numerical comparison (for example, a predetermined value).

Each aspect/embodiment described in the present disclosure may be used alone, may be used in combination, or may be used by switching according to execution. In addition, the notification of predetermined information (for example, notification of “being X”) is not limited to being performed explicitly, but may be performed implicitly (for example, not notifying the predetermined information). good too.

Although the present disclosure has been described in detail above, it should be apparent to those skilled in the art that the present disclosure is not limited to the embodiments described in this disclosure. The present disclosure can be practiced with modifications and variations without departing from the spirit and scope of the present disclosure as defined by the claims. Accordingly, the description of the present disclosure is for illustrative purposes and is not meant to be limiting in any way.

Software, whether referred to as software, firmware, middleware, microcode, hardware description language or otherwise, includes instructions, instruction sets, code, code segments, program code, programs, subprograms, and software modules. , applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, and the like.

Software, instructions, information, etc. may also be sent and received over a transmission medium. For example, the software uses wired technology (coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), etc.) and/or wireless technology (infrared, microwave, etc.) to create websites, Wired and/or wireless technologies are included within the definition of transmission medium when sent from a server or other remote source.

As used in this disclosure, the terms "system" and "network" are used interchangeably.

In addition, the information, parameters, etc. described in the present disclosure may be expressed using absolute values, may be expressed using relative values from a predetermined value, or may be expressed using other corresponding information. may be represented.

Servers and/or clients may also be referred to as transmitters, receivers, communication devices, and/or the like. At least one of the server and the client may be a device mounted on a mobile object, the mobile object itself, or the like. The mobile object may be a vehicle (e.g., car, airplane, etc.), an unmanned mobile object (e.g., drone, self-driving car, etc.), or a robot (manned or unmanned ). At least one of the server and the client includes devices that do not necessarily move during communication operations. For example, at least one of the server and client may be an IoT (Internet of Things) device such as a sensor.

Also, the server in the present disclosure may be read as a client terminal. For example, a configuration in which communication between a server and a client terminal is replaced with communication between a plurality of user terminals (for example, D2D (Device-to-Device), V2X (Vehicle-to-Everything), etc.) Each aspect/embodiment of the present disclosure may be applied to. In this case, the client terminal may have the functions of the server described above.

Similarly, the client terminal in the present disclosure may be read as a server. In this case, the server may have the functions that the client terminal described above has.

As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Judgement", "determining" are, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (eg, lookup in a table, database, or other data structure), ascertaining as "judged" or "determined", and the like. Also, "judgment" and "determination" are used for receiving (e.g., receiving information), transmitting (e.g., transmitting information), input, output, access (accessing) (for example, accessing data in memory) may include deeming that a "judgment" or "decision" has been made. In addition, "judgment" and "decision" are considered to be "judgment" and "decision" by resolving, selecting, choosing, establishing, comparing, etc. can contain. In other words, "judgment" and "decision" may include considering that some action is "judgment" and "decision". Also, "judgment (decision)" may be read as "assuming", "expecting", "considering", or the like.

The terms "connected", "coupled", or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, It can include the presence of one or more intermediate elements between two elements being "connected" or "coupled." Couplings or connections between elements may be physical, logical, or a combination thereof. For example, "connection" may be read as "access". As used in this disclosure, two elements are defined using at least one of one or more wires, cables, and printed electrical connections and, as some non-limiting and non-exhaustive examples, in the radio frequency domain. , electromagnetic energy having wavelengths in the microwave and optical (both visible and invisible) regions, and the like.

As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly specified otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

Any reference to elements using the "first," "second," etc. designations used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, reference to a first and second element does not imply that only two elements can be employed or that the first element must precede the second element in any way.

Where "include," "including," and variations thereof are used in this disclosure, these terms are inclusive, as is the term "comprising." is intended. Furthermore, the term "or" as used in this disclosure is not intended to be an exclusive OR.

In this disclosure, where articles have been added by translation, such as a, an, and the in English, the disclosure may include the plural nouns following these articles.

In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean that "A and B are different from C". Terms such as "separate," "coupled," etc. may also be interpreted in the same manner as "different."

DESCRIPTION OF SYMBOLS 10... Imaging device 20... Area|region determination apparatus 21... Acquisition part 22... Setting part 23... Derivation part 25... Determination part 1001... Processor 1002... Memory 1003... Storage 1004... Communication apparatus 1005... Input device, 1006... Output device, 1007... Bus.

Claims (4)

an acquisition unit that acquires an image of a structure;
a setting unit that sets a plurality of candidate regions including at least part of the structure in the image acquired by the acquisition unit;
a deriving unit for deriving an index indicating ease of detection of relative displacement of a part of the structure included in each of the candidate regions for each of the plurality of candidate regions set by the setting unit;
a determination unit that determines, from among the plurality of candidate regions, candidates for a measurement region , which is a region in which displacement measurement of the structure is performed, based on the index derived by the derivation unit; Area determination device. 2. The region determination device according to claim 1, wherein said index is derived based on an autocorrelation function for each of said plurality of candidate regions in said image. 3. The area determination device according to claim 2, wherein said index is derived based on an error between said autocorrelation function and an autocorrelation model formula. 4. The deriving unit, while changing the size of each of the plurality of candidate regions, derives the index for each of the plurality of candidate regions whose sizes have changed. The area determination device according to .

Images