WO2022202926A1

WO2022202926A1 - Accuracy correction device and augmented reality image display device

Info

Publication number: WO2022202926A1
Application number: PCT/JP2022/013665
Authority: WO
Inventors: 徹哉土居; 友典川上
Original assignee: 株式会社デンソー
Priority date: 2021-03-26
Filing date: 2022-03-23
Publication date: 2022-09-29
Also published as: JP2022150965A

Abstract

This accuracy correction device 50 is provided in an augmented reality image display device 5 and comprises an input unit 54 and a correction value setting unit 56. The augmented reality image display device: recognizes a space of a filmed video; and generates an augmented reality image by disposing an object in the video by using, as a reference point, the coordinates spaced apart by a prescribed distance from specific coordinates in the space. The input unit 54 is configured to input distance information that indicates the actual distance between two specified points in the actual space, and the correction value setting unit sets a correction value for a prescribed distance on the basis of the distance information input from the input unit and a reference distance between the two points recognized in the augmented reality image display device.

Description

Accuracy correction device and augmented reality image display device

Cross-reference to related applications

This international application claims priority based on Japanese Patent Application No. 2021-053811 filed with the Japan Patent Office on March 26, 2021, and Japanese Patent Application No. 2021-053811 The entire contents are incorporated by reference into this international application.

The present disclosure relates to an accuracy correction device for an augmented reality image display device and an augmented reality image display device.

Augmented reality image display devices are known that virtually extend the world in front of you by displaying virtual objects overlaid on images captured by a camera.

In this device, as described in Patent Document 1, the display position of the object within the augmented reality image is set in advance based on the distance from a specific position in the physical space.

Then, when actually displaying an augmented reality image, a specific position recognized in the captured space is set as specific coordinates, and a position a predetermined distance away from the specific coordinates is set as a reference point for object display. Display objects as points.

JP 2019-121322 A

However, as a result of detailed studies by the inventor, in the device described in Patent Document 1, the display position of the object in the augmented reality image is defined in the real space due to variations in the characteristics of each device, that is, individual differences. However, a problem was found in that it deviated from the desired position.

One aspect of the present disclosure aims to suppress deterioration in display position accuracy of an object due to individual differences in an augmented reality image display device that displays a virtual object overlaid on an image captured by a camera. do.

An accuracy correction device according to the first aspect of the present disclosure is provided in an augmented reality image display device. This augmented reality image display device recognizes the space of the image captured by the image capturing unit, and places an object in the image using coordinates that are a predetermined distance away from specific coordinates in that space as a reference point. It is a device that generates an image and displays it on a display unit.

The accuracy correction device of the present disclosure includes an input section and a correction value setting section. Among these, the input unit inputs distance information representing the actual distance between specific two points in the real space, and the correction value setting unit recognizes the distance information input from the input unit and the augmented reality image display device. A correction value for the predetermined distance is set based on the reference distance between the two points.

Therefore, according to the accuracy correction device of the present disclosure, when the reference distance between two points recognized by the augmented reality image display device deviates from the normal distance obtained from the distance information, A correction value can be set.

Therefore, the augmented reality image display device uses the set correction value to correct the predetermined distance used for setting the reference point, thereby displaying the object at the proper position where it should originally be displayed in the augmented reality image. be able to.

Therefore, according to the accuracy correction device of the present disclosure, it is possible to improve the display position accuracy of the object in the augmented reality image display device.

Next, an augmented reality image display device according to a second aspect of the present disclosure includes an imaging unit, a space recognition unit, an image generation unit, and a display unit.

The shooting unit shoots images of the surroundings, and the space recognition unit recognizes the space of the images shot by the shooting unit. In addition, the image generation unit generates and displays an augmented reality image by arranging an object in the video with coordinates that are a predetermined distance from the specific coordinates as reference points in the space recognized by the space recognition unit. The unit displays the augmented reality image generated by the image generation unit.

Also, the augmented reality image display device of the present disclosure includes an input unit and a correction value setting unit, similar to the accuracy correction device described above. Then, the image generating section corrects the predetermined distance based on the correction value set by the correction value setting section, and sets a reference point as the display position of the object.

Therefore, according to the augmented reality image display device of the present disclosure, it is possible to display an object at an appropriate position where it should originally be displayed in an augmented reality image, and it is possible to improve the display position accuracy of the object.

It is an explanatory view showing composition of the whole vehicle-mounted sensor adjustment support system of a 1st embodiment. 1 is a block diagram showing the configuration of an augmented reality image display device; FIG. FIG. 4 is an explanatory diagram showing an example of specific coordinates and reference lines specified in the space around the vehicle; FIG. 10 is an explanatory diagram showing a method of setting a reference point, which is the display position of an object; 4 is a flowchart showing accuracy correction processing executed by an accuracy correction unit; 9 is a flowchart showing accuracy correction processing of the second embodiment; It is a flow chart showing accuracy correction processing of a 3rd embodiment.

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[First embodiment]
(1) Overall Configuration As shown in FIG. 1, an augmented reality image display device (hereafter referred to as an AR machine) 5 of this embodiment is an in-vehicle sensor adjustment support system that assists adjustment work of in-vehicle sensors necessary for collision damage mitigation braking. , it is used to provide the operator 3 with the installation position of the equipment for adjustment.

For this reason, the AR machine 5 of the present embodiment is worn on the head of the worker 3 who is the user, and displays an augmented reality image (hereafter referred to as an AR image) in front of the worker 3, so-called goggles. type display device. Note that "AR" is an abbreviation for "Augmented Reality".

The basic configuration of the in-vehicle sensor adjustment support system is the same as the in-vehicle sensor adjustment support system described in Patent Document 1. Accordingly, the vehicle-mounted sensor adjustment support system includes a server 201 , a personal computer (PC) 202 , a relay device 203 and an AR device 5 .

Of these, the server 201 and the PC 20 are connected to the communication network 200. Also, the relay device 203 relays wireless data communication, and is capable of wireless data communication with the communication network 200 . Also, the PC 202 and the AR device 5 have a wireless communication function, and can wirelessly communicate data with the relay device 203 . Therefore, the AR machine 5, the server 201 and the PC 202 can perform data communication with each other via the relay device 203 or the communication network 200. FIG.

The server 201 stores vehicle type information for each vehicle including vehicle 1. In addition, the server 201 stores object data indicating an installation position object for each type of adjustment equipment. The installation position object is an image indicating the installation position of the adjustment facility. In addition, the server 201 also stores various work-related information (for example, work procedures) related to adjustment work for each type of adjustment equipment.

The PC 202 can download and save vehicle type information, object data, and work-related information from the server 201 . It may be possible to upload vehicle type information, installation position objects, and work-related information from the PC 202 to the server 201 .

The AR machine 5 can download and acquire vehicle type information, installation position objects, and work-related information from the server 201 or PC 202 . The AR machine 5 displays in real time an image 7 captured by a camera 32 (see FIG. 2) as a capturing unit. When the AR device 5 is properly attached to the worker 3, the video 7 is a video of the space in front of the worker 3. FIG.

The worker 3 puts the vehicle 1 on the floor surface 2 of the predetermined work area and performs adjustment work for various in-vehicle sensors provided on the vehicle 1 . This adjustment work is performed by installing an adjustment facility corresponding to the vehicle-mounted sensor to be adjusted at a predetermined position outside the vehicle 1 and using the adjustment facility.

The in-vehicle sensor adjustment support system of this embodiment is used when performing this adjustment work. That is, the in-vehicle sensor adjustment support system provides the worker 3 with the installation position of the adjustment facility via the AR machine 5 so that the worker 3 can easily and efficiently install the adjustment facility.

That is, the AR machine 5 displays the image 7, and furthermore, according to the operation of the operator 3, an installation position object indicating the installation position is added to the position in the image 7 where the adjustment equipment should be installed. display. In other words, the AR machine 5 has a vision-based augmented reality function, and by means of the augmented reality function, the adjustment equipment can be installed at the installation position where the adjustment equipment should be installed in the actual image 7 captured by the camera 32. The AR image is displayed on the display unit 34 by superimposing the position object.

The vehicle 1 of the present embodiment is provided with a front camera 16, a millimeter wave radar sensor 17, a right rear radar (not shown), a left rear radar (not shown), etc., as in-vehicle sensors for collision damage reduction. ing.

The front camera 16 is provided in front of the passenger compartment of the vehicle 1 and photographs the front of the vehicle 1 . Images captured by the front camera 16 are used in various driving support systems such as a collision prevention support system and a lane departure prevention support system mounted on the vehicle 1, for example.

The millimeter wave radar sensor 17 is provided behind the front bumper of the vehicle 1, for example. The millimeter wave radar sensor 17 radiates radio waves in the millimeter wave band, and receives the reflected waves of the radiated radio waves that are reflected by a target in front of the vehicle 1, thereby detecting the position and distance of the target. The results of detection by the millimeter wave radar sensor 17 are used in various driving support systems such as a collision prevention support system and an obstacle warning system mounted on the vehicle 1, for example.

The right rear radar and left rear radar basically have the same configuration as the millimeter wave radar sensor 17 . The right rear radar detects the position and distance of a target existing on the right rear of the vehicle 1 , and the left rear radar detects the position and distance of a target existing on the left rear of the vehicle 1 . The right rear radar and the left rear radar are used for various driving support systems such as a blind spot monitor system mounted on the vehicle 1, for example.

In order for the front camera 16 to capture an appropriate range in front of the vehicle 1, it is necessary to properly adjust the optical axis of the front camera 16. Equipment for adjustment used when adjusting the optical axis is, for example, three target plates.

When adjusting the optical axis of the front camera 16, the worker 3 installs three target plates at predetermined positions in front of the vehicle 1, respectively. Then, the three target plates are photographed by the front camera 16, and the optical axis of the front camera 16 is appropriately adjusted based on the photographed images of the three target plates.

Also, in order to accurately detect the target by the millimeter wave radar sensor 17 and the left and right rear radars, it is necessary to appropriately adjust the angle axis (that is, the radiation angle of the radar wave) of each of these sensors. A reflector is used for adjustment of the angle axis.

The worker 3 installs a reflector at a predetermined position in front of the vehicle 1 when adjusting the angle axis of the millimeter wave radar sensor 17 . Then, the millimeter wave radar sensor 17 emits a radar wave, receives a reflected wave of the radar wave reflected by a reflector, and appropriately adjusts the angle axis based on the received reflected wave. Also, when adjusting the angle axes of the left and right rear radars, the angle axes are adjusted in the same manner by installing a reflector at a predetermined position for each rear radar.

By the way, in order to properly adjust the optical axis of the front camera 16, each of the three target plates must be properly installed at a predetermined position. Also, in order to properly adjust the angular axes of the millimeter wave radar sensor 17 and the left and right rear radars, it is necessary to properly install reflectors at predetermined positions for each of these sensors.

The AR machine 5 is configured to provide the worker 3 with the installation positions of the three target plates and reflectors when performing these adjustment operations. That is, for example, when adjusting the angular axis of the millimeter wave radar sensor 17, the AR device 5 places the reflector at the position where the reflector should be installed in the image 7 captured by the camera 32, as shown in FIG. is displayed.

(2) Configuration of AR Machine As shown in FIG. 2 , the AR machine 5 includes a space recognition sensor 31 , a camera 32 , a position recognition sensor 33 , and a display section 34 . Each of these units is configured in the same manner as the AR machine described in Patent Document 1.

That is, the space recognition sensor 31 is a sensor that acquires information indicating various objects existing in front of the AR machine 5, and the space in front of the AR machine 5 is detected three-dimensionally by the space recognition sensor 31. , and spatial information is detected as a result of the detection.

The camera 32 captures an image in front of the AR device 5 at a specific frame rate and outputs it as captured data. Further, the self-position recognition sensor 33 detects the position of the AR machine 5 itself in the three-dimensional space, more specifically, for example, the orientation (angle), and outputs self-position information as the detection result.

The display unit 34 is configured to be able to display an image, and displays the video indicated by the photographed data output from the camera 32, that is, the video 7. Also, the display unit 34 displays various objects such as the installation position object 112 shown in FIG. The display unit 34 is mounted on the AR machine 5 so that the operator 3 who wears the AR machine 5 appropriately on his head can visually recognize the image 7 including various objects.

The AR device 5 further includes a space recognition unit 35, an image recognition unit 36, a self-position recognition unit 37, a wireless communication unit 38, an AR image generation unit 39, and an accuracy correction unit 50.

The space recognition unit 35 periodically acquires space information detected by the space recognition sensor 31 and analyzes the space information in real time. Then, based on the analysis result, the space in front of the AR device 5 is three-dimensionally recognized in real time.

The image recognition unit 36 recognizes a specific image in the captured image 7 based on the captured data output from the camera 32 . In this embodiment, feature points are extracted from the image 7, and various images can be recognized based on the extracted feature points. Images that can be recognized by the image recognition unit 36 include, for example, emblems, license plates, and specific markers provided at the front and rear ends of various vehicles.

As shown in FIG. 3, the vehicle 1 of this embodiment is provided with a front emblem 11 and a front number plate 13 at the front end, and a rear emblem 12 and a rear number plate 14 at the rear end.

Therefore, in addition to being able to recognize the vehicle 1 itself, the image recognition unit 36 can individually recognize the

emblems

11 and 12 and the

license plates

13 and 14 of the vehicle 1 . Information on various images that can be recognized by the image recognition unit 36 may be stored in the memory of the AR machine 5 in advance, or may be downloaded from the server 201 or the PC 202 .

In addition, the image recognition unit 36 can continue to recognize the position of the once recognized image by the tracking function, even if the position or angle of the camera 32 changes and the captured image changes.

Also, the self-position recognition unit 37 recognizes the direction (angle) of the AR device 5 based on the self-position information output from the self-position recognition sensor 33 .

Then, the space recognition unit 35, the image recognition unit 36, and the self-position recognition unit 37 output the space recognition information, the image recognition information, and the self-position recognition information, which are the recognition results, to the AR image generation unit 39. do.

The wireless communication unit 38 is for performing wireless communication with the server 201 or the PC 202 via the relay device 203, and is connected to the AR image generation unit 39.

The AR image generation unit 39 causes the display unit 34 to display the image 7 based on the shooting data input from the image recognition unit 36 . The AR image generation unit 39 also acquires vehicle type information, object data, work-related information, etc. of the vehicle to be adjusted from the server 201 or the PC 202 via the wireless communication unit 38 .

Then, the AR image generation unit 39, based on the information obtained via the wireless communication unit 38 and the information input from the space recognition unit 35, the image recognition unit 36, and the own position recognition unit 37, adjusts the equipment for adjustment. , and displays the installation position object in the image 7 . The AR image generation unit 39 can also cause the display unit 34 to display work-related information in accordance with a user's operation.

The AR machine 5 is equipped with a computer including a CPU and memory. The memory is a semiconductor storage device such as ROM, RAM, and flash memory. The memory stores a program for causing the computer to function as a space recognition section 35, an image recognition section 36, a self-position recognition section 37, and an AR image generation section 39. FIG.

Therefore, the functions of the space recognition unit 35, the image recognition unit 36, the own position recognition unit 37, and the AR image generation unit 39 described above are realized by the CPU executing the programs stored in the memory. However, at least some or all of these functions may be implemented using one or more pieces of hardware instead of processing by software.

(3) Installation position calculation operation of the AR image generation unit As described above, the AR image generation unit 39 calculates the installation position of the adjustment facility in order to display the installation position object in the image 7 displayed on the display unit 34. Calculate

The procedure for calculating the installation position will be described by taking the case of calculating the installation position of the reflector in order to adjust the radiation angle (angular axis) of the radar wave of the millimeter wave radar sensor 17 as an example. Note that the procedure described below is described in detail in Patent Document 1, so a detailed description thereof will be omitted here.

The AR image generator 39 three-dimensionally recognizes the space in front of the camera 32 based on the spatial information detected by the space recognition sensor 31 and the self-position information output from the self-position recognition sensor 33. , recognize the floor 2 in the space. When the floor surface 2 is recognized, the relative positional relationship between the recognized floor surface 2 and the position of the AR machine 5 in the three-dimensional coordinate space is calculated.

Next, the AR image generation unit 39 acquires the positions of the front emblem 11 and the rear emblem 12 recognized by the image recognition unit 36 as three-dimensional coordinates as the worker 3 moves around the vehicle 1 .

Then, the AR image generator 39 generates

perpendiculars

21, 22 from the positions of the

emblems

11, 12 to the floor 2, finds

intersections

23, 24 between the

perpendiculars

21, 22 and the floor 2, and A line passing through the

intersections

23 and 24 is calculated as the centerline 25 of the vehicle 1 . FIG. 3 shows an example of the image 7 in which the

perpendicular lines

21, 22 and the center line 25 are superimposed.

The center line 25 and

intersections

23 and 24 calculated in this way are used to set the installation position of the adjustment equipment. Specifically, for example, when calculating the installation position of the reflector, which is equipment for adjusting the millimeter wave radar sensor 17, the three-dimensional coordinates of the intersection 23 in front of the vehicle are used as specific coordinates that serve as a reference for the installation position. be done.

Then, the AR image generation unit 39 selects from the vehicle type information of the vehicle 1 acquired from the server 201 or the PC 202, the distance between the specific coordinates as data for installation of the reflector, which is equipment for adjusting the millimeter wave radar sensor 17. Read distance data representing

This distance data and specific coordinates are set in advance for each vehicle type and on-vehicle sensor to be adjusted, and the AR image generation unit 39 determines the installation position of the adjustment equipment based on this information.

Specifically, when setting the installation position of the reflector with respect to the millimeter wave radar sensor 17, as shown in FIG. Set the coordinates as a reference point P1. Then, the AR image generator 39 displays the image of the reflector obtained from the object data as the installation position object 112 at the set reference point P1, as indicated by the two-dot chain line in FIG.

Note that the reference point P1 for displaying the installation position object 112 is set as a three-dimensional coordinate that is a predetermined distance along the center line 25 from the specific coordinates that are the three-dimensional coordinates of the intersection point 23. Therefore, the reference point P1 and the vehicle The relative positional relationship with 1 is constant. Therefore, when the worker 3 turns or moves, the display position, angle, size, etc. of the installation position object 112 in the image 7 change along with the movement of the direction and position.

(4) Configuration of Accuracy Correction Unit As described above, the installation position of the adjustment equipment used for the adjustment work of the in-vehicle sensor mounted on the vehicle 1 is set based on the feature points in the image captured by the camera 32. It is set based on a reference point P1 which is a predetermined distance away from the specified coordinates.

However, in the real space around the vehicle 1, the reference point P1 may deviate from the normal position P0, which is a predetermined distance away from the specific coordinates. Since this deviation is due to individual differences in the AR device 5, it cannot be improved even by correcting the distance data stored in the server 201 or the PC 202. FIG.

Therefore, in the present embodiment, the AR machine 5 is provided with the accuracy correction unit 50 shown in FIG.

The accuracy correction unit 50 corresponds to an example of the accuracy correction device of the present disclosure, and includes a display control unit 52, an input unit 54, and a correction value setting unit 56 in this embodiment.

The display control unit 52 causes the video 7 displayed on the display unit 34 by the AR image generation unit 39 to display a verification object representing the reference distance. The display position of the verification object is set at a position where the passenger can easily measure the length of the verification object using a tape measure or the like within the space recognized by the AR image generator 39 .

For example, the display position of the verification object may be set at a position a predetermined distance away from the worker 3 so that the length can be measured by the worker 3 just by reaching out. Alternatively, the surface of the target recognized by the AR image generation unit 39, such as the body of the vehicle 1 or the floor surface 2 in the image 7, may be set as the display position.

Also, the verification object displayed at the display position may be any object that allows the worker 3 to measure the reference distance while viewing the image 7. For example, a linear object whose length is the reference distance. It may be displayed as a verification object.

Next, the input unit 54 allows the worker 3 to input information such as the length of the verification object displayed on the display unit 34 by voice input, key operation, or movement of the worker 3 himself. It is intended to

The input by the movement of the worker 3 himself/herself is realized, for example, by the worker 3 moving a finger or the like in front of the camera 32 and the image recognition unit 36 recognizing the movement as input information. In this case, the input unit 54 inputs the recognition result by the image recognition unit 36 .

Therefore, when the verification object of the reference distance is displayed on the display unit 34, the worker 3 measures the length of the verification object in the real space while viewing the image 7, and the measurement result is displayed in the actual space. The distance can be input to the accuracy correction unit 50 .

The correction value setting unit 56 recognizes the measured distance input via the input unit 54 as the actual distance that is actually measured as the reference distance, and based on the recognized actual distance and the reference distance, the AR device 5 recognizes A correction value (distance correction value) for the distance that is

This distance correction value is for correcting the distance data used to set the installation positions of various adjustment equipment such as the reflector and the three target plates described above. Therefore, the distance correction value can be used as a common correction value for various distance data acquired from the server 201 or the PC 202. By multiplying the distance data, the various distance data can be appropriately corrected. , is calculated as a correction factor.

Therefore, for example, as shown in FIG. 4, when the AR image generator 39 displays the installation position object 112 of the reflector shown in FIG. 4, the distance data is corrected from the predetermined distance L1 to the predetermined distance L0. become.

By this correction, the reference point that defines the display position of the installation position object 112 is set to the reference point P0 that is separated from the reference point P1 before the correction by the correction distance dL. can be displayed at the regular installation position of the reflector.

Note that the distance correction value does not necessarily have to be a correction coefficient, and a correction distance for distance data may be set for each verification object.

(5) Accuracy correction processing In the accuracy correction unit 50, the functions of the display control unit 52 and the correction value setting unit 56 are performed by the computer provided in the AR machine 5 or the computer provided in the accuracy correction unit 50. It is realized by executing a program for correction.

Therefore, in order to realize the functions of the display control unit 52 and the correction value setting unit 56, accuracy correction processing executed by a computer will be described. In this accuracy correction process, the operator 3 inputs a calibration command for the AR device 5 via the input unit 54 while the AR device 5 is displaying the image 7 on the display unit 34, and the calibration command is , the CPU executes the accuracy correction program stored in the memory.

As shown in FIG. 5, when the accuracy correction process is started, the CPU first causes the AR image generation unit 39 to display a reference distance verification object in the image 7 currently being displayed in S110. , the processing as the display control unit 52 is executed.

In S110, when the verification object is displayed, the worker 3 measures the length of the verification object in the real space using a tape measure or the like while viewing the image 7 displayed on the display unit 34. , the measurement result is input through the input unit 54 .

Therefore, after executing the process of S110, the CPU waits for the input of the measurement result of the reference distance from the input unit 54 in S120, and when the measurement result is input, the process proceeds to S130.

In S130, the measurement result input from the input unit 54 is recognized as the actual distance of the reference distance, and in subsequent S140, the correction value setting unit 56 calculates the distance correction value based on the actual distance and the reference distance. Execute the process as

Note that this distance correction value is a correction coefficient for correcting the distance recognized by the AR device 5, and is calculated by dividing the actual distance by the reference distance according to the following equation, for example.

Correction coefficient=actual distance/reference distance After the distance correction value is calculated in S140, the CPU proceeds to S150. Then, in S150, the AR image generation unit 39 corrects the distance data for installation of adjustment equipment, which is acquired from the server 201 or PC 202 for each vehicle type and for each in-vehicle sensor and stored in the memory, and the accuracy correction process ends.

In addition, in S150, by outputting the correction coefficient as the distance correction value to the AR image generation unit 39, the AR image generation unit 39 may correct various distance data stored in the memory.

In S150, various distance data are read from the AR image generation unit 39, the read distance data is multiplied by a correction coefficient to correct the distance data, and the corrected distance data is returned to the AR image generation unit 39. You may do so.

(6) Effect As described above, the AR machine 5 of the present embodiment is provided with the accuracy correction unit 50 as the accuracy correction device of the present disclosure. The accuracy correction unit 50 displays the verification object at the reference distance in the image 7 displayed on the display unit 34, thereby allowing the worker 3 to measure the length of the verification object in the real space, and the length of the verification object. A distance correction value is calculated from the actual distance and the reference distance which are the measurement results.

As a result, according to the accuracy correction unit 50 of the present embodiment, the distance data used when the AR image generation unit 39 displays the installation position object of the adjustment equipment in the image 7 is corrected using the distance correction value. be able to.

Therefore, according to the present embodiment, the installation position of the adjustment facility can be accurately presented to the worker 3 using the installation position object 112 when performing the adjustment work of various on-vehicle sensors mounted on the vehicle. will be able to Therefore, according to the present embodiment, it is possible to suppress the influence of display errors that occur for each AR device 5 and improve the display accuracy of the installation position object.

[Second embodiment]
Since the basic configuration of the second embodiment is the same as that of the first embodiment, differences will be described below. In the following description, the same reference numerals as in the first embodiment indicate the same configuration, and refer to the preceding description.

In the first embodiment, in the accuracy correction process, a reference distance verification object is displayed in the image 7 currently being displayed, and the operator 3 measures the length of the object. The description has been given assuming that the distance correction value is calculated based on the distance.

On the other hand, in the second embodiment, the worker 3 is made to specify two points that are the reference distance in the real space, and the AR image generation unit 39 is made to recognize the distance between the two points. A distance correction value is calculated from the reference distance thus obtained and the actual distance, which is the reference distance in the physical space.

Therefore, in the present embodiment, the accuracy correction processing executed by the accuracy correction unit 50 in this manner will be described along the flowchart shown in FIG.

As shown in FIG. 6, in the accuracy correction process of this embodiment, first, in S210, input guidance is displayed in the image 7 so that the worker 3 designates two points separated by a certain distance, and the process proceeds to S220. .

According to the display of the input guide in S210, the operator 3 uses a tape measure or the like to measure a certain reference distance in the real space, and specifies two points at both ends of the distance via the input unit 54 by air tapping or the like. In this case, the input unit 54 inputs the position as the point designated by the worker 3 when the image recognition unit 36 recognizes the air tapping action by the worker 3 .

The two points can be specified by allowing the image recognition unit 36 to recognize the positions of the two points, that is, the three-dimensional coordinates. , two points may be input. Alternatively, the worker 3 may, for example, photograph a long object of a certain length and cause the image recognition unit 36 to recognize two points at both ends of the long object.

Next, in S220, it is determined whether or not two points separated by a certain distance from the worker 3 have been designated, thereby waiting for two points to be designated. The determination in S220 is made, for example, by determining whether or not two points have been recognized in the image recognition section 36 .

Further, for example, when two points are recognized by the image recognition unit 36, the two points recognized by the AR image generation unit 39 are displayed in the image 7 so as to be identifiable. It may be determined that two points have been input when 39 displays two points.

When it is determined in S220 that two points have been designated, the process proceeds to S230, and the distance between the two points recognized by the image recognition unit 36 is acquired from the AR image generation unit 39. This distance is the distance between two points recognized by the AR machine 5, and in S220, this distance is acquired as the reference distance.

Then, in the following S240, a distance correction value is calculated based on the reference distance acquired in S230 and the actual distance between two points designated by the worker 3 in the physical space. Note that the process of S240 functions as the correction value setting unit 56, like S140 of the first embodiment.

When the distance correction value is calculated in S240, the process proceeds to S250. In S250, in the same procedure as in S150 of the first embodiment, the AR image generation unit 39 corrects the distance data for installation of adjustment equipment acquired from the server 201 or the PC 202, and ends the accuracy correction process.

As described above, in the second embodiment, the worker 3 is made to input two points that are the reference distance in the real space, and the AR image generation unit 39 is made to recognize the distance between the two points. Since the recognized reference distance includes an error specific to the AR machine 5, a distance correction value for canceling the error is calculated based on the reference distance and the actual distance in the real space.

Therefore, the accuracy correction unit 50 of the second embodiment can also obtain the same effects as those of the first embodiment.

[Third embodiment]
Like the second embodiment, the third embodiment has the same basic configuration as the first embodiment, so the differences will be described below. In the following description, the same reference numerals as in the first embodiment indicate the same configuration, and refer to the preceding description.

On the other hand, in the third embodiment, numerical information indicating the length of the reference distance is displayed in addition to the verification object of the reference distance in the currently displayed image 7, and the operator 3 is provided with the verification object The difference between the actual distance and the reference distance, which is the measurement result of the length, is input as error information. A distance correction value is calculated based on the input error information.

As shown in FIG. 7, in the accuracy correction process of the present embodiment, first, in S310, the AR image generation unit 39 generates an object for verification of the reference distance and a length of the reference distance in the image 7 currently being displayed. display numerical information that indicates the Note that this process corresponds to an example of the display control unit of the present disclosure.

In S310, when the verification object and the numerical information of the reference distance are displayed, the worker 3 measures the length of the verification object in the real space using a tape measure or the like while viewing the image 7. Then, the worker 3 inputs the difference between the actual distance, which is the result of the measurement, and the reference distance obtained from the numerical information displayed on the image 7 via the input unit 54 as error information of the reference distance.

Therefore, in the following S320, it is determined whether or not the error information of the reference distance has been input from the input unit 54, thereby waiting for the error information to be input. do.

In S330, the distance correction value is calculated based on the reference distance error information input from the input unit 54, and the process proceeds to S340. Note that the processing of S330 corresponds to an example of the correction value setting unit of the present disclosure.

In S340, the AR image generation unit 39 corrects the distance data for installation of adjustment equipment acquired from the server 201 or PC 202 in the same procedure as in S150 and S250 described above, and the accuracy correction process ends.

As described above, in the third embodiment, the verification object at the reference distance and the numerical information representing the length thereof are displayed in the image 7 currently being displayed, and the operator 3 is instructed to determine the length of the verification object. is measured, and the difference between the actual distance and the reference distance, which is the result of the measurement, is input. This difference is the difference between the reference distance recognized by the AR unit 5 and the actual distance in the real space, and is a distance recognition error unique to the AR unit 5. Calculate the correction value.

Therefore, the accuracy correction unit 50 of the third embodiment can also obtain the same effects as those of the first embodiment.

[Other Modifications]
Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the above-described embodiments, and various modifications can be made.

a) In the above embodiment, the input unit 54 has been described as inputting information input by the worker 3 through voice input, key operation, movement of the worker 3 himself, or the like. On the other hand, the input section 54 may be further configured to input information transmitted from the external device 58 shown in FIG. Note that the external device 58 may be a mobile terminal such as a smart phone or a tablet terminal, or a fixed terminal such as a PC.

b) In the above embodiment, the AR machine 5 was described as being of a goggle type, but for example, a mobile terminal such as a tablet terminal equipped with a camera and a display unit may be provided with the functions of the AR machine.

c) In the above embodiment, the accuracy correction unit 50 has been described as being incorporated in the AR machine 5 as one function of the AR machine 5 . However, the accuracy correction unit 50 may be configured as an accuracy correction device separate from the AR device 5 and connected to the AR device 5 so as to correct display errors unique to the AR device 5 .

d) In the above embodiment, the AR machine 5 was described as being used to present the installation location of the adjustment facility used for the adjustment work of the in-vehicle sensor installed in the vehicle. However, if the accuracy correction device of the present disclosure is an AR machine configured to place an object at a reference point a predetermined distance away from specific coordinates in the space captured by the camera, it is the same as the above embodiment. can be applied to

e) In the above embodiment, the functions of the display control unit 52 and the correction value setting unit 56 in the accuracy correction unit 50 are realized by executing a program by the CPU of the computer that constitutes the AR machine 5 or the accuracy correction unit 50. described as a thing. However, these functions of the accuracy correction unit 50 may be realized by a combination of a computer program and a dedicated hardware logic circuit, or by only one or more dedicated hardware logic circuits.

f) A plurality of functions possessed by one component in the above embodiment may be realized by a plurality of components, or a function possessed by one component may be realized by a plurality of components. Also, a plurality of functions possessed by a plurality of components may be realized by a single component, or a function realized by a plurality of components may be realized by a single component. Also, part of the configuration of the above embodiment may be omitted. Moreover, at least part of the configuration of the above embodiment may be added or replaced with respect to the configuration of the other above embodiment.

g) In addition to the accuracy correction device or the augmented reality image display device, the present disclosure includes a system having the accuracy correction device or the augmented reality image display device as a component, and a computer functioning as the accuracy correction device or the augmented reality image display device. It can also be realized in various forms such as a program, a non-transitional actual recording medium such as a semiconductor memory storing this program, an accuracy correction method, or an augmented reality image display method.

Claims

An accuracy correction device,
The accuracy correction device is provided in an augmented reality image display device (5),
The augmented reality image display device recognizes the space of the image captured by the image capturing unit (32), and arranges the object in the image using the coordinates that are a predetermined distance away from the specific coordinates in the space as a reference point. is a device that generates an augmented reality image and displays it on a display unit (34),
The accuracy correction device is
an input unit (54) configured to input distance information representing the actual distance between two specific points in real space;
A correction value setting unit configured to set a correction value for the predetermined distance based on the distance information input from the input unit and the reference distance between the two points recognized by the augmented reality image display device. (56) and
A precision correction device.
The accuracy correction device according to claim 1,
a display control unit (52) configured to display a verification object capable of measuring the reference distance in real space on the augmented reality image displayed on the display unit;
The correction value setting unit acquires the distance information input from the input unit as an actual distance measured by the user using the verification object displayed on the display unit, and An accuracy correction device configured to set the correction value based on the actual distance and the reference distance.
The accuracy correction device according to claim 1,
The input unit is configured to be able to specify two points separated by a certain distance in real space as the distance information,
The correction value setting unit causes the augmented reality image display device to recognize the distance between the two points specified via the input unit, acquires it as the reference distance, an accuracy correction device configured to set the correction value based on the actual distance between the two points at .
The accuracy correction device according to claim 1,
A display control unit (52) configured to display a verification object capable of measuring the reference distance in real space and numerical information representing the reference distance on the augmented reality image displayed on the display unit ),
The correction value setting unit
An error representing a difference between an actual distance measured by a user using the verification object for the distance information input from the input unit and the reference distance specified by the numerical information information, obtained as
An accuracy correction device configured to set the correction value based on the error information.
The accuracy correction device according to any one of claims 1 to 4,
The accuracy correction device, wherein the input unit is configured to input the distance information according to information acquired from an external device (58).
a capturing unit (32) configured to capture an image of the surroundings;
a space recognition unit (35) configured to recognize the space of the image captured by the capturing unit;
An image generator configured to generate an augmented reality image by arranging an object in the video using coordinates that are a predetermined distance away from specific coordinates in the space recognized by the space recognition unit as reference points. a part (39);
a display unit (34) configured to display the augmented reality image generated by the image generator;
an input unit (54) configured to input distance information representing the actual distance between two specific points in real space;
A correction configured to set a correction value for the predetermined distance based on the distance information input from the input unit and the reference distance between the two points recognized by the image generation unit in the space. a value setting unit (56);
and wherein the image generation unit is configured to correct the predetermined distance based on the correction value and set the reference point.
The augmented reality image display device according to claim 6,
An augmented reality image display device, wherein the augmented reality image display device is goggles wearable by a user.