KR20150144619A - Work in Process Inspection System using Motion Detection And Method Thereof - Google Patents

Work in Process Inspection System using Motion Detection And Method Thereof Download PDF

Info

Publication number
KR20150144619A
KR20150144619A KR1020140073686A KR20140073686A KR20150144619A KR 20150144619 A KR20150144619 A KR 20150144619A KR 1020140073686 A KR1020140073686 A KR 1020140073686A KR 20140073686 A KR20140073686 A KR 20140073686A KR 20150144619 A KR20150144619 A KR 20150144619A
Authority
KR
South Korea
Prior art keywords
image
time
area
unit
work
Prior art date
Application number
KR1020140073686A
Other languages
Korean (ko)
Inventor
함세훈
김용태
곽동호
김수영
Original Assignee
현대자동차주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 현대자동차주식회사 filed Critical 현대자동차주식회사
Priority to KR1020140073686A priority Critical patent/KR20150144619A/en
Priority to US14/559,547 priority patent/US20150185731A1/en
Publication of KR20150144619A publication Critical patent/KR20150144619A/en

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62D—MOTOR VEHICLES; TRAILERS
    • B62D65/00—Designing, manufacturing, e.g. assembling, facilitating disassembly, or structurally modifying motor vehicles or trailers, not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62D—MOTOR VEHICLES; TRAILERS
    • B62D65/00—Designing, manufacturing, e.g. assembling, facilitating disassembly, or structurally modifying motor vehicles or trailers, not otherwise provided for
    • B62D65/02—Joining sub-units or components to, or positioning sub-units or components with respect to, body shell or other sub-units or components
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion

Landscapes

  • Engineering & Computer Science (AREA)
  • Manufacturing & Machinery (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

A work process inspection system according to an embodiment of the present invention includes: a moving picture photographing part for photographing a work action of a worker; and a control part for determining whether the worker has performed a standard work process from a detention time in a virtual area where motion of the worker photographed through the moving picture photographing part is set. According to an embodiment of the present invention, the process inspection system can determine whether the worker has performed a determined work process by checking whether the motion of the worker photographed through a three dimensional scanner remains in the established virtual work area for a predetermined time.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a motion inspection system,

The present invention relates to a process inspection system using motion recognition, and more particularly, to a process inspection system using motion recognition, in which a worker performs a standard work process through whether or not an operation of an operator in a vehicle assembling process has stayed within a set virtual work area for a set time The present invention relates to a process inspection system using motion recognition,

It is very important to determine whether the assembled parts are assembled by the correct process when the operator manually assembles the parts in the assembling process of the vehicle.

For example, a process in which various components assembled in a transmission of a vehicle are assembled according to the assembling sequence will be described.

The transmission must be assembled in order with the hub, thrust washer, hub assembly, thrust bearing, and hub clutch. Each component must be assembled according to the correct assembly direction.

If the assembling order of the parts is different from the assembling direction, a malfunction may occur in the operation of the transmission.

In order to solve this problem, it has been confirmed that the assembly was correctly performed through a separate confirmation process. However, according to the prior art, a separate confirmation process is required, which causes a problem that the entire assembly time is increased.

As described above, when an operator assembles various parts provided in the vehicle, various problems arise due to poor assembling of the parts unless the predetermined assembling order or assembling direction is confirmed.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a process inspection system using motion recognition capable of confirming a predetermined work process order or a work state by an operator.

A process inspection system using motion recognition according to an embodiment of the present invention includes a moving image photographing unit for photographing a work operation of an operator; And a controller for determining whether a worker has performed a standard work process based on a residence time within a hypothetical area where the motion of the worker photographed through the motion picture photographing unit is set.

Wherein the control unit comprises: an operation extracting unit that extracts a motion of a joint of an operator from an image photographed through the moving image photographing unit; And an area determination unit for determining a time during which the movement of the joint extracted by the operation extraction unit stays in the set virtual work area.

The residence time may be from the time when the movement of the joint extracted by the operation extracting unit enters the virtual work area to the time when the movement of the joint extracted from the virtual work area.

The area determining unit may determine that the worker has performed the standard work process if the residence time is within a predetermined error range from the set time.

The control unit may determine a result of the operation using the difference between the image captured through the image capturing unit and the standard image.

The controller may further include an image determiner for comparing the photographed image with the set standard image to determine whether the photographed image is different from the standard image.

The image determining unit may determine that the operation result is not satisfied when a difference between the image captured by the image capturing unit and the standard image occurs.

And an alarm unit for generating an alarm when the residence time is shorter than the set time or when the difference between the photographed image and the set standard image is larger than the set range.

According to another aspect of the present invention, there is provided a method of inspecting a work process, comprising: photographing a work operation of an operator; Extracting a motion of the joint of the operator from the photographed moving image; Measuring a residence time of staying within a hypothetical working area where movement of the extracted joint is set; And comparing the residence time with the set time to determine whether a standard work process has been performed.

The residence time may be from the time when the movement of the joint is within the virtual work area to the time when the movement of the joint is out of the virtual work area.

If the residence time is within a predetermined error range from the set time, it can be judged that the standard work process has been performed.

Photographing a completed part of the work; And comparing the photographed image with a standard image.

If a difference between the photographed image and the standard image occurs, it can be determined that the operation result is not satisfied.

And generating an alarm when the residence time is out of a predetermined error range of the set time or when a difference between the photographed image and the standard image occurs.

According to the embodiment of the present invention as described above, whether or not the movement of the operator photographed through the three-dimensional scanner remains within the set virtual work area for a predetermined period of time, It is possible to judge whether or not it has been performed.

Further, the image photographed by the camera can be compared with the standard image, and it can be determined whether the work state performed by the operator satisfies the predetermined work state.

These drawings are for the purpose of describing an exemplary embodiment of the present invention, and therefore the technical idea of the present invention should not be construed as being limited to the accompanying drawings.
1 is a conceptual diagram showing a configuration of a work process system according to an embodiment of the present invention.
2 is a block diagram illustrating a configuration of a work process system according to an embodiment of the present invention.
3 is a conceptual diagram for explaining an operator's movements using a work process system according to an embodiment of the present invention.
4 is a flowchart illustrating an operation method of a work process system according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention.

The present invention may be embodied in many different forms and is not limited to the embodiments described herein.

In order to clearly illustrate the present invention, parts not related to the description are omitted, and the same or similar components are given the same reference numerals throughout the specification.

In addition, since the components shown in the drawings are arbitrarily shown for convenience of explanation, the present invention is not necessarily limited to those shown in the drawings.

1 is a conceptual diagram showing a configuration of a work process system according to an embodiment of the present invention. 2 is a block diagram illustrating a configuration of a work process system according to an embodiment of the present invention.

1 and 2, a work process system according to an embodiment of the present invention includes a moving picture photographing unit for photographing a work operation of a worker, a moving picture photographing unit for photographing a work And a controller 40 for determining whether the worker has performed a standard work process from the residence time at the work station.

The work process inspection system may further include an image photographing unit for photographing the completed part. The control unit 40 may determine a result of the operation using the difference between the image captured through the image capturing unit and the standard image.

The moving image capturing unit may be a three-dimensional camera 20 or a three-dimensional scanner 10, and the image capturing unit may be a camera 20 for capturing an image.

The moving picture photographing unit photographs the movement of the worker, converts the movement of the worker into three-dimensional data, and the converted three-dimensional data is transmitted to the control unit (40). The basic operation of the three-dimensional scanner 10 is well known in the art, and a detailed description thereof will be omitted.

The camera 20 photographs a part where the operator has performed the operation, and the image photographed through the camera 20 is transmitted to the controller 40.

The control unit 40 includes an operation extraction unit 41 for extracting a movement of an operator and a control unit 40 for determining whether or not the movement of the operator extracted by the operation extraction unit 41 and the standard operation are performed by the operation extraction unit 41 And an area judging section 43 for judging the area. The control unit 40 may further include an image determining unit 45 for determining whether a worker's work satisfies a standard work state.

The control unit 40 may be provided with one or more processors that operate according to a set program, and the set program is configured to perform each step of the work process inspection method according to an embodiment of the present invention.

The operation extracting unit 41 extracts the joint position of the operator using the three-dimensional data transmitted from the three-dimensional scanner 10, and extracts the joint movement of the operator using the extracted joint position.

The area determining unit 43 determines whether or not the movement of the operator extracted by the operation extracting unit 41 remains within the set virtual work area for the set time and determines whether or not the worker has performed the standard work do. Here, the standard motion means a predetermined work order or a predetermined work process for performing a specific work process. And, the staying time during the set time in the virtual work area where the worker's movement is set is defined as the stay time.

3, the operation extracting unit 41 extracts the joint position and joint motion of the operator using the three-dimensional data (see FIG. 3 (a)), and the region determining unit 43 (Refer to FIG. 3 (b)) in which the motion of the extracted joint moves into the virtual work area set in advance and the time (see FIG. 3 (c)) in which the movement of the extracted joint occurs in the virtual work area.

Then, the residence time is calculated from the time at which the movement of the joint enters the virtual working area and the time at which the movement leaves the virtual working area.

At this time, the area determining unit 43 determines that the worker has performed the standard work if the movement time of the joint is within the predetermined error range of the set time. The area determining unit 43 determines that the worker does not perform the standard work if the movement time of the joint is less than the set time or is longer than the set time.

Explain the parts assembled in the transmission as an example. The parts to be assembled in the transmission must be assembled in order of hub, thrust washer, hub assembly, thrust bearing, and hub clutch.

As shown in Fig. 1, a virtual area is set based on a work table provided for each part. For example, the periphery of the workbench where the hub is disposed is set as the 'A' area as a virtual work area, the periphery of the workbench where the thrust washer is disposed is set as a virtual work area 'B' The vicinity of the workbench is set as a 'C' area as a virtual work area, the vicinity of the workbench where the thrust bearings are disposed is set as a virtual work area 'D', and the workbench around which the hub clutch is disposed is set as a virtual work area Set to 'E' area. The periphery of the workbench for assembling the components is set as an imaginary work area 'F'.

First, the operation extracting unit 41 extracts the position of the operator's joint and the movement of the joint through the three-dimensional scanner 10. The area determining unit 43 measures the movement time of the joint of the operator extracted by the operation extracting unit 41 from the time when the 'A' area enters and the time when the 'A' area departs from the 'A' Calculate the residence time in the area. If the movement of the operator's joint is equal to the set time in the 'A' area, the area determining unit 43 determines that the operator has performed the operation of picking up the hub in the area 'A'.

After staying in the 'A' region for the set time, the residence time in the 'F' region is measured. If the movement of the operator's joint is the same as the set stay time in the 'F' area, the area determining unit 43 determines that the operator assembled the hub in the 'F' area.

Next, the area determining unit 43 measures the time at which the movement of the operator's joint extracted from the operation extracting unit 41 departs from the 'B' area and the 'B' area, Calculate the residence time in the 'B' area. If the movement of the operator's joint is equal to the set time in the 'B' area, the area determining unit 43 determines that the operator has performed the operation of picking up the thrust washer in the 'B' area.

After staying in the 'B' region for the set time, the residence time in the 'F' region is measured. If the movement of the operator's joint is the same as the set stay time in the 'F' area, the area determining unit 43 determines that the operator assembled the thrust washer in the 'F' area.

Next, the area determining unit 43 measures the movement time of the joint of the operator extracted by the operation extracting unit 41 and the time at which the 'C' area departs from the 'C' Calculate the residence time in the 'C' area. If the movement of the operator's joint is equal to the set time in the 'C' area, the area determining unit 43 determines that the operator has performed the operation of picking up the hub assembly in the 'C' area.

After staying in the 'C' region for the set time, the residence time in the 'F' region is measured. If the movement of the operator's joint is the same as the set stay time in the 'F' area, the area determining unit 43 determines that the operator assembled the hub assembly in the 'F' area.

Next, the area determining unit 43 measures the time at which the movement of the operator's joint extracted from the operation extracting unit 41 deviates from the time at which the 'D' region enters and the time at which the movement of the joint of the operator extracted from the 'D' Calculate the residence time in the 'D' area. If the movement of the operator's joint is equal to the set time in the 'D' area, the area determining unit 43 determines that the operator has performed the operation of picking up the thrust bearing in the 'D' area.

After staying in the 'D' region for the set time, the residence time in the 'F' region is measured. If the movement of the operator's joint is the same as the set time of stay in the 'F' area, the area determining unit 43 determines that the operator assembled the thrust bearing in the 'F' area.

Next, the area determining unit 43 measures the movement time of the joint of the operator extracted from the operation extracting unit 41, the time at which the 'E' region enters and the time at which the movement of the joint of the operator extracted from the 'E' Calculate the residence time in the 'E' area. If the movement of the operator's joint is equal to the set time in the 'E' area, the area determining unit 43 determines that the operator has performed the operation of picking up the hub clutch in the 'E' area.

After staying in the 'E' region for the set time, the residence time in the 'F' region is measured. If the movement of the operator's joint is the same as the set stay time in the 'F' area, the area determining unit 43 determines that the operator assembled the hub clutch in the 'F' area.

As described above, it is possible to determine whether or not the operator has performed a predetermined series of work processes by measuring the movement staying time of the joint in each area.

The image determining unit 45 compares the image photographed by the camera 20 with the set standard image to determine whether the photographed image is different from the standard image. Here, the standard image means an image of a predetermined work result to determine whether a specific work process has been accurately performed. Through the image determination unit 45, it is possible to determine whether or not the worker has correctly performed the predetermined job.

Meanwhile, the work process inspection system according to the embodiment of the present invention may further include a warning unit 50 for generating an alarm if the worker does not perform the predetermined work process or the work state does not satisfy the predetermined work state have.

That is, the warning unit 50 generates an alarm when there is a difference between the movement of the joint extracted through the area determination unit 43 and the standard movement. At this time, the alarm may be implemented in various ways such as a siren or a beacon.

Hereinafter, a work process inspection method according to an embodiment of the present invention will be described with reference to FIG.

4 is a flowchart illustrating an operation method of a work process system according to an embodiment of the present invention.

4, the three-dimensional scanner 10 photographs a work operation of an operator, and the operation extracting unit 41 extracts a three-dimensional image of the worker's joint through a three-dimensional image obtained through the three- The motion is extracted (S10).

The area determining unit 43 measures the staying time in which the movement of the joint extracted by the operation extracting unit 41 stays in the virtual working area (S20), and determines whether the measured staying time is equal to the set time (S30).

If there is a difference between the measured residence time and the set time, a warning message is sent to the operator through the warning unit 50 to notify the worker to perform the standard job (S60).

If the measured residence time is equal to the set time, it is determined that the worker has performed the predetermined work process, and the image of the completed work is photographed using the camera 20 (S40).

The image determining unit 45 compares the difference between the image captured by the camera 20 and the preset standard image, and determines whether the operation performed by the operator is correctly performed (S50).

If there is a difference between the photographed image and the standard image, a warning message is sent to the warning unit 50 indicating that the completed component has failed (S60). In this way, it is possible to prevent the occurrence of an assembly failure by comparing the image captured by the camera 20 with the standard image.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. It will be understood that various modifications and changes may be made without departing from the scope of the appended claims.

10: Three-dimensional scanner
20: Camera
40:
41:
43:
45:
50: Warning section

Claims (14)

A moving picture photographing part photographing a work operation of an operator; And
A control unit for determining whether a worker has performed a standard work process based on a residence time within a hypothetical area where a movement of an operator photographed through the moving picture photographing unit is set;
And a work process inspection system.
The method according to claim 1,
The control unit
An operation extracting unit for extracting a movement of an operator's joint from an image photographed through the moving picture photographing unit; And
An area judging unit for judging a time at which the movement of the joint extracted by the operation extracting unit stays in a set virtual work area;
And a work process inspection system.
3. The method of claim 2,
Wherein the residence time is from the time when the movement of the joint extracted by the operation extracting unit enters the virtual work area to the time when the movement of the joint is deviated from the virtual work area.
3. The method of claim 2,
Wherein the area determining unit determines that the worker has performed the standard work process if the residence time is within a predetermined error range from the set time.
The method according to claim 1,
And a video image capturing unit for capturing an image of the finished part,
Wherein the control unit determines the operation result using the difference between the image captured through the image capturing unit and the standard image.
6. The method of claim 5,
The control unit
Further comprising an image determination unit for comparing the photographed image with the set standard image to determine whether the photographed image is different from the standard image.
3. The method of claim 2,
Wherein the image determining unit determines that the operation result is not satisfied when a difference between the image captured by the image capturing unit and the standard image occurs.
8. The method according to claim 2 or 7,
Further comprising an alarm unit for generating an alarm when the residence time is shorter than the set time or when the difference between the photographed image and the set standard image is larger than the set range.
Photographing a work operation of an operator;
Extracting a motion of the joint of the operator from the photographed moving image;
Measuring a residence time of staying within a hypothetical working area where movement of the extracted joint is set; And
Comparing the residence time with the set time to determine whether a standard work process has been performed;
And a control unit for controlling the operation of the work process.
10. The method of claim 9,
Wherein the residence time is from the time when the movement of the joint is within the virtual working area to the time when the movement of the joint is out of the virtual working area.
10. The method of claim 9,
And determines that the standard work process has been performed if the residence time is within a predetermined error range from the set time.
10. The method of claim 9,
Photographing a completed part of the work; And
Comparing the photographed image with a standard image;
Further comprising the steps < RTI ID = 0.0 > of: < / RTI >
13. The method of claim 12,
And if the difference between the photographed image and the standard image is generated, it is determined that the operation result is not satisfied.
14. The method according to claim 11 or 13,
Generating an alarm when the residence time deviates from a predetermined error range of the set time or when a difference between the photographed image and the standard image occurs;
Further comprising the steps < RTI ID = 0.0 > of: < / RTI >
KR1020140073686A 2013-12-26 2014-06-17 Work in Process Inspection System using Motion Detection And Method Thereof KR20150144619A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020140073686A KR20150144619A (en) 2014-06-17 2014-06-17 Work in Process Inspection System using Motion Detection And Method Thereof
US14/559,547 US20150185731A1 (en) 2013-12-26 2014-12-03 Work-in-process inspection system using motion detection, and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140073686A KR20150144619A (en) 2014-06-17 2014-06-17 Work in Process Inspection System using Motion Detection And Method Thereof

Publications (1)

Publication Number Publication Date
KR20150144619A true KR20150144619A (en) 2015-12-28

Family

ID=55084901

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140073686A KR20150144619A (en) 2013-12-26 2014-06-17 Work in Process Inspection System using Motion Detection And Method Thereof

Country Status (1)

Country Link
KR (1) KR20150144619A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023038453A1 (en) * 2021-09-09 2023-03-16 주식회사 테이아 Vehicle manufacturing work quality assurance system and method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023038453A1 (en) * 2021-09-09 2023-03-16 주식회사 테이아 Vehicle manufacturing work quality assurance system and method

Similar Documents

Publication Publication Date Title
US9769469B2 (en) Failure detection apparatus and failure detection program
US11463679B2 (en) Embedded system, fast structured light based 3D camera system and method for obtaining 3D images using the same
JP4784752B2 (en) Image processing device
CN111156923A (en) Workpiece detection method, workpiece detection device, computer equipment and storage medium
JP2014241578A5 (en)
AU2011200089A1 (en) Integration of manufacturing control functions using a multi-functional vision system
JP2009037392A (en) Operation support system
JP6113631B2 (en) Work confirmation system
JP2019191117A (en) Image processing device, image processing method, and program
CN109108430B (en) System and method for automated welding
KR101535801B1 (en) Process inspection device, method and system for assembling process in product manufacturing using depth map sensors
CN105068139A (en) Detection technology for mounting condition of piston cooling nozzle
JP2012143844A (en) Automatic assembling system and automatic assembling method
KR20150144619A (en) Work in Process Inspection System using Motion Detection And Method Thereof
KR101741997B1 (en) Robot Arm Align Apparatus And Align Method With The Same
JP2021179441A (en) Device for inspecting runway floodlight and method for inspecting runway floodlight
US20230419477A1 (en) Anomaly detection system in the automatic placement of composites during the manufacturing of structural elements
KR101362677B1 (en) Apparatus for aligning a semiconductor wafer using image of flat zone and method thereof
JP2021096610A (en) Information processing system, information processing method, and information processing program
US20170050319A1 (en) Programmable Machine Vision Device
KR102091014B1 (en) Machine vision inspection device and product inspection method using machine vision
KR20150104766A (en) Tracking method for badness history in inspection process
KR101567476B1 (en) Method for assembly a part using 3D sensor
JP2007010419A (en) Three-dimensional shape of object verifying system
CN205129209U (en) Automatically, seek mark welding system based on robot welding

Legal Events

Date Code Title Description
E601 Decision to refuse application