KR20220167429A - A position adjustment system for lighting device using lighting bracket for 6-axis robot and an integrated control system for optical devices comprising the same - Google Patents

Abstract

According to one embodiment of the present invention, provided is a lighting bracket, which includes: a bracket body portion detachably coupled to one side of the lighting; and a bracket grip portion protruding upward from the upper surface of the bracket body portion and gripped by a lighting position control device. Both side surfaces of the bracket grip portion gripped by the lighting position control device may be parallel to each other.

Description

A lighting device position adjustment system using a lighting bracket for a 6-axis robot and an optical device integrated control system including the same

The present invention relates to a lighting device position control system capable of effectively controlling the position of a lighting device using a lighting bracket for a 6-axis robot and an integrated optical device control system including the same.

Smart factory refers to an intelligent production factory that improves productivity, quality, and customer satisfaction by applying information and communication technology (ICT) combined with digital automation solutions to production processes such as design, development, manufacturing, distribution, and logistics. Smart factories have automated various production processes, but the process that has the most effect on increasing product production rate is checking and managing defective products and managing material movement between processes. Conventionally, in order to check a defective product, a person directly or by using a photographed image is used to determine a defective product, but the existing method has a problem with somewhat low accuracy.

Specifically, in the past, the setting of an optical system for taking an image suitable for detecting a defective product had to be performed manually and in a TRAIAL-ERROR manner. However, this method has a problem in that a lot of manpower and time are invested because the hardware configuration of the optical system, the shooting method, and the lighting state must be continuously changed.

The present invention is to solve the above-described problems, and provides an optical environment capable of automatically taking images and can effectively adjust the position of the lighting device to change the optical system, and an optical device including the same We want to provide an integrated control system.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problems described above, and other technical problems may exist.

Lighting bracket according to an embodiment of the present invention, the bracket body portion detachably coupled to one side of the lighting; and a bracket gripping portion that protrudes upward from the upper surface of the bracket main body and is gripped by the lighting position adjusting device, and both sides of the bracket gripping portion that the light position adjusting device grips may be parallel to each other.

Also, the lighting may be coaxial lighting.

In addition, the bracket body portion may be formed to protrude from a side surface of the bracket grip portion.

In addition, a bracket protrusion having an inclined upper surface and formed to protrude from an upper end of the bracket grip portion may be further included, and at least one or more bracket protrusion portions may be disposed side by side in a longitudinal direction of the bracket grip portion.

In addition, the bracket grip portion may be made of an elastic material.

A lighting device position control system according to an embodiment of the present invention includes a lighting device having a light that emits electricity by utilizing electric energy and a light bracket coupled to the light and connected to the light position control device; a lighting position adjusting device that moves the position of the lighting device by gripping the lighting bracket; and an optical control module for controlling the lighting position adjusting device, wherein the lighting bracket protrudes upward from the upper surface of the bracket main body and a bracket main body detachably coupled to one surface of the lighting to adjust the lighting position. The apparatus may include a bracket grip portion for gripping, and both sides of the bracket grip portion for gripping the lighting position adjusting device may be parallel to each other.

In addition, the lighting position adjusting device may be a 6-axis industrial robot arm.

An optical device integrated control system according to an embodiment of the present invention includes an optical environment providing system that calculates a predicted optical environment that is an optical environment capable of generating an image similar to or identical to a provided image that is a predetermined image; and a lighting device positioning system for adjusting the position of the lighting so that the lighting device is positioned corresponding to the predicted optical environment transmitted from the optical environment providing system, wherein the lighting device positioning system utilizes electric energy A lighting device having a light that emits electricity and a lighting bracket coupled to the light and connected to the lighting position adjusting device, a lighting position adjusting device that moves the position of the lighting device by gripping the lighting bracket, and the lighting position adjusting device It includes an optical control module for controlling, and the lighting bracket includes a bracket body portion detachably coupled to one surface of the light and a bracket grip portion protruding upward from the upper surface of the bracket body portion for gripping the lighting position adjusting device. And, the bracket grip portion, both side surfaces that the lighting position adjusting device grips may be parallel to each other.

In addition, the optical environment providing system calculates a receiving unit receiving the provided image and a predicted optical environment, which is an optical environment capable of generating an image similar to or identical to the provided image received from the receiving unit, by utilizing the first optical environment providing model. and a calculation unit that performs operation, and the calculation unit may generate the first optical environment providing model through deep learning.

Also, the first optical environment provision model may be generated by deep learning an image and an optical environment of an optical system for generating the image.

A system for automatically changing a photographing device according to an embodiment of the present invention includes a housing unit; a photographing device that receives light reflected from an object to obtain a digital image, and includes a first photographing device and a second photographing device that is different from the first photographing device; a photographing device position changing device connected to the housing, connected to the first photographing device and the second photographing device, and moving positions of the first photographing device and the second photographing device; and an optical control module for controlling the device for changing the location of the photographing device so that the photographing device can obtain a digital image.

In addition, the device for changing the position of the photographing device may include a guide part extending in one direction from the housing part and a movable body part connected to the guide part so as to be movable in a translational position in one direction or another direction and in which the photographing device is disposed. can

In addition, the movable body portion may be rotated based on the guide portion.

In addition, the first photographing device includes a first lens unit through which light is transmitted and a first photographing unit which receives light passing through the first lens unit and calculates an image, and the second photographing device includes a light transmitted through the first lens unit. A first moving body comprising a second lens unit and a second capturing unit for receiving light passing through the second lens unit and calculating an image, wherein the moving body unit includes the first capturing unit and the first capturing unit disposed therein. and a second moving body unit in which the first lens unit and the second lens unit are disposed.

In addition, the optical control module may rotate the first moving body so that only one of the at least one capturing unit calculates a digital image.

In addition, the optical control module may rotate the second moving body so that light passing through one of the at least one lens unit is transferred to a photographing unit that calculates a digital image.

An optical device integrated control system according to an embodiment of the present invention includes an optical environment providing system that calculates a predicted optical environment that is an optical environment capable of generating an image similar to or identical to a provided image that is a predetermined image; and an automatic photographing device changing system for changing the positions of the photographing devices so that the photographing devices can calculate an image corresponding to the predicted optical environment transmitted from the optical environment providing system. The automatic camera changing system acquires a digital image by receiving light reflected from a housing and an arbitrary object, and uses a first photographing device and a second photographing device that is different from the first photographing device. A photographing device having a photographing device, a photographing device position changing device connected to the housing, to which the first photographing device and the second photographing device are connected, and moving the positions of the first photographing device and the second photographing device, and one An optical control module may be provided to control the device for changing the position of the photographing device so that the photographing device can obtain a digital image.

In addition, the optical environment providing system calculates a receiving unit receiving the provided image and a predicted optical environment, which is an optical environment capable of generating an image similar to or identical to the provided image received from the receiving unit, by utilizing the first optical environment providing model. and a calculation unit that performs operation, and the calculation unit may generate the first optical environment providing model through deep learning.

In addition, when the provided image is input, the first optical environment providing model may present a similarity between a predicted image predicted to be generated through the optical system under the predicted optical environment and a provided image together with the predicted optical environment. .

A smart factory system according to an embodiment of the present invention includes a production process system having production-related devices so that products can be produced according to a predetermined design method; an optical system that acquires an image by photographing an article being manufactured by the production process system; and a central control system controlling the production process system and the optical system.

In addition, the factory system may further include a display device for displaying information necessary for operating and managing the smart factory system.

In addition, the production process system includes a conveyor belt for moving products in production, a defective product moving means for moving defective products from the production line to another place, a moving device for moving products in production to another production process line, and arbitrary items are stored. A storage tank may be provided.

In addition, the central control system may include an optical environment providing system for calculating a predicted optical environment, an optical control system for controlling the optical system, and a process control system for controlling the production process system.

In addition, the optical environment providing system includes a receiver receiving a provided image generated by photographing by the optical system under a used optical environment, a calculation unit calculating whether or not the provided image is different from a reference image, which is an image that is an optimization standard, A storage unit for storing information required to implement the optical environment providing method and a transmission unit for transmitting information to an external device may be provided.

In addition, the optical system includes an optical device capable of capturing images or videos, a lighting position adjusting device capable of adjusting the position of lighting among the optical devices, and a photographing device position changing device capable of automatically changing the type of the optical device. can be provided.

In addition, the optical device may include a lighting device and a photographing device.

A lighting device position control system using a lighting bracket for a 6-axis robot according to the present invention and an optical device integrated control system including the same can maximize factory operation efficiency.

In addition, defect inspection accuracy can be improved.

In addition, utilization of the optical system can be maximized.

In addition, product production efficiency can be improved.

However, the effects of the present invention are not limited to the above-mentioned effects, and effects not mentioned will be clearly understood by those skilled in the art from this specification and the accompanying drawings.

1 is a relationship diagram of an optical environment providing system provided by a smart factory system according to an embodiment of the present invention.
Figure 2 is a block diagram of an optical environment providing system according to an embodiment of the present invention
3 is a view showing an optical system according to an embodiment of the present invention
4 is a flowchart of a method for providing an optical environment according to an embodiment of the present invention.
5 is a view for explaining an optical environment providing model generating step in the optical environment providing method according to an embodiment of the present invention.
6 is a diagram for explaining a predicted optical environment calculating step and a reference optical environment calculating step in the optical environment providing method according to an embodiment of the present invention.
7 is an exploded perspective view of a lighting device provided in a lighting device position control system according to an embodiment of the present invention.
8 is an actual embodiment of a state in which the lighting position adjusting device according to an embodiment of the present invention grips the lighting bracket
Figure 9 is a view for explaining the function of the bracket protrusion provided with the lighting bracket according to an embodiment of the present invention
10 is a diagram for explaining an operation of a device for changing a location of a photographing device according to an embodiment of the present invention.

Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings. However, the spirit of the present invention is not limited to the presented embodiments, and those skilled in the art who understand the spirit of the present invention may add, change, delete, etc. other elements within the scope of the same spirit, through other degenerative inventions or the present invention. Other embodiments included within the scope of the inventive idea can be easily proposed, but it will also be said to be included within the scope of the inventive concept.

In addition, components having the same function within the scope of the same idea appearing in the drawings of each embodiment are described using the same reference numerals.

A smart factory system according to an embodiment of the present invention obtains an image by photographing a production process system having production-related devices so that products can be produced according to a predetermined design method, and an item being manufactured by the production process system. It may include an optical system and a central control system for controlling the production process system and the optical system.

In addition, the smart factory system may further include a display device for displaying information necessary for operating and managing the smart factory system.

A production process system may include all devices, devices, and equipment capable of manufacturing and producing an article.

As an example, a production process system may include a conveyor belt that moves items in production, a defective product transfer unit that moves defective products from one production line to another, a mover that moves items in production to another production line, and a storage unit in which random items are stored. tanks and the like.

As an example, the production process system may further include a collection module for collecting video or images to check the status of components of the smart factory system.

The central control system may include an optical environment providing system for calculating a predicted optical environment, an optical control system for controlling the optical system, and a process control system for controlling the production process system.

The central control system may be wired/wireless connected to the production process system, the optical system, and/or the collection module to enable information communication.

The production process system may assemble, manufacture, and/or produce raw materials or parts in a predetermined way, and the optical system may photograph the product being produced and transmit related images to a central control system.

Based on the image received from the process control system, it is possible to determine whether the product being manufactured or the finished product is being manufactured normally.

If the process control system determines that an item is defective, the defective item moving unit may move the item to another location on the production line.

Here, another place may be a storage tank in which only defective products are stored.

The collection module may transmit image and/or video information about the degree to which defective products are filled in the storage tank to the process control system.

The process control system may determine whether a predetermined condition is satisfied based on the video and/or image transmitted from the collection module.

Here, the predetermined condition may be a condition in which defective products are stored in the storage tank at least a certain standard based on the maximum storage capacity of the storage tank.

When a predetermined condition is satisfied, the moving device may transfer the defective product in the storage tank to another location.

The process control system can automatically operate the factory by moving the goods appropriately for each process line using a moving device.

To this end, the process control system may control the production process system using images and/or images collected from the collection module.

Hereinafter, the optical environment providing system will be described in detail.

1 is a relationship diagram of an optical environment providing system provided in a smart factory system according to an embodiment of the present invention, and FIG. 2 is a configuration diagram of an optical environment providing system according to an embodiment of the present invention.

1 and 2, the optical environment providing system 100 according to an embodiment of the present invention includes a receiving unit 110 for receiving a provided image generated by an optical system B10 photographing under an optical environment in use and the above It may include a calculation unit 120 that calculates whether there is a difference between the provided image and a reference image, which is an image serving as an optimization standard.

In addition, the system for providing an optical environment 100 may further include a storage unit 130 for storing information required to implement a method for providing an optical environment and a transmission unit 140 for transmitting information to an external device.

The receiving unit 110 may receive information from an external device.

The calculation unit 120 may perform information processing calculations required to implement the optical environment providing method.

The optical environment providing system 100 may transfer a predicted optical environment and/or a reference optical environment to the display device D10.

The display device D10 displays the reference optical environment through the display, so that the user can easily check the reference optical environment.

For example, the display device D10 may be a display device, a terminal device, a computing device, a smart TV, a PDA, and the like.

However, it is not limited thereto, and the display device D10 can be modified in various ways at a level obvious to those skilled in the art.

The provided image may be created by photographing by the optical system B10, or may be an image created by an external server or computer program.

3 is a diagram illustrating an optical system according to an embodiment of the present invention.

Referring to FIG. 3 , the optical system B10 may be a device for calculating an image by photographing a predetermined object.

The optical system B10 includes an optical device 400, which is a device capable of capturing images or videos, a lighting position adjusting device 500 capable of adjusting the position of a light 411 among optical devices 400, and an optical device 400. An apparatus 600 for changing the position of a photographing device capable of automatically changing the type may be provided.

For example, the optical device 400 may include a lighting device 410 and a photographing device 420 .

However, the type of the optical device 400 is not limited thereto and can be variously modified at a level obvious to those skilled in the art.

For example, the optical device 400 may include a camcorder.

The photographing device 420 may include a lens unit 421 and a photographing unit 422 .

The lens unit 421 may include a lens through which light passes, an aperture, and the like.

The photographing unit 422 may include all equipment for receiving light passing through the lens and calculating it as image data.

For example, the photographing unit 422 may include an image sensor, a shutter, and the like.

The lighting device 410 may include a lighting 411 that emits electricity by utilizing electrical energy and a lighting bracket 412 coupled to the lighting 411 and connected to the lighting position adjusting device 500 .

The type of lighting 411 may mean a type of lighting such as an LED or an incandescent bulb, and may mean information on a type of lighting such as dome lighting, coaxial lighting, ring lighting, bar lighting, four-pole lighting, surface lighting, and the like. there is.

However, the type of lighting is not limited thereto and can be variously modified at a level obvious to those skilled in the art. Hereinafter, the description is based on the fact that the lighting is coaxial lighting, but the present invention is not limited thereto.

A detailed description of the structure and function of the lighting bracket will be described later.

The lighting position adjusting device 500 may change the position of the lighting device 410 by gripping the lighting device 410 .

The optical control system may adjust the brightness of the light 411 and may change or designate the position of the light 411 by controlling the light position adjusting device 500 .

Effects affecting an image taken by the optical system B10 according to the brightness and position of the lighting 411 may be previously stored in the central control system.

For example, the lighting position adjusting device 500 may be a robot arm.

However, it is not limited thereto, and the light position adjusting device 500 may include any device capable of moving an object.

Hereinafter, a case in which the lighting position adjusting device 500 is a 6-axis robot arm will be described, but the present invention is not limited thereto.

As a specific example, the lighting position adjusting device 500 includes a first link unit (R10), a second link unit (R20), a third link unit (R30), a fourth link unit (R40), and a fifth link unit (R50). ), a sixth link part (R60), a work part (T10) capable of performing a predetermined operation, and a first joint part (Z10) combining the first link part (R10) and the second link part (R20). ), a second joint part Z20 combining the second link part R20 and the third link part R30, and combining the third link part R30 and the fourth link part R40 A third joint part Z30, a fourth joint part Z40 combining the fourth link part R40 and the fifth link part R50, the fifth link part R50 and the sixth link part A fifth joint part (Z50) coupling (R60) and a sixth joint part (Z60) coupling the sixth link part (60) and the work part (T10) may be provided.

Each link part may mean a member having a predetermined volume.

The first link unit R10 may be fixed on the ground.

The second link part R20 may be rotated based on the first link part R10 by the first joint part Z10.

That is, the degree of rotation of the second link part R20 with respect to the first link part R10 may be determined according to the rotation angle of the first joint part Z10.

The third link part R30 can be rotated based on the second link part R20 by the second joint part Z20, and similarly, the third link part R30 can be rotated based on the second link part R20. The degree of rotation of the three-link part R30 may be determined according to the rotation angle of the second joint part Z20.

The above-described features are also applied to the fourth link unit R40, the fifth link unit R50, the sixth link unit R60, and the work unit T10, and a detailed description thereof is duplicated with the above description. may be omitted to the extent possible.

The work part T10 is coupled to one end of the sixth link part R60 and can be rotated based on the sixth link part R60 by the sixth joint part Z60.

The work part T10 may mean a part capable of performing a predetermined work on an arbitrary object.

The work unit T10 may be a device capable of gripping the lighting bracket 412 .

For example, the work unit T10 may be gripped by pressing both sides of the lighting bracket 412 with a mechanism that operates like tongs.

However, it is not limited thereto, and the working part T10 can be variously modified at a level obvious to those skilled in the art.

For example, the working unit may grip the lighting bracket 412 in a suction type.

Hereinafter, a portion on one end of the 6-axis robot arm may be referred to as a reference portion.

As a specific example, in order to facilitate analysis, a virtual central point of a virtual circular sphere including all of the work portions T10 may be referred to as a reference portion.

However, the shape of the reference portion is not limited thereto and can be variously modified at a level obvious to those skilled in the art.

The optical control system may use the reference unit as a reference for adjusting the position of the lighting 411 .

That is, when the optical control system wants to move the lighting 411 to a desired coordinate, it can move the reference unit to the desired coordinate.

The optical control system designates desired coordinates and directions, calculates the position of each link unit and the angle of the joint unit based on the coordinates, and controls the lighting position adjusting device 500 based on this.

As an example, an inverse kinematics algorithm is used, but the present invention is not limited thereto, and various modifications are possible at a level obvious to those skilled in the art.

The optical control system may control the lighting position adjusting device 500 based on the most appropriate solution among the eight solutions calculated by Inverse Kinematics.

For example, the optical control system may select a solution in which the total amount of angular change of the first joint part to the third joint part is small.

In addition, the optical control system may select a solution having the smallest angle change of the sixth joint.

In addition, when a plurality of solutions coexist within a predetermined angular range of a total amount of angular change of the first to third joint parts, the optical control system may select a solution having the least angular change of the sixth joint part.

For example, when one solution has an angular change of 120 degrees between the first joint part and the third joint part, and another solution has an angular change amount of 121 degrees between the first joint part and the third joint part, and the predetermined angle range is 5 degrees. , a solution having the smallest angle change of the sixth joint may be selected from among one solution and another solution.

A system for automatically changing a photographing device according to an embodiment of the present invention acquires a digital image by receiving light reflected from a housing unit (I10) and an arbitrary object, and obtains a first photographing device and a device different from the first photographing device. A photographing device 420 having a second photographing device that is connected to the housing, the first photographing device and the second photographing device are connected, and the positions of the first photographing device and the second photographing device are moved. It may include a photographing device position changing device 600 and an optical control module that controls the photographing device position changing device 600 so that one photographing device 420 can obtain a digital image.

The housing part may refer to a device mounted on the ground, and a conveyor belt A11 may pass on the upper side of the housing part.

The photographing device 420 may include a first through N-th photographing device 420 . Here, N may be a natural number of 2 or greater.

For example, the first photographing device may include a first lens unit 421a through which light is transmitted and a first photographing unit 422a through which light passing through the first lens unit 421 is received and an image is generated. there is.

For example, the second photographing device may include a second lens unit 421 through which light is transmitted and a second photographing unit 422b which receives light passing through the second lens unit 421b and calculates an image. there is.

Each photographing device 420 may include a photographing unit and a lens unit, and since technical characteristics are the same as those described above, overlapping may be omitted.

The optical control module means an optical control system, and a detailed description thereof may be omitted to the extent that it overlaps with the above description.

The apparatus 600 for changing the position of the photographing device is connected to the guide part extending in one direction from the housing part and the guide part so as to be able to move in a translational position in one direction or another direction, and the photographing device 420 is disposed. A body portion 620 may be provided.

The guide part provides power so that the guide body part 610 extending upward from the upper surface of the housing part and the moving body part 620 extrapolated to the guide body part 610 can be moved in the vertical direction. A power unit (not shown) and a guide gear unit (not shown) for transmitting power from the guide power unit to the moving body 620 may be provided.

As an example, the guide power unit may be a motor driven by electricity, but the present invention is not limited thereto and may be variously modified at a level obvious to those skilled in the art.

As an example, the guide gear unit may include a rack-pinion gear, but the present invention is not limited thereto and may be variously modified at a level apparent to those skilled in the art.

The moving body part 620 may be rotated based on the guide part.

The moving body part 620 includes the first moving body part 621 where the first photographing part 422 and the first photographing part 422 are disposed, and the first lens part 421 and the second lens. A second moving body 622 in which the unit 421 is disposed may be provided.

The moving body part 620 may further include a rotating part (not shown) for rotating the first moving body part 621 and the second moving body part 622 .

The second movable body 622 may be positioned below the first movable body 621 .

The first movable main body 621 and the second movable main body 622 may be rotated only by a predetermined angle.

Shooting units may protrude from the side of the first moving body 621 .

Each of the photographing units 422 may be spaced apart from each other in the circumferential direction of the first moving body unit 621 .

Lens units may protrude from the side surface of the second moving body unit 622 and may be disposed.

Each of the lens units may be spaced apart from each other in the circumferential direction of the second moving body unit 622 .

One photographing unit and one lens unit may be arranged to correspond to each other in the vertical direction.

A photographing unit positioned above the object to be photographed may be a photographing unit that calculates an image, and a lens unit below the photographing unit that calculates an image may be a lens unit that provides light to the photographing unit.

The optical control module may rotate the first moving body 621 so that only one of the at least one capturing unit produces a digital image.

The optical control module may rotate the second moving body 622 so that light passing through one of the at least one lens unit is transmitted to a photographing unit that generates a digital image.

An optical device integrated control system according to an embodiment of the present invention, an optical environment providing system and an optical environment providing system that calculates a predicted optical environment, which is an optical environment capable of generating an image similar to or identical to a provided image, which is a predetermined image. An automatic imaging device change system for changing the positions of the imaging devices so that the imaging device corresponding to the optical environment (for example, the predicted optical environment and/or the reference optical environment) can calculate an image.

In addition, the optical device integrated control system may further include a lighting device positioning system for adjusting the position of the lighting 411 so that the lighting device 410 is positioned to correspond to the predicted optical environment transmitted from the optical environment providing system. can

The system for automatically changing the photographing device may control the apparatus 600 for changing the location of the photographing device in order to set the photographing device according to the optical environment transmitted from the optical environment providing system.

Similarly, the lighting device positioning system may control the lighting positioning device 500 to set the lighting device according to the optical environment transmitted from the optical environment providing system.

The lighting device position control system according to the present invention is a light having a light 411 that emits electricity by utilizing electrical energy and a light bracket 412 coupled to the light 411 and connected to the light position control device 500. Device 410, a lighting position adjusting device 500 for moving the position of the lighting device 410 by gripping the lighting bracket 412, and an optical control module for controlling the lighting position adjusting device 500. can

Hereinafter, the optical environment providing method implemented by the optical environment providing system will be described in detail.

4 is a flowchart of a method for providing an optical environment according to an embodiment of the present invention.

An optical environment providing method according to an embodiment of the present invention includes an optical environment providing model generating step (S110) of generating a first optical environment providing model by deep learning a predetermined image and an optical environment of an optical system for generating the image; and It may include a provided image receiving step ( S120 ) in which the receiving unit of the optical environment providing system receives a provided image that is a predetermined image.

In addition, the optical environment providing method is an optical environment in which an operation unit of the optical environment providing system inputs the provided image to the first optical environment providing model to generate an image identical to or similar to the provided image. A predicted optical environment calculation step (S141) of calculating ? may be further included.

In addition, the optical environment providing method may further include a predicted optical environment proposing step ( S142 ) of transmitting the predicted optical environment calculated by the first optical environment providing model to the display device D10 .

In addition, the optical environment providing method may further include a mode selection step ( S130 ) of selecting whether to calculate a predicted optical environment as a first mode or a reference optical environment as a second mode.

In addition, the optical environment providing method includes a first reference optical environment calculation step in which the calculator 120 calculates whether the provided image is different from the reference image, and the calculator 120 calculates whether the provided image is the reference image. The method may further include a reference optical environment calculation step (S141) comprising a second reference environment calculation step of calculating a reference optical environment capable of generating the reference image through the optical system when there is a difference from the reference optical environment.

In addition, the method for providing optimal information on the optical environment may further include a reference optical environment proposal step ( S142 ) of transmitting the reference optical environment calculated by the second optical environment providing model to the display device D10 .

Hereinafter, each step will be described in detail.

5 is a diagram for explaining an optical environment providing model generating step in the optical environment providing method according to an embodiment of the present invention.

The calculation unit may generate an optical environment providing model through machine learning or deep learning.

The optical environment providing model may include a first optical environment providing model and a second optical environment providing model.

The first optical environment providing model may be a model providing a predicted optical environment as an output, and the second optical environment providing model may be a model providing a reference optical environment as an output.

Referring to FIG. 5(a) , the calculation unit may generate the first optical environment providing model through deep learning.

As a specific example, the calculation unit may calculate a first optical environment providing model by performing deep learning on a predetermined image and an optical environment of an optical system for generating the predetermined image.

The optical environment is described in detail below.

Referring to FIG. 5 (b), the operation unit performs deep learning using image integration information including optimization information, which is information on whether the image is optimized, an image, and an optical environment of the optical system when the image is generated. A second optical environment provision model may be generated.

Specifically, the image integration information includes an optimal image corresponding to an optimized image and an optimal optical environment that is an optical environment of the optical system when the optimal image is generated, and optimal image integration information corresponding to a non-optimized image. Required image integration information including a required image and a required optical environment that is an optical environment of an optical system when the required image is generated may be provided.

The second optical environment provision model may be calculated by machine learning or deep learning.

The above-described deep learning may use a back propagation algorithm, which is an algorithm for updating the weight of a neural network using labeled data of an output layer, but is not limited thereto. .

Here, since the deep neural network and the back propagation algorithm are conventionally known, a detailed description thereof may be omitted.

The second optical environment providing model may include an image analysis model and an optimal environment model, and each model may be calculated by a calculation unit through machine learning or deep learning.

In order to form an image analysis model, an image analysis model that analyzes the difference between the two images may be formed by deep learning the optimal image, the required image, and the difference between the two images, and analyzing the images, respectively.

As an example, the difference between images may be brightness, color, sharpness, and/or size of a reference object.

Here, the reference object is an object that can be a reference in the image, and may be pre-stored in the storage unit.

For example, if an object present in the proposed image is a mouse, the reference object may be a wheel present in the mouse.

An optimal image may refer to an image to be finally obtained through an optical system.

The optimal optical environment may refer to an optical environment in which an optical system can produce an optimal image.

The required image may be an image that is not in the same state as the optimal image.

Here, the same state may mean that illumination, color, sharpness, and/or focal length (size of the reference object) are the same.

The required optical environment may refer to an optical environment in which an optical system can produce a required image.

In order to form an optimal environment model, an optimal image, an optimal optical environment, a required image, and a required optical environment may be deep-learned.

Here, information on the difference between the optimal image and the required image can be additionally deep-learned.

The second optical environment providing model may have an overall structure such that information on the difference calculated through the image analysis model may be input to the optimal environment model.

The optical environment may include a hardware environment related to specifications of the optical system, a use environment related to a method of using the optical system, and an external environment unrelated to specifications of the optical system.

The use environment may include at least one of lens focal length information, lens aperture information, and lens shutter speed information.

The external environment may include at least one of light type information, light position (including coordinates and direction), and light brightness information.

For example, the hardware environment may include information such as the type and specification of an image sensor, the type and specification of a lens, and the type and specification of a shutter.

That is, it may include all information related to the hardware equipment of the optical system.

For example, the use environment may include information on a focal length, shutter speed, and/or aperture of a lens.

The focal length of a lens, shutter speed, and aperture information may be important factors in determining the state of an image.

For example, the external environment may include light model information, light specification information, light type information, light brightness information, number information of lights, and/or light position information.

Lighting specification information may be information about light output.

The type of lighting may mean a type of lighting such as an LED or an incandescent light bulb, and may mean information on a type of lighting such as a dome light, a coaxial light, a ring light, a bar light, a four-pole light, or a surface light.

This may be because the state of the image may change depending on the type of lighting.

The brightness of lighting may be estimated as an external environment.

Alternatively, the optical environment optimization information system may further include a light sensing unit to sense the brightness of light.

The light sensing unit may provide lighting information to the calculating unit.

The user may input the number of lights that may affect the optical system to the optical environment providing system.

To this end, the optical environment providing system may further include an input unit into which information may be input.

A user may input distance information from an area photographed by the optical system to the light to the optimal information providing system, and the calculation unit may calculate a position of the light three-dimensionally based on the area photographed by the optical system.

Location information of such lighting may be included as an external environment.

In the mode selection step, the user may select the first mode or the second mode for the optical environment providing system.

In this way, the user can obtain a desired optical environment according to the purpose and need.

6 is a diagram for explaining a predicted optical environment calculating step and a reference optical environment calculating step in the optical environment providing method according to an embodiment of the present invention.

Referring to FIG. 6 , when the manager selects the first mode, in the step of calculating the predicted optical environment, if a provided image is input to the first optical environment providing model, the operation unit calculates the provided image from the first optical environment providing model. It is possible to calculate a predicted optical environment, which is an optical environment capable of generating an image similar to or identical to .

In the predictive optical environment calculating step, the calculation unit calculates a similarity between a predicted image predicted to be generated through the optical system under the predicted optical environment and a provided image together with the predicted optical environment provided by the first optical environment providing model. can do.

When the provided image is input, the first optical environment providing model may present a similarity between a predicted image predicted to be generated through the optical system under the predicted optical environment and a provided image together with the predicted optical environment.

The similarity between the predicted image and the provided image can be calculated by illuminance, color, sharpness, and/or size of a reference object, and the method of calculating the similarity between images can utilize existing known technology. may be omitted.

As an example, similarity may be expressed as a percentage (%).

However, the method of expressing the degree of similarity is not limited thereto and can be variously modified at a level obvious to those skilled in the art.

The first optical environment provision model may present the predicted optical environment and a plurality of similarities corresponding to the predicted optical environment.

The optical environment providing system may display a plurality of predicted optical environments in an order of high similarity on the display device.

Through this, the user of the optical environment providing system can easily know the optical environment required to produce the proposed image.

When the manager selects the second mode, in the step of calculating the reference optical environment, the provided image may be input to the second optical environment model, and the reference optical environment may be calculated.

To explain this in detail, the step of calculating a reference optical environment may include a step of calculating a first reference optical environment and a step of calculating a second reference environment.

In the first reference optical environment calculation step, when a provided image is input to an image analysis model, whether the provided image is the same as the reference image may be analyzed through the image analysis model.

The image analysis model may calculate a difference between the two images when there is a difference between the provided image and the reference image.

In the second reference optical environment calculation step, when the difference information between the two images calculated through the image analysis model, the provided image, and the used optical environment are input to the optimal environment model, the reference optical environment may be calculated.

The reference optical environment may refer to an optical environment in which the optical system may generate the reference image through photographing.

Here, the reference optical environment may be calculated by inputting only other information without inputting the optical environment to the optimal environment model.

This may be determined by the deep learning algorithm of the optimal environment model, the model implementation method, and the type of input data.

The used optical environment may refer to an optical environment when an optical system generates a provided image.

The optimal information system of the optical environment may transmit the reference optical environment to the display device.

The display device may display the reference optical environment on a display.

An operator can obtain the convenience of finding an optimal optical environment only with provided images captured from the optical system and/or used optical environment information.

For example, the solution of the reference optical environment may be plural.

Here, the optical environment providing system may calculate recommended information for one optical environment among a plurality of reference optical environments.

For example, if there is a case (case 1) in which a reference image can be calculated even if only the use environment is changed without changing the hardware environment and the external environment in the optical environment, the operation unit is based on the reference optical environment in the first case. can be calculated as recommended information.

For example, there is no case in which a reference image can be calculated even if only the use environment is changed without changing the hardware environment and the external environment in the optical environment, but the external environment and the external environment are changed without changing the hardware environment in the optical environment. If there is a case in which the reference image can be calculated by changing, the calculation unit may calculate the reference optical environment in the second case as recommendation information.

This may mean that the operator can change the optical environment easily and at low cost.

7 is an exploded perspective view of a lighting device provided in a lighting device position adjusting system according to an embodiment of the present invention, and FIG. 8 is an actual state in which a lighting position adjusting device according to an embodiment of the present invention grips a lighting bracket. It is an embodiment.

7 and 8 (a), the lighting bracket 412 according to an embodiment of the present invention includes a bracket body portion 412a detachably coupled to one surface of the lighting 411 and the bracket body portion. It may include a bracket grip portion 412b protruding upward from the upper surface of 412a and gripped by the lighting position adjusting device 500 .

In addition, the lighting bracket 412 may further include a bracket protrusion 412c formed to protrude from an upper end of the bracket grip portion 412b and having an inclined upper surface.

The lighting bracket 412 may be closely coupled to the upper surface of the lighting 411 .

The bracket grip portion 412b may be disposed to protrude from the rear surface of the light 411 in a rearward direction.

This may be to effectively grip the working part of the lighting position adjusting device.

Existing lighting position control devices have many difficulties in directly gripping the lighting 411 (eg, coaxial lighting).

The lighting bracket 412 solves this problem.

For example, the bracket grip portion 412b may have a rectangular parallelepiped shape.

The lighting position adjusting device 500 may grip the long side of the bracket gripping portion 412b.

For example, the operator can grip both sides of the bracket grip portion 412b at the same time by having a tongs grip mechanism.

Both side surfaces of the bracket grip part 412b gripped by the lighting position adjusting device may be parallel to each other.

However, the shape of the bracket grip portion 412b is not limited thereto and can be variously modified at a level obvious to those skilled in the art.

The bracket body portion 412a may protrude from a side surface of the bracket grip portion 412b.

A bracket body portion 412a may be formed by extending from the lower end of the bracket grip portion 412b in both lateral directions of the bracket grip portion 412b.

The bracket body portion 412a may be in close contact with the rear surface of the light by the fastening means.

A work unit for gripping the bracket grip portion 412b may be positioned on the upper side of the bracket body portion 412a.

A plurality of bracket protrusions 412c may exist.

For example, as shown in the drawing, the number of bracket protrusions 412c may be five.

However, the number of bracket protrusions 412c is not limited thereto and can be variously modified at a level obvious to those skilled in the art.

At least one or more bracket protrusions 412c may be arranged in parallel in the longitudinal direction of the bracket grip part 412b.

The bracket protrusion 412c may have a protruding inclined surface 412c-1, which is an inclined upper surface, and a protruding vertical surface 412c-2, which is a vertical surface connected to the protruding inclined surface 412c-1.

The worker can easily determine whether or not the working part normally grips the bracket grip part 412b through a change in the relative height of the protruding inclined surfaces 412c-1.

For example, the bracket grip portion 412b may be made of an elastic material.

However, the material of the bracket grip part 412b is not limited thereto and can be variously modified at a level obvious to those skilled in the art.

Referring to FIG. 8 , unlike that shown in FIG. 2 , the work unit may hold the bracket grip portion so that the sixth joint portion is located in the lateral direction of the bracket grip portion 412b.

Hereinafter, the method shown in FIG. 8 will be described based on the gripping of the bracket grip by the working unit.

9 is a view for explaining a function of a bracket protrusion provided with a lighting bracket according to an embodiment of the present invention.

Referring to FIG. 9 (a), it is a view showing a state in which the work unit grips the bracket grip portion 412b in a normal position.

In this case, all of the heights of the bracket protrusions 412c may be the same.

The operator can conveniently grasp that the lighting position adjusting device is gripped incorrectly by sequentially touching the bracket protrusions 412c.

Referring to FIG. 9 (b), it is a view showing a state in which the work unit grips the bracket grip portion 412b in an abnormal position.

In this case, the height of the bracket protrusion 412c existing on the upper side of the bracket grip portion 412b held by the work unit may be higher than the bracket protrusion 412c existing on the upper side of the bracket grip portion 412b not gripped by the work unit. .

The operator can conveniently grasp that the lighting position adjusting device is gripped incorrectly by sequentially touching the bracket protrusions 412c.

Referring to FIG. 9(c), it is a view showing a state in which the work unit grips the bracket grip portion 412b in an abnormal position.

For example, a case may occur when the bracket grip portion 412b and the work portion are not arranged side by side.

In this case, the heights of the bracket grip parts 412b may be different.

The operator can conveniently grasp that the lighting position adjusting device 500 is gripped incorrectly by sequentially touching the bracket protrusions 412c.

9 is shown somewhat exaggeratedly, the operator can easily grasp the case where the lighting position adjusting device is holding the lighting bracket incorrectly.

10 is a diagram for explaining an operation of an apparatus for changing a location of a photographing device according to an embodiment of the present invention.

Referring to FIG. 10 (a) , the first movable body 621 and the second movable body 622 may move along the guide body 610 in a vertical direction.

Specifically, when electric energy is introduced into the guide power unit disposed in the housing unit, the power of the guide power unit may be transmitted to the moving body 620 through the guide gear unit.

The first movable main body 621 and the second movable main body 622 may be moved vertically at the same time.

Referring to FIG. 10 (b), the first moving body 621 may be rotated in one direction or the other direction by a rotating unit.

Here, the first moving body part 621 may be rotated by a predetermined angle unit.

This may be because the lens unit 421 and the photographing unit 422 must be located at positions corresponding to each other in the vertical direction.

Similarly, the second moving body 622 may be rotated in one direction or the other direction by the rotating unit, and may be rotated by a predetermined angle unit.

The rotating unit may be disposed on each of the first moving body 621 and the second moving body 622 .

Due to this, the first moving body portion 621 and the second moving body portion 622 may be individually rotated.

In the accompanying drawings, in order to more clearly express the technical idea of the present invention, components that are not related to or detached from the technical idea of the present invention are briefly expressed or omitted.

In the above, the configuration and characteristics of the present invention have been described based on the embodiments according to the present invention, but the present invention is not limited thereto, and various changes or modifications can be made within the spirit and scope of the present invention. It is apparent to those skilled in the art, and therefore such changes or modifications are intended to fall within the scope of the appended claims.

110: receiving unit 120: calculating unit
130: storage unit 140: transmission unit

Claims (10)

Bracket body portion detachably coupled to one side of the light; and
A bracket grip portion protruding upward from the upper surface of the bracket body portion and gripped by the lighting position adjusting device; includes,
The bracket grip part,
Both sides to which the lighting position adjusting device grips are parallel to each other,
lighting bracket.
According to claim 1,
the lighting,
coaxial light,
lighting bracket.
According to claim 1,
The bracket body part,
Formed to protrude from the side of the bracket grip portion,
lighting bracket.
According to claim 3,
A bracket protrusion having an inclined top surface and protruding from the upper end of the bracket grip portion; further comprising,
The bracket protrusion,
At least one or more are arranged side by side in the longitudinal direction of the bracket grip part,
lighting bracket.
According to claim 4,
The bracket grip part,
made of elastic material,
lighting bracket.
A lighting device having a lighting bracket that is coupled to a light that emits electricity using electrical energy and connected to the light position adjusting device;
a lighting position adjusting device that moves the position of the lighting device by gripping the lighting bracket; and
An optical control module for controlling the lighting position adjusting device; includes,
The lighting bracket,
A bracket body portion detachably coupled to one surface of the light and a bracket grip portion protruding upward from the upper surface of the bracket body portion for gripping the light position adjusting device,
The bracket grip part,
Both sides to which the lighting position adjusting device grips are parallel to each other,
Lighting equipment positioning system.
According to claim 6,
The lighting position control device,
6-axis industrial robot arm,
Lighting equipment positioning system.
an optical environment providing system that calculates a predicted optical environment that is an optical environment capable of generating an image similar to or identical to a provided image that is a predetermined image; and
A lighting device positioning system for adjusting the position of the lighting so that the lighting device is positioned to correspond to the predicted optical environment transmitted from the optical environment providing system; includes,
The lighting device position control system,
A lighting device having a light that emits electricity using electrical energy and a lighting bracket coupled to the light and connected to the light position adjusting device, a lighting position adjusting device that moves the position of the lighting device by gripping the lighting bracket, and the above Including an optical control module for controlling the lighting position adjusting device,
The lighting bracket,
A bracket body portion detachably coupled to one surface of the light and a bracket grip portion protruding upward from the upper surface of the bracket body portion for gripping the light position adjusting device,
The bracket grip part,
Both sides to which the lighting position adjusting device grips are parallel to each other,
Optical device integrated control system.
According to claim 8,
The optical environment providing system,
A receiving unit receiving the provided image and a calculation unit calculating a predicted optical environment, which is an optical environment capable of generating an image similar to or identical to the provided image received from the receiving unit, by using a first optical environment providing model;
The calculation unit,
Generating the first optical environment providing model through deep learning,
Optical device integrated control system.
According to claim 9,
The first optical environment providing model,
Created by deep learning of the image and the optical environment of the optical system for generating the image,
Optical device integrated control system.

Images