KR102239594B1 - Electronic device and method for producing flexion contour expression images - Google Patents

Abstract

Disclosed is an electronic device for generating bending expression images to provide 3D shape information easily used by a user, and a method thereof. According to the present invention, the electronic device comprises: a first structured light emitting unit emitting first structured light corresponding to a first structured light pattern; a first structured light sensor unit acquiring an image including a reflective pattern formed by reflection of the first structured light; a second structured light emitting unit emitting second structured light corresponding to a second structured light pattern; a second structured light sensor unit acquiring an image including a reflection pattern formed by reflection of the second structured light corresponding to the second structured light pattern; and a control unit using the image acquired through the first structured light sensor unit and the image obtained through the second structured light sensor unit to generate a bending expression image including bending information.

Description

Electronic device and method for generating an image representing flexion {ELECTRONIC DEVICE AND METHOD FOR PRODUCING FLEXION CONTOUR EXPRESSION IMAGES}

The present disclosure relates to an electronic device and method for generating a curvature expression image, and more particularly, to an electronic device and method for providing a recommended golf putting line by generating a curvature expression image of a golf green.

In the case of putting in golf, the golfer accurately grasps information such as the inclination around the pin (hole cup) of the golf green (hereinafter, information around the pin location) and strikes the golf ball with the appropriate strength and direction to hit the ball into the hole cup. You have to put it in (pin).

Therefore, since putting has a very large effect on the score, information around the pin's location has been treated as the most important factor in a golf game, and many golfers have tried to grasp the information around the pin location before putting on the green. Sit back a few steps to the back or observe the slope of the green by almost matching the ground and eye level. At this time, in order to determine the inclination between the golf ball and the hole cup, observation from the left or the right side, observation from the rear or the rear side of the hole cup, and even grasping the fine slope around the hole cup.

However, it is very difficult for a golfer or caddy to observe the actual green with the naked eye and to grasp information such as the inclination around the pin's position as a whole and accurately. Methods of acquiring dimensional shape information and providing it through a mobile terminal are emerging.

Here, the horizontal measurement auxiliary device provides information necessary for determining the putting direction angle by attaching a horizontal measuring device to a ball marker to measure the inclination of the green at the position of the golf ball, and measure the inclination at the position of the hole cup. do. However, in such a horizontal measurement auxiliary device, the inclination between two points can be measured, but it is difficult to measure the overall topographic inclination of the green between the golf ball and the pin.

In recent years, instead of a ball marker, a method of using an inclination measurement app installed on a smartphone equipped with a tilt sensor has appeared, but this is the same method as the ball marker method, and the measurement means is only replaced by a smartphone, and is still It is difficult to measure the overall terrain slope of the green between the golf ball and the pin.

On the other hand, there is a method of providing information obtained through actual measurement of 3D shape information of the green through a mobile terminal, which can most accurately provide information on the slope of the green.

This method uses a high-precision laser scanner to measure the position (latitude, longitude) and altitude (height) of grid points on the green at intervals of several centimeters to obtain 3D shape information for the entire green. It's a way to provide information to golfers.

However, the high-precision laser scanner is difficult to carry, and thus, there is a problem that it can be used only in a golf course in which 3D shape information has been obtained in advance.

Therefore, there is a need for research on an electronic device and method capable of obtaining 3D shape information that can be easily used by a user.

The present disclosure has been conceived in response to the above-described background technology, and is intended to provide an electronic device and method for generating a curvature expression image.

In order to solve the above-described problem, an electronic device is disclosed. The electronic device may include: a first structured light irradiation unit configured to irradiate first structured light corresponding to a first structured light pattern; A first structured light sensor unit acquiring an image including a reflection pattern formed by reflecting the first structured light; A second structured light irradiation unit for irradiating second structured light corresponding to the second structured light pattern; A second structured light sensor unit acquiring an image including a reflective pattern formed by reflecting second structured light corresponding to the second structured light pattern; And a controller configured to generate a curvature expression image including curvature information by using the image acquired through the first structured light sensor unit and the image acquired through the second structured light sensor unit.

In addition, the control unit includes a first image including a first reflection pattern formed by reflecting the first structured light from the first area through the first structured light sensor unit and the first structured light being reflected from the second area A third image including a third reflective pattern formed by obtaining a second image including a second reflective pattern formed as a result, and reflecting the second structured light from the second region through the second structured light sensor unit Is obtained, recognizes first depth information using the third reflection pattern, and determines a distance between the first region and the electronic device by comparing the first reflection pattern and the second reflection pattern, , By determining a first compensation value for matching the second reflection pattern with the first reflection pattern based on the distance, and correcting the first depth information according to the first compensation value. It is possible to generate second depth information.

In addition, the curvature expression image may be a 3D depth image corresponding to the second area generated by using the second depth information of the second area.

In addition, the electronic device may include: a display unit that displays the curvature expression image; Or a communication unit that transmits the curved image to an external device; It may further include.

In addition, the first structured light may be RGB light.

In addition, the second structured light may be IR light.

In addition, the first structured light pattern may be a regular dot pattern, and the second structured light pattern may be a random dot pattern.

In addition, the electronic device further includes: an angle sensor unit configured to measure a first acquisition angle of the first image and a second acquisition angle of the second image, wherein the controller further includes, when determining the distance, The distance may be determined using a difference between the first acquisition angle and the second acquisition angle, and a comparison result of the first reflection pattern and the second reflection pattern.

In addition, the first image is an image of the first area acquired in a vertical direction of the first object or a vertical direction of the first area, and the second image and the third image are inclined from the vertical direction. It may be an image of a second area including the first object and the second object acquired in the true direction.

Also, the second image and the third image may be images acquired at the same viewpoint.

In addition, the first object may be a golf ball, and the second object may be a hole existing on a golf green.

The control unit may generate a recommended golf putting line.

In addition, the electronic device may include: a display unit configured to display an image in which the curve expression image and the recommended golf putting line are joined; Or a communication unit for transmitting the image to which the curved expression image and the recommended golf putting line are joined to an external device; It may further include.

In addition, the controller: may determine to display an area of the second area corresponding to the recommended putting line using RGB light.

Disclosed is a method of generating a curvature expression image performed by an electronic device in order to solve the above-described problem. The method includes: irradiating a first structured light corresponding to a first structured light pattern to a first area and a second area through a first structured light irradiation unit; A first image including a first reflection pattern formed by reflecting the first structured light from the first area through a first structured light sensor unit, and a second image including a first reflecting pattern formed by reflecting the first structured light from the second area Obtaining a second image including a reflective pattern; Irradiating a second structured light corresponding to a second structured light pattern to the second area through a second structured light irradiation unit; Acquiring a third image including a third reflective pattern formed by reflecting second structured light corresponding to the second structured light pattern from the second area through a second structured light sensor unit; Recognizing first depth information using the third reflection pattern through a control unit; Determining a distance between the first region and the electronic device by comparing the first reflection pattern and the second reflection pattern through the control unit; Determining a first compensation value for matching the second reflection pattern with the first reflection pattern based on the distance; And generating second depth information of the second area by correcting the first depth information according to the first compensation value. And generating a curvature expression image including curvature information by using the second depth information.

In addition, the curvature expression image may be a 3D depth image corresponding to the second area generated by using the second depth information of the second area.

The present disclosure may provide an electronic device and a method for generating a curvature expression image.

1 is a block diagram of an electronic device 100 according to some embodiments of the present disclosure.
2 is a diagram for describing a first structured light pattern and a second structured light pattern according to some embodiments of the present disclosure.
3 is a diagram for describing a first reflection pattern and a second reflection pattern according to some embodiments of the present disclosure.
4 is a diagram for describing a method of correcting a second reflection pattern and a third reflection pattern according to a first compensation value according to some embodiments of the present disclosure.
5 is a flowchart illustrating a method of generating a curvature representation image performed by an electronic device according to some embodiments of the present disclosure.
6 is a simplified and general schematic diagram of an exemplary computing environment in which embodiments of the present disclosure may be implemented.

Various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for illustrative purposes, a number of specific details are disclosed to aid in an overall understanding of one or more aspects. However, it will also be appreciated by those of ordinary skill in the art that this aspect(s) may be practiced without these specific details. The following description and the annexed drawings set forth in detail certain illustrative aspects of the one or more aspects. However, these aspects are illustrative and some of the various methods in the principles of the various aspects may be used, and the descriptions described are intended to include all such aspects and their equivalents. Specifically, as used herein, “an embodiment”, “example”, “aspect”, “example”, and the like are not construed as having any aspect or design being better or advantageous than other aspects or designs. May not.

Hereinafter, the same or similar components are assigned the same reference numerals regardless of the reference numerals, and redundant descriptions thereof are omitted. In addition, in describing the embodiments disclosed in the present specification, when it is determined that a detailed description of related known technologies may obscure the subject matter of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the present specification is not limited by the accompanying drawings.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present disclosure. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements.

Although the first, second, and the like are used to describe various devices or components, it goes without saying that these devices or components are not limited by these terms. These terms are only used to distinguish one device or component from another device or component. Therefore, it goes without saying that the first device or component mentioned below may be a second device or component within the spirit of the present disclosure.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used with meanings that can be commonly understood by those of ordinary skill in the art to which this disclosure belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or”. That is, unless specified otherwise or is not clear from the context, "X employs A or B" is intended to mean one of the natural inclusive substitutions. That is, X uses A; X uses B; Or when X uses both A and B, "X uses A or B" can be applied to either of these cases. In addition, the term “and/or” as used herein should be understood to refer to and include all possible combinations of one or more of the listed related items.

In addition, the terms "information" and "data" as used herein may often be used interchangeably with each other.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it is directly connected to or may be connected to the other component, but other components may exist in the middle. It should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

The suffixes "module" and "unit" for constituent elements used in the following description are given or used interchangeably in consideration of only the ease of writing the specification, and do not themselves have a distinct meaning or role from each other.

When an element or layer is referred to as “on” or “on” of another component or layer, it is not only above the other component or layer, but also the other layer or other component in the middle. Includes all intervening cases. On the other hand, when a component is referred to as "directly on" or "directly on", it means that no other component or layer is interposed therebetween.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc. It can be used to easily describe a component or a correlation with other components. Spatially relative terms should be understood as terms including different directions of the device during use or operation in addition to the directions shown in the drawings.

For example, if a component shown in a drawing is turned over, a component described as "below" or "beneath" of another component will be placed "above" the other component. I can. Accordingly, the exemplary term “below” may include both directions below and above. Components may be oriented in other directions, and thus spatially relative terms may be interpreted according to the orientation.

Objects and effects of the present disclosure, and technical configurations for achieving them will become apparent with reference to the embodiments described later in detail together with the accompanying drawings. In describing the present disclosure, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the subject matter of the present disclosure, a detailed description thereof will be omitted. In addition, terms to be described later are terms defined in consideration of functions in the present disclosure, which may vary according to the intention or custom of users or operators.

However, the present disclosure is not limited to the embodiments disclosed below, and may be implemented in various different forms. The present embodiments are provided only to make the present disclosure complete, and to fully inform the scope of the disclosure to those of ordinary skill in the art to which the present disclosure belongs, and the present disclosure is only defined by the scope of the claims. . Therefore, the definition should be made based on the contents throughout the present specification.

The scope of rights to the method in the claims of the present disclosure is generated by the functions and features described in each step, and unless the precedence of the order is specified in each step constituting the method, the claim It is not affected by the order of description of each step in the range. For example, in the claims described in a manner that includes steps A and B, even if step A is described before step B, the scope of rights is not limited to that step A must precede step B.

1 is a block diagram of an electronic device 100 according to some embodiments of the present disclosure. 2 is a diagram for describing a first structured light pattern and a second structured light pattern according to some embodiments of the present disclosure. 3 is a diagram for describing a first reflection pattern and a second reflection pattern according to some embodiments of the present disclosure. 4 is a diagram for describing a method of correcting a second reflection pattern and a third reflection pattern according to a first compensation value according to some embodiments of the present disclosure.

The electronic device 100 according to some embodiments of the present disclosure can improve speed and accuracy while reducing the amount of computation by compensating for a height at which a user generates an image through the electronic device 100 in generating a curvature expression image. have. Specifically, the electronic device 100 may generate a curvature expression image with a small amount of computation by correcting depth information generated at an angle inclined with respect to the ground with depth information obtained in a vertical direction.

The electronic device 100 may include a mobile terminal such as a smart phone, a tablet, a smart watch, and smart glasses. As another example, the electronic device 100 may be an accessory device that can be attached to a mobile terminal. In this case, the electronic device 100 may perform some operations using a component of the mobile terminal. As another example, the electronic device 100 may be a device for performing a method of generating a curvature expression image according to some embodiments of the present disclosure by communicating with an external device through the communication unit 110. For example, the electronic device 100 is a device that transmits an image or information obtained to perform the method for generating a curvature expression image according to the present disclosure to an external device, and then receives the image or information processed by the external device again. I can. As another example, the electronic device 100 may be a single device for performing the method of generating a curvature representation image according to some embodiments of the present disclosure. However, the present invention is not limited thereto, and the electronic device 100 may include various devices.

Referring to FIG. 1, the electronic device 100 includes a communication unit 110, an input unit 120, a control unit 130, a structured light irradiation unit 140, a structured light sensor unit 150, an angle sensor unit 160, and a storage unit. It may include 170 and a display unit 180. However, the above-described components are not essential for implementing the electronic device 100, and thus the electronic device 100 may have more or fewer components than the components listed above.

The communication unit 110 may include one or more modules that enable communication between the electronic device 100 and a communication system, or between the electronic device 100 and an external device or server. In addition, the communication unit 110 may include one or more modules that connect the electronic device 100 to one or more networks.

Networks according to some embodiments of the present disclosure include Public Switched Telephone Network (PSTN), x Digital Subscriber Line (xDSL), Rate Adaptive DSL (RADSL), Multi Rate DSL (MDSL), Very High Speed (VDSL). Various wired communication systems such as DSL), Universal Asymmetric DSL (UADSL), High Bit Rate DSL (HDSL), and local area network (LAN) can be used.

In addition, the networks presented here include Code Division Multi Access (CDMA), Time Division Multi Access (TDMA), Frequency Division Multi Access (FDMA), Orthogonal Frequency Division Multi Access (OFDMA), Single Carrier-FDMA (SC-FDMA), and Various wireless communication systems such as other systems can be used.

The network according to the embodiments of the present disclosure may be configured regardless of its communication mode such as wired and wireless, and is composed of various communication networks such as a local area network (LAN) and a wide area network (WAN). Can be. In addition, the network may be a known World Wide Web (WWW), and may use a wireless transmission technology used for short-distance communication such as infrared (IrDA) or Bluetooth.

The techniques described herein may be used not only in the networks mentioned above, but also in other networks.

The input unit 120 may receive information from a user. When information is input through the input unit 120, the controller 130 may control the operation of the electronic device 100 to correspond to the input information. The input unit 120 includes a mechanical input means (or a mechanical key, for example, a button located on the front, rear or side of the electronic device 100, a switch, and a touch input means. As an example, the touch input means is composed of a virtual key, a soft key, or a visual key displayed on a touch screen through software processing, or the touch On the other hand, the virtual key or the visual key can be displayed on the touch screen while having various forms, while the virtual key or the visual key can be displayed on the touch screen. , Text, icon, video, or a combination thereof. As an example of the input unit 120 operated to receive a command for controlling the operation of the electronic device 100 , May also be collectively referred to as a manipulating portion.

The controller 130 may generally control the overall operation of the electronic device 100. The controller 130 processes signals, data, information, etc. that are input or output through the components of the electronic device 100, or drives an application program stored in the storage unit 170 to provide appropriate information or functions to the user or You can handle it. For example, the controller 130 may perform a method of generating a curvature expression image according to some embodiments of the present disclosure.

The control unit 130 may control at least some of the components of the electronic device 100 in order to drive the application program stored in the storage unit 170. Furthermore, in order to drive the application program, the controller 130 may operate by combining at least two or more of the components included in the electronic device 100 with each other.

Various embodiments described herein may be implemented in a recording medium and a storage medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 130 itself.

According to software implementation, embodiments such as procedures and functions described in the present specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. The software code can be implemented with a software application written in an appropriate programming language. The software code may be stored in the storage unit 170 and executed by the control unit 130.

The structured light irradiation unit 140 and the structured light sensor unit 150 may operate complementarily to generate and irradiate structured light and receive the reflected structured light to generate an image.

The structured light irradiation unit 140 and the structured light sensor unit 150 may include a first structured light irradiation unit 141 and a first structured light sensor unit 151. The first structured light irradiation unit 141 and the first structured light sensor unit 151 may use RGB light, but are not limited thereto. The first structured light irradiation unit 141 may irradiate the first structured light corresponding to the first structured light pattern. In this case, the first structured light sensor unit 151 may generate an image including a reflection pattern by receiving the reflected first structured light. As described below, the first structured light pattern may be a pattern composed of a plurality of dots arranged at uniform intervals. In this case, the controller 130 may measure the distance or determine the height of the electronic device 100 by using a plurality of reflection patterns generated corresponding to the first structured light pattern.

The structured light irradiation unit 140 and the structured light sensor unit 150 may include a second structured light irradiation unit 142 and a second structured light sensor unit 152 capable of generating a 3D image or depth information. have. In this case, the second structured light irradiated by the second structured light irradiation unit 142 and received by the second structured light sensor unit 152 may be IR light. However, the present invention is not limited thereto, and the second structured light may be visible light (eg, IR light).

The structured light irradiation unit 142 may include a Light Emitting Diode (LED) including a plurality of light sources for generating light, a Vertical Cavity Surface Emitting Laser (VCSEL), or an Edge Emitting Laser (EEL), but are limited thereto. It doesn't work. The light generated by the second structured light irradiation unit 142 may pass through a diffractive optical element (DOE) to generate a second structured light pattern. The second structured light pattern may include a pattern of a plurality of dots that are randomly arranged. However, the present invention is not limited thereto, and the second structured light pattern may include various patterns such as a line pattern, a matrix pattern, and a dot pattern.

For example, the second structured light irradiation unit 142 and the second structured light sensor unit 152 may be components of a structured light type 3D depth camera. However, the present invention is not limited thereto, and the second structured light irradiation unit 142 and the second structured light sensor unit 152 are various types of 3D depth recognition technology, such as a stereo method, a Time-Of-Flight method, and a combination method thereof. It may be a component of a 3D depth camera using.

For example, the image generated by receiving the structured light irradiated by the second structured light irradiation unit 142 by the second structured light sensor unit 152 may include parallax movement generated according to the depth of the reflecting object. have. In this case, the controller 130 may check the disparity of the parallax movement to generate depth information for the object. The generated depth information may be used to generate a curvature expression image including curvature information of an object or terrain.

The angle sensor unit 160 may measure an angle in a direction in which the electronic device faces by measuring the position and angular velocity of the electronic device 100. For example, the angle sensor unit 160 may include a gyro sensor. When an image is generated by the structured light irradiation unit 140 and the structured light sensor unit 150, the angle sensor unit generates information on the direction (or angle) that the electronic device 100 faces at the time the image is generated. I can. The direction or angle of the generated electronic device 100 may be used to generate a curvature expression image.

The storage unit 170 may store a program for the operation of the control unit 130 and may temporarily or permanently store input/output data. The storage unit 170 includes a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), RAM (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, It may include at least one type of storage medium among magnetic disks and optical disks. The storage unit 170 may be operated under control by the control unit 130.

The display unit 180 may display (output) information processed by the electronic device 100. For example, the display unit 180 may include information on an execution screen of an application program driven by the electronic device 100, information related to an event, information related to a game result, or a user interface (UI) or GUI based on such execution screen information. (Graphic User Interface) information can be displayed.

The display unit 180 may form a layer structure with the touch sensor or are integrally formed, thereby implementing a touch screen. Such a touch screen may function as an input unit 120 that provides an input interface between the electronic device 1000 and a user, and may provide an output interface between the electronic device 100 and a player.

The display unit 180 according to some embodiments of the present disclosure may be provided in an area of the electronic device 100. The display unit 180 may output various images.

For example, the display unit 180 may display a curvature expression image and/or a recommended golf putting line, or an image to which they are bonded.

Hereinafter, operations of the components of the electronic device 100 described above for performing the method of generating a curvature expression image according to some embodiments of the present disclosure will be described.

The control unit 130 includes a first image including a first reflection pattern formed by reflecting the first structured light from the first area through the first structured light sensor unit 151 and reflecting the first structured light from the second area As a result, a second image including a second reflection pattern formed may be obtained.

Specifically, in order to compare the image for the first area (ie, the first image) and the image for the second area (ie, the second image), a first image may be obtained first. However, on the contrary, after the second image is first acquired, the first image may be acquired. Typically, the first image and the second image may be acquired at different viewpoints.

The first image may be an image of the first area acquired in a vertical direction of the first object or a vertical direction of the first area. Also, the vertical direction of the first area may include a case in which the electronic device 100 faces a direction perpendicular to the ground. When the first image is acquired in the vertical direction of the first object, the image of the first area may be an image of the first area including the first object. As another example, the first image may be an image of the first area acquired in a vertical direction of the first area. In this case, the first image may be an image of the first area not including the first object.

Specifically, for example, the first image may be an image obtained by photographing (or sensing) the user with the electronic device 100 facing the floor. In this case, the first area may include an area in a direction in which the user looks at the floor vertically. As another example, the first area may refer to an area that is photographed or sensed using the electronic device 100 while the user vertically looks at the location of the first object (eg, a golf ball). Here, the vertical direction may include not only a direction that is 90 degrees to the ground, but also a direction that is an angle that is substantially 90 degrees (for example, an angle having a deviation of +5 degrees to -5 degrees).

The first structured light irradiated by the first structured light irradiation unit 141 may be light that can be seen by a person (eg, visible light including RGB light). When the structured light irradiated by the first structured light irradiation unit 141 is visible light, not only the first reflection pattern reflected by the structured light irradiated to the first area, but also the structured light irradiated to the second area described below. The second reflection pattern reflected by the light can be visually confirmed, thereby facilitating operation of the electronic device. However, the present invention is not limited thereto, and the first structured light may be invisible light (eg, IR light).

The first structured light pattern may be composed of various patterns. For example, the first structured light pattern may be a regular dot pattern in which a plurality of dots are arranged at regular intervals. When the first structured light pattern is a regular dot pattern, the spacing of the plurality of dots and the direction of the pattern may be different depending on the direction in which structured light corresponding to the first structured light pattern is irradiated.

As described above, since the first image is an image of the first area acquired in the vertical direction of the first object or in the vertical direction of the first area, the first reflection pattern includes a plurality of dots forming the first structured light pattern. It may include a pattern forming a regular interval. When a plurality of dots form a regular interval, the first reflection pattern may represent a pattern in which the plurality of dots are not driven or inclined in a specific direction (eg, left or right).

In this case, a pattern of a plurality of dots (ie, a first reflection pattern) appearing in the first image may represent an arrangement at a constant interval (or exhibiting negligible deviation). As will be readily understood by those of ordinary skill in the art, this constant interval may be changed according to the height of the electronic device from the first area (or the distance between the first area and the electronic device 100). . The spacing of the plurality of dots constituting the first reflection pattern is compared with the spacing of the plurality of dots appearing in the second image for the second area, as described below, thereby comparing the electronic device 100 or the electronic device 100. A distance between the user, the first area and the electronic device (or the height of the electronic device 100 with respect to the ground), the distance between the object on the first area or the second area, or a point may be determined.

As described above, when the first image is obtained first, an image (ie, a second image) of the second area for comparison with the first image may be obtained. However, on the contrary, since the second image may be acquired first and then the first image may be acquired, the order of acquisition may vary.

Specifically, in the second image, the structured light corresponding to the same structured light pattern (that is, the first structured light pattern) by the same structured light irradiation unit (ie, the first structured light irradiation unit 141) as the first image The reflected image may be obtained by acquiring the same structured light sensor unit as the first image (ie, the first structured light sensor unit 151 ). However, the second image may be an image obtained for an area different from the first image (ie, the second area). In this case, since the second image has a different direction and angle of irradiating the structured light corresponding to the first structured light pattern to the second area than the first area, the second reflection of the second image corresponding to the second area The pattern may be different from the first reflection pattern of the first image.

As described above, the first image is an image of the first area obtained in the vertical direction of the first object or in the vertical direction of the first area (thus, which may be in a direction perpendicular to the ground), whereas the second image May be an image of the second area obtained in a direction inclined from a direction perpendicular to the ground. Therefore, since the first image and the second image were each acquired (e.g., sensed or photographed) in different directions, the first image and the second image have different patterns (i.e., the first structured light pattern) for the same first structured light pattern. A reflective pattern and a second reflective pattern) may be included, respectively. The first reflection pattern and the second reflection pattern are compared with each other, and the comparison result is the distance between the first area and the electronic device, or the user who has the electronic device 100 or the electronic device 100 and the object on the second area. Alternatively, it may be used to determine the distance to a point and the direction of acquisition.

According to some embodiments of the present disclosure, the controller 130 includes a third image including a third reflection pattern formed by reflecting the second structured light from the second area through the second structured light sensor unit 152. Can be obtained. In this case, the controller 130 may recognize the first depth information by using the third reflection pattern.

Specifically, as described above, for example, the second structured light irradiation unit 142 and the second structured light sensor unit 152 may be components of a 3D depth camera using IR light or the like. In this case, the control unit 130 calculates the distortion of the pattern caused by the surface roughness while the second structured light irradiated from the second structured light sensor unit is reflected from the second area by using the third reflection pattern. It is possible to obtain depth information of the region. Accordingly, the third image including the third reflection pattern may be used to recognize depth information (ie, first depth information) of the second area. However, the present invention is not limited thereto, and the second structured light irradiation unit 142 and the second structured light sensor unit 152 may be used to obtain depth information in various ways.

The first image is an image of the first area obtained in the vertical direction of the first object or in the vertical direction of the first area, while the third image is inclined from the vertical direction of the first area in the same way as the second image. It may be an image of the second area acquired in the direction. To this end, in order to obtain the second image and the third image in the same direction, it is preferable that the second image and the third image are images obtained at the same viewpoint. As described below, since the second image and the third image are acquired in the same direction with respect to the second area, the third reflection pattern included in the third image is It can be corrected using the second reflection pattern.

Specifically, the first depth information of the second region obtained from the third image may be depth information in a state inclined with respect to the ground because the third image is obtained in a direction inclined from a vertical direction of the first region. Since it is preferable in terms of the computational amount and speed of the algorithm that the curvature expression image is generated using depth information in the vertical direction, the first depth information is depth information corresponding to the vertical direction of the second area (hereinafter, referred to as second depth information). It is advantageously corrected to).

Hereinafter, the control unit of the electronic device 100 for generating second depth information in a vertical direction with respect to the ground by correcting the first depth information, and generating a curvature expression image including curvature information using the second depth information The operation of 130 will be described with reference to FIGS. 2 to 4.

Referring to FIG. 2, a first structured light pattern 200 and a second structured light pattern 300 according to some embodiments of the present disclosure are illustrated.

According to some embodiments of the present disclosure, the first structured light pattern 200 may be a regular dot pattern. In addition, the second structured light pattern 300 may be a random dot pattern.

As shown in FIG. 2, the regular dot pattern may include a pattern in which a plurality of dots forming a pattern are arranged at regular intervals. In this case, when the structured light corresponding to the regular dot pattern is irradiated on one surface (eg, the ground) in the vertical direction, the pattern of the reflected structured light may be a pattern in which a plurality of dots are arranged at regular intervals. In this case, as described above, the distance between the dots may increase proportionally according to the distance between the electronic device 100 and the reflective surface. In addition, when the regular dot pattern is irradiated in a direction inclined in a vertical direction with respect to any one surface, the spacing between dots relatively close to the first structured light irradiation unit 141 increases relatively little, while the first structured light irradiation unit ( 141), the spacing of dots that are relatively far can be increased by a relatively large amount.

The ratdom dot pattern may have a pattern of a plurality of dots that are randomly arranged. In addition, the spacing of the plurality of dots randomly arranged according to the distance between the electronic device 100 and the reflective surface may increase proportionally. In addition, when the random dot pattern is also irradiated in a direction inclined in a vertical direction with respect to any one surface, the spacing between the dots relatively close to the second structured light irradiation unit 142 is relatively slightly increased, while the second structured light irradiation unit ( 142), the spacing of dots that are relatively far can be increased by a relatively large amount. Therefore, by using the relationship between the first reflection pattern in the first area corresponding to the first structured light pattern and the second reflection pattern in the second area, the third reflection pattern in the second area corresponding to the second structured light pattern It can be corrected with a reflection pattern irradiated in the vertical direction.

Referring to FIG. 3A, a first reflection pattern according to some embodiments of the present disclosure is illustrated. Referring to FIG. 3B, a second reflection pattern according to some embodiments of the present disclosure is illustrated. In each drawing, an arrow indicates a direction in which an image is acquired (eg, a sensing direction or a photographing direction).

According to some embodiments of the present disclosure, the angle sensor unit 160 may measure a first acquisition angle of the first image and a second acquisition angle of the second image. In this case, the controller 130 may determine the distance by using the difference between the first and second photographing angles and a comparison result of the first and second reflection patterns. Here, the distance may include a distance between the first area and the electronic device 100. For example, the distance between the first area and the electronic device 100 may include a height of the electronic device 100 with respect to the ground. As another example, the distance may include a distance to an object or a point on the first area or the second area.

As described above, since the first image including the first reflection pattern is an image of the first area acquired in the vertical direction of the first object or in the vertical direction of the first area, the first reflection pattern includes a plurality of dots at regular intervals. It can represent a pattern arranged in.

On the other hand, since the second image including the second reflection pattern is acquired in a direction inclined with respect to the vertical direction, the second reflection pattern represents a pattern in which a plurality of dots are arranged at different intervals as shown in FIG. 3B. I can.

In this case, the spacing of the pair of dots included in the plurality of dots of the first reflective pattern is compared with the spacing of the corresponding pair of dots included in the plurality of dots constituting the second reflecting pattern. And a difference between the second reflection pattern may be determined. For example, it can be seen that the spacing between the plurality of dots close to the direction in which the image was acquired (e.g., five dots at the bottom in FIGS. 3A and 3B) is relatively small between the first and second reflection patterns. have. On the contrary, it can be seen that the spacing of the plurality of dots far from the direction in which the image was acquired (eg, the upper five dots in FIGS. 3A and 3B) is relatively large between the first reflection pattern and the second reflection pattern. I can. A pair of dots whose spacing is measured can be paired in various directions such as back and forth, sideways, and diagonal directions based on the direction in which the image was acquired. The relative difference (i.e., the comparison result) of the spacing between the corresponding pairs between the first and second reflection patterns determines the distance between the first area and the electronic device 100, or determines the distance between the first area and the second area. It can be used to measure the distance to an object in or to a point.

Specifically, a difference in spacing between a plurality of dots of the first reflection pattern and the second reflection pattern may represent a relative difference between the first image and the second image. In this case, the relative values may be used to obtain an absolute value representing the distance by additionally using an angle difference between the direction in which the first image is acquired and the direction in which the second image is acquired. Accordingly, a distance between the first area and the electronic device 100 or an actual distance to an object or a point on the first area or the second area may be calculated. This angle difference may be determined by obtaining the angle of the electronic device 100 at the time when the first image is acquired and the angle of the electronic device 100 at the time when the second image is acquired, respectively, by the angle sensor unit 160. . Here, the angle of the electronic device 100 when the first image is acquired may be referred to as the first acquisition angle, and the angle of the electronic device 100 when the second image is acquired may be referred to as the second acquisition angle. I can.

Accordingly, a distance between the first region and the electronic device may be determined using a difference between the first and second photographing angles and a comparison result of the first and second reflection patterns. In addition, by using the difference between the first and second photographing angles and the comparison result of the first and second reflection patterns, the first object (for example, a golf ball) and the second A distance between objects (eg, a hole existing on a golf green) may be determined. However, the present invention is not limited thereto, and distances of various objects may be determined in various ways.

Referring to FIG. 4, a method for explaining a method of correcting a second reflection pattern and a third reflection pattern is described.

As described above, the first depth information of the second area acquired from the third image may be depth information in a state inclined with respect to the ground because the third image is acquired in a direction inclined from the vertical direction of the first area. Therefore, since it is advantageous in terms of the computational amount and accuracy of the algorithm to generate the curvature expression image using depth information in the vertical direction, the first depth information is depth information corresponding to the vertical direction of the second area (hereinafter, the second depth Information).

Referring to FIG. 4A, a second reflective pattern 200 generated by a first structured light pattern and a third reflective pattern 300 generated by a second structured light pattern are shown together.

According to some embodiments of the present disclosure, a first compensation value for matching the second reflection pattern with the first reflection pattern may be determined based on a distance between the first region and the electronic device 100. As will be readily understood by those skilled in the art, the distance between the first area and the electronic device 100 may include the height of the electronic device 100 from the ground.

The distance between the first area and the electronic device 100 may be used to determine a first compensation value for matching the second reflection pattern with the first reflection pattern together with a difference between the first acquisition angle and the second acquisition angle. Here, the first compensation value may include values for matching with the pattern (eg, the first reflection pattern) when the second reflection pattern is obtained in the vertical direction of the second area.

Referring to FIG. 4A, a plurality of directions 210 in which a plurality of dots forming a second reflection pattern are corrected by a first compensation value are displayed. Referring to FIG. 4B, it can be seen that the second reflective pattern is matched with the first reflective pattern, so that a plurality of dots are arranged at regular intervals.

In the same way, the first compensation value can be used to correct the third reflection pattern. In FIG. 4B, a plurality of directions 310 in which a plurality of dots forming a third reflection pattern are corrected by a first compensation value are displayed. In this case, the third reflection pattern may be corrected according to a method of matching with the first reflection pattern of the first reflection pattern. Accordingly, as shown in FIG. 4C, the third reflection pattern may be corrected as a reflection pattern obtained in the vertical direction of the second area.

When the third reflection pattern is corrected, first depth information including depth information values of a plurality of dots included in the third reflection pattern may also be corrected. For example, depth information of each of the plurality of dots included in the third reflection pattern may have depth information modified to correspond to the plurality of dots of the corrected third reflection pattern. Here, the modified depth information may be depth information when the third reflection pattern is acquired in the vertical direction of the second area, and the depth information may be included in the second depth information of the second area.

According to some embodiments of the present disclosure, the controller 130 may use the image acquired through the first structured light sensor unit 151 and the image acquired through the second structured light sensor unit 152 to obtain bending information. It is possible to create a curvature expression image to include. Specifically, as described above, the controller 130 may determine a first compensation value through the first image and the second image acquired through the first structured light sensor unit 151. In this case, the controller 130 may correct the position and first depth information of the plurality of dots of the third reflection pattern by using the first compensation value. Specifically, as illustrated in FIG. 4C, a plurality of dots of the third reflective pattern may be moved to a position that can be obtained in the vertical direction of the second area according to the first compensation value. In addition, the plurality of dots of the third reflection pattern moved to the corrected position may have second depth information that can be obtained in the vertical direction of the second area by correcting the first depth information. In this case, the position and second depth information of the plurality of dots of the corrected third reflection pattern may be used to generate a curvature expression image.

According to some embodiments of the present disclosure, the first object may be a golf ball, and the second object may be a hole existing on a golf green. In this case, the valley representation image may represent a part of the topography of the golf green indicated by the position of the golf ball and the hole existing on the golf green.

According to some embodiments of the present disclosure, the controller 130 may generate a recommended golf putting line. Since the location of the golf ball and the location of the hole existing on the golf green can be displayed on the goal curve expression image, a recommended golf putting line between the golf ball and the hole can be generated using the curve information of the curve expression image.

In detail, the control unit 130 displays the position of the golf ball and the position of the hole on the golf green on the curvature expression image, and after performing a simulation using a known putting trajectory material property simulation method, the recommended golf putting line Can generate information. For example, the method of simulating the physical properties of the putting trajectory is as follows.

In general, the simulation of the physical properties of the putting trajectory is performed using the principle of force.The force applied when hitting the golf ball, the static friction applied between the golf ball and the green, and the translation friction and rotational friction generated when the golf ball rolls. It is distinguished by friction), and the position of the ball (latitude, longitude, altitude) relative to the time axis can be calculated through a numerical analysis method taking into account the gravity generated according to the slope of the green. At this time, if the minimum speed and maximum speed for the golf ball to enter the hole cup are designated in advance, the golf ball can enter the hole cup while drawing different trajectories according to the strength of the putting strike.

In addition, since the golf ball after the hit is pushed, but proceeds while rotating, the golf ball is initially pushed by the hitting method, and then rotated by the frictional force and gravity of the green and can move. On the other hand, the golf ball by the rolling hitting method can rotate and rebound sensitively to the inclination due to the initial rotation. Therefore, the trajectory by the hitting hitting method and the trajectory by the rolling hitting method have different shapes, and each trajectory is determined according to the hitting method, so that a putting trajectory physical property simulation can be performed. The putting trajectory physical property simulation may be repeated, for example, until at least one trajectory acquires a predetermined accuracy. The trajectory obtained by obtaining the predetermined accuracy may be generated as recommended golf putting line information.

According to some embodiments of the present disclosure, the display unit may display an image in which the curve expression image and the recommended golf putting line are joined. In this case, the user may be provided with a curvature expression image and a recommended golf putting line displayed on the display unit of the electronic device 100.

According to some embodiments of the present disclosure, the communication unit 110 may transmit the image to which the curve expression image and the recommended golf putting line are joined to an external device. The image transmitted to the external device may be displayed on the display of the external device. For example, the external device may include a computing device including a smartphone, a smart watch, a tablet, and other display devices.

According to some embodiments of the present disclosure, the controller 130 may determine to display an area of the second area corresponding to the recommended golf putting line using RGB light. Specifically, in addition to displaying the recommended golf putting line on the display of the electronic device 100 or the external device, the controller 130 may control the components of the electronic device 100 to display the recommended golf putting line on the actual golf green. In this case, the first structured light irradiation unit 141 capable of irradiating RGB light may be used to display the recommended golf putting line on the second area. As another example, an optical projector unit (not shown) may be used to display the recommended golf putting line on the second area. In this case, the electronic device 100 may increase an effect of providing a recommended golf putting line by providing an augmented reality function.

The electronic device 100 according to some embodiments of the present disclosure can improve speed and accuracy while reducing the amount of computation by compensating for a height at which a user generates an image through the electronic device 100 in generating a curvature expression image. have. Specifically, the electronic device 100 may generate a curvature expression image with a small amount of computation by correcting depth information generated at an angle inclined with respect to the ground with depth information obtained in a vertical direction.

5 is a flowchart illustrating a method of generating a curvature representation image performed by an electronic device according to some embodiments of the present disclosure.

According to some embodiments of the present disclosure, a method of an electronic device may include steps s100 to s180 described below. However, these steps are described for illustrative purposes only, and some steps may be changed or omitted, or additional steps may be added. In addition, these steps may be performed in any order, and are not necessarily performed in the order described below.

According to some embodiments of the present disclosure, in a method for generating a curvature expression image performed by an electronic device, the first structured light corresponding to the first structured light pattern is applied to the first area and the second area through the first structured light irradiation unit 141. It may include the step of irradiating the area (s100).

According to some embodiments of the present disclosure, a method of generating a curvature expression image performed by an electronic device includes a first reflection formed by reflecting the first structured light from the first area through the first structured light sensor unit 151. A step of acquiring a first image including a pattern and a second image including a second reflection pattern formed by reflecting the first structured light in the second area (s110).

According to some embodiments of the present disclosure, a method of generating a curvature expression image performed by an electronic device irradiates a second structured light corresponding to a second structured light pattern to the second area through the second structured light irradiation unit 142 It may include a step (s120).

According to some embodiments of the present disclosure, in a method of generating a curvature expression image performed by an electronic device, a second structured light corresponding to the second structured light pattern is transmitted through the second structured light sensor unit 152 to the second area. A step (s130) of acquiring a third image including a third reflection pattern formed by being reflected from

According to some embodiments of the present disclosure, a method of generating a curvature expression image performed by an electronic device includes recognizing first depth information using the third reflection pattern through the control unit 130 (S140). can do.

According to some embodiments of the present disclosure, a method for generating a curvature expression image performed by an electronic device may include comparing the first reflection pattern and the second reflection pattern through the control unit 130 to provide the first region and the electronic device. It may include the step (s150) of determining the distance between.

According to some embodiments of the present disclosure, a method for generating a curvature representation image performed by an electronic device includes determining a first compensation value for matching the second reflection pattern with the first reflection pattern based on the distance ( s160).

According to some embodiments of the present disclosure, a method for generating a curvature expression image performed by an electronic device includes generating second depth information of the second area by correcting the first depth information according to the first compensation value ( s170).

According to some embodiments of the present disclosure, a method of generating a curvature expression image performed by an electronic device may include generating a curvature expression image including curvature information by using the second depth information (S180).

According to some embodiments of the present disclosure, the curvature expression image may be a 3D depth image corresponding to the second area generated using the second depth information of the second area.

6 is a simplified and general schematic diagram of an exemplary computing environment in which embodiments of the present disclosure may be implemented.

While the present disclosure has been described above as generally capable of being implemented by a computing device, one of ordinary skill in the art would appreciate the disclosure in combination with computer-executable instructions and/or other program modules that may be executed on one or more computers and/or of hardware and software. It will be appreciated that it can be implemented in combination.

Generally, program modules include routines, programs, components, data structures, etc. that perform particular tasks or implement particular abstract data types. In addition, to those skilled in the art, the method of the present disclosure is not limited to single-processor or multiprocessor computer systems, minicomputers, mainframe computers, as well as personal computers, handheld computing devices, microprocessor-based or programmable consumer electronics, etc. It will be appreciated that each of these may be implemented with other computer system configurations, including one or more associated devices).

The described embodiments of the present disclosure may also be practiced in a distributed computing environment where certain tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Computers typically include a variety of computer-readable media. Computer-readable media can be any computer-readable media, including volatile and nonvolatile media, transitory and non-transitory media, removable and non-transitory media. Includes removable media. By way of example and not limitation, computer-readable media may include computer-readable storage media and computer-readable transmission media. Computer-readable storage media include volatile and nonvolatile media, temporary and non-transitory media, removable and non-removable media implemented in any method or technology for storing information such as computer readable instructions, data structures, program modules or other data. Includes the medium. Computer-readable storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital video disk (DVD) or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage. Devices, or any other medium that can be accessed by a computer and used to store desired information.

Computer-readable transmission media typically implement computer-readable instructions, data structures, program modules, or other data on a modulated data signal such as a carrier wave or other transport mechanism. Includes all information delivery media. The term modulated data signal refers to a signal in which one or more of the characteristics of the signal is set or changed so as to encode information in the signal. By way of example and not limitation, computer-readable transmission media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. Combinations of any of the above-described media are also intended to be included within the scope of computer-readable transmission media.

An exemplary environment 1100 is shown that implements various aspects of the present disclosure, including a computer 1102, which includes a processing device 1104, a system memory 1106, and a system bus 1108. do. System bus 1108 couples system components, including but not limited to, system memory 1106 to processing device 1104. The processing unit 1104 may be any of a variety of commercially available processors. Dual processors and other multiprocessor architectures may also be used as processing unit 1104.

The system bus 1108 may be any of several types of bus structures that may be additionally interconnected to a memory bus, a peripheral bus, and a local bus using any of a variety of commercial bus architectures. System memory 1106 includes read-only memory (ROM) 1110 and random access memory (RAM) 1112. The basic input/output system (BIOS) is stored in non-volatile memory 1110 such as ROM, EPROM, EEPROM, etc. This BIOS is a basic input/output system that helps transfer information between components in the computer 1102, such as during startup. Includes routines. RAM 1112 may also include high speed RAM such as static RAM for caching data.

The computer 1102 also includes an internal hard disk drive (HDD) 1114 (e.g., EIDE, SATA)-this internal hard disk drive 1114 can also be configured for external use within a suitable chassis (not shown). Yes—, a magnetic floppy disk drive (FDD) 1116 (for example, to read from or write to a removable diskette 1118), and an optical disk drive 1120 (for example, a CD-ROM). For reading the disk 1122 or for reading from or writing to other high-capacity optical media such as DVD). The hard disk drive 1114, magnetic disk drive 1116, and optical disk drive 1120 are each connected to the system bus 1108 by a hard disk drive interface 1124, a magnetic disk drive interface 1126, and an optical drive interface 1128. ) Can be connected. The interface 1124 for implementing an external drive includes at least one or both of Universal Serial Bus (USB) and IEEE 1394 interface technologies.

These drives and their associated computer readable media provide non-volatile storage of data, data structures, computer executable instructions, and the like. In the case of computer 1102, drives and media correspond to storing any data in a suitable digital format. Although the description of the computer-readable medium above refers to a removable optical medium such as a HDD, a removable magnetic disk, and a CD or DVD, those skilled in the art may use a zip drive, a magnetic cassette, a flash memory card, a cartridge, etc. It will be appreciated that other types of computer-readable media, such as the ones, may also be used in the exemplary operating environment and that any such media may contain computer-executable instructions for performing the methods of the present disclosure.

A number of program modules, including the operating system 1130, one or more application programs 1132, other program modules 1134, and program data 1136, may be stored in the drive and RAM 1112. All or part of the operating system, applications, modules and/or data may also be cached in RAM 1112. It will be appreciated that the present disclosure may be implemented on several commercially available operating systems or combinations of operating systems.

A user may input commands and information to the computer 1102 through one or more wired/wireless input devices, for example, a pointing device such as a keyboard 1138 and a mouse 1140. Other input devices (not shown) may include a microphone, IR remote control, joystick, game pad, stylus pen, touch screen, and the like. These and other input devices are often connected to the processing unit 1104 through the input device interface 1142, which is connected to the system bus 1108, but the parallel port, IEEE 1394 serial port, game port, USB port, IR interface, It can be connected by other interfaces such as etc.

A monitor 1144 or other type of display device is also connected to the system bus 1108 through an interface such as a video adapter 1146. In addition to the monitor 1144, the computer generally includes other peripheral output devices (not shown) such as speakers, printers, and the like.

Computer 1102 may operate in a networked environment using logical connections to one or more remote computers, such as remote computer(s) 1148, via wired and/or wireless communication. The remote computer(s) 1148 may be a workstation, a computing device computer, a router, a personal computer, a portable computer, a microprocessor-based entertainment device, a peer device, or other common network node, and is generally connected to the computer 1102. Although it includes many or all of the components described for simplicity, only memory storage device 1150 is shown. The logical connections shown include wired/wireless connections to a local area network (LAN) 1152 and/or to a larger network, eg, a wide area network (WAN) 1154. Such LAN and WAN networking environments are common in offices and companies, and facilitate enterprise-wide computer networks such as intranets, all of which can be connected to worldwide computer networks, for example the Internet.

When used in a LAN networking environment, the computer 1102 is connected to the local network 1152 via a wired and/or wireless communication network interface or adapter 1156. Adapter 1156 may facilitate wired or wireless communication to LAN 1152, which also includes a wireless access point installed therein to communicate with wireless adapter 1156. When used in a WAN networking environment, the computer 1102 may include a modem 1158, connected to a communication computing device on the WAN 1154, or through the Internet, to establish communication over the WAN 1154. Have other means. Modem 1158, which may be an internal or external and a wired or wireless device, is connected to the system bus 1108 through a serial port interface 1142. In a networked environment, program modules described for the computer 1102 or portions thereof may be stored in the remote memory/storage device 1150. It will be appreciated that the network connections shown are exemplary and other means of establishing communication links between computers may be used.

Computer 1102 is associated with any wireless device or entity deployed and operated in wireless communication, e.g., a printer, scanner, desktop and/or portable computer, portable data assistant (PDA), communication satellite, wireless detectable tag. It operates to communicate with any device or place, and a phone. This includes at least Wi-Fi and Bluetooth wireless technologies. Accordingly, the communication may be a predefined structure as in a conventional network or may simply be ad hoc communication between at least two devices.

Wi-Fi (Wireless Fidelity) allows you to connect to the Internet or the like without wires. Wi-Fi is a wireless technology such as a cell phone that allows such devices, for example computers, to transmit and receive data indoors and outdoors, that is, anywhere within the coverage area of a base station. Wi-Fi networks use a wireless technology called IEEE 802.11 (a, b, g, etc.) to provide a secure, reliable and high-speed wireless connection. Wi-Fi can be used to connect computers to each other, to the Internet, and to a wired network (using IEEE 802.3 or Ethernet). The Wi-Fi network can operate in an unlicensed 2.4 and 5 GHz radio band, for example, at a data rate of 11 Mbps (802.11a) or 54 Mbps (802.11b), or in a product including both bands (dual band). .

Those of ordinary skill in the art of this disclosure will understand that information and signals may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols and chips that may be referenced in the above description are voltages, currents, electromagnetic waves, magnetic fields or particles, optical fields. Or particles, or any combination thereof.

A person of ordinary skill in the art of the present disclosure includes various exemplary logical blocks, modules, processors, means, circuits and algorithm steps described in connection with the embodiments disclosed herein, electronic hardware, (convenience). For the sake of clarity, it will be appreciated that it may be implemented by various types of programs or design code or a combination of both (referred to herein as software). To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the particular application and design constraints imposed on the overall system. A person of ordinary skill in the art of the present disclosure may implement the described functions in various ways for each specific application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

The various embodiments presented herein may be implemented as a method, apparatus, or article of manufacture using standard programming and/or engineering techniques. The term article of manufacture includes a computer program, carrier, or media accessible from any computer-readable storage device. For example, computer-readable storage media include magnetic storage devices (e.g., hard disks, floppy disks, magnetic strips, etc.), optical disks (e.g., CD, DVD, etc.), smart cards, and flash devices. Memory devices (eg, EEPROM, cards, sticks, key drives, etc.). In addition, the various storage media presented herein include one or more devices and/or other machine-readable media for storing information.

It is to be understood that the specific order or hierarchy of steps in the presented processes is an example of exemplary approaches. Based on the design priorities, it is to be understood that within the scope of this disclosure a specific order or hierarchy of steps in processes may be rearranged. The appended method claims provide elements of the various steps in a sample order, but are not meant to be limited to the specific order or hierarchy presented.

A description of the presented embodiments is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these embodiments will be apparent to those of ordinary skill in the art, and general principles defined herein may be applied to other embodiments without departing from the scope of the present disclosure. Thus, the present disclosure is not to be limited to the embodiments presented herein, but is to be construed in the widest scope consistent with the principles and novel features presented herein.

Claims (16)

In the electronic device,
A first structured light irradiation unit for irradiating first structured light corresponding to the first structured light pattern;
A first structured light sensor unit acquiring an image including a reflection pattern formed by reflecting the first structured light;
A second structured light irradiation unit for irradiating second structured light corresponding to the second structured light pattern;
A second structured light sensor unit acquiring an image including a reflective pattern formed by reflecting second structured light corresponding to the second structured light pattern; And
A control unit for generating a curvature expression image including curvature information using the image acquired through the first structured light sensor unit and the image acquired through the second structured light sensor unit;
Including,
The control unit,
A first image including a first reflection pattern formed by reflecting the first structured light from a first area through the first structured light sensor unit and a second reflection formed by reflecting the first structured light from a second area Obtaining a second image including the pattern,
Acquiring a third image including a third reflection pattern formed by reflecting the second structured light from the second area through the second structured light sensor unit,
Recognizing first depth information using the third reflection pattern,
Determining a distance between the first region and the electronic device by comparing the first reflection pattern and the second reflection pattern,
Determining a first compensation value for matching the second reflection pattern with the first reflection pattern based on the distance,
Generates second depth information of the second area by correcting the first depth information according to the first compensation value, and
When determining the distance, the difference between the first acquisition angle of the first image measured through the angle sensor unit and the second acquisition angle of the second image measured through the angle sensor unit, and the first reflection pattern Determining the distance using the comparison result value of the second reflection pattern,
Electronic device.
delete The method of claim 1,
The curvature expression image,
A 3D depth image corresponding to the second area generated using the second depth information of the second area,
Electronic device.
The method of claim 3,
A display unit that displays the curvature expression image; or
A communication unit that transmits the curvature expression image to an external device;
Further comprising,
Electronic device.
The method of claim 1,
The first structured light,
RGB maniac,
Electronic device.
The method of claim 1,
The second structured light,
IR maniac,
Electronic device.
The method of claim 1,
The first structured light pattern,
Is a regular dot pattern, and
The second structured light pattern,
A random dot pattern,
Electronic device.
delete The method of claim 1,
The first image,
An image of the first area obtained in a vertical direction of the first object or in a vertical direction of the first area, and
The second image and the third image,
An image of a second area including the first object and the second object acquired in a direction inclined from the vertical direction,
Electronic device.
The method of claim 1,
The second image and the third image are images acquired at the same time point,
Electronic device.
The method of claim 9,
The first object,
Is a golf ball, and
The second object,
The hole-in that exists on the golf green,
Electronic device.
The method of claim 11,
The control unit,
To create a recommended golf putting line,
Electronic device.
The method of claim 12,
A display unit that displays an image in which the curved expression image and the recommended golf putting line are joined; or
A communication unit for transmitting the image to which the curved expression image and the recommended golf putting line are joined to an external device;
Further comprising,
Electronic device.
The method of claim 12,
The control unit:
Determining to display an area of the second area corresponding to the recommended golf putting line using RGB light,
Electronic device.
In the method of generating a curvature expression image performed by an electronic device,
Irradiating the first structured light corresponding to the first structured light pattern to the first area and the second area through the first structured light irradiation unit;
A first image including a first reflective pattern formed by reflecting the first structured light from the first area through a first structured light sensor unit, and a second image including a first reflecting pattern formed by reflecting the first structured light from the second area Obtaining a second image including a reflective pattern;
Irradiating a second structured light corresponding to a second structured light pattern to the second area through a second structured light irradiation unit;
Acquiring a third image including a third reflective pattern formed by reflecting second structured light corresponding to the second structured light pattern from the second area through a second structured light sensor unit;
Recognizing first depth information using the third reflection pattern through a control unit;
Determining a distance between the first region and the electronic device by comparing the first reflection pattern and the second reflection pattern through the control unit;
Determining a first compensation value for matching the second reflection pattern with the first reflection pattern based on the distance; And
Generating second depth information of the second area by correcting the first depth information according to the first compensation value;
Generating a curvature expression image including curvature information using the second depth information;
Including,
The step of determining a distance between the first region and the electronic device by comparing the first reflection pattern and the second reflection pattern through the control unit,
Measuring a first acquisition angle of the first image and a second acquisition angle of the second image through an angle sensor included in the electronic device; And
Determining the distance by using the difference between the first acquisition angle and the second acquisition angle and a comparison result of the first reflection pattern and the second reflection pattern through the control unit;
Containing,
How to create a curvature representation image.
The method of claim 15,
The curvature expression image,
A 3D depth image corresponding to the second area generated using the second depth information of the second area,
How to create a curvature representation image.

Images