KR101940736B1 - Sketch smart calculator - Google Patents

Abstract

The present invention derives the actual model (building, obstacle, topography, shape) of the photographed image based on the photographed image and the photographed distance as well as the computation capability of the existing calculator and determines the length, height, The present invention provides a sketch smart calculator capable of calculating a size and calculating a size without depending on a computer recognition format as if it is handwritten using a handwriting on the screen. An image detection unit for detecting a target model to be selected through a sketch using a user's electronic pen in the original image taken by the photographing unit; A distance calculating unit for calculating an actual distance of the object model detected by the image detecting unit, Based on the actual distance calculation based on the distance calculation unit length of the selected target model, and is composed by comprising a size calculation model for calculating the actual size including the height.

Description

Sketch smart calculator {Sketch smart calculator}

The present invention relates to a smart calculator, and more particularly to a smart calculator that derives an actual model (building, obstacle, topography, shape) of a photographed image based on not only computation capability of an existing calculator but also photographed image and photographed distance, The present invention relates to a sketch smart calculator capable of calculating a size such as a length, a height, and a width, and can calculate a size regardless of a computer-recognized format, such as handwriting using a handwriting on a screen.

People may encounter many new objects and objects as they live, and sometimes they want to know the length, height, and width of these objects and objects. For example, you may want to know the actual size when buying living things such as furniture and desks, or you want to know the height of a building on the street.

In the case of furniture or a desk, the size of the actual size can be known by asking the staff. However, if you want to know the size of the display in the shop window, if there is no staff, Often there is no. In addition, in the case of household goods other than furniture, there are cases in which the size is not described, and therefore, many objects can not be identified without resizing them. On the other hand, there are times when the height of the building in the street is curious. Because the size of the building differs according to the perspective, it is difficult to judge the approximate height by the naked eye, and it is inconvenient to ask the manager the height.

To solve this inconvenience, it seems possible to use a portable terminal. In other words, along with the rapid development of mobile phones in recent years, the mobile phone has a built-in sensor for indicating the camera and its direction, angle, tilt, acceleration, and illumination. When these sensors are applied, various services can be provided through a mobile phone. For example, when a mobile phone camera is shot toward a specific object, an angle through which the mobile phone is facing can be confirmed using an application program.

There is a possibility that the application program and the camera provided in the portable terminal can be utilized variously in the size measurement method.

However, a method of measuring the actual size and height of an object using a camera and a sensor provided in a mobile phone has not yet been developed and provided, and the length, height, and width of the object or object If you want to know the size, you can not solve it.

Patent Registration No. 10-0121760 (registered on August 29, 1997) Patent Registration No. 10-1074678 (registered on October 12, 2011) Japanese Patent Application Laid-Open No. 10-2013-0022831 (publication date 2013.03.07)

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide an image processing apparatus and method, which can extract an actual model (a building, an obstacle, a topography, a shape) of a photographed image based on not only the calculation capability of a conventional calculator but also a photographed image and a photographed distance , The size of the derived model, such as length, height, and width, and also provides a sketch smart calculator that can calculate the size regardless of the computer-recognized format as if it were handwritten using handwriting on the screen. There is a purpose.

It is another object of the present invention to provide a sketch smart calculator that can calculate not only the length, height, and width of a derived model, but also a number using a model to calculate by arithmetic operation.

Other objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

According to another aspect of the present invention, there is provided a sketch smart calculator comprising: a photographing unit that photographs a model to be measured using a camera to generate an original image; A distance calculating section for calculating an actual distance from the photographing section to a target model photographed; a distance calculating section for calculating a distance between the target model and the distance detected by the image detecting section; And a model size calculating unit for calculating an actual size including the length and height of the selected object model based on the actual distance calculated by the calculating unit.

Preferably, the sketch smart calculator further comprises an image correcting unit for correcting distortion and sharpness of the original image photographed based on the weather or the temperature photographed through the photographing unit through an average value correction of an edge range.

Preferably, the image detecting unit includes a selection line detecting unit that selects a line of a target model selected by a user through a sketch using the electronic pen on a screen of the portable terminal displaying the original image photographed by the photographing unit, A virtual line detecting unit for generating a plurality of imaginary straight lines having an interval to intersect with each other and detecting one virtual line overlapping or neighboring a line of the target model selected by the selected line detecting unit among the generated virtual lines; An edge detection unit for detecting only an edge area in an original image photographed by the image pickup unit; and an edge detection unit for detecting a line of the selected target model, an overlapping or neighboring one virtual line and an edge area of the original image, A matching processing unit, and a matching processing unit The lines are connected to is characterized in that the model consists of a detector for detecting a target model.

Preferably, the distance calculating unit compares the distance between the photographing unit and the target model with the previously stored reference distance based on the image size of the target model detected by the image detecting unit and the focal distance of the photographing unit to select a module for distance calculation A GPS module that is selected when the target model exists at a distance longer than the reference distance by the module selection unit and detects the current position of the photographing unit and the target model through the GPS information; A sensor unit which is selected when there is a target model at a distance and detects the time of returning the laser emitted from the photographing unit; a current position information of the photographing unit and the target model detected by the GPS module; The actual distance from the photographing unit to the photographed target model is calculated And a re-calculation section.

Preferably, the distance calculating unit measures a distance between two object models and calculates an actual distance between the object model and the photographing unit based on the actual distance between the photographing unit and the model that knows the actual distance based on the distance between the two measured models. In this case, the distance between the two object models is calculated by plotting straight lines parallel to the two object models at regular intervals from top to bottom, and calculating the average of the longest interval between the longest maximum value and the shortest minimum value .

Preferably, when calculating the target model size using the movement distance detected by the GPS module, the model size calculator calculates the size of the target model captured before the forward movement, The actual size (height) of the target model is calculated by assigning the size change of the photographed target model to the ratio of the fixed distance traveled and divided by the ratio, and when the return time detected by the sensor unit is used, Calculating a height from a measured vertical position in the photographing unit through a trigonometric function based on the measured angle and the distance measured through the sensor unit, To calculate an actual size (height) of the object model.

The sketch smart calculator according to the present invention as described above has the following effects.

First, the distance between the camera and the camera is measured, and the actual size of the photographed object is calculated using the characteristics of the camera and the measured values, and the length, height, Can quickly and easily measure the exact physical model of the object.

Second, the length (height, width) of an object to be measured can be easily selected by designating or describing a photographed object as if it is handwritten on a portable terminal, so that it is possible to more conveniently and accurately set the object or range to be measured.

Third, it can be used as an optimized design tool because more accurate calculation can be performed considering the influence of weather and temperature when detecting captured images.

1 is a block diagram showing the configuration of a sketch smart calculator according to an embodiment of the present invention;
FIG. 2 is a block diagram showing the configuration of the image detecting unit in FIG. 1 in detail;
FIG. 3 is a block diagram showing in detail the configuration of the distance detecting unit in FIG.
4 is a view for explaining a method of measuring a distance between two objects in the distance detecting unit of FIG. 3;
FIG. 5 is a view for explaining a method of calculating a slope of a terrain slope when the model is a terrain in the model size calculating unit of FIG. 1;
6A to 6C are views for explaining an embodiment using a screen displayed on a portable terminal to which an actual size of a target model measured in the model size calculating unit of FIG. 1 is applied

Other objects, features and advantages of the present invention will become apparent from the detailed description of the embodiments with reference to the accompanying drawings.

A preferred embodiment of a sketch smart calculator according to the present invention will be described with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. It is provided to let you know. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention and are not intended to represent all of the technical ideas of the present invention. Therefore, various equivalents It should be understood that water and variations may be present.

1 is a block diagram showing a configuration of a sketch smart calculator according to an embodiment of the present invention.

1, the sketch smart calculator of the present invention includes a photographing unit 100 that photographs a model to be measured using a camera and generates an original image, An image detector 200 for detecting a target model to be selected by a user through a sketch using an electronic pen,

A distance calculating unit 300 for calculating an actual distance from the photographing unit 100 to a photographed object model, and an actual distance calculated by the distance calculating unit 300 and the object model detected by the image detecting unit. And a model size calculation unit 400 for calculating an actual size including the length, height, and the like of the selected target model.

In this case, the sketch smart calculator of the present invention further includes an image correcting unit 500 for correcting the distortion and sharpness of the original image photographed based on the weather or temperature photographed through the photographing unit 100 through an average value correction of the edge range . The average value correction of the edge range derives an edge area from the original image. If the edge area (width) of the derived edge exceeds a predefined range, the average value of the edge range is calculated and the edge range is reduced to a certain range .

As shown in FIG. 2, the image detecting unit 200 may display a sketch of a portable terminal (smart phone, tablet PC, etc.) on which an original image photographed by the photographing unit 100 is displayed, A selection line detecting unit 210 for selecting a line of the selected target model; a plurality of virtual straight lines having a predetermined interval from the original image taken by the photographing unit 100 so as to intersect with each other; A virtual line detection unit 220 for detecting one of the virtual lines overlapping or neighboring with a line of the selected model in the selected line detection unit 210, and a virtual line detection unit 220 for detecting only an edge area in the original image picked up by the photographing unit 100 A line of the selected target model, one overlapping or neighboring virtual line, and an edge area of the original image are compared with each other Chapter is composed of the matching processing unit 240, and a model detection portion 250 for detecting a target model by connecting the virtual line detected by the matching processing unit 240 for detecting a virtual line which is located close to.

3, the distance calculating unit 300 calculates the distance between the photographing unit 100 and the object 100 based on the image size of the object model detected by the image detecting unit 200 and the focal length of the photographing unit 100. [ A module selection unit 310 for selecting a module for distance calculation by comparing a distance to a model with a previously stored reference distance, and a module selection unit 310 for selecting, when there is a target model at a distance longer than a reference distance, A GPS module 320 for detecting the current position of the target model and GPS module 300 for selecting a target model at a distance shorter than a reference distance from the module selection unit 310, A sensor unit 330 for detecting the time of returning the laser beam emitted from the sensor module 330 to the sensor module 330, a current position information of the photographing module 100 and the target model detected by the GPS module 320, One of the return times And a distance calculation unit 340 for calculating an actual distance from the photographing unit 100 to a photographed target model. For reference, the reference distance may be a distance at which the sensor unit 330 can stably detect the target model.

At this time, the distance calculation unit 340 calculates the distance using the sensor unit 330 when the object is close enough to be recognized by the sensor, and calculates the distance using the GPS information when the object is far away. The current position information of the target model is detected and the distance is calculated. When using the GPS module 320, the target model can be used when the GPS image is displayed. If the target model is not displayed on the GPS image, And the actual distance between the target model and the photographing unit 100 is measured based on the measured distance.

As a method for measuring the distance between the two object models, as shown in FIG. 4, a straight line parallel to the two object models 10 and 20 for the accuracy of distance between the two object models 10 and 20 Marked from top to bottom at regular intervals. Then, an average of the longest and shortest minimum values of the intervals between the angles is calculated, and based on the actual distance between the photographing unit 100 and the model, 100) and the target model. This can be used not only when using the GPS module 320, but also when measuring the distance between the two object models 10 and 20 using the sensor unit 330.

When the target model size is calculated using the movement distance detected by the GPS module 320, the model size calculation unit 400 advances a predetermined distance (20 cm) straight toward the target model and then stops, The actual size of the target model can be calculated by assigning the size of the target model and the size change of the target model taken after the forward to the ratio of the shifted constant distance and dividing the ratio.

When the return time detected by the sensor unit 330 is used, the model size calculation unit 400 may measure a horizontal angle between the photographed measurement point and the ground, and measure the angle between the measured angle and the sensor unit 330 (Height) from the photographing unit 100 to the measurement point through the trigonometric function based on the measured distance from the photographing unit 100, and adds the heights at the input ground to calculate the actual size .

Various embodiments that can be used by using a configuration for measuring an actual size of a target model using the sketch smart calculator according to the present invention will be described as follows.

First Embodiment

In the first embodiment, a description will be given of obtaining the area and area of a building when the object model to be measured is a building.

6A to 6C, when the actual size including the length, height, and the like of the building, which is a target model, is calculated in the model size calculating unit 400, the screen size of the portable terminal (smartphone, tablet PC, etc.) The area (area) of the target building is calculated by assigning a numerical value of an actual size to a specific formula through a sketch using the electronic pen by the user.

At this time, if the specific formula is displayed on the screen of the portable terminal by the user's selection of the "simple calculation mode" for the four-ary operation calculator program, the user can use the provided formula calculator, And the area (area) of the area.

Alternatively, if the user selects the "mode for each theme" after storing the specific formula in the storage unit in advance according to the theme, the specific formula stored in advance in the storage unit according to the theme is displayed, When you select a formula, the specific formula selected on the screen is displayed. Thus, the user can directly record the actual size values measured through the sketch using the electronic pen in the specific formula displayed, or move the numerical value through the dragging to place the input position corresponding to the specific formula displayed on the screen, Area (area), etc. are calculated. In this case, the theme stored in the storage unit can be determined in various ways such as architecture, building, bank, physics, mathematics, etc., and a user can create a theme and store it newly. It is also possible.

Alternatively, if the area (area) of the target model is calculated in advance, the selected pattern is stored in the storage unit according to the pattern or form of the calculated target model, and then the user selects the " Detect and display an existing model that matches at least a certain percentage (70%) of the pattern or shape of the measured target model among the information. Therefore, when the user selects an available model among the existing models displayed on the screen, the specific formula used when the area (area) of the corresponding model is calculated is displayed on the screen. Then, after correcting the part of the specific formula shown that needs to be corrected, the actual size measured by the sketch using the electronic pen may be directly written in the specific formula shown, or the numerical movement by dragging may correspond to the specific formula displayed on the screen The area (area) of the target building is automatically calculated.

Second Embodiment

In the second embodiment, description will be given of finding the form of the terrain when the target model to be measured is a terrain or a shape.

5, when the distance and size of the target model, that is, the target model, are calculated, the laser size of the laser used in the sensor unit 330 within a certain range of the calculated size of the terrain, Calculate each return time. Then, the tilt angle of the target model is calculated through the respective distances using the return time.

When the model size calculating unit 400 calculates the distance and size of the terrain and the shape, it takes three arbitrary points through a sketch using the electronic pen based on the calculated terrain, connects the three segments connecting the three points Calculate the angle of the included angle connecting the three points.

Third Embodiment

In the third embodiment, the target model to be measured is an automobile, and is used to provide a maintenance estimate due to an accident.

First, when the length, area, and shape of the vehicle are calculated according to the accident area of the vehicle, which is a target model, the model size calculator 400 stores the price and the repair cost for each part in the storage unit in advance. And detects a part and a part that match with a photograph stored in the storage unit. Then, the price of the target model is calculated using the detected information, and the calculated price is transmitted to the user. At this time, the price of each object stored in the storage unit can be modified or the price can be specified as a percentage.

Accordingly, when a car accident occurs, a photograph is taken, the maintenance price for the part is measured, and the information is displayed on the screen of the portable terminal of the user.

Fourth Embodiment

In the fourth embodiment, the measured object model is a product or restaurant menu.

First, when the length, area, and shape of a product menu or a restaurant menu, which is a target model, are calculated in the model size calculating unit 400, And detects a matching commodity or a restaurant menu in comparison with the photograph stored in the shop. Then, the price of the target model is calculated using the detected information, and the calculated price is transmitted to the user. At this time, it is possible to find objects and simultaneously calculate multiple objects at the same time.

Accordingly, when a photograph is taken of a bowl in a restaurant, a price is inputted and stored in a storage unit, a user takes a picture of the bowl he or she has consumed, and the price of the bowl is measured and displayed on the portable terminal. Likewise, it can be utilized in the calculation of Mart.

Accordingly, when a car accident occurs, a photograph is taken, the maintenance price for the part is measured, and the information is displayed on the screen of the portable terminal of the user.

Fifth Embodiment

In the fifth embodiment, the case where the object model to be measured is a paper receipt is used.

First, when the target model is a receipt in the model size calculation unit 400, the distance and size between the number and the number displayed on the receipt are calculated, and the corresponding number can be recognized using the distance and the size of the calculated number .

When the recognized number is displayed on the screen of the portable terminal of the user, the user displays a calculator on the screen of the portable terminal through the selection of the "simple calculation mode" for the four-way calculator program.

Accordingly, the user can easily calculate the usage amount displayed on the receipt by using the number and the calculator displayed on the screen of the portable terminal of the user.

The amount of usage thus calculated allows the user to calculate the amount of usage calculated in the bank balance in response to the user's bank balance. At this time, in order to apply the bank balance, it is necessary to perform bank login in advance to enable login at all times.

Sixth Embodiment

In the sixth embodiment, the velocity is calculated using the distance of the target model measured by the model size calculation unit 400. [

First, the model size calculator 400 stores the distance of the measured target model, measures the distance of the target model after a few seconds (1 second).

Then, when the measured object model proceeds along the horizontal axis, the traveling distance is calculated, and the velocity of the object model is calculated based on the distance with time. When the measured object model proceeds in the front or diagonal direction, the travel distance measured using the sensor unit 330 or the GPS module 320 is calculated, and the speed of the object model is calculated based on the distance with time .

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. It will be apparent to those skilled in the art that various modifications may be made without departing from the scope of the present invention. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

Claims (6)

A photographing unit for photographing a model to be measured using a camera to generate an original image;
A selection line detection unit for selecting a line of a target model selected by a user through a sketch using the electronic pen on a screen of the portable terminal displaying the original image photographed by the photographing unit; A virtual line detection unit for generating virtual line lines so as to intersect with each other and detecting one virtual line overlapping or neighboring the line of the target model selected by the selected line detection unit among the generated virtual lines; An edge detector for detecting only an edge area in the image; a matching processor for detecting a nearest virtual line by comparing the line of the selected target model, one overlapping or neighboring virtual line and the edge area of the original image, The virtual line detected by the matching processing unit is connected to the target model And the image detector which includes a model ship detection,
A distance calculating unit for calculating an actual distance from the photographing unit to a photographed target model,
The actual size including the length and height of the selected target model based on the target model detected by the image detector and the actual distance calculated by the distance calculator is calculated and the target model size , The size of the target model photographed before the forward movement and the size change of the target model captured after the forward movement are assigned to the ratio of the constant moving distance and divided by the ratio And a model size calculating unit for calculating an actual size (height) of the target model by using the sketch smart calculator. The method according to claim 1,
Wherein the sketch smart calculator further comprises an image correcting unit for correcting distortion and sharpness of an original image photographed based on weather or temperature photographed through a photographing unit through an average value correction of an edge range. delete The apparatus as claimed in claim 1, wherein the distance calculating unit
A module selecting unit for selecting a module for distance calculation by comparing the distance between the photographing unit and the target model with the previously stored reference distance based on the image size of the target model detected by the image detecting unit and the focal distance of the photographing unit,
A GPS module that is selected when there is a target model at a distance longer than the reference distance in the module selection unit and detects a current position of the photographing unit and the target model through the GPS information;
A sensor unit which is selected when the target model exists at a distance shorter than the reference distance by the module selection unit and detects a time when the laser beam emitted from the photographing unit returns;
A distance calculator configured to calculate an actual distance from the photographing unit to a photographed target model using any one of the current position information of the photographing unit and the target model detected by the GPS module and the return time detected by the sensor unit Lt; / RTI > 5. The method of claim 4,
The distance calculating unit measures the distance between two object models and calculates the actual distance between the object model and the photographing unit based on the actual distance between the photographing unit and the model that knows the actual distance based on the distance between the two measured models,
In this case, the distance between the two object models is calculated by plotting straight lines parallel to the two object models at regular intervals from top to bottom, and calculating the average of the longest interval between the longest and shortest minimum values. A sketch smart calculator. The apparatus of claim 4, wherein the model size calculation unit
When the return time detected by the sensor unit is used, the angle between the photographed measurement point and the horizontal plane on the ground is measured. Based on the measured angle and the distance measured through the sensor unit, Calculates the height to the measurement point, and adds up the heights at the input paper surface to calculate the actual size (height) of the target model.

Images