KR101780207B1 - Apparatus for image based cherry blossoms observing and method by using the same - Google Patents

Abstract

The present invention relates to an apparatus for observing a cherry blossoms and a method thereof. The present invention observes the germination, flowering and full blooming of cherry blossoms based on an image of specific target trees and habitats so as to inform the progress degree of cherry blossoms in famous places in spring, thereby improving the convenience of tourists, helping to promote tourist detention, and reducing traffic congestion by dispersing tourists.

Description

[0001] APPARATUS FOR IMAGE BASED CHERRY BLOSSOMS OBSERVING AND METHOD BY USING THE SAME [0002]

The present invention relates to an apparatus and method for observing cherry blossoms based on images, and more particularly, to a method of observing cherry blossoms by germinating, blooming, or blooming of cherry blossoms based on images of a specific target tree or habitat The present invention relates to a device and method for observing cherry blossoms based on images, which can help attract tourists to scenic spots and reduce traffic congestion by dispersing travelers.

At present, weather-related organizations are observing the change of seasons and observing the degree of flowering of plants, and observing climate change trends by statistical analysis of observation data.

In recent years, as more people have more leisure time, the demand for detailed information about cherry blossoms, which are representative of spring outings, is increasing. There is a limitation in providing detailed information such as blooming cherry blossoms and blooming of famous places.

In particular, when we look at the analysis data of the research institute recently, we analyzed the interest of the people in spring. It is also noteworthy that this interest in spring cherry blossoms has been mentioned among people through blogs rather than news and Twitter. The cherry blossoms are the most popular among the many spring-related sites mentioned in these blogs.

In addition, the main issues related to cherry blossoms in spring are analyzed. The major issues related to cherry blossoms are as weather forecasts, parking lots, safety accidents, rain, theme resting places, cherry blossom photos, spring festivals, and field trips. Especially, many people showed the weather forecast together with the spring cherry blossom viewing. In addition to mountain climbing and outing, related safety accidents are also a big issue. In addition, since many congestion occurs on the highway during the cherry blossom season, it is necessary to provide information on cherry blossoms in various places to disperse the travelers, to reduce regional variation, and to provide information on new sightseeing spots.

Recently, there is a growing need to provide more accurate and more detailed status information (eg, cherry blossoms) in order to distribute tourists locally in order to meet citizens' right to know and go out for seasons. In addition, local governments where tourist attractions are located are able to create new added value by promoting information on local tourist attractions in real time, and this need is increasing.

Therefore, according to the present invention, it is possible to improve the convenience of travelers by observing the progress of cherry blossoms in famous places in spring, to help attract tourists to tourist spots, and to reduce traffic congestion by dispersing travelers by providing information of cherry trees We propose an image based cherry blossom observation system and its method.

Next, a brief description will be given of the prior arts that exist in the technical field of the present invention, and technical matters which the present invention intends to differentiate from the prior arts will be described.

Korean Patent Laid-Open No. 10-2005-0039441 (Mar. 29, 2005) discloses a method for providing and acquiring a comprehensive support for travel by a two-way communication network, a communication system thereof, and a program, When the user designates a desired earth, the photograph screen is transmitted. A photograph of the season landscape can be displayed on a screen by selecting a landscape of four seasons or a current season landscape. In addition, if the current landscape photographed by the photographer on the mobile phone by the travel consumer is imported into the database device as tourist facility information by posting and released, the seasonal scenery can be viewed in a more real- Is disclosed.

However, according to the prior art, only the seasonal scenery can be seen by showing the image information previously prepared by the traveler or the system to the traveler, and the convenience of the traveler can be improved by observing the progress of the cherry blossom in the famous spot in spring as in the present invention And does not provide a technical structure that will help tourists to attract tourists.

Therefore, by observing and providing cherry blossom information in the spring through the present invention, it is possible to improve the convenience of travelers, to help tourists in sightseeing spots, and to reduce the traffic congestion by dispersing travelers, .

The present invention has been made in order to solve the above problems, and it is an object of the present invention to provide a method and apparatus for analyzing the shape and color of a particular target tree or habitat of a famous place, And a method for observing a cherry blossom based on the distribution of the cherry blossoms, and a method for observing the cherry blossoms based on images.

The present invention aims to improve the convenience of travelers by informing the degree of progress of cherry blossoms at famous places in spring by observing the germination, flowering and full blooming of cherry blossoms based on images of specific target trees and habitats, And to provide a cherry blossom observing apparatus and a method thereof that can reduce the traffic congestion by dispersing the travelers and helping to attract tourists.

It is another object of the present invention to provide an image-based cherry blossom observing apparatus and method, which can predict the progress of cherry blossoms by further reflecting current weather or environmental conditions.

The present invention relates to a device for observing cherry blossoms based on images that can accurately estimate the progress of cherry blossom through observations of cherry blossoms and can predict the progress of cherry blossoms based on information on the rate of progress of cherry blossoms according to the weather, It is another object to provide a method.

An image-based cherry blossom observing apparatus according to an embodiment of the present invention includes a shape analyzing unit for confirming a shape of a flower or a flower in a branch of an observation target of a cherry blossom image photographed by a camera; A color analyzer for checking the colors of flowers and flowers identified above; And determining a germination of the flower bud and a flowering of the flower based on the identified color, and determining a germination, flowering and full bloom of the bloom based on the germination rate of the flower bud and the flowering rate of the flower .

The cherry blossom observation apparatus includes a cherry blossom image management unit for managing cherry blossom images received from the camera through a communication unit for each region; And a storage management unit for storing the cherry blossom image and the state information of the cherry blossom determined by the cherry blossom state determination unit in each region and storing the divided information in a database.

The cherry blossom observing apparatus may further include an additional information managing unit for managing provision of additional information including weather information, traffic information, convenience facilities, or a combination thereof expected according to the traveling speed of the cherry tree.

The morphological analysis unit may include an area dividing unit for dividing the observation target tree and the background from the cherry blossom image taken by the camera; A Histogram of Oriented Gradient (HOG) processing unit for separating flower buds and flowers from the separated observation branches; And a position correcting unit for correcting the position of the separated observation target branches and confirming the positions of the flowers and flowers.

The color analyzing unit may be configured to perform a color analysis on the basis of RGB (Red, Green, Blue), Hue, Saturation, Value, Hue, Saturation, Lightness, Commission Internationale de l'Eclairage, ), Or CMYK (Cyan, Magenta, Yellow, K (Black)).

The cherry state determining unit determines the germination state when the flower bud germinated out of the total flower buds determined from the observation target tree branches is 20% or more, and determines the flower buds of the flowers identified in one object (a bundle of buds) If the number of flowers is three or more, it is determined to be in the flowering state, and it is determined that flowers are bloomed in a full bloom state when flowers are observed in 80% or more of the whole flower buds of the observers.

The cherry blossom observing apparatus may include information on whether or not the cherry blossoms will progress in the future according to the weather condition of the place where the cherry blossom image was photographed, and may provide information including cherry blossom observation, cherry blossom prediction, or a combination thereof.

According to another aspect of the present invention, there is provided a method of observing cherry blossoms based on an image, the method comprising: a shape analysis step of confirming a flower shape and a flower shape in a branch of an observation target of a cherry blossom image photographed by a camera; A color analysis step of confirming the colors of flowers and flowers identified above; And confirming the germination of the flower bud and the flowering of the flower based on the identified color and determining the germination, flowering and full bloom of the cherry blossom based on the confirmed germination rate of the flower bud and the flowering rate of the flower .

The cherry blossom observing method includes: a cherry blossom image managing step of managing a cherry blossom image provided by the camera according to each region; And storing the cherry blossom image and the state information of the cherry blossom determined in the cherry blossoming state determination step in each region and storing the divided information in a database.

The method of observing the cherry blossom may further include providing additional information including weather information, traffic information, convenience facilities, or a combination thereof expected according to the traveling speed of the cherry blossom.

The shape analysis step may include a region separation step of separating a tree branch and a background from a cherry tree image taken by a camera; A HOG processing step of separating flower buds and flowers from the above-mentioned separated observation target branches; And a position correcting step of correcting the position of the separated observation target branches and confirming the positions of flowers and flowers.

The cherry state determination step determines the germination state if the flower bud germinated out of the total flower buds identified in the observation target tree branches is 20% or more, and determines the flower buds identified in one object (a bundle of buds) Is determined to be in the flowering state when the number of flowers is three or more, and it can be determined that flowers are flown in at least 80% of the flowers of the tree branches.

The cherry blossom observing method includes predicting whether or not the cherry blossom will proceed in accordance with the weather condition of the place where the cherry blossom image is photographed, and can provide information including cherry blossom observation, cherry blossom prediction, or a combination thereof.

As described above, according to the image-based cherry blossom observing apparatus and method of the present invention, the shape and color analysis are performed based on the image of a particular target tree or habitat of a famous place in spring, The number of flowers and the number of flowers, the number of flowers, the number of flowers, the number of flowers, and the number of flowers, the number of cherry blossoms glowing, blooming, full bloom, etc. by observing the degree of cherry blossom is provided to the user, It is possible to improve the image of the engine, and it is possible to disperse the travelers through the provision of accurate cherry tree information, thereby mitigating traffic congestion.

In addition, the development and promotion of new tourist information using cherry blossom is performed for each local government, thereby attracting new tourists and creating new added value.

1 is a conceptual diagram for explaining a cherry blossom observation based on an image according to an embodiment of the present invention.
2 is a diagram schematically illustrating the configuration of an image-based cherry blossom observation apparatus according to an embodiment of the present invention.
Fig. 3 is a detailed view showing the configuration of the cherry blossom observation server of Fig. 2;
Fig. 4 is a detailed view showing the configuration of the cherry blossom observation unit shown in Fig. 3. Fig.
FIG. 5 is a diagram for explaining a concept of separating a tree branch and a background from a cherry tree image performed in the region separation unit of FIG. 4. FIG.
FIG. 6 is a diagram for explaining a concept of separating flower buds, flowers, and the like from isolated observation target branches performed by the HOG processing unit of FIG.
FIG. 7 is a diagram for explaining a concept of confirming the positions of flower buds, flowers, etc. by correcting the position of the separated branch observers performed by the position correcting unit of FIG.
FIG. 8 is a diagram illustrating a concept of color histogram distribution analysis of hues such as flowers and flowers performed in the color analysis unit of FIG. 4. FIG.
FIG. 9 is a diagram showing a close-up picture and a whole picture of a cherry blossom image obtained according to the germination, flowering, and fullness state of the cherry blossom determined in the cherry blossom determination part of FIG.
FIG. 10 is a flowchart illustrating an operation process of an image-based cherry blossom observation method according to an embodiment of the present invention in detail.
11 is a flowchart showing details of the shape and color analysis step of FIG.

Hereinafter, an apparatus and method for observing cherry blossoms based on images of the present invention will be described in detail with reference to the accompanying drawings. The present invention may be embodied in many different forms and is not limited to the embodiments described herein. Like parts are designated with like reference numerals throughout the specification.

Before describing the constitution of the present invention, general description of cherry blossoms will be described as follows.

The cherry tree is a plant belonging to the rosewood rosaceae, cherry tree, cherry tree, and cherry tree in the dictionary meaning, and the cherry tree is in early April, that is, it is forsythia, and the true spring is right, and it blooms for a few days.

Germination is the growth of seeds or eyes under moderate environmental conditions, which means that the bark that protects the eyes has burst and leaves or petals are visible. The germination of spring flowers is defined as the time when germination of about 20% of the eyes of the total number of eyes is germinated when the buds of a representative (representative bud of a bundle of branches) are germinated. . In the case of woody plants such as cherry blossoms, 20% of the total number of eyes of the observation tree, regardless of the leaf or flower eyes, germinate is observed as germination days.

And until the flowers are bloomed, there are the process of turning the growth point into a state of making flower buds, the process of differentiating each part of flower, and the process of maturation of different parts. Flower bud formation and flowering are governed by external conditions such as light and temperature in addition to internal conditions such as age of plants. The term "flowering" refers to a time when a bud is blooming, but since it is difficult to define the degree, a multitude of plants (peach, forsythia, cherry blossom, etc.) ) Is defined as the flowering date when three or more flowers have completely blossomed.

And, in full bloom, when flower buds bloom more than 80% of whole flower bud of representative tree branches after blooming, bloom day is defined.

In Korea, cherry blossom fronts start from the southern countryside, and cherry blossoms start to bloom when they reach 10 degrees in the East Coast (Gangneung) and 11.5 degrees in the west coast (Gwangju). The flowering of cherry blossoms is on March 30 in Jeju, around April 5 in the southern coast, and around April 15 in Seoul and Chubu.

The official blooming of cherry blossoms in Seoul is based on the trees set at the Seoul Weather Meteorological Observatory (located in Songwol-dong, Jongno-gu, Seoul). Since 2007, the Meteorological Administration has designated major cherry blossom viewing complexes in seven areas nationwide and has designated the Yoonjungro area in Yeouido as a cherry blossom viewing area in Seoul. Yoonjiro Yoon Jung-ro Cherry Blossom Park is a range from the south end of Sogang University to the alumni of the National Assembly. The cherry trees of the three trees managed by Yeongdeungpo-gu Office (118-120, Ward Administration Division) are the criteria for blooming.

1 is a conceptual diagram for explaining a cherry blossom observation based on an image to which the present invention is applied. At this time, the order of execution according to the present invention can be changed by the use environment or a person skilled in the art.

As shown in Fig. 1, a camera for capturing the appearance of cherry blossoms is installed in a community of cherry blossoms, and each camera is connected to a cherry blossom management server through network equipment.

In order to observe the cherry blossoms, a camera installed in a particular habitat or a target tree carries out a surrounding image capture based on the control of the cherry blossom observation server (1), and transmits the captured image to the cherry blossom observation server through a network communication network (2).

The cherry blossom observation server stores the shot images received from each camera by region (③), and determines the state of cherry blossoms by observing germination, flowering, and full bloom of cherry blossoms based on the photographed images (④).

When determining the state of the cherry blossoms, the cherry blossom observation server extracts a specific region from the entire shot image, and analyzes the shape and color. Based on the shape and color analysis information, the number of flower buds germinated, The method of confirming whether the cherry blossoms germinate, bloom or bloom is used as reference.

After determining the status of the cherry blossoms, the cherry blossom observation server stores the cherry blossom images taken by the camera and germination, flowering, and full cherry blossom state information (⑤), and upon request of the user terminal connected to the cherry blossom observation server through the network communication network Provides cherry blossom image for each region and germination, flowering, and full cherry blossom state information to corresponding user terminal (⑥).

Accordingly, the user can check cherry blossom images and germination, flowering, and full cherry blossom state information of the desired area in detail through various terminals such as smart phones and PCs owned by the user (⑦).

On the other hand, when the cherry blossom observation server determines germination conditions such as germination, flowering, and full bloom, it can predict the progress of the cherry blossom by further reflecting the current weather or environmental conditions. That is, the cherry blossom observation server can predict the progress of the cherry blossom by referring to the weather conditions together with the cherry blossom images taken by each camera.

2 is a diagram schematically illustrating the configuration of an image-based cherry blossom observation apparatus according to an embodiment of the present invention.

As shown in FIG. 2, the apparatus for observing cherry blossom of the present invention includes a network communication network 100, a camera 200, a cherry tree observation server 300, and a user terminal 400.

The network communication network 100 is a variety of currently known communication networks such as wired / wireless Internet, Bluetooth, Zigbee, WiFi and the like. The communication network 100 includes a camera 200, a cherry blossom observation server 300, So that data communication related to the cherry blossom image and the status information can be performed mutually.

The camera 200 is installed in a community of cherry blossoms and the like and shoots the entire community or representative tree, and then transmits the photographed image to the cherry blossom observation server 300 through the network communication network 100.

At this time, the camera 200 communicates with the management office of each mountain or community through a coaxial cable or a light line in an environment in which communication is not directly established with the cherry blossom observation server 300, The image transmitted from each camera can be transmitted to the cherry blossom observation server 300 through the network equipment.

The cherry blossom observation server 300 is a computer operated by a business operator performing a cherry blossom information providing service. The cherry blossom observation server 300 divides and stores cherry blossom images transmitted from the camera 200 through the network communication network 100, Based on the observation of the germination, flowering, full bloom of cherry blossoms and determine the state of cherry blossoms. Then, at the request of the user terminal 400, cherry blossom images and germination, flowering, and full cherry blossom state information for each region are provided to the corresponding user terminal 400.

At this time, the cherry blossom observation server 300 can build the cherry blossom observation result as a database and use it as a reference data in the future. In this process, since the database may lack enough space to store image data collected from all over the country, information on the germination, flowering and full bloom of cherry blossoms is stored intensively. And stores the image in the middle, and saves the storage space of the database.

The cherry blossom observation server 300 not only provides the cherry blossom image and status information but also collects various information desired by the user including the speed of cherry blossom, expected weather information, traffic information, and convenience facilities . For this purpose, the cherry blossom observation server 300 connects with servers or databases of other organizations (for example, weather, traffic, and forestry related organizations) to combine information from various agencies to provide more sophisticated travel information.

In addition, the cherry blossom observation server 300 can further perform a function of predicting whether or not the cherry blossoms will progress in the future according to the weather condition of the place where the cherry blossom image is photographed. Accordingly, the cherry blossom observation server 300 can include cherry blossom observation, To the desired user.

The user terminal 400 is a smart phone, a tablet, a notebook PC, a desktop PC, etc., possessed by individual users. The user terminal 400 is connected to the cherry blot observation server 300 through the network communication network 100, Information of cherry blossom viewing and germination, blooming, and cherry blossom in full bloom is received from the cherry blossom observation server 300 and displayed on the screen.

On the other hand, in the cherry blossom observation server 300, a specific region is extracted from the entire image photographed by the camera 200, and the shape and color are analyzed in the extracted region. Then, based on the analyzed shape and color information, , And the number of flowers and the distribution of the flowers completely, to confirm whether the cherry blossoms germinate, bloom or bloom.

The evaluation criteria for cherry blossoms are as follows. At present, the person in charge of evaluating the cherry blossom of the institution determines the germination, flowering, and full bloom of the cherry blossoms by subjective judgment. Therefore, it is difficult for an individual to quantitatively observe the developmental state of a plant, and there is a possibility of causing a mistake or judgment error. In addition, observations of cherry blossoms require a long experience, and the difficulties of individual differences in the subject matter and the revelation of the task-takers.

Therefore, it is necessary to express it quantitatively instead of the subjective result of subjective judgment of the person in charge of evaluating cherry blossom. That is, according to the present invention, a method of analyzing the shape and color of a specific region extracted from a camera photographed image, and measuring germination, flowering, and fullness of cherry blossoms based on the number of flower buds germinated, I want to. The germination is judged to be germination when the number of germinating germination measured in this way becomes 20% or more of the total germination eyes. When three or more germination buds are completely bloomed in a bundling bud, If the bud is more than 80% of the total bloom of representative tree branches, judge it as full bloom.

The target of the observation is to specify the reference tree of cherry tree. After obtaining the detailed photograph (close-up photograph) and the whole photograph of the cherry tree by the camera, the evaluation step of the cherry tree is measured through the evaluation algorithm. 00, 11:00, 13:00, 15:00, 17:00).

3 is a detailed view showing the configuration of the cherry blossom observation server 300 of FIG.

3, the cherry blossom observation server 300 includes a communication unit 310, a cherry blossom image collecting unit 320, a cherry blossom observation unit 330, a storage management unit 340, an additional information management unit 350, and the like .

The communication unit 310 receives the cherry blossom image from each camera 200 through the network communication network 100. In response to a request from the user terminal 400, the communication unit 310 provides information on the cherry blossom image and the cherry blossom state of the specific area to the user terminal 400 through the network communication network 100.

The cherry blossom image managing unit 320 divides the cherry blossom images received from the camera 200 through the communication unit 310 into regions and stores them in a database. In other words, the image transmitted from the camera 200 is divided into time and place and stored in the database. The collected image information is transmitted to the cherry blossom observation unit 330 to monitor the state of cherry blossoms. Collecting and providing them. In addition, when a request is made from the cherry blossom observing unit 330, a desired image may be provided from the camera 200 of the corresponding place in real time.

The cherry tree state observing unit 330 is a unit that performs a core function of the present invention and has a function of observing the cherry tree image taken from each camera 200 stored in the database under the control of the cherry tree image managing unit 320, , Check the shape of flower, check the color of flowers and flowers. Based on the confirmed color, the germination of the flower bud and the flowering of the flower are confirmed, and the germination, flowering and full bloom of the cherry blossom are determined based on the germination rate of the flower bud and the flowering rate of the flower.

The storage management unit 340 divides the cherry blossom images collected by the camera 200 collected by the cherry tree image management unit 320 and the cherry blossom images determined by the cherry blossom observation unit 330 into regions and stores them in a database And accesses and transmits information on the reference image already stored according to a request of the cherry blossom observing unit 330. If necessary, conventional cherry blossom observation results can be accessed.

The additional information management unit 350 manages the additional information related to the weather information, traffic information, convenience facilities, and the like, which are expected according to the progress speed of the cherry tree, to the user terminal 400.

FIG. 4 is a detailed view of the configuration of the cherry state observing unit 330 of FIG.

4, the cherry state observation unit 330 includes a shape analysis unit 332 including a region separation unit 3321, an HOG processing unit 3322, and a position correction unit 3323, a color analysis unit 334, and a cherry blossom state determination unit 336.

The morphological analysis unit 332 performs a function of confirming the shape of a flower or a flower in the branch of the observation target of the cherry blossom image photographed by each camera 200 through the network communication network 100. At this time, morphological analysis basically uses template matching technique.

The shape analysis unit 332 includes a region separation unit 3321 for separating the observation target tree branches and background from the cherry tree image captured by the camera 200, A HOG processing unit 3322 for separating the flowers, and a position correcting unit 3323 for correcting the positions of the separated branches of the observer and confirming the positions of flowers and flowers. That is, the morphological analyzer 332 composes a candidate group having a shape of a flower shape based on the image taken close-up through the camera 200, and detects a part showing a flower shape through edge detection will be.

The color analyzer 334 performs a function of confirming the colors of flowers and flowers confirmed by the morphology analyzer 332. The color analysis uses at least one color model of RGB, HSV, HSL, CIE, CMY, or CMYK. That is, the color analyzer 334 separates the colors of flowers and flowers identified by the shape analyzer 332 using various known color models.

The cherry blossom state determination unit 336 confirms the germination of the flower buds and the flowering of the flower buds of the observation target tree based on the analysis information confirmed through the shape analysis unit 332 and the color analysis unit 334, Ratio, and flowering rate of flowers, it functions to determine the germination, flowering and full state of cherry blossoms.

Next, the process for observing the cherry state performed by the shape analyzer 332 and the color analyzer 334 will be described in detail with reference to FIGs. 5 to 8. FIG.

5 is a view for explaining a concept of separating a tree branch and a background from a cherry tree image performed by the region separation unit 3321 of FIG.

5, in order to extract information (tree branches, tree eyes, etc.) required in a complex image having an actual branch or background from an original image of a cherry tree image, And separates each region.

In order to simplify the complex color distribution, clustering is performed by expressing similar colors in a zonal form, thereby separating the branches and the background from the cherry blossom images.

That is, segmentation is performed using a mean shift algorithm to simplify the color representation and to separate the regions of the image.

FIG. 6 is a diagram for explaining a concept of separating flower buds, flowers, and the like from separated observation target branches performed by the HOG processing unit 3322 of FIG.

As shown in FIG. 6, the HOG processing unit 3322 separates flowers and flowers from the observation target branches separated by the region separation unit 3321.

That is, as shown in Fig. 6 (a), the tree branches to be observed are defined as cylinders, and the flower buds are defined as circles, thereby separating flower buds and flowers from the observation target branches.

As shown in FIG. 6 (b), the HOG divides the target area into cells of a predetermined size, obtains a histogram of the direction of edge pixels (pixels having a gradient magnitude of a predetermined value or more) for each cell, Are vectors connected in series. In other words, the HOG can be viewed as an orientation histogram template of the edge.

In the case of template matching, the geometric information of the original image can be maintained as it is, but the matching can not be performed even if the shape or position of the object slightly changes. On the other hand, histogram matching can match even if the shape of the object changes, but because it loses geometric information of the object and only memorizes the distribution (composition ratio) information, there is a problem that it also matches the wrong object. HOG can be regarded as a matching method in the middle step between template matching and histogram matching. In the block unit, geometric information is maintained, but histograms are used in each block to have some robust characteristics for local changes.

In addition, since HOG uses edge direction information, it can be seen as a kind of edge-based template matching method. Since the edge is basically less sensitive to image brightness change and illumination change, it can be considered that HOG has similar characteristics. In addition, HOG is an image feature suitable for identifying an object having unique unique outline information, such as a person, an automobile, etc., because the internal pattern is not complicated, because it uses information of the silhouette (contour) of the object.

FIG. 7 is a diagram for explaining a concept of confirming the positions of flowers, flowers, and the like by correcting the positions of separated branches of observation objects performed by the position correcting unit 3323 of FIG. 4. The position correcting unit 3323 The position is corrected by using information such as branches, flower eyes, and eyes in the image.

In other words, the morphological data such as branches are collected by using the skeletonization algorithm, and then the positions of the branches are corrected by comparing with the existing images, and the positions of the flowers and flowers are classified.

FIG. 8 is a diagram illustrating a concept of color histogram distribution analysis of hues such as flowers, flowers, and the like classified by the morphological analysis unit 332 performed by the color analysis unit 334 of FIG. 4. In the color analysis unit 334, And confirms the color of flowers, flower, etc. confirmed through the analysis unit 332.

At this time, the color analyzer 334 uses known color models such as RGB, HSV, HSL, CIE, CMY, and CMYK when performing color analysis.

For example, the RGB color model is a color model created by adding and mixing the colors of Red, Green, and Blue, and a specific color is represented by a mixture of R, G, and B. Therefore, Color, and extracts how much R, G, and B are respectively included. Using this, it is possible to observe how the cherry blossoms change from a specific cherry blossom image collected by a camera. That is, it is possible to extract color components of R, G and B from color information of an image photographed by a camera in a state of knowing color information of a flower or a flower, and to predict what kind of flower or flower the flower or flower will change.

The HSL color model is a color model made up of hue, saturation and lightness. It analyzes the color information of flowers and flowers of a cherry tree as components of color, saturation and lightness, , It is possible to analyze the progress of the cherry blossom germination, flowering, full bloom and the like.

FIG. 9 is a view showing a close-up photograph and an entire photograph of a cherry blossom image obtained according to the germination, flowering and full state of cherry blossom determined by the cherry blossom state determination unit 336 of FIG.

As shown in FIG. 9, the cherry state determination unit 336 determines whether or not the flower buds of the tree branches of interest are observed based on the information analyzed by the shape analysis unit 332 and the color analysis unit 334, And germination, flowering and fullness of cherry blossoms are determined by confirming the number of the flowering buds. For example, if the germination percentage of the flower buds germinated among the total flower buds determined from the observation target branches is 20% or more, the germination state is determined, and the number of flowers identified from one object (a bundle of buds) , It is decided to be in the flowering state, and if it is blossomed in 80% or more of the whole flower buds of the observation target tree branches, it is decided to be in full bloom state.

The cherry blossom images for germination, flowering and bloom are received from the camera 200 and stored and managed. When requested by the user terminal 400, cherry blossom images for each state are provided to the corresponding user terminals 400.

Next, an embodiment of the image-based cherry blossom observing method according to the present invention will be described in detail with reference to FIGS. 10 and 11. FIG. At this time, each step according to the method of the present invention may be changed in the use environment or the order by a person skilled in the art.

FIG. 10 and FIG. 11 are flowcharts illustrating an operation process of an image-based cherry blossom observation method according to an embodiment of the present invention in detail.

First, a camera 200 for photographing a state of a cherry tree is installed in a cherry tree community in each area of the country, and each camera 200 is connected to a cherry tree management server 300 through a network communication network 100 .

In order to observe the cherry blossoms, a camera 200 installed in a particular community or a target tree shoots a surrounding image based on the control of the cherry blossom observation server 300 and transmits the shot image to the cherry blossom observation server 300 through the network communication network 100. [ Lt; / RTI >

Then, the cherry blossom observation server 300 divides the photographed images received from the respective cameras 200 by region and stores the cherry blossoms, and determines the state of the cherry blossoms by observing germination, flowering, full bloom, etc. of the cherry blossoms based on the photographed images.

10, the cherry blossom observation server 300 extracts a region to be observed from the entire photograph of the cherry blossom image photographed by the camera 200 (S110). That is, in order to observe the state of cherry blossoms at the cherry blossom observation server 300, a region of a specific target tree branch is extracted from the entire photograph.

After extracting the observation target region through step S110, the cherry blossom observation server 300 analyzes the shape and color of the observation target area, and confirms the germination percentage of the flower bud and the flowering ratio of the flower based on the analysis.

11, the cherry blossom observation server 300 performs a region separation step for separating the observation target tree branches and the background from the cherry blossom image taken by the camera 200 (S121) (Step S122). In the step S122, the position of the flower bud or flower is corrected by correcting the position of the separated branch object. (S123).

Thereafter, the cherry blossom observation server 300 compares the flowers of flowers and flowers based on the morphological analysis information performed in steps S121 to S123 (S124).

After performing the shape and color analysis, the cherry blossom observation server 300 confirms the germination rate of flower buds, the flowering rate of flowers, and the like (S125).

After checking the shape and color of the observation target area and confirming the germination rate of flower buds, the flowering rate of flowers, etc., the cherry blossom observation server 300 determines whether the current state of the cherry blossom is germinated (S130 ). In other words, it is to check whether the flower bud germinated out of the total flower buds identified in the observation tree branches is 20% or more.

If the current state of the cherry blossom is germinated, the cherry blossom observation server 300 acquires the germinated whole image from the camera 200 (S140).

However, if it is determined in step S130 that the current state of the cherry blossom is not germinated, the cherry blossom observation server 300 determines whether the current state of the cherry blossom is in the flowering state (S150). That is, it is to confirm whether the number of flowers identified in one object (a bundle of buds) of the observation target tree is three or more.

If the current state of the cherry blossom is in the flowering state, the cherry blossom observation server 300 acquires the entire image in the flowering state from the camera 200 (S160).

However, if it is determined in step S150 that the current state of the cherry blossom is not in the flowering state, the cherry blossom observation server 300 determines whether the state of the current cherry tree is full (S170). In other words, it is to check whether the flower is blossomed in more than 80% of the whole flower buds of the observation tree.

If the current state of the cherry blossom is full, the cherry blossom observation server 300 obtains a full image in full screen from the camera 200 (S180).

However, if it is determined in step S170 that the current state of the cherry blossom is not full, the cherry blossom observation server 300 receives the cherry blossom image again from the camera 200 and repeats step S110 and subsequent steps.

After determining the state of the cherry blossom through steps S110 to S190, the cherry blossom observation server 300 requests the user terminal 400 to transmit the cherry blossom image and the germination, flowering, To the corresponding user terminal (400). Accordingly, the user can confirm the cherry blossom image and germination, flowering, and full cherry blossom state information of the desired area in detail through various terminals such as smart phones and PCs owned by the user.

Meanwhile, the cherry blossom observation server 300 may further provide additional information including weather information, traffic information, convenience facilities, or a combination thereof expected according to the progress speed of the cherry blossom.

Further, the cherry blossom observation server 300 may further perform a function of predicting whether or not the cherry blossoms will progress in the future according to the weather condition of the place where the cherry blossom image is photographed, and may further include information including cherry blossom observation, cherry blossom prediction, To a desired user.

As described above, the present invention accurately observes the degree of progress of cherry blossoms at famous places in the spring and provides it to the user, thereby improving the convenience of travelers who take a break in spring, can improve the image of a weather- By providing precise information on cherry blossom trees, traffic congestion can be alleviated by dispersing travelers.

In addition, since the present invention can develop and promote new tourist information utilizing cherry blossom for each local government, new value added can be created with attracting new tourists.

It will be apparent to those skilled in the art that various modifications may be made to the invention without departing from the spirit and scope of the invention as defined in the following claims And changes may be made without departing from the spirit and scope of the invention.

100: network communication network 200: camera
300: cherry tree observation server 310: communication section
320: Cherry Blossom Image Management Unit 330: Cherry Blossom Condition Monitoring Unit
332: Shape analysis unit 3321:
3322: HOG processing unit 3323:
334: color analysis unit 336: cherry state determination unit
340: storage management unit 350: additional information management unit
400: User terminal

Claims (13)

A morphological analysis unit for checking the shape of a flower or a flower on a tree branch observed by a camera;
A color analyzer for checking the colors of flowers and flowers identified above; And
Determining a germination of the flower bud and a flowering of the flower based on the identified color and determining a germination, flowering and full bloom of the cherry blossom based on the confirmed germination ratio of the flower bud and the flowering rate of the flower,
The morphological analysis unit may include:
An area dividing unit for dividing the observation target tree branches and the background from the cherry tree images taken by the camera;
A Histogram of Oriented Gradient (HOG) processing unit for separating flower buds and flowers from the separated observation branches; And
And a position correcting unit for correcting the positions of the separated branches of the observer and confirming the positions of the flowers and the flowers. The method according to claim 1,
The cherry blossom observing apparatus comprises:
A cherry blossom image managing unit for managing the cherry blossom images received from the camera through a communication unit according to each region; And
And a storage management unit for storing the cherry blossom image and the state information of the cherry blossom determined by the cherry blossom state determination unit in each region and storing the information in a database. The method according to claim 1,
The cherry blossom observing apparatus comprises:
And a supplementary information managing unit for managing provision of supplementary information including weather information, traffic information, convenience facilities, or combinations thereof expected according to the progress speed of the cherry blossom. . delete The method according to claim 1,
Wherein the color analyzer comprises:
(Hue, Saturation, Lightness), HSV (Hue, Saturation, Lightness), CIE (Commission Internationale de l'Eclairage), CMY (Cyan, Magenta, Yellow) , Magenta, yellow, and K (Black)) using the at least one color model. The method according to claim 1,
The cherry blossom-
The germination state is determined when the flower bud germinated out of the total flower buds identified in the tree branches is more than 20%
When the number of flowers identified in one object (a bundle of buds) of the observation target tree is 3 or more, it is determined to be in a flowering state,
Wherein the bloom is determined to be in full bloom when the flower is blossomed in 80% or more of the whole bloom of the observer's target tree. The method according to claim 1,
The cherry blossom observing apparatus comprises:
And predicting whether or not the cherry blossom will proceed in accordance with the weather condition of the place where the cherry blossom image is photographed,
A cherry blossom observation, a cherry blossom prediction, or a combination thereof. A shape analysis step of confirming the shape of flower buds and flowers in the branches of observation objects of the cherry blossom images photographed by the camera;
A color analysis step of confirming the colors of flowers and flowers identified above; And
Determining the germination of the flower bud and the flowering of the flower on the basis of the identified color and determining the germination, flowering and full bloom of the cherry blossom based on the confirmed germination rate of the flower bud and the flowering rate of the flower,
Wherein the shape analysis step comprises:
An area separation step of separating a tree branch and a background from a cherry tree image taken by a camera;
A Histogram of Oriented Gradient (HOG) processing step of separating flower buds and flowers from the separated observation target branches; And
And a position correcting step of correcting the positions of the separated branches of the observer and confirming the positions of flowers and flowers. The method of claim 8,
In the cherry blossom observation method,
A cherry blossom image management step of managing a cherry blossom image provided from the camera for each region; And
And storing the cherry blossom image and the state information of the cherry blossom determined in the cherry blossoming state determination step in each region and storing the separated information in a database. The method of claim 8,
In the cherry blossom observation method,
And providing additional information including weather information, traffic information, convenience facilities, or a combination thereof expected according to the progress speed of the cherry blossom. delete The method of claim 8,
Wherein the cherry state determination step comprises:
The germination state is determined when the flower bud germinated out of the total flower buds identified in the tree branches is more than 20%
When the number of flowers identified in one object (a bundle of buds) of the observation target tree is 3 or more, it is determined to be in a flowering state,
Wherein the bloom is determined to be in full bloom when the flower is blossomed in at least 80% of the whole bloom of the observer. The method of claim 8,
In the cherry blossom observation method,
And predicting whether or not the cherry blossom will proceed in accordance with the weather condition of the place where the cherry blossom image is photographed,
A cherry blossom observing method based on images, characterized by providing information including cherry blossom observation, cherry blossom prediction, or a combination thereof.

Images