KR101291047B1 - User terminal having plants information providing application and method for providing plants information - Google Patents

Abstract

The present invention relates to a user terminal and a plant information providing method including a plant information providing application. A user terminal including a plant information providing application according to the present invention recognizes an object based on the image information according to a memory for storing plant information, a camera for obtaining image information, and driving of the plant information providing application. And a display for outputting the plant information and a microprocessor for querying the memory based on the recognized object to obtain plant information corresponding to the recognized object.

Description

USER TERMINAL HAVING PLANTS INFORMATION PROVIDING APPLICATION AND METHOD FOR PROVIDING PLANTS INFORMATION

The present invention relates to a user terminal including a plant information providing application and a method for providing plant information, and in particular, image information photographed by a camera of a user terminal by a user in a user terminal having a plant information providing application provided by a plant information providing system. The present invention relates to a user terminal and a plant information providing method including a plant information providing application for recognizing an object by image processing and outputting plant information stored in a memory of a user terminal in advance corresponding to the recognized object.

The development of information technology is rapidly spreading the spread of computers and the Internet. In particular, the Internet industry has exploded, and many host computers are connected to the Internet every day, making a great contribution to making the world a global village. Along with this widespread use of personal computers, the World Wide Web has contributed to providing the public with relatively easy access to the Internet by providing multimedia functions and ease of use.

It is common practice for ordinary people to access the Internet using the World Wide Web, search for necessary information, and obtain appropriate contents. For example, if a user wants to travel to a certain area, he or she can obtain information about the tourist attractions, accommodations, transportation facilities, or famous restaurants of the area in advance, and make an appropriate reservation. Can stand. In general, when a user acquires information by using the Internet, a user generally inputs a related search term, and the search term is queried into an internal database at the site, and the result corresponding to the queried query is extracted. The extracted search result is provided to the user's terminal after a certain processing process.

However, if the user does not know the appropriate search word, the information acquisition process using the Internet is difficult to use. For example, if a user wants to know information about a plant found while traveling to a specific region and the name of the plant is not known, the information acquisition process using the Internet cannot be used. In general, plants are organisms with cell walls and chlorophyll, which lead to independent nutrition by photosynthesis. Since the variety of plants is very diverse, it is very difficult for the general public to obtain information on a specific plant without the preparation of a plant illustration book.

A specific object of the present invention is to recognize a plant based on image information about a plant obtained through a camera by using a plant information providing application provided by a plant information providing system, and extract and output information on the plant. To provide a user terminal and a plant information providing method comprising a plant information providing application that can easily obtain information about the plant even without knowing the name of the plant.

Another object of the present invention is to generate and output reference information corresponding to location information and time information based on location information and time information corresponding to a user or a user terminal using a plant information providing application provided by the plant information providing system. Accordingly, to provide a user terminal and a plant information providing method including a plant information providing application that allows a user to obtain appropriate reference information at a specific location and a specific time.

Still another object of the present invention is to provide a user terminal and a plant including a plant information providing application capable of generating and outputting an image album using image information, caption information, etc. using the plant information providing application provided by the plant information providing system. It is to provide a method of providing information.

In order to achieve the above object, according to an aspect of the present invention, in the user terminal is installed and driven plant information providing application, a memory for storing plant information, a camera for obtaining image information, the driving of the plant information providing application And a microprocessor for recognizing an object based on the image information, querying the memory based on the recognized object, and obtaining a plant information corresponding to the recognized object, and a display for outputting the plant information. It is possible to provide a user terminal that includes.

In a preferred embodiment, the user terminal may further include a speaker for outputting the auditory information of the plant information. In addition, the plant information providing application queries plant information in the memory based on the object recognition component that recognizes an object and the object that the object recognition component recognizes, based on the image information, and supplies the plant information corresponding to the query. And a memory processing component for acquiring. The plant information providing application may further include an output information processing component configured to process the obtained plant information into a form suitable for output through at least one of a display and a speaker. The plant information providing application may further include a location information processing component for generating reference information in association with the memory based on at least one of location information and time information corresponding to a user or a user terminal. The location information may be estimated corresponding to the user terminal. The plant information providing application may further include a video album management component that generates a video album based on at least one of video information, caption information, and edit information input by a user. In addition, the plant information providing application is characterized in that it is provided from the plant information providing system coupled through a communication network.

According to another aspect of the present invention, in the method for providing plant information performed by a user terminal installed and driven by a plant information providing application, receiving the image information, recognizing a target based on the image information, It is possible to provide a plant information providing method including searching for plant information based on a recognized object and outputting the plant information.

In a preferred embodiment, the method for providing plant information may further comprise processing the plant information into a form suitable for output. The recognizing of the object may include extracting contour information from the image information, clarifying the extracted contour information based on a preset threshold value, removing noise of the cleared contour information, and removing noise. From the clear outlined contour information, extracting the relative proportion of each part of the object, measuring the relative proportion of the extracted part and similarity with the prepared standard data, and measuring the similarity between the extracted relative proportion and the standard data. If it is determined that the result is valid, the method includes the step of recognizing the object corresponding to the standard data. The plant information providing method may further include generating reference information and outputting the reference information based on at least one of location information and time information corresponding to the user or the user terminal. The location information may be estimated corresponding to the user terminal. In addition, the method for providing plant information includes receiving at least one of image information, caption information, and edit information, generating a video album based on at least one of the video information, caption information, and edit information, and outputting the video album. It may further comprise a step. The plant information providing method may further include outputting a video album editing UI (User Interface), wherein at least one of the video information, caption information, and editing information is input using the video album editing UI. .

According to the present invention, the following effects can be expected.

According to the present invention, by using a plant information providing application provided by the plant information providing system recognizes the plant based on the image information about the plant obtained through the camera, the user by extracting and outputting the information on the plant A user terminal and a plant information providing method including a plant information providing application capable of easily obtaining information on a corresponding plant even without knowing a name of the corresponding plant may be provided.

In addition, according to the present invention, by using the plant information providing application provided by the plant information providing system based on the location information and time information corresponding to the user or the user terminal, generates and outputs the reference information corresponding to the location information and time information As a result, a user terminal and a plant information providing method including a plant information providing application that allows a user to obtain appropriate reference information at a specific location and at a specific time may be provided.

In addition, according to the present invention, a user terminal and a plant information including a plant information providing application for generating and outputting a video album using image information, caption information, etc. using the plant information providing application provided by the plant information providing system. A provision method can be provided.

1 is a view schematically showing a coupling relationship between a plant information providing system and a user terminal.
2 is a diagram schematically showing a hardware configuration of a user terminal according to a preferred embodiment of the present invention.
Figure 3a is a schematic diagram showing the functional block of the plant information providing application driven in the user terminal according to an embodiment of the present invention.
3b schematically illustrates functional blocks of a plant information providing application driven in a user terminal according to another exemplary embodiment of the present invention.
Figure 3c schematically illustrates the functional blocks of the plant information providing application driven in the user terminal according to another embodiment of the present invention.
Figure 4 is a flow chart schematically showing a plant information providing method according to the operation of the plant information providing application in the user terminal according to an embodiment of the present invention.
5 is a flowchart schematically showing a process of object recognition according to a preferred embodiment of the present invention.
6 is a flowchart schematically illustrating a method for providing reference information according to the operation of a plant information providing application in a user terminal according to an exemplary embodiment of the present invention.
7 is a flowchart schematically illustrating a method for providing a video album according to driving of a plant information providing application in a user terminal according to an exemplary embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to designate the same or similar components throughout the drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

1 is a view schematically showing a coupling relationship between a plant information providing system and a user terminal. Referring to FIG. 1, the plant information providing system 100 according to the present invention may be combined with a plurality of user terminals 500 through a communication network 600 such as a public telephone network (PSTN), the Internet, and a wireless communication network.

The user terminal 500 according to the present invention is preferably a mobile terminal, specifically portable, and download and install the plant information providing application provided by the plant information providing system 100 through the communication network 600 I can drive it. The user terminal 500 according to the present invention may generate image information with at least a shooting function or may receive image information generated by another device, and may be extracted by driving a plant information providing application based on the image information. Among the plant information, a display for outputting visual information and / or a speaker for outputting auditory information, and a memory for storing plant information and the like. The user terminal 500 according to the present specification is a cellular phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device. And the like. However, it will be easily understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals, such as digital TVs and desktop computers, except when applicable only to mobile terminals. There will be. A detailed configuration of the user terminal 500 will be described in more detail with reference to FIG. 2.

2 is a diagram schematically showing a hardware configuration of a user terminal according to an exemplary embodiment of the present invention. Referring to FIG. 2, the user terminal 500 includes a camera 507, an image processing unit 509, a display 503, a memory 505, a communication unit 511, a key input unit 513, a power supply unit 515, and the like. It includes a microprocessor 501 that controls and drives the plant information providing application according to the present invention to perform the plant information providing method.

The communication unit downloads the plant information providing application according to the present invention from the plant information providing system to be coupled through a communication network. The memory 505 stores a plant information providing application, plant information related thereto, reference information, and the like. The camera 507 and the image processing unit 509 obtain image information about a specific plant as a target. The display 503 outputs visual information such as image, video, text data, and the like, and the speaker 504 outputs auditory information. The key input unit 513 inputs various selection signals by a user's operation. The power supply unit 515 provides energy required for the operation of the user terminal 500.

According to the present invention, the plant information stored in the memory 505 may be extracted in correspondence with the object recognized based on the image information obtained through the camera 507 by driving the plant information providing application in the user terminal 500. And visual information such as an image, a video, and text data output to the display 503 and / or auditory information output to the speaker 504. The contents of the plant information may include plant name, taxonomic information such as scientific name, plant growth information such as distribution area or flowering time, toxicity, and other characteristic information. In addition, the plant information stored in the memory 505 is processed and stored as reference information corresponding to the location information and time information corresponding to the user or the user terminal 500 through the operation of the plant information providing application, or the display 503 and And / or output via speaker 504. The reference information is preferably information that can be referred to plants for the user, such as information on plant groups, detailed distribution areas, flowering periods, etc. that grow in March of Gyeryongsan. In addition, the memory 505 may store a video album editing user interface (UI), and further include image information, caption information, and / or edit information input using the image album editing UI. The information, caption information, and / or edit information may be used to generate a video album to be described later. In addition, the generated image album may be further stored in the memory 505.

3A is a view schematically showing a functional block of a plant information providing application driven in a user terminal according to an exemplary embodiment of the present invention. Referring to FIG. 3A, the plant information providing application may include a target recognition component 701, a memory processing module 703, and an output information processing component 705. The object recognition component 701 performs a function of recognizing an object based on the image information obtained through the camera. The memory processing component 703 queries the plant information in the memory based on the object recognized by the object recognition component 701, and performs a function of obtaining the plant information corresponding to the query. The output information processing component 505 functions to process the plant information obtained corresponding to the recognized object into a form suitable for output through the display and / or the speaker.

3B is a view schematically showing a functional block of a plant information providing application driven in a user terminal according to another exemplary embodiment of the present invention. Referring to FIG. 3B, the plant information provision application may further include a location information processing component 709. The location information processing component 709 refers to the location information and time information corresponding to the user or the user terminal input through the key input unit, or the location information processing time based on the location information and time information estimated and generated to correspond to the user terminal. Function to generate information.

3C is a view schematically showing a functional block of a plant information providing application driven in a user terminal according to another preferred embodiment of the present invention. Referring to FIG. 3C, the plant information providing application may further include a video album management component 709. The video album management component 709 manages a video album editing UI stored in the memory, and uses the video album editing UI output through a display and / or a speaker to input video information, caption information and / or edits. Creates a video album based on the information. The generated video album may be output through a display and / or a speaker. Image information, caption information, editing information, and / or image album input by the user may be further stored in the memory.

4 is a flowchart schematically showing a plant information providing method according to driving of a plant information providing application in a user terminal according to an exemplary embodiment of the present invention. Referring to FIG. 4, the user terminal receives image information through a camera (step 401). The image information may include an image and a video of the whole or part (such as a flower, leaf, stem, etc.) of a specific plant. Thereafter, the user terminal recognizes the object based on the input image information (step 403). Specifically, the object is recognized based on the image information through the object recognition component of the plant information providing application. An object recognition process performed through the object recognition component of the plant information providing application will be described in more detail with reference to FIG. 5.

5 is a flowchart schematically illustrating an object recognition process according to an exemplary embodiment of the present invention. Referring to FIG. 5, the user terminal extracts outline information from the image information through the object recognition component of the plant information providing application (step 501). Thereafter, the user terminal may clarify the extracted contour information based on a preset threshold value through the object recognition component of the plant information providing application (step 503). That is, the user terminal sets the threshold value to be set to '0' if each pixel value of the contour information extracted through the object recognition component of the plant information providing application is smaller than a preset threshold value (for example, 128) and to '255' if it is larger. The clarification process of the contour information can be performed through a threshold transform. Thereafter, the user terminal removes noise on the outlined contour information by using a media filter through the object recognition component of the plant information providing application (step 505). Thereafter, the user terminal extracts the relative ratio of each part of the object from the cleared contour information from which noise is removed through the object recognition component of the plant information providing application (step 507). Thereafter, the user terminal measures the relative ratio of each part extracted through the object recognition component of the plant information providing application and the similarity with the prepared standard data (step 509). The user terminal measures the similarity between the relative ratio of each part extracted through the object recognition component of the plant information providing application and the standard data, and if it is determined to be valid, recognizes the object corresponding to the standard data (step 511).

Referring back to FIG. 4, the user terminal searches for plant information based on the recognized object (step 405). Specifically, the plant information is queried in the memory based on the object recognized through the memory processing component of the plant information providing application, and the plant information corresponding to the query is obtained. Thereafter, the user terminal processes the plant information into a form suitable for output from the user terminal (step 407). Specifically, the plant information acquired corresponding to the object recognized through the output information processing component of the plant information providing application is processed into a form suitable for output by the user terminal. Thereafter, the user terminal outputs the processed output information (step 409).

6 is a flowchart schematically illustrating a method for providing reference information according to driving of a plant information providing application in a user terminal according to an exemplary embodiment of the present invention. Referring to FIG. 6, the user terminal receives location information and time information corresponding to the user or the user terminal through a key input unit, or estimates location information of the user terminal (step 601). Specifically, location information and time information corresponding to the user or the user terminal are received from the key input unit through the location information processing component of the plant information providing application. Location information and time information input from the key input unit may be, for example, a place (Gyeryongsan, etc.) and a time (March) that the user wants to visit. Since the time information may be set based on the current time, the time information may not be separately received from the key input unit. In addition, the location information corresponding to the user terminal is estimated through the location information processing component of the plant information providing application. Estimation of the location information for the user terminal may be performed using a network-based technology, a terminal-based technology, a dedicated network-based technology, or the like. When the location information is estimated through the location information processing component of the plant information providing application, the time information may be set based on the current time.

Thereafter, the user terminal generates reference information based on at least one of the location information and the time information (step 603). Specifically, the reference information is generated by interworking with the memory based on at least one of the location information and the time information through the location information processing component of the plant information providing application. Thereafter, the user terminal outputs the generated reference information through the display and / or the speaker (step 605).

7 is a flowchart schematically illustrating a video album providing method according to driving of a plant information providing application in a user terminal according to an exemplary embodiment of the present invention. Referring to FIG. 7, the user terminal outputs a video album editing UI previously stored in a memory through a display and / or a speaker (step 701). In detail, the image album editing UI previously stored in the memory is output through the display and / or the speaker through the image album management component of the plant information providing application. Thereafter, the user terminal receives image information, caption information, and editing information according to the user's use of the video album editing UI (step 703). Specifically, the video information, caption information, and / or edit information input using the user's video album editing UI are received through the video album management component of the plant information providing application. Thereafter, the user terminal generates a video album based on at least one of the video information, the caption information, and the edit information (step 705). Specifically, a video album is generated based on at least one of video information, caption information, and edit information through a video album management component of the plant information providing application. Thereafter, the user terminal outputs the generated video album through the display and / or the speaker (step 707). The generated image album may be further stored in the memory.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the scope of the present invention but to limit the scope of the technical idea of the present invention. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

100: plant information providing system
500: User terminal
501 microprocessor
503: display
504: Stickers
505: memory
507 camera
509: image processing unit
511: communication unit
513: key input unit
515: power supply
600: communication network
700: plant information providing application
701: target recognition component
703: Memory Processing Component
705: output information processing component
707: location information processing component
709: Video album management component

Claims (15)

In the user terminal,
A memory for storing plant information;
A camera for acquiring image information;
A microprocessor that recognizes an object based on the image information and queries the memory based on the recognized object to obtain plant information corresponding to the recognized object from the memory; And
A display for outputting the plant information;
The user terminal is provided with a plant information providing application, the microprocessor performs an operation in accordance with the operation of the plant information providing application,
Further comprising a speaker for outputting the auditory information of the plant information,
The plant information providing application further includes a video album management component that generates a video album based on at least one of video information, caption information, and edit information input by a user.
The plant information providing application is a user terminal characterized in that receiving the plant information from the plant information providing system combined with the location information and time information through a communication network. delete The method of claim 1,
The plant information providing application
An object recognition component that recognizes an object based on the image information; And
And a memory processing component for querying the memory for plant information based on an object recognized by the object recognition component and obtaining the plant information corresponding to the query. The method of claim 3,
The plant information providing application
And an output information processing component for processing the obtained plant information to be output through at least one of a display and a speaker. 5. The method of claim 4,
The plant information providing application
And a location information processing component for generating reference information in association with the memory based on at least one of location information and time information corresponding to a user or a user terminal. The method of claim 5,
The location information is estimated according to the user terminal. delete delete A plant information providing method performed by a user terminal in which the plant information providing application according to any one of claims 1 and 3 to 6 is installed and driven.
Receiving the image information;
Recognizing an object based on the image information;
Searching for plant information based on the recognized object; And
Outputting the plant information;
Processing the plant information to be output through at least one of a display and a speaker of the user terminal;
Recognizing the object may include extracting contour information from the image information;
Clarifying the extracted contour information by comparing a predetermined threshold value with a pixel value for the contour information;
Removing noise for the clarified contour information;
Extracting the relative ratio of each part of the object from the deconstructed contour information without noise;
Measuring a relative ratio of each extracted part and similarity with standard data prepared in advance; And
And determining that the object is corresponding to the standard data when it is determined to be valid as a result of measuring the similarity between the extracted relative proportion of each part and the standard data. delete delete 10. The method of claim 9,
Generating reference information based on at least one of location information and time information corresponding to a user or the user terminal; And
And outputting the reference information. The method of claim 12,
And the location information is estimated corresponding to the user terminal. 10. The method of claim 9,
Receiving at least one of image information, caption information, and edit information;
Generating a video album based on at least one of the video information, caption information, and edit information;
Plant information providing method further comprising the step of outputting the video album. 15. The method of claim 14,
And outputting a video album editing user interface (UI), wherein at least one of the video information, caption information, and editing information is input using the video album editing UI.

Images