KR102243798B1 - Information service providing method using bigdata of images collecting by touch of mobile device and system therefor - Google Patents

Abstract

A method and a system for providing an information service using image big data collected by a touch-based mobile device are provided. According to an embodiment of the present invention, a method for providing an information service using image big data includes: transmitting annotation information of an image and an annotation image corresponding to the annotation information from a mobile device; Receiving the annotation information and the annotation image transmitted from at least one mobile device in a server; Collecting the annotation information and the annotation image received from the at least one mobile device in the server as image big data for a preset object; And providing an information service related to the object based on the collected image big data by the server.

Description

Information service provision method and system using image big data collected by touch-based mobile device {INFORMATION SERVICE PROVIDING METHOD USING BIGDATA OF IMAGES COLLECTING BY TOUCH OF MOBILE DEVICE AND SYSTEM THEREFOR}

The present invention relates to a technology for providing information service using image big data collected by the touch of a mobile device, and more specifically, a technology created for artificial intelligence learning or information collection based on a touch of a mobile device such as a smartphone. The present invention relates to a method and system for providing an information service using image big data capable of collecting images and providing information services related to images based on the collected images and information thereon.

In recent years, deep learning has been applied to various recognitions such as face recognition, full body recognition, posture recognition, voice recognition, object recognition, and data mining. In particular, researches on combining deep learning learning networks with object recognition that recognize specific objects from images are being actively conducted in various ways.

To learn artificial intelligence, images (or data) are collected, annotations are performed on the collected images, and learning is conducted using annotated images. Then, the image used for learning is loaded, and an annotation for the designated block is generated by designating a block with a mouse or the like in the loaded image.

However, in the prior art, since a corresponding user for generating an annotation performs an annotation operation on each of all images, it is time-consuming and expensive, and it is difficult to collect data.

Accordingly, the present invention provides a method for easily collecting annotations and annotated images for images required for artificial intelligence learning through a mobile device, and providing an image-related information service using the collected image big data. I propose that system.

Embodiments of the present invention collect images generated for artificial intelligence learning or information collection based on a touch of a mobile device such as a smartphone, and provide an image-related information service based on the collected images and information thereon. Provides an information service providing method and system using big data that can be imaged.

Specifically, embodiments of the present invention receive annotation information for a specific object, an annotation image as well as an original image from each mobile device, and provide an information service related to a specific object based on the received image big data for the specific object. Provides an information service providing method and system using image big data that can be provided.

According to an embodiment of the present invention, a method for providing an information service using image big data includes: transmitting annotation information of an image and an annotation image corresponding to the annotation information from a mobile device; Receiving the annotation information and the annotation image transmitted from at least one mobile device in a server; Collecting the annotation information and the annotation image received from the at least one mobile device in the server as image big data for a preset object; And providing an information service related to the object based on the collected image big data by the server.

In the providing step, information on the object may be converted into a database using the collected image big data, and an information service related to the object may be provided based on the information on the databased object.

The receiving step includes receiving additional information including location information and time information of the original image of the annotation image from the at least one mobile device, and the collecting step is performed based on the received additional information. If the location of and is the same, it is possible to remove duplicates and collect image big data for the object by using the annotation information and the annotation image other than the annotation information and the annotation image in which the object is not included.

Further, the method of providing an information service using image big data according to an embodiment of the present invention further includes the step of providing the annotation information and a reward for the annotation image from the server to the user of the first mobile device. can do.

In the step of paying the reward, when a specific mission related to the object is requested from the server to the first mobile device, and an execution result corresponding to the specific mission is received from the first mobile device, according to each of the specific missions. A preset additional reward may be additionally paid to the user of the first mobile device.

The receiving step includes receiving additional information including location information and time information of the original image for the annotation image from the at least one mobile device, and the providing step includes the additional information when the object is a car. And, based on the image big data, at least one of information for each location, information for each time slot, and information for each type of the vehicle may be provided as an information service.

The transmitting may include obtaining an image including the object; Setting a target area in the acquired image; Generating the annotation information and the annotation image for the set target area; And transmitting the generated annotation information and annotation image to the server.

An information service providing system using image big data according to an embodiment of the present invention includes: a receiver configured to receive annotation information of an image transmitted from at least one mobile device and an annotation image corresponding to the annotation information; A collection unit that collects the received annotation information and annotation image as image big data for a preset object; And a service unit that provides an information service related to the object based on the collected image big data.

The service unit may convert information on the object into a database using the collected image big data, and provide an information service related to the object based on the information on the databased object.

The receiving unit receives additional information including location information and time information of the original image for the annotation image from the at least one mobile device, and the collection unit has the same time and location based on the received additional information. In this case, redundancy may be removed, and image big data for the object may be collected using the annotation information and the annotation image other than the annotation information and the annotation image in which the object is not included.

Furthermore, the information service providing system using image big data according to an embodiment of the present invention further includes a reward unit for providing corresponding annotation information and a reward for the annotation image to each user of the at least one mobile device. can do.

The reward unit requests a specific mission related to the object to a first mobile device, and when an execution result corresponding to the specific mission is received from the first mobile device, the first additional reward is preset according to each of the specific missions. Additional payments can be made to users of mobile devices.

The receiving unit receives additional information including location information and time information of the original image for the annotation image from the at least one mobile device, and the service unit receives the additional information and the image big when the object is a car. Based on the data, at least one of location-specific information, time-specific information, and type-specific information about the vehicle may be provided as an information service.

The receiving unit acquires an image including the object from each of the at least one mobile device, sets a target area from the acquired image, and generates the annotation information and the annotation image for the set target area And, by transmitting the generated annotation information and the annotation image, the annotation information and the annotation image may be received.

According to embodiments of the present invention, an image generated for artificial intelligence learning or information collection is collected based on a touch of a mobile device such as a smartphone, and an image-related information service is provided based on the collected image and information thereon. Can provide.

For example, the present invention collects annotation information related to a vehicle, an annotation image, as well as an original image from each mobile device, and provides an information service related to a vehicle by using the collected image big data on the vehicle. By providing rewards to users of mobile devices that provide annotation information and annotation images as well as original images, it is easy to collect car images, collect data required for artificial intelligence learning, and are required to perform annotations. You can save time and money consumption.

1 shows a system according to an embodiment for explaining the present invention.
FIG. 2 shows an exemplary diagram for explaining an information service process for the system of FIG. 1.
3 is a flowchart illustrating an operation of a method for providing an information service using image big data according to an embodiment of the present invention.
4 shows an exemplary diagram for explaining a process of setting a target area in the present invention.
FIG. 5 shows an exemplary diagram for explaining a method of setting the target area of FIG. 4.
6 shows an exemplary diagram for additional information additionally received from a mobile device.
7 shows the configuration of an information service providing system using image big data according to an embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in a variety of different forms, only the present embodiments make the disclosure of the present invention complete, and common knowledge in the technical field to which the present invention pertains. It is provided to completely inform the scope of the invention to those who have, and the invention is only defined by the scope of the claims.

The terms used in the present specification are for describing exemplary embodiments, and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, "comprises" and/or "comprising" refers to the recited component, step, operation, and/or element. It does not exclude presence or addition.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used with meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in advance that are generally used are not interpreted ideally or excessively unless explicitly defined specifically.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. The same reference numerals are used for the same elements in the drawings, and duplicate descriptions for the same elements are omitted.

Embodiments of the present invention collect annotation information related to a specific object, an annotation image as well as an original image from each mobile device, and provide an information service related to a specific object using image big data for the collected specific object. By providing rewards to users of mobile devices that provide annotation information and annotation images related to objects, as well as original images, it is easy to collect data on specific objects required for artificial intelligence learning, and is required to perform annotations. The point is to reduce time and cost consumption.

Here, in the present invention, an annotation on a target area included in an image is performed by each of the users using a mobile device, and by generating an annotation image corresponding to the target area, data on a specific object is transmitted from each of the mobile devices. It can be easily collected, and when a mission such as additional shooting for a specific object is requested and performed, additional rewards for the mission may be provided. Of course, the additional rewards provided according to the mission may vary depending on the mission type, and the criteria for setting these additional rewards may vary depending on the data required for collecting data or the difficulty of the mission, and these criteria and additional reward values It may be determined by a business operator or an individual who provides the present invention.

In the present invention, annotating the target area may mean that coordinate values for the target area are information.

1 shows a system according to an embodiment for explaining the present invention.

As shown in FIG. 1, the system includes a plurality of mobile devices 100, a server 200, and a customer company 300 using information.

Each of the mobile devices 100 accesses the server through wired or wireless Internet, and an annotation for a target area generated by each of the mobile devices 100 and an annotation image corresponding to the target area, as well as an original image, that is, taken on a mobile device, or As a terminal capable of providing the acquired image to the server 200, all types of terminals capable of performing network access may be included.

For example, the mobile device 100 includes a notebook, a portable terminal, a smart phone, etc. that can set a target area through a touch input, and includes all user devices capable of performing the technology of the present invention by accessing a network. can do.

The mobile device 100 displays an image of a target object acquired by a camera, for example, a car, a license plate, a character on a license plate, a person's face, a specific object, etc. on the screen of the mobile device, and touches the mobile device. Touch input for use on the screen, for example, by setting the target area from the image through the action of rubbing the target area or drawing a figure including the target area, thereby generating an annotation for the set target area, based on the generated annotation. An annotation image corresponding to the target area can be created.

Here, the mobile device 100 may annotate the target area by converting the coordinate value of the target area, that is, the target area including the object to be annotated, into information through the setting of the target area.

Furthermore, when the image is acquired, the mobile device 100 automatically sets a target area corresponding to a specific object, for example, a car or a license plate, corresponding to a vehicle license plate, and a target area that is automatically set from the acquired image. By providing to the user, it is possible to automatically set the target area through user confirmation. Of course, when there are a plurality of objects set in the image, the mobile device 100 may automatically set the target area based on the priority according to the location. For example, when a mobile device includes a plurality of objects in an image, an object close to the center of the image may be set as an object of the target area, and then the target area may be set, or the object with the best sharpness based on the sharpness of the objects Can also be automatically set as the target area. In the case of automatically setting the target area, the annotation must be performed through the user's confirmation.

In the present invention, the mobile device 100 has been described as generating an annotation and an annotation image of a target area and providing it to a server, but the present invention is not limited thereto, and all kinds of data required for artificial intelligence learning may be provided to the server. have. For example, the mobile device 100 may provide location information, photographing time information, and information about the vehicle to the server through a user input when the target object is a vehicle.

Further, the mobile device 100 may obtain an image captured through a camera executed by the application in which an application for carrying out the present invention is installed and executed by the application, and the image stored in advance in the storage means of the device in the application is stored. By loading, you can also acquire an image.

Furthermore, the mobile device 100 provides additional information including annotation information on an image captured for a predetermined specific object, an annotation image and an original image, and additional information including a shooting location and a shooting time for the image as needed. In this case, a reward can be provided, and the reward can be used at a place affiliated with a company related to a specific object, for example, at a gas station, a charging station, a repair shop, or a vehicle purchase when a specific object is a car.

At this time, the mobile device 100 is a specific mission requested from the server, for example, additional photographing of a provided vehicle image, a request to confirm the type of the photographed vehicle, taking a picture of the vehicle for a vehicle license plate including a lucky number, schedule If additional information is provided to the server 200 according to need, annotation information, annotation image and original image for the mission performed by taking more than the number of times or more, additional rewards according to the type of mission performed can be provided. Additional rewards may vary depending on the mission.

Rewards and additional rewards provided to the mobile device 100 may be determined by a provider providing the present invention.

Furthermore, the user of the mobile device 100 can receive not only points as rewards through the application of the present invention, but also information about the vehicle of the transmitted image, new car price, used car price, maker, etc., advertisements, etc. This information can also be used to quickly check information about the car.

The network is a communication network that connects the mobile devices 100, the server 200 and the information-using customer 300, and uses a communication network (for example, a mobile communication network, wired Internet, wireless Internet, broadcasting network) that the network may include. Not only a communication method, but also short-range wireless communication between devices may be included. For example, the Internet is a personal area network (PAN), local area network (LAN), campus area network (CAN), metropolitan area network (MAN), wide area network (WAN), broadband network (BBN), and the Internet. It may include any one or more of the networks. In addition, the network may include any one or more of a network topology including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree, or a hierarchical network, but is not limited thereto. .

The server 200 collects annotation information, annotation images, and original images including objects from mobile devices, and provides an information service to a company related to the object, that is, an information-using customer 300, based on the collected image big data. As a server that provides, it collects additional information including annotation information, annotated image and original image for a specific object, as well as location information and shooting information, and learns artificial intelligence with the collected image big data or uses image big data. By creating a database for the object, an information service related to the object can be provided using the created database.

In this case, when the received information is related information, the server 200 may provide a reward for this to the mobile device 100.

Of course, the server 200 is not limited to receiving only the above-described data from the mobile device, and may receive all information required for providing an object-related information service or performing artificial intelligence learning.

In addition, the server 200 may convert the collected image big data into a database in order to provide an information service related to an object, and use the databased object-related data to provide an information service, for example, where the object is a car. In this case, information for each location, information for each time period, information for each type, etc. can be provided, or artificial intelligence can be learned.

At this time, the server 200 removes duplicates when the time and location are the same based on the received additional information when receiving additional information including location information and time information from the mobile device 100, and the object is By collecting image big data about objects using annotation information and annotation images, excluding annotation information and annotation images that are not included, duplicated information and information not related to the object are removed, and only information related to the object is collected as image big data. can do. As described above, the present invention can prevent unnecessary information from being collected, and when irrelevant information is provided depending on the situation, a notification may be provided to the user of the corresponding mobile device.

Furthermore, the server 200 may additionally receive information on additional missions performed by the mobile device 200 by requesting the mobile device 200 for additional missions required for data collection, and Additional rewards may be provided to the mobile device 100.

The server 200 converts information on the object into a database using image big data collected for the object, and may provide information services to the information-using customer 300 by using this data.

For example, if the object is a car, the server 200 uses information-using customer 300 as a company related to a car, and provides information service related to a car. For example, car distribution by region, distribution by region according to vehicle type, distribution by time It can provide various information services related to automobiles, etc.

Furthermore, the server 200 may provide various services through artificial intelligence learning using data collected from each of the mobile devices 100.

Furthermore, the server 200 not only points when providing rewards to the mobile device 100, but also the specifications of the vehicle of the image transmitted from the mobile device 100, new car price, used car price, maker information, advertisements, etc. You can also provide

The information-using customer 300 is a company that receives information service related to an object provided by the server 200, and may include a terminal or a server of the information-using customer.

Here, the information-using customer 300 may provide the information usage fee for the use of the information service provided by the server 200 to the company operating the server 200, and the usage fee may be different depending on the type of information service used. .

This invention will be described in detail with reference to FIGS. 2 to 7 as follows.

FIG. 2 shows an exemplary diagram for explaining an information service process for the system of FIG. 1, and illustrates an exemplary diagram for a case where an object is a vehicle.

As shown in FIG. 2, a user of the mobile device 100 captures a car image using a camera, sets a target area including a car in the captured image, annotates the car area, and then annotates the car area. If additional information including photographing time information, location information, direction information, etc. is provided to the server 200 according to the need for the annotation image and the photographed original image, the server 200 determines the appropriateness of the information. If it is determined that, by providing a preset reward, for example, points to the mobile device 100, the user of the mobile device 100 can obtain points obtained when purchasing a preset affiliate, such as a gas station, a charging station, a repair shop, or a vehicle. Can be used.

The server 200 collects annotation information, annotation images, original images, and additional information related to automobiles received from the mobile devices 100 as image big data, and converts the collected image big data into a database to create a database for automobiles. It is generated, and provides a vehicle-related information service to the information user using the vehicle database, so that the information usage fee for the vehicle information service can be received from the information user.

Here, the server 200 converts vehicle information, location information, vehicle image, customer information, etc., into a database using the collected vehicle image big data, so that distribution information about the vehicle, for example, vehicle distribution by time, Vehicle information services such as vehicle distribution by region and vehicle distribution can be provided.

Furthermore, the server 200 may learn a neural network using the collected image big data for artificial intelligence learning about a vehicle, and even if the image big data is updated through such artificial intelligence learning, the vehicle information service can be easily performed. Can be updated. Of course, the collection of image big data for artificial intelligence learning in the present invention, database creation using the collected image big data, artificial intelligence learning update, and database update can be appropriately adjusted within the scope of the technology according to the present invention.

3 is a flowchart illustrating an operation of a method for providing an information service using image big data according to an embodiment of the present invention.

Referring to FIG. 3, a method according to an embodiment of the present invention captures an image including a target object to be annotated using a camera provided in the mobile device in each of the mobile devices, thereby obtaining an image, and When an image including a is acquired, the acquired image is displayed on the screen of the mobile device, and a target area to be annotated through a user input, for example, a touch input, is set on the displayed image (S310).

Here, step S310 is not limited to acquiring an image only by photographing using a camera, but an image including a target object photographed by another person and transmitted from another person, an image including a target object previously stored in the user's mobile device, etc. In the present invention, all types of images that can be used for artificial intelligence learning may be included.

In addition, in step S310, the target area may be automatically set based on the action of rubbing the touch screen on the image. For example, when a touch is input diagonally, a rectangle having a diagonal line may be set as the target area. That is, in step S310, the target area may be set using any method capable of setting the target area through a user's touch input, and the set target area may be modified or added through the user's input.

For example, as illustrated in FIG. 4, when the acquired image is an image 410 including a vehicle, and the corresponding image 410 is displayed on the screen of the mobile device 400, the vehicle is displayed through a user's touch input. A target area 420 for the target area may be set, and when the target area 420 is set, an annotation for the set target area is performed or generated.

Here, the target region may be annotated by making information about coordinate values of the target region, for example, the minimum and maximum values of the X-axis and the minimum and maximum values of the Y-axis for the target region.

In this case, the coordinate value for the target area may be stored as an annotation file.

Further, in the present invention, the method of setting the target area is not only the above-described method, but also as shown in FIG. 5, selecting a partial area including a target object, for example, a car, in a zigzag method through a user's touch input, or It is also possible to select in a direction, counterclockwise, or diagonally, and set a target area for a vehicle based on information on a preset object, that is, information on a vehicle. The method of setting the target area in FIG. 5 is a method of automatically setting a target object including a partial area selected by the user as a target area using information on a partial area including the target object and information on the target object. The method of setting the target area may include both the method of FIG. 4 and the method of FIG. 5, as well as all methods of setting the target area including the target object based on a touch.

The application related to the present invention installed in the mobile device of the present invention may display a guideline of a certain shape, for example, a'+' shape, to prevent a case where the focus is out of focus in the process of acquiring an image including a target object. Alternatively, forced focusing can be performed in the center of the guideline. In addition, in order to prevent shaking, hand shake correction may be forcibly applied, or shooting may be performed only within a specified acceleration sensor value fluctuation range. Also, the resolution of the captured image may be determined in consideration of the processing speed in the server or may have a preset resolution. In addition, in order to solve the problem of insufficient memory when taking a picture, the recorded image can be temporarily stored in RAM and then deleted. If the same image is continuously uploaded, check whether the picture is the same by using the recording time, GPS, gravity sensor, and gyro sensor information. It can be filtered afterwards. In addition, in order to prevent a case where a car image displayed on a computer screen is captured rather than a case where an actual car image is taken, it may be blocked using an artificial intelligence network that detects a regular grid pattern taken together when the computer screen is taken. Furthermore, in order to prevent inaccurate transmission of location information, if three or more GPS satellites are being received, it can be determined as outdoors and used as it is, and if less than three GPS satellites are being received, it is determined as indoors and recently stored. Location information can be used, or when the location information is not confirmed, the application's photo-taking function can be stopped and the user can be guided to take a picture in an area where location can be checked. In addition, it is possible to block transmission of vehicles whose license plate area is not recognized through the vehicle license plate recognition artificial intelligence network. In addition, the present invention provides a notification of re-photographing the target object when the target area is smaller than a predetermined size when setting the target area in the image, so that the target object can be properly captured.

When a target object, for example, a target area including a vehicle is set in step S310, annotation information and an annotation image corresponding to the target area are generated by performing an annotation operation on the target area (S320).

Here, in step S320, the target area may be cropped using coordinate value information of the target area based on the annotation information, and an image of the target area corresponding to the coordinate value information may be generated as an annotation image.

When the annotation information and the annotation image are generated in step S320, the annotation information corresponding to the generated coordinate value information, the annotation image corresponding to the target area, the original image, and additional information are provided to a preset server, that is, an information service for the target object. It transmits to the providing server (S330).

Here, the mobile device of the present invention may transmit the annotation image to the server, but is not limited thereto, and information on the target area, for example, in the case of a car license plate, the car number identified by the user or the car number identified by the application of the mobile device. Can also be provided as a server.

The server receives the annotation information, the annotation image, the original image and additional information transmitted from the mobile devices, and if the received information is determined to be suitable data for the target object, it provides a preset reward to the user of the mobile device (S340). , S350).

Here, in the present invention, whether or not appropriate data for the target object is determined may be determined by determining whether or not the target object is duplicated with information already received, and whether or not the target object is included. For example, in the present invention, it is possible to determine whether the received information overlaps with the already received information by using the location information and time information included in the additional information according to need. Through processing, it is possible to determine whether or not a target object, for example, a car is included.

At this time, the reward provided to the user may be calculated as points, and may be converted into various coupon types according to the calculated point score, and the converted coupon may be used by affiliates.

In this case, the reward provided to the user may include the specifications of the vehicle of the image transmitted by the user, the price of a new car, the price of a used car, information on a maker, etc., and an advertisement.

As shown in FIG. 6, the additional information received through step S340 may include various information such as a photographing time, a photographing position, a resolution, and a direction for the corresponding image.

When the image big data on the target object is collected for a certain period of time, the image big data on the collected target object is converted into a database to create a database (DB) for the target object (S360).

Here, in step S360, the target object, for example, vehicle information on a vehicle, location information, vehicle image, time information, customer information, trim information, and the like may be converted into a database.

In the method of receiving image big data for the target object in step S360, the user of the mobile device may directly photograph and provide the target object, but is not limited thereto, and in order to additionally collect data on the target object, the server Specific missions can be provided to mobile device users. For example, when the collected image is not clear or an additional image is required, a request for the request may be requested to the mobile device of the user, thereby additionally receiving an image for a corresponding mission to collect data. Of course, the present invention can provide an additional reward for taking an additional image to a corresponding user.

As another example, if a vehicle image of a license plate including a specific number is provided as a mission, an image of a vehicle including a specific number may be collected, and an additional reward for the mission may be provided to a user who performs the mission.

As another example, when an image including multiple vehicles is received, image data on the middle vehicle may be collected by providing a mission for requesting an image of a specific vehicle, for example, a middle vehicle among the corresponding vehicles.

In addition, the method according to the present invention may provide various methods for collecting an image of a target object, and such a method may include a method of providing an additional reward to a user.

Further, the method according to the present invention can securely process the area or information corresponding to personal information for the security of personal information when personal information, for example, a person's face, is included in the collected image big data. The method of performing the processing may be performed by various methods such as cropping and blurring of the target area. Of course, a method of securely processing personal information is not limited thereto, and all methods that can be used in the present invention may be included.

When the DB for the image big data collected for the target object is generated in step S360, an information service related to the target object is provided to the information user based on the DB for the image big data (S370).

As described above, the method according to the present invention collects an image generated for artificial intelligence learning or information collection based on a touch of a mobile device such as a smartphone, and a target object, for example, based on the collected image and information thereon. , It can provide information services related to automobiles.

For example, the present invention collects annotation information related to a vehicle, an annotation image, as well as an original image from each mobile device, and provides an information service related to a vehicle by using the collected image big data on the vehicle. By providing rewards to users of mobile devices that provide annotation information and annotation images as well as original images, it is easy to collect car images, collect data required for artificial intelligence learning, and are required to perform annotations. You can save time and money consumption.

That is, the present invention can reduce the cost and time required for annotation, and facilitate data collection because a plurality of general users using mobile devices perform annotation of images required to provide artificial intelligence learning or information services. Therefore, artificial intelligence learning can be performed quickly, and various information services related to the target object can be provided to information users.

Further, the method according to the present invention provides a notification to the user when the annotation is performed on the target object while the annotation on the same target object has already been performed and the annotation image has already been transmitted to the server, and the provided notification is provided. It is also possible to determine whether to perform a process for generating and transmitting an annotation and an annotation image through the user's judgment.

At this time, the annotation and image generation process for the same target object may be set not to be performed more than a certain number of times, and the number of settings may be set by a business operator or individual providing the technology of the present invention, or the setting item of the corresponding application It can also be set through.

7 shows the configuration of an information service providing system using image big data according to an embodiment of the present invention, and shows the configuration of the servers of FIGS. 1 and 2. Here, the system of FIG. 7 may include all the contents of FIGS. 1 to 6.

Referring to FIG. 7, a system 700 according to an embodiment of the present invention includes a reception unit 710, a collection unit 720, a reward unit 730, and a service unit 740.

The receiving unit 710 receives annotation information of an image transmitted from at least one mobile device, an annotation image corresponding to the annotation information, and an original image.

Here, the receiving unit 710 may additionally receive additional information including a photographing time, a photographing location, and direction information for the corresponding image.

Further, the receiving unit 710 may receive additional information according to mission performance when a mission for collecting additional images or information is provided to the user and the mission is performed by the user.

The collection unit 720 collects the annotation information, the annotation image, and the original image received from at least one or more mobile devices as image big data for a preset object.

Here, the collection unit 720 removes duplicates when the time and location are the same based on the received additional information, and uses the remaining annotation information and annotation images excluding the annotation information and the annotation image without the target object to provide an image for the target object. Big data can be collected.

The reward unit 730 provides corresponding annotation information, a corresponding annotation image, and a reward for the original image to each user of at least one mobile device.

Here, when the additional mission is performed and the additional mission is successfully performed, the reward unit 730 may additionally provide an additional reward for performing the additional mission to a corresponding user.

In this case, the reward unit 730 may provide not only points as a reward provided to a user, but also a specification for a vehicle of a transmitted image, a new car price, a used car price, information on a maker, etc., an advertisement, and the like.

The service unit 740 provides an object-related information service based on the collected image big data.

Here, the service unit 740 may convert information on an object into a database using the collected image big data, and provide an object-related information service based on the information on the databased object.

Further, when the target object is a vehicle, the service unit 740 may provide at least one of information for each location, information for each time slot, and information for each type on the vehicle based on additional information and image big data as an information service.

Although the description thereof is omitted in the system of FIG. 7, each component constituting FIG. 7 may include all the contents described in FIGS. 1 to 6, which is obvious to those skilled in the art.

The system or device described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the systems, devices, and components described in the embodiments are, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA). ), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. Further, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to operate as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or, to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodyed in a transmitted signal wave. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiments may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

As described above, although the embodiments have been described by the limited embodiments and drawings, various modifications and variations are possible from the above description to those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as systems, structures, devices, circuits, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and those equivalent to the claims also fall within the scope of the claims to be described later.

Claims (14)

Transmitting the annotation information of the image and the annotation image corresponding to the annotation information from the mobile device;
Receiving the annotation information and the annotation image transmitted from at least one mobile device in a server;
Collecting, in the server, the annotation information and the annotation image received from the at least one mobile device as image big data for a preset object; And
Providing an information service related to the object based on the collected image big data in the server
Including,
The transmitting step
Obtaining an image including the object;
Setting a target area in the acquired image;
Generating the annotation information and the annotation image for the set target area; And
Transmitting the generated annotation information, the annotation image, and the acquired image to the server
Including,
The step of setting the target area
When a plurality of preset objects are included in the acquired image, an object having the best sharpness among the objects is automatically set as the target area,
Generating the annotation image
When annotation on the same object has already been performed and the annotated image and the acquired image are already transmitted to the server and the annotation on the same object is performed again, a notification is provided to the user, and the user Decide whether to generate annotations based on the input of
Generating the annotation image
An information service providing method using image big data that limits the generation of annotations more than a predetermined number of times for the same object.
The method of claim 1,
The providing step is
An information service using image big data, characterized in that information on the object is converted into a database using the collected image big data, and an information service related to the object is provided based on the information on the databased object. Delivery method.
The method of claim 1,
The receiving step
Receiving additional information including location information and time information of the original image for the annotation image from the at least one mobile device,
The collecting step
If the time and location are the same based on the received additional information, redundancy is removed, and image big data for the object is collected using the annotation information and annotation images other than the annotation information and the annotation image without the object. A method of providing information service using image big data.
The method of claim 1,
Providing a reward for the annotation information and the annotation image from the server to the user of the first mobile device
An information service providing method using image big data, characterized in that it further comprises.
The method of claim 4,
The step of paying the reward
When a specific mission related to the object is requested from the server to the first mobile device, and an execution result corresponding to the specific mission is received from the first mobile device, an additional reward set in advance according to each of the specific missions is provided to the first mobile device. 1 A method of providing an information service using image big data, characterized in that additional payments are made to a user of a mobile device.
The method of claim 1,
The receiving step
Receiving additional information including location information and time information of the original image for the annotation image from the at least one mobile device,
The providing step is
When the object is a vehicle, information using image big data, characterized in that at least one of information for each location, information for each time slot, and information for each type is provided as an information service based on the additional information and the image big data. How to provide the service.
delete A receiver configured to receive annotation information of an image transmitted from at least one mobile device and an annotation image corresponding to the annotation information;
A collection unit that collects the received annotation information and annotation image as image big data for a preset object; And
A service unit that provides an information service related to the object based on the collected image big data
Including,
The receiving unit
Obtaining an image including the object from each of the at least one mobile device, setting a target area from the acquired image, generating the annotation information and the annotation image for the set target area, and the By transmitting the generated annotation information, the annotation image, and the obtained image, the annotation information and the annotation image are received,
In each of the at least one mobile device
When a plurality of preset objects are included in the acquired image, an object with the best sharpness among the objects is automatically set as the target area, and the same object is already annotated, and the annotated image and the acquired When the annotation on the same object is performed again while the image has already been transmitted to the server, a notification is provided to the user, and it is determined whether or not to generate the annotation based on the user's input, and for the same object in advance. An information service providing system using image big data that limits the generation of annotations more than a set number of times.
The method of claim 8,
The service unit
An information service using image big data, characterized in that information on the object is converted into a database using the collected image big data, and an information service related to the object is provided based on the information on the databased object. Delivery system.
The method of claim 8,
The receiving unit
Receiving additional information including location information and time information of the original image for the annotation image from the at least one mobile device,
The collection unit
If the time and location are the same based on the received additional information, redundancy is removed, and image big data for the object is collected using the annotation information and annotation images other than the annotation information and the annotation image without the object. An information service providing system using image big data.
The method of claim 8,
A reward unit that provides a reward for the annotation information and the annotation image to each user of the at least one mobile device
Information service providing system using image big data, characterized in that it further comprises.
The method of claim 11,
The reward unit
When a specific mission related to the object is requested from the first mobile device, and a result corresponding to the specific mission is received from the first mobile device, additional rewards preset according to each of the specific missions are provided to the first mobile device. An information service providing system using image big data, characterized in that additional payments are made to the user.
The method of claim 8,
The receiving unit
Receiving additional information including location information and time information of the original image for the annotation image from the at least one mobile device,
The service unit
When the object is a vehicle, information using image big data, characterized in that at least one of information for each location, information for each time slot, and information for each type is provided as an information service based on the additional information and the image big data. Service delivery system.
delete

Images