KR20200062158A - Method and system for filtering image using point of interest - Google Patents

Abstract

Disclosed are a method and a system for filtering an image using a point of interest. The image filtering method includes the steps of: accessing at least one image storage related to a user when trying to register an image as reviewing information on a point of interest specified by the user; and providing an image corresponding to the information related to the point of interest among images in the image storage by mapping the information related to the point of interest and image file information in the image storage.

Description

Method and system for filtering images using points of interest{METHOD AND SYSTEM FOR FILTERING IMAGE USING POINT OF INTEREST}

The description below relates to techniques for filtering images.

Due to the social trend that the public's interest in food and cooking related information has increased significantly in recent years, contents provided by various media such as TV, magazines, etc. Through this, it became easy to access.

In addition, the above-mentioned restaurant information is naturally constructed by region, menu, price, etc. through the Internet, so that it is easy to access only by searching through a search site.

In general, the restaurant information includes information on the main menu, food picture, price, and taste of the restaurant, as well as information on the area where the restaurant is located, a map, etc., and is mainly provided in the form of posts through blogs on the Internet. have.

As described above, photos can be freely shared among users on the Internet. For example, in Korean Patent Publication No. 10-2015-0061727 (published on June 05, 2015), the interpretation of people's unique interpretation of various topics on-line Disclosed is a method for providing a picture-related service that provides a space for sharing a picture.

Provides a method and system for filtering an image based on the location of the point of interest when registering review information for the point of interest.

Provided is a method and system capable of providing a filtered image based on the location of a point of interest by distinguishing it from other images.

A method executed in a computer system, the computer system comprising at least one processor configured to execute computer readable instructions contained in memory, the method being specified by a user, by the at least one processor Accessing at least one image repository associated with the user when registering an image as review information on a point of interest; And providing, by the at least one processor, information corresponding to the point of interest among the images on the image store by mapping information related to the point of interest and image file information in the image store. Gives

According to one aspect, the providing may include querying the image file information using at least one of location information of the point of interest and time information when the user visited the point of interest.

According to another aspect, the providing may include filtering an image corresponding to the location information of the point of interest among the images on the image storage.

According to another aspect, the providing may include filtering an image corresponding to time information of the user visiting the point of interest among images on the image storage.

According to another aspect, the providing step may include filtering an image corresponding to the selected object as a result of image analysis by analyzing an image on the image storage when an object to be reviewed is selected at the point of interest. .

According to another aspect, the point of interest may be specified as a point of interest in which the user's visit is verified through uploading of a receipt.

According to another aspect, the step of accessing may access an image repository obtained by an access authority in the service subscription process of the user or an image repository selected by the user.

A computer-readable recording medium having a program for executing the method on a computer is provided.

A computer system, comprising: a memory; And at least one processor coupled to the memory and configured to execute computer readable instructions contained in the memory, wherein the at least one processor registers an image as review information for a point of interest specified by a user. If desired, the image corresponding to the point of interest among the images on the image store is accessed by accessing at least one image store related to the user and mapping information related to the point of interest and image file information in the image store. It provides a computer system characterized in that it provides.

According to embodiments of the present invention, when registering review information on a point of interest, an image may be filtered based on the location of the point of interest, and the filtered image based on the location of the point of interest may be distinguished from other images. Can provide.

According to embodiments of the present invention, by providing a filtered image based on a point of interest in the service stage, it is possible to shorten the image search time of the review producer and induce simple and fast image selection.

1 is a diagram showing an example of a network environment according to an embodiment of the present invention.
2 is a block diagram illustrating an internal configuration of an electronic device and a server according to an embodiment of the present invention.
3 is a block diagram illustrating an example of components that a processor of a server may include according to an embodiment of the present invention.
4 is a flowchart illustrating an example of a method that can be performed by a server according to an embodiment of the present invention.
5 is for explaining an example of the process of producing a list of points of interest in an embodiment of the present invention.
6 illustrates an example of a process for confirming a user's visit in an embodiment of the present invention.
7 illustrates another example of a process of confirming a user's visit in one embodiment of the present invention.
8 shows an example of a process of filtering an image using a point of interest in an embodiment of the present invention.
9 shows an example of a screen displaying a filtered picture in one embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Embodiments of the present invention relate to a technique for filtering an image, and more particularly, to a method and system for filtering an image using the point of interest when registering review information for the point of interest.

Embodiments including those specifically disclosed herein can filter an image based on the location of the point of interest when registering review information for the point of interest, thereby improving efficiency, convenience, quality of service, etc. Significant advantages in terms can be achieved.

1 is a diagram showing an example of a network environment according to an embodiment of the present invention. The network environment of FIG. 1 shows an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. 1 is an example for explaining the invention, and the number of electronic devices or the number of servers is not limited as shown in FIG. 1.

The plurality of electronic devices 110, 120, 130, and 140 may be fixed terminals or mobile terminals implemented as a computer system. For example, a plurality of electronic devices (110, 120, 130, 140), smart phones (smart phone), mobile phones, navigation, computers, notebooks, digital broadcasting terminal, PDA (Personal Digital Assistants), PMP (Portable Multimedia Player) ), tablet PCs, game consoles, wearable devices, internet of things (IoT) devices, virtual reality (VR) devices, and augmented reality (AR) devices. For example, although the shape of a smartphone is shown as an example of the electronic device 110 in FIG. 1, in the embodiments of the present invention, the electronic device 110 is substantially different from the network 170 using a wireless or wired communication method. It may mean one of various physical computer systems capable of communicating with the electronic devices 120, 130, 140 and/or the servers 150, 160.

The communication method is not limited, and a communication method using a communication network (eg, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network, a satellite network, etc.) that the network 170 may include, as well as short-range wireless communication between devices are included. Can be. For example, the network 170 includes a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), and a broadband network (BBN). , Any one or more of the networks such as the Internet. Further, the network 170 may include any one or more of a network topology including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree, or a hierarchical network. It is not limited.

Each of the servers 150 and 160 communicates with a plurality of electronic devices 110, 120, 130, and 140 through a network 170 to provide commands, codes, files, contents, services, or the like, or a plurality of computers. It can be implemented with devices. For example, the server 150 may be a system that provides a first service to a plurality of electronic devices 110, 120, 130, 140 accessed through the network 170, and the server 160 is also a network ( It may be a system that provides a second service to a plurality of electronic devices (110, 120, 130, 140) accessed through (170). As a more specific example, the server 150 is a service that is intended for the application (eg, a place recommendation service, etc.) through an application as a computer program installed and driven on a plurality of electronic devices 110, 120, 130, and 140 As a first service, a plurality of electronic devices 110, 120, 130, and 140 may be provided. As another example, the server 160 may provide a service for distributing a file for installing and driving the above-described application to a plurality of electronic devices 110, 120, 130, 140 as a second service.

2 is a block diagram illustrating an internal configuration of an electronic device and a server according to an embodiment of the present invention. 2 illustrates an internal configuration of the electronic device 110 and the server 150 as an example of the electronic device. In addition, other electronic devices 120, 130, 140 or the server 160 may also have the same or similar internal configuration to the above-described electronic device 110 or the server 150.

The electronic device 110 and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223, and input/output interfaces 214 and 224. The memory 211, 221 is a non-transitory computer-readable recording medium, such as random access memory (RAM), read only memory (ROM), disk drive, solid state drive (SSD), flash memory, etc. And a permanent mass storage device. Here, a non-volatile mass storage device such as a ROM, SSD, flash memory, disk drive, etc. may be included in the electronic device 110 or the server 150 as a separate permanent storage device separate from the memories 211 and 221. In addition, the memory 211, 221 has an operating system and at least one program code (for example, a code installed for the electronic device 110 to provide a browser or a specific service installed on the electronic device 110). Can be stored. These software components may be loaded from a computer-readable recording medium separate from the memories 211 and 221. Such a separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, disk, tape, DVD/CD-ROM drive, and memory card. In other embodiments, software components may be loaded into memory 211 and 221 through communication modules 213 and 223 rather than a computer-readable recording medium. For example, at least one program is a computer program installed by files provided by a file distribution system (for example, the server 160 described above) that distributes installation files of developers or applications through the network 170. It may be loaded into the memories 211 and 221 based on (for example, the above-described application).

Processors 212 and 222 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Instructions may be provided to processors 212 and 222 by memory 211 and 221 or communication modules 213 and 223. For example, the processors 212 and 222 may be configured to execute instructions received according to program codes stored in a recording device such as the memories 211 and 221.

The communication modules 213 and 223 may provide a function for the electronic device 110 and the server 150 to communicate with each other through the network 170, and the electronic device 110 and/or the server 150 are different. A function for communicating with an electronic device (eg, the electronic device 120) or another server (eg, the server 160) may be provided. For example, the request generated by the processor 212 of the electronic device 110 according to the program code stored in the recording device, such as the memory 211, the server 150 through the network 170 under the control of the communication module 213 ). Conversely, control signals, commands, contents, files, etc. provided under the control of the processor 222 of the server 150 are communicated through the communication module 223 and the network 170 and the communication module 213 of the electronic device 110. ) To the electronic device 110. For example, control signals, commands, contents, files, and the like of the server 150 received through the communication module 213 may be transmitted to the processor 212 or the memory 211, and contents or files may be transferred to the electronic device ( 110) may be further stored as a storage medium (permanent storage device described above).

The input/output interface 214 may be a means for interfacing with the input/output device 215. For example, the input device may include devices such as a keyboard, mouse, microphone, and camera, and the output device may include devices such as displays, speakers, haptic feedback devices, and the like. As another example, the input/output interface 214 may be a means for interface with a device in which functions for input and output are integrated into one, such as a touch screen. The input/output device 215 may be configured with the electronic device 110 and one device. Further, the input/output interface 224 of the server 150 may be a means for interfacing with the server 150 or with an apparatus (not shown) for input or output that the server 150 may include. As a more specific example, the service configured by using the data provided by the server 150 or the electronic device 120 when the processor 212 of the electronic device 110 processes a command of a computer program loaded in the memory 211. The screen or content may be displayed on the display through the input/output interface 214.

Also, in other embodiments, the electronic device 110 and the server 150 may include more components than those in FIG. 2. However, there is no need to clearly show most prior art components. For example, the electronic device 110 may be implemented to include at least some of the input/output devices 215 described above, or other components such as a transceiver, a Global Positioning System (GPS) module, a camera, various sensors, and a database. It may further include. As a more specific example, when the electronic device 110 is a smartphone, an acceleration sensor or a gyro sensor, a camera module, various physical buttons included in a smartphone, buttons using a touch panel, input/output ports, and a vibrator for vibration Various components, such as, may be implemented to be further included in the electronic device 110.

First, the receipt-based place recommendation service will be described.

In this specification, the point of interest may refer to the main facilities on the map, and in particular, may refer to a place-based recommendation target such as a restaurant or a popular place.

In the embodiments of the present invention, a model for proving a user's visit based on a receipt for a point of interest in a place recommendation service platform and registering a review information of the point of interest by a user whose visit has been verified, recommending a point of interest based on this Would like to build

3 is a block diagram showing an example of components that a processor of a server may include according to an embodiment of the present invention, and FIG. 4 is an example of a method that can be performed by a server according to an embodiment of the present invention It is a flow chart showing.

The server 150 according to the present exemplary embodiment may provide a reward for a user review of a point of interest by implementing a reward model in a place recommendation service. In one example, the server 150 serves as a platform for providing a place recommendation service to a plurality of electronic devices 110, 120, 130, and 140 that are clients. The server 150 may provide a place recommendation service for a point of interest in conjunction with an application installed on the electronic devices 110, 120, 130, and 140. The place recommendation service platform provides registration of points of interest, provision of points of interest (recommendation, exposure, advertisements, etc.), matching between targeting elements for points of interest, alignment of points of interest, billing according to points of interest, distribution of profits to points of interest, etc. It can mean a server system to perform.

The processor 222 of the server 150 is a component for performing the method of providing compensation according to FIG. 4, as shown in FIG. 3, a visit proof unit 310, an information collection unit 320, and a place recommendation unit It may include (330). Depending on the embodiment, components of the processor 222 may be selectively included or excluded from the processor 222. Further, according to an embodiment, the components of the processor 222 may be separated or merged to express the function of the processor 222.

The processor 222 and the components of the processor 222 may control the server 150 to perform steps S410 to S430 included in the compensation providing method of FIG. 4. For example, the processor 222 and components of the processor 222 may be implemented to execute instructions according to code of an operating system included in the memory 221 and code of at least one program.

Here, the components of the processor 222 may be expressions of different functions performed by the processor 222 according to an instruction provided by the program code stored in the server 150. For example, the user visit verification unit 310 may be used as a functional expression of the processor 222 that controls the server 150 according to the above-described command so that the server 150 proves the user's visit to the point of interest. have.

The processor 222 may read necessary commands from the memory 221 loaded with commands related to the control of the server 150. In this case, the read command may include an instruction for controlling the processor 222 to execute steps S410 to S430 to be described later.

In step S410, the visit proof unit 310 may verify the user's visit by reading the receipt for the point of interest. The user can submit, ie upload, the receipt issued at the point of interest to the service platform through camera shooting or the like. In other words, the user may upload a previously photographed receipt image or a receipt image acquired in real time through shooting to the server 150. Accordingly, the visit proof unit 310 may verify the user's visit to the point of interest by reading the uploaded receipt and confirming the user's visit to the point of interest specified from the read result. As an example, the visit proof unit 310 may provide a character reading function (eg, an optical character reader (OCR), etc.), and extract information on the point of interest from the uploaded receipt through the character reading function, and the corresponding point of interest Users can check visits. At this time, the visit proof unit 310 may confirm that the user himself has visited the proof of visit based on the receipt, and may recognize the visit as a valid visit. The method of confirming the visit will be explained in detail later.

In step S420, the information collection unit 320 may collect the information extracted from the receipt as review information on points of interest visited by the user. The information collection unit 320 may store and maintain the review information on the point of interest in the database on the platform by matching the receipt image with the uploaded user information. The information collection unit 320 may obtain review information including point of interest information, visit information, menu information, and the like from a receipt submitted by the user. The review information may include information on the Internet related to information extracted from the receipt, as well as information extracted from the receipt. For example, if the point of interest is a restaurant, the point of interest information may include basic information such as the restaurant name (mutual name), telephone number, address, and industry, and the visit information includes the date and time the user visited the restaurant and the total number of people visited. Etc., and the menu information may include the quantity and price information for each individual menu ordered by the user, the total amount of payment, and the like. The information collection unit 320 may provide a user with a registration level and a reward level by checking in real time whether the point of interest is a place registered on the platform based on the information obtained from the receipt.

The server 150 can build and maintain the type of business, address, phone number, menu, and price of each point of interest previously registered in the platform as a database on the platform, and update the existing information in the database using the information collected from the receipt. Or you can register new information and process reviews. For example, the server 150 may update the information on the database by obtaining the type of business or the phone number of the location using the point of interest information. In addition, the server 150 may accumulate the information collected from the receipt to collect records related to the point of interest (eg, the number of visitors, the total sales status, the sales ranking by menu, etc.). In addition, if the point of interest information collected from the receipt does not exist on the database, the server 150 may register the point of interest as a new point of interest. The menu list is maintained for each point of interest on the database on the platform. Similarly, if there is no menu information collected from the receipt, it is also possible to register as a new menu.

The server 150 may collect and register review information that is directly input or selected by the user in addition to information collected from the receipt as review information on the point of interest. Users who have proved a visit to the point of interest with a receipt can upload images (including photos or videos) as review information for the point of interest, as well as register various types of evaluation information such as ratings and comments. . At this time, the server 150 may apply the weight of the review information of the user whose visit confirmation is verified through the receipt to be reflected on the platform. The server 150 provides review information on the point of interest to service users. In this case, review information of a user whose visit confirmation is verified through a receipt may be displayed separately from other review information. For example, an image uploaded by a user whose visit confirmation is verified through a receipt among images uploaded as review information on a point of interest may be displayed separately from other images.

In step S430, the place recommendation unit 330 may produce and recommend a list of points of interest including at least one point of interest. The place recommendation unit 330 may issue a list of points of interest including at least one point of interest among the points of interest visited by the user according to a user's request, and service users can subscribe to the list of points of interest issued by the user It can be recommended in the form. In addition, the place recommendation unit 330 may recommend points of interest, such as a specific purpose or theme, to service users based on records related to points of interest. For example, profile information (eg, age, gender, place of residence, interests, etc.) of a user who has proved a visit to a point of interest is used as reference data for recommendation, and through this, a'date place','family gathering place' on the platform 'You can recommend points of interest for a variety of purposes, such as. In addition, the place recommendation unit 330 may also recommend the'popular menu' at the point of interest based on the record of each menu of the point of interest, for example, the ranking of sales by menu.

5 is for explaining an example of the process of producing a list of points of interest.

Referring to FIG. 5, the user_A 510 may upload the receipt of the POI_1 of the point of interest he has visited to the place recommendation service platform 550 in the form of an image file through camera shooting or the like. Through the receipt upload, the visit of the user_A 510 to the POI_1 of interest can be proved.

The place recommendation service platform 550 may read the receipt of the point of interest POI_1 uploaded by the user_A 510 and obtain review information including the point of interest information, visit information, and menu information from the read result.

The place recommendation service platform 550 may store the review information on the POI_1 of interest point where the visit of the user_A 510 is proved and match the identification information of the user_A 510 and the receipt image file.

The user_A 510 can verify the visit through the receipt of POI_1 for the POI_1 of interest point he has visited, and upload and register the photo (and/or video) taken near POI_1 or POI_1 as review information for POI_1. Can be.

The place recommendation service platform 550 may utilize the review information obtained from the receipt uploaded by the user_A 510 in recommending the POI_1 of interest to service users.

The place recommendation service platform 550 may provide a reward to the user_A 510 who has registered the review information through the receipt upload for the POI_1 of interest. In particular, the place recommendation service platform 550 may distribute a portion of the platform revenue to the user_A 510 who first registered the review information when the point of interest POI_1 is a point of interest that does not exist on the platform.

The place recommendation service platform 550 may generate at least one point of interest in which a visit is proved as a receipt at the request of the user_A 510 as a point of interest list 501 and publish it as a subscribeable list. The point of interest list 501 may be directly selected by the user_A 510 or may be made of points of interest (for example, POI_1 to POI_4) classified according to a predetermined criterion (location, type of industry, recent review, etc.). .

The place recommendation service platform 550 may grant the user_A 510 who issued the interest point list 501 a copyright that is the right to the interest point list 501. The right recognition period for the point of interest list 501 is set to a predetermined predetermined period (for example, 1 year), and a reward may be provided to the user_A 510 during the period.

The place recommendation service platform 550 may recommend the interest point list 501 to service users, and the service users may subscribe to the interest point list 501.

Therefore, when the user_A 510 photographs the receipt of the point of interest he has visited and uploads it to the place recommendation service platform 550, the place recommendation service platform 550 displays the information extracted from the receipt by the user_A 510. A list of points of interest 501 that is automatically stored as review information of the visited points of interest and disclosed to the outside may be generated based on a list of points of interest where the review information is stored.

Hereinafter, a method of confirming the user's visit will be described.

The process of confirming the user's own visit is included in the above-described step (S410) and may be performed by the visit proof unit 310.

6 shows an example of a process for confirming a user's own visit.

Referring to FIG. 6, in step S601, when the receipt image file is uploaded from the user terminal, for example, the electronic device 110, the visit proof unit 310 is exchangeable image file format (EXIF) information included in the receipt image file Terminal information can be obtained from. EXIF information is an image file format used in the camera, and can include basic information such as the camera model name and exposure level, time information such as the shooting time, and location and spatial information such as latitude and longitude coordinates, elevation, and azimuth angle. have.

In step S602, the visit proof unit 310 compares the terminal information obtained from the receipt image file with the terminal information of the actual electronic device 110 that uploads the receipt image file, and whether or not the user visits the user according to whether the two terminal information match. Can judge. The visit proof unit 310 compares the terminal information photographed with the receipt at the time of uploading the receipt image file and the terminal information actually uploading the receipt and determines that the uploaded receipt is a receipt by the user's own photographing. It can be acknowledged that it is the user's own visit.

7 shows another example of a process of confirming a user's own visit.

Referring to FIG. 7, in step S701, when the receipt image file is uploaded from the electronic device 110, the visit proof unit 310 may acquire location information at the time of capturing the corresponding image, that is, the receipt shooting location, from the receipt image file. have. For example, the visit proof unit 310 may acquire location information tagged in the receipt image file or location information included in the EXIF information of the receipt image file.

In step S702, the visit proof unit 310 may extract the information on the point of interest from the receipt by reading the uploaded receipt image file through a text reading function, and the location of the point of interest using the information extracted from the receipt Information and visit times can be obtained. In other words, the visit proof unit 310 may obtain the address of the point of interest and the visit time from the result of reading the receipt.

In step (S703), the visit verification unit 310 uses the location record collected from the electronic device 110 when the receipt photographing location is near the address of the point of interest extracted from the receipt, and the It may be determined whether the location information of the device 110 has a history located within a certain radius of the location information of the point of interest. At this time, the visit proof unit 310 may prove that the receipt is due to the user's own visit when there is a history corresponding to the receipt information in the location record of the electronic device 110. In other words, the visit proof unit 310 determines if the user has a history of being located near the POI place indicated on the receipt before and after a predetermined time (for example, 1 hour) before and after the time indicated on the receipt, by judging as the point of interest actually visited by the user It can be acknowledged that it is the user's own visit.

Therefore, in the present embodiment, it is possible to effectively prevent the visiting proof using the receipt by confirming that the user himself has visited the proof of the visit based on the receipt and admitting the visit as a valid visit.

Hereinafter, specific embodiments of a method and system for filtering an image will be described.

The process of filtering the image is included in the process of registering the review information on the point of interest, and may be performed by the information collection unit 320 included in the above-described step (S420).

8 shows an example of an image filtering process.

Referring to FIG. 8, in step S801, the information collection unit 320 may acquire access rights to at least one image storage related to the user in the process of subscribing to the place recommendation service. For example, when the server 150 installs an application on the electronic device 110 and subscribes to a place recommendation service, the server 150 acquires access to an album (gallery) that is an image storage of the electronic device 110 through the application. can do. The server 150 is a local storage of the electronic device 110 in addition to the album in the electronic device 110, as well as other folders or locations (directories) in which images are stored, and can be linked with the server 150 and the electronic device 110. Users may have access to cloud storage or other electronic devices that are allowed access.

In step S802, when the user wants to register an image as review information for a specific point of interest, the information collection unit 320 may first check the location information of the point of interest. For example, the information collection unit 320 may identify information related to the point of interest visited by the user at the time the user uploads the receipt of the point of interest, for example, the location and time of visit of the point of interest, and the user receives the receipt. When you want to upload an image in the form of a review of points of interest that proved your visit, you can check the location information of the points of interest. At this time, the location information of the point of interest may be used as an image filtering condition. In addition, the information collection unit 320 is information for applying as an image filtering condition, and the location information of the point of interest to be reviewed by the user, as well as the visit time of the point of interest can be checked together.

In step S803, the information collecting unit 320 may filter the image stored in the image store having access authority by using the location information of the point of interest identified in step S802.

For example, the information collection unit 320 may search for location information tagged in the image file or location information included in the EXIF information of the image file by using the location information of the point of interest for the image stored in the image storage, At this time, based on the location information of the point of interest, an image having location information within a certain range may be selected.

As another example, the information collecting unit 320 may include an image to be uploaded by the user when the location information of the point of interest is confirmed through uploading a receipt for the point of interest to be reviewed by the user even if it is not an image store having access permission When a folder or location is selected, an image corresponding to the location information of the point of interest may be selected by using file information of the image included in the folder or location.

At this time, the information collection unit 320 may filter the image on the image store using the visit time along with the location information of the point of interest. In other words, the information collecting unit 320 may select an image captured before or after a predetermined range of time at which the user visited the point of interest (eg, about 1 hour or so) near the location of the point of interest visited by the user from the image on the image repository. .

In addition, the information collecting unit 320 may also select an image captured at the time of visit of the point of interest from among the images on the image store using the time at which the user visited the point of interest without considering location information of the point of interest. Do.

Accordingly, the information collecting unit 320 may filter the image corresponding to the information of the point of interest that the user wants to review by mapping the point of interest information held by the platform and the image file information in the image store through uploading the receipt of the user.

Furthermore, the information collection unit 320 may first provide a guide for selecting a specific review target, such as a menu unit, a store interior or exterior, of a point of interest that a user wishes to review, and at this time, among images on the image store It is also possible to filter the image corresponding to the selected review object through the guide. Whether the image on the image store is food or the foreground of a company can be identified through image analysis techniques such as machine learning. For example, from the information extracted from the user's receipt, when the industry of interest is an Italian restaurant and the menu consumed by the user is pasta, filter the image corresponding to Italian food or pasta among the images taken at the point of interest or food related You can weight the ranking of the image. If the user selects a guide to leave a review of the interior or exterior rather than the menu of the point of interest they have visited, similarly, the image for the interior or exterior is filtered out of the image taken at the point of interest, excluding food images. You can weight the ranking of the image.

In addition, the information collection unit 320 provides a list of images stored in the image storage so that the user can select an image to upload. At this time, the selected image for a point of interest to be reviewed by the user is exposed at the top of the list or Alternatively, it may be preferentially exposed to a separate recommended location.

9 shows an image selection screen 900 for selecting an image to be uploaded during a review process for a specific point of interest.

For example, when the user wants to upload an image as review information in the process of reviewing a specific point of interest, the information collecting unit 320 stores the image of the user through the image selection screen 900 as shown in FIG. 9. An image list 910 including thumbnails of images stored in the list may be provided.

At this time, the information collecting unit 320 filters the image taken near the point of interest to be reviewed by the user or the image taken at the time when the user visits the point of interest, and selects the filtered image 911 as an image selection screen 900 ) Can be displayed at the top of the image list 910 provided.

In addition to displaying the filtered image 911 at the top of the image list 910, in the image selection screen 900, a separate area or a specific location according to exposure priority or specific gravity (for example, the highest exposure priority or specific gravity) It is also possible to display the filtered image 911 on the location).

In addition, the information collecting unit 320 may display the filtered image 911 for a point of interest that the user wants to review differently from other images 912 by utilizing various display elements (frame border or size, etc.). have.

The information collection unit 320 may collect and register the image selected through the image selection screen 900 from the user as review information for the point of interest in the process of reviewing a specific point of interest.

Although the image filtering subject is described as being included in the server 150, the present invention is not limited thereto, and the server 150 transmits the point of interest information (location and/or time) to be reviewed by the user to the client including the image storage. It is also possible to filter directly from the client.

Furthermore, the server 150 may automatically tag related interest point information on another photo (or video) uploaded by the user using the receipt information uploaded by the user.

It is assumed that the record of the user uploading the receipt is stored and maintained on the platform, and it is confirmed that the user is visiting the uploaded receipt. The server 150 when the user uploads another picture in the same domain as the place recommendation service or through a related service (social networking service, data cloud service, etc.) that can be linked to the place recommendation service, the same user is existing in the picture. You can automatically tag the point of interest information of the uploaded receipt. For example, the server 150 compares the terminal information on which the receipt was taken and the terminal information on which the other photo was taken, or if it is determined that it is the same, or (user information uploading the receipt using deep learning on the platform or using existing information) Assuming you know) If the user who uploaded the receipt is included in another photo, check the location information included in the EXIF information of the other photo and the point of interest information of the previously uploaded receipt, and the point of interest mapped to the photo Information can be recorded.

Points of interest information that is automatically mapped to other photos using receipt information can be used in photo search and can be provided as a search result of the point of interest for photos when searching.

Therefore, in this embodiment, when a user uploads a picture through a place recommendation service or another service that can be linked to the place recommendation service, the same user can automatically tag the point of interest information in the picture using the previously uploaded receipt information You can use it when searching for photos.

According to the embodiments of the present invention, when registering review information for a point of interest, an image can be filtered based on the location of the point of interest, and the filtered image is distinguished from other images based on the location of the point of interest. Can be provided. Therefore, according to embodiments of the present invention, by providing a filtered image based on a point of interest in a service step, it is possible to shorten the image search time of the review producer and induce simple and fast image selection.

The device described above may be implemented with hardware components, software components, and/or combinations of hardware components and software components. For example, the devices and components described in the embodiments include a processor, controller, arithmetic logic unit (ALU), digital signal processor (micro signal processor), microcomputer, field programmable gate array (FPGA), programmable It may be implemented using one or more general purpose computers or special purpose computers, such as a logic unit, microprocessor, or any other device capable of executing and responding to instructions. The processing device may perform an operating system (OS) and one or more software applications running on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, a processing device may be described as one being used, but a person having ordinary skill in the art, the processing device may include a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that may include. For example, the processing device may include a plurality of processors or a processor and a controller. In addition, other processing configurations, such as parallel processors, are possible.

The software may include a computer program, code, instruction, or a combination of one or more of these, and configure the processing device to operate as desired, or process independently or collectively You can command the device. Software and/or data may be embodied in any type of machine, component, physical device, computer storage medium, or device in order to be interpreted by the processing device or to provide instructions or data to the processing device. have. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may continuously store a program executable on a computer or may be temporarily stored for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or several hardware combinations, and is not limited to a medium directly connected to a computer system, but may be distributed on a network. Examples of the medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks, And program instructions including ROM, RAM, flash memory, and the like. In addition, examples of other media include an application store for distributing applications, a site for distributing or distributing various software, and a recording medium or storage medium managed by a server.

As described above, although the embodiments have been described by a limited embodiment and drawings, those skilled in the art can make various modifications and variations from the above description. For example, the described techniques are performed in a different order than the described method, and/or the components of the described system, structure, device, circuit, etc. are combined or combined in a different form from the described method, or other components Alternatively, even if substituted or substituted by equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (9)

In a method running on a computer system,
The computer system includes at least one processor configured to execute computer readable instructions contained in memory,
The above method,
Accessing at least one image storage associated with the user when registering the image as review information on a point of interest specified by the user by the at least one processor; And
Providing, by the at least one processor, information related to the point of interest among images on the image store by mapping information related to the point of interest and image file information in the image store;
How to include. According to claim 1,
The providing step,
Querying the image file information using at least one of location information of the point of interest and time information when the user visited the point of interest.
How to include. According to claim 1,
The providing step,
Filtering an image corresponding to the location information of the point of interest from among the images on the image storage
How to include. According to claim 1,
The providing step,
Filtering an image corresponding to time information when the user visits the point of interest among images on the image storage
How to include. According to claim 1,
The providing step,
Filtering an image corresponding to the selected object as a result of image analysis by analyzing an image in the image store when an object to be reviewed is selected at the point of interest
How to include. According to claim 1,
The point of interest is specified as a point of interest in which the user's visit is proved through the receipt upload.
Method characterized by. According to claim 1,
The approaching step,
Accessing an image repository obtained by an access authority in the service subscription process of the user or an image repository selected by the user
Method characterized by. A computer-readable recording medium on which a program for executing the method of any one of claims 1 to 7 is recorded on a computer. In the computer system,
Memory; And
At least one processor coupled to the memory and configured to execute computer readable instructions contained in the memory
Including,
The at least one processor,
When registering an image as review information on a point of interest specified by a user, access to at least one image storage associated with the user,
Providing an image corresponding to information related to the point of interest among images on the image store by mapping information related to the point of interest and image file information in the image store
Computer system characterized by.

Images