KR102427830B1 - Method and system for filtering image using point of interest - Google Patents

Abstract

Methods and systems for filtering images using points of interest are disclosed. The image filtering method may include: accessing at least one image repository related to the user when registering an image as review information for a point of interest specified by the user; and providing an image corresponding to the information related to the POI from among the images in the image storage by mapping the information related to the POI with information on the image file in the image storage.

Description

METHOD AND SYSTEM FOR FILTERING IMAGE USING POINT OF INTEREST

The description below relates to techniques for filtering images.

Due to the recent social trend in which the public's interest in food and cooking-related information is greatly increasing, the general public also provides information about some hidden restaurants, which were passed on by word of mouth among some gourmets in the past, through various media such as TV and magazines. was easily accessible through

In addition, the above-mentioned restaurant information can be easily accessed through a search through a search site as data is naturally built by region, menu, price, etc. through the Internet.

In general, restaurant information includes information about the restaurant's main menu, food photos, prices, taste, etc., as well as information such as the region where the restaurant is located, a map, etc. have.

In this way, photos can be freely shared among users on the Internet. Disclosed is a method for providing a photo-related service that provides a space for sharing photos.

A method and system for filtering images based on the location of the point of interest when registering review information on the point of interest are provided.

A method and system for providing a filtered image based on the location of a point of interest, differentiated from other images, are provided.

A method executed on a computer system, the computer system comprising at least one processor configured to execute computer readable instructions contained in a memory, the method comprising: specified by a user, by the at least one processor; accessing at least one image repository related to the user when registering an image as review information for a point of interest; and providing, by the at least one processor, an image corresponding to the information related to the POI from among the images on the image storage by mapping the information related to the POI and information on the image file in the image storage. provides

According to an aspect, the providing may include inquiring the image file information using at least one of location information of the POI and time information when the user visited the POI.

According to another aspect, the providing may include filtering an image corresponding to the location information of the POI from among the images on the image storage.

According to another aspect, the providing may include filtering an image corresponding to information about a time when the user visited the POI from among the images on the image storage.

According to another aspect, the providing may include, when an object to be reviewed at the point of interest is selected, analyzing an image on the image storage and filtering an image corresponding to the selected object as a result of image analysis. .

According to another aspect, the POI may be specified as a POI at which the user's visit is verified through receipt upload.

According to another aspect, the accessing may include accessing an image storage acquired by the user in a service subscription process or an image storage selected by the user.

There is provided a computer-readable recording medium in which a program for executing the method in a computer is recorded.

A computer system comprising: a memory; and at least one processor coupled to the memory and configured to execute computer readable instructions contained in the memory, wherein the at least one processor registers an image as review information for a point of interest specified by a user. If the user wants to access at least one image repository related to the user, and map the information related to the point of interest and image file information in the image repository, an image corresponding to the information related to the point of interest from among the images on the image repository is selected. It provides a computer system, characterized in that it provides.

According to embodiments of the present invention, when you want to register review information for a point of interest, you can filter an image based on the location of the point of interest, and distinguish the filtered image based on the location of the point of interest from other images. can provide

According to embodiments of the present invention, by providing an image filtered based on a point of interest in the service stage, it is possible to shorten the image search time of the review producer and induce simple and quick image selection.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention.
2 is a block diagram for explaining the internal configuration of an electronic device and a server according to an embodiment of the present invention.
3 is a block diagram illustrating an example of components that a processor of a server may include according to an embodiment of the present invention.
4 is a flowchart illustrating an example of a method that a server may perform according to an embodiment of the present invention.
5 is for explaining an example of a process for producing a POI list according to an embodiment of the present invention.
6 illustrates an example of a process of confirming a user's own visit according to an embodiment of the present invention.
7 illustrates another example of a process of confirming a user's own visit according to an embodiment of the present invention.
8 is a diagram illustrating an example of a process of filtering an image using a point of interest according to an embodiment of the present invention.
9 shows an example of a screen displaying a filtered picture according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Embodiments of the present invention relate to image filtering technology, and more particularly, to a method and system capable of filtering an image by using the POI when review information on the POI is registered.

Embodiments including those specifically disclosed in this specification can filter images based on the location of the point of interest when registering review information for the point of interest, thereby improving efficiency, convenience, service quality, etc. Significant advantages can be achieved in terms of aspects.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention. The network environment of FIG. 1 shows an example including a plurality of electronic devices 110 , 120 , 130 , 140 , a plurality of servers 150 , 160 , and a network 170 . 1 is an example for explaining the invention, and the number of electronic devices or the number of servers is not limited as in FIG. 1 .

The plurality of electronic devices 110 , 120 , 130 , and 140 may be a fixed terminal implemented as a computer system or a mobile terminal. Examples of the plurality of electronic devices 110 , 120 , 130 , 140 include a smart phone, a mobile phone, a navigation device, a computer, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), and a portable multimedia player (PMP). ), tablet PCs, game consoles, wearable devices, Internet of things (IoT) devices, virtual reality (VR) devices, augmented reality (AR) devices, and the like. As an example, in FIG. 1 , the shape of a smartphone is shown as an example of the electronic device 110 , but in embodiments of the present invention, the electronic device 110 is substantially configured to be different through the network 170 using a wireless or wired communication method. It may refer to one of various physical computer systems capable of communicating with the electronic devices 120 , 130 , 140 and/or the servers 150 and 160 .

The communication method is not limited, and a communication method using a communication network (eg, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network, a satellite network, etc.) that the network 170 may include, as well as a short-distance wireless communication between devices may be included. can For example, the network 170 may include a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), and a broadband network (BBN). , the Internet, and the like. In addition, the network 170 may include any one or more of a network topology including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree, or a hierarchical network, etc. not limited

Each of the servers 150 and 160 communicates with the plurality of electronic devices 110 , 120 , 130 , 140 and the network 170 through a computer device or a plurality of computers providing commands, codes, files, contents, services, etc. It can be implemented in devices. For example, the server 150 may be a system that provides a first service to a plurality of electronic devices 110 , 120 , 130 , 140 connected through the network 170 , and the server 160 is also a network ( It may be a system that provides the second service to the plurality of electronic devices 110 , 120 , 130 , and 140 connected through 170 . As a more specific example, the server 150 uses an application as a computer program installed and driven in the plurality of electronic devices 110 , 120 , 130 , and 140 to provide a service (eg, a place recommendation service, etc.) may be provided to the plurality of electronic devices 110 , 120 , 130 , and 140 as a first service. As another example, the server 160 may provide a service for distributing a file for installing and driving the above-described application to the plurality of electronic devices 110 , 120 , 130 , and 140 as the second service.

2 is a block diagram for explaining the internal configuration of an electronic device and a server according to an embodiment of the present invention. In FIG. 2 , the internal configuration of the electronic device 110 and the server 150 will be described as an example of the electronic device. In addition, other electronic devices 120 , 130 , 140 or server 160 may also have the same or similar internal configuration as the aforementioned electronic device 110 or server 150 .

The electronic device 110 and the server 150 may include memories 211 and 221 , processors 212 and 222 , communication modules 213 and 223 , and input/output interfaces 214 and 224 . The memories 211 and 221 are non-transitory computer-readable recording media, and are non-transitory computer-readable recording media, such as random access memory (RAM), read only memory (ROM), disk drive, solid state drive (SSD), flash memory, and the like. It may include a permanent mass storage device. Here, a non-volatile mass storage device such as a ROM, an SSD, a flash memory, a disk drive, etc. may be included in the electronic device 110 or the server 150 as a separate permanent storage device distinct from the memories 211 and 221 . In addition, in the memories 211 and 221 , an operating system and at least one program code (eg, a browser installed and driven in the electronic device 110 or codes for an application installed in the electronic device 110 to provide a specific service) can be stored. These software components may be loaded from a computer-readable recording medium separate from the memories 211 and 221 . The separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD/CD-ROM drive, and a memory card. In another embodiment, the software components may be loaded into the memories 211 and 221 through the communication modules 213 and 223 rather than the computer-readable recording medium. For example, the at least one program is a computer program installed by files provided through the network 170 by a file distribution system (eg, the above-described server 160 ) for distributing installation files of developers or applications. It may be loaded into the memories 211 and 221 based on (eg, the above-described application).

The processors 212 and 222 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. The instructions may be provided to the processors 212 and 222 by the memories 211 and 221 or the communication modules 213 and 223 . For example, the processors 212 and 222 may be configured to execute received instructions according to program codes stored in a recording device such as the memories 211 and 221 .

The communication modules 213 and 223 may provide a function for the electronic device 110 and the server 150 to communicate with each other through the network 170 , and the electronic device 110 and/or the server 150 may communicate with each other through the network 170 . A function for communicating with an electronic device (eg, the electronic device 120 ) or another server (eg, the server 160 ) may be provided. For example, a request generated by the processor 212 of the electronic device 110 according to a program code stored in a recording device such as the memory 211 is transmitted to the server 150 through the network 170 under the control of the communication module 213 . ) can be transferred. Conversely, a control signal, command, content, file, etc. provided under the control of the processor 222 of the server 150 passes through the communication module 223 and the network 170 to the communication module 213 of the electronic device 110 . ) through the electronic device 110 may be received. For example, a control signal, command, content, or file of the server 150 received through the communication module 213 may be transmitted to the processor 212 or the memory 211 , and the content or file may be transmitted to the electronic device ( 110) may be stored as a storage medium (the above-described permanent storage device) that may further include.

The input/output interface 214 may be a means for interfacing with the input/output device 215 . For example, the input device may include a device such as a keyboard, mouse, microphone, camera, and the like, and the output device may include a device such as a display, speaker, haptic feedback device, and the like. As another example, the input/output interface 214 may be a means for an interface with a device in which functions for input and output are integrated into one, such as a touch screen. The input/output device 215 may be configured as one device with the electronic device 110 . In addition, the input/output interface 224 of the server 150 may be a means for interfacing with a device (not shown) for input or output that is connected to the server 150 or that the server 150 may include. As a more specific example, when the processor 212 of the electronic device 110 processes a command of a computer program loaded in the memory 211 , a service configured using data provided by the server 150 or the electronic device 120 . A screen or content may be displayed on the display through the input/output interface 214 .

In addition, in other embodiments, the electronic device 110 and the server 150 may include more components than those of FIG. 2 . However, there is no need to clearly show most of the prior art components. For example, the electronic device 110 is implemented to include at least a part of the above-described input/output device 215 or other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, and a database. may include more. As a more specific example, when the electronic device 110 is a smart phone, an acceleration sensor or a gyro sensor, a camera module, various physical buttons, a button using a touch panel, an input/output port, and a vibrator for vibration generally included in the smart phone Various components such as may be implemented to be further included in the electronic device 110 .

First, a receipt-based place recommendation service will be described.

In the present specification, the point of interest may mean encompassing major facilities on a map, and in particular, may mean a place-based recommendation target such as a restaurant or a popular place.

Embodiments of the present invention are a model for proving a user's visit based on a receipt for a point of interest in a place recommendation service platform, registering the review information of the point of interest by the verified user, and recommending a point of interest based on this. is to build.

3 is a block diagram illustrating an example of components that a processor of a server may include according to an embodiment of the present invention, and FIG. 4 is an example of a method that the server may perform according to an embodiment of the present invention is a flowchart showing

The server 150 according to the present embodiment may provide a reward for a user review on a point of interest by implementing a reward model in the place recommendation service. For example, the server 150 serves as a platform for providing a place recommendation service to a plurality of electronic devices 110 , 120 , 130 , and 140 that are clients. The server 150 may provide a place recommendation service for a point of interest in connection with an application installed on the electronic devices 110 , 120 , 130 , and 140 . The place recommendation service platform performs registration of points of interest, provision of points of interest (recommendation, exposure, advertisement, etc.), matching between targeting elements for points of interest, alignment of points of interest, charging according to points of interest provision, revenue distribution for points of interest, etc. It may mean a server system that performs

The processor 222 of the server 150 is a component for performing the method of providing a reward according to FIG. 4 , and as shown in FIG. 3 , a visit verification unit 310 , an information collection unit 320 , and a place recommendation unit 330 may be included. Depending on the embodiment, components of the processor 222 may be selectively included in or excluded from the processor 222 . In addition, according to an embodiment, the components of the processor 222 may be separated or combined to express the functions of the processor 222 .

The processor 222 and the components of the processor 222 may control the server 150 to perform the steps S410 to S430 included in the compensation providing method of FIG. 4 . For example, the processor 222 and components of the processor 222 may be implemented to execute instructions according to the code of the operating system included in the memory 221 and the code of at least one program.

Here, the components of the processor 222 may be expressions of different functions performed by the processor 222 according to instructions provided by the program code stored in the server 150 . For example, the user visit verification unit 310 may be used as a functional representation of the processor 222 that controls the server 150 according to the above-described instruction so that the server 150 certifies the user's visit to the point of interest. have.

The processor 222 may read a necessary command from the memory 221 in which the command related to the control of the server 150 is loaded. In this case, the read command may include a command for controlling the processor 222 to execute steps S410 to S430 to be described later.

In step S410, the visit verification unit 310 may verify the user's visit by reading the receipt for the point of interest. The user can submit or upload the receipt issued at the point of interest to the service platform through camera shooting, etc. In other words, the user may upload a pre-photographed receipt image or a receipt image acquired in real time through shooting to the server 150 . Accordingly, the visit verification unit 310 may verify the user's visit confirmation to the POI by reading the uploaded receipt and confirming the user's visit to the POI specified from the reading result. As an example, the visit verification unit 310 may provide a character reading function (eg, OCR (optical character reader), etc.), and extract information about the POI from the receipt uploaded through the character reading function to extract the corresponding POI of user visits. In this case, the visit verification unit 310 may confirm that the user himself/herself has visited in the receipt-based visit verification, and may recognize the visit as a valid visit only for the user himself/herself. The method of confirming that it is a personal visit will be described in detail later.

In step S420, the information collection unit 320 may collect the information extracted from the receipt as review information on the POI visited by the user. The information collection unit 320 may store and maintain the review information on the point of interest in a database on the platform by matching the receipt image with the user information who uploaded it. The information collection unit 320 may obtain review information including point of interest information, visit information, menu information, and the like, from a receipt submitted by the user. The review information may include information extracted from the receipt as well as information on the Internet related to the information extracted from the receipt. For example, if the point of interest is a restaurant, the point of interest information may include basic information such as a restaurant name (business name), phone number, address, and industry type, and the visit information includes the date and time the user visited the restaurant and the total number of people visited. and the like, and the menu information may include quantity and price information for each individual menu ordered by the user, the total amount of payment, and the like. The information collection unit 320 may check in real time whether the corresponding point of interest is a place registered on the platform based on the information obtained from the receipt, and may provide the user with the registration status and the level of compensation.

The server 150 can build and maintain the industry type, address, phone number, menu, menu price, etc. of the point of interest registered in advance on the platform as a database on the platform, and update the existing information on the database using the information collected from the receipt. Or, you can register new information and handle review aggregation. For example, the server 150 may update information on the database by using the POI information to obtain whether the business type or phone number of the corresponding location has been changed. In addition, the server 150 may accumulate information collected from the receipts to aggregate records related to points of interest (eg, the number of visitors, total sales status, sales ranking for each menu, etc.). Also, when the POI information collected from the receipt does not exist in the database, the server 150 may register the POI as a new POI. A menu list is maintained for each point of interest in the database on the platform. Similarly, if the menu information collected from the receipt does not exist, it is also possible to register it as a new menu.

The server 150 may collect and register review information directly input or selected by the user in addition to the information collected from the receipt as review information on the point of interest. Users who have verified their visit to the point of interest with a receipt can not only upload images (including photos and videos) as review information for the point of interest, but also register various types of evaluation information such as ratings and comments. . In this case, the server 150 may apply a weight to the review information of the user whose visit confirmation is verified through the receipt to be reflected in the platform. The server 150 provides review information on the point of interest to service users. In this case, the user's review information whose visit is verified through a receipt may be displayed separately from other review information. For example, an image uploaded by a user whose visit confirmation is verified through a receipt among images uploaded as review information for a point of interest may be displayed separately from other images.

In step S430 , the place recommendation unit 330 may produce and recommend a POI list including at least one POI. The place recommendation unit 330 may issue a POI list including at least one POI among the POIs visited by the corresponding user according to the user's request, and service users may subscribe to the POI list issued by the user. form can be recommended. Also, the place recommendation unit 330 may recommend a point of interest, such as a specific purpose or theme, to service users based on a record related to the point of interest. For example, the user's profile information (eg, age, gender, residence, interest, etc.) of a user who has visited a point of interest is used as reference data for recommendation, and through this, the 'date place' and 'family gathering place' on the platform are used. Points of interest for various purposes such as ' can be recommended. In addition, the place recommendation unit 330 may also recommend a 'popular menu' at the point of interest based on a record for each individual menu of the point of interest, for example, a sales ranking for each menu.

5 is for explaining an example of a process of producing a POI list.

Referring to FIG. 5 , user_A 510 may upload the receipt of the POI_1 to the POI visited by the user to the place recommendation service platform 550 in the form of an image file through camera shooting. The user_A 510's visit to the point of interest POI_1 may be verified by uploading the receipt.

The place recommendation service platform 550 reads the receipt of the point of interest POI_1 uploaded by the user_A 510 to obtain review information including the point of interest information, visit information, and menu information from the reading result.

The place recommendation service platform 550 may match and store the review information on the point of interest POI_1, where the visit of the user_A 510 is verified, with the identification information of the user_A 510 and the receipt image file.

User_A 510 can prove the visit through the receipt of POI_1 for the point of interest POI_1 visited by the user_A 510 can

The place recommendation service platform 550 may utilize the review information obtained from the receipt uploaded by the user_A 510 in recommending the point of interest POI_1 to service users.

The place recommendation service platform 550 may provide a reward to the user_A 510 who has registered review information for the point of interest POI_1 by uploading a receipt. In particular, when the point of interest POI_1 is a point of interest that does not exist on the platform, the place recommendation service platform 550 may distribute a portion of the platform revenue to user_A 510 who first registered review information.

The place recommendation service platform 550 may produce at least one POI whose visit is verified with a receipt according to the request of the user_A 510 as the POI list 501 and publish it as a subscribing list. The POI list 501 may be made of POIs (eg, POI_1 to POI_4) that are directly selected by user_A 510 or classified according to a predetermined criterion (location, industry, recent review order, etc.). .

The place recommendation service platform 550 may grant copyright, which is a right for the POI list 501, to the user_A 510 who has issued the POI list 501 . The right recognition period for the POI list 501 is set to a predetermined period (eg, one year) in advance, and a reward may be provided to the user_A 510 during the period.

The place recommendation service platform 550 may recommend the POI list 501 to service users, and the service users may subscribe to the POI list 501 .

Accordingly, when user_A 510 captures a receipt of a point of interest he has visited and uploads it to the place recommendation service platform 550 , the place recommendation service platform 550 transmits the information extracted from the receipt to the user_A 510 . A point of interest list 501 that is automatically stored as review information of the visited point of interest and disclosed to the outside based on the list of points of interest in which the review information is stored may be generated.

Hereinafter, a method of confirming the user's own visit will be described.

The process of confirming the user's own visit may be included in the above-described step S410 and performed by the visit verification unit 310 .

6 illustrates an example of a process of confirming a user's own visit.

Referring to FIG. 6 , in step S601 , when a receipt image file is uploaded from the user terminal, for example, the electronic device 110 , the visit verification unit 310 includes exchangeable image file format (EXIF) information included in the receipt image file. terminal information can be obtained from EXIF information is an image file format used for cameras, and it can include basic information such as camera model name and exposure degree, time information such as shooting time, location and spatial information such as longitude and latitude coordinates, elevation, and shooting azimuth. have.

In step (S602), the visit verification unit 310 compares the terminal information obtained from the receipt image file with the terminal information of the actual electronic device 110 for uploading the receipt image file, and whether the two terminal information matches whether or not the person visits. can be judged The visit verification unit 310 compares the terminal information that photographed the receipt at the time of uploading the receipt image file and the terminal information that actually uploads the receipt, and if they match, it is determined that the uploaded receipt is a receipt by the user's own shooting, It can be acknowledged that it is the user's own visit.

7 illustrates another example of a process of confirming a user's own visit.

Referring to FIG. 7 , when the receipt image file is uploaded from the electronic device 110 in step S701 , the visit verification unit 310 obtains location information at the time of photographing the corresponding image, that is, the receipt photographing location from the receipt image file. have. For example, the visit verification unit 310 may acquire location information tagged in the receipt image file or location information included in the EXIF information of the receipt image file.

In step S702, the visit verification unit 310 can extract information about the point of interest from the receipt by reading the uploaded receipt image file through a text reading function, and the location of the point of interest using the information extracted from the receipt Information and visit times can be obtained. In other words, the visit verification unit 310 may acquire the address and the visit time of the point of interest from the receipt reading result.

In step S703, the visit verification unit 310 uses the location record collected from the electronic device 110 when the receipt photographing location is near the address of the point of interest extracted from the receipt, before and after a certain period of time before and after the visit time of the point of interest. It may be determined whether there is a history in which the location information of the device 110 is located within a predetermined radius of the location information of the point of interest. In this case, when the history corresponding to the receipt information exists in the location record of the electronic device 110 , the visit verification unit 310 may prove the receipt by the user's own visit. In other words, the visit verification unit 310 determines the point of interest that the user actually visited when there is a history of the user being located near the POI place displayed on the receipt within a predetermined time (eg, 1 hour) before and after the time displayed on the receipt. It can be acknowledged that it is the user's own visit.

Therefore, in the present embodiment, by confirming that the user has visited in the proof of visit based on the receipt and acknowledging that the visit is valid only for the visit, it is possible to effectively prevent abusing of the proof of visit using the receipt.

Hereinafter, a specific embodiment of a method and system for filtering an image will be described.

The process of filtering the image is included in the process of registering review information for the POI. For example, it may be included in the above-described step S420 and performed by the information collecting unit 320 .

8 shows an example of an image filtering process.

Referring to FIG. 8 , in step S801 , the information collection unit 320 may acquire an access right to at least one image repository related to the user while the user subscribes to the place recommendation service. For example, when the server 150 installs an application on the electronic device 110 and subscribes to a place recommendation service, the server 150 acquires an access right to an album (gallery) that is an image storage of the electronic device 110 through the application. can do. In addition to the album within the electronic device 110 , the server 150 is a local storage of the electronic device 110 , as well as other folders or locations (directories) in which images are stored, as well as interworking with the server 150 and the electronic device 110 . of users may have access to the cloud storage or storage of other electronic devices that are allowed access.

In step S802 , when the user intends to register an image as review information for a specific point of interest, the information collection unit 320 may first check the location information of the point of interest. For example, the information collection unit 320 may determine information related to the point of interest visited by the user at the time the user uploads the receipt of the point of interest, for example, the location and visit time of the point of interest, and the user receives the receipt. When you want to upload an image in the form of a review for a point of interest that has proven to be visited by , you can check the location information of the point of interest. In this case, the location information of the POI may be used as an image filtering condition. In addition, the information collection unit 320 may check the location information of the POI that the user wants to review as well as the visit time of the POI as information to be applied as an image filtering condition.

In step S803, the information collection unit 320 may filter the images stored in the image storage having the access right by using the location information of the POI identified in step S802.

For example, the information collection unit 320 may inquire location information tagged in an image file or location information included in EXIF information of an image file using location information of a point of interest for an image stored in the image storage, In this case, an image having location information within a predetermined range may be selected based on location information of the POI.

As another example, the information collection unit 320 includes an image to be uploaded by the user when the location information of the point of interest is confirmed through receipt upload for the point of interest that the user wants to review, even if it is not an image storage having access right. When a folder or location is selected, an image corresponding to the location information of the point of interest can be selected by using file information of an image included in the folder or location.

In this case, the information collection unit 320 may filter the images on the image storage using the visit time together with the location information of the POI. In other words, the information collection unit 320 may select images taken before and after a certain range (eg, around 1 hour) of the time when the user visited the point of interest near the location of the point of interest visited by the user from among the images on the image storage. .

In addition, the information collection unit 320 may use the time that the user visits the point of interest without considering the location information of the point of interest to select an image taken around the visit time of the point of interest from among the images on the image storage. do.

Accordingly, the information collection unit 320 may filter the image corresponding to the information of the POI that the user wants to review by mapping the POI information held by the platform and the image file information in the image storage through the user's receipt upload.

Furthermore, the information collection unit 320 may first provide a guide for selecting a specific review target, such as a menu unit, an interior or exterior of a store, for a point of interest that the user wants to review, and in this case, from among the images on the image storage It is also possible to filter images corresponding to the review target selected through the guide. Whether the image on the image storage is food or the foreground of a company can be identified through image analysis technology such as machine learning. For example, from the information extracted from the user's receipt, when the industry of the point of interest is an Italian restaurant and the menu consumed by the user is pasta, from the images taken at the point of interest, images corresponding to Italian food or pasta are filtered or food related You can give weight to the ranking of images. If the user selects a guide that wants to leave a review on the interior or exterior rather than the menu of the point of interest he has visited, similarly, from the images taken at the point of interest, the image of the interior or exterior is provided by filtering out the food image, or You can give weight to the ranking of the image.

In addition, the information collection unit 320 provides a list of images stored in the image storage so that the user can select an image to upload. At this time, the selected image for the point of interest that the user wants to review is exposed at the top of the list or Alternatively, it may be preferentially exposed in a separate recommended location.

9 illustrates an image selection screen 900 for selecting an image to be uploaded in a review process for a specific POI.

For example, when the user wants to upload an image as review information in a review process for a specific point of interest, the information collection unit 320 may store the user's image through the image selection screen 900 as shown in FIG. 9 . It is possible to provide an image list 910 composed of thumbnails of images stored in the .

At this time, the information collection unit 320 filters the image taken near the point of interest that the user wants to review or the image taken around the time the user visited the point of interest, and displays the filtered image 911 on the image selection screen 900 ) can be displayed at the top of the image list 910 provided through.

In addition to displaying the filtered image 911 at the top of the image list 910, a separate area on the image selection screen 900 or a specific location according to the exposure priority or weight (eg, the highest exposure priority or weight) It is also possible to display the filtered image 911 in location).

In addition, the information collection unit 320 utilizes various display elements (frame borders or sizes, etc.) to display the filtered image 911 for the POI that the user wants to review differently so as to be distinguished from other images 912 . have.

The information collection unit 320 may collect and register an image selected by the user through the image selection screen 900 as review information on the corresponding point of interest in the review process for the specific point of interest.

Although it is described that the image filtering subject is included in the server 150, the server 150 is not limited thereto, and the server 150 transmits the POI information (location and/or time) that the user wants to review to the client including the image storage. It is also possible to filter directly on the client.

Furthermore, the server 150 may automatically tag the relevant POI information to another photo (or video) uploaded by the user using the receipt information uploaded by the user.

It is assumed that the record that the user uploads the receipt is stored and maintained on the platform, and that the user's own visit is confirmed for the uploaded receipt. When the user uploads another photo within the same domain as the place recommendation service or through a related service (social networking service, data cloud service, etc.) that can be linked with the place recommendation service, the same user is already included in the photo. You can automatically tag the POI information of the uploaded receipt. As an example, the server 150 compares the terminal information on which the receipt was taken and the terminal information on which other photos were taken and determines that they are the same, or (user information who uploaded the receipt using deep learning or existing information on the platform) (assuming that the user who uploaded the receipt is included in another photo) information can be recorded.

Point of interest information automatically mapped to other photos using receipt information can be utilized in a photo search, and may be provided as a search result of the corresponding point of interest for photos when searching.

Therefore, in this embodiment, when a user uploads a photo through a place recommendation service or another service that can be linked with a place recommendation service, the same user can use the previously uploaded receipt information to automatically tag the POI information on the photo. and can be used for photo search.

As such, according to embodiments of the present invention, when you want to register review information on a point of interest, you can filter an image based on the location of the point of interest, and distinguish the filtered image based on the location of the point of interest from other images. can be provided. Accordingly, according to embodiments of the present invention, by providing an image filtered based on the point of interest in the service step, it is possible to shorten the image search time of the review producer and induce simple and quick image selection.

The device described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, the devices and components described in the embodiments may include a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), and a programmable logic unit (PLU). It may be implemented using one or more general purpose or special purpose computers, such as a logic unit, microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that may include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

The software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be embodied in any type of machine, component, physical device, computer storage medium or device for interpretation by or providing instructions or data to the processing device. have. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. In this case, the medium may be to continuously store the program executable by the computer, or to temporarily store the program for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or several hardware combined, it is not limited to a medium directly connected to any computer system, and may exist distributed on a network. Examples of the medium include a hard disk, a magnetic medium such as a floppy disk and a magnetic tape, an optical recording medium such as CD-ROM and DVD, a magneto-optical medium such as a floppy disk, and those configured to store program instructions, including ROM, RAM, flash memory, and the like. In addition, examples of other media may include recording media or storage media managed by an app store that distributes applications, sites that supply or distribute other various software, and servers.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (9)

A method executed on a computer system, comprising:
the computer system comprising at least one processor configured to execute computer readable instructions contained in a memory;
The method is
accessing, by the at least one processor, at least one image repository related to the user when an image is to be registered as review information for a point of interest where the user's visit is verified through receipt upload;
selecting and providing, by the at least one processor, an image corresponding to the information related to the POI from among the images in the image storage by mapping the information related to the POI and information on the image file in the image storage; and
registering, by the at least one processor, an image selected from among images corresponding to the information related to the POI as review information on the POI;
including,
The information related to the POI includes information extracted from the receipt and information on the Internet related to the extracted information and is used as an image filtering condition for selecting images stored in the image storage,
The providing step is
Providing an image filtered based on the POI in the image storage as a search result for the POI
How to characterize. According to claim 1,
The providing step is
Inquiring the image file information by using at least one of the location information of the POI and the time information when the user visited the POI
How to include. According to claim 1,
The providing step is
filtering an image corresponding to the location information of the POI from among the images on the image storage;
How to include. According to claim 1,
The providing step is
filtering an image corresponding to the time information when the user visited the POI from among the images on the image storage;
How to include. According to claim 1,
The providing step is
filtering an image corresponding to the selected object as a result of image analysis by analyzing an image on the image storage when an object to be reviewed is selected at the POI;
How to include. delete According to claim 1,
The approaching step is
Accessing the image storage acquired by the user in the service subscription process or the image storage selected by the user
How to characterize. A computer-readable recording medium in which a program for executing the method of any one of claims 1 to 5 and 7 in a computer is recorded. In a computer system,
Memory; and
at least one processor coupled to the memory and configured to execute computer readable instructions contained in the memory
including,
the at least one processor,
a process of accessing at least one image storage related to the user when an image is to be registered as review information for a point of interest where the user's visit is verified through receipt upload;
a process of selecting and providing an image corresponding to the information related to the POI from among the images in the image storage by mapping the information related to the POI and image file information in the image storage; and
A process of registering an image selected from among images corresponding to the information related to the POI as review information on the POI.
process the
The information related to the POI includes information extracted from the receipt and information on the Internet related to the extracted information and is used as an image filtering condition for selecting images stored in the image storage,
the at least one processor,
Providing an image filtered based on the POI in the image storage as a search result for the POI
A computer system characterized by a.

Images