KR102274773B1 - System and method for providing shopping service - Google Patents

Abstract

According to the present invention, a shopping cart generating barcode information of a purchased product, a shopping data server generating consumer purchase information according to the barcode information, and recommended product information corresponding to the product according to the consumer purchase information are detected, and the recommendation There is provided a shopping service providing system including an advertisement server that generates advertisement information according to product information and provides the advertisement information to a terminal.

Description

A shopping service provision system and a shopping service provision method {SYSTEM AND METHOD FOR PROVIDING SHOPPING SERVICE}

The present invention relates to a technology for providing a shopping service, and more particularly, to a technology for providing a shopping service for providing shopping-related advertisements and shopping data.

A typical example of inconvenience to consumers using mart is the inconvenience of having to stand in line for a long time to pay.

In order to reduce the waiting time for a checkout, technologies such as attaching an RFID tag to a product for quick calculation have been devised, but attaching the tag to all products incurs time and money costs.

Therefore, in general marts, the clerk adheres to the method of recognizing and calculating barcodes pre-printed or attached to products through a barcode reader.

In addition, the general mart system is only at the level of offline display or online posting of events or planned products unilaterally provided by the mart, and cannot provide advertisement information related to the product that the consumer is currently purchasing in the mart.

Republic of Korea Patent Publication No. 2013-0119665

SUMMARY The technical problem to be solved by the present invention is to provide a shopping service providing system and a shopping service providing method.

The technical problems to be achieved by the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. There will be.

According to an aspect of the present invention, a shopping cart for generating barcode information of a purchased product; a shopping data server that generates consumer purchase information according to the barcode information; and an advertisement server for detecting recommended product information corresponding to the product according to the consumer purchase information, generating advertisement information according to the recommended product information, and providing the advertisement information to the terminal.

The advertisement server analyzes the big data of the shopping data server through a natural language processing (NLP) algorithm, selects a recommended product related to the consumer purchase information according to a preset association relationship, and selects information on the selected recommended product It is possible to detect the recommended product information.

The shopping data server may collect product information corresponding to each product and consumer information corresponding to the consumer, respectively, and update the shopping data of the database through big data analysis.

The consumer information may include purchase pattern information accumulating the consumer purchase information and online behavior data of the consumer.

The shopping data server may provide the shopping data to the terminal.

According to another aspect of the present invention, there is provided a method for providing a shopping service by a shopping service providing system, the method comprising: generating, by a shopping cart, barcode information of a purchased product; generating, by a shopping data server, consumer purchase information according to the barcode information; and detecting, by the advertisement server, recommended product information corresponding to the product according to the consumer purchase information, generating advertisement information according to the recommended product information, and providing the advertisement information to the terminal.

The step of detecting, by the advertisement server, recommended product information corresponding to the product according to the consumer purchase information, and generating advertisement information according to the recommended product information and providing the information to the terminal, includes the advertisement server using the big data of the shopping data server. Analyzing data through a natural language processing (NLP) algorithm, selecting a recommended product related to the consumer purchase information according to a preset correlation relationship, and detecting recommended product information, which is information of the selected recommended product can do.

The shopping service providing method may further include, by the shopping data server, collecting product information corresponding to each product and consumer information corresponding to the consumer, respectively, and updating the shopping data of the database through big data analysis.

The consumer information may include purchase pattern information accumulating the consumer purchase information and online behavior data of the consumer.

The shopping service providing method may further include the step of providing, by the shopping data server, the shopping data to the terminal.

According to another aspect of the present invention, there is provided a computer-readable recording medium storing a computer program for executing the shopping service providing method.

According to an embodiment of the present invention, it is possible to immediately recognize the product that the consumer is currently purchasing.

In addition, according to an embodiment of the present invention, an advertisement related to a product that the consumer is purchasing may be provided to the consumer.

In addition, according to an embodiment of the present invention, it is possible to provide data related to a consumer's shopping to businesses such as an advertising agency, a product manufacturer, and a distributor.

1 is a diagram illustrating a shopping service providing system according to an embodiment of the present invention.
2 is a view showing the configuration of a shopping cart according to an embodiment of the present invention.
3 is a view showing an external appearance of a shopping cart according to an embodiment of the present invention;
4 is a diagram illustrating a recognition area of a shopping cart according to an embodiment of the present invention.
5 is a diagram illustrating a barcode recognized by a shopping cart and a recognition rate thereof according to an embodiment of the present invention;
6 is a flowchart illustrating a process in which a shopping service providing system provides a shopping service according to an embodiment of the present invention.
7 is a flowchart illustrating a method for recognizing a product by a shopping cart according to an embodiment of the present invention.

Hereinafter, the present invention will be described with reference to the accompanying drawings. However, the present invention may be embodied in several different forms, and thus is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be “connected (connected, contacted, coupled)” with another part, it is not only “directly connected” but also “indirectly connected” with another member interposed therebetween. "Including cases where In addition, when a part "includes" a certain component, this means that other components may be further provided without excluding other components unless otherwise stated.

The terms used herein are used only to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In this specification, terms such as "comprises" or "have" are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a shopping service providing system according to an embodiment of the present invention.

Referring to FIG. 1 , a shopping service providing system according to an embodiment of the present invention includes a shopping cart 110 , an advertisement server 120 , and a shopping data server 130 .

The shopping cart 110 recognizes a barcode of a product that a consumer currently purchases in an offline store, generates barcode information, and transmits the barcode information to the shopping data server 130 . The shopping cart 110 will be described in detail later with reference to FIG. 2 .

The shopping data server 130 generates consumer purchase information including basic information such as a price of a product purchased by the user through the shopping shopping cart 110 , a manufacturer, and the like corresponding to the barcode information, and the display position of the product. The shopping data server 130 transmits consumer purchase information to the advertisement server 120 .

The advertisement server 120 detects recommended product information corresponding to the consumer purchase information from the shopping data server 130 . For example, the advertisement server 120 analyzes big data stored in the shopping data server 130 through a natural language processing (NLP) algorithm, and selects a recommended product associated with consumer purchase information according to a preset correlation relationship. and recommended product information, which is information of the selected recommended product, may be detected from the shopping data server 130 . The advertisement server 120 transmits advertisement information including recommended product information to the consumer terminal 10 . Accordingly, when the consumer purchases a product through the shopping cart 110 , the consumer may check the purchased product, his/her past purchase pattern, and advertisement information presenting a recommended product based on the user's online behavior.

The shopping data server 130 stores shopping data including at least one of product information such as product price, basic information of a manufacturer, etc., product display location, etc., a purchase pattern of a consumer, and online behavior data of a consumer. Save. For example, the shopping data server 130 receives and stores product information from each vendor terminal 20 , stores a purchase pattern that accumulates consumer purchase information, and receives online behavior data from the consumer terminal 10 , It is possible to store consumer information such as storage. After receiving product information or consumer information from each terminal, the shopping data server 130 may update the shopping data of the database through big data analysis. When the shopping data server 130 receives a request for shopping data from the consumer terminal 10 and the vendor terminal 20 , the shopping data server 130 transmits the corresponding shopping data to the terminal. For example, the shopping data server 130 provides sales information of own/third-party products to product manufacturers, and provides shopping data such as product information, marketing statistics, and customer information-based sales statistics related to each product to an advertising agency. In addition, shopping data such as the consumer's purchase order and the time the consumer stays in each area in the store can be provided to the retailer.

Meanwhile, the advertisement server 120 may receive weather information from the outside and provide purchase recommendation information for recommending and/or evaluating a product to the consumer terminal 10 using the received weather information.

Here, the purchase recommendation information may recommend a purchase for a designated food using the weather information or reflect consumption evaluation of a product for which barcode information is generated in the shopping cart 110 according to the weather information. For example, when receiving weather information of a specific fruit origin and determining that the harvest and/or quality of the fruit is a good harvest and/or higher than the reference value, the advertisement server 120 recommends purchasing the fruit as a seasonal fruit, or When the generation of barcode information on the corresponding fruit is completed, purchase recommendation information for evaluating that consumption (purchase) for the corresponding fruit is wise may be provided to the consumer terminal 10 .

In addition, if it is determined that the harvest and/or quality of the rice is poor and/or below the reference value by receiving the weather information of the specific rice origin, the Product Recommendation Department does not recommend the purchase of the rice or the barcode information for the rice is not recommended. When the generation is completed, purchase recommendation information for evaluating that consumption (purchase) of the corresponding rice is not wise may be provided to the consumer terminal 10 .

2 is a diagram illustrating a configuration of a shopping cart according to an embodiment of the present invention. 3 is a diagram illustrating an external appearance of a shopping cart according to an embodiment of the present invention. 4 is a diagram illustrating a recognition area of a shopping cart according to an embodiment of the present invention. 5 is a diagram illustrating a barcode recognized by a shopping cart and a recognition rate thereof according to an embodiment of the present invention.

Referring to FIG. 2 , a shopping cart according to an embodiment of the present invention includes a communication unit 210 , a recognition unit 220 , a transport unit 230 , and a storage unit 240 .

The communication unit 210 exchanges data with the shopping data server 130 through a designated protocol.

The recognition unit 220 generates an image by photographing a product in the shopping cart, and recognizes a region corresponding to a barcode in the image using a convolutional neural network (hereinafter, referred to as a barcode region) for the generated image. and generates barcode information according to the barcode area. The recognition unit 220 performs a pre-processing process according to a specified method for each image, extracts an object area corresponding to a product from each image, and extracts a candidate barcode area that is an area estimated to be a barcode area among the object areas. For example, the recognition unit 220 may detect the candidate barcode area through a predetermined method, such as detecting an area in which an edge in which values of adjacent pixels change rapidly among object areas continuously appear. The recognition unit 220 may input the candidate barcode region into a pre-trained convolutional neural network, and among the candidate barcode regions, the region classified as a class of the barcode region with the highest probability may be detected as the barcode region. The recognition unit 220 detects a barcode area among candidate barcode areas as shown in FIG. 5 through a convolutional neural network, and calculates a recognition rate indicating a probability of being classified into a class of the barcode area. In this case, the recognition unit 220 may include a recognition area in which a product can be located, as shown in 310 of FIG. 3 , and a plurality of cameras that generate an image by photographing a product placed in the recognition area. In this case, the plurality of cameras may generate an image by photographing the product in different directions as shown in 410 of FIG. 4 . In addition, the recognition unit 220 may include a weight sensor at the lower end of the recognition area so that, when a product is located in the recognition area, the above-described camera may be operated to generate an image. At this time, since each camera shoots a product in a plurality of directions, one or more of the images photographed by each camera may be an image of a barcode. In addition, a plurality of cameras may form a multi-channel image to capture a product in a shopping cart at 360 degrees without blind spots. For example, when it is assumed that the recognition area is a virtual cube, the plurality of cameras of the recognition unit 120 may generate an image by photographing in all directions (front, rear, left, right, top and bottom) of the cube.

The recognition unit 220 may transmit barcode information for each product to the shopping data server 130 through the communication unit 210 . The payment server connected to the shopping data server 130 may calculate the price of the product purchased by the user using the corresponding shopping cart through barcode information, and may perform payment for the product. Also, when the recognition rate is less than or equal to a specified threshold, the recognition unit 220 may transmit an inspection message informing that the user needs to inspect the corresponding product to the external server. Accordingly, the external server may display product information corresponding to the inspection message to the user through a terminal such as a kiosk to confirm whether the product directly purchased by the user is correct.

The transport unit 230 transports the product for which the generation of barcode information located in the recognition area has been completed through the power of the motor to the storage area located at the lower end of the recognition area.

The storage unit 240 includes a storage area ( 320 in FIG. 3 ) capable of accommodating a storage container such as a shopping cart so that, when the product is transported from the recognition area to the storage area, the product is accommodated in the storage container. The storage unit 240 may include a net for alleviating the impact on the product transported from the recognition area to the storage area, and may include a height adjustment module for adjusting the height of the corresponding net. For example, the storage unit 240 may control the height adjustment module to lower the height of the net as the weight of the recognized product is heavier. Accordingly, the storage unit 240 allows the product recognized in the storage container to be stored in the storage container, and the user can easily retrieve the purchased product through the storage container.

Meanwhile, the shopping cart according to an embodiment of the present invention includes a product recommendation unit (not shown) that receives weather information from an external server through the communication unit 110 and recommends and/or evaluates products using the received weather information. may include more.

Here, the product recommendation unit may recommend a purchase for a designated food using the weather information, or may perform a consumption evaluation on a product for which barcode information has been generated according to the weather information. For example, if it is determined that the harvest and/or quality of the fruit is a good harvest and/or higher than the standard value by receiving weather information of the origin of a specific fruit, the product recommendation department recommends a purchase for the fruit or provides barcode information for the fruit If the generation of the fruit is completed, consumption (purchase) for the corresponding fruit can be evaluated as wise.

In addition, if it is determined that the harvest and/or quality of the rice is poor and/or below the reference value by receiving the weather information of the specific rice origin, the Product Recommendation Department does not recommend the purchase of the rice or the barcode information for the rice is not recommended. If the generation is complete, it can be evaluated that consumption (purchase) for the rice is not wise.

The product recommendation unit may output purchase recommendation information and/or consumption evaluation using a separate display device. In addition, the product recommendation unit transmits purchase recommendation information and/or consumption evaluation to the shopping data server 130 through the communication unit 210, and provides purchase recommendation information and / or may provide a consumption evaluation.

6 is a flowchart illustrating a process in which a shopping service providing system provides a shopping service according to an embodiment of the present invention.

Referring to FIG. 6 , the shopping cart 110 generates barcode information in step 610 . The process of generating barcode information will be described in detail later with reference to FIG. 7 .

In step 620 , the shopping cart 110 transmits barcode information to the shopping data server 130 .

In step 630, the shopping data server 130 generates consumer purchase information including basic information such as the price of a product purchased by the user through the shopping shopping cart 110, manufacturer, etc., and the display position of the product corresponding to the barcode information. .

In step 640 , the shopping data server 130 transmits consumer purchase information to the advertisement server 120 .

In step 650 , the advertisement server 120 selects a recommended product related to consumer purchase information by referring to the database of the shopping data server 130 according to a preset criterion, and requests the recommended product information from the shopping data server 130 .

In step 660 , the shopping data server 130 transmits recommended product information to the advertisement server 120 .

In step 670 , the advertisement server 120 generates advertisement information including recommended product information and transmits the generated advertisement information to the consumer terminal 10 .

In step 680, the shopping data server 130 updates the database through big data analysis. For example, the shopping data server 130 may continuously collect consumer-related information, such as product and consumer purchase information, from a terminal or other server, and process the collected data into shopping data through big data analysis. have.

In step 690 , the shopping data server 130 receives a request for shopping data from the vendor terminal 20 . Alternatively, the shopping data server 130 may receive a request for shopping data from the consumer terminal 10 .

In step 695 , the shopping data server 130 transmits the shopping data to the vendor terminal 20 .

7 is a flowchart illustrating a method of recognizing a product by a shopping cart according to an embodiment of the present invention. Each of the steps described below is collectively referred to as a shopping cart for a concise and clear description of the process or invention performed through each functional unit constituting the above-described shopping cart with reference to FIG. 2 . In addition, each step of FIG. 7 corresponds to step 610 described above with reference to FIG. 6 .

Referring to FIG. 7 , in step 710, the shopping cart measures the weight through a weight sensor provided in the recognition area.

In step 720, the shopping cart determines whether the weight measured in step 710 is greater than or equal to a specified value.

If the weight is less than the specified value in step 720, the shopping cart repeats the process in step 710.

If the weight is greater than or equal to a predetermined value in step 720, in step 730, the shopping cart captures the product and creates an image. In this case, the shopping cart may generate a plurality of images corresponding to each direction through a plurality of cameras that photograph the recognition area in different directions.

In step 740 the shopping cart detects a candidate barcode area from the image. For example, the shopping cart may perform a pre-processing specified for the image, detect an object area corresponding to a product in the pre-processed image, and detect a candidate barcode area in the object area.

In step 750, the shopping cart inputs candidate barcode regions to the pre-trained convolutional neural network to detect a recognition rate for each candidate barcode region, and detects a candidate barcode region with the highest recognition rate as the barcode region.

In step 760, the shopping cart determines whether the recognition rate corresponding to the barcode area is less than or equal to a threshold value.

When the recognition rate corresponding to the barcode area exceeds the threshold in step 760, the shopping cart recognizes the barcode in the barcode area and generates barcode information in step 770.

If the recognition rate corresponding to the barcode area is less than or equal to the threshold in step 760, the shopping cart generates an inspection message indicating that the corresponding product needs to be checked in step 780. In this case, the check message may include a barcode in the barcode area.

In step 790, the shopping cart controls the motor to transport the product from the recognition area to the storage area. In this case, the shopping cart may control the height of the mesh positioned in the storage area according to the weight of the product.

In step 795 , the shopping cart transmits barcode information and an inspection message to the shopping data server 130 .

Therefore, the shopping cart according to an embodiment of the present invention calculates the price of the recognized product by automatically recognizing the product that the consumer wants to purchase without using a separate electronic tag for the product and without the clerk using a barcode reader. , the payment of goods can be performed.

The above-described embodiments of the present invention may be implemented through various means. Embodiments of the present invention may be implemented by hardware, firmware, software, or a combination thereof. In the case of implementation by hardware, the method according to embodiments of the present invention may include one or more ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), It may be implemented by Field Programmable Gate Arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, and the like. In the case of implementation by firmware or software, the method according to the embodiments of the present invention may be implemented in the form of a module, procedure, or function that performs the functions or operations described above. A computer program in which a software code or the like is recorded may be stored in a computer-readable recording medium or a memory unit and driven by a processor. The memory unit may be located inside or outside the processor, and may transmit and receive data to and from the processor by various known means. Also, combinations of each block in the block diagram attached to the present invention and each step in the flowchart may be performed by computer program instructions. These computer program instructions may be embodied in an encoding processor of a general purpose computer, special purpose computer, or other programmable data processing equipment, such that the instructions executed by the encoding processor of the computer or other programmable data processing equipment may correspond to each block of the block diagram or Each step of the flowchart creates a means for performing the functions described. These computer program instructions may also be stored in a computer-usable or computer-readable memory which may direct a computer or other programmable data processing equipment to implement a function in a particular manner, and thus the computer-usable or computer-readable memory. The instructions stored in the block diagram may also produce an item of manufacture containing instruction means for performing the functions described in each block in the block diagram or in each step in the flowchart. The computer program instructions may also be mounted on a computer or other programmable data processing equipment, such that a series of operational steps are performed on the computer or other programmable data processing equipment to create a computer-executed process to create a computer or other programmable data processing equipment. It is also possible that instructions for performing the processing equipment provide steps for carrying out the functions described in each block of the block diagram and each step of the flowchart. In addition, each block or each step may represent a module, segment, or part of code including one or more executable instructions for executing a specified logical function. It should also be noted that in some alternative embodiments it is also possible for the functions recited in blocks or steps to occur out of order. For example, it is possible that two blocks or steps shown one after another may in fact be performed substantially simultaneously, or that the blocks or steps may sometimes be performed in the reverse order according to the corresponding function.

As such, those skilled in the art to which the present invention pertains will understand that the present invention may be embodied in other specific forms without changing the technical spirit or essential characteristics thereof. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. The scope of the present invention is indicated by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. .

10: consumer terminal
20: vendor terminal
110: shopping cart
120: ad server
130: shopping data server
210: communication unit
220: recognition unit
230: transport unit
240: storage unit
310: recognition area
320: storage area

Claims (11)

a shopping cart that generates barcode information of a purchased product;
a shopping data server that generates consumer purchase information according to the barcode information; and
an advertisement server that detects recommended product information corresponding to the product according to the consumer purchase information, generates advertisement information according to the recommended product information, and provides it to the terminal;
The shopping cart is
Receive weather information from the outside and provide purchase recommendation information to consumers by performing at least one of product recommendation and evaluation using the received weather information,
By receiving weather information of the country of origin of a specified product, judging the harvest and quality of the product, and outputting purchase recommendation information for the specified product, and outputting a consumption evaluation for a product for which barcode information has been generated according to the weather information to consumers A shopping service providing system, characterized in that the purchase recommendation information and consumption evaluation are provided to the customer.
According to claim 1,
The advertisement server analyzes the big data of the shopping data server through a natural language processing (NLP) algorithm, selects a recommended product related to the consumer purchase information according to a preset association relationship, and selects information on the selected recommended product A shopping service providing system, characterized in that it detects recommended product information.
According to claim 1,
The shopping data server collects product information corresponding to each product and consumer information corresponding to the consumer, respectively, and updates the shopping data of the database through big data analysis.
4. The method of claim 3,
The consumer information is a shopping service providing system, characterized in that it includes purchase pattern information accumulated by the consumer purchase information, and online behavior data of the consumer.
4. The method of claim 3,
The shopping data server provides the shopping data corresponding to the request to the terminal when the shopping data is requested.
A method for a shopping service providing system to provide a shopping service,
generating, by the shopping cart, barcode information of the purchased product;
generating, by a shopping data server, consumer purchase information according to the barcode information; and
detecting, by an advertisement server, recommended product information corresponding to the product according to the consumer purchase information, generating advertisement information according to the recommended product information, and providing it to a terminal;
The shopping cart receives weather information from the outside, and evaluates and recommends products using the received weather information,
By receiving weather information of the country of origin of a specified product, judging the harvest and quality of the product, and outputting purchase recommendation information for the specified product, and outputting a consumption evaluation for a product for which barcode information has been generated according to the weather information to consumers A shopping service providing method, characterized in that providing the purchase recommendation information and consumption evaluation to a customer.
7. The method of claim 6,
The step of detecting, by the advertisement server, recommended product information corresponding to the product according to the consumer purchase information, generating advertisement information according to the recommended product information and providing it to a terminal,
The advertisement server analyzes the big data of the shopping data server through a natural language processing (NLP) algorithm, selects a recommended product related to the consumer purchase information according to a preset correlation relationship, and selects information on the selected recommended product Detecting recommended product information
A method of providing a shopping service comprising a.
7. The method of claim 6,
and collecting, by the shopping data server, product information corresponding to each product and consumer information corresponding to the consumer, respectively, and updating the shopping data of the database through big data analysis.
9. The method of claim 8,
The method of providing a shopping service, wherein the consumer information includes purchase pattern information accumulating the consumer purchase information and online behavior data of the consumer.
9. The method of claim 8,
When the shopping data server receives a request for the shopping data, the shopping service providing method according to claim 1, wherein the shopping data corresponding to the request is provided to the terminal.
A computer-readable recording medium storing a computer program for executing the method of any one of claims 6 to 10.

Images