KR20220091227A - Recycling collection apparatus and method for payment of reward point using the same - Google Patents

Abstract

The present invention relates to a recycling collection device and a method of paying a reward point using the same, and the recycling recovery device includes a communication device, a memory including instructions, and a processor executing the instructions to verify and collect a recyclable object, the processor comprising: Recognizing the identification code of the scanned article from the first camera module to check the recycling classification value of the article, opening and closing the external inlet of the storage box corresponding to the recycling classification value, and when the article is located in the waiting space inside the external inlet, the waiting space The second camera module mounted on the upper side transmits the scanned image of the article to the interlocked central server to receive the result data of the article. When the classification values match, the internal input port mounted at the bottom of the waiting space is opened and closed to move the goods to the recovery space, and the point ID transmitted to the central server and point rewards according to the recycling standards of the goods can be provided.

Description

Recycling collection device and reward point payment method using the same

A recycling recovery device and a method of paying a reward point using the same are provided.

Currently, in order to facilitate disposal such as incineration or recycling of waste, a policy of classifying and discharging waste by material is being implemented.

Accordingly, objects such as paper, cans, glass, plastic, and vinyl are classified and discharged as recyclable items, and the discharged items are collected and sorted again by type and type at a separate collection site for final recycling. .

However, each individual performs the process of classifying products and discharging them into the corresponding bins. Due to inaccurate separation and discharging, the products in each bin are separately checked and re-separated. Through this, additional manpower and time are required, which incurs costs, which lowers the practicality of recycling.

In order to prevent such a situation, technologies are being developed to accurately recognize the type of recyclables and put them into the appropriate bins when performing separation and discharge for the first time.

Methods are being developed that recognize the object by recognizing the barcode printed or attached to the product, classifying the object or recognizing the product photographed in the image, and then discharging it into the corresponding container. If the barcode is not attached or the barcode area is damaged, it is difficult to recognize the product, and simple image analysis is easy to cause errors in recognizing a completely different object due to its shape.

Therefore, there is a need for a technology to increase the participation in separation and discharge by recognizing an object in an image taken through an artificial intelligence algorithm, performing a double check procedure, improving the accuracy of object recognition, and paying points to the user accordingly.

One embodiment of the present invention is to provide a recycling recovery device and a reward point payment method that induces the user to correctly separate and discharge recyclables through double verification, and provides a point reward for the separated discharge to the user.

In addition to the above problems, the embodiment according to the present invention may be used to achieve other problems not specifically mentioned.

According to an embodiment of the present invention, a communication device, a memory including instructions, and a processor executing instructions to verify and collect a recyclable object, the processor includes: Recognizing the identification code to check the recycling classification value of the product, opening and closing the external inlet of the storage box corresponding to the recycling classification value, and when the article is located in the waiting space inside the external inlet, from the second camera module mounted on the upper side of the waiting space The image of the scanned item is transmitted to the interlocked central server to receive the result data of the item. If the result data is not the same as the recycling classification value, the external input port is opened. Move the goods to the recovery space by opening and closing the inside inlet.

The processor scans the identification code capable of recognizing the point ID through the first camera module, and when the collection of the product is completed based on the scanned identification code, the point ID and the recycling classification value of the product are transmitted to the central server. You can request a point reward.

The processor requests item identification along with the image and device ID of the scanned item from the second camera module, and is classified according to the material or type of recyclables in the item image through an identification model that is learned in connection with the device ID in the central server. Result data including a recycling classification value of the article may be received.

The identification model may be an artificial intelligence model that is repeatedly learned so that the recycling classification value of the corresponding article is output from the inputted article image based on the collected recycling classification values of the objects and one or more images of the articles.

If the processor does not recognize the identification code of the article, the processor transmits the image of the article photographed by the first camera module to the central server to receive the result data of the article obtained by the identification model, and determine the recycling classification value from the result data of the article can be checked

The processor, upon recognizing the point ID, initializes the count, increments the count based on the number of the corresponding item each time the collection of the product is completed, and if no progress signal is input for N seconds after the collection of the product is completed By completing the separation and discharging, estimating the count as the number of recovered recyclables, the point ID, count, and recycling classification value of the article are transmitted to the central server to request a point reward.

When the point ID is recognized through the first camera module, the processor displays the color according to the progress step in the interlocked display module, the request for the progress step, whether the recyclables are matched according to the confirmed recycling classification value or result data, and the point accumulation history One or more of , may be indicated.

According to an embodiment of the present invention, there is provided an operation method in which a recycling collection device pays a point reward, scanning a user's point ID through a first camera module, then scanning an identification code of an article to be separated and discharged; scanning Recognizing the identified identification code, opening the external inlet of the storage box corresponding to the recycling classification value of the corresponding article, and closing the external inlet when the article is located in the waiting space inside the external inlet; a second camera module installed in the waiting space Obtaining the entire image of the product through determining, if it is not a recycling object, open the external input port, if it is a recycling object, open the internal input hole installed at the bottom of the waiting space to move the goods to the recovery space, and when the goods are collected, the central and requesting a point reward by transmitting the recyclable classification value and number of the article to the point ID to the server.

In the receiving of the result data, the result data including the recycling classification value of the article classified according to the material or type of the recycled article in the article image through the identification model learned in connection with the device ID in the central server may be received.

In the step of closing the external inlet, if the identification code is not recognized, the image of the product photographed by the first camera module is transmitted to the central server to receive the result data of the product obtained by the identification model of the central server, and the result data of the product The recycling classification value is checked in , and if an unrecognizable error message is confirmed in the result data, a recyclable product non-recyclable message can be displayed on the interlocking display module.

In the step of moving to the collection space, when the recyclable classification value confirmed in the result data is the recyclable classification value confirmed through the scanned identification code, it may be estimated that the article corresponds to the recyclable object.

In the step of moving to the collection space, if the object is not a recyclable product, the external input port may be opened and a message for requesting removal of the article located in the waiting space may be displayed on the display module.

According to an embodiment of the present invention, the recyclable object of the corresponding article is checked through the external camera module and the internal camera module, the verification error is detected through artificial intelligence, and the external/internal inlet is controlled so that the corresponding article is not collected. It can improve the accuracy of the discharge.

According to an embodiment of the present invention, as a point reward is performed through accurate separation and discharge of products, it is possible to induce active separation and emission through substantial compensation while providing information on products that can be separated and discharging to users.

1 is an exemplary view showing a recycling recovery system according to an embodiment of the present invention.
2 is an exemplary view showing a recycling and recovery device according to an embodiment of the present invention.
3 is a flowchart illustrating a method of operating a recycling and recovery apparatus according to an embodiment of the present invention.
4 is an exemplary diagram for explaining a scanning process of the first and second camera modules according to an embodiment of the present invention.
5 is an exemplary diagram illustrating a screen displayed on a display module according to an embodiment of the present invention.
6 is a block diagram illustrating a central server according to an embodiment of the present invention.
7 is a flowchart illustrating a point reward process according to the number of recycling according to an embodiment of the present invention.
8 is a block diagram of a computing device according to an embodiment of the present invention.

With reference to the accompanying drawings, the embodiments of the present invention will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily implement them. The present invention may be embodied in many different forms and is not limited to the embodiments described herein. In order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and the same reference numerals are used for the same or similar components throughout the specification. In addition, in the case of a well-known known technology, a detailed description thereof will be omitted.

Throughout the specification, when a part "includes" a certain element, it means that other elements may be further included, rather than excluding other elements, unless otherwise stated.

In addition, terms such as “…unit”, “…group”, “…module”, etc. described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware or software or a combination of hardware and software. can

The device described in the present invention is composed of hardware including at least one processor, a memory device, a communication device, and the like, and a program executed in combination with the hardware is stored in a designated place. The hardware has the configuration and capability to implement the method of the present invention. The program includes instructions for implementing the method of operation of the present invention described with reference to the drawings, and is combined with hardware such as a processor and a memory device to execute the present invention.

As used herein, “transmission or provision” may include not only direct transmission or provision, but also transmission or provision indirectly through another device or using a detour path.

In this specification, terms including an ordinal number such as first, second, etc. may be used to describe various elements, but the elements are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present disclosure, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component.

In the flowchart described with reference to the drawings in this specification, the order of operations may be changed, several operations may be merged, some operations may be divided, and specific operations may not be performed.

1 is an exemplary view showing a recycling recovery system according to an embodiment of the present invention.

At this time, the configuration of the recycling recovery system only shows a schematic configuration necessary for description according to an embodiment of the present invention, but is not limited to this configuration.

As shown in FIG. 1, the recycling recovery system includes a recycling recovery device 100, a central server 200, a user terminal 300, and a store server 400, and their configuration is connected to a network to collect data. send and receive

Here, the network may include any type of communication network that transmits data, such as a wired communication network, a short-distance or short-distance wireless communication network, and a mixed network thereof, and may be implemented in the form of a private network constructed using a dedicated line.

The recycling recovery device 100 is implemented as a storage box classified according to the material of the recyclables, and may be installed alone or installed in one or more based on the type of recyclables discharged from a store or an installation place.

In detail, the recycling and recovery apparatus 100 may include individual storage boxes such as plastics 101, cans 102, bottles (CASE1, 103), bottles (CASE2, 104), etc. depending on the type. In this way, even if the material is the same, the storage box may be set differently based on the criteria classified or recycled in the store.

For example, it can be designated as CASE or CASE2 depending on the bottles recycled within the store and those discharged outside, or it can be designated as a separate CASE depending on the size of the product or the manufacturer of the bottle.

The recycling and recovery device 100 has an independent device ID, and stores the material or type of recyclables to be recovered for each storage box linked to each device ID.

The recycling collection device 100 recognizes and recognizes the object for the collection target based on the external camera, and then recognizes the product for the collection target again based on the internal camera. to recover

The recycling and recovery device 100 stores identification information on items used or distributed in the store, and when the identification information is recognized through the external camera, the product photographed through the internal camera is transmitted to the central server 200 . And, based on the received result, it is checked whether or not it is a recyclable product.

At this time, if the identification information is not recognized through the external camera, the recycling collection device 100 transmits the image photographed by the external camera module to the central server 200, and based on the received result, it is possible to check whether a recycling product is a target. have.

As such, the recycling and recovery device 100 checks whether or not a recycling product is a target based on the image of the product photographed through the external camera and the internal camera, and automatically opens and closes the input port for recovering the recycling product when the recycling product is the target.

In addition, the recycling collection device 100 communicates with the central server 200 to recognize the user's point ID and provide a point reward according to the recovered recyclables.

When the central server 200 receives a predetermined request message from the recycling collection device 100, it generates and provides result data based on the request message.

In detail, when the central server 200 receives the product image and the device unique ID, the store linked to the device unique ID and the type or material of recyclables collected by the device installed in the store are checked. After that, the central server 200 selects an identification model learned based on the identified data, inputs an image of an article to the selected identification model, checks whether the article is a recyclable object, and transmits the result to the recycling collection device 100 do.

Here, the learned identification model is implemented as a machine learning algorithm based on artificial intelligence such as Support Vector Machine (SVM), Random Forest Model (Random Forest, RF), Convolution Neural Network (CNN), etc. It is possible.

The central server 200 may build and manage the learned identification models in association with the store ID or device ID, and may use one identification model corresponding to each device ID.

Alternatively, the central server 200 may input the image photographed through the first camera module and the image photographed through the second camera module from the recycling collection device 100 into different identification models learned according to circumstances, respectively. For example, the central server 200 uses the first identification model for determining the types and materials of recyclables for images of various types of products and images of products classified into specific materials, and the input image is a specific material. It can be separately provided and applied as a second identification model for determining whether a product is classified as .

The central server 200 records the points earned or used based on the point ID in a table, and manages the points by building a point database.

The central server 200 updates the corresponding point database in consideration of the type and number of recyclables recovered in the point ID according to the point reward request of the recycling collection device 100 .

The user terminal 300 represents a terminal of a user who has performed membership registration in order to perform recycling collection and receive points according to the recycling.

Here, the user represents a customer who has to deal with recyclables generated in the process of visiting or using a specific store performing the point payment service.

The user may be issued a point card by performing a subscription procedure for the point payment service, or may be issued a point app card by installing a program or application in the user terminal.

When the application installed in the user terminal 300 confirms individual authentication information (ID, PASSWORD, pattern, biometrics, etc.) from the user, it displays an identification code that can be implemented as a pattern code, barcode, QR code, etc. for identifying the user can be displayed in

In addition, the user terminal 300 may provide the user with the time point at which the user discharges the recyclables to the recycling collection device 100 through the corresponding application, the points generated, the accumulated points, the stores visited, the type of the discharged recyclables, and the like to the user.

In addition, the user terminal 300 may provide a store type, address, store name, product name, service name, etc. that can use the points, along with the type, address, and store name of the store performing the point payment service.

As such, the user terminal 300 collectively refers to a terminal having arithmetic processing capability by having a memory means and a processor, respectively, for example, a personal computer, a handheld computer, a personal digital assistant (PDA). ), cell phones, smart devices, and tablets.

The store server device 400 is a server of an affiliate store that intends to provide a point reward service for recycling recovery, and may be linked with one or more recycling recovery devices 100 .

The store server device 400 sets the device ID for the associated recycling and collection device 100 , the recycled items to be collected, the material, and the like, and shares it with the central server 200 . In addition, the store server device 400 stores and manages identification codes for items provided by the store, and shares the identification codes for each item and one or more images photographed for each item with the central server 200 .

The store server device 400 may store the identification code for the article in the recycling and recovery device 100 to collect only the products provided by the store, and store based on the material of the recyclables recovered by the recycling and recovery device 100 . It can be set to be recoverable for other items as well.

Meanwhile, the store server device 400 may be implemented as a server device for managing a corresponding store for each store or as a central server device for an affiliated store managing an affiliated store.

In other words, when the store server device 400 is implemented as an affiliate store central server device, it is possible to collectively transmit the affiliate store ID, items, images, etc. handled for each affiliate store to the central server 200, and Point accumulation events, events, etc. can be processed by collectively sharing them with the central server 200 .

2 is an exemplary view showing a recycling and recovery apparatus according to an embodiment of the present invention.

2 is an exemplary view showing the external shape of the recycling and recovery device 100, (a) of FIG. 2 shows a standby state, (b) shows an open state of the external inlet, (c) shows the external inlet and the inside Indicates the state in which the input port is open.

Hereinafter, the external camera module will be described as the first camera module 110 , and the internal camera module will be described as the second camera module 150 .

Although the recycling and recovery device 100 having one storage box is illustrated in FIG. 2A , in the case of the recycling recovery device 100 having a plurality of storage boxes, one first camera module 110 and a display module 120 are shown. ) is associated with multiple storage boxes.

As shown in (a) of Figure 2, the storage box is divided into an upper end and a lower end, the front portion of the upper end is provided with an external inlet (130).

In addition, although the first camera module 110 and the display module 120 are shown in the upper region of the storage box, the first camera module 110 and the display module 120 can be set to different installation locations, respectively, and the storage box and It can be installed in a separate structure spaced apart.

Also, the first camera module 110 and the display module 120 may be combined into one device. For example, the first camera module 110 is mounted on the upper end of the display module 120 so that it can be used as a single device.

The first camera module 110 may include one or more cameras, and may include a scanner that scans an identification code of an article according to an applied situation.

After recognizing the point ID, the display module 120 may display a request message in a predetermined step or a screen having an effect such as a message format, a graph format, or an animation for a result according to the step.

Also, the display module 120 may display a color corresponding to each step after recognizing the point ID.

In the upper front portion of the storage box, the external inlet 130 is opened and closed by an internal control signal, and an internal input 140 is provided on the upper surface part connected to the lower end in the state in which the external inlet 130 is opened.

In other words, when the external inlet 130 is closed, the internal inlet 140 is not visible, and in the standby state, it is blocked to be separated from the space for storing the internal recyclables.

On the other hand, as shown in (b) of Fig. 2, the external inlet 130 is opened and closed in the form of a sliding door in which one or both doors slide along the grooves created in the upper and lower door frames and push the door of the external inlet into the body of the upper front part. can

Although FIG. 2(b) is illustrated in the form of a sliding door moving left and right, the present invention is not limited thereto, and the door may be opened and closed up and down, and various opening/closing methods such as a lifting door method are applicable. In addition, the external inlet 130 may be provided on the upper side of the storage box, and in this case, it is possible to implement an opening and closing method applicable from the upper side.

When the external inlet 130 is opened, the waiting space (A) is exposed and a second camera module 150 is provided on the upper side of the waiting space (A) to photograph an article placed in the waiting space (A).

The second camera module 150 may be composed of one or more cameras that take pictures of the article, and when the article is placed in the waiting space (A), after the external inlet 130 is closed, the second camera module 150 is Creates a full image of the item.

The second camera module 150 may be equipped with a separate light for image generation in the waiting space A, which is a closed space, or a camera specialized for night photography.

At the lower end of the waiting space (A), the internal inlet 140 is located, and when the internal inlet 140 is opened and closed by an internal control signal, as in FIG. ) can be moved. In (c) of FIG. 2, both the external inlet 130 and the internal inlet 140 are shown in an open state for convenience of explanation, but in a practical driving method, the external inlet 130 and the internal inlet 140 are not opened at the same time. , can only be opened selectively.

In this way, the recycling and recovery device 100 performs the first process of opening and closing the external inlet 130 according to the article identified based on the image photographed through the first camera module 110 and the second camera module 150 . A second process of opening and closing the internal inlet 140 according to the identified item based on the image taken through is performed.

Through this, the recyclables can be recovered to the actual recovery space (B) according to the standard of separation and discharge through a double verification process through the first and second processes.

Hereinafter, a method in which the recycling recovery device recovers recycling through the double verification step will be described in detail with reference to FIGS. 3 to 5 .

3 is a flowchart illustrating an operation method of a recycling and recovery apparatus according to an embodiment of the present invention, and FIG. 4 is an exemplary view for explaining a scanning process of the first and second camera modules according to an embodiment of the present invention.

As shown in FIG. 3 , the recycling and recovery apparatus 100 recognizes a point ID ( S101 ).

When the recycling collection device 100 scans the identification code of the point card app displayed on the screen of the user terminal 300 through the first camera module 110, the interlocking count is initialized to 0.

Here, the first camera module 110 can be designed to be driven when a specific object is detected within a predetermined distance, and scans the identification code of the point card app implemented as a QR code, a barcode card number, and the like.

As shown in FIG. 4A , when the first camera module 110 scans the screen of the user terminal 300 , the recycling collection device 100 may recognize the user's point ID through the scanned identification code.

At this time, the recycling collection device 100 displays an ID, a user name, a nickname, etc. corresponding to the recognized point ID on the display screen, and locates the identification code area of the article to be discharged in front of the first camera module 110 . A message requesting to do so can be displayed together.

And the recycling collection device 100 scans the identification code of the article through the first camera module 110 (S103).

As shown in Fig. 4 (b), the first camera module 110 generates an overall image of the product including the identification code of the product. Here, the identification code is a barcode for each product or includes all marks that distinguish products such as QR codes and distinguish products.

On the other hand, when the identification code of the product is attached separately at each store, it can be attached as a material that can be separated during washing, and it is easy to sort by recycling, and it is possible to the extent that the recycled product does not affect the subsequent recycling step.

Next, the recycling collection device 100 extracts the identification code area from the entire image generated by the first camera module 110 to recognize the identification code (S105).

The recycling and recovery apparatus 100 may extract a product code representing a product based on the recognized identification code, and recognize the type, material, etc. of the recycled product corresponding to the product code. For example, the recycling and recovery device 100 may recognize bottled beverages sold in the store from the identification code of the product, and the product may be recognized as a recyclable product that can be classified as a bottle.

At this time, if the recycling and recovery device 100 is difficult to recognize the identification code, the user may once again display a message requesting that the camera position the identification code of the article in front of the first camera module 110, Accordingly, it is possible to return to step S103 again.

And if the identification code is not recognized, the recycling collection device 100 transmits the product image to the central server 200 and receives the result (S105).

When the recycling and recovery device 100 does not recognize the identification code from the entire product image, such as the identification code is partially damaged or the identification code cannot be extracted, the entire product image is transmitted to the central server 200 .

The recycling collection device 100 transmits an identification request to the central server 200 together with the device ID and the entire image of the article including the identification code, and receives result data for the request. Here, the result data may include data on items to be classified for normal recognition or error data for abnormal recognition.

In detail, the result data for normal recognition may be received as one or more values among the product code of the corresponding product, the type of recyclable product, or the classification value of the material.

Then, the recycling and recovery device 100 checks whether or not a recycling object is a target based on the received result (S109). The recycling and recovery device 100 displays on the display module 120 when it is determined that the recycling is impossible to recover ( S111 ).

When the recycling and recovery apparatus 100 receives the error data, it may estimate that the corresponding article is a non-recyclable article and display a corresponding message on the display module 120 .

On the other hand, when the recycling and recovery apparatus 100 receives the product code as the result data, it may check whether the product is classified as a recycled product based on the product code.

As such, if the recycling and recovery device 100 recognizes the identification code in step S105 or confirms that it is a recyclable object in step S109, confirms the type of the product, opens the external inlet 130 for the type, and puts the product on the waiting shelf When located, the external inlet 130 is closed (S113).

If a plurality of storage boxes are connected based on the classification of recyclables, the recycling and recovery device 100 opens the external inlet 130 of the corresponding storage box based on the type of product.

For example, in the case of storage boxes classified into plastics, cans, and bottles, the recycling and recovery device 100 opens the external inlet 130 of the storage box of the plastics if the recognized product is plastic. In addition, the recycling collection device 100 may provide a screen displaying the location of the storage box to be put into the display module 120 .

The recycling recovery device 100 may check whether the article is put in through the second camera module 150 installed in the internal waiting space with the external input port 130 opened. Accordingly, the recycling collection device 100 sets the opening/closing time of the external inlet 130 or automatically closes the corresponding external inlet 130 after a predetermined time elapses from a point in time when no movement is detected in the second camera module 150 . can be set.

Alternatively, the closing time of the external inlet 130 may be confirmed by the user through the display module 120 or the closing time of the external inlet 130 may be set through a separate button.

The recycling collection device 100 scans the product through the second camera module 150 (S115).

As shown in (c) of Fig. 4, the recycling and recovery device 100 acquires the entire image of the product through the second camera module 150, and acquires the entire image of one or more products at each different shooting angle can do.

Next, the recycling collection device 100 transmits the product image to the central server 200 and receives the result (S117).

The recycling collection device 100 transmits an article identification request together with one or more images and device IDs to the central server 200 . Then, the result data is received from the central server 200 . Here, the result data may be the same as in step S105 above.

Next, the recycling and recovery device 100 checks whether or not the recycling target (S119). The recycling recovery device 100 checks whether the result data received from the central server 200 is the same as the recognition result of step S105 or step S109 described above.

The recycling and recovery device 100 opens the external input port and displays a message that the recycling cannot be recovered if the classification of recyclables is different according to the received result data or is not a recyclable object (S121). The recycling and recovery apparatus 100 may display a message indicating that the product cannot be recovered together with a message requesting that the product be removed from the corresponding waiting space on the display module 130 .

On the other hand, if it is checked whether the corresponding article is a recyclable object, the recycling and recovery device 100 opens the internal input port 140 to collect the article (S123). The recycling collection device 100 increases the count to 1 when collection of the article is completed. Here, the count refers to the number of recyclables that are collected.

Thereafter, the recycling and collection device 100 checks the input of the progress signal within N seconds (S125). (N is a natural number) Here, the progress signal is a scan item through the first camera module 110 or the display module 120 ) or a signal input through a separately set button.

In other words, when the first camera module 110 scans a product within N seconds, the recycling and recovery device 100 may return to step S103 and proceed.

In addition, after displaying the non-recovery message in step S111 or step S121, if a progress signal is received within N seconds, the process returns to step S103 and proceeds.

On the other hand, if the recycling and recovery device 100 does not receive an input of a progress signal within N seconds, the recovery step is terminated.

In this case, the recycling and recovery apparatus 100 may terminate the collection process and request a point reward from the central server 200 based on the type and number of recovered articles.

Here, the number of recovered articles is set based on the previously set count.

Meanwhile, the recycling and recovery device 100 may receive the number of articles having the same material to be put in in the process of input through the external input port 130 through the display module 120 or a separately set button. When a plurality of articles are put in as described above, the recycling and collection device 100 transmits one or more images captured through the second camera module 140, the device ID, and the number of identification together to the central server 200 to request identification. can Accordingly, the recycling and collection device 100 extracts the image of the article as much as the number of identifications from the entire image based on the number of identification and the result data received from the central server 200, and inputs the result to the learned identification model for each product. data can be received. In addition, the recycling and recovery apparatus 100 counts as many as the corresponding number of articles while recovering the articles when all the articles are classified as the same recycled article and are the same as the classification of the corresponding storage box. On the other hand, if all the articles are not the same, the recycling and recovery apparatus 100 may display a recovery impossible message and request removal.

5 is an exemplary diagram illustrating a screen displayed on a display module according to an embodiment of the present invention.

As shown in FIG. 5 , the display module 120 may display a message and a color for a progress step according to each recovery step.

As shown in (a) of Figure 5, the recyclables that the user wants to discharge are classified into bottles, and only the external inlet of the storage box for storing the bottles is opened.

Accordingly, the display module 120 recognizes that the recycling of the article is a bottle, and may display a color indicating a progress step accordingly.

For example, the color indicating the progress stage is green (recognized) when the point ID is recognized, and yellow (in progress) is displayed in the stage until the item is scanned and collection is completed. If it is, it can be displayed in red (error occurrence). Through these colors, the user can intuitively understand the situation in the process of collecting the goods.

The indication of such a progress step is, for example, as shown in FIG. 5(b).

First, in the progress stage, it is displayed in yellow, and at the same time, a request message to put the bottle into the slot and the location of the storage box to be put can be displayed.

In addition, if an error occurs, it can be displayed in red and the message that it is not subject to recyclables at the same time. When the collection of recyclables is complete, it is displayed in green and at the same time as 1 recyclable has been collected along with the message, points ID and accumulated points can be displayed.

The screen of the display module 120 is an example, and the color of the progress stage is not necessarily limited thereto, and it can be implemented as a mark through which the user can intuitively grasp the state based on the progress stage.

Hereinafter, an identification model is learned through communication with the recycling collection device 100 and the store server device 400 using FIGS. 6 and 7, and a point reward is performed on the collected recyclables based on the result of the learned identification model. The central server 200 will be described in detail.

6 is a block diagram illustrating a central server according to an embodiment of the present invention.

As shown in FIG. 6 , the central server 200 includes a store communicator 210 , a learner 220 , a data manager 230 , a device receiver 240 , a classifier 250 , a point manager 260 , and a device transmitter. (270).

For description, the store communicator 210 , the learner 220 , the data manager 230 , the device receiver 240 , the classifier 250 , the point manager 260 and the device transmitter 270 are named and called, but these are at least A computing device operated by one processor. Here, the store communicator 210, the learner 220, the data manager 230, the device receiver 240, the classifier 250, the point manager 260 and the device transmitter 270 are implemented in one computing device, It may be implemented distributed in separate computing devices. When distributed in a separate computing device, the store communicator 210 , the learner 220 , the data manager 230 , the device receiver 240 , the classifier 250 , the point manager 260 and the device transmitter 270 are They can communicate with each other through a communication interface. The computing device may be any device capable of executing a software program written to carry out the present invention, and may be, for example, a server, a laptop computer, or the like.

For convenience of description, the central server 200 shows a configuration for performing communication with the store server device 400 and a configuration for performing communication with the recycling collection device 100 together, but a separate server based on the subject performing the communication Alternatively, it can be implemented as a device.

The configuration of the central server 200 only shows a schematic configuration necessary for description according to an embodiment of the present invention, and is not limited thereto.

The store communicator 210 is a communicator that communicates with the store server device 400 and receives store distribution product data and store distribution product images. Here, the store distribution product images may include a plurality of images photographed from various shooting angles for each product.

The learner 220 generates learning data based on the store distribution product data and store distribution product images collected by the store communicator 210 and uses the generated learning data to learn an AI-based identification model.

The training data is data obtained by matching input data and result data of the identification model, and is data obtained by matching various store distribution product images and product classification values or product codes to be derived from the images.

The learner 220 may repeatedly learn the identification model to derive matched result data from the input data based on the training data.

Since the learner 220 is learned with learning data based on distribution products of each store, an identification model can be built for each store. In other words, the learning model may be stored in association with the store ID or the ID of the recycling collection device 100 installed in the store.

The learner 220 may re-learn the existing identification model based on the updater data collected whenever the store distribution product data and the store distribution product images are updated. And the learner 220 may learn the identification model based on the stored product DB without going through the store communicator 210 .

The data manager 230 may store and manage store distribution product data and store distribution product images in a separate product database (product DB).

In detail, the data manager 230 may store the product name, product code, product identification code, product recycling classification, and product images in the database.

The data manager 230 may continuously delete/modify/record data of the product database, and the recorded data may be utilized as learning data applied to learning the identification model.

The device receiver 240 receives an article image identification request or a point reward request from the recycling collection device 100 .

The device receiver 240 transmits the data received together according to the request received from the recycling collection device 100 to each classifier 250 or the point manager 260 .

When the classifier 250 receives the image and the device ID for the product image identification request, the image is input to the learned identification model linked to the device ID, and the recyclable classification value of the product included in the image or the product code of the product to acquire

In addition, the point manager 260 allocates points to the corresponding point IDs by synthesizing the points and the number allocated to each recyclable product based on the device ID, point ID, recyclable classification, number, etc. received together in response to the point reward request.

The point manager 260 updates the point database (point DB) by recording the points assigned to the corresponding point ID, the time point when the point reward request is received, the recyclable classification, the number, the device ID, the store ID, and the like.

The point database includes information on the accumulation, use, and expiration of points based on the point ID of the user who has signed up for the point reward service, and includes points set for each item of recyclables for each store.

In this case, the point manager 260 may perform a point reward according to the recycling processing standard, and may manage the point database by transferring points, double accumulation, etc. based on the point management policy for each store.

In addition, the device transmitter 270 transmits the result data for the request received from the recycling recovery device 100 to the recycling recovery device 100 .

In detail, as an image identification result, a recyclable classification value or a product code of an article may be transmitted, or a point reward result may be transmitted.

In addition, the central server 200 inquires the point accumulation history through a program or app installed in the user terminal 300, and points use history, points accumulation available stores, points available stores, promotions or events provided by each store, etc. can provide

7 is a flowchart illustrating a point reward process according to the number of recycling according to an embodiment of the present invention.

Referring to Figure 7, the central server 200 has already completed the learning of the store distribution product data and the corresponding image to build the identification model, the central server 200 and the recycling collection device 100 after the point accumulation operation indicates.

The recycling collection device 100 recognizes the user's point ID through the first camera module 110 (S201). The recycling collection device 100 may initialize the count to 0 when the point ID is recognized.

And the recycling collection device 100 recognizes the identification code for the product scanned through the first camera module 110 (S203). At this time, if the identification code is not recognized, the recycling collection device 100 generates a product image photographed through the first camera module 110 . Then, the recycling collection device 100 transmits the device ID and product image to the central server 200 to request product identification.

The central server 200 inputs a product image to the learned identification model based on the product identification request, and outputs a result thereof (S209). Here, the result value may have one or more of the product identification code, product name, product material type (eg, bottle, can, plastic, paper, etc.) extracted from the product image, and an error for inability to identify can be printed out.

The central server 200 transmits the output result to the recycling collection device 100 (S2110). Then, if the central server 200 is not identifiable based on the result, an error message is displayed on the display 120 and automatically terminated if a progress signal is not received within N seconds.

On the other hand, when the central server 200 recognizes the identification code of the article in step S203 or receives the result of identifying the article in the article image in step S211, the central server 200 opens the external inlet, and the article photographed through the second camera 150 An image is created (S213), and an article identification is requested while transmitting the device ID and the article image to the central server 200 (S215).

The central server 200 inputs a product image to the learned identification model based on the product identification request, outputs a result thereof (S217), and transmits the result to the recycling collection device 100 (S219).

Thereafter, when the recycling and recovery device 100 opens and closes the internal input port to collect the corresponding article (S221), a point reward is requested including the input point ID and device ID, and the inputted article, number, and the like (S223).

If the recycling collection device 100 does not receive an input signal within N seconds, it may terminate the recycling product recovery step and request a point reward for recovery of the recycled products as much as the counted number to the central server 200 .

The central server 200 performs a point reward according to the product type and number to the point ID (S225), and transmits the point reward result to the recycling and collection device 100 (S227).

The central server 200 extracts points allocated to recyclables in the store from the point database, and accumulates points in the corresponding point ID based on the type and number of recyclables. And the central server 200 may update the current data with the accumulated point details.

And, the recycling and recovery device 100 displays a point accumulation guide for the corresponding point ID based on the received result (S229). Here, the recycling collection device 100 may display the currently accumulated points of the corresponding point ID, the recycled articles, the number, and the total accumulated points together.

On the other hand, the recycling collection device 100 may perform point accumulation through a receipt at a specific store. For example, the recycling collection device 100 replaces the receipt barcode attached to the receipt with a point ID and recognizes it, and then completes the collection of the recycled product with the receipt barcode. A reward may be requested from the central server 200 .

Accordingly, the central server 200 performs a point reward for the receipt barcode, and when the receipt barcode is input from the user terminal 300 within a certain validity period, the receipt barcode is used as the point ID of the user corresponding to the input user terminal 300 . You can transfer the points assigned to .

In this way, the central server 200 may transfer the points accumulated using the receipt barcode to the user point ID later and update the point database.

8 is a block diagram of a computing device according to an embodiment of the present invention.

In FIG. 8 , the recycling collection apparatus 100 described in FIGS. 1 to 7 may be implemented as a computing device, for example, a computer-readable medium.

Referring to FIG. 8 , the computing device 500 includes a communication device 501 , a display device 503 , an input device 505 , a first camera module 507 , a second camera module 509 , and a memory 511 . , storage 513 , and at least one processor 515 , the components of which are connected via a peripheral interface such as a bus.

The communication device 501 allows the memory 511 and/or the processor 515 to access the network. The display device 503 may use a liquid crystal display (LCD) technology or a light emitting polymer display (LPD) technology, and the display device 503 may be a capacitive, resistive or infrared touch display. The display device 503 outputs an operation result of the program executed by the processor 515 on the screen. The input device 505 is a means for receiving a user command, and may include various input devices such as a touch sensor, a keypad, a button, and a pointing device. The first camera module 507 and the second camera module 509 may be automatically driven by the processor 515 or driven by the input device 505 .

In addition, the memory 511 stores various programs and data necessary for the operation of the computing device 500 . The storage 513 stores various data and programs required for executing the operation of the present invention.

The at least one processor 515 is a device that controls the operation of the computing device 500 , and may be various types of processors 515 that process instructions included in a program, for example, a central processing unit (CPU). , a micro processor unit (MPU), a micro controller unit (MCU), a graphic processing unit (GPU), or the like. The memory 511 loads the corresponding program so that the instructions described to execute the operation of the present invention are processed by the processor 515 .

According to the present invention, the recyclable object of the relevant article is checked through the external camera module and the internal camera module, the verification error is detected using artificial intelligence, and the external/internal inlet is controlled so that the article is not collected, so the accuracy of separation and discharge can improve

In addition, by performing point rewards through accurate separation of products, it is possible to induce active separation of emission through actual compensation while providing information on products that can be separated and discharging to users.

Although preferred embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention as defined in the following claims are also provided. is within the scope of the

Claims (12)

communication device,
memory containing instructions, and
and a processor for verifying and collecting recyclables by executing the instructions,
The processor is
Recognizing the identification code of the scanned article from the first camera module mounted on the outside of the storage box, confirming the recycling classification value of the article, opening and closing the external input port of the storage box corresponding to the recycling classification value,
When the article is located in the waiting space inside the external inlet, the image of the article scanned from the second camera module mounted on the upper side of the waiting space is transmitted to a central server interlocked to receive the result data of the article,
When the result data is not the same as the recycling classification value, the external input port is opened, and when the recycling classification value is the same, the internal input hole mounted at the bottom of the waiting space is opened and closed to move the article to the recovery space. Device.
In claim 1,
The processor is
An identification code capable of recognizing a point ID is scanned through the first camera module, and when the collection of the product is completed based on the scanned identification code, the point ID and the recycling classification value of the product are transmitted to the central server A recycling recovery device that requests a point reward.
In claim 1,
The processor is
requesting item identification along with an image of the item scanned from the second camera module and a device ID;
Recycling and collecting device for receiving the result data including the recycling classification value of the article classified according to the material or type of the recycled article in the article image through an identification model learned in connection with the device ID in the central server.
In claim 3,
The identification model is
A recycling collection device, which is an artificial intelligence model that is repeatedly learned to output a recycling classification value of a corresponding article from an input article image based on the recycling classification value of the collected recycling target articles and one or more images of the articles.
In claim 3,
The processor is
If the identification code of the article is not recognized, the image of the article photographed by the first camera module is transmitted to the central server to receive the result data of the article obtained by the identification model,
A recycling and recovery device for confirming the recycling classification value in the result data of the article.
In claim 2,
The processor is
Upon recognizing the point ID, the count is initialized,
Each time the collection of the article is completed, the count is incremented based on the number of the corresponding article,
If no progress signal is input for N seconds even after the collection of the article is completed, separate discharge is completed,
A recycling collection device for requesting a point reward by estimating the count as the number of recovered recyclables, and transmitting the point ID, count, and recycling classification value of the article to the central server.
In claim 2,
The processor is
When the point ID is recognized through the first camera module, the color according to the progress step in the interlocked display module, the request for the progress step, the recyclables according to the confirmed recycling classification value or result data, the point accumulation history, A recycling retrieval device displaying one or more.
As an operation method for the recycling recovery device to pay a point reward,
After scanning the user's point ID through the first camera module, scanning the identification code of the article to be separated and discharged;
Recognizing the scanned identification code, opening the external inlet of the storage box corresponding to the recycling classification value of the article, and closing the external inlet when the article is located in the waiting space inside the external inlet;
acquiring an entire image of the article through a second camera module installed on the waiting space;
Transmitting the acquired image to an interlocked central server to request product identification, and receiving result data according to the product identification request;
Based on the result data, it is judged whether the product is subject to recyclables, if it is not the recyclable object, the external input port is opened. moving to the recovery space; and
Requesting a point reward by transmitting the recyclable classification value and number of the article to the point ID to the central server when the collection of the article is completed
A method of operating a recycling recovery device comprising a.
In claim 8,
Receiving the result data comprises:
Operation method of a recycling collection device for receiving the result data including the recycling classification value of the article classified according to the material or type of the recycled article in the article image through the identification model learned in connection with the device ID in the central server .
In claim 9,
The step of closing the external inlet is,
If the identification code is not recognized, the image of the article photographed by the first camera module is transmitted to the central server to receive the result data of the article obtained by the identification model of the central server, and from the result data of the article Check the recycling classification value,
When an unrecognizable error message is identified in the result data, a method of operating a recycling collection device for displaying a non-recyclable message on an interlocked display module.
In claim 10,
The step of moving to the recovery space comprises:
When the recyclables classification value identified in the result data is the recyclables classification value identified through the scanned identification code, the method of operating a recycling collection device for estimating that the article corresponds to a recyclable object.
In claim 11,
The step of moving to the recovery space comprises:
When the recycling object is not the object, an external input port is opened, and a removal request message for the article located in the waiting space is displayed on the display module.

Images