WO2021097840A1 - 物品清单的确定方法、装置、计算机设备及存储介质 - Google Patents

物品清单的确定方法、装置、计算机设备及存储介质 Download PDF

Info

Publication number
WO2021097840A1
WO2021097840A1 PCT/CN2019/120376 CN2019120376W WO2021097840A1 WO 2021097840 A1 WO2021097840 A1 WO 2021097840A1 CN 2019120376 W CN2019120376 W CN 2019120376W WO 2021097840 A1 WO2021097840 A1 WO 2021097840A1
Authority
WO
WIPO (PCT)
Prior art keywords
item
information
identification information
video detection
determining
Prior art date
Application number
PCT/CN2019/120376
Other languages
English (en)
French (fr)
Inventor
吴晓
胡龙耀
耿路
吴靖
范育宸
刘怀国
刘润声
Original Assignee
连云港伍江数码科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 连云港伍江数码科技有限公司 filed Critical 连云港伍江数码科技有限公司
Priority to PCT/CN2019/120376 priority Critical patent/WO2021097840A1/zh
Publication of WO2021097840A1 publication Critical patent/WO2021097840A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07FCOIN-FREED OR LIKE APPARATUS
    • G07F11/00Coin-freed apparatus for dispensing, or the like, discrete articles

Definitions

  • the present invention relates to the field of information processing technology, in particular to a method, device, computer equipment and storage medium for determining an item list.
  • new retail has gradually become popular. In many respects, it is the general trend that new retail gradually replaces traditional retail.
  • the cashier uses a scanner to scan the products one by one, and then determines the information of the items selected by the customer, and then generates a list of items.
  • customers often need to queue for a long time, which makes shopping inefficient.
  • the embodiments of the present invention provide a method, a device, a computer device, and a storage medium for determining an item list, which can generate an item list during a user's selection of items, thereby greatly improving shopping efficiency.
  • a method for determining an item list includes the following steps: obtaining detection information of an item display area; when it is determined that the item display area is in an item picking state according to the detection information, determining the item identification information of the picked item.
  • the item identification information is obtained by identifying the item identification on the taken item; the item list is determined according to the item identification information.
  • the step of determining the item identification information of the picked-up item includes: receiving first video detection information sent by a video detection device; when the first video detection information includes a location When the color block information is successfully obtained, the target position of the item identification on the picked item is determined according to the obtained positioning color block information; the identification identification instruction is sent to the video detection device; the identification identification instruction is used to control the location
  • the video detection device recognizes the item identification in the target location to obtain item identification information; and outputs the item identification information through an output device.
  • the step of sending an identification recognition instruction to the video detection device includes: sending a direction recognition instruction to the video detection device; the direction recognition instruction is used to control the video detection device The device recognizes the direction of the positioning color block; receives the direction of the positioning color block returned by the video detection device, and sends an identification recognition instruction to the video detection device; to control the video detection device according to the positioning color block The direction recognizes the color code and/or EAN code of the item in the target location to obtain item identification information.
  • the step of determining the item identification information of the picked item further includes: outputting a prompt message when the first video detection information includes information that the acquisition of the positioning color block information fails; To prompt the user to adjust the angle of the picked-up item, until the video detection device obtains the positioning color block information.
  • the method further includes: receiving second video detection information sent by a video detection device; when determining based on the second video detection information When the picked item is taken out of the item display area and then returns to the item display area again, the corresponding item identification information is deleted from the item list.
  • the method further includes: when it is determined that there is duplicate item identification information in the item list, deleting the corresponding duplicate from the item list Item identification information.
  • the method further includes: acquiring biometric information of the user who took the article, Determining the item list corresponding to the biometric information; the step of determining the item list according to the item identification information includes: adding the item identification information to the item list corresponding to the biometric information.
  • the step of determining that the article display area is in an article taking state according to the detection information includes: when it is determined that an article is being taken according to the third video detection information sent by the video detection device When the user holds it in his hand, it is determined that the article display area is in an article taking state.
  • the step of determining that the article display area is in an article taking state according to the detection information includes: when the infrared detection device is determined according to the infrared detection information sent by the infrared detection device When the emitted infrared light is blocked, it is determined that the article display area is in the article taking state.
  • an embodiment of the present invention provides a device for determining an item list, which includes: a detection information acquisition module for acquiring detection information of an item display area; an identification information determining module for determining When the item display area is in the item taking state, the item identification information of the picked item is determined; the item identification information is obtained by identifying the item identifier on the picked item; and the item list determining module is used for The item list is determined according to the item identification information.
  • the method and device for determining the item list described above determines whether the item has been taken based on the detection information of the item display area; when the item display area is in the item picking state, the item identification information of the picked item is determined, and then the item list is determined.
  • the list of items can be generated during the user's selection of items, which can effectively improve the efficiency of shopping.
  • a computer device includes a memory, a processor, and a computer program that is stored on the memory and can run on the processor.
  • the processor executes the computer program, the following steps are implemented: acquiring detection information of an item display area; When it is determined according to the detection information that the item display area is in the item-taking state, the item identification information of the picked-up item is determined; the item identification information is obtained by identifying the item identification on the picked-up item; The item identification information determines the item list.
  • the above-mentioned computer equipment can generate an item list during the user's selection of items, which can effectively improve shopping efficiency.
  • a computer-readable storage medium on which a computer program is stored, when the computer program is executed by a processor, the following steps are realized: acquiring detection information of an item display area; when the item display area is determined based on the detection information When the item is taken, the item identification information of the taken item is determined; the item identification information is obtained by identifying the item identification on the taken item; the item list is determined according to the item identification information.
  • the above-mentioned computer-readable storage medium can generate an item list during the user's selection of items, which can effectively improve shopping efficiency.
  • Fig. 1 is an application environment diagram of a method for determining an item list in an embodiment
  • FIG. 2 is a schematic flowchart of a method for determining a list of items in an embodiment
  • FIG. 3 is a schematic diagram of the structure of positioning color blocks in an embodiment
  • FIG. 4 is a schematic diagram of the positional relationship between the positioning color block and the item identification in an embodiment
  • Figure 5 is a schematic diagram of a start code and an end code in an embodiment
  • FIG. 6 shows the corresponding relationship between the RGB center code and the octal numerical number in an embodiment
  • FIG. 7 shows the corresponding relationship between the RGB center code and the octal numerical number in another embodiment
  • FIG. 8 is a comparison diagram of the outer frame line and the background of the RGB center code in an embodiment
  • FIG. 9 is a structural block diagram of a device for determining an item list in an embodiment
  • Fig. 10 is a structural block diagram of a system for determining an item list in an embodiment.
  • the method for determining the item list provided in this application can be applied to the computer device as shown in FIG. 1.
  • the computer device can be a server, and its internal structure diagram can be as shown in Figure 1.
  • the computer equipment includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities, which can be implemented through the main control board.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system, a computer program, and a database.
  • the internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium.
  • the database of the computer equipment is used to store data such as detection information, item identification information, and item lists.
  • the network interface of the computer device is used to communicate with an external terminal through a network connection.
  • FIG. 1 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied.
  • the specific computer device may Including more or fewer parts than shown in the figure, or combining some parts, or having a different arrangement of parts.
  • the embodiment of the present invention provides a method, a device, a computer device, and a storage medium for determining an item list. Detailed descriptions are given below.
  • a method for determining an item list is provided. Taking this method applied to the main control board as an example, it includes the following steps:
  • the item display area refers to the area where items are displayed, which can be a freezer, a refrigerator, a locker, a merchandise display area, and so on.
  • the item display area can be set in a shopping mall, a supermarket, or a home, and the embodiment of the present invention does not limit its application scenarios.
  • articles can refer to commodities, household daily necessities, etc., specifically, beverages, fruits and vegetables, daily necessities, etc., and these articles can be pasted with two-dimensional codes, barcodes, and color codes that contain article identification information.
  • the detection information can be obtained by the detection device.
  • the detection device can refer to video detection equipment, infrared detection equipment, sensors, etc.
  • the detection device can be installed in the article display area or near the article display area.
  • the simultaneous detection device can be one, two or more.
  • the item identification information may refer to the EPC code, EAN code, product code, product name, product weight, product description, placement location, production date, shelf life, price, quantity and other information of each item.
  • the item identification information can distinguish the corresponding item from other items, and may also include the relationship with other items (as belonging to a certain item category, etc.).
  • the item identification can refer to a two-dimensional code, barcode, color code, item number, pattern and other identifying marks. After the identification of the item is determined, it can be displayed through an output device (printer, display, etc.).
  • the item display area being in the item taking state may mean that there is an item in the item display area being in the taking state.
  • the item display area can be divided into three states: when the user's arm is close to the item and is not in contact with the item, it is not taken, and this state is defined as the waiting state; when the item is in When the user is in the hand or when the user is taking out and viewing, this state is defined as the item taking state (the state under observation).
  • this state is defined as a certain state (selected state), at this time the item identification information corresponding to the item temporarily observed by the user can be upgraded to certain information.
  • S203 Determine an item list according to the item identification information.
  • the item list refers to a list containing items, quantity, price and other information corresponding to the items picked up by the user.
  • the item list may also contain no information or information such as "unselected item”.
  • the item list confirmation information can be sent to the mobile terminal bound to the user, and the user can click the screen of the mobile terminal to confirm when the user checks it and confirms that it is correct.
  • the user when the user selects more than one item, it may also include a process of integrating the item identification information of each item selected by the user. It can accurately summarize the items and quantities of the list that needs to be generated, and at the same time confirm the validity of the summary results to prevent data confusion and other problems
  • the item identification information of the item picked up by the user is recognized during the process of selecting the item by the user, and the item list is generated according to the item identification information.
  • the item list can be generated during the user's selection of items, which can effectively improve shopping efficiency. It is a more concise and accurate solution for unmanned sales or unmanned warehouse statistics to generate item lists and data aggregation processes in the future.
  • the video detection device when the user selects an item, the video detection device may be combined with the video detection device to determine the status of the video detection area.
  • the video detection device determines the status of the video detection area.
  • the item list can be output through a handheld terminal or the like, and the user is reminded to confirm the item list by scanning codes, fingerprints, voice, or the like.
  • the user can modify the piece of information; when the user thinks that a certain piece of information is not needed, he can also request the deletion of the corresponding information.
  • the item list generated when the user picks up the item can be regarded as a temporary item list, and the item confirmed by the user can be regarded as an official item list. Subsequent deletion of the item identification information in the official item list requires the user's consent.
  • the step of determining the item identification information of the picked item includes: receiving the first video detection information sent by the video detection device; when the first video detection information includes a positioning color When the block information obtains successful information, determine the target position of the item identification on the picked item according to the obtained positioning color block information; send an identification recognition instruction to the video detection device; the identification identification instruction is used to control the The video detection equipment recognizes the item identification in the target location to obtain item identification information; and outputs the item identification information through an output device.
  • video detection equipment refers to equipment with a video information detection function, which can be implemented through cameras, mobile phones, video recording equipment, cameras, electronic watches, etc.
  • the output device refers to a device that can output the information generated by the main control board to the user, and can be a display installed near the item display area, a mobile terminal bound by the user, a player, and the like.
  • the output mode can be video, text, voice, picture, etc.
  • the output of item identification information through the mobile terminal can be achieved by means of WeChat, SMS, etc.
  • additional information corresponding to the item can be obtained based on the item identification information (the additional information can be the item's usage method, cooking method, item origin, composition, storage conditions, manufacturer, etc.) And output the additional information.
  • the item identification information output by the output device may be displayed once after the user takes an item, or may be displayed collectively when it is detected that the user has finished selecting the item.
  • the timing can be started after the item identification information is displayed. If the user picks up a new item again, the item identification information of the new item will be displayed. If the timing time is reached, it is not detected. If a user picks up an item, the item identification information can be stopped.
  • the color positioning block refers to a block structure with a certain color, and these color positioning blocks can be set near the item identification. These positioning color blocks can be arranged according to a certain arrangement position, and the video detection device can determine the direction of the item identification according to the arrangement of these positioning color blocks.
  • the embodiment of the present invention does not limit the color, shape, number, arrangement, etc. of these color blocks.
  • the positioning color block information can be the color, shape, quantity, location, and corresponding item identification information of the color block.
  • a schematic diagram of positioning color blocks may be as shown in FIG. 3. These color blocks can be painted on the four corners of a certain area of the article packaging bag, and the colors can be red, green, blue, and yellow from top to bottom from left to right. Color combinations are not restricted).
  • the video detection device detects that the color blocks from top to bottom and left to right are red, green, blue, and yellow (as shown in Figure 3a)
  • the object is the front facing the video detection device.
  • the color blocks from top to bottom and left to right are green, red, yellow, and blue (as shown in Figure 3b)
  • the object is the back facing the video detection device.
  • the object When the color blocks from top to bottom and left to right are detected as yellow, blue, green, and red (as shown in Figure 3c), the object is rotated 180° from the front to face the video detection device. When the color blocks from top to bottom and left to right are detected as blue, yellow, red, and green (as shown in Figure 3d), the object is rotated 180° on the back to face the video detection device. In this way, the orientation of the object can be determined according to the direction of the positioning color block, thereby providing a prerequisite for the subsequent video detection device to identify the identification information of the object.
  • the item identification can be set inside or near the positioning color block, or the positioning color block information contains the position of the item identification. As shown in Figure 4, the item identification is set inside the positioning block, and the video detection device successfully obtains the location of the positioning color block to know the location of the item identification, and then determine the identification information of the item.
  • the step of sending an identification recognition instruction to the video detection device includes: sending a direction recognition instruction to the video detection device; the direction recognition instruction is used to control the video detection device to recognize and locate color blocks Receiving the direction of the positioning color block returned by the video detection device, and sending an identification recognition instruction to the video detection device; to control the video detection device to recognize the target according to the direction of the positioning color block
  • the color code and/or EAN code of the item in the location can obtain the item identification information.
  • the item color code can also be called a color band, which can be composed of multiple colored squares, and the color and arrangement of the squares can represent different item identification information when the color and arrangement of the squares are different.
  • the item color code can also be represented by color blocks. You can assign different numerical numbers to the RGB values of the item color codes. When determining the RGB value of the item color code, determine its corresponding numerical number, and then determine the item identification information. Table 1 below shows the correspondence between different RGB values and numerical numbers.
  • the maximum value 255 and the minimum value 0 of the RGB function can be used to define the color. For example, eight colors can be used to correspond to the octal number 0 ⁇ 7, as shown in Table 1 (also can be based on the video detection).
  • the pixels of the measuring equipment are set to binary, decimal, hexadecimal, etc.).
  • the colors defined by the maximum value and the minimum value are all pure colors and have a high degree of recognition, which can effectively improve the accuracy of obtaining item identification information.
  • the RGB values corresponding to these numerical numbers can also be other values.
  • the RGB color mode is a color standard in the industry. A variety of colors are obtained by changing the three color channels of red (R), green (G), and blue (B) and superimposing them with each other. colour. This color standard includes almost all colors perceivable by human vision, and is one of the most widely used color systems at present. When the RGB function executes successfully, it returns the color determined by the specified component, which is represented by a long integer.
  • the requirements of RGB three channels are as follows:
  • the item color code may include: a start code, an end code, and an RGB center code; identifying the item color code in the target location to obtain item identification information can be achieved in the following manner: determining the start code and the end code of the item color code; The RGB center code between the start code and the end code is acquired, and the item identification information is determined according to the RGB value of the RGB center code.
  • the color arrangement of the color blocks in the RGB center code can be diverse, and different color arrangements can correspond to different item identification information (arrangement coding rules can be predetermined according to a certain algorithm).
  • start code and the end code can be a short line as shown in FIG. 5, the horizontal line represents the start code, and the vertical line represents the end code.
  • start code and end code can also be expressed in other graphics or forms.
  • the corresponding relationship between the RGB center code and the corresponding octal numerical number can be shown in Figures 6 and 7 (the corresponding relationship between the numerical number and the RGB value is shown in Table 1).
  • the RGB center code in FIG. 6 is represented by a rectangular box
  • the RGB center code in FIG. 7 is represented by a circular box, and the inside of these rectangular boxes and circular models is filled with colors corresponding to RGB values.
  • the color of the outer frame of the RGB center code can be different from the color of the package of the attached item to distinguish it from the package of the item and improve the accuracy of identification. As shown in Figure 8, when the background (item packaging) is white, the frame of the RGB center code is black, and when the background is black, the frame of the RGB center code is white. At the same time, a proper gap can be left between the barcodes.
  • the direction of the item identification and the target location of the item identification are determined according to the positioning color block information, which can effectively ensure the reliability of the identification information of the item.
  • outputting the item identification information through the output device can allow the user to understand the relevant information of the item picked up, so as to prompt the user to complete actions such as product selection and purchase.
  • the step of determining the item identification information of the picked item further includes: when the first video detection information includes information that the location color patch information has failed to be acquired, outputting a prompt message; Prompt the user to adjust the angle of the picked item until the video detection device obtains the positioning color block information.
  • the video detection device may not be able to obtain complete positioning color block information (for example: the positioning color block is blocked by the user's hand, then The video detection equipment cannot obtain complete positioning color block information).
  • the user can be prompted to regulate the way the user picks up or put the product, and the product can be placed at an angle or position that is conducive to video detection.
  • the user is reminded to make adjustments when the acquisition of the positioning color patch information fails, which can ensure the successful acquisition of the positioning color patch information.
  • the method further includes: receiving second video detection information sent by a video detection device; When the picked item is taken out of the item display area and then returns to the item display area again, the corresponding item identification information is deleted from the item list.
  • the related information that the item has been put back can be displayed through a display or the like.
  • timer to organize the item list. For example, you can start timing after the item is picked up. If the item is still in the item display area after a preset period of time, it is considered that the user has not taken it away Item display area. Remove the item identification information corresponding to the item from the item list.
  • the method further includes: when it is determined that there is duplicate item identification information in the item list, deleting the corresponding duplicate item identification information from the item list.
  • the further processing may include removing invalid data, information classification (for example, item identification information corresponding to items of the same type are arranged nearby), and the like.
  • the main control board receives the second video detection information, determine the corresponding The item identification information of the item, the obtained item identification information is compared with the item list to see if there is matching item identification information. If there is matching item identification information, determine whether there is any user taking the item from the item display area in the time period before the current time according to the video detection information; if so, it is considered that the user has taken it again For the same item, add 1 to the number of items in the corresponding item identification information in the item list. If there is no item, it is considered that the user took the item out and then took it back, that is, the item was taken out of the item display area and returned to the item display area again .
  • the item list is processed according to the location of the item and the specific information of the item list, which can effectively ensure the accuracy of the information in the item list.
  • the method further includes: obtaining the biometric information of the user who took the article to determine The item list corresponding to the biometric information; the step of determining the item list according to the item identification information includes: adding the item identification information to the item list corresponding to the biometric information.
  • biometric information can refer to fingerprints, facial features, iris, body shape and other information.
  • biometric information is a facial image, it may be the facial recognition information of the picked-up item obtained through the video detection device.
  • the biometric information recognized by the video detection device can be stored in the database together with the user's shopping behavior, so as to mark the user and analyze the user's consumption behavior.
  • the video detection device recognizes that user A has taken an item, it obtains user A's biometric information, and determines whether there is an item list corresponding to the biometric information. If yes, add the item identification information of the picked item to the corresponding item list; if not, create a blank item list, and add the item identification information of the picked item to the blank item list.
  • the video detection device can obtain the biometric information, it can generate a blank item list for this shopping for the corresponding biometric information (the user's biometric information can be temporarily associated with the item list, that is, the item The list is created under the user name).
  • the corresponding item identification information is added to the blank item list.
  • This embodiment implements the process of determining the item list based on the user's biometric information, which can ensure that a user has a unique item list corresponding to it, and prevent information confusion between different users. At the same time, it can choose to keep or cancel the item list according to the user's wishes.
  • the step of determining that the item display area is in an item taking state according to the detection information includes: when it is determined that an item is being taken by the user according to the third video detection information sent by the video detection device When held in the hand, it is determined that the article display area is in the article taking state.
  • a certain item is held in the hand by the user can be determined by the position of the item, the hand movement, and so on.
  • the video detection information is used to determine whether the user has taken the item, and then the state of the item display area is determined.
  • the step of determining that the article display area is in an article taking state according to the detection information includes: when the infrared detection device is determined according to the infrared detection information sent by the infrared detection device When the emitted infrared light is blocked, it is determined that the article display area is in the article taking state.
  • infrared detection information is used to determine whether the user has picked up an item, and then the state of the item display area is determined.
  • the infrared detection device can be installed in the area where the user selects the item, so as to determine whether the user performs the action of selecting the item according to whether the infrared detection area (the range of infrared emission and infrared reception) is blocked by the signal.
  • the infrared detection device can be installed on the inner or outer surface of the freezer, in a parallel relationship with the freezer door.
  • User A enters the area covered by the supermarket video detection equipment.
  • the video detection device detects user A's biometric information and sends the detected biometric information to the main control board.
  • the main control board determines whether the biometric information corresponds to an item list. If not, a blank item list is generated for it.
  • the main control board can interact with the user A through the display screen set in the supermarket, and ask the user A's willingness to continue shopping. If user A is willing to continue shopping, keep a blank item list for him; if user A is not willing to continue shopping, then cancel the blank item list.
  • each drink is in its original position, and the freezer is in a waiting state.
  • the video detection device detects that the position of the drink has changed; it is determined that the freezer is in the item taking state.
  • the video detection equipment scans the outer surface of the beverage bottle to determine the location and direction of the color block.
  • the position and direction of the color code of the article on the beverage L that the user said to take is determined according to the position and direction of the positioning color block, and then the arrangement and combination mode of the color code of the article is determined, and the EAN code is determined.
  • the video detection device detects that user A takes beverage L out of the freezer and puts it in the shopping cart, it will prompt user A with beverage L information (including beverage type, quantity, etc.) on the display screen and ask him to confirm whether to choose buy. If the user chooses to purchase, the corresponding item identification information in the item list can be determined as a confirmed state, and the user's consent is required to delete the item identification information later.
  • beverage L information including beverage type, quantity, etc.
  • the item list is fed back to the user through the display for subsequent operations such as settlement and payment.
  • the item list can be generated during the user's selection of items, which can effectively improve shopping efficiency.
  • Just set up video detection equipment near the item display area which has low hardware requirements. It is simple and easy to use, convenient to use, can effectively save manpower and material resources, and compared with human operation, can more effectively avoid process errors and prevent differences in the results of the item list.
  • the application prospect is very broad.
  • the present invention also provides a device for determining the item list, which can be used to execute the method for determining the item list.
  • a device for determining the item list can be used to execute the method for determining the item list.
  • the illustrated structure does not constitute a limitation on the device, and may include comparisons. More or fewer parts are shown, or some parts are combined, or different parts are arranged.
  • the device for determining the item list includes a detection information acquisition module 901, an identification information determination module 902, and an item list determination module 903.
  • the detailed description is as follows:
  • the detection information acquisition module 901 is used to acquire the detection information of the item display area.
  • the identification information determining module 902 is configured to determine the item identification information of the picked item when it is determined that the item display area is in the item picking state according to the detection information; the item identification information is used to identify the picked item Get the item identification on the item.
  • the item list determining module 903 is configured to determine the item list according to the item identification information.
  • the item list can be generated during the user's selection of items, which can effectively improve shopping efficiency.
  • the identification information determination module 902 includes: a video detection information acquisition sub-module for receiving first video detection information sent by a video detection device; a target position determination sub-module for when the first video detection information When a video detection information contains information indicating that the positioning color block information is successfully acquired, the target position of the item identification on the picked item is determined according to the obtained positioning color block information; the identification information determination sub-module is used to report the video
  • the detection device sends an identification recognition instruction; the identification identification instruction is used to control the video detection device to recognize the item identification in the target location to obtain item identification information; and output the item identification information through an output device.
  • the identification information determining sub-module includes: a direction recognition unit, configured to send a direction recognition instruction to the video detection device; the direction recognition instruction is used to control the video detection device to recognize a positioning color block The direction of the identification; the identification recognition unit is used to receive the direction of the positioning color block returned by the video detection device, and send an identification recognition instruction to the video detection device; to control the video detection device according to the positioning color block Identify the color code and/or the EAN code of the item in the target location in the direction of, and obtain item identification information.
  • the identification information determining module 902 is further configured to output prompt information when the first video detection information includes information that the acquisition of the positioning color block information fails; to prompt the user to adjust the picked-up item Angle, until the video detection device obtains the positioning color block information.
  • it further includes: a first deletion module for receiving second video detection information sent by a video detection device; when it is determined that the picked item is taken out according to the second video detection information When the article display area returns to the article display area again, the corresponding article identification information is deleted from the article list.
  • it further includes: a second deletion module, configured to delete the corresponding repeated item identification information from the item list when it is determined that there is duplicate item identification information in the item list.
  • it further includes: a biometric information acquisition module, configured to obtain biometric information of the user who picked up the item, and determine the item list corresponding to the biometric information; item list determination module 903 And is also used to add the item identification information to the item list corresponding to the biometric information.
  • a biometric information acquisition module configured to obtain biometric information of the user who picked up the item, and determine the item list corresponding to the biometric information
  • item list determination module 903 is also used to add the item identification information to the item list corresponding to the biometric information.
  • the identification information determining module 902 is further configured to determine that an item is held in the hand by the user according to the third video detection information sent by the video detection device, and determine that the item display area is in the item pick-up area. status.
  • the identification information determining module 902 is further configured to determine that the item display area is in the item display area when it is determined according to the infrared detection information sent by the infrared detection device that the infrared light emitted by the infrared detection device is blocked. Take the state.
  • a system for determining an item list is also provided, and the system is used to implement the method for determining an item list in the foregoing embodiment of the present invention.
  • the determination system of the item list can be as shown in FIG. 10. Including video detection equipment, item identification set on the item, main control board and display structure. The function of each structure can be:
  • Video detection equipment detect biometric information in a specific area, user's body movement information, and detect positioning color blocks and item identifications on items.
  • the display is used to deliver information such as product information, interactive information, and item lists to users. That is, you can place product advertisements, product information, user's every step of the operation process, and prompts for the user's subsequent operations on the screen. At the same time, you can also display the number of items taken by the user and their traceability information (product production date, product Origin, product shelf life, price), etc.
  • Main control board Determine the item list based on the information of the video detection equipment.
  • the main control board may include a processing module, a storage module, a list generating module, and an associated module.
  • the function of each module can be:
  • Processing module processing and analyzing the data uploaded by the video detection equipment.
  • Storage module Stores the data recognized by the video detection equipment and the data generated by the main control board, such as: biometric information, commodity ribbon-EAN information, item lists, etc.
  • Order generation module Generate a blank item list corresponding to the user's biometric information, and add the corresponding item identification information to the item list after the user takes the item.
  • Association module bind and associate the EAN code corresponding to the item identification with the item list.
  • the item list can be generated during the user's selection of items, which can effectively improve shopping efficiency.
  • the device for determining the item list of the present invention corresponds to the method for determining the item list of the present invention one-to-one.
  • the technical features and beneficial effects described in the embodiment of the method for determining the item list are applicable to the item list.
  • the specific content can be referred to the description in the method embodiment of the present invention, which will not be repeated here, and it is hereby declared.
  • the logical division of each program module is only an example. In actual applications, it can be used according to needs, for example, due to the configuration requirements of the corresponding hardware or the convenience of the software implementation.
  • the above function allocation is completed by different program modules, that is, the internal structure of the device for determining the item list is divided into different program modules to complete all or part of the functions described above.
  • a computer device including a memory, a processor, and a computer program stored in the memory and capable of running on the processor.
  • the processor executes the computer program, the following steps are implemented: Obtain the detection of the item display area.
  • the item identification information of the picked item is determined; the item identification information identifies the item identification information on the picked item Obtain; Determine the list of items according to the item identification information.
  • the processor further implements the following steps when executing the computer program: receiving the first video detection information sent by the video detection device; Information, determine the target location of the item identification on the picked item according to the acquired positioning color block information; send an identification recognition instruction to the video detection device; the identification identification instruction is used to control the identification of the video detection device The item identification in the target location is used to obtain item identification information; the item identification information is output through an output device.
  • the processor further implements the following steps when executing the computer program: sending a direction recognition instruction to the video detection device; the direction recognition instruction is used to control the direction in which the video detection device recognizes the positioning color block; Receive the direction of the positioning color block returned by the video detection device, and send an identification recognition instruction to the video detection device; to control the video detection device to identify the target location according to the direction of the positioning color block Item color code and/or EAN code to obtain item identification information.
  • the processor further implements the following steps when executing the computer program: when the first video detection information contains information that the acquisition of the positioning color block information fails, output a prompt message; to prompt the user to adjust the picked-up information The angle of the object until the video detection device obtains the positioning color block information.
  • the processor further implements the following steps when executing the computer program: receiving the second video detection information sent by the video detection device; when determining that the picked item is taken according to the second video detection information When returning to the article display area after exiting the article display area, the corresponding article identification information is deleted from the article list.
  • the processor further implements the following step when executing the computer program: when it is determined that there is duplicate item identification information in the item list, delete the corresponding duplicate item identification information from the item list.
  • the processor further implements the following steps when executing the computer program: acquiring the biometric information of the user who took the picked-up item, and determining the item list corresponding to the biometric information.
  • the processor further implements the following step when executing the computer program: adding the item identification information to the item list corresponding to the biometric information.
  • the processor further implements the following steps when executing the computer program: when it is determined that an item is held by the user according to the third video detection information sent by the video detection device, it is determined that the item display area is in the item Take the state.
  • the processor further implements the following steps when executing the computer program: when it is determined according to the infrared detection information sent by the infrared detection device that the infrared light emitted by the infrared detection device is blocked, determining the item display area It is in the state of taking items.
  • a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the following steps are implemented: acquiring detection information of an item display area; When it is determined that the item display area is in the item taking state, the item identification information of the picked item is determined; the item identification information is obtained by identifying the item identification on the picked item; the item is determined according to the item identification information List.
  • the following steps are further implemented: receiving the first video detection information sent by the video detection device; when the first video detection information includes the positioning color block information, the acquisition is successful In the case of information, determine the target position of the item identification on the picked item according to the acquired positioning color block information; send an identification recognition instruction to the video detection device; the identification identification instruction is used to control the video detection device Identify the item identification in the target location to obtain item identification information; output the item identification information through an output device.
  • the following steps are further implemented: sending a direction recognition instruction to the video detection device; the direction recognition instruction is used to control the direction in which the video detection device recognizes the positioning color block Receiving the direction of the positioning color block returned by the video detection device, and sending an identification recognition instruction to the video detection device; to control the video detection device to identify the target position according to the direction of the positioning color block The item color code and/or EAN code of the item to obtain the item identification information.
  • the following steps are also implemented: when the first video detection information contains information that the location color patch information has failed to be acquired, a prompt message is output; Take the angle of the object until the video detection device obtains the positioning color block information.
  • the following steps are also implemented: receiving the second video detection information sent by the video detection device; when it is determined based on the second video detection information that the picked item is When the item display area is taken out and returned to the item display area again, the corresponding item identification information is deleted from the item list.
  • the following step is further implemented: when it is determined that there is duplicate item identification information in the item list, the corresponding duplicate item identification information is deleted from the item list.
  • the following steps are further implemented: obtaining the biometric information of the user who picked up the item, and determining the item list corresponding to the biometric information.
  • the following step is further implemented: adding the item identification information to the item list corresponding to the biometric information.
  • the following steps are also implemented: when it is determined that an item is held by the user according to the third video detection information sent by the video detection device, it is determined that the item display area is The status of the item being taken.
  • the step of determining that the item display area is in an item picking state according to the detection information includes: When the infrared detection information determines that the infrared light emitted by the infrared detection device is blocked, it is determined that the article display area is in an article taking state.
  • a person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program.
  • the program can be stored in a computer readable storage medium. Independent product sales or use. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connections (electronic devices) with one or more wiring, portable computer disk cases (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable and editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM).
  • the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because it can be used, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable media if necessary.
  • the program is processed in a way to obtain the program electronically and then stored in the computer memory.
  • each part of the present invention can be implemented by hardware, software, firmware or a combination thereof.
  • multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if it is implemented by hardware, as in another embodiment, it can be implemented by any one or a combination of the following technologies known in the art: Discrete logic circuits, application-specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

Landscapes

  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Economics (AREA)
  • Development Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种物品清单的确定方法、装置、计算机设备及存储介质,属于信息处理技术领域。所述方法包括:获取物品陈列区域的侦测信息(S201);当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息;所述物品识别信息通过识别所述所拿取物品上的物品标识得到(S202);根据所述物品识别信息确定物品清单(S203)。上述技术方案,解决了在确定购物清单的过程中,顾客往往需要经过长时间的排队,使得购物效率低下的问题。在用户挑选物品的过程中就能生成物品清单,能有效提高购物的效率。

Description

物品清单的确定方法、装置、计算机设备及存储介质 技术领域
本发明涉及信息处理技术领域,特别是涉及物品清单的确定方法、装置、计算机设备及存储介质。
背景技术
近几年来,新零售逐渐普及。在许多方面,新零售逐渐替代传统零售已经是大势所趋。传统的购物过程是收银员使用扫描仪逐个扫描商品之后确定顾客所选择的物品信息,进而生成物品清单。但是这个过程中,顾客往往需要经过长时间的排队,这就使得购物效率低下。
发明内容
基于此,本发明实施例提供了物品清单的确定方法、装置、计算机设备及存储介质,能在用户挑选物品的过程中生成物品清单,极大地提高购物效率。
本发明实施例的内容如下:
一种物品清单的确定方法,包括以下步骤:获取物品陈列区域的侦测信息;当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息;所述物品识别信息通过识别所述所拿取物品上的物品标识得到;根据所述物品识别信息确定物品清单。
在其中一个实施例中,所述确定所拿取物品的物品识别信息的步骤,包括:接收视讯侦测设备发送的第一视讯侦测信息;当所述第一视讯侦测信息中包含有定位色块信息获取成功的信息时,根据所获取的定位色块信息确定所拿取物品上物品标识的目标位置;向所述视讯侦测设备发送标识识别指令;所述标识识别指令用于控制所述视讯侦测设备识别所述目标位置中的物品标识,得到物品识别信息;通过输出装置输出所述物品识别信息。
在其中一个实施例中,所述向所述视讯侦测设备发送标识识别指令的步骤,包括:向所述视讯侦测设备发送方向识别指令;所述方向识别指令用于控制所述视讯侦测设备识别定位色块的方向;接收视讯侦测设备返回的所述定位色块的方向,向所述视讯侦测设备发送标识识别指令;以控制所述视讯侦测设备根据所述定位色块的方向识别所述目标位置中的物品彩色码和/或EAN码,得到物品识别信息。
在其中一个实施例中,所述确定所拿取物品的物品识别信息的步骤,还包括:当所述第一视讯侦测信息中包含有定位色块信息获取失败的信息时,输出提示信息;以提示用户调整所拿取物品的角度,直到视讯侦测设备获取到定位色块信息。
在其中一个实施例中,所述根据所述物品识别信息确定物品清单的步骤之后,还包括:接收视讯侦测设备发送的第二视讯侦测信息;当根据所述第二视讯侦测信息判定所述所拿取物品被拿出物品陈列区域后再次回到所述物品陈列区域时,从所述物品清单中删除对应的物品识别信息。
在其中一个实施例中,所述根据所述物品识别信息确定物品清单的步骤之后,还包括:当确定所述物品清单中存在重复的物品识别信息时,从所述物品清单中删除对应的重复物品识别信息。
在其中一个实施例中,所述当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态的步骤之后,还包括:获取拿取所述所拿取物品的用户的生物识别信息,确定与所述生物识别信息对应的物品清单;所述根据所述物品识别信息确定物品清单的步骤,包括:将所述物品识别信息添加至所述与所述生物识别信息对应的物品清单中。
在其中一个实施例中,所述根据所述侦测信息确定所述物品陈列区域处于物品拿取状态的步骤,包括:当根据视讯侦测设备发送的第三视讯侦测信息确定某一物品被用户拿在手中时,判定所述物品陈列区域处于物品拿取状态。
在其中一个实施例中,所述根据所述侦测信息确定所述物品陈列区域处于物品拿取状态的步骤,包括:当根据红外侦测设备发送的红外侦测信息确定所述红外侦测设备发射的红外光被遮挡时,判定所述物品陈列区域处于物品拿取状态。
相应的,本发明实施例提供一种物品清单的确定装置,包括:侦测信息获取模块,用于获取物品陈列区域的侦测信息;识别信息确定模块,用于当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息;所述物品识别信息通过识别所述所拿取物品上的物品标识得到;以及,物品清单确定模块,用于根据所述物品识别信息确定物品清单。
上述物品清单的确定方法及装置,根据物品陈列区域的侦测信息确定物品是否被拿取;在物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息,进而确定物品清单。在用户挑选物品的过程中就能生成物品清单,能有效提高购物的效率。
一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机 程序,所述处理器执行所述计算机程序时实现以下步骤:获取物品陈列区域的侦测信息;当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息;所述物品识别信息通过识别所述所拿取物品上的物品标识得到;根据所述物品识别信息确定物品清单。
上述计算机设备,在用户挑选物品的过程中就能生成物品清单,能有效提高购物的效率。
一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现以下步骤:获取物品陈列区域的侦测信息;当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息;所述物品识别信息通过识别所述所拿取物品上的物品标识得到;根据所述物品识别信息确定物品清单。
上述计算机可读存储介质,在用户挑选物品的过程中就能生成物品清单,能有效提高购物的效率。
附图说明
图1为一个实施例中物品清单的确定方法的应用环境图;
图2为一个实施例中物品清单的确定方法的流程示意图;
图3为一个实施例中定位色块的结构示意图;
图4为一个实施例中定位色块与物品标识的位置关系的示意图;
图5为一个实施例中起始码和结束码的示意图;
图6为一个实施例中RGB中心码与八进制数值编号的对应关系;
图7为另一个实施例中RGB中心码与八进制数值编号的对应关系;
图8为一个实施例中RGB中心码的外框线与背景的对比图;
图9为一个实施例中物品清单的确定装置的结构框图;
图10为一个实施例中物品清单的确定系统的结构框图。
具体实施方式
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。
本申请提供的物品清单的确定方法可以应用于如图1所示的计算机设备中。该计算机设 备可以是服务器,其内部结构图可以如图1所示。该计算机设备包括通过系统总线连接的处理器、存储器、网络接口和数据库。其中,该计算机设备的处理器用于提供计算和控制能力,可以通过主控板实现。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统、计算机程序和数据库。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该计算机设备的数据库用于存储侦测信息、物品识别信息、物品清单等数据。该计算机设备的网络接口用于与外部的终端通过网络连接通信。该计算机程序被处理器执行时实现一种物品清单的确定方法。
本领域技术人员可以理解,图1中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备的限定,具体的计算机设备可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。
本发明实施例提供一种物品清单的确定方法、装置、计算机设备和存储介质。以下分别进行详细说明。
在一个实施例中,如图2所示,提供了一种物品清单的确定方法。以该方法应用于主控板端为例进行说明,包括以下步骤:
S201、获取物品陈列区域的侦测信息。
其中,物品陈列区域指的是陈列物品的区域,可以是冰柜、冰箱、储物柜、商品陈列区等。该物品陈列区域可以设置在商场、超市或家庭等场景中,本发明实施例并不限定其应用场景。另外,物品可以指商品、家庭日常用品等,具体可以是饮料、蔬果、生活用品等,这些物品上可以粘贴包含有物品识别信息的二维码、条形码、彩色码等。
侦测信息可以由侦测装置来获取。其中侦测装置可以指视讯侦测设备、红外侦测设备、传感器等。侦测装置可以安装在物品陈列区域中,或者在物品陈列区域附近。同时侦测装置可以是一个,也可以是两个甚至多个。
S202、当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息;所述物品识别信息通过识别所述所拿取物品上的物品标识得到。
其中,物品识别信息可以指各个物品的EPC码、EAN码、商品编码、商品名称、商品重量、商品描述、放置位置、生产日期、保质期、价格、数量等等信息。这些物品识别信息可以将对应的物品与其他物品区别开来,也可以包含与其他物品的关系(如同属于某一个物品种类等)。物品标识可以指二维码、条形码、彩色码、物品编号、图案等具有标识性的标识。物品标识确定以后,可以通过输出设备(打印机、显示器等)进行展示。
物品陈列区域处于物品拿取状态可以指物品陈列区域中有物品处于被拿取状态。其中,用户在挑选物品的过程中,物品陈列区域可分为三种状态:当用户手臂靠近物品且与商品非接触时,属于未拿取,将这一状态定义为待选状态;当物品处于用户手中或者说用户取出正在查看时,将这一状态定义为物品拿取状态(观察中状态)。当经过用户观察后物品被放入购物篮或者放回至原来的位置,将这一状态定义为确定状态(选择完毕状态),此时可以将用户临时观察的物品对应的物品识别信息升级为确定信息。
S203、根据所述物品识别信息确定物品清单。
其中,物品清单指包含用户所拿取物品对应的品项、数量、价格等信息的列表。当然,如果确定用户未拿取物品陈列区域中的物品时,该物品清单中也可以没有信息或包含有“未选择物品”等信息。
生成物品清单之后还可以包括请求用户对清单中的信息进行确认的过程。例如:可以向与用户绑定的移动终端发送物品清单确认信息,用户查看以后确认无误时,可以点击移动终端的屏幕进行确认。
同时,当用户所选择的物品不止一个时,还可以包括将用户所选择的各个物品的物品识别信息进行整合的过程。可以对所需要生成清单的品项、数量等所述进行精确汇总,同时对汇总结果的有效性进行确认,以防止数据错乱等问题
本实施例的物品清单的确定方法,在用户挑选物品的过程中识别用户所拿取物品的物品识别信息,并根据该物品识别信息生成物品清单。该物品清单在用户挑选物品的过程中就能生成,能有效提高购物的效率。是未来无人售货或无人仓储统计生成物品清单和数据汇总流程较为简洁精确的解决方案。
在一个实施例中,在用户挑选物品的过程中,可以结合视讯侦测设备来确定视讯侦测区域的所属状态。当根据视讯侦测设备确定用户将某一物品放入购物车、购物手提篮、购物篮、手提袋等购物容器中或者放回物品陈列区域时,可以判定对应的物品为选择完毕状态。
在一个实施例中,可以通过手持终端等输出物品清单,并提醒用户通过扫码、指纹、语音等方式对该物品清单进行确认。当用户认为清单中的某条信息有问题时,可以对该条信息进行修改;当用户认为某条信息不需要时,还可以请求删除相应的信息。在这种情况下,用户拿取物品时生成的物品清单可以认为是临时物品清单,经过用户确认的可以认为是正式的物品清单。后续要删除正式的物品清单中的物品识别信息时需要经过用户同意。
在一个实施例中,所述确定所拿取物品的物品识别信息的步骤,包括:接收视讯侦测设 备发送的第一视讯侦测信息;当所述第一视讯侦测信息中包含有定位色块信息获取成功的信息时,根据所获取的定位色块信息确定所拿取物品上物品标识的目标位置;向所述视讯侦测设备发送标识识别指令;所述标识识别指令用于控制所述视讯侦测设备识别所述目标位置中的物品标识,得到物品识别信息;通过输出装置输出所述物品识别信息。
其中,视讯侦测设备指的是具有视频信息侦测功能的设备,可以通过摄像头、手机、录像设备、相机、电子手表等实现。
输出装置指的是能够将主控板生成的信息输出给用户的装置,可以是安装在物品陈列区域附近的显示器、用户绑定的移动终端、播放器等。输出的方式可以为视频、文字、语音、图片等。同时,通过移动终端输出物品识别信息可以借助微信、短信等方式实现。另外,向用户输出物品识别信息时,可以根据物品识别信息获取与该物品相对应的附加信息(这些附加信息可以是物品使用方式、烹饪方式、物品产地、成分、储存条件、生产厂家等等)并输出该附加信息。另外,以输出方式为显示为例,输出装置输出物品识别信息可以在用户拿取一个物品以后显示一次,也可以是在探测到用户挑选完物品时集中显示。当拿取一个物品显示一次时,可以在显示物品识别信息之后开始计时,如果用户重新拿取了新的物品则显示所拿取的新物品的物品识别信息,如果计时时间到达都没有侦测到有用户拿取物品则可以停止显示该物品识别信息。
定位色块指的是具有一定颜色的块状结构,这些定位色块可以设置在物品标识附近。这些定位色块可以按照一定的排布位置进行排布,视讯侦测设备根据这些定位色块的排布就能确定物品标识的方向。本发明实施例对这些色块的颜色、形状、数量、排布等不做限制。定位色块信息可以是色块的颜色、形状、数量、位置、所对应的物品识别信息等。
具体地,定位色块的示意图可以如图3所示。这些色块可以是涂于物品包装袋某个区域的四个角,颜色从上至下从左至右可以分别为红、绿、蓝、黄四种(本发明实施例对色块具体布局与颜色组合均不作限制)。当视讯侦测设备检测到从上至下从左至右的色块颜色为红、绿、蓝、黄时(如图3a),物品为正面面对视讯侦测设备。当检测到从上至下从左至右的色块颜色为绿、红、黄、蓝时(如图3b),物品为背面面对视讯侦测设备。当检测到从上至下从左至右的色块颜色为黄、蓝、绿、红时(如图3c),物品为正面旋转180°面对视讯侦测设备。当检测到从上至下、从左至右的色块颜色为蓝、黄、红、绿时(如图3d),物品为背面旋转180°面对视讯侦测设备。由此根据定位色块的方向就可以判断物品的朝向,从而为接下来视讯侦测设备识别物品识别信息提供前提条件。
物品标识可以设置在定位色块内部或附近,或者定位色块信息中包含有物品标识的位置。如图4所示,物品标识设置在定位方块的内部,视讯侦测设备成功获取到定位色块的位置就能知道物品标识的位置,进而确定物品识别信息。
基于上述内容,向所述视讯侦测设备发送标识识别指令的步骤,包括:向所述视讯侦测设备发送方向识别指令;所述方向识别指令用于控制所述视讯侦测设备识别定位色块的方向;接收视讯侦测设备返回的所述定位色块的方向,向所述视讯侦测设备发送标识识别指令;以控制所述视讯侦测设备根据所述定位色块的方向识别所述目标位置中的物品彩色码和/或EAN码,得到物品识别信息。
其中,物品彩色码也可以称为色带,它可以由多个彩色方块组成,方块的颜色、排布不同时可以代表不同的物品识别信息。
具体地,物品彩色码也可以通过颜色块来表示。可以为物品彩色码的RGB值赋予不同的数值编号。在确定物品彩色码的RGB值时,确定其对应的数值编号,进而确定物品识别信息。如下表1为不同RGB值与数值编号的对应关系。为便于颜色被视讯侦测设备捕捉,可以取RGB函数的最大值255和最小值0来定义颜色,例如,可以通过八种颜色对应八进制数的0~7,如表1(还可以根据视讯侦测设备的像素设置成二进制、十进制、十六进制等)。通过最大值和最小值定义的颜色均为纯色,具有较高的辨识度,能有效提高物品识别信息获取的准确率。当然,与这些数值编号对应的RGB值还可以为其他值。
数值编号 R G B 颜色
0 0 0 0 黑色
1 0 0 255 蓝色
2 0 255 0 绿色
3 0 255 255 青色
4 255 0 0 红色
5 255 0 255 洋红色
6 255 255 0 黄色
7 255 255 255 白色
表1 RGB值与八进制数值编号的对应表
其中,RGB色彩模式是工业界的一种颜色标准,通过对红(R)、绿(G)、蓝(B)三个颜色通道的变化以及它们相互之间的叠加来得到各式各样的颜色。这个颜色标准几乎包括了人类视 力所能感知的所有颜色,是目前运用最广的颜色系统之一。RGB函数执行成功时返回由指定分量确定的颜色,用长整数表示。RGB三通道的要求如下表2:
部分 描述
red 必要参数;Integer类型;数值范围:0~255;表示颜色的红色成份
green 必要参数;Integer类型;数值范围:0~255;表示颜色的绿色成份
blue 必要参数;Integer类型;数值范围:0~255;表示颜色的蓝色成份
表2 RGB三通道的要求
进一步地,物品彩色码可以包括:起始码、结束码和RGB中心码;识别目标位置中的物品彩色码得到物品识别信息可以通过以下方式实现:确定物品彩色码的起始码和结束码;获取所述起始码和结束码之间的RGB中心码,根据所述RGB中心码的RGB值确定物品识别信息。其中,RGB中心码中色块的颜色排布可以是多样的,不同的颜色排布可以对应不同的物品识别信息(排布编码规则可以根据一定的算法预先确定)。
起始码和结束码的实现方式可以为如图5所示的短线,横线表示起始码,竖线表示结束码。当然,起始码和结束码也可以通过其他图形或形式表示。
RGB中心码与对应的八进制数值编号的对应关系可以如图6和7所示(数值编号与RGB值的对应关系如表1所示)。其中,图6的RGB中心码通过矩形框表示,图7的RGB中心码通过圆形框表示,这些矩形框和圆形款内部填充有对应RGB值的颜色。
RGB中心码外框线的颜色可以与所贴附的物品包装颜色不同,以与该物品包装进行区别,提高识别的准确率。如图8所示,当背景(物品包装)为白色时,RGB中心码的边框为黑色,当背景为黑色时,RGB中心码的边框为白色。同时,条码之间可以留有适当的间隙。
本实施例,根据定位色块信息确定物品标识的方向以及物品标识的目标位置,这些信息能有效保证物品识别信息的可靠性。另外,通过输出装置输出物品识别信息能够让用户了解所拿取物品的相关信息,以促使用户完成商品挑选、购买等动作。
在一个实施例中,所述确定所拿取物品的物品识别信息的步骤,还包括:当所述第一视讯侦测信息中包含有定位色块信息获取失败的信息时,输出提示信息;以提示用户调整所拿取物品的角度,直到视讯侦测设备获取到定位色块信息。
用户在拿取物品时,由于光照、拿取角度、拿取位置等因素的影响,视讯侦测设备可能没法获取到完整的定位色块信息(例如:定位色块被用户的手遮挡,则视讯侦测设备无法获取到完整的定位色块信息)。此时可以通过提示规范用户拿取或摆放商品的方式,把商品放至 利于视讯侦测的角度或位置。
同时,还可以提醒用户进行手部移动,将物品移动到光照更好的位置;将定位色块所在的包装区域弄平整等。
本实施例,在定位色块信息获取失败时提醒用户进行调整,能保证定位色块信息的成功获取。
在一个实施例中,所述根据所述物品识别信息确定物品清单的步骤之后,还包括:接收视讯侦测设备发送的第二视讯侦测信息;当根据所述第二视讯侦测信息判定所述所拿取物品被拿出物品陈列区域后再次回到所述物品陈列区域时,从所述物品清单中删除对应的物品识别信息。当用户将物品放回至物品陈列区域中时,可以通过显示器等方式显示物品已放回的相关信息。
在实际的购物过程中,会有用户拿起某个商品查看以后决定不购买而将该商品放回原来的位置,或者刚开始想要购买某一个商品并将其拿出物品陈列区域之后因为某些原因不想购买该商品的情况。而由于在用户查看该商品时主控制器已经将该商品的物品识别信息添加至物品清单中了,因此,要从物品清单中删除相应的物品识别信息。
当然,还可以结合计时器来对物品清单进行整理,例如:可以在物品被拿起后开始计时,如果经过预设的时间段后该物品还是处于物品陈列区域,则认为用户没有将其带离物品陈列区域。将该物品对应的物品识别信息从物品清单中清除。
另一方面,当获取物品识别信息后,因为光线或手部遮挡等原因有可能导致二次或多次的重复识别,此时需要将二次或多次重复识别的信息进行去重复处理。因此,根据所述物品识别信息确定物品清单的步骤之后,还包括:当确定所述物品清单中存在重复的物品识别信息时,从所述物品清单中删除对应的重复物品识别信息。
生成物品清单之后,还可以包括对物品清单中的信息进行进一步处理的过程。该进一步处理可以包括去除无效数据、信息归类(例如:同一种类的物品对应的物品识别信息就近排布)等。
进一步地,根据第二视讯侦测信息判定所拿取物品被拿出物品陈列区域后再次回到物品陈列区域可以通过以下方式实现:当主控板接收到第二视讯侦测信息时,确定对应的物品识别信息,将所获取的物品识别信息与物品清单进行比对以查看是否有相匹配的物品识别信息。若有相匹配的物品识别信息,则根据视讯侦测信息判断当前时刻往前的时间段内是否有用户从物品陈列区域拿取该物品的动作;若有,则认为用户是再一次拿取了同样的物品,将物品 清单中对应物品识别信息中的物品数量加1,若没有,则认为是用户将物品拿出之后又拿回来了,即被拿出物品陈列区域后再次回到物品陈列区域。
本实施例,根据物品的位置以及物品清单的具体信息对物品清单进行处理,能有效保证物品清单中信息的准确性。
在一个实施例中,所述当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态的步骤之后,还包括:获取拿取所述所拿取物品的用户的生物识别信息,确定与所述生物识别信息对应的物品清单;所述根据所述物品识别信息确定物品清单的步骤,包括:将所述物品识别信息添加至所述与所述生物识别信息对应的物品清单中。
其中,生物识别信息可以指指纹、脸象、虹膜、体型等信息。当生物识别信息为脸象时,可以是通过视讯侦测设备获取拿取物品的人脸识别信息。视讯侦测设备所识别的生物识别信息可以和用户的购物行为一起存入数据库中,以便对用户进行标示并对用户的消费行为进行分析。
如果视讯侦测设备识别到用户A拿取了某一物品时,获取用户A的生物识别信息,并判断与该生物识别信息是否对应有物品清单。如果有,则将所拿取物品的物品识别信息添加到对应到物品清单中;如果没有,则可以建立一个空白物品清单,将所拿取物品的物品识别信息添加到该空白物品清单中。
当然,获取用户的生物识别信息时用户也不一定要拿取物品。当视讯侦测设备能获取到生物识别信息时,就可以为对应的生物识别信息生成此次购物的空白物品清单(可以将用户的生物识别信息与物品清单进行临时性关联绑定,即将此物品清单建立到该用户名下)。当该用户拿取了物品时,再将对应的物品识别信息添加至空白物品清单中。
生成空白物品清单之后,可以通过触摸屏、微信、语音、手势识别等途径与用户互动并询问其继续购物的意愿。如果用户决定不继续购物,则可以将相应的空白物品清单取消。
本实施例实现的是根据用户的生物识别信息确定物品清单的过程,能保证一个用户对应有唯一的物品清单,防止造成不同用户之间的信息混淆。同时能根据用户的意愿选择保留或取消物品清单。
在一个实施例中,所述根据所述侦测信息确定所述物品陈列区域处于物品拿取状态的步骤,包括:当根据视讯侦测设备发送的第三视讯侦测信息确定某一物品被用户拿在手中时,判定所述物品陈列区域处于物品拿取状态。
其中,某一物品被用户拿在手中可以通过物品的位置、手的动作等来确定。
本实施例,通过视讯侦测信息来确定用户是否有拿取物品,进而确定物品陈列区域的所处状态。
在另一个实施例中,所述根据所述侦测信息确定所述物品陈列区域处于物品拿取状态的步骤,包括:当根据红外侦测设备发送的红外侦测信息确定所述红外侦测设备发射的红外光被遮挡时,判定所述物品陈列区域处于物品拿取状态。本实施例,通过红外侦测信息来确定用户是否有拿取物品,进而确定物品陈列区域的所处状态。
其中,红外侦测设备可以安装在用户挑选物品的必经区域,以根据红外侦测区域(发射红外和接收红外的范围)是否存在信号遮挡的情况确定用户是否执行挑选物品的动作。以物品陈列区域为冰柜为例,可以将红外侦测设备设置在冰柜内或外表面,与冰柜门成平行关系。
上述两个实施例可以相互结合,以保证物品陈列区域所属状态判断的准确性。
为了更好地理解上述方法,以下以用户A到超市的冰柜拿取饮料为例详细阐述一个本发明物品清单的确定方法的应用实例。
1、用户A进入超市视讯侦测设备覆盖的区域。该视讯侦测设备对用户A的生物识别信息进行侦测,并将侦测到的生物识别信息发送给主控板。
2、主控板接收到该生物识别信息后,判断该生物识别信息是否对应有物品清单。如果没有,则为其生成空白物品清单。
3、生成空白物品清单后,主控板可以通过设置在超市的显示屏与用户A互动,询问用户A继续购物的意愿。如果用户A愿意继续购物,则为其保留空白物品清单;如果用户A不愿意继续购物,则取消该空白物品清单。
4、用户A在冰柜前挑选饮料之前,各个饮料处于其原来的位置,冰柜属于待选状态。当用户A在冰柜前挑选饮料并取出其中一瓶饮料时,视讯侦测设备侦测到饮料的位置发生变化;确定冰柜处于物品拿取状态。
5、视讯侦测设备扫描饮料瓶外表面以确定定位色块的位置和方向。根据定位色块的位置和方向确定用户说拿取的饮料L上的物品彩色码的位置和方向,进而确定物品彩色码的排列组合模式,确定其中的EAN码。
6、将EAN码对应的商品信息添加至与用户A对应的物品清单中;同时获取并通过用户的手机显示饮料L的商品名称、商品重量、放置位置、生产日期、保质期、价格、饮用方式等。
7、若视讯侦测设备侦测到用户A将饮料L拿出冰柜并放入购物车中时,通过显示器屏 幕提示用户A饮料L的信息(包括饮料类型、数量等)并请其确认是否选择购买。若用户选择购买,则可以将物品清单中对应的物品识别信息确定为已确认状态,后续要删除该物品识别信息时需要经过用户同意。
8、若用户A将饮料L拿出冰柜外一段时间后又将该饮料放回冰柜中,则认为用户A放弃购买饮料L;将物品清单中关于饮料L的信息删除。另外,去除物品清单中的重复数据。
9、将物品清单通过显示器反馈给用户,以便进行结算付款等后续操作。
本实施例,在用户挑选物品的过程中就能生成物品清单,能有效提高购物的效率。在物品陈列区域附近设置视讯侦测设备即可,对硬件要求低。简单易上手、使用便捷,能够有效地节省人力物力,并且相对于人为操作,可以更有效地避免流程错误,防止造成物品清单结果上的差异,应用前景十分广阔。
需要说明的是,对于前述的各方法实施例,为了简便描述,将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明并不受所描述的动作顺序的限制,因为依据本发明,某些步骤可以采用其它顺序或者同时进行。
基于与上述实施例中的物品清单的确定方法相同的思想,本发明还提供物品清单的确定装置,该装置可用于执行上述物品清单的确定方法。为了便于说明,物品清单的确定装置实施例的结构示意图中,仅仅示出了与本发明实施例相关的部分,本领域技术人员可以理解,图示结构并不构成对装置的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
如图9所述,物品清单的确定装置包括侦测信息获取模块901、识别信息确定模块902和物品清单确定模块903,详细说明如下:
侦测信息获取模块901,用于获取物品陈列区域的侦测信息。
识别信息确定模块902,用于当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息;所述物品识别信息通过识别所述所拿取物品上的物品标识得到。
以及,物品清单确定模块903,用于根据所述物品识别信息确定物品清单。
本实施例,在用户挑选物品的过程中就能生成物品清单,能有效提高购物的效率。
在一个实施例中,识别信息确定模块902,包括:视讯侦测信息获取子模块,用于接收视讯侦测设备发送的第一视讯侦测信息;目标位置确定子模块,用于当所述第一视讯侦测信息中包含有定位色块信息获取成功的信息时,根据所获取的定位色块信息确定所拿取物品上 物品标识的目标位置;识别信息确定子模块,用于向所述视讯侦测设备发送标识识别指令;所述标识识别指令用于控制所述视讯侦测设备识别所述目标位置中的物品标识,得到物品识别信息;通过输出装置输出所述物品识别信息。
在一个实施例中,识别信息确定子模块,包括:方向识别单元,用于向所述视讯侦测设备发送方向识别指令;所述方向识别指令用于控制所述视讯侦测设备识别定位色块的方向;标识识别单元,用于接收视讯侦测设备返回的所述定位色块的方向,向所述视讯侦测设备发送标识识别指令;以控制所述视讯侦测设备根据所述定位色块的方向识别所述目标位置中的物品彩色码和/或EAN码,得到物品识别信息。
在一个实施例中,识别信息确定模块902,还用于当所述第一视讯侦测信息中包含有定位色块信息获取失败的信息时,输出提示信息;以提示用户调整所拿取物品的角度,直到视讯侦测设备获取到定位色块信息。
在一个实施例中,还包括:第一删除模块,用于接收视讯侦测设备发送的第二视讯侦测信息;当根据所述第二视讯侦测信息判定所述所拿取物品被拿出物品陈列区域后再次回到所述物品陈列区域时,从所述物品清单中删除对应的物品识别信息。
在一个实施例中,还包括:第二删除模块,用于当确定所述物品清单中存在重复的物品识别信息时,从所述物品清单中删除对应的重复物品识别信息。
在一个实施例中,还包括:生物识别信息获取模块,用于获取拿取所述所拿取物品的用户的生物识别信息,确定与所述生物识别信息对应的物品清单;物品清单确定模块903,还用于将所述物品识别信息添加至所述与所述生物识别信息对应的物品清单中。
在一个实施例中,识别信息确定模块902,还用于当根据视讯侦测设备发送的第三视讯侦测信息确定某一物品被用户拿在手中时,判定所述物品陈列区域处于物品拿取状态。
在一个实施例中,识别信息确定模块902,还用于当根据红外侦测设备发送的红外侦测信息确定所述红外侦测设备发射的红外光被遮挡时,判定所述物品陈列区域处于物品拿取状态。
在一个实施例中,还提供一种物品清单的确定系统,该系统用于实现本发明上述实施例中的物品清单的确定方法。物品清单的确定系统可以如图10所示。包括视讯侦测设备、设置在物品上的物品标识、主控板以及显示器结构。各个结构的功能可以为:
1、视讯侦测设备:侦测特定区域内的生物识别信息、用户肢体动作信息以及侦测物品上的定位色块以及物品标识等。
2、显示器:显示器用于将商品信息、互动信息、物品清单等信息投放给用户。即可以在屏幕上投放商品的广告、货物信息、用户每一步的操作过程以及对用户后续操作的提示等,同时还可以在屏幕上显示用户取出物品的数量及其溯源信息(商品生产日期、商品产地、商品保质期、价格)等。
3、主控板:根据视讯侦测设备的信息确定物品清单。该主控板可以包括处理模块、存储模块、清单生成模块和关联模块。各个模块的功能可以为:
处理模块:处理分析视讯侦测设备上传的数据。
存储模块:存储视讯侦测设备识别的数据以及主控板生成的数据,如:生物识别信息、商品色带-EAN信息、物品清单等。
订单生成模块:生成与用户的生物识别信息对应的空白物品清单,并在用户拿取物品之后将对应的物品识别信息添加至物品清单中。
关联模块:将物品标识对应的EAN码与物品清单进行绑定关联。
本实施例,在用户挑选物品的过程中就能生成物品清单,能有效提高购物的效率。
需要说明的是,本发明的物品清单的确定装置与本发明的物品清单的确定方法一一对应,在上述物品清单的确定方法的实施例阐述的技术特征及其有益效果均适用于物品清单的确定装置的实施例中,具体内容可参见本发明方法实施例中的叙述,此处不再赘述,特此声明。
此外,上述示例的物品清单的确定装置的实施方式中,各程序模块的逻辑划分仅是举例说明,实际应用中可以根据需要,例如出于相应硬件的配置要求或者软件的实现的便利考虑,将上述功能分配由不同的程序模块完成,即将所述物品清单的确定装置的内部结构划分成不同的程序模块,以完成以上描述的全部或者部分功能。
在一个实施例中,提供了一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,处理器执行计算机程序时实现以下步骤:获取物品陈列区域的侦测信息;当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息;所述物品识别信息通过识别所述所拿取物品上的物品标识得到;根据所述物品识别信息确定物品清单。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:接收视讯侦测设备发送的第一视讯侦测信息;当所述第一视讯侦测信息中包含有定位色块信息获取成功的信息时,根据所获取的定位色块信息确定所拿取物品上物品标识的目标位置;向所述视讯侦测设备发送标识识别指令;所述标识识别指令用于控制所述视讯侦测设备识别所述目标位置中的物品标 识,得到物品识别信息;通过输出装置输出所述物品识别信息。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:向所述视讯侦测设备发送方向识别指令;所述方向识别指令用于控制所述视讯侦测设备识别定位色块的方向;接收视讯侦测设备返回的所述定位色块的方向,向所述视讯侦测设备发送标识识别指令;以控制所述视讯侦测设备根据所述定位色块的方向识别所述目标位置中的物品彩色码和/或EAN码,得到物品识别信息。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:当所述第一视讯侦测信息中包含有定位色块信息获取失败的信息时,输出提示信息;以提示用户调整所拿取物品的角度,直到视讯侦测设备获取到定位色块信息。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:接收视讯侦测设备发送的第二视讯侦测信息;当根据所述第二视讯侦测信息判定所述所拿取物品被拿出物品陈列区域后再次回到所述物品陈列区域时,从所述物品清单中删除对应的物品识别信息。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:当确定所述物品清单中存在重复的物品识别信息时,从所述物品清单中删除对应的重复物品识别信息。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:获取拿取所述所拿取物品的用户的生物识别信息,确定与所述生物识别信息对应的物品清单。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:将所述物品识别信息添加至所述与所述生物识别信息对应的物品清单中。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:当根据视讯侦测设备发送的第三视讯侦测信息确定某一物品被用户拿在手中时,判定所述物品陈列区域处于物品拿取状态。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:当根据红外侦测设备发送的红外侦测信息确定所述红外侦测设备发射的红外光被遮挡时,判定所述物品陈列区域处于物品拿取状态。
在一个实施例中,提供了一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器执行时实现以下步骤:获取物品陈列区域的侦测信息;当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息;所述物品识别信息通过识别所述所拿取物品上的物品标识得到;根据所述物品识别信息确定物品清单。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:接收视讯侦测设备发送 的第一视讯侦测信息;当所述第一视讯侦测信息中包含有定位色块信息获取成功的信息时,根据所获取的定位色块信息确定所拿取物品上物品标识的目标位置;向所述视讯侦测设备发送标识识别指令;所述标识识别指令用于控制所述视讯侦测设备识别所述目标位置中的物品标识,得到物品识别信息;通过输出装置输出所述物品识别信息。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:向所述视讯侦测设备发送方向识别指令;所述方向识别指令用于控制所述视讯侦测设备识别定位色块的方向;接收视讯侦测设备返回的所述定位色块的方向,向所述视讯侦测设备发送标识识别指令;以控制所述视讯侦测设备根据所述定位色块的方向识别所述目标位置中的物品彩色码和/或EAN码,得到物品识别信息。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:当所述第一视讯侦测信息中包含有定位色块信息获取失败的信息时,输出提示信息;以提示用户调整所拿取物品的角度,直到视讯侦测设备获取到定位色块信息。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:接收视讯侦测设备发送的第二视讯侦测信息;当根据所述第二视讯侦测信息判定所述所拿取物品被拿出物品陈列区域后再次回到所述物品陈列区域时,从所述物品清单中删除对应的物品识别信息。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:当确定所述物品清单中存在重复的物品识别信息时,从所述物品清单中删除对应的重复物品识别信息。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:获取拿取所述所拿取物品的用户的生物识别信息,确定与所述生物识别信息对应的物品清单。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:将所述物品识别信息添加至所述与所述生物识别信息对应的物品清单中。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:当根据视讯侦测设备发送的第三视讯侦测信息确定某一物品被用户拿在手中时,判定所述物品陈列区域处于物品拿取状态。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:所述根据所述侦测信息确定所述物品陈列区域处于物品拿取状态的步骤,包括:当根据红外侦测设备发送的红外侦测信息确定所述红外侦测设备发射的红外光被遮挡时,判定所述物品陈列区域处于物品拿取状态。
本领域普通技术人员可以理解,实现上述实施例方法中的全部或部分流程,是可以通过 计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,作为独立的产品销售或使用。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。
应当理解,本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。
本发明实施例的术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或(模块)单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。
以上所述实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。
以上所述实施例仅表达了本发明的几种实施方式,不能理解为对本发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进,这些都属于本发明的保护范围。因此,本发明专利的保护范围应以所附权利要求为准。

Claims (10)

  1. 一种物品清单的确定方法,其特征在于,包括以下步骤:
    获取物品陈列区域的侦测信息;
    当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息;所述物品识别信息通过识别所述所拿取物品上的物品标识得到;
    根据所述物品识别信息确定物品清单。
  2. 根据权利要求1所述的物品清单的确定方法,其特征在于,所述确定所拿取物品的物品识别信息的步骤,包括:
    接收视讯侦测设备发送的第一视讯侦测信息;
    当所述第一视讯侦测信息中包含有定位色块信息获取成功的信息时,根据所获取的定位色块信息确定所拿取物品上物品标识的目标位置;
    向所述视讯侦测设备发送标识识别指令;所述标识识别指令用于控制所述视讯侦测设备识别所述目标位置中的物品标识,得到物品识别信息;
    通过输出装置输出所述物品识别信息。
  3. 根据权利要求2所述的物品清单的确定方法,其特征在于,所述向所述视讯侦测设备发送标识识别指令的步骤,包括:
    向所述视讯侦测设备发送方向识别指令;所述方向识别指令用于控制所述视讯侦测设备识别定位色块的方向;
    接收视讯侦测设备返回的所述定位色块的方向,向所述视讯侦测设备发送标识识别指令;以控制所述视讯侦测设备根据所述定位色块的方向识别所述目标位置中的物品彩色码和/或EAN码,得到物品识别信息。
  4. 根据权利要求2所述的物品清单的确定方法,其特征在于,所述确定所拿取物品的物品识别信息的步骤,还包括:
    当所述第一视讯侦测信息中包含有定位色块信息获取失败的信息时,输出提示信息;以提示用户调整所拿取物品的角度,直到视讯侦测设备获取到定位色块信息。
  5. 根据权利要求1所述的物品清单的确定方法,其特征在于,所述根据所述物品识别信息确定物品清单的步骤之后,还包括:
    接收视讯侦测设备发送的第二视讯侦测信息;当根据所述第二视讯侦测信息判定所述所 拿取物品被拿出物品陈列区域后再次回到所述物品陈列区域时,从所述物品清单中删除对应的物品识别信息;
    和/或,
    当确定所述物品清单中存在重复的物品识别信息时,从所述物品清单中删除对应的重复物品识别信息。
  6. 根据权利要求1所述的物品清单的确定方法,其特征在于,所述当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态的步骤之后,还包括:
    获取拿取所述所拿取物品的用户的生物识别信息,确定与所述生物识别信息对应的物品清单;
    所述根据所述物品识别信息确定物品清单的步骤,包括:
    将所述物品识别信息添加至所述与所述生物识别信息对应的物品清单中。
  7. 根据权利要求1至6任一项所述的物品清单的确定方法,其特征在于,所述根据所述侦测信息确定所述物品陈列区域处于物品拿取状态的步骤,包括:
    当根据视讯侦测设备发送的第三视讯侦测信息确定某一物品被用户拿在手中时,判定所述物品陈列区域处于物品拿取状态;
    和/或,
    当根据红外侦测设备发送的红外侦测信息确定所述红外侦测设备发射的红外光被遮挡时,判定所述物品陈列区域处于物品拿取状态。
  8. 一种物品清单的确定装置,其特征在于,包括:
    侦测信息获取模块,用于获取物品陈列区域的侦测信息;
    识别信息确定模块,用于当根据所述侦测信息确定所述物品陈列区域处于物品拿取状态时,确定所拿取物品的物品识别信息;所述物品识别信息通过识别所述所拿取物品上的物品标识得到;
    以及,物品清单确定模块,用于根据所述物品识别信息确定物品清单。
  9. 一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至7任一项所述的方法的步骤。
  10. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至7任一项所述的方法的步骤。
PCT/CN2019/120376 2019-11-22 2019-11-22 物品清单的确定方法、装置、计算机设备及存储介质 WO2021097840A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/120376 WO2021097840A1 (zh) 2019-11-22 2019-11-22 物品清单的确定方法、装置、计算机设备及存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/120376 WO2021097840A1 (zh) 2019-11-22 2019-11-22 物品清单的确定方法、装置、计算机设备及存储介质

Publications (1)

Publication Number Publication Date
WO2021097840A1 true WO2021097840A1 (zh) 2021-05-27

Family

ID=75981147

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/120376 WO2021097840A1 (zh) 2019-11-22 2019-11-22 物品清单的确定方法、装置、计算机设备及存储介质

Country Status (1)

Country Link
WO (1) WO2021097840A1 (zh)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105787413A (zh) * 2016-02-04 2016-07-20 中国联合网络通信集团有限公司 一种二维码内容显示区域的定位方法及装置
CN107085737A (zh) * 2016-02-14 2017-08-22 上海快仓智能科技有限公司 二维码的编解码系统、生成方法及装置、识别方法及装置
CN107749023A (zh) * 2017-10-30 2018-03-02 周燕红 一种无人超市自动管理方法及装置
CN108875690A (zh) * 2018-06-29 2018-11-23 百度在线网络技术(北京)有限公司 无人零售商品识别系统
CN108922028A (zh) * 2018-08-03 2018-11-30 济南每日优鲜便利购网络科技有限公司 自动售卖设备、自动售卖设备的控制方法及系统
CN109002780A (zh) * 2018-07-02 2018-12-14 深圳码隆科技有限公司 一种购物流程控制方法、装置和用户终端
CN109345734A (zh) * 2018-09-30 2019-02-15 连云港伍江数码科技有限公司 物品清单的确定方法、装置、计算机设备及存储介质
CN109754525A (zh) * 2019-01-11 2019-05-14 京东方科技集团股份有限公司 自动售卖设备及其控制方法、存储介质及电子设备
WO2019130779A1 (ja) * 2017-12-28 2019-07-04 株式会社ブイシンク 店舗
CN110097715A (zh) * 2018-01-29 2019-08-06 大黑天物产株式会社 商品管理服务器、自动收银系统及商品管理方法

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105787413A (zh) * 2016-02-04 2016-07-20 中国联合网络通信集团有限公司 一种二维码内容显示区域的定位方法及装置
CN107085737A (zh) * 2016-02-14 2017-08-22 上海快仓智能科技有限公司 二维码的编解码系统、生成方法及装置、识别方法及装置
CN107749023A (zh) * 2017-10-30 2018-03-02 周燕红 一种无人超市自动管理方法及装置
WO2019130779A1 (ja) * 2017-12-28 2019-07-04 株式会社ブイシンク 店舗
CN110097715A (zh) * 2018-01-29 2019-08-06 大黑天物产株式会社 商品管理服务器、自动收银系统及商品管理方法
CN108875690A (zh) * 2018-06-29 2018-11-23 百度在线网络技术(北京)有限公司 无人零售商品识别系统
CN109002780A (zh) * 2018-07-02 2018-12-14 深圳码隆科技有限公司 一种购物流程控制方法、装置和用户终端
CN108922028A (zh) * 2018-08-03 2018-11-30 济南每日优鲜便利购网络科技有限公司 自动售卖设备、自动售卖设备的控制方法及系统
CN109345734A (zh) * 2018-09-30 2019-02-15 连云港伍江数码科技有限公司 物品清单的确定方法、装置、计算机设备及存储介质
CN109754525A (zh) * 2019-01-11 2019-05-14 京东方科技集团股份有限公司 自动售卖设备及其控制方法、存储介质及电子设备

Similar Documents

Publication Publication Date Title
US11568632B1 (en) Item identification among a variant of items
US10909667B1 (en) Image rectification using transformation data
US20230214768A1 (en) Detecting inventory changes
US20220108270A1 (en) Transitioning items from a materials handling facility
US11127061B2 (en) Method, product, and system for identifying items for transactions
WO2019165892A1 (zh) 自动售货方法、装置和计算机可读存储介质
CN109064270B (zh) 智能购物车、服务器、智能购物系统及方法
US11328147B1 (en) Identifying item barcodes
US11393253B1 (en) Using sensor data to determine activity
CA2888153A1 (en) Methods and arrangements for identifying objects
CN107221079A (zh) 一种自动售货机及其售货方法
US10346659B1 (en) System for reading tags
US11798380B2 (en) Identifying barcode-to-product mismatches using point of sale devices
US11922486B2 (en) Identifying items using cascading algorithms
US20230037427A1 (en) Identifying barcode-to-product mismatches using point of sale devices and overhead cameras
US11270102B2 (en) Electronic device for automated user identification
CN111428621A (zh) 货架交互方法、装置和货架
CN110276623B (zh) 控制、展示、播放方法、服务器、电子价签、设备和系统
CN109345734A (zh) 物品清单的确定方法、装置、计算机设备及存储介质
CN110348926B (zh) 门店系统、展示柜、物品信息展示方法及装置
US11392889B1 (en) Analysis of events for state detection
WO2021097840A1 (zh) 物品清单的确定方法、装置、计算机设备及存储介质
US11625725B1 (en) Stateless secure payment system
JP6345656B2 (ja) 家電装置で使用した物品を特定する情報処理システム及び防犯システム
US10181108B1 (en) Item attribute collection

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19953442

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19953442

Country of ref document: EP

Kind code of ref document: A1