WO2019128908A1 - 数据对象信息处理方法、装置、系统及电子设备 - Google Patents

数据对象信息处理方法、装置、系统及电子设备 Download PDF

Info

Publication number
WO2019128908A1
WO2019128908A1 PCT/CN2018/123000 CN2018123000W WO2019128908A1 WO 2019128908 A1 WO2019128908 A1 WO 2019128908A1 CN 2018123000 W CN2018123000 W CN 2018123000W WO 2019128908 A1 WO2019128908 A1 WO 2019128908A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
data object
identifier
image
data
Prior art date
Application number
PCT/CN2018/123000
Other languages
English (en)
French (fr)
Inventor
朱瑜
Original Assignee
阿里巴巴集团控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司 filed Critical 阿里巴巴集团控股有限公司
Publication of WO2019128908A1 publication Critical patent/WO2019128908A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/18—Payment architectures involving self-service terminals [SST], vending machines, kiosks or multimedia terminals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/32—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
    • G06Q20/327—Short range or proximity payments by means of M-devices
    • G06Q20/3276—Short range or proximity payments by means of M-devices using a pictured code, e.g. barcode or QR-code, being read by the M-device
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00—Cash registers
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00—Cash registers
    • G07G1/0036—Checkout procedures
    • G07G1/0045—Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00—Cash registers
    • G07G1/01—Details for indicating
    • G07G1/06—Details for indicating with provision for the noting of the money to be paid
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00—Cash registers
    • G07G1/12—Cash registers electronically operated
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/32—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
    • G06Q20/326—Payment applications installed on the mobile devices

Definitions

  • the present application relates to the field of data object information processing technologies, and in particular, to a data object information processing method, apparatus, system, and electronic device.
  • a self-service cash register is deployed at the exit location of the store, and the cash register is equipped with a scanning code device, and the customer can align the barcode of the selected product with the scanning code device to complete the identification of the purchased product and the price information. Confirmation. After all the purchased products have been scanned, the cash register can calculate the amount to be paid. Then, the customer can present the terminal device such as his mobile phone, open the cooperative application, display the payment code, and the cash register can scan. The payment code information of the user, thereby completing the payment of the order.
  • the deployment of the self-service cash register described above allows the customer to complete the settlement process by himself, and also helps to save labor costs in the physical store.
  • the problem of loss prevention is usually involved, that is, it is necessary to avoid the occurrence of less sweeping or mis-sweeping of the customer, so as to reduce the risk of property damage to the physical store. For example, since the customer scans the code himself, it may happen that in fact, a total of 10 items have been purchased, but only 9 of them are scanned during the scan, and another item that has not been scanned will be It may be taken away along with other items that have already been scanned.
  • the customer actually purchases a relatively high-priced product, but for the purpose of taking advantage of the price, etc., the bar code of other low-priced products may be removed and posted on the high-priced product, so that the payment is made. Low prices take high-priced items. All of these situations will bring economic losses to physical stores.
  • each self-service cash register needs to be equipped with a corresponding staff member around the clock, otherwise the customer will not be able to complete the settlement.
  • this will violate the original intention of self-service cashier and has a limited role in saving labor costs.
  • other methods are used for loss prevention.
  • the weighing machine can be connected to the weighing platform. After the user is required to scan the code, the product is placed on the weighing platform for weighing. If the heavy weight matches the specification of the product corresponding to the scan result, the operation is allowed to continue, otherwise the self-service settlement cannot be completed.
  • This method can play a role in preventing damage to a certain extent and does not require human intervention.
  • some ice cubes may be added to the package, and at this time, it will be placed on the weighing platform at the time of settlement. The weight is greater than the actual weight of the product, in which case it will also result in a failure to settle smoothly, and so on.
  • the present application provides a data object information processing method, apparatus, system, and electronic device, which can more effectively perform loss prevention processing in a self-service settlement process.
  • a data object information processing system includes a terminal device, an image acquisition device, and an information processor, wherein:
  • the terminal device includes an information entry area for inputting identification information of the selected data object in the settlement process
  • the image collection device is configured to perform image collection on a process of inputting data object identification information
  • the information processor is configured to: according to the data object identifier information received by the terminal device, and the image data collected by the image collection device, the user operation behavior and the actual data object information recorded in the settlement process The degree of matching is judged.
  • a data object information processing method includes:
  • a data object information processing method includes:
  • the obtained data entry identifier information and the collected image data are provided to the server, and the server determines the matching degree between the user operation behavior and the actually entered data object information in the settlement process.
  • a data object information processing method includes:
  • a data object information processing apparatus includes:
  • the entry information obtaining unit is configured to obtain the identifier input information of the selected data object
  • An image collecting unit configured to perform image collection on a process of inputting data object identification information
  • the determining unit is configured to determine, according to the data object identifier input information and the collected image data, a matching degree between the user operation behavior and the actually entered data object information in the settlement process.
  • a data object information processing apparatus includes:
  • the entry information obtaining unit is configured to obtain the identifier input information of the selected data object
  • An image collecting unit configured to perform image collection on a process of inputting data object identification information
  • the information submitting unit is configured to provide the obtained data entry identifier information and the collected image data to the server, and the server determines the matching degree between the user operation behavior and the actually entered data object information in the settlement process. .
  • a data object information processing apparatus includes:
  • the information receiving unit is configured to receive the identifier input information of the data object purchased by the user submitted by the terminal device, and the image data collected by the process of inputting the data object identifier information;
  • the determining unit is configured to determine, according to the data object identifier input information and the collected image data, a matching degree between the user operation behavior and the actually entered data object information in the settlement process.
  • An electronic device comprising:
  • One or more processors are One or more processors;
  • a memory associated with the one or more processors the memory for storing program instructions that, when read by the one or more processors, perform the following operations:
  • the present application discloses the following technical effects:
  • the image collection device and the information processor can be set in the data object information processing system, so that the image collection device can perform the user's operation behavior and related in the process of inputting the data object identification information through the terminal device.
  • the image information of the data object is collected, and then the information processor can determine whether the data object actually taken by the user is consistent with the data object entered in the terminal device by means of image analysis, thereby realizing the self-checkout process. Loss prevention treatment.
  • FIG. 1 is a schematic diagram of an application scenario provided by an embodiment of the present application.
  • FIG. 2 is a schematic diagram of a system provided by an embodiment of the present application.
  • 3-1 to 3-4 are schematic diagrams of interfaces of a terminal device according to an embodiment of the present application.
  • FIG. 5 is a flowchart of a second method provided by an embodiment of the present application.
  • FIG. 6 is a flowchart of a third method provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a first device provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a second device provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram of a third device provided by an embodiment of the present application.
  • FIG. 10 is a schematic diagram of an electronic device according to an embodiment of the present application.
  • a settlement terminal device 101 can be deployed in a physical store and equipped with an image capture device 102 (eg, a camera, etc.).
  • an image acquisition device may be provided for a sales terminal such as a POS machine.
  • the image collection device can perform image collection, and the image collection result can be used to determine whether the user has “less scan” during the settlement process. , "wrong scan” and so on.
  • the number of products can be ambiguously identified, and information such as the identification of a specific data object can be accurately identified to determine whether there is an act of cheating with an unequal value commodity, and the like.
  • the data analysis based on the video or the photo image itself is not a completely new technology, but the embodiment of the present application applies the image analysis technology to the self-settlement application scenario for performing loss prevention processing, and
  • data processing based on image recognition has better feasibility. This is because if the collected image content is too complicated, it may be difficult to extract effective information from it, so that in the prior art, image recognition is more in the concept stage, and the scope of practical application is not wide.
  • the user since the user usually needs to input the identification information of each selected data object piece by piece during the settlement process, for example, if a user selects 10 items in total, the settlement is performed.
  • the barcodes of the respective products are aligned with the scanning port of the terminal device to input the data object identification information. Therefore, the image information of the product that the user inputs each time can be collected by the image collecting device, and then the user can perform an input operation on the number of items according to the collected image data, and the identifier of the specific data object for each operation. ,and many more. In this way, the result of the analysis from the image can be compared with the actual recorded result, thereby determining the degree of matching between the user's user operation behavior and the actually entered data object information, that is, determining whether the user exists. Less sweep or "wrong sweep".
  • the product scanned by the user and the actually recorded data object information may be compared by using the solution provided in the embodiment of the present application.
  • a product placement table or the like may be provided in the vicinity of the terminal device, and the user may be required to place all the products purchased by the user on the placement table before or after the data object identification information is entered, preferably not between each other.
  • the image acquisition device After overlapping each other, the image acquisition device then performs image acquisition on the items on the placement table. In this way, information such as the number of products actually purchased by the user and the identification information can be determined and used for comparison with the data object information of the actual entry system.
  • this alternative method requires the cooperation of the user.
  • the method of image collection of the information of the product picked up by the user each time is a more preferable solution. Because it implements a loss prevention process in a non-cooperating state of the user, the user only needs to perform the scanning operation such as scanning code normally, and does not need to perform additional operations specifically for the loss prevention processing, thereby facilitating the user to be improved. The experience also further improves efficiency.
  • the first embodiment provides a data object information processing system.
  • the system may specifically include a terminal device 201, an image collection device 202, and an information processor 203, where:
  • the terminal device 201 includes an information entry area for inputting identification information of the selected data object during the settlement process;
  • the image collection device 202 is configured to perform image collection on a process of inputting data object identification information
  • the information processor 203 is configured to: according to the data object identifier information received by the terminal device 201 and the image data collected by the image collection device 202, the user operation behavior and the actual data entered in the settlement process. The degree of matching of the object information is judged.
  • the terminal device 201 may be specifically deployed in a physical store, or may be in the form of a settlement terminal such as a POS, so that portable settlement can be realized.
  • the main function of the terminal device 201 is to help the user complete the self-service settlement process.
  • the image capture device 202 and the information processor 203 perform loss prevention control.
  • the presence of the image collector 202 and the information processor 203 may not be perceived, and the operation may be directly performed according to the prompt of the terminal device 201.
  • an information entry area may be provided, and the specific form of the information entry area may also be different according to different information input methods.
  • the information entry area may specifically be a scan code port or the like in a hardware form.
  • FIG. 3-1 it shows a specific implementation form of the terminal device.
  • the scan code port 301 can be located at a lower right corner of the terminal device.
  • the prompt information may be displayed on the display screen of the terminal device, for example, "click the screen to start self-checkout", and the like. After the user clicks on the screen, the entry mode information can also be prompted.
  • the prompt can be prompted by the graphic and the text, and the text portion can include “waiting to scan the product code, please barcode the product. Align the code below the port, and so on.
  • the user can align the graphic code such as the barcode of the product that he has purchased with the scan code port one by one, and the terminal device can obtain the identification information of the specific data object.
  • the terminal device may also pre-store information such as the price of each data object, or obtain price information of a specific data object from the server in real time, and may also accumulate the price of each data object in the process of scanning the code, and The information of the data object is displayed in the display of the terminal device, as shown in Figure 3-3.
  • the scan code may be unsuccessful. Therefore, the identification information of the data object may be input by manually inputting the product code.
  • the information entry area may specifically refer to the display of the terminal device.
  • An area for example, a button such as "Manually input barcode" displayed in the lower left corner of the display in Figure 3-3, the user can click the button to open the virtual keyboard, and compare the barcode of the purchased product with the specific data.
  • the object identification information is input to the terminal device.
  • the associated client program can be installed in a mobile terminal device that is private to the user, for example, a “box horse app” on the mobile phone side.
  • the identification information and the like of the data object acquired by the terminal device 201 can also be submitted to the server corresponding to the application, for example, the server of the "box horse” in the foregoing example, and the corresponding order is generated by the server. Then, as shown in FIG.
  • the terminal device 201 can prompt the user in the display screen: "Please open the payment code of the box horse app, align the code scanning port below", and the like. After that, the user can operate the related application program pre-installed in the terminal device such as his mobile phone, and enter the payment code interface, and align the display screen of the mobile phone with the scan code port of the terminal device 201, and the terminal device can correlate the payment code.
  • the information is provided to the server, so that the server can complete the payment processing by using information such as the user account carried in the payment code.
  • the terminal device 201 can be equipped with a smart operating system.
  • recommendation information such as a marketing plan that can be provided on an App (application) installed in a mobile terminal device such as a mobile phone can be provided to the user through the settlement terminal device.
  • the user is also able to obtain more marketing information such as marketing activities, or recommendation information about more data objects, or the like, through the terminal device during the settlement process or after the settlement is completed.
  • Users can also interact directly through such terminal devices, including completing interactive games, winning corresponding rewards, or selecting data objects of interest to place orders, and so on.
  • the settlement terminal device can acquire information such as the user's account and further obtain information such as the identity characteristics of the user, in the process of providing the recommendation information, the personalized recommendation can be provided according to different users.
  • This recommended information can also be information about related online data objects, so that user drainage from offline to online can also be achieved.
  • the terminal device can also be equipped with a larger area of the screen, and can exist in the form of a touch screen for better support for interaction with the user. In short, in this way, the entire terminal device 201 looks like a relatively large tablet computer, and can present more rich information, and can also interact with the user, and save space.
  • the terminal device 201 can also be provided with a multi-view camera, which can be used to acquire a face image of the user, thereby performing identity verification on the user.
  • the user usually binds the user's face image with the account information during the real-name authentication process. Therefore, the user can compare the face image of the user actually operated and the account information entered by the user. Whether it is the user's own operation, to avoid the use of the user's terminal equipment by others, resulting in loss of the user's property and the like.
  • the user can be authenticated by collecting the biometric information of the user, including the fingerprint, the iris, and the like.
  • the biosignal information collecting device can be collectively referred to as Collecting biometric information of the user for authenticating the user.
  • the biological sign information collecting device may be built in the terminal device 201, or may be independently set and communicated with the terminal device 201, and the like.
  • the image collection device 202 can perform image collection on the user operation behavior, the information of the operated data object, and the like in the process of settlement without the user's perception.
  • the image capturing device may specifically input the identification information of the selected data object by means of piece-by-piece input.
  • image information of the data object operated at each entry is collected.
  • the location of the image capturing device and the shooting angle may be determined according to the location of the information input area in the terminal device. For example, as shown in FIG.
  • the image capturing device may be located in the The information input area is obliquely upward, and the shooting angle can cover a range centered on the information input area, and the image information of the data object can be performed in the process of marking the data object by entering the data entry area. collection. In this way, it is possible to avoid collecting too much invalid image information, and more accurately collecting information on the user's operation behavior and the image of the product actually operated by the user.
  • the product operated by the user herein may specifically refer to the product currently being scanned. For example, the user holds a product, and the barcode of the product is aligned with the scan port of the terminal device 201 for scanning. Then the item is the item operated by the user.
  • the image capturing device 202 may specifically perform video recording on the process of inputting the data object identification information, and then analyze and determine the specifically recorded video data.
  • image acquisition may be performed by other means such as taking a photo.
  • the image capture device can also recognize the user's operation behavior, and each time the user is identified to perform a scan operation such as scanning a product, a photograph is taken. Or multiple photos, one or more photos are taken when the operation of entering the next item identification information is recognized, and so on. In this way, each time an identification input operation of an item is performed, one or more photos can be acquired correspondingly, and subsequent analysis and judgment can be performed by analyzing the photos.
  • the collected image data may be provided to the information processor 203, and the information processor 203 may operate the user in the settlement process according to the data object identification information received by the terminal device and the image data collected by the image collection device. The behavior is judged by the degree of matching of the data object information actually entered.
  • the information processor 203 can be located in the terminal device 201, that is, the related determining operation can be performed locally in the terminal device 201. Alternatively, the information processor 203 may also be located in the server of the cloud. At this time, the relevant collection result information may be submitted to the server, and the information processor in the server performs the relevant determination operation. At this time, the information processor on the server side can adopt the method of synchronous judgment, that is, while receiving the relevant data collection result, the judgment is performed, and the judgment result can be provided to the terminal device 201 in real time, and the terminal device 201 can determine whether to allow in real time. The user continues to operate.
  • the server-side information processor may also adopt an asynchronous judgment manner, that is, in the process of actually performing settlement by the user, only the collected related data may be received, but the judgment is not performed temporarily, and the subsequent set time is uniformly set.
  • the segment performs a judgment operation.
  • the result of the judgment can usually be provided to the client used by the relevant manager of the physical store, for example, when a problem with the order of a certain user is found, the related information can be provided to the administrator of the corresponding physical store.
  • Subsequent specific processing may be determined according to actual conditions. For example, the user may be liable, or the user may be tagged, the user may not be allowed to use the self-checkout terminal device for settlement, and the like.
  • the information processor may specifically identify the quantity information when performing the judgment, or may also accurately identify the identification information of the specific data object. For example, for the former, the information processor may determine the number of times the user performs the entry operation, and the number of data objects actually entered, and determine whether the number of times the specified entry operation is consistent with the number of actually entered data objects. For the latter, the information processor may determine, according to the collected image data, an identifier of the data object operated by the user during the performing the input operation, determine the identifier of the operated data object, and the entered data object Whether the logos are consistent.
  • the data object operated by the user described herein refers to a data object corresponding to the product that the user actually holds and scans the code near the scan code port, and the identifier of the data object actually entered into the terminal device may be different. For example, if the user attempts to settle a high-priced item with a bar code of a low-priced item, there may be a case where the item A is to be purchased, but the bar code of the item B is removed in advance and attached to the bar code position of the item A, In this way, when the hand-held product A performs scanning code, the bar code of the product B is actually scanned. At this time, the terminal device receives the identification information of the data object corresponding to the product B, and thus, the user holds the identification information.
  • the product is inconsistent with the actual scanned product.
  • the correspondence between the identifier of the data object and the image feature information may be saved in advance, so that the collected image data may be obtained according to the collected image data. And the corresponding relationship, determining an identifier of the data object operated by the user during the performing the input operation.
  • the image collection device and the information processor can be set in the data object information processing system, so that the image acquisition device can perform the operation behavior on the user in the process of inputting the data object identification information through the terminal device. And the image information of the related data object is collected, and then the information processor can determine whether the data object actually taken by the user is consistent with the data object entered in the terminal device by means of image analysis, thereby realizing self-help Loss prevention processing during settlement.
  • the image collection device can perform the input operation for the user each time the user performs the piece-by-piece information input process.
  • the image information of the data object is collected, so that the loss prevention processing in the non-cooperating state of the user can be realized, which is beneficial to improving the user experience and further improving the efficiency.
  • the second embodiment provides a data object information processing method from the perspective of the terminal device.
  • the image collection device may be integrated in the terminal device, or may be connected to the terminal device in an external manner.
  • the information device may also be included in the terminal device, and the information processor may be implemented in various forms such as software or hardware.
  • the method may specifically include:
  • S402 Perform image collection on a process of inputting data object identification information
  • S403 Determine, according to the data object identifier input information and the collected image data, a matching degree between the user operation behavior and the actually entered data object information in the settlement process.
  • the identification entry information of the selected data object when the identification entry information of the selected data object is obtained, the identification entry information of the selected data object submitted by the piece-by-piece entry manner can be obtained.
  • the user can perform a scan operation on the data objects purchased by them one by one, or input bar code information of each data object piece by piece, and the like.
  • the process when performing image collection on the process of inputting the data object identification information, the process may perform image recording on the process of data object identification information input by means of piece-by-piece input, thereby reducing user cooperation.
  • the process of recording the data object identification information may be video recorded, and then, when performing analysis, the video image may be analyzed and processed. Alternatively, it is also possible to take an image by taking a photograph or the like.
  • the number of fuzzy numbers may be determined. Specifically, the number of times the user performs the entry operation and the number of actually recorded data objects may be determined, and then the number of the specified entry operations and the actual entered data object are determined. The number is the same.
  • the identifier of the data object operated by the user during the input operation may be determined according to the collected image data, and then, the identifier of the operated data object and the identifier of the entered data object are determined. Consistent.
  • the correspondence between the identification of the data object and the image feature information may be saved in advance. In this way, the identifier of the data object operated by the user during the input operation can be determined according to the collected image data and the corresponding relationship.
  • the operation when determining whether the identifier of the operated data object is consistent with the identifier of the entered data object, the operation may be determined every time a piece of input information about the selected data object identifier is received. The identifier of the data object is consistent with the identifier of the entered data object. If the judgment result corresponding to the currently received entry information is inconsistent, the settlement operation may be interrupted.
  • the first set of the identifiers of the operated data objects is composed of the identifiers of the entered data objects. Is the second set the same?
  • the third embodiment provides another data object information processing method from the perspective of the terminal device.
  • the information processor can be located at the server end. Therefore, related image recognition and determination operations can be completed on the server side. .
  • the method may specifically include:
  • S502 Perform image collection on a process of inputting data object identification information
  • S503 The identifier input information of the obtained data object and the collected image data are provided to the server, and the server determines the matching degree between the user operation behavior and the actually entered data object information in the settlement process.
  • the fourth embodiment is corresponding to the three-phase of the embodiment. From the perspective of the server, a data object information processing method is provided. Referring to FIG. 6, the method may specifically include:
  • S601 receiving identifier input information of a data object purchased by the user, and acquiring image data collected by the process of inputting the data object identifier information;
  • S602 Determine, according to the data object identifier input information and the collected image data, a matching degree between the user operation behavior and the actually entered data object information in the settlement process.
  • synchronization processing or asynchronous processing can be performed.
  • information such as the collection time of the specific image data can be saved, and therefore, according to the specific The time information is used to determine the match between the order information and the acquired image data.
  • a server needs to connect multiple physical stores or multiple terminal devices, it can also store specific store identification, terminal device identification and other information in the order and the collected image data, so as to generate the same terminal device in the unified store.
  • the order information is matched with the image data collected by the image acquisition device associated with the device.
  • the attribute information of the order to be matched may be determined first, and the attribute information of the order includes: an entity store identifier associated with the order, a terminal device identifier, an order generation time information, and a time when the data object identifier entry is started.
  • attribute information of the collected image data may be further determined, and the attribute information of the image data includes: a physical store identifier associated with the image data, a terminal device identifier, and image collection time information.
  • the image data to be analyzed corresponding to the order may be determined according to the attribute information of the order and the attribute information of the image data, and the input information according to the data object identifier associated with the order, and the image data to be analyzed, The degree of matching between the user operation behavior and the actual data object information entered during the settlement process is judged.
  • the embodiment of the present application further provides a data object information processing apparatus.
  • the apparatus may specifically include:
  • the entry information obtaining unit 701 is configured to obtain the identifier input information of the selected data object
  • the image collection unit 702 is configured to perform image collection on a process of inputting data object identification information
  • the determining unit 703 is configured to determine, according to the data object identifier input information and the collected image data, a matching degree between the user operation behavior and the actually entered data object information in the settlement process.
  • the entry information obtaining unit may be specifically configured to:
  • the image acquisition unit may be specifically configured to:
  • the determining unit may be specifically configured to:
  • the determining unit can also be used to:
  • the device may further include:
  • a correspondence relationship holding unit configured to pre-store a correspondence between the identifier of the data object and the image feature information
  • the determining unit is specifically configured to:
  • the determining unit may be specifically configured to:
  • the device may further include:
  • the interrupt processing unit is configured to interrupt the settlement operation if the judgment result corresponding to the currently received entry information is inconsistent.
  • the determining unit may be specifically configured to:
  • the embodiment of the present application further provides a data object information processing apparatus.
  • the apparatus may include:
  • the entry information obtaining unit 801 is configured to obtain the identifier input information of the selected data object
  • the image collecting unit 802 is configured to perform image collection on a process of inputting data object identification information
  • the information submitting unit 803 is configured to provide the identifier entry information of the obtained data object and the collected image data to the server, where the server performs the matching degree between the user operation behavior and the actually entered data object information in the settlement process. Judge.
  • the embodiment of the present application further provides a data object information processing apparatus.
  • the apparatus may include:
  • the information receiving unit 901 is configured to receive the identifier input information of the data object purchased by the user submitted by the terminal device, and the image data collected by the process of inputting the data object identifier information;
  • the determining unit 902 is configured to determine, according to the data object identifier input information and the collected image data, a matching degree between the user operation behavior and the actually entered data object information in the settlement process.
  • the received information further includes an identifier of a physical store where the terminal device is located, and a terminal device identifier.
  • the determining unit may specifically include:
  • An order information determining subunit configured to determine attribute information of an order to be matched, where the attribute information of the order includes: an entity store identifier associated with the order, a terminal device identifier, an order generation time information, and a data object identifier entry is started. time;
  • An image information determining subunit configured to determine attribute information of the collected image data, where the attribute information of the image data includes: a physical store identifier associated with the image data, a terminal device identifier, and image collection time information;
  • An image data determining subunit configured to determine image data to be analyzed corresponding to the order according to attribute information of the order and attribute information of the image data;
  • the determining subunit is configured to determine, according to the data object identifier input information associated with the order, and the image data to be analyzed, a degree of matching between the user operation behavior and the actually entered data object information in the settlement process.
  • the device also provides an electronic device, including:
  • One or more processors are One or more processors;
  • a memory associated with the one or more processors the memory for storing program instructions that, when read by the one or more processors, perform the following operations:
  • FIG. 10 exemplarily shows the architecture of the electronic device.
  • the device 1000 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, and a personal digital assistant. , aircraft, etc.
  • device 1000 can include one or more of the following components: processing component 1002, memory 1004, power component 1006, multimedia component 1008, audio component 1010, input/output (I/O) interface 1012, sensor component 1014, And a communication component 1016.
  • processing component 1002 memory 1004, power component 1006, multimedia component 1008, audio component 1010, input/output (I/O) interface 1012, sensor component 1014, And a communication component 1016.
  • Processing component 1002 typically controls the overall operation of device 1000, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • the processing component 1002 may include one or more processors 1020 to execute instructions to complete a traffic compression request when the preset condition is met in the video playing method provided by the technical solution of the present disclosure, and send the traffic compression request to the server, where the traffic is sent to the server.
  • processing component 1002 can include one or more modules to facilitate interaction between component 1002 and other components.
  • processing component 1002 can include a multimedia module to facilitate interaction between multimedia component 1008 and processing component 1002.
  • the memory 1004 is configured to store various types of data to support operation at the device 1000. Examples of such data include instructions for any application or method operating on device 1000, contact data, phone book data, messages, pictures, videos, and the like.
  • the memory 1004 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Disk Disk
  • Optical Disk Optical Disk
  • Power component 1006 provides power to various components of device 1000.
  • Power component 1006 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for device 1000.
  • the multimedia component 1008 includes a screen between the device 1000 and the user that provides an output interface.
  • the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can sense not only the boundaries of the touch or sliding action, but also the duration and pressure associated with the touch or slide operation.
  • the multimedia component 1008 includes a front camera and/or a rear camera. When the device 1000 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
  • the audio component 1010 is configured to output and/or input an audio signal.
  • the audio component 1010 includes a microphone (MIC) that is configured to receive an external audio signal when the device 1000 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode.
  • the received audio signal may be further stored in memory 1004 or transmitted via communication component 1016.
  • the audio component 1010 also includes a speaker for outputting an audio signal.
  • the I/O interface 1012 provides an interface between the processing component 1002 and the peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.
  • Sensor assembly 1014 includes one or more sensors for providing device 1000 with a status assessment of various aspects.
  • sensor assembly 1014 can detect an open/closed state of device 1000, a relative positioning of components, such as the display and keypad of device 1000, and sensor component 1014 can also detect a change in position of one component of device 1000 or device 1000. The presence or absence of user contact with device 1000, device 1000 orientation or acceleration/deceleration, and temperature variation of device 1000.
  • Sensor assembly 1014 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
  • Sensor assembly 1014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor assembly 1014 can also include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • Communication component 1016 is configured to facilitate wired or wireless communication between device 1000 and other devices.
  • the device 1000 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof.
  • the communication component 1016 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel.
  • the communication component 1016 also includes a near field communication (NFC) module to facilitate short range communication.
  • NFC near field communication
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • device 1000 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A gate array (FPGA), controller, microcontroller, microprocessor, or other electronic component implementation for performing the above methods.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable A gate array
  • controller microcontroller, microprocessor, or other electronic component implementation for performing the above methods.
  • a non-transitory computer readable storage medium comprising instructions, such as a memory 1004 comprising instructions executable by processor 1020 of device 1000 to perform the video provided by the disclosed technical solutions
  • the traffic compression request is generated and sent to the server, where the traffic compression request records information for triggering the server to acquire the target attention area, and the traffic compression request is used to request the server priority.
  • the code content of the video content in the target area is ensured; the video content corresponding to the code stream file is played according to the code stream file returned by the server, where the code stream file is the server according to the traffic compression request to the target attention area.
  • the non-transitory computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
  • the present application can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, the technical solution of the present application may be embodied in the form of a software product in essence or in the form of a software product, which may be stored in a storage medium such as a ROM/RAM or a disk. , an optical disk, etc., includes instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments of the present application or portions of the embodiments.
  • a computer device which may be a personal computer, server, or network device, etc.

Abstract

数据对象信息处理方法、装置、系统及电子设备（1000），系统包括终端设备（201），图像采集设备（202），以及信息处理器（203），其中：终端设备（201）中包括信息录入区域，用于在结算过程中录入所选购数据对象的标识信息；图像采集设备（202），用于对录入数据对象标识信息的过程进行图像采集（S402，S502）；信息处理器（203），用于根据终端设备（201）接收到的数据对象标识信息，以及图像采集设备（202）采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断（S403，S602）。能够在自助结算的过程中更有效的进行防损处理。

Description

数据对象信息处理方法、装置、系统及电子设备
本申请要求2017年12月26日递交的申请号为201711436577.7、发明名称为“数据对象信息处理方法、装置及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及数据对象信息处理技术领域，特别是涉及数据对象信息处理方法、装置、系统及电子设备。
背景技术
随着线上到线下技术的发展，一些超市等实体店铺中为顾客提供了自助结算服务，用以解决传统的人工结算收银过程造成的长时间等待等问题。例如，在店铺的出口位置部署自助收银机，收银机上配备有扫码装置，顾客可以将其选定的商品的条形码等标识对准扫码装置，完成对所选购商品的识别，以及价格信息的确认。将所选购的全部商品完成扫码之后，该收银机可以计算出应支付的金额，然后，顾客可以出示其手机等终端设备，打开合作的应用程序，展示出付款码，收银机便可以扫描用户的付款码信息，从而完成对订单的支付。
上述自助式收银机的部署，使得顾客可以自己完成结算过程，同时也有利于节省实体店铺中的人力成本。但是，在实际应用中，在顾客自助结算的过程中，通常会涉及到防损的问题，也即，需要尽量避免顾客少扫或者错扫的情况发生，以降低实体店铺受到财产损失的风险。例如，由于是顾客自己进行扫码，因此，可能出现的情况是，实际上一共选购了10件商品，但是，扫码时只扫了其中的9件，另一件未扫码的商品将可能会被连同其他已经扫码的商品被带走。或者，顾客实际选购了一件价格比较高的商品，但是出于占便宜等目的，可能会将其他的价格比较低的商品的条形码等取下，贴在该高价商品上，以至于通过支付较低的价格取走高价格的商品。以上这些情况都会给实体店铺带来经济损失。
现有技术中，为了避免上述情况的发生，通常会采用人工干预的方式，也即，每台自助式收银机旁边都需要配备相应的工作人员全天候值守，否则顾客将无法完成结算。但是，这会违背自助收银的设计初衷，在节省人力成本方面的作用比较有限。另外，现 有技术中使用其他的方式进行防损，例如，可以为收银机连接称重台，强制性的要求用户扫码完成后，将商品放到该称重台进行称重，如果实际称重的重量与扫码结果对应的商品的规格相符，则允许继续操作，否则将无法继续完成自助结算。该方法能够从一定程度上起到防损的作用，并且无需人为干预。但是，在实际应用中仍然会存在一些问题，例如，存在一些重量相等但是价格不等的商品，因此，难以防止顾客用等重量商品条形码替换的方式进行作弊。另外，如果顾客所购买的是一些生鲜类的商品，为了起到保险或者冷藏等作用，可能会在包装袋内加一些冰块等，此时，会使得在结算时放置到称重台上的重量大于商品实际的重量，在这种情况下，也会造成无法顺利进行结算，等等。
可见，如何在自助结算的情况下更有效的进行防损，成为需要本领域技术人员解决的技术问题。
发明内容
本申请提供了数据对象信息处理方法、装置、系统及电子设备，能够在自助结算的过程中更有效的进行防损处理。
本申请提供了如下方案：
一种数据对象信息处理系统，包括终端设备，图像采集设备，以及信息处理器，其中：
所述终端设备中包括信息录入区域，用于在结算过程中录入所选购数据对象的标识信息；
所述图像采集设备，用于对录入数据对象标识信息的过程进行图像采集；
所述信息处理器，用于根据所述终端设备接收到的数据对象标识信息，以及所述图像采集设备采集到的图像数据，对所述结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
一种数据对象信息处理方法，包括：
获得所选购数据对象的标识录入信息；
对录入数据对象标识信息的过程进行图像采集；
根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
一种数据对象信息处理方法，包括：
获得所选购数据对象的标识录入信息；
对录入数据对象标识信息的过程进行图像采集；
将所获得的数据对象的标识录入信息以及所采集到的图像数据提供给服务器，由所述服务器对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
一种数据对象信息处理方法，包括：
接收终端设备提交的用户所选购数据对象的标识录入信息，以及对录入数据对象标识信息的过程采集到的图像数据；
根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
一种数据对象信息处理装置，包括：
录入信息获得单元，用于获得所选购数据对象的标识录入信息；
图像采集单元，用于对录入数据对象标识信息的过程进行图像采集；
判断单元，用于根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
一种数据对象信息处理装置，包括：
录入信息获得单元，用于获得所选购数据对象的标识录入信息；
图像采集单元，用于对录入数据对象标识信息的过程进行图像采集；
信息提交单元，用于将所获得的数据对象的标识录入信息以及所采集到的图像数据提供给服务器，由所述服务器对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
一种数据对象信息处理装置，包括：
信息接收单元，用于接收终端设备提交的用户所选购数据对象的标识录入信息，以及对录入数据对象标识信息的过程采集到的图像数据；
判断单元，用于根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
一种电子设备，包括：
一个或多个处理器；以及
与所述一个或多个处理器关联的存储器，所述存储器用于存储程序指令,所述程序指令在被所述一个或多个处理器读取执行时，执行如下操作：
获得所选购数据对象的标识录入信息；
对录入数据对象标识信息的过程进行图像采集；
根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
根据本申请提供的具体实施例，本申请公开了以下技术效果：
通过本申请实施例，能够在数据对象信息处理系统中设置图像采集设备以及信息处理器，这样，在通过终端设备进行数据对象标识信息录入的过程中，图像采集设备能够对用户的操作行为以及相关的数据对象的图像信息进行采集，进而，信息处理器就可以通过图像分析的方式，确定出用户实际所拿的数据对象与录入到终端设备中的数据对象是否一致，以此实现在自助结算过程中的防损处理。
当然，实施本申请的任一产品并不一定需要同时达到以上所述的所有优点。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本申请实施例提供的应用场景示意图；
图2是本申请实施例提供的系统示意图；
图3-1至3-4是本申请实施例提供的终端设备的界面示意图；
图4是本申请实施例提供的第一方法的流程图；
图5是本申请实施例提供的第二方法的流程图；
图6是本申请实施例提供的第三方法的流程图；
图7是本申请实施例提供的第一装置的示意图；
图8是本申请实施例提供的第二装置的示意图；
图9是本申请实施例提供的第三装置的示意图；
图10是本申请实施例提供的电子设备的示意图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员所获得的所有其他实施例，都属于本申请保 护的范围。
在本申请实施例中，为了更有效的在结算过程中进行防损，又降低对人工干预的依赖，提供了一种新的结算方案。在该方案中，首先从硬件角度，参见图1，可以在实体店铺内部署结算终端设备101，并配备图像采集设备102(例如，摄像头等)。或者，在实际应用中，也可以是为POS机等销售终端配备图像采集设备。这样，在用户在使用终端设备对其选购的商品进行结算的过程中，可以通过图像采集设备进行图像采集，这种图像采集结果就可以用于判断用户在结算过程中是否存在“少扫”、“错扫”等情况。具体的，可以模糊识别商品个数，还可以精确的识别具体的数据对象的标识等信息，判断是否存在用不等值商品进行作弊的行为，等等。
需要说明的是，基于视频或者照片图像的数据分析本身并不属于全新的技术，但本申请实施例是将这种图像分析技术应用到自助结算的应用场景中，用于进行防损处理，并且，在本申请实施例的应用场景下，基于图像识别的数据处理具有更好的可行性。这是因为，如果采集到的图像内容过于繁杂，可能会很难从中提取出有效的信息，以至于在现有技术下，图像识别更多的处于概念阶段，实际应用的范围并不广。而在本申请实施例的场景下，由于用户在结算的过程中，通常需要逐件的录入所选购的各个数据对象的标识信息，例如，某用户一共选择了10件商品，则在进行结算时，用户可以一件一件的拿起其选购的商品，分别将各个商品的条形码等对准终端设备的扫码口等区域，以进行数据对象标识信息的录入。因此，可以通过图像采集设备采集到用户每次录入的商品的图像信息，进而就可以根据采集到的图像数据分析出用户一共对多少件商品执行了录入操作，每次操作的具体数据对象的标识，等等。这样，就可以将从图像中分析的结果，与实际录入的结果进行比对，以此确定出用户的用户操作行为与实际所录入数据对象信息的匹配度，也即，确定出用户是否存在“少扫”或者“错扫”等情况。当然，在实际应用中，即使不是采用逐件录入的方式进行录入，也可以采用本申请实施例中提供的方案对用户扫操作的商品与实际录入的数据对象信息进行比对。例如，可以在终端设备附近提供商品放置台等，可以要求用户在录入数据对象标识信息之前或者之后，将其选购的全部商品平铺的放在该放置台上，相互之间最好不要有互相重叠等情况，然后，图像采集设备对放置台上的商品进行图像采集。这样，也可以确定出用户实际所选购的商品的数量以及标识等信息，并用于与实际录入系统的数据对象信息进行比对。当然，这种替代方式需要用户的配合，因此，前述在用户逐件录入数据对象标识信息的过程中，对用户每次拿起的商品的信息进行图像采集的方式，是更为优选的方案，因为其实现了一 种用户非配合状态下的防损处理，用户只需要正常进行扫码等录入操作即可，不需要专门为了配合防损处理而进行额外的操作，因此，更有利于提升用户体验，也进一步提高效率。
下面分别从多个不同的角度，对本申请实施例提供的技术方案进行详细介绍。
实施例一
首先，该实施例一提供了一种数据对象信息处理系统，参见图2，该系统具体可以包括终端设备201，图像采集设备202，以及信息处理器203，其中：
所述终端设备201中包括信息录入区域，用于在结算过程中录入所选购数据对象的标识信息；
所述图像采集设备202，用于对录入数据对象标识信息的过程进行图像采集；
所述信息处理器203，用于根据所述终端设备201接收到的数据对象标识信息，以及所述图像采集设备202采集到的图像数据，对所述结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
其中，所述终端设备201具体可以部署在实体店铺中，或者，也可以是以POS等结算终端的方式存在，这样可以实现便携式的结算。终端设备201的主要作用是帮助用户完成自助的结算过程，在结算的过程中，通过所述图像采集器202以及信息处理器203进行防损控制。但是，对于用户而言，可以不必感知所述图像采集器202以及信息处理器203的存在，直接按照终端设备201的提示进行操作即可。
例如，具体实现时，可以提供信息录入区域，根据信息录入方式的不同，信息录入区域的具体形式也可以有所不同。例如，如果是通过扫码的方式录入数据对象的标识信息，则该信息录入区域具体可以是以硬件形式存在扫码口等。例如，如图3-1所示，其展示了终端设备的一种具体实现形式，具体的，扫码口301可以位于终端设备的右下角等位置。在没有用户来进行结算的状态下，可以在终端设备的显示屏中展示出提示信息，例如，“点击屏幕开始自助结账”，等等。在用户点击屏幕后，还可以对录入方式信息进行提示，例如，如图3-2所示，可以通过图形加文字的形式进行提示，文字部分可以包括“正在等待扫描商品码，请将商品条码对准下方扫码口”，等等。接下来，用户便可以逐件将自己所选购的商品的条形码等图形码对准扫码口，进而，终端设备便可以获取到具体的数据对象的标识信息。另外，终端设备中还可以预先保存各个数据对象的价格等信息，或者实时从服务器获得具体数据对象的价格信息，在扫码的过程中，还可以对各个数据对象的价格等进行累加，并将数据对象的信息展示在终端设备的显示屏中， 如图3-3所示。
当然，有些情况下可能会出现扫码不成功等情况，因此，还可以提供通过手动输入商品码的方式来录入数据对象的标识信息，此时，信息录入区域具体可以是指终端设备显示屏中的一块区域，例如，如图3-3中显示屏左下角显示的“手动输入条形码”等按钮，用户可以通过点击该按钮打开虚拟键盘，并对照着所选购商品的条形码，将具体的数据对象标识信息输入到终端设备中。
在完成对所选购的全部商品的信息录入之后，便可以通过点击终端设备屏幕上显示的“确认付款”等按钮来确定完成录入操作，之后可以通过关联的客户端程序完成支付。其中，关联的客户端程序可以安装在用户私有的移动终端设备中，例如，手机端的“盒马App”等。相应的，终端设备201所获取到的数据对象的标识信息等也可以提交给这种应用程序对应的服务器，例如，前述例子中的“盒马”的服务器等，由服务器生成相应的订单。之后，如图3-4所示，终端设备201可以在显示屏中提示用户：“请打开盒马App的付款码，对准下方扫码口”，等等。之后，用户便可以操作自己的手机等终端设备中预先安装的相关应用程序，并进入付款码界面，将手机的显示屏对准终端设备201的扫码口，终端设备便可以将付款码的相关信息提供给服务器，这样，服务器便可以利用付款码中携带的用户账户等信息完成支付处理。
具体实现时，可以为终端设备201搭载智能操作系统，这样，可以将手机等移动终端设备中安装的App(应用)上可以提供的营销方案等推荐信息，通过这种结算终端设备提供给用户，使得用户在结算的过程中或者结算完成之后，还能够通过这种终端设备获得更多的营销活动等推荐信息，或者，关于更多数据对象的推荐信息，等等。用户还可以直接通过这种终端设备进行互动，包括完成互动游戏，赢取相应的奖励，或者，还可以选择自己感兴趣的数据对象进行下单，等等。并且，由于结算终端设备能够获取到用户的账户等信息，进而还可以获得用户的身份特征等信息，因此，在提供这些推荐信息的过程中，还可以根据不同的用户提供个性化的推荐。这种推荐的信息还可以是相关的线上数据对象的信息，这样，还可以实现从线下到线上的用户引流。另外，该终端设备还可以配备较大面积的屏幕，并且可以是以触摸屏的形式存在，以用于更好的支持与用户的互动。总之，通过这种方式使得整个终端设备201看上去像是一个比较大的平板电脑，在可以呈现更丰富信息的同时，还可以与用户进行互动，并且比较节省空间。
另外，终端设备201还可以带有多目摄像头，可以用于获取用户的人脸图像，进而对用户进行身份验证。具体实现时，由于用户在实名认证过程中，通常会将用户的人脸 图像与账户信息进行绑定，因此，可以通过比对实际操作的用户的人脸图像，以及用户录入的账户信息，确定是否为用户本人的操作，以避免他人冒用用户的终端设备，而导致用户的财产等受到损失。当然，在实际应用中，还可以通过采集用户其他的生物体征信息对用户进行身份认证，包括指纹、虹膜等，因此，在本申请实施例中可以统一称为生物体征信息采集设备，其用于采集用户的生物体征信息，以用于对用户进行身份认证。具体的，该生物体征信息采集设备可以内置于所述终端设备201内，或者，还可以是独立设置，并与终端设备201之间能够进行通信，等等。
以上对具体的结算过程进行了介绍，而图像采集设备202则可以在结算的过程中，在用户可以不必感知的情况下，对用户操作行为、所操作的数据对象的信息等进行图像采集。其中，具体实现时，为了提高图像识别的准确度，并且实现在用户非配合状态下的信息采集，所述图像采集设备具体可以在通过逐件录入的方式录入所选购数据对象的标识信息的过程中，对每次录入时所操作的数据对象的图像信息进行采集。为了能够提高采集的图像的质量，图像采集设备所在的位置以及拍摄角度等还可以根据终端设备中信息录入区域所在的位置来确定，例如，如图1所示，可以使得图像采集设备位于所述信息录入区域的斜上方，并且可以使得拍摄角度可以覆盖以信息录入区域为中心的一个范围，在通过将数据对象靠近所述信息录入区域进行标识录入的过程中，可以对数据对象的图像信息进行采集。这样，可以避免采集到过多的无效图像信息，还可以更准确的采集到用户的操作行为情况，以及用户实际操作的商品的图像等信息。其中，这里所述的用户所操作的商品，具体就可以是指当前正在扫码的商品，例如，用户手持一个商品，将该商品的条形码对准终端设备201的扫码口进行扫码操作，则该商品就是用户所操作的商品。
其中，图像采集设备202具体可以对所述录入数据对象标识信息的过程进行视频录制，后续通过分析具体录制的视频数据进行分析判断。或者，还可以采用拍摄照片等其他方式来进行图像采集。在采用拍摄照片的方式进行图像采集的方式下，还可以由图像采集设备对用户的操作行为进行识别，每次识别到用户正在执行对一件商品的扫码等录入操作时，便拍摄一张或者多张照片，在识别出录入下一个商品标识信息的操作时，再拍摄一张或者多张照片，以此类推。这样，每次执行对一件商品的标识录入操作，便可以对应获取到一张或者多张照片，后续可以通过分析这些照片的方式进行分析判断。
采集到的图像数据可以提供给信息处理器203，信息处理器203便可以根据终端设备接收到的数据对象标识信息，以及所述图像采集设备采集到的图像数据，对所述结算 过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
其中，信息处理器203可以位于终端设备201中，也即，可以在终端设备201本地进行相关的判断操作。或者，信息处理器203也可以位于云端的服务器中，此时，相关的采集结果信息可以提交到服务器，由服务器中的信息处理器来执行相关的判断操作。此时，服务器端的信息处理器可以采用同步判断的方式，也即，边接收相关的数据采集结果，边进行判断，并将判断结果可以实时提供给终端设备201，终端设备201可以实时确定是否允许用户继续操作。或者，服务器端的信息处理器还可以采用异步判断的方式，也就是说，在用户实际进行结算的过程中，可以仅接收采集到的相关数据，但是暂时不进行判断，后续在统一设定的时间段进行判断操作。这种情况下，判断的结果通常可以提供给实体店铺的相关管理人员等所使用的客户端，例如，在发现某用户的订单存在问题时，可以将相关的信息提供给对应实体店铺的管理员。后续的具体处理则可以根据实际情况而定，例如，可以对用户进行追责，或者，给用户打上标签，不允许用户再使用自助结算终端设备进行结算，等等。
其中，信息处理器具体在进行判断时，可以模糊识别数量信息，或者还可以精确识别具体数据对象的标识信息。例如，对于前者，信息处理器可以确定用户执行录入操作的次数，以及实际所录入数据对象的数量，并判断所述指定录入操作的次数与实际所录入数据对象的数量是否一致。对于后者，信息处理器可以根据所述采集到的图像数据，确定用户执行录入操作过程中所操作的数据对象的标识，判断所述所操作的数据对象的标识，与所录入的数据对象的标识是否一致。其中，这里所述的用户所操作的数据对象，就是指用户实际所手持并靠近扫码口进行扫码的商品对应的数据对象，其与实际录入到终端设备中的数据对象的标识可能会是不同的。例如，如果用户试图用低价格商品的条形码对一个高价格商品进行结算，则可能出现以下情况：想要购买商品A，但是预先将商品B的条形码取下，贴在商品A的条码位置处，这样，手持商品A进行扫码时，实际上是对商品B的条形码进行扫码，此时，终端设备所接收到的是商品B对应的数据对象的标识信息，因此，就会出现用户所手持的商品与实际扫码的商品不一致的情况。其中，为了能够从所采集到的图像数据中识别出具体数据对象的标识信息，可以预先保存数据对象的标识与图像特征信息之间的对应关系，这样，就可以根据所述采集到的图像数据以及所述对应关系，确定用户执行录入操作过程中所操作的数据对象的标识。
总之，通过本申请实施例，能够在数据对象信息处理系统中设置图像采集设备以及信息处理器，这样，在通过终端设备进行数据对象标识信息录入的过程中，图像采集设 备能够对用户的操作行为以及相关的数据对象的图像信息进行采集，进而，信息处理器就可以通过图像分析的方式，确定出用户实际所拿的数据对象与录入到终端设备中的数据对象是否一致，以此实现在自助结算过程中的防损处理。
在优选的实施方式中，由于用户通常是逐件录入其所选购的数据对象的标识信息，因此，图像采集设备可以在用户进行逐件信息录入的过程中，对用户每次执行录入操作的数据对象的图像信息进行采集，这样可以实现在用户非配合状态下的防损处理，有利于提升用户体验，进一步提高效率。
实施例二
该实施例二是从终端设备的角度提供了一种数据对象信息处理方法，在该方法中，图像采集设备可以集成在终端设备内，或者，也可以采用外置的方式与终端设备进行连接，另外，终端设备中还可以包括信息处理器，该信息处理器可以通过软件或者硬件等多种形式来实现。在这种情况下，参见图4，该方法具体可以包括：
S401：获得所选购数据对象的标识录入信息；
S402：对录入数据对象标识信息的过程进行图像采集；
S403：根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
其中，具体在获得所选购数据对象的标识录入信息时，可以获得通过逐件录入的方式所提交的所选购数据对象的标识录入信息。例如，用户可以逐件对其选购的数据对象执行扫码操作，或者逐件输入各数据对象的条形码信息，等等。
具体在对录入数据对象标识信息的过程进行图像采集时，可以是在通过逐件录入的方式进行数据对象标识信息录入的过程中，对所述过程进行图像录制，以此来降低对用户配合度的依赖。具体在进行图像采集时，可以对所述录入数据对象标识信息的过程进行视频录制，后续在进行分析时，可以是基于录制的视频图像进行分析处理。或者，还可以采用拍摄照片等方式来进行图像的采集。
具体在进行判断时，可以进行模糊的数量判断，具体的，可以确定用户执行录入操作的次数，以及实际所录入数据对象的数量，然后，判断所述指定录入操作的次数与实际所录入数据对象的数量是否一致。
或者，还可以可进行精确的数据对象标识的一致性比对，检测出不等价商品条形码替换的情况。具体的，可以根据所述采集到的图像数据，确定用户执行录入操作过程中所操作的数据对象的标识，然后，判断所述所操作的数据对象的标识，与所录入的数据 对象的标识是否一致。
为了执行上述图像识别过程，可以预先保存数据对象的标识与图像特征信息之间的对应关系。这样，可以根据所述采集到的图像数据以及所述对应关系，确定用户执行录入操作过程中所操作的数据对象的标识。
其中，具体在判断所述所操作的数据对象的标识，与所录入的数据对象的标识是否一致时，可以在每接收到关于所选购数据对象标识的一条录入信息时，判断所述所操作的数据对象的标识，与所录入的数据对象的标识是否一致。如果当前接收到的录入信息对应的判断结果为不一致，则可以中断结算操作。
或者，还可以是在完成对所选购的全部数据对象的标识信息录入之后，判断所述所操作的各数据对象的标识所组成的第一集合，与所录入的各数据对象的标识所组成的第二集合是否相同。
实施例三
该实施例三是从终端设备的角度，提供了另一种数据对象信息处理方法，在该方法中，信息处理器可以位于服务器端，因此，相关的图像识别及判断操作可以在服务器端来完成。此时，参见图5，该方法具体可以包括：
S501：获得所选购数据对象的标识录入信息；
S502：对录入数据对象标识信息的过程进行图像采集；
S503：将所获得的数据对象的标识录入信息以及所采集到的图像数据提供给服务器，由所述服务器对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
实施例四
该实施例四是与实施例三相对应的，从服务器的角度，提供了一种数据对象信息处理方法，参见图6，该方法具体可以包括：
S601：接收用户所选购数据对象的标识录入信息，以及对录入数据对象标识信息的过程采集到的图像数据；
S602：根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
对于在服务器端进行图像识别以及判断的情况，可以进行同步处理或者异步处理。其中，在异步处理的情况下，由于服务器中可以保存具体的订单信息，以及各个订单的生成时间等信息，另外，具体图像数据的采集时间等信息也都可以进行保存，因此，可 以根据具体的时间信息进行订单信息与采集的图像数据之间的匹配判断。如果一个服务器需要对接多个实体店铺，或者多个终端设备，则还可以在订单以及采集到的图像数据中保存具体的店铺标识、终端设备标识等信息，以此将统一店铺内同一终端设备产生的订单信息与该设备关联的图像采集设备采集的图像数据进行匹配判断。
具体的，可以首先确定待匹配的订单的属性信息，所述订单的属性信息包括：所述订单关联的实体店铺标识、终端设备标识、订单生成时间信息以及开始进行数据对象标识录入的时间。另外还可以确定所采集到的图像数据的属性信息，所述图像数据的属性信息包括：所述图像数据关联的实体店铺标识、终端设备标识以及图像采集时间信息。之后，可以根据所述订单的属性信息以及图像数据的属性信息，确定所述订单对应的待分析图像数据，并根据所述订单关联的数据对象标识录入信息，以及所述待分析图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
关于前述实施例二至实施例四中的未详述部分，可以参见前述实施例一中的记载，这里不再赘述。
与实施例二相对应，本申请实施例还提供了一种数据对象信息处理装置，参见图7，该装置具体可以包括：
录入信息获得单元701，用于获得所选购数据对象的标识录入信息；
图像采集单元702，用于对录入数据对象标识信息的过程进行图像采集；
判断单元703，用于根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
具体实现时，所述录入信息获得单元具体可以用于：
获得通过逐件录入的方式所提交的所选购数据对象的标识录入信息。
所述图像采集单元具体可以用于：
在通过逐件录入的方式进行数据对象标识信息录入的过程中，对所述过程进行图像录制。
所述判断单元具体可以用于：
确定用户执行录入操作的次数，以及实际所录入数据对象的数量；
判断所述指定录入操作的次数与实际所录入数据对象的数量是否一致。
或者，所述判断单元也可以用于：
根据所述采集到的图像数据，确定用户执行录入操作过程中所操作的数据对象的标识；
判断所述所操作的数据对象的标识，与所录入的数据对象的标识是否一致。
另外，该装置还可以包括：
对应关系保存单元，用于预先保存数据对象的标识与图像特征信息之间的对应关系；
所述判断单元具体用于：
根据所述采集到的图像数据以及所述对应关系，确定用户执行录入操作过程中所操作的数据对象的标识。
其中，所述判断单元具体可以用于：
每接收到关于所选购数据对象标识的一条录入信息，判断所述所操作的数据对象的标识，与所录入的数据对象的标识是否一致。
此时，该装置还可以包括：
中断处理单元，用于如果当前接收到的录入信息对应的判断结果为不一致，则中断结算操作。
另外，所述判断单元具体可以用于：
在完成对所选购的全部数据对象的标识信息录入之后，判断所述所操作的各数据对象的标识所组成的第一集合，与所录入的各数据对象的标识所组成的第二集合是否相同。
与实施例三相对应，本申请实施例还提供了一种数据对象信息处理装置，参见图8，该装置可以包括：
录入信息获得单元801，用于获得所选购数据对象的标识录入信息；
图像采集单元802，用于对录入数据对象标识信息的过程进行图像采集；
信息提交单元803，用于将所获得的数据对象的标识录入信息以及所采集到的图像数据提供给服务器，由所述服务器对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
与实施例四相对应，本申请实施例还提供了一种数据对象信息处理装置，参见图9，该装置可以包括：
信息接收单元901，用于接收终端设备提交的用户所选购数据对象的标识录入信息，以及对录入数据对象标识信息的过程采集到的图像数据；
判断单元902，用于根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
其中，所述接收到的信息还包括终端设备所在实体店铺的标识，以及终端设备标识。
此时，所述判断单元具体可以包括：
订单信息确定子单元，用于确定待匹配的订单的属性信息，所述订单的属性信息包括：所述订单关联的实体店铺标识、终端设备标识、订单生成时间信息以及开始进行数据对象标识录入的时间；
图像信息确定子单元，用于确定所采集到的图像数据的属性信息，所述图像数据的属性信息包括：所述图像数据关联的实体店铺标识、终端设备标识以及图像采集时间信息；
图像数据确定子单元，用于根据所述订单的属性信息以及图像数据的属性信息，确定所述订单对应的待分析图像数据；
判断子单元，用于根据所述订单关联的数据对象标识录入信息，以及所述待分析图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
另外，该装置还提供了一种电子设备，包括：
一个或多个处理器；以及
与所述一个或多个处理器关联的存储器，所述存储器用于存储程序指令,所述程序指令在被所述一个或多个处理器读取执行时，执行如下操作：
获得所选购数据对象的标识录入信息；
对录入数据对象标识信息的过程进行图像采集；
根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
其中，图10示例性的展示出了电子设备的架构，例如，设备1000可以是移动电话，计算机，数字广播终端，消息收发设备，游戏控制台，平板设备，医疗设备，健身设备，个人数字助理，飞行器等。
参照图10，设备1000可以包括以下一个或多个组件：处理组件1002，存储器1004，电源组件1006，多媒体组件1008，音频组件1010，输入/输出(I/O)的接口1012，传感器组件1014，以及通信组件1016。
处理组件1002通常控制设备1000的整体操作，诸如与显示，电话呼叫，数据通信，相机操作和记录操作相关联的操作。处理元件1002可以包括一个或多个处理器1020来执行指令，以完成本公开技术方案提供的视频播放方法中的当满足预设条件时，生成流量压缩请求，并发送给服务器，其中所述流量压缩请求中记录有用于触发服务器获取目标关注区域的信息，所述流量压缩请求用于请求服务器优先保证目标关注区域内视频内容的码率；根据服务器返回的码流文件播放所述码流文件对应的视频内容，其中所述码 流文件为服务器根据所述流量压缩请求对所述目标关注区域之外的视频内容进行码率压缩处理得到的视频文件的全部或部分步骤。此外，处理组件1002可以包括一个或多个模块，便于处理组件1002和其他组件之间的交互。例如，处理部件1002可以包括多媒体模块，以方便多媒体组件1008和处理组件1002之间的交互。
存储器1004被配置为存储各种类型的数据以支持在设备1000的操作。这些数据的示例包括用于在设备1000上操作的任何应用程序或方法的指令，联系人数据，电话簿数据，消息，图片，视频等。存储器1004可以由任何类型的易失性或非易失性存储设备或者它们的组合实现，如静态随机存取存储器(SRAM)，电可擦除可编程只读存储器(EEPROM)，可擦除可编程只读存储器(EPROM)，可编程只读存储器(PROM)，只读存储器(ROM)，磁存储器，快闪存储器，磁盘或光盘。
电源组件1006为设备1000的各种组件提供电力。电源组件1006可以包括电源管理系统，一个或多个电源，及其他与为设备1000生成、管理和分配电力相关联的组件。
多媒体组件1008包括在设备1000和用户之间的提供一个输出接口的屏幕。在一些实施例中，屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板，屏幕可以被实现为触摸屏，以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。触摸传感器可以不仅感测触摸或滑动动作的边界，而且还检测与触摸或滑动操作相关的持续时间和压力。在一些实施例中，多媒体组件1008包括一个前置摄像头和/或后置摄像头。当设备1000处于操作模式，如拍摄模式或视频模式时，前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。
音频组件1010被配置为输出和/或输入音频信号。例如，音频组件1010包括一个麦克风(MIC)，当设备1000处于操作模式，如呼叫模式、记录模式和语音识别模式时，麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器1004或经由通信组件1016发送。在一些实施例中，音频组件1010还包括一个扬声器，用于输出音频信号。
I/O接口1012为处理组件1002和外围接口模块之间提供接口，上述外围接口模块可以是键盘，点击轮，按钮等。这些按钮可包括但不限于：主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件1014包括一个或多个传感器，用于为设备1000提供各个方面的状态评估。例如，传感器组件1014可以检测到设备1000的打开/关闭状态，组件的相对定位， 例如所述组件为设备1000的显示器和小键盘，传感器组件1014还可以检测设备1000或设备1000一个组件的位置改变，用户与设备1000接触的存在或不存在，设备1000方位或加速/减速和设备1000的温度变化。传感器组件1014可以包括接近传感器，被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件1014还可以包括光传感器，如CMOS或CCD图像传感器，用于在成像应用中使用。在一些实施例中，该传感器组件1014还可以包括加速度传感器，陀螺仪传感器，磁传感器，压力传感器或温度传感器。
通信组件1016被配置为便于设备1000和其他设备之间有线或无线方式的通信。设备1000可以接入基于通信标准的无线网络，如WiFi，2G或3G，或它们的组合。在一个示例性实施例中，通信部件1016经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中，所述通信部件1016还包括近场通信(NFC)模块，以促进短程通信。例如，在NFC模块可基于射频识别(RFID)技术，红外数据协会(IrDA)技术，超宽带(UWB)技术，蓝牙(BT)技术和其他技术来实现。
在示例性实施例中，设备1000可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现，用于执行上述方法。
在示例性实施例中，还提供了一种包括指令的非临时性计算机可读存储介质，例如包括指令的存储器1004，上述指令可由设备1000的处理器1020执行以完成本公开技术方案提供的视频播放方法中的当满足预设条件时，生成流量压缩请求，并发送给服务器，其中所述流量压缩请求中记录有用于触发服务器获取目标关注区域的信息，所述流量压缩请求用于请求服务器优先保证目标关注区域内视频内容的码率；根据服务器返回的码流文件播放所述码流文件对应的视频内容，其中所述码流文件为服务器根据所述流量压缩请求对所述目标关注区域之外的视频内容进行码率压缩处理得到的视频文件。例如，所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
通过以上的实施方式的描述可知，本领域的技术人员可以清楚地了解到本申请可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台 计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例或者实施例的某些部分所述的方法。
本说明书中的各个实施例均采用递进的方式描述，各个实施例之间相同相似的部分互相参见即可，每个实施例重点说明的都是与其他实施例的不同之处。尤其，对于系统或系统实施例而言，由于其基本相似于方法实施例，所以描述得比较简单，相关之处参见方法实施例的部分说明即可。以上所描述的系统及系统实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下，即可以理解并实施。
以上对本申请所提供的数据对象信息处理方法、装置、系统及电子设备，进行了详细介绍，本文中应用了具体个例对本申请的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本申请的方法及其核心思想；同时，对于本领域的一般技术人员，依据本申请的思想，在具体实施方式及应用范围上均会有改变之处。综上所述，本说明书内容不应理解为对本申请的限制。

Claims (26)

  1. 一种数据对象信息处理系统，其特征在于，包括终端设备，图像采集设备，以及信息处理器，其中：
    所述终端设备中包括信息录入区域，用于在结算过程中录入所选购数据对象的标识信息；
    所述图像采集设备，用于对录入数据对象标识信息的过程进行图像采集；
    所述信息处理器，用于根据所述终端设备接收到的数据对象标识信息，以及所述图像采集设备采集到的图像数据，对所述结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
  2. 根据权利要求1所述的系统，其特征在于，
    所述图像采集设备具体用于，在通过逐件录入的方式录入所选购数据对象的标识信息的过程中，对每次录入时所操作的数据对象的图像信息进行采集。
  3. 根据权利要求1所述的系统，其特征在于，
    所述图像采集设备的位置以及角度根据所述信息录入区域的位置进行确定，具体用于，在通过将数据对象靠近所述信息录入区域进行标识录入的过程中，对数据对象的图像信息进行采集。
  4. 根据权利要求1所述的系统，其特征在于，还包括：
    生物体征信息采集设备，用于采集用户的生物体征信息，以用于对用户进行身份认证。
  5. 根据权利要求1所述的系统，其特征在于，
    所述终端设备中还包括显示屏，用于在结算过程中，对录入数据对象的信息进行展示。
  6. 根据权利要求1所述的系统，其特征在于，
    所述终端设备搭载有智能操作系统，还包括信息推荐模块，用于根据用户的信息提供个性化的推荐信息。
  7. 根据权利要求6所述的系统，其特征在于，
    所述推荐信息包括数据对象信息，和/或线上营销活动信息。
  8. 根据权利要求1至7任一项所述的系统，其特征在于，
    所述信息处理器位于所述终端设备中。
  9. 根据权利要求1至7任一项所述的系统，其特征在于，
    所述信息处理器位于服务器中；
    所述图像采集设备还用于将所采集到的图像数据上传到所述服务器。
  10. 一种数据对象信息处理方法，其特征在于，包括：
    获得所选购数据对象的标识录入信息；
    对录入数据对象标识信息的过程进行图像采集；
    根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
  11. 根据权利要求10所述的方法，其特征在于，
    所述获得所选购数据对象的标识录入信息，包括：
    获得通过逐件录入的方式所提交的所选购数据对象的标识录入信息。
  12. 根据权利要求10所述的方法，其特征在于，
    所述对录入数据对象标识信息的过程进行图像采集，包括：
    在通过逐件录入的方式进行数据对象标识信息录入的过程中，对所述过程进行图像录制。
  13. 根据权利要求10所述的方法，其特征在于，
    所述对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断，包括：
    确定用户执行录入操作的次数，以及实际所录入数据对象的数量；
    判断所述指定录入操作的次数与实际所录入数据对象的数量是否一致。
  14. 根据权利要求10所述的方法，其特征在于，
    所述对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断，包括：
    根据所述采集到的图像数据，确定用户执行录入操作过程中所操作的数据对象的标识；
    判断所述所操作的数据对象的标识，与所录入的数据对象的标识是否一致。
  15. 根据权利要求14所述的方法，其特征在于，还包括：
    预先保存数据对象的标识与图像特征信息之间的对应关系；
    所述根据所述采集到的图像数据，确定用户执行录入操作过程中所操作的数据对象的标识，包括：
    根据所述采集到的图像数据以及所述对应关系，确定用户执行录入操作过程中所操作的数据对象的标识。
  16. 根据权利要求14所述的方法，其特征在于，
    所述判断所述所操作的数据对象的标识，与所录入的数据对象的标识是否一致，包括：
    每接收到关于所选购数据对象标识的一条录入信息，判断所述所操作的数据对象的标识，与所录入的数据对象的标识是否一致。
  17. 根据权利要求16所述的方法，其特征在于，还包括：
    如果当前接收到的录入信息对应的判断结果为不一致，则中断结算操作。
  18. 根据权利要求14所述的方法，其特征在于，
    所述判断所述所操作的数据对象的标识，与所录入的数据对象的标识是否一致，包括：
    在完成对所选购的全部数据对象的标识信息录入之后，判断所述所操作的各数据对象的标识所组成的第一集合，与所录入的各数据对象的标识所组成的第二集合是否相同。
  19. 一种数据对象信息处理方法，其特征在于，包括：
    获得所选购数据对象的标识录入信息；
    对录入数据对象标识信息的过程进行图像采集；
    将所获得的数据对象的标识录入信息以及所采集到的图像数据提供给服务器，由所述服务器对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
  20. 一种数据对象信息处理方法，其特征在于，包括：
    接收终端设备提交的用户所选购数据对象的标识录入信息，以及对录入数据对象标识信息的过程采集到的图像数据；
    根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
  21. 根据权利要求20所述的方法，其特征在于，
    所述接收到的信息还包括终端设备所在实体店铺的标识，以及终端设备标识。
  22. 根据权利要求21所述的方法，其特征在于
    所述根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断，包括：
    确定待匹配的订单的属性信息，所述订单的属性信息包括：所述订单关联的实体店铺标识、终端设备标识、订单生成时间信息以及开始进行数据对象标识录入的时间；
    确定所采集到的图像数据的属性信息，所述图像数据的属性信息包括：所述图像数据关联的实体店铺标识、终端设备标识以及图像采集时间信息；
    根据所述订单的属性信息以及图像数据的属性信息，确定所述订单对应的待分析图像数据；
    根据所述订单关联的数据对象标识录入信息，以及所述待分析图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
  23. 一种数据对象信息处理装置，其特征在于，包括：
    录入信息获得单元，用于获得所选购数据对象的标识录入信息；
    图像采集单元，用于对录入数据对象标识信息的过程进行图像采集；
    判断单元，用于根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
  24. 一种数据对象信息处理装置，其特征在于，包括：
    录入信息获得单元，用于获得所选购数据对象的标识录入信息；
    图像采集单元，用于对录入数据对象标识信息的过程进行图像采集；
    信息提交单元，用于将所获得的数据对象的标识录入信息以及所采集到的图像数据提供给服务器，由所述服务器对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
  25. 一种数据对象信息处理装置，其特征在于，包括：
    信息接收单元，用于接收终端设备提交的用户所选购数据对象的标识录入信息，以及对录入数据对象标识信息的过程采集到的图像数据；
    判断单元，用于根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
  26. 一种电子设备，其特征在于，包括：
    一个或多个处理器；以及
    与所述一个或多个处理器关联的存储器，所述存储器用于存储程序指令,所述程序指令在被所述一个或多个处理器读取执行时，执行如下操作：
    获得所选购数据对象的标识录入信息；
    对录入数据对象标识信息的过程进行图像采集；
    根据所述数据对象标识录入信息，以及所采集到的图像数据，对结算过程中用户操作行为与实际所录入数据对象信息的匹配度进行判断。
PCT/CN2018/123000 2017-12-26 2018-12-24 数据对象信息处理方法、装置、系统及电子设备 WO2019128908A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711436577.7A CN109961594A (zh) 2017-12-26 2017-12-26 数据对象信息处理方法、装置及系统
CN201711436577.7 2017-12-26

Publications (1)

Publication Number Publication Date
WO2019128908A1 true WO2019128908A1 (zh) 2019-07-04

Family

ID=67022440

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/123000 WO2019128908A1 (zh) 2017-12-26 2018-12-24 数据对象信息处理方法、装置、系统及电子设备

Country Status (3)

Country Link
CN (1) CN109961594A (zh)
TW (1) TW201928816A (zh)
WO (1) WO2019128908A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110535917B (zh) * 2019-08-14 2022-09-20 泰安协同软件有限公司 一种数据录入与照片同步采集方法及系统
CN110808978B (zh) * 2019-10-31 2022-04-15 支付宝(杭州)信息技术有限公司 实名认证方法以及装置
CN111028003A (zh) * 2019-11-27 2020-04-17 湖南士多仔信息科技有限公司 基于自动售卖机网络的广告推送系统及方法
CN111311848A (zh) * 2020-01-16 2020-06-19 青岛创捷中云科技有限公司 一种自助收银ai防损系统及方法
CN113496155B (zh) * 2020-03-20 2023-09-29 北京京东振世信息技术有限公司 信息处理的方法、装置、设备和计算机可读介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030120547A1 (en) * 2001-12-26 2003-06-26 Ncr Corporation Self-checkout system
CN103617681A (zh) * 2013-11-11 2014-03-05 青岛中科英泰商用系统有限公司 具有提醒功能和多种防损措施的超市自助结算方法和设备
CN104299334A (zh) * 2013-07-16 2015-01-21 东芝泰格有限公司 信息处理装置及其控制方法
CN105539534A (zh) * 2016-01-28 2016-05-04 徐天宏 智能购物车
CN106781121A (zh) * 2016-12-14 2017-05-31 朱明� 基于视觉分析的超市自助结账智能系统
CN107038822A (zh) * 2017-03-27 2017-08-11 杭州赛狐科技有限公司 一种自助收银系统及方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10323691A1 (de) * 2003-05-22 2004-12-23 Wincor Nixdorf International Gmbh Selbstbedienungskasseneinrichtung
US7118026B2 (en) * 2003-06-26 2006-10-10 International Business Machines Corporation Apparatus, method, and system for positively identifying an item
US20050061874A1 (en) * 2003-09-19 2005-03-24 International Business Machines Corporation Using radio frequency identification with transaction-specific correlator values to detect and/or prevent theft and shoplifting
ITMI20041265A1 (it) * 2004-06-23 2004-09-23 Coupon Line S R L Metodo e sistema per la gestione ed emissione di offerte commerciali personalizzate durante la permanenza in un punto vendita
JP2006350806A (ja) * 2005-06-17 2006-12-28 Toshiba Tec Corp 無線タグ認識装置及び商品販売データ処理装置
EP2163095A4 (en) * 2007-06-09 2011-05-18 Sensormatic Electronics Llc SYSTEM AND METHOD FOR INTEGRATION OF VIDEO ANALYTICS AND DATA EXPLORATION / ANALYTICS
CN103632464A (zh) * 2013-11-14 2014-03-12 成都博约创信科技有限责任公司 集图像识别与标签识别于一体的收银方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030120547A1 (en) * 2001-12-26 2003-06-26 Ncr Corporation Self-checkout system
CN104299334A (zh) * 2013-07-16 2015-01-21 东芝泰格有限公司 信息处理装置及其控制方法
CN103617681A (zh) * 2013-11-11 2014-03-05 青岛中科英泰商用系统有限公司 具有提醒功能和多种防损措施的超市自助结算方法和设备
CN105539534A (zh) * 2016-01-28 2016-05-04 徐天宏 智能购物车
CN106781121A (zh) * 2016-12-14 2017-05-31 朱明� 基于视觉分析的超市自助结账智能系统
CN107038822A (zh) * 2017-03-27 2017-08-11 杭州赛狐科技有限公司 一种自助收银系统及方法

Also Published As

Publication number Publication date
TW201928816A (zh) 2019-07-16
CN109961594A (zh) 2019-07-02

Similar Documents

Publication Publication Date Title
WO2019128908A1 (zh) 数据对象信息处理方法、装置、系统及电子设备
TWI729289B (zh) 就餐結算方法、智慧點餐設備以及智慧餐廳支付系統
CN104537532B (zh) 消费数据记录方法及装置
CN106022758A (zh) 信息推荐方法和装置
KR20160135696A (ko) 수치 이전 방법, 단말, 클라우드 서버 및 컴퓨터 판독 가능한 저장 매체
US10803438B2 (en) Reading apparatus
KR20160110348A (ko) 계좌 이체 처리를 진행하는 방법과 장치
CN110945552B (zh) 一种产品销量提报方法、支付方法和终端设备
CN104951935A (zh) 一种分账方法及装置
CN107564196B (zh) 储物设备控制方法及装置
CN111090327A (zh) 商品信息的处理方法、装置及电子设备
WO2015165172A1 (zh) 在语音服务中的信息发送方法和装置
CN107563876B (zh) 物品购买方法及装置、存储介质
JP6387821B2 (ja) 商品登録装置、商品登録方法、および、商品画像提供システム
CN112348606A (zh) 信息推荐方法、装置及系统
US9245264B2 (en) Reading apparatus
JP2014074972A (ja) 顔画像による本人認証支援システム
JP6517480B2 (ja) 接客管理システム、顧客端末、サーバー装置、接客管理方法、及び接客方法
CN114881631B (zh) 收银系统、电子设备及计算机可读介质
CN114724311B (zh) 储物柜开柜方法、装置、设备及计算机可读存储介质
US20180276636A1 (en) Point-of-sale terminal having a dynamically set user interface
KR20200024538A (ko) 이미지 검색과 관련한 정보 추천 방법 및 이를 지원하는 서비스 장치
JP2013200895A (ja) データ処理装置及びプログラム
CN112529560A (zh) 离线收银系统、方法、装置及电子设备
CN110913339A (zh) 实体门店的信息处理方法、装置及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18896939

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18896939

Country of ref document: EP

Kind code of ref document: A1