TW201928816A - Data object information processing method, apparatus, and system, and electronic device - Google Patents

Abstract

A data object information processing method, apparatus, and system, and an electronic device. The system comprises a terminal device, an image acquisition device, and an information processor. The terminal device comprises an information input area for inputting identification information of a selected data object in a checkout process. The image acquisition device is configured to perform image acquisition on the process of inputting the data object identification information. The information processor is configured to determine, according to the data object identification information received by the terminal device and image data collected by the image acquisition device, a degree of matching between user operation behavior and actual input data object information in the checkout process. The invention can achieve effective loss prevention in a self-service checkout process.

Description

Data object information processing method, device and system

This case relates to the technical field of data object information processing, in particular to a data object information processing method, device and system.

With the development of online-to-offline technologies, some supermarkets and other physical stores have provided self-service settlement services to customers to solve problems such as long waits caused by the traditional manual settlement cashier process. For example, a self-service cash register is deployed at the exit of the store. The cash register is equipped with a code scanning device. The customer can align the barcode and other identification of the selected product with the code scanning device to complete the identification of the purchased product and price information Confirmation. After scanning the code of all the purchased products, the cash register can calculate the amount that should be paid. Then, the customer can present his mobile phone and other terminal devices, open the cooperative application, and display the payment code, and the cash register can scan The user's payment code information to complete the payment of the order. The deployment of the above-mentioned self-service cash register enables customers to complete the settlement process by themselves, and also helps to save labor costs in physical stores. However, in practical applications, in the process of customer self-service settlement, the problem of loss prevention is usually involved, that is, it is necessary to avoid the situation that customers scan less or misscan as much as possible to reduce the risk of property loss to physical stores. For example, because the customer scans the code by himself, it may happen that a total of 10 items were actually purchased, but only 9 of them were scanned when the code was scanned, and the other unscanned product will be scanned. May be taken away along with other scanned goods. Or, the customer actually purchased a relatively high-priced product, but for the purpose of taking advantage of the bargain, the barcodes of other relatively low-priced products may be removed and affixed to the high-priced product, so that they can be paid more Lower prices take away higher-priced goods. All the above situations will bring economic losses to physical stores. In the prior art, in order to avoid the above situation, manual intervention is usually adopted, that is, each self-service cash register needs to be equipped with corresponding staff on duty around the clock, otherwise the customer will not be able to complete the settlement. However, this would run counter to the original intention of the self-service cash register and has a relatively limited role in saving labor costs. In addition, in the prior art, other methods are used for loss prevention. For example, a cash register can be connected to a weighing platform. After the user scans the code, it is mandatory to place the goods on the weighing platform for weighing. If the weight of the product matches the specifications of the product corresponding to the code scanning result, you are allowed to continue the operation, otherwise you will not be able to complete the self-service settlement. This method can play a role in preventing damage to a certain extent, and does not require human intervention. However, there are still some problems in practical applications. For example, there are some products of equal weight but different prices. Therefore, it is difficult to prevent customers from cheating by replacing barcodes of products of equal weight. In addition, if the customer purchases some fresh products, in order to play the role of insurance or refrigeration, some ice cubes may be added to the packaging bag. At this time, it will be placed on the weighing platform during checkout. The weight is greater than the actual weight of the product. In this case, the settlement cannot be performed smoothly, etc. It can be seen that how to perform loss prevention more effectively in the case of self-service settlement has become a technical problem that needs to be solved by those skilled in the art.

This case provides a data object information processing method, device, and system, which can more effectively perform loss prevention processing in the process of self-service settlement. This case provides the following solutions: A data object information processing system, including terminal equipment, image acquisition equipment, and information processor, where: The terminal equipment includes an information input area for inputting selected data objects during the settlement process标识 The image acquisition device is used for image acquisition of the process of inputting the identification information of the data object; 资讯 The information processor is used for the data object identification information received by the terminal device and the image acquisition The image data collected by the device judges the degree of matching between the user operation behavior and the actually entered data object information during the settlement process. A data object information processing method includes: obtaining identification input information of a purchased data object; 影像 image collection of the process of inputting data object identification information; inputting information based on the data object identification and the collected image data, During the settlement process, the degree of matching between the user's operation behavior and the actual data object information entered is judged. A data object information processing method includes: obtaining the identification input information of the purchased data object; 影像 image collection of the process of inputting the identification information of the data object; 提供 providing the obtained identification input information of the data object and the collected image data To the server, the server judges the matching degree between the user operation behavior and the actually entered data object information during the settlement process. A data object information processing method includes: receiving identification input information of a data object purchased by a user and submitted by a terminal device, and image data collected during the process of inputting data object identification information; 输入 inputting information based on the data object identification, and The collected image data is used to judge the matching degree between user operation behavior and actual input data object information during the settlement process. A data object information processing device includes: an input information obtaining unit for obtaining identification input information of a purchased data object; an image acquisition unit for performing image collection on a process of inputting identification information of the data object; a judgment unit for: According to the data object identifier input information and the collected image data, the degree of matching between the user operation behavior and the actual input data object information during the settlement process is judged. A data object information processing device includes: an input information obtaining unit for obtaining identification input information of a purchased data object; an image collection unit for performing image collection on a process of inputting data object identification information; 对象 an information submission unit for The identification input information of the obtained data object and the collected image data are provided to a server, and the server judges the matching degree between the user operation behavior and the actually input data object information during the settlement process. A data object information processing device includes: an information receiving unit for receiving identification input information of a data object purchased by a user and submitted by a terminal device, and image data collected during the process of inputting the identification information of the data object; a judging unit for According to the input information of the data object identifier and the collected image data, the degree of matching between the user operation behavior and the actually input data object information during the settlement process is judged. An electronic device includes: (i) one or more processors; and a memory associated with the one or more processors, the memory is used to store program instructions, and the program instructions are When the processor reads and executes, it performs the following operations: obtaining the identification input information of the purchased data object; 影像 image acquisition of the process of inputting the identification information of the data object; 输入 inputting information according to the data object identification, and the collected image data , To judge the degree of matching between the user's operation behavior and the actual input data object information during the settlement process. According to the specific embodiments provided in this case, this case reveals the following technical effects: Through this embodiment of the case, it is possible to set up image acquisition equipment and information processors in the data object information processing system. In this way, the input of the data object identification information through the terminal device During the process, the image acquisition device can collect the user's operation behavior and the image information of the relevant data objects. Furthermore, the information processor can determine the data objects actually taken by the user and the input to the terminal device through image analysis. Whether the data objects in the data are consistent, so as to realize the loss prevention processing in the self-service settlement process. Of course, the implementation of any of the products does not necessarily need to achieve all the advantages described above.

In the following, the drawings in the embodiment of the present case will be combined, Clarify the technical solution in the embodiment of this case, Fully described, Obviously, The described embodiments are only a part of the embodiments in this case, Not all embodiments. Based on the examples in this case, All other embodiments obtained by a person of ordinary skill in the art, All belong to the scope of protection in this case.     In the example of this case, In order to more effectively prevent losses during the settlement process, And reduce dependence on manual intervention, A new settlement scheme is provided. In this scenario, From a hardware perspective, See Figure 1, The settlement terminal device 101 can be deployed in a physical store, And equipped with an image capture device 102 (e.g., Camera, etc.). or, In practical applications, It is also possible to equip sales terminals such as POS machines with image acquisition equipment. such, When a user uses a terminal device to settle a purchase of an item, Image acquisition can be performed through image acquisition equipment, This image acquisition result can be used to determine whether there are “less scans”, "Wrong scan" and other situations. specific, Can fuzzy identify the number of products, It can also accurately identify information such as the identity of specific data objects, Determine whether there is cheating with unequal products, and many more.      It should be noted, Data analysis based on video or photo images is not a new technology in itself. However, the embodiment of this case applies this image analysis technology to the application scenario of self-service settlement. For loss prevention treatment, and, In the application scenario of the embodiment of this case, Data processing based on image recognition has better feasibility. This is because, If the content of the captured image is too complicated, It can be difficult to extract effective information from it. So that under the existing technology, Image recognition is more at the concept stage, The range of practical applications is not wide. In the scenario of the embodiment of this case, Since the user is in the process of settlement, It is usually necessary to enter the identification information of each data object purchased one by one. E.g, A user selects a total of 10 items. When billing, Users can pick up their purchased items one by one, Align the bar code of each product to the area such as the code port of the terminal device. To enter data object identification information. therefore, The image information of the product input by the user can be collected through the image acquisition device. Then, based on the collected image data, it is possible to analyze how many items the user has performed input operations on, The identity of the specific data object for each operation, and many more. such, You can analyze the results from the image, Compared with the actual input result, In this way, the degree of matching between the user's user behavior and the actual data object information entered is determined. That is, Determine whether the user has "less scans" or "wrong scans". of course, In practical applications, Even if it ’s not entered piece by piece, The solution provided in the embodiment of the case may also be used to compare the goods scanned by the user with the data object information actually input. E.g, You can provide a product placement table, etc. near the terminal device. You can require users to enter data object identification information before or after Place all the products they purchase on the placement table. It ’s best not to overlap each other, etc. then, The image acquisition device performs image acquisition on the goods on the placing table. such, You can also determine the number of goods and logos that the user actually purchased. And it is used to compare with the data object information of the actual input system. of course, This alternative requires the cooperation of the user, therefore, In the aforementioned process of inputting data object identification information by the user, The method of image capturing the information of the product that the user picks up each time. Is the more preferred solution, Because it implements a loss prevention process in a non-cooperative state of the user, The user only needs to perform input operations such as code scanning, No additional operations are required specifically to cope with damage prevention treatments, therefore, More conducive to improving the user experience, It also further improves efficiency.     The following are from different angles, The technical solutions provided by the embodiments of this case are described in detail.         Embodiment 1 First, The first embodiment provides a data object information processing system, See Figure 2. The system may specifically include a terminal device 201, Image acquisition equipment 202, And the information processor 203, among them:     The terminal device 201 includes an information input area, Used to enter the identification information of the selected data object during the settlement process;     The image acquisition device 202, Image collection for the process of inputting data object identification information;     The information processor 203, Configured to be based on the data object identification information received by the terminal device 201, And image data collected by the image acquisition device 202, The matching degree between the user operation behavior and the actually entered data object information in the settlement process is judged.      among them, The terminal device 201 may be specifically deployed in a physical store, or, It can also exist as a settlement terminal such as POS. This enables portable billing. The main function of the terminal device 201 is to help users complete a self-service settlement process. During the settlement process, Loss control is performed through the image collector 202 and the information processor 203. but, For users, It is not necessary to sense the existence of the image collector 202 and the information processor 203, Simply follow the prompts of the terminal device 201 to perform the operation.      E.g, When implemented, Can provide information input area, Depending on how the information is entered, The specific form of the information input area can also vary. E.g, If the identification information of the data object is entered through code scanning, The information input area may specifically include a code scanning port in a hardware form. E.g, As shown in Figure 3-1, It shows a specific implementation form of terminal equipment, specific, The code scanning port 301 may be located at a lower right corner of the terminal device. When there is no user to check out, The prompt information can be displayed on the display of the terminal device. E.g, "Tap the screen to start self-checkout", and many more. After the user taps the screen, You can also prompt for input method information. E.g, As shown in Figure 3-2, You can use graphics and text to prompt. The text can include "Waiting to scan product codes, Please align the barcode of the product with the scanning port below ", and many more. Next, The user can align the barcodes and other graphic codes of the products they have purchased with the scan port one by one. and then, The terminal device can obtain the identification information of the specific data object. In addition, The terminal device can also store information such as the price of each data object in advance. Or get real-time price information for specific data objects from the server, During the scanning process, You can also add up the prices and other data objects, The information of the data object is displayed on the display of the terminal device. As shown in Figure 3-3.      of course, In some cases, unsuccessful scanning may occur. therefore, You can also enter the identification information of the data object by manually entering the product code. at this time, The information input area may specifically refer to an area in a terminal device display. E.g, As shown in the button in the lower left corner of the display, such as the "manual input barcode" The user can open the virtual keyboard by clicking the button. And comparing the barcode of the purchased product, Enter the specific data object identification information into the terminal device.     After entering the information for all the products you have purchased, You can confirm the completion of the input operation by clicking the "Confirm Payment" button displayed on the screen of the terminal device You can then complete the payment through the associated client program. among them, The associated client program can be installed in a user's private mobile terminal device. E.g, "Box Horse App" on mobile phones, etc. corresponding, The identification information of the data object obtained by the terminal device 201 can also be submitted to the server corresponding to this application. E.g, The server of "Box Horse" in the previous example, etc. The server generates the corresponding order. after that, As shown in Figure 3-4, The terminal device 201 may prompt the user on the display: "Please open the payment code of Hema App, Align the Scanning Port Below ", and many more. after that, Users can then operate pre-installed related applications in their mobile devices, such as their mobile phones. And enter the payment code interface, Align the display of the mobile phone with the code scanning port of the terminal device 201, The terminal device can then provide information about the payment code to the server. such, The server can then use the user account and other information carried in the payment code to complete the payment process.     When it is implemented, It can be equipped with a smart operating system for the terminal device 201, such, The recommended information such as marketing solutions that can be provided on the App (application) installed on mobile terminal devices such as mobile phones Provided to users through this settlement terminal, So that during the settlement or after the settlement is completed, You can also get more recommended information such as marketing activities through this terminal device. or, Recommendations for more data subjects, and many more. Users can also interact directly through this terminal device, Including completing interactive games, Win the corresponding reward, or, You can also choose the data object you are interested in to place an order. and many more. and, Since the settlement terminal device can obtain information such as the user's account, In addition, information such as the identity of the user can be obtained. therefore, In providing these recommendations, You can also provide personalized recommendations based on different users. This recommended information can also be information about relevant online data objects. such, It can also achieve user drainage from offline to online. In addition, The terminal can also be equipped with a larger screen, And can be in the form of a touch screen, To better support interaction with users. Anyway, In this way, the entire terminal device 201 looks like a relatively large tablet computer. While more informative, And interact with users, And it saves space.     Also, The terminal device 201 may also have multiple cameras, Can be used to get the user's face image, Users are then authenticated. When implemented, Since the user is in the real-name authentication process, Usually, the user's face image is tied to the account information. therefore, By comparing the face images of actual users, And the account information entered by the user, Determine whether it is the user ’s action, To prevent others from using the user ’s terminal device, As a result, the user's property is lost. of course, In practical applications, You can also authenticate users by collecting other biometric information of users. Including fingerprints, Iris, etc. therefore, In the embodiment of the present case, it may be collectively referred to as a biological sign information collection device It is used to collect user's biometric information. Used to authenticate users. specific, The biological sign information collection device may be built in the terminal device 201, or, Can also be set independently, And can communicate with the terminal device 201, and many more.     The specific settlement process was introduced above, The image acquisition device 202 can be used in the settlement process. Where users do n’t have to be aware, For user actions, Collect image information of the data object being operated. among them, When implemented, In order to improve the accuracy of image recognition, And realize the information collection in the non-cooperative state of the user, The image acquisition device can specifically input identification information of the purchased data object through a piece-by-piece input method, Collect the image information of the data object operated by each input. In order to improve the quality of the captured images, The location of the image capture device and the shooting angle can also be determined based on the location of the information input area in the terminal device. E.g, As shown in Figure 1, The image acquisition device can be positioned diagonally above the information input area, In addition, the shooting angle can cover a range centered on the information input area. In the process of identification input by bringing a data object close to the information input area, Can collect image information of data objects. such, You can avoid collecting too much invalid image information. It can also collect the user's operation behavior more accurately. And images of the products that the user actually operates. among them, Products operated by the user described here, Specifically, it can refer to the product currently being scanned. E.g, The user holds an item, Align the barcode of the product with the scanning port of the terminal device 201 to perform a scanning operation, Then the product is the product operated by the user.      among them, The image acquisition device 202 may specifically perform video recording on the process of inputting the identification information of the data object. Follow-up analysis and judgment through analysis of specific recorded video data. or, Other methods, such as taking photos, can also be used for image acquisition. In the method of capturing images by taking pictures, The user's operation behavior can also be identified by the image acquisition device. Every time it is recognized that the user is performing an input operation such as scanning a product code, Take one or more photos, When recognizing the operation of entering the next product identification information, Take one or more photos, And so on. such, Each time you enter the identity of an item, You can get one or more photos correspondingly, Follow-up analysis and judgment can be made by analyzing these photos.     The acquired image data can be provided to the information processor 203, The information processor 203 can then according to the data object identification information received by the terminal device, And image data collected by the image acquisition device, The matching degree between the user operation behavior and the actually entered data object information in the settlement process is judged.      among them, The information processor 203 may be located in the terminal device 201, That is, Related judgment operations may be performed locally on the terminal device 201. or, The information processor 203 may also be located in a server in the cloud. at this time, Relevant collection result information can be submitted to the server. An information processor in the server performs related judgment operations. at this time, The server-side information processor can use synchronous judgment. That is, While receiving relevant data collection results, While judging, And provide the judgment result to the terminal device 201 in real time, The terminal device 201 can determine in real time whether the user is allowed to continue the operation. or, The server-side information processor can also use asynchronous judgment. That is, During the actual settlement process by the user, Can only receive relevant data collected, But for the time being, no judgment is made. Subsequent judgment operations are performed in a uniformly set time period. In this situation, The result of the judgment can usually be provided to the client used by the relevant management staff of the physical store, etc. E.g, When a problem is found with a user ’s order, The relevant information can be provided to the manager of the corresponding physical store. The subsequent specific treatment can be determined according to the actual situation. E.g, Can hold users accountable, or, Tag users, Users are not allowed to use self-service settlement terminal devices for settlement, and many more.      among them, When the information processor makes specific judgments, Can blur identification of quantity information, Or you can accurately identify the identification information of a specific data object. E.g, For the former, The information processor determines the number of times a user performs an input operation, And the number of data objects actually entered, It is also determined whether the number of times of the specified input operation is consistent with the number of data objects actually input. For the latter, The information processor may be based on the acquired image data, Determine the identity of the data object operated by the user during the input operation, Determine the identifier of the data object being operated on, Is it consistent with the ID of the entered data object? among them, The data objects operated by the user described here, Refers to the data object corresponding to the product that the user actually holds and is near the scan port to scan the code. It may be different from the identification of the data object actually input into the terminal device. E.g, If a user attempts to settle a high-priced item with the bar code of a low-priced item, The following situations may occur: Want to buy product A, But remove the barcode of product B in advance, Affixed to the barcode position of product A, such, When scanning the code with the product A in hand, In fact, the barcode of product B is scanned. at this time, The terminal device receives the identification information of the data object corresponding to the product B. therefore, There will be a situation where the product held by the user is inconsistent with the actual code-scanned product. among them, In order to be able to identify the identification information of specific data objects from the collected image data, The correspondence between the identification of the data object and the image feature information can be saved in advance, such, Based on the acquired image data and the corresponding relationship, Determine the identity of the data object operated by the user during the input operation.     In short, Through the examples in this case, The image acquisition equipment and information processor can be set in the data object information processing system. such, In the process of inputting data object identification information through a terminal device, The image acquisition device can collect user's operation behavior and image information of related data objects. and then, The information processor can use image analysis. Determine whether the data object actually taken by the user is consistent with the data object input into the terminal device, In this way, loss prevention processing in the process of self-service settlement is realized.     优选 In a preferred embodiment, Since users usually enter the identification information of the data objects they have purchased one by one, therefore, The image capture device can be used during the user's input of piece of information, Collect the image information of the data object each time the user performs an input operation, In this way, loss prevention processing can be achieved in the non-cooperative state of the user. Conducive to improving the user experience, Further improve efficiency.         Second embodiment: This second embodiment provides a data object information processing method from the perspective of a terminal device. In this method, The image acquisition equipment can be integrated in the terminal equipment, or, You can also connect to the terminal device externally, In addition, The terminal device may also include an information processor, The information processor may be implemented in various forms such as software or hardware. under these circumstances, See Figure 4, The method may specifically include:     S401: Obtain the identification input information of the selected data object;     S402: Image collection of the process of inputting the identification information of the data object;     S403: Inputting information according to the data object identifier, And the acquired image data, Determine the degree of matching between the user's operation behavior and the actual data object information entered during the settlement process.      among them, Specifically, when obtaining the identification input information of the selected data object, It is possible to obtain the identification input information of the purchased data object submitted through the piece-by-piece input method. E.g, Users can perform code scanning on their selected data objects one by one. Or enter the barcode information of each data object one by one. and many more.     Specifically during image acquisition of the process of inputting identification information of data objects, It can be in the process of inputting the data object identification information through the piece by piece input method. Video recording the process, This reduces the dependence on user cooperation. Specifically during image acquisition, Video recording may be performed on the process of inputting the identification information of the data object, During subsequent analysis, It can be based on the recorded video image for analysis and processing. or, You can also take pictures to collect images.     When making judgments, Can make fuzzy quantitative judgments, specific, Can determine the number of times a user performs an input operation, And the number of data objects actually entered, then, It is determined whether the number of times of the specified input operation is consistent with the number of data objects actually input.     Or, It can also perform accurate consistency comparison of data object identifiers. Detected a bar code replacement for an unequal product. specific, According to the acquired image data, Determine the identity of the data object operated by the user during the input operation, then, Determine the identifier of the data object being operated on, Is it consistent with the ID of the entered data object?     执行 In order to perform the above image recognition process, The correspondence between the identification of the data object and the image feature information can be saved in advance. such, According to the acquired image data and the corresponding relationship, Determine the identity of the data object operated by the user during the input operation.      among them, Specifically in determining the identifier of the data object being operated on, When it is consistent with the ID of the entered data object, Each time an input message is received regarding the identity of the selected data object, Determine the identifier of the data object being operated on, Is it consistent with the ID of the entered data object? If the judgment result corresponding to the currently received input information is inconsistent, You can interrupt the settlement operation.     Or, Alternatively, after the identification information of all the selected data objects is input, Judging the first set consisting of the identifiers of the data objects being operated on, Whether it is the same as the second set composed of the identifiers of the input data objects.         Embodiment 3 The third embodiment is from the perspective of a terminal device. Provides another data object information processing method, In this method, The information processor can be located on the server side. therefore, Relevant image recognition and judgment operations can be completed on the server side. at this time, See Figure 5, The method may specifically include:     S501: Obtain the identification input information of the selected data object;     S502: Image collection of the process of inputting the identification information of the data object;     S503: Providing the obtained identification information of the data object and the collected image data to the server, The server judges the matching degree between the user operation behavior and the actually entered data object information during the settlement process.         Fourth embodiment: This fourth embodiment corresponds to the three phases of the embodiment. From a server perspective, Provides a data object information processing method, See Figure 6, The method may specifically include:     S601: Receive identification input information of data objects purchased by users, And image data collected during the process of inputting identification information of the data object;     S602: Inputting information according to the data object identifier, And the acquired image data, Determine the degree of matching between the user's operation behavior and the actual data object information entered during the settlement process.     For the case of image recognition and judgment on the server side, Can be synchronized or asynchronous. among them, In the case of asynchronous processing, Since specific order information can be stored on the server, And when each order was generated, In addition, Information such as the acquisition time of specific image data can also be saved, therefore, Matching judgment between order information and captured image data can be made based on specific time information. If a server needs to connect to multiple physical stores, Or multiple terminal devices, You can also store specific store logos in the order and captured image data, Terminal equipment identification, etc. In this way, the order information generated by the same terminal device in the unified store is matched with the image data collected by the image acquisition device associated with the device.      specific, You can first determine the attribute information of the order to be matched. The attribute information of the order includes: The physical store identifier associated with the order, Terminal equipment identification, The time when the order was generated and the time when the data object identification input was started. You can also determine the attribute information of the acquired image data. The attribute information of the image data includes: The physical store identification associated with the image data, Terminal equipment identification and image acquisition time information. after that, According to the attribute information of the order and the attribute information of the image data, Determining the image data to be analyzed corresponding to the order, And enter information according to the data object identifier associated with the order, And the image data to be analyzed, Determine the degree of matching between the user's operation behavior and the actual data object information entered during the settlement process.     Regarding the undetailed parts in the foregoing second to fourth embodiments, Please refer to the description in the first embodiment, I won't repeat them here.     Corresponds to the second embodiment, The embodiment of the present case also provides a data object information processing device, See Figure 7, The device may specifically include:     Input information obtaining unit 701, Used to obtain the identification input information of the selected data object;     Image acquisition unit 702, Image collection for the process of inputting data object identification information;     Judging unit 703, For inputting information according to the data object identifier, And the acquired image data, Determine the degree of matching between the user's operation behavior and the actual data object information entered during the settlement process.     When it is implemented, The input information obtaining unit may be specifically configured to:     Obtain the identification input information of the purchased data object submitted through the piece-wise input method.     The image acquisition unit can be specifically used for:     In the process of inputting the identification information of the data object through the input by piece, Image recording of the process.     判断 The judgment unit may be specifically used for:     Determine the number of times the user performs an input operation, And the number of data objects actually entered;     Determine whether the number of specified input operations is consistent with the number of data objects actually input.     Or, The judging unit may also be configured to:     According to the acquired image data, Determine the identity of the data object operated by the user during the input operation;     Judging the identifier of the data object being operated on, Is it consistent with the ID of the entered data object?     Also, The device may also include:     Correspondence preservation unit, It is used to pre-store the correspondence between the identification of the data object and the image feature information;     The judgment unit is specifically used for:     According to the acquired image data and the corresponding relationship, Determine the identity of the data object operated by the user during the input operation.      among them, The determining unit may be specifically configured to:     Each time an input message is received regarding the identity of the selected data object, Determine the identifier of the data object being operated on, Is it consistent with the ID of the entered data object?      at this time, The device may also include:     Interrupt processing unit, It is used if the judgment result corresponding to the currently received input information is inconsistent, The settlement operation is interrupted.     Also, The determining unit may be specifically configured to:     完成 After entering the identification information of all the selected data objects, Judging the first set consisting of the identifiers of the data objects being operated on, Whether it is the same as the second set composed of the identifiers of the input data objects.     Corresponds to the three phases of the embodiment, The embodiment of the present case also provides a data object information processing device, See Figure 8, The device may include:     Input information obtaining unit 801, Used to obtain the identification input information of the selected data object;     Image acquisition unit 802, Image collection for the process of inputting data object identification information;     Information submission unit 803, It is used to provide the identification input information of the obtained data object and the collected image data to the server, The server judges the matching degree between the user operation behavior and the actually entered data object information during the settlement process.     Corresponds to the fourth embodiment, The embodiment of the present case also provides a data object information processing device, See Figure 9, The device may include:     Information receiving unit 901, It is used to receive the identification input information of the user-selected data object submitted by the terminal device. And image data collected during the process of inputting identification information of the data object;     Judging unit 902, For inputting information according to the data object identifier, And the acquired image data, Determine the degree of matching between the user's operation behavior and the actual data object information entered during the settlement process.      among them, The received information further includes an identifier of a physical store where the terminal device is located, And terminal device identification.      at this time, The determining unit may specifically include:     Order information determination subunit, Attribute information used to determine the order to be matched. The attribute information of the order includes: The physical store identifier associated with the order, Terminal equipment identification, The time when the order was generated and the time when the data object identification input was started;     Image information determination subunit, Used to determine the attribute information of the acquired image data. The attribute information of the image data includes: The physical store identification associated with the image data, Terminal equipment identification and image acquisition time information;     Determining subunits of image data, Used for the attribute information of the order and the attribute information of the image data, Determining the image data to be analyzed corresponding to the order;     Judging subunits, For inputting information according to a data object identifier associated with the order, And the image data to be analyzed, Determine the degree of matching between the user's operation behavior and the actual data object information entered during the settlement process.     Also, The device also provides an electronic device, include:     One or more processors; And memory associated with the one or more processors, The memory is used for storing program instructions, When the program instructions are read and executed by the one or more processors, Do the following:     Obtain the identification input information of the selected data object;     影像 Image collection for the process of inputting identification information of data objects;     输入 Enter information based on the data object identifier, And the acquired image data, Determine the degree of matching between the user's operation behavior and the actual data object information entered during the settlement process.      among them, FIG. 10 exemplarily shows the architecture of an electronic device. E.g, The device 1000 may be a mobile phone, computer, Digital broadcasting terminal, Messaging equipment, Game console, Tablet device, Medical equipment, Fitness equipment, Personal digital assistant, Aircraft, etc.     Referring to FIG. 10, The device 1000 may include one or more of the following components: Processing component 1002, Memory 1004, Power module 1006, Multimedia component 1008, Audio component 1010, Input / output (I / O) port 1012, Sensor assembly 1014, And communication component 1016.     Processing component 1002 generally controls the overall operation of equipment 1000, Such as with display, Phone call, Data communications, Operations associated with camera operations and recording operations. The processing component 1002 may include one or more processors 1020 to execute instructions, In order to complete the video playback method provided by the technical solution of the present case, when a preset condition is satisfied, Generate traffic compression requests, And send it to the server, The traffic compression request records information used to trigger the server to obtain the target area of interest. The traffic compression request is used to request a server to preferentially guarantee a bit rate of video content in a target area of interest; Playing the video content corresponding to the stream file according to the stream file returned by the server, The bitstream file is all or part of the steps of a video file obtained by the server performing bitrate compression processing on video content outside the target area of interest according to the traffic compression request. In addition, The processing component 1002 may include one or more modules, Facilitates interaction between component 1002 and other components. E.g, The processing component 1002 may include a multimedia module, In order to facilitate the interaction between the multimedia component 1008 and the processing component 1002.     The memory 1004 is configured to store various types of data to support operation on the device 1000. Examples of this material include instructions for any application or method for operating on device 1000, Contact information, Phonebook information, message, image, Video, etc. The memory 1004 may be implemented by any type of volatile or non-volatile storage device or a combination thereof. Such as static random access memory (SRAM), Electrically erasable and programmable read-only memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read-only memory (ROM), Magnetic memory, Flash memory, Disk or disc.     The power supply assembly 1006 provides power to various components of the device 1000. The power component 1006 may include a power management system, One or more power supplies, And other and generated for device 1000, Manage and distribute power associated components.     Multimedia component 1008 includes a screen that provides an output port between device 1000 and the user. In some embodiments, The screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, The screen can be implemented as a touch screen, To receive input signals from the user. The touch panel includes one or more touch sensors to sense a touch, Swipe and gesture on touch panel. Touch sensors can not only sense the boundaries of a touch or swipe, It also detects duration and pressure associated with touch or swipe operations. In some embodiments, The multimedia component 1008 includes a front camera and / or a rear camera. When device 1000 is in operation mode, Such as in shooting mode or video mode, The front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.     The audio component 1010 is configured to output and / or input audio signals. E.g, The audio component 1010 includes a microphone (MIC), When device 1000 is in operation mode, Such as call mode, In recording mode and voice recognition mode, The microphone is configured to receive an external audio signal. The received audio signal may be further stored in the memory 1004 or transmitted via the communication component 1016. In some embodiments, The audio component 1010 also includes a speaker, Used to output audio signals.     I / O port 1012 provides a port between the processing module 1002 and the peripheral port module. The peripheral port module may be a keyboard. Click the wheel, Buttons, etc. These buttons can include, but are not limited to: Home button, Volume buttons, Start button and lock button.     Sensor assembly 1014 includes one or more sensors, It is used to provide various aspects of status assessment for the device 1000. E.g, The sensor component 1014 can detect the on / off state of the device 1000, Relative positioning of components, For example, the components are a display and a keypad of the device 1000, The sensor component 1014 can also detect a change in the position of the device 1000 or a component of the device 1000, The presence or absence of user contact with device 1000, Device 1000 orientation or acceleration / deceleration and temperature change of device 1000. The sensor assembly 1014 may include a proximity sensor, It is configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1014 may further include a light sensor, Such as CMOS or CCD image sensors, For use in imaging applications. In some embodiments, The sensor assembly 1014 may further include an acceleration sensor, Gyroscope sensor, Magnetic sensor, Pressure sensor or temperature sensor.     The communication module 1016 is configured to facilitate wired or wireless communication between the device 1000 and other devices. The device 1000 can access a wireless network based on a communication standard. Like WiFi, 2G or 3G, Or a combination of them. In an exemplary embodiment, The communication component 1016 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, The communication component 1016 further includes a near field communication (NFC) module, To facilitate short-range communications. E.g, The NFC module can be based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wide Band (UWB) technology, Bluetooth (BT) technology and other technologies.     In an exemplary embodiment, The device 1000 may be implemented by one or more application specific integrated circuits (ASICs), Digital Signal Processor (DSP), Digital Signal Processing Equipment (DSPD), Programmable logic device (PLD), Field Programmable Gate Array (FPGA), Controller, Microcontroller, Microprocessor or other electronic components, Used to perform the above method.     In an exemplary embodiment, A non-transitory computer-readable storage medium including instructions is also provided, For example, a memory 1004 including instructions, The above instructions may be executed by the processor 1020 of the device 1000 to complete the video playback method provided by the technical solution of the present disclosure. When a preset condition is satisfied, Generate traffic compression requests, And send it to the server, The traffic compression request records information used to trigger the server to obtain the target area of interest. The traffic compression request is used to request a server to preferentially guarantee a bit rate of video content in a target area of interest; Playing the video content corresponding to the stream file according to the stream file returned by the server, The bitstream file is a video file obtained by the server performing bitrate compression processing on video content outside the target area of interest according to the traffic compression request. E.g, The non-transitory computer-readable storage medium may be a ROM, Random access memory (RAM), CD-ROM, magnetic tape, Floppy disks and optical data storage devices.     According to the description of the above embodiments, Those skilled in the art can clearly understand that this case can be implemented by means of software plus the necessary universal hardware platform. Based on this understanding, The technical solution of this case is essentially in the form of software products, or the part that contributes to the existing technology, The computer software product may be stored in a storage medium, Such as ROM / RAM, Disk, CDs, etc. Includes several instructions to make a computer device (may be a personal computer, server, Or network equipment, etc.) perform the method described in each embodiment or some parts of the embodiment.     实施 Each embodiment in this specification is described in a progressive manner, The same and similar parts between the various embodiments may refer to each other, Each embodiment highlights differences from other embodiments. especially, For a system or system embodiment, Since it is basically similar to the method embodiment, So the description is relatively simple, For related points, refer to the description of the method embodiments. The systems and system embodiments described above are merely schematic, The units described as separate components may or may not be physically separated, The component displayed as a unit may or may not be a physical unit. Can be located in one place, Or it can be distributed across multiple network units. Some or all of the modules may be selected according to actual needs to achieve the objective of the solution of this embodiment. Without any creative work, those of ordinary skill in the art, That can be understood and implemented.     The above-mentioned methods for processing data object information provided in this case, Devices and systems, Detailed introduction, This article uses specific examples to explain the principle and implementation of this case. The description of the above embodiments is only used to help understand the method of the case and its core ideas; Simultaneously, For those of ordinary skill in the art, According to the idea of this case, There will be changes in the specific implementation and application scope. In summary, The contents of this description should not be construed as a limitation on this case.

101‧‧‧Settlement terminal equipment

102‧‧‧Image Acquisition Equipment

201‧‧‧ Terminal Equipment

202‧‧‧Image Acquisition Equipment

203‧‧‧ Information Processor

301‧‧‧Scanning mouth

S401, S402, S403‧‧‧ steps

S501, S502, S503‧‧‧ steps

S601, S602‧‧‧ steps

701‧‧‧ Input information obtaining unit

702‧‧‧Image Acquisition Unit

703‧‧‧Judgment unit

801‧‧‧ Input information obtaining unit

802‧‧‧Image Acquisition Unit

803‧‧‧Information submission unit

901‧‧‧Information receiving unit

902‧‧‧judgment unit

1000‧‧‧ Equipment

1002‧‧‧Processing component

1004‧‧‧Memory

1006‧‧‧Power Supply

1008‧‧‧Multimedia component

1010‧‧‧Audio Components

1012‧‧‧Input / Output (I / O) port

1014‧‧‧Sensor components

1016‧‧‧Communication component

1020‧‧‧Processor

In order to more clearly explain the embodiments of the present case or the technical solutions in the prior art, the drawings needed to be used in the embodiments are briefly introduced below. Obviously, the drawings in the following description are just some embodiments of the present case. For those of ordinary skill in the art, other schemes can be obtained based on these schemes without paying creative labor. Fig. 1 is a schematic diagram of an application scenario provided by an embodiment of the present case; Fig. 2 is a schematic diagram of a system provided by an embodiment of the present case; Figs. 3-1 to 3-4 are interface diagrams of terminal equipment provided by the embodiment of the present case; Fig. 4 is provided by the embodiment of the present case流程图 FIG. 5 is a flowchart of the second method provided by the embodiment of the present case; FIG. 6 is a flowchart of the third method provided by the embodiment of the present case; FIG. 7 is a flowchart of the first device provided by the embodiment of the present case Schematic diagram; FIG. 8 is a schematic diagram of the second device provided by the embodiment of the present case; FIG. 9 is a schematic diagram of the third device provided by the embodiment of the present case; FIG. 10 is a schematic diagram of the electronic device provided by the embodiment of the present case.

Claims (26)

A data object information processing system, characterized in that it includes a terminal device, an image acquisition device, and an information processor, wherein: 终端 the terminal device includes an information input area for inputting an identifier of the selected data object during the settlement process Information; the image acquisition device is used to perform image acquisition on the process of inputting data object identification information; the information processor is used to collect data object identification information received by the terminal device, and the image acquisition device collects information The obtained image data judges the degree of matching between the user's operation behavior and the actually entered data object information during the settlement process. The system according to claim 1, wherein: 采集 the image acquisition device is specifically configured to: in the process of inputting the identification information of the purchased data object through a piece-by-piece input method, the data object operated by each input Image information. The system according to claim 1, wherein: 的 the position and angle of the image acquisition device are determined according to the position of the information input area, and are specifically used for identifying input by bringing a data object close to the information input area In the process, the image information of the data object is collected. The system according to claim 1, further comprising: a biometric information collection device, configured to collect biometric information of a user for identity authentication of the user. The system according to claim 1, wherein: 终端 the terminal device further includes a display for displaying information of the input data object during the settlement process. The system according to claim 1, wherein the terminal device is equipped with a smart operating system and further includes an information recommendation module for providing personalized recommendation information according to user information. The system according to claim 6, wherein the recommendation information includes data object information and / or online marketing activity information. The system according to any one of claims 1 to 7, wherein: the information processor is located in the terminal device. The system according to any one of claims 1 to 7, wherein: 资讯 the information processor is located in a server; the image acquisition device is further configured to upload the acquired image data to the server. A data object information processing method, comprising: obtaining identification input information of a purchased data object; 影像 image acquisition of the process of inputting data object identification information; 输入 inputting information according to the data object identification, and the collected information Image data, to judge the matching degree between user operation behavior and actual input data object information in the settlement process. The method according to claim 10, wherein the step of obtaining the identification input information of the purchased data object comprises: obtaining the identification input information of the purchased data object submitted in a piece-wise manner. The method according to claim 10, wherein: said performing image collection on a process of inputting data object identification information comprises: 影像 performing a process of inputting data object identification information through a piece-by-piece input method, and imaging said process Record. The method according to claim 10, wherein: (i) judging the matching degree between the user operation behavior and the actual input data object information during the settlement process includes: (ii) determining the number of times the user performs the input operation, and the actual input data object. Quantity; judging whether the number of times of the specified input operation is consistent with the actual number of data objects input. The method according to claim 10, wherein: judging the matching degree between user operation behavior and actual input data object information in the settlement process includes: 确定 determining the user to perform input operation process based on the collected image data The identifier of the data object operated in the step; judging whether the identifier of the data object operated is consistent with the identifier of the input data object. The method according to claim 14, further comprising: pre-storing the correspondence between the identification of the data object and the image feature information; determining the operation performed by the user during the input operation based on the collected image data The identification of the data object includes: 确定 determining the identification of the data object operated by the user during the input operation according to the collected image data and the corresponding relationship. The method according to claim 14, wherein: determining whether the identifier of the operated data object is consistent with the identifier of the entered data object includes: each time an input is received regarding the identifier of the purchased data object Information to determine whether the identifier of the operated data object is consistent with the identifier of the entered data object. The method according to claim 16, further comprising: 中断 interrupting the settlement operation if the judgment result corresponding to the currently received input information is inconsistent. The method according to claim 14, wherein: (i) determining whether the identifier of the data object being operated is consistent with the identifier of the input data object includes: (ii) completing the identification information of all selected data objects; After the input, it is determined whether the first set composed of the identifiers of the operated data objects is the same as the second set composed of the identifiers of the entered data objects. A data object information processing method, comprising: 包括 obtaining identification input information of a purchased data object; 影像 image acquisition of the process of inputting the identification information of the data object; inputting the obtained identification information of the data object and the collected information The image data is provided to a server, and the server judges the degree of matching between the user operation behavior and the actually entered data object information during the settlement process. A data object information processing method, comprising: receiving identification input information of a data object purchased by a user and submitted by a terminal device, and image data collected during the process of inputting data object identification information; according to the data object identification The input information and the collected image data are used to judge the matching degree between the user operation behavior and the actual input data object information during the settlement process. The method according to claim 20, wherein the received information further includes an identifier of a physical store where the terminal device is located, and a terminal device identifier. The method according to claim 21, wherein the inputting information based on the data object identifier and the collected image data to determine the degree of matching between the user operation behavior and the actual input data object information during the settlement process include: : Determine the attribute information of the order to be matched, the attribute information of the order includes: the physical store identification, terminal equipment identification, order generation time information and the time when the data object identification input is started; determine the collected information Attribute information of image data, the attribute information of the image data includes: the physical store identification, terminal equipment identification, and image collection time information associated with the image data; 确定 determining the information based on the attribute information of the order and the attribute information of the image data Describe the image data to be analyzed corresponding to the order; 输入 input information according to the data object identifier associated with the order, and the image data to be analyzed, to match the user's operation behavior with the actual input data object information in the settlement process; OK. A data object information processing device, comprising: 包括 an input information obtaining unit for obtaining identification input information of a purchased data object; an image acquisition unit for performing image collection on a process of inputting identification information of the data object; ； judgment The unit is configured to judge the matching degree between the user operation behavior and the actual input data object information according to the data object identification input information and the collected image data. A data object information processing device, comprising: an input information obtaining unit for obtaining identification input information of a purchased data object; an image acquisition unit for performing image collection on a process of inputting data object identification information; information A submitting unit, configured to provide the obtained identification input information of the data object and the collected image data to a server, and the server performs matching between the user operation behavior and the actual input data object information during the settlement process Judge. A data object information processing device, comprising: 包括 an information receiving unit for receiving identification input information of a data object purchased by a user and submitted by a terminal device, and image data collected during the process of inputting the identification information of the data object; The judging unit is configured to judge the matching degree between the user operation behavior and the actually input data object information according to the data object identifier input information and the collected image data. An electronic device, comprising: ： one or more processors; and a memory associated with the one or more processors, the memory is used to store program instructions, and the program instructions are When one or more processors read and execute, perform the following operations: obtain the identification input information of the purchased data object; 影像 image capture the process of inputting the identification information of the data object; 输入 enter the information according to the data object identification, and collect The obtained image data judges the matching degree between the user operation behavior and the actual data object information input during the settlement process.