WO2021098306A1 - 一种物品比对方法和装置 - Google Patents

一种物品比对方法和装置 Download PDF

Info

Publication number
WO2021098306A1
WO2021098306A1 PCT/CN2020/110000 CN2020110000W WO2021098306A1 WO 2021098306 A1 WO2021098306 A1 WO 2021098306A1 CN 2020110000 W CN2020110000 W CN 2020110000W WO 2021098306 A1 WO2021098306 A1 WO 2021098306A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
item
dimensional
comparison
model information
Prior art date
Application number
PCT/CN2020/110000
Other languages
English (en)
French (fr)
Inventor
王强
Original Assignee
北京沃东天骏信息技术有限公司
北京京东世纪贸易有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京沃东天骏信息技术有限公司, 北京京东世纪贸易有限公司 filed Critical 北京沃东天骏信息技术有限公司
Priority to EP20889388.3A priority Critical patent/EP4030373A4/en
Priority to US17/777,414 priority patent/US20220405823A1/en
Publication of WO2021098306A1 publication Critical patent/WO2021098306A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0623—Item investigation
    • G06Q30/0625—Directed, with specific intent or strategy
    • G06Q30/0629—Directed, with specific intent or strategy for generating comparisons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0282—Rating or review of business operators or products
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0631—Item recommendations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Shopping interfaces
    • G06Q30/0643—Graphical representation of items or shoppers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/012—Dimensioning, tolerancing

Definitions

  • the present invention relates to the field of computer technology, in particular to an item comparison method and device.
  • the comparison of items in e-commerce websites or APP shopping, especially 3C products, furniture, cars, etc. is mainly a simple comparison of pictures and basic parameter information, and the three-dimensional shape of the items is usually supplemented by the user’s brain, lacking physical objects. Intuitive comparison.
  • the embodiments of the present invention provide an item comparison method and device, which can at least solve the problem of the lack of intuitive, multi-angle, and multi-environment comparison of the same type of items in the prior art.
  • an item comparison method which includes: in response to a selection operation on at least two items in an item list, acquiring according to the identifiers of the at least two items Corresponding item information; 3D model information is rendered based on each item information to obtain 3D model information of each item; image information of the real scene is received to construct the 3D reconstruction information of the real scene, and the 3D model information of each item is superimposed on Perform display comparison on the three-dimensional reconstruction information.
  • the item information includes three-dimensional resources and information summary values
  • the rendering of the three-dimensional model information based on the information of each item also includes: using an information summary algorithm to process the three-dimensional resources of each item to obtain the first information summary value; if the information summary value is the same as the corresponding first information summary value, then Perform 3D model information rendering based on each 3D resource.
  • the item information further includes a three-dimensional resource download address
  • the first information summary value After the first information summary value is obtained, it further includes: if the information summary value is different from the corresponding first information summary value, downloading the three-dimensional resource based on the three-dimensional resource download address in the item information; using the information summary algorithm to The downloaded three-dimensional resource is processed to obtain the second information summary value; if the information summary value is the same as the corresponding second information summary value, the downloaded three-dimensional resource is used to render the three-dimensional model information.
  • the constructing the three-dimensional reconstruction information of the real scene includes: determining the three-dimensional coordinate value of each pixel in the image information by using a three-dimensional horizon coordinate system, so as to perform the three-dimensional reconstruction based on the three-dimensional coordinate value.
  • Rebuild information construction includes: determining the three-dimensional coordinate value of each pixel in the image information by using a three-dimensional horizon coordinate system, so as to perform the three-dimensional reconstruction based on the three-dimensional coordinate value.
  • the superimposing the three-dimensional model information of each item on the three-dimensional reconstruction information for display comparison includes: in the three-dimensional reconstruction information, determining the storage of each three-dimensional model information according to a predetermined relative spatial position relationship The position is displayed by superimposing each 3D model information with the 3D reconstruction information of the corresponding storage location.
  • an item comparison device including: an information acquisition module, configured to respond to a selection operation on at least two items in an item list, according to the at least The identification of the two items to obtain the corresponding item information; the model building module is used to render the three-dimensional model information based on the item information to obtain the three-dimensional model information of each item; the three-dimensional overlay module is used to receive the image information of the real scene to Constructing the three-dimensional reconstruction information of the real scene, superimposing the three-dimensional model information of each item on the three-dimensional reconstruction information for display comparison.
  • an electronic device for comparing items is provided.
  • the electronic device of the embodiment of the present invention includes: one or more processors; a storage device, configured to store one or more programs, and when the one or more programs are executed by the one or more processors, the One or more processors implement any of the above-mentioned item comparison methods.
  • a computer-readable medium on which a computer program is stored, and when the program is executed by a processor, any one of the above-mentioned item comparison methods is implemented .
  • one of the above-mentioned embodiments of the present invention has the following advantages or beneficial effects: when the user is viewing the item list or item details, he clicks "Add AR Comparison” to add related products to the comparison queue, and then By clicking on the "Start AR Comparison” of the list to start the AR display for comparison, this achieves the purpose of intuitive, multi-angle, multi-environment, and real-time comparison of two or more items.
  • FIG. 1 is a schematic diagram of the main flow of an item comparison method according to an embodiment of the present invention
  • Fig. 2 is a schematic diagram of a process for selecting an item according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of another process of selecting items according to an embodiment of the present invention.
  • Figure 4 is a schematic diagram of the three-dimensional model information of two objects superimposed on the three-dimensional reconstruction information of the real scene
  • FIG. 5 is a schematic diagram of the main flow of an optional item comparison method according to an embodiment of the present invention.
  • Fig. 6 is a schematic diagram of main modules of an item comparison device according to an embodiment of the present invention.
  • FIG. 7 is an exemplary system architecture diagram to which the embodiment of the present invention can be applied.
  • Fig. 8 is a schematic structural diagram of a computer system suitable for implementing a mobile device or a server according to an embodiment of the present invention.
  • FIG. 1 shown is a main flow chart of an item comparison method provided by an embodiment of the present invention, which includes the following steps:
  • S101 In response to a selection operation on at least two items in the item list, obtain corresponding item information according to the identifiers of the at least two items;
  • S102 Perform three-dimensional model information rendering based on the information of each item to obtain the three-dimensional model information of each item;
  • S103 Receive image information of the real scene to construct 3D reconstruction information of the real scene, and superimpose the 3D model information of each item on the 3D reconstruction information for display comparison.
  • the AR comparison can solve the comparison problem that cannot be solved by the language and the image.
  • the user can input text, pictures and other keywords in the search bar to obtain items that meet the search request and combine them into a list form; or a list composed of items recommended by default when the user opens the APP or the homepage of the website.
  • the user clicks at least two items to add the selected item to the AR comparison In the queue.
  • the platform is usually managed based on the ID of the item, so the item list and AR comparison queue are all presented as item ID information.
  • the basic information of each item is obtained according to its ID; the basic information includes, but is not limited to, the appearance feature information of the item, such as volume, color, appearance, etc.
  • the AR comparison queue in this step is equivalent to summarizing the items selected by the user and triggering the AR display process through the "Start AR Comparison" button. And for items in the AR comparison queue, before clicking "Start AR Comparison", they can be deleted or added at any time in response to user operations, but it is necessary to ensure that the number of items in the queue is not less than two.
  • the three-dimensional model information is information that can present the item in a three-dimensional space. If the item is a mobile phone, the three-dimensional model information may include information about its length, width, and height, and location information such as cameras and earphone holes.
  • the 3D rendering module can be used to render the 3D model information of each item based on the 3D resources in the basic information. For specific description, refer to the following figure 5, which will not be repeated here.
  • the present invention needs to fuse the three-dimensional model information of multiple objects with the real scene, and therefore needs to perform 3D reconstruction (3D Reconstruction) on the real scene.
  • three-dimensional reconstruction refers to the establishment of a mathematical model suitable for computer representation and processing of three-dimensional objects. It is the basis for processing, operating and analyzing its properties in a computer environment. It is also the key to establishing a virtual reality that expresses the objective world in a computer. technology.
  • the user Before performing image processing, the user is required to first obtain a two-dimensional image of a real scene by using an image acquisition device (such as a camera).
  • an image acquisition device such as a camera
  • environmental factors need to be considered in the acquisition process, because the lighting conditions and the geometric characteristics of the camera have a great impact on the subsequent image processing.
  • the three-dimensional model information of each selected item can be merged with the three-dimensional reconstruction information of the real scene to present the real superimposition effect.
  • the position of each coordinate point in the 3D model information in the 3D reconstruction information is determined to achieve binding.
  • the user is not sure which color rice cooker to buy is better to look at at home.
  • two or more rice cookers selected by the user can be displayed and compared at the same time at the same time.
  • the user can view and select intuitively, as shown in Figure 4, for example.
  • the display of different three-dimensional model information in the three-dimensional reconstruction information has a certain relative spatial position relationship. For example, when there are only two items, you can choose left and right display, up and down display; when there are three items, you can choose left and right display, triangle display, etc. Thus, according to the number of items, different relative spatial position relationships can be constructed. Combined with the three-dimensional model information (or 3D resources, such as length, width and height) of each item, the storage location of each item is determined. For example, item 1 is on the left and item 2 is on the right.
  • the user can participate in the item placement operation, for example, drag the three-dimensional model information of the rice cooker onto the table.
  • the Android gesture module can obtain the screenX and screenY coordinates of the gesture through the touch event. This coordinate is the screen coordinate, which needs to be converted to the horizon coordinate. Assuming that the screen coordinates are ModelVector3 (x, y, z), the screen coordinates are converted to the horizon coordinates and become ScreenVector3 (screenX, screen, ModelVector3.z), thereby implementing gesture movement and rotation operations.
  • the screen coordinates are ModelVector3 (x, y, z)
  • ScreenVector3 screenX, screen, ModelVector3.z
  • the user when selecting an item, the user can not only learn about the item based on the basic information of the item, but also compare it based on its three-dimensional model information to give the user an intuitive feeling, improve the efficiency of item recommendation, and reduce the return and exchange of items. Frequency to enhance the user’s shopping experience.
  • FIG. 5 there is shown a schematic flowchart of an optional item comparison method according to an embodiment of the present invention, which includes the following steps:
  • S501 In response to a selection operation of at least two items in the item list, obtain corresponding item information according to the identifiers of the at least two items; where the item information includes a three-dimensional resource, a three-dimensional resource download address, and an information summary value;
  • S502 Use the information summary algorithm to process the three-dimensional resources of each item to obtain the first information summary value
  • S505 Use the information digest algorithm to process the downloaded three-dimensional resources to obtain a second information digest value
  • S507 Receive image information of the real scene to construct 3D reconstruction information of the real scene, and superimpose the 3D model information of each item on the 3D reconstruction information for display comparison.
  • steps S501 and S507 reference may be made to the description of steps S101 and S103 shown in FIG. 1, which will not be repeated here.
  • the three-dimensional model information rendering of the article is mainly performed based on the rendering module, and the rendering module includes a rendering library (such as OpenGL) or other rendering engines.
  • the rendering module includes a rendering library (such as OpenGL) or other rendering engines.
  • the image of the item on the platform is usually presented in a two-dimensional form, but because the three-dimensional model information is displayed in a three-dimensional manner, it is necessary to load the 3D resources from the basic information of the item (the length, width, height, and shape of the item are stored in the basic information) ); Among them, the 3D resource is an independent individual, including three-dimensional vertex coordinates, normals, textures, etc., such as a 3D rice cooker.
  • 3D resources are composed of a set of binary data, which may be abnormally modified during network transmission or when stored locally. Therefore, in addition to 3D resources, the basic information of the item also includes MD5 (Message Digest Algorithm MD5, Message Digest Algorithm 5th Edition), which is used to verify 3D resources, ensure the accuracy of 3D resources, and avoid imaging discrepancies.
  • MD5 Message Digest Algorithm MD5, Message Digest Algorithm 5th Edition
  • the above MD5 is stored on the server, and the server processes the 3D resources based on the existing MD5 tools to generate a hexadecimal MD5 string. Further, the MD5 string is unique, and the server saves the MD5 string in the basic information of the item. When the client subsequently requests the basic information of the item from the server, the MD5 can be obtained.
  • the local client can process the loaded 3D resource based on the information digest algorithm, so as to obtain an MD5, that is, the first MD5, on the local client.
  • the first MD5 is the same as the original loaded MD5, it means that the loaded 3D resource is correct; otherwise, it means the loaded 3D resource is wrong.
  • the local client needs to perform 3D resource based on the 3D resource download address in the basic information of the item. download. Similarly, 3D resource verification is required afterwards.
  • MD5 uses little-endian (little-endian mode) to input arbitrary length information, group it in 512-bit, generate four 32-bit data, and finally jointly output a fixed 128-bit information summary.
  • the basic process is: Fill, block, buffer initialization, cyclic compression, and get results.
  • the MD5 algorithm is a commonly used algorithm in this field, so for the server or local client, the MD5 value generated is also the same for the same 3D resource.
  • the present invention is mainly aimed at the AR display comparison of at least two items, so the above operations can be applied to multiple item operations at one time. And after ensuring the correctness of the 3D resources, the 3D model information will be rendered.
  • the method provided in the above embodiment uses MD5 to verify the 3D resources to filter abnormal 3D resources and re-download the correct 3D resources to ensure the correctness of the rendered 3D model information, so as to improve the appearance of the same type of objects.
  • FIG. 6 there is shown a schematic diagram of main modules of an item comparison device 600 provided by an embodiment of the present invention, including:
  • the information obtaining module 601 is configured to obtain corresponding item information according to the identifiers of the at least two items in response to a selection operation on at least two items in the item list;
  • the model building module 602 is used to perform 3D model information rendering based on the information of each item to obtain the 3D model information of each item;
  • the three-dimensional superimposition module 603 is configured to receive image information of the real scene to construct the three-dimensional reconstruction information of the real scene, and superimpose the three-dimensional model information of each item on the three-dimensional reconstruction information for display comparison.
  • the item information includes three-dimensional resources and information summary values
  • the model establishment module 602 is also used for:
  • the three-dimensional model information is rendered based on each three-dimensional resource.
  • the item information also includes a three-dimensional resource download address
  • the model establishment module 602 is used to:
  • the downloaded three-dimensional resource is used to render the three-dimensional model information.
  • the three-dimensional superimposition module 603 is used to determine the three-dimensional coordinate value of each pixel in the image information by using the three-dimensional horizon coordinate system, so as to perform the three-dimensional reconstruction information based on the three-dimensional coordinate value Construct.
  • the three-dimensional superimposition module 603 is used to determine the storage location of each three-dimensional model information according to a predetermined relative spatial position in the three-dimensional reconstruction information, so as to associate each three-dimensional model information with the corresponding storage location.
  • the three-dimensional reconstruction information is superimposed and displayed.
  • Figure 7 shows an exemplary system architecture 700 to which embodiments of the present invention can be applied.
  • the system architecture 700 may include terminal devices 701, 702, 703, a network 704, and a server 705 (just an example).
  • the network 704 is used to provide a medium for communication links between the terminal devices 701, 702, 703 and the server 705.
  • the network 704 may include various connection types, such as wired, wireless communication links, or fiber optic cables, and so on.
  • the user can use the terminal devices 701, 702, and 703 to interact with the server 705 via the network 704 to receive or send messages and so on.
  • Various communication client applications may be installed on the terminal devices 701, 702, and 703.
  • the terminal devices 701, 702, and 703 may be various electronic devices that have a display screen and support web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and so on.
  • the server 705 may be a server that provides various services, for example, a back-end management server (just an example) that provides support for shopping websites browsed by users using the terminal devices 701, 702, and 703.
  • a back-end management server (just an example) that provides support for shopping websites browsed by users using the terminal devices 701, 702, and 703.
  • the method provided by the embodiment of the present invention is generally executed by the server 705, and correspondingly, the device is generally set in the server 705.
  • terminal devices, networks, and servers in FIG. 7 are merely illustrative. According to implementation needs, there can be any number of terminal devices, networks, and servers.
  • FIG. 8 shows a schematic structural diagram of a computer system 800 suitable for implementing a terminal device of an embodiment of the present invention.
  • the terminal device shown in FIG. 8 is only an example, and should not bring any limitation to the function and scope of use of the embodiment of the present invention.
  • the computer system 800 includes a central processing unit (CPU) 801, which can be based on a program stored in a read-only memory (ROM) 802 or a program loaded from a storage portion 808 into a random access memory (RAM) 803 And perform various appropriate actions and processing.
  • ROM read-only memory
  • RAM random access memory
  • various programs and data required for the operation of the system 800 are also stored.
  • the CPU 801, the ROM 802, and the RAM 803 are connected to each other through a bus 804.
  • An input/output (I/O) interface 805 is also connected to the bus 804.
  • the following components are connected to the I/O interface 805: an input part 806 including a keyboard, a mouse, etc.; an output part 807 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and speakers, etc.; a storage part 808 including a hard disk, etc. ; And a communication section 809 including a network interface card such as a LAN card, a modem, and the like. The communication section 809 performs communication processing via a network such as the Internet.
  • the driver 810 is also connected to the I/O interface 805 as needed.
  • a removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 810 as needed, so that the computer program read from it is installed into the storage section 808 as needed.
  • the process described above with reference to the flowchart can be implemented as a computer software program.
  • the disclosed embodiments of the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart.
  • the computer program may be downloaded and installed from the network through the communication part 809, and/or installed from the removable medium 811.
  • the central processing unit (CPU) 801 the above-mentioned functions defined in the system of the present invention are executed.
  • the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable removable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium.
  • the computer-readable medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device .
  • the program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.
  • each block in the flowchart or block diagram may represent a module, program segment, or part of the code, and the above-mentioned module, program segment, or part of the code contains one or more for realizing the specified logic function.
  • Executable instructions may also occur in a different order than noted in the drawings. For example, two blocks shown in succession can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved.
  • each block in the block diagram or flowchart, and the combination of blocks in the block diagram or flowchart can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by It is realized by a combination of dedicated hardware and computer instructions.
  • the modules involved in the embodiments described in the present invention can be implemented in software or hardware.
  • the described module can also be set in the processor, for example, it can be described as: a processor includes an information acquisition module, a model establishment module, and a three-dimensional superimposition module.
  • a processor includes an information acquisition module, a model establishment module, and a three-dimensional superimposition module.
  • the names of these modules do not constitute a limitation on the module itself under certain circumstances.
  • a three-dimensional overlay module can also be described as "a module that overlays three-dimensional model information and three-dimensional reconstruction information.”
  • the present invention also provides a computer-readable medium.
  • the computer-readable medium may be included in the device described in the above embodiment; or it may exist alone without being assembled into the device.
  • the foregoing computer-readable medium carries one or more programs, and when the foregoing one or more programs are executed by a device, the device includes:
  • the image information of the real scene is received to construct the 3D reconstruction information of the real scene, and the 3D model information of each item is superimposed on the 3D reconstruction information for display comparison.

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Development Economics (AREA)
  • Strategic Management (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种物品比对方法和装置，该方法包括：响应于对物品列表中至少两个物品的选择操作，根据所述至少两个物品的标识，获取相应的物品信息（S101）；基于各物品信息进行三维模型信息渲染，得到各物品的三维模型信息（S102）；接收现实场景的图像信息，以构建所述现实场景的三维重建信息，将各物品的三维模型信息叠加在所述三维重建信息上进行展示比对（S103）。使得用户在挑选物品时，除了基于物品基本信息了解物品外，还可以基于其三维模型信息进行直观比对，以给予用户直观感觉，提高了物品推荐效率。

Description

一种物品比对方法和装置 技术领域
本发明涉及计算机技术领域，尤其涉及一种物品比对方法和装置。
背景技术
目前电商网站或APP购物中物品的比对，尤其是3C类产品、家具、汽车等，主要是图片和基本参数信息的简单对比，而对物品的立体形态通常靠用户脑补，缺少实物的直观比较。
发明内容
有鉴于此，本发明实施例提供一种物品比对方法和装置，至少能够解决现有技术中缺少对同一类物品有一个直观、多角度以及多环境比较的问题。
为实现上述目的，根据本发明实施例的一个方面，提供了一种物品比对方法，包括：响应于对物品列表中至少两个物品的选择操作，根据所述至少两个物品的标识，获取相应的物品信息；基于各物品信息进行三维模型信息渲染，得到各物品的三维模型信息；接收现实场景的图像信息，以构建所述现实场景的三维重建信息，将各物品的三维模型信息叠加在所述三维重建信息上进行展示比对。
可选的，所述物品信息包括三维资源和信息摘要值；
所述基于各物品信息进行三维模型信息渲染，还包括：利用信息摘要算法，对各物品的三维资源进行处理，得到第一信息摘要值；若信息摘要值与相应第一信息摘要值相同，则基于各三维资源进行三维模型信息渲染。
可选的，所述物品信息还包括三维资源下载地址；
在所述得到第一信息摘要值之后，还包括：若信息摘要值与相应第一信息摘要值不同，则基于物品信息中的三维资源下载地址进行三维资源下载；利用所述信息摘要算法，对下载的三维资源进行处理，得到第二信息摘要值；若信息摘要值与相应第二信息摘要值相同，则利用下载的三维资源进行三维模型信息渲染。
可选的，所述构建所述现实场景的三维重建信息，包括：利用三维视界坐标系方式，确定所述图像信息中各像素点的三维坐标值，以基于所述三维坐标值进行所述三维重建信息构建。
可选的，所述将各物品的三维模型信息叠加在所述三维重建信息上进行展示比对，包括：在所述三维重建信息中，按照预定的相对空间位置关系确定各三维模型信息的存放位置，以将各三维模型信息与相应存放位置的三维重建信息进行叠加展示。
为实现上述目的，根据本发明实施例的另一方面，提供了一种物品比对装置，包括：信息获取模块，用于响应于对物品列表中至少两个物品的选择操作，根据所述至少两个物品的标识，获取相应的物品信息；模型建立模块，用于基于各物品信息进行三维模型信息渲染，得到各物品的三维模型信息；三维叠加模块，用于接收现实场景的图像信息，以构建所述现实场景的三维重建信息，将各物品的三维模型信息叠加在所述三维重建信息上进行展示比对。
为实现上述目的，根据本发明实施例的再一方面，提供了一种物品比对电子设备。
本发明实施例的电子设备包括：一个或多个处理器；存储装置，用于存储一个或多个程序，当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现上述任一所述的物品比 对方法。
为实现上述目的，根据本发明实施例的再一方面，提供了一种计算机可读介质，其上存储有计算机程序，所述程序被处理器执行时实现上述任一所述的物品比对方法。
根据本发明所述提供的方案，上述发明中的一个实施例具有如下优点或有益效果：用户在观看物品列表或者物品详情时，通过点击“加入AR比较”来将相关产品加入到比较队列，然后通过点击比较对列表的“开始AR比较”来开启AR展示进行比较，以此实现了两个及以上物品进行直观的、多角度的、多环境的、实时的比较目的。
上述的非惯用的可选方式所具有的进一步效果将在下文中结合具体实施方式加以说明。
附图说明
附图用于更好地理解本发明，不构成对本发明的不当限定。其中：
图1是根据本发明实施例的一种物品比对方法的主要流程示意图；
图2是本发明实施例选择物品的流程示意图；
图3是本发明实施例的另一种选择物品的流程示意图；
图4是两个物品的三维模型信息叠加在现实场景三维重建信息后的示意图；
图5是根据本发明实施例的一种可选的物品比对方法的主要流程示意图；
图6是根据本发明实施例的一种物品比对装置的主要模块示意图；
图7是本发明实施例可以应用于其中的示例性系统架构图；
图8是适于用来实现本发明实施例的移动设备或服务器的计算机系统的结构示意图。
具体实施方式
以下结合附图对本发明的示范性实施例做出说明，其中包括本发明实施例的各种细节以助于理解，应当将它们认为仅仅是示范性的。因此，本领域普通技术人员应当认识到，可以对这里描述的实施例做出各种改变和修改，而不会背离本发明的范围和精神。同样，为了清楚和简明，以下的描述中省略了对公知功能和结构的描述。
参见图1，示出的是本发明实施例提供的一种物品比对方法的主要流程图，包括如下步骤：
S101：响应于对物品列表中至少两个物品的选择操作，根据所述至少两个物品的标识，获取相应的物品信息；
S102：基于各物品信息进行三维模型信息渲染，得到各物品的三维模型信息；
S103：接收现实场景的图像信息，以构建所述现实场景的三维重建信息，将各物品的三维模型信息叠加在所述三维重建信息上进行展示比对。
上述实施方式中，对于步骤S101，AR比较可以解决语言文字和图像解决不了的比较问题。
对于物品列表，可以是用户通过在搜索栏输入文字、图片等关键词，得到符合搜索请求的物品并组合成列表形式；或者用户打开APP或网站首页时，默认推荐的物品所组成的列表。
参见图2所示，物品列表中每个物品后都设有一个“加入AR(Augmented Reality，增强现实)比较”的选项，用户点击该选项，即代表选择。由于本发明主要进行不同物品的比较，所以用户需要至少点击两个物品的“加入AR比较”的选项。用户每次点击，所选择的物品均会自动添加至“AR比较队列”中。
参见图3所示，在显示物品列表后，用户点击“进行AR比较”按钮，进入AR比较操作界面。与图2所示不同之处在于，此时每个物品后仅显示有一个选择框，用户勾选这个框，即代表选择。选择完毕之后，点击界面底部(实际也可以是其他位置)的“加入AR比较队列” 选项，即将所选择的所有物品一同添加至AR比较队列中。
通过在物品列表或物品详情中设置“加入AR比较”相关语义的文字或者UI(User Interface，用户界面)、点击事件，用户通过点击至少两个物品，以将所点击选择的物品加入到AR比较队列中。
需要说明的是，平台通常是基于物品的ID进行管理的，因此物品列表、AR比较队列中均呈现为物品的ID信息。
在AR比较队列中，根据各物品的ID，获取其基本信息；其中，基本信息包括但不限于是物品的外形特征信息，例如体积、颜色、外观等。
在AR比较队列底部或其他位置，同样设置有一个“开始AR比较”相关语义的文字或者UI、点击事件(参见图2和图3)，用户通过点击该选项，即可进入AR展示流程。
需要说明的是，本步骤中的AR比较队列，相当于对用户选中的物品进行汇总，并通过“开始AR比较”按钮来触发进入AR展示流程。且对于AR比较队列中的物品，在点击“开始AR比较”之前，可以响应于用户操作随时进行删除或增加，但需保证队列中的物品数量不少于两个。
对于步骤S102，三维模型信息为可以在三维空间里呈现物品的信息，若物品为手机，则其三维模型信息可以为包括其长、宽、高体积信息，摄像头、耳机孔等位置信息。
对于各物品的三维模型信息渲染，可以利用3D渲染模块，基于基本信息中的3D资源进行。具体描述参见后续图5所示，在此不再赘述。
对于步骤S103，本发明需将多个物品的三维模型信息与现实场景进行融合，因此须对现实场景进行三维重建(3D Reconstruction)。
其中，三维重建是指对三维物体建立适合计算机表示和处理的数学模型，是在计算机环境下对其进行处理、操作和分析其性质的基础，也是在计算机中建立表达客观世界的虚拟现实的关键技术。
在进行图像处理之前，需要用户首先利用图像采集设备(例如摄像机)获取现实场景的二维图像。且采集过程中需要考虑环境因素，因为光照条件、相机的几何特性等对后续的图像处理造成很大的影响。
利用GoogleARCore、AppleARKit、3D视界坐标系4x4的Anchor矩阵信息或者其他基于SLAM(Simultaneous Localization And Mapping，即时定位与地图构建)的SDK(Software Development Kit，软件开发工具包)，将采集的图像信息处理为三维的坐标，以构建三维重建信息。
为了呈现不同物品在现实场景下的效果，可以将所选择的各物品的三维模型信息与现实场景的三维重建信息进行融合，以此呈现真实的叠加效果。例如，基于GoogleARCore提供的Projection Matrix、View Matrix、和Pose，确定三维模型信息中各个坐标点在三维重建信息中的位置，从而实现绑定。
例如，用户想买一辆车，但是不确定买A级车还是B级车、黑色还是白色，假若此时有两个虚拟的3D实物汽车呈现，便于用户直观了解到每款汽车的实物效果，以此确定所购买汽车。
再比如，对于某品牌型号的电饭煲，用户不确定买哪种颜色的电饭煲放在家里更好看，通过上述方式，将用户选中的两款或者多款电饭煲同时展现在家里进行摆放和比较，便于用户直观查看和选择，例如参见图4所示。
进一步的，不同三维模型信息在三维重建信息中的展示具有一定的相对空间位置关系。例如，仅有两个物品时，可以选择左右展示、上下展示；当有三个物品时，可以选择左右展示、三角形展示等。由此根据物品的数量，可以构建不同的相对空间位置关系。再结合各个物品的三维模型信息(或3D资源，例如长宽高)，确定各个物品的存放位置。例如，物品1位于左侧，物品2位于右侧。
更进一步的，在将三维模型信息叠加至三维重建信息中之后，用户可以参与物品摆放操作，例如拖动电饭煲的三维模型信息至桌子上。
以Android系统为例，Android的手势模块可以通过touch事件获取手势的screenX、screenY坐标。此坐标为屏幕坐标，需将其转换为视界坐标。假设屏幕坐标为ModelVector3(x,y,z)，则屏幕坐标转换为视界坐标后为ScreenVector3(screenX,screen,ModelVector3.z)，由此实现手势的移动和旋转操作。
上述实施例所提供的方法，用户在挑选物品时，除了基于物品基本信息了解物品外，还可以基于其三维模型信息进行比对，以给予用户直观感觉，提高了物品推荐效率，降低了物品退换频率，以此提升了用户购物体验。
参见图5，示出了根据本发明实施例的一种可选的物品比对方法流程示意图，包括如下步骤，
S501：响应于对物品列表中至少两个物品的选择操作，根据所述至少两个物品的标识，获取相应的物品信息；其中，物品信息包括三维资源、三维资源下载地址和信息摘要值；
S502：利用信息摘要算法，对各物品的三维资源进行处理，得到第一信息摘要值；
S503：若信息摘要值与相应第一信息摘要值相同，则基于各三维资源进行三维模型信息渲染，得到各物品的三维模型信息；
S504：若信息摘要值与相应第一信息摘要值不同，则基于物品信息中的三维资源下载地址进行三维资源下载；
S505：利用所述信息摘要算法，对下载的三维资源进行处理，得到第二信息摘要值；
S506：若信息摘要值与相应第二信息摘要值相同，则利用下载的三维资源进行三维模型信息渲染，得到各物品的三维模型信息；
S507：接收现实场景的图像信息，以构建所述现实场景的三维重建信息，将各物品的三维模型信息叠加在所述三维重建信息上进行展 示比对。
上述实施方式中，对于步骤S501和S507可参见图1所示步骤S101和S103的描述，在此不再赘述。
上述实施方式中，对于步骤S502～S506，对于物品的三维模型信息渲染，主要基于渲染模块进行，渲染模块中包含渲染库(如OpenGL)或者其他的渲染引擎。
平台中物品的图像通常呈现为二维形态，但由于三维模型信息是以三维方式进行的展示，所以需要从物品基本信息中加载3D资源(物品的长宽高、外形等信息存储于基本信息中)；其中，3D资源是一个独立的个体，包括三维顶点坐标、法线、贴图等，如3D电饭煲。
3D资源是由一组二进制数据组成，其可能在网络传输或在存储至本地时被异常修改。因此除了3D资源外，物品的基本信息中还包括MD5(Message Digest Algorithm MD5，消息摘要算法第五版)，用以验证3D资源，确保3D资源的准确性，避免成像不符的情况。
上述MD5，为存储于服务端，由服务端基于现有MD5工具处理3D资源，以生成一个16进制的MD5串。进一步的，该MD5串是唯一的，服务端将该MD5串保存至物品的基本信息中，当后续客户端向服务端请求物品基本信息时，即可获取得到该MD5。
为判断所加载的3D资源是否正确，可以在本地客户端，基于信息摘要算法，对所加载的3D资源进行处理，以此在本地客户端得到一个MD5，即第一MD5。
若该第一MD5与原加载到的MD5相同，则表示所加载的3D资源正确；否则，表明所加载的3D资源错误，本地客户端需基于物品基本信息中的3D资源下载地址，进行3D资源下载。同样，之后需要进行3D资源校验。
另外，MD5使用little-endian(小端模式)，输入任意不定长度信息，以512-bit进行分组，生成四个32-bit数据，最后联合输出固定128-bit 的信息摘要，其基本过程为：填充、分块、缓冲区初始化、循环压缩、得出结果。且MD5算法是本领域较为常用的算法，所以对于服务端或本地客户端，在针对同一3D资源的情况下，所生成的MD5值也相同。
本发明主要针对至少两个物品的AR展示比较，因此以上操作可一次性适用于多个物品操作。且在确保3D资源的正确性后，才会进行三维模型信息的渲染。
上述实施例所提供的方法，通过MD5对3D资源进行校验，用以筛选异常3D资源，并重新下载正确3D资源，以确保渲染三维模型信息的正确性，以此对同一类物品外观方面有一个直观的、多角度的、多环境的、实时的比较。
参见图6，示出了本发明实施例提供的一种物品比对装置600的主要模块示意图，包括：
信息获取模块601，用于响应于对物品列表中至少两个物品的选择操作，根据所述至少两个物品的标识，获取相应的物品信息；
模型建立模块602，用于基于各物品信息进行三维模型信息渲染，得到各物品的三维模型信息；
三维叠加模块603，用于接收现实场景的图像信息，以构建所述现实场景的三维重建信息，将各物品的三维模型信息叠加在所述三维重建信息上进行展示比对。
本发明实施装置中，所述物品信息包括三维资源和信息摘要值；
所述模型建立模块602，还用于：
利用信息摘要算法，对各物品的三维资源进行处理，得到第一信息摘要值；
若信息摘要值与相应第一信息摘要值相同，则基于各三维资源进行三维模型信息渲染。
本发明实施装置中，所述物品信息还包括三维资源下载地址；
所述模型建立模块602，用于：
若信息摘要值与相应第一信息摘要值不同，则基于物品信息中的三维资源下载地址进行三维资源下载；
利用所述信息摘要算法，对下载的三维资源进行处理，得到第二信息摘要值；
若信息摘要值与相应第二信息摘要值相同，则利用下载的三维资源进行三维模型信息渲染。
本发明实施装置中，所述三维叠加模块603，用于：利用三维视界坐标系方式，确定所述图像信息中各像素点的三维坐标值，以基于所述三维坐标值进行所述三维重建信息构建。
本发明实施装置中，所述三维叠加模块603，用于：在所述三维重建信息中，按照预定的相对空间位置关系确定各三维模型信息的存放位置，以将各三维模型信息与相应存放位置的三维重建信息进行叠加展示。
另外，在本发明实施例中所述装置的具体实施内容，在上面所述方法中已经详细说明了，故在此重复内容不再说明。
图7示出了可以应用本发明实施例的示例性系统架构700。
如图7所示，系统架构700可以包括终端设备701、702、703，网络704和服务器705(仅仅是示例)。网络704用以在终端设备701、702、703和服务器705之间提供通信链路的介质。网络704可以包括各种连接类型，例如有线、无线通信链路或者光纤电缆等等。
用户可以使用终端设备701、702、703通过网络704与服务器705交互，以接收或发送消息等。终端设备701、702、703上可以安装有各种通讯客户端应用。
终端设备701、702、703可以是具有显示屏并且支持网页浏览的 各种电子设备，包括但不限于智能手机、平板电脑、膝上型便携计算机和台式计算机等等。
服务器705可以是提供各种服务的服务器，例如对用户利用终端设备701、702、703所浏览的购物类网站提供支持的后台管理服务器(仅为示例)。
需要说明的是，本发明实施例所提供的方法一般由服务器705执行，相应地，装置一般设置于服务器705中。
应该理解，图7中的终端设备、网络和服务器的数目仅仅是示意性的。根据实现需要，可以具有任意数目的终端设备、网络和服务器。
下面参考图8，其示出了适于用来实现本发明实施例的终端设备的计算机系统800的结构示意图。图8示出的终端设备仅仅是一个示例，不应对本发明实施例的功能和使用范围带来任何限制。
如图8所示，计算机系统800包括中央处理单元(CPU)801，其可以根据存储在只读存储器(ROM)802中的程序或者从存储部分808加载到随机访问存储器(RAM)803中的程序而执行各种适当的动作和处理。在RAM 803中，还存储有系统800操作所需的各种程序和数据。CPU 801、ROM 802以及RAM 803通过总线804彼此相连。输入/输出(I/O)接口805也连接至总线804。
以下部件连接至I/O接口805：包括键盘、鼠标等的输入部分806；包括诸如阴极射线管(CRT)、液晶显示器(LCD)等以及扬声器等的输出部分807；包括硬盘等的存储部分808；以及包括诸如LAN卡、调制解调器等的网络接口卡的通信部分809。通信部分809经由诸如因特网的网络执行通信处理。驱动器810也根据需要连接至I/O接口805。可拆卸介质811，诸如磁盘、光盘、磁光盘、半导体存储器等等，根据需要安装在驱动器810上，以便于从其上读出的计算机程序根据需要被安装入存储部分808。
特别地，根据本发明公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本发明公开的实施例包括一种计算机程序产品，其包括承载在计算机可读介质上的计算机程序，该 计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中，该计算机程序可以通过通信部分809从网络上被下载和安装，和/或从可拆卸介质811被安装。在该计算机程序被中央处理单元(CPU)801执行时，执行本发明的系统中限定的上述功能。
需要说明的是，本发明所示的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本发明中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本发明中，计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：无线、电线、光缆、RF等等，或者上述的任意合适的组合。
附图中的流程图和框图，图示了按照本发明各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，上述模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发 生。例如，两个接连地表示的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图或流程图中的每个方框、以及框图或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本发明实施例中所涉及到的模块可以通过软件的方式实现，也可以通过硬件的方式来实现。所描述的模块也可以设置在处理器中，例如，可以描述为：一种处理器包括信息获取模块、模型建立模块、三维叠加模块。其中，这些模块的名称在某种情况下并不构成对该模块本身的限定，例如三维叠加模块还可以被描述为“将三维模型信息和三维重建信息叠加的模块”。
作为另一方面，本发明还提供了一种计算机可读介质，该计算机可读介质可以是上述实施例中描述的设备中所包含的；也可以是单独存在，而未装配入该设备中。上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被一个该设备执行时，使得该设备包括：
响应于对物品列表中至少两个物品的选择操作，根据所述至少两个物品的标识，获取相应的物品信息；
基于各物品信息进行三维模型信息渲染，得到各物品的三维模型信息；
接收现实场景的图像信息，以构建所述现实场景的三维重建信息，将各物品的三维模型信息叠加在所述三维重建信息上进行展示比对。
根据本发明实施例的技术方案，用户在挑选物品时，除了基于物品基本信息了解物品外，还可以基于其三维模型信息进行直观比对，以给予用户直观感觉，提高了物品推荐效率，降低了物品退换频率，以此提升了用户购物体验。
上述具体实施方式，并不构成对本发明保护范围的限制。本领域技术人员应该明白的是，取决于设计要求和其他因素，可以发生各种各样的修改、组合、子组合和替代。任何在本发明的精神和原则之内所作的修改、等同替换和改进等，均应包含在本发明保护范围之内。

Claims (8)

  1. 一种物品比对方法，包括：
    响应于对物品列表中至少两个物品的选择操作，根据所述至少两个物品的标识，获取相应的物品信息；
    基于各物品信息进行三维模型信息渲染，得到各物品的三维模型信息；以及
    接收现实场景的图像信息，以构建所述现实场景的三维重建信息，将各物品的三维模型信息叠加在所述三维重建信息上进行展示比对。
  2. 根据权利要求1所述的方法，其中，所述物品信息包括三维资源和信息摘要值；
    所述基于各物品信息进行三维模型信息渲染，还包括：
    利用信息摘要算法，对各物品的三维资源进行处理，得到第一信息摘要值；以及
    若信息摘要值与相应第一信息摘要值相同，则基于各三维资源进行三维模型信息渲染。
  3. 根据权利要求2所述的方法，其中，所述物品信息还包括三维资源下载地址；
    在所述得到第一信息摘要值之后，还包括：
    若信息摘要值与相应第一信息摘要值不同，则基于物品信息中的三维资源下载地址进行三维资源下载；
    利用所述信息摘要算法，对下载的三维资源进行处理，得到第二信息摘要值；以及
    若信息摘要值与相应第二信息摘要值相同，则利用下载的三维资源进行三维模型信息渲染。
  4. 根据权利要求1所述的方法，其中，所述构建所述现实场景的 三维重建信息，包括：
    利用三维视界坐标系方式，确定所述图像信息中各像素点的三维坐标值，以基于所述三维坐标值进行所述三维重建信息构建。
  5. 根据权利要求1-4中任一项所述的方法，其中，所述将各物品的三维模型信息叠加在所述三维重建信息上进行展示比对，包括：
    在所述三维重建信息中，按照预定的相对空间位置关系确定各三维模型信息的存放位置，以将各三维模型信息与相应存放位置的三维重建信息进行叠加展示。
  6. 一种物品比对装置，包括：
    信息获取模块，用于响应于对物品列表中至少两个物品的选择操作，根据所述至少两个物品的标识，获取相应的物品信息；
    模型建立模块，用于基于各物品信息进行三维模型信息渲染，得到各物品的三维模型信息；以及
    三维叠加模块，用于接收现实场景的图像信息，以构建所述现实场景的三维重建信息，将各物品的三维模型信息叠加在所述三维重建信息上进行展示比对。
  7. 一种电子设备，包括：
    一个或多个处理器；
    存储装置，用于存储一个或多个程序，
    当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如权利要求1-5中任一所述的方法。
  8. 一种计算机可读介质，其上存储有计算机程序，所述程序被处理器执行时实现如权利要求1-5中任一所述的方法。
PCT/CN2020/110000 2019-11-18 2020-08-19 一种物品比对方法和装置 WO2021098306A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP20889388.3A EP4030373A4 (en) 2019-11-18 2020-08-19 OBJECT COMPARISON METHOD AND APPARATUS
US17/777,414 US20220405823A1 (en) 2019-11-18 2020-08-19 Object comparison method, and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911130833.9 2019-11-18
CN201911130833.9A CN112819559A (zh) 2019-11-18 2019-11-18 一种物品比对方法和装置

Publications (1)

Publication Number Publication Date
WO2021098306A1 true WO2021098306A1 (zh) 2021-05-27

Family

ID=75852902

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/110000 WO2021098306A1 (zh) 2019-11-18 2020-08-19 一种物品比对方法和装置

Country Status (4)

Country Link
US (1) US20220405823A1 (zh)
EP (1) EP4030373A4 (zh)
CN (1) CN112819559A (zh)
WO (1) WO2021098306A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114972660A (zh) * 2022-08-01 2022-08-30 山东星绘时空智能科技有限公司 一种基于倾斜摄影的实景三维图核实分析系统

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116894933B (zh) * 2023-09-08 2024-01-26 先临三维科技股份有限公司 一种三维模型比较方法、装置、设备和存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080041079A (ko) * 2006-11-06 2008-05-09 신형민 온라인 쇼핑몰에서 자신을 꾸미는 방법, 코디미
CN105183154A (zh) * 2015-08-28 2015-12-23 上海永为科技有限公司 一种虚拟对象和实景影像的互动展示方法
CN108492356A (zh) * 2017-02-13 2018-09-04 苏州宝时得电动工具有限公司 增强现实系统及其控制方法
CN108510368A (zh) * 2018-03-30 2018-09-07 联想(北京)有限公司 一种用于现实场景获取对象信息的方法及装置
CN109410314A (zh) * 2018-04-28 2019-03-01 武汉思普崚技术有限公司 基于三维空间的拓扑结构动态渲染的方法及装置
CN110232743A (zh) * 2019-06-11 2019-09-13 珠海格力电器股份有限公司 一种通过增强现实技术展示物品的方法和装置
CN110458648A (zh) * 2019-07-09 2019-11-15 北京三快在线科技有限公司 对象展示方法、装置、电子设备及可读存储介质

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140063061A1 (en) * 2011-08-26 2014-03-06 Reincloud Corporation Determining a position of an item in a virtual augmented space
US20140178029A1 (en) * 2012-12-26 2014-06-26 Ali Fazal Raheman Novel Augmented Reality Kiosks
US10140651B1 (en) * 2014-10-14 2018-11-27 Amazon Technologies, Inc. Displaying item information relative to selection regions of an item image
CN107767211A (zh) * 2017-09-26 2018-03-06 北京小米移动软件有限公司 基于增强现实的产品对比方法、装置及存储介质
CN107622524A (zh) * 2017-09-29 2018-01-23 百度在线网络技术（北京）有限公司 用于移动终端的显示方法和显示装置
US11082535B2 (en) * 2018-12-20 2021-08-03 Here Global B.V. Location enabled augmented reality (AR) system and method for interoperability of AR applications
CN109903129A (zh) * 2019-02-18 2019-06-18 北京三快在线科技有限公司 增强现实显示方法与装置、电子设备、存储介质
CN109634925B (zh) * 2019-02-20 2024-06-14 平安科技（深圳）有限公司 资源文件下载方法、装置、计算机设备和存储介质

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080041079A (ko) * 2006-11-06 2008-05-09 신형민 온라인 쇼핑몰에서 자신을 꾸미는 방법, 코디미
CN105183154A (zh) * 2015-08-28 2015-12-23 上海永为科技有限公司 一种虚拟对象和实景影像的互动展示方法
CN108492356A (zh) * 2017-02-13 2018-09-04 苏州宝时得电动工具有限公司 增强现实系统及其控制方法
CN108510368A (zh) * 2018-03-30 2018-09-07 联想(北京)有限公司 一种用于现实场景获取对象信息的方法及装置
CN109410314A (zh) * 2018-04-28 2019-03-01 武汉思普崚技术有限公司 基于三维空间的拓扑结构动态渲染的方法及装置
CN110232743A (zh) * 2019-06-11 2019-09-13 珠海格力电器股份有限公司 一种通过增强现实技术展示物品的方法和装置
CN110458648A (zh) * 2019-07-09 2019-11-15 北京三快在线科技有限公司 对象展示方法、装置、电子设备及可读存储介质

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114972660A (zh) * 2022-08-01 2022-08-30 山东星绘时空智能科技有限公司 一种基于倾斜摄影的实景三维图核实分析系统
CN114972660B (zh) * 2022-08-01 2022-10-25 山东星绘时空智能科技有限公司 一种基于倾斜摄影的实景三维图核实分析系统

Also Published As

Publication number Publication date
EP4030373A4 (en) 2023-09-13
CN112819559A (zh) 2021-05-18
US20220405823A1 (en) 2022-12-22
EP4030373A1 (en) 2022-07-20

Similar Documents

Publication Publication Date Title
US10719571B2 (en) Virtualized rendering
US9953350B2 (en) Augmented reality view of product instructions
US8935328B2 (en) System and method for collaborative 3D visualization and real-time interaction on a computer network
US10795529B2 (en) Permitting participant configurable view selection within a screen sharing session
US8984153B2 (en) Cloud-based device interaction
WO2021008166A1 (zh) 用于虚拟试衣的方法和装置
US20160191627A1 (en) Method and apparatus for execution of applications in a cloud system
WO2020207085A1 (zh) 信息分享方法、装置、电子设备及存储介质
JP2014525092A (ja) サードパーティのコンテンツをオンライン文書署名に関連付けるための方法
WO2019114328A1 (zh) 一种基于增强现实的视频处理方法及其装置
US11843674B2 (en) Virtual workspace experience visualization and optimization
WO2021098306A1 (zh) 一种物品比对方法和装置
US10846779B2 (en) Custom product categorization of digital media content
US20230385363A1 (en) Web site preview generation based on web site type
WO2022052563A1 (zh) 一种服务构建方法、相关装置及计算机可读存储介质
US11960817B2 (en) Web site preview based on client presentation state
AU2021330320B2 (en) Transactions over live media
CN103164217B (zh) 用于后端系统的独立数据实体
WO2023142601A1 (zh) 一种基于区块链的数据处理方法、设备以及可读存储介质
US20240231889A1 (en) Information processing device, information processing system, information processing method, and storage medium
CN110620805B (zh) 用于生成信息的方法和装置
JP5066128B2 (ja) コンテンツ提示装置、コンテンツ提示方法及びプログラム
CN114816082A (zh) 应用于云应用的输入控制方法、装置以及电子设备
CN116229585A (zh) 一种图像活体检测方法、装置、存储介质及电子设备
CN111598639A (zh) 用于生成图像的方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20889388

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020889388

Country of ref document: EP

Effective date: 20220412

NENP Non-entry into the national phase

Ref country code: DE