WO2024051063A1 - 信息展示方法、装置及电子设备 - Google Patents

信息展示方法、装置及电子设备 Download PDF

Info

Publication number
WO2024051063A1
WO2024051063A1 PCT/CN2023/071970 CN2023071970W WO2024051063A1 WO 2024051063 A1 WO2024051063 A1 WO 2024051063A1 CN 2023071970 W CN2023071970 W CN 2023071970W WO 2024051063 A1 WO2024051063 A1 WO 2024051063A1
Authority
WO
WIPO (PCT)
Prior art keywords
wrist
model
dimensional
display
dimensional model
Prior art date
Application number
PCT/CN2023/071970
Other languages
English (en)
French (fr)
Inventor
郭震
Original Assignee
阿里巴巴（中国）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴（中国）有限公司 filed Critical 阿里巴巴（中国）有限公司
Publication of WO2024051063A1 publication Critical patent/WO2024051063A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Shopping interfaces
    • G06Q30/0643—Graphical representation of items or shoppers

Definitions

  • This application relates to the field of augmented reality technology, and in particular to information display methods, devices and electronic equipment.
  • This application provides information display methods, devices and electronic equipment, which can provide users with an experience closer to that of actually trying on physical products offline, thereby helping users make shopping decisions.
  • An information display method including:
  • the target object is a wrist-worn object, which includes a dial part and a watch strap part.
  • the three-dimensional model includes a first model modeled according to the size of the dial part, and a model of the watch strap part.
  • the second model obtained by modeling;
  • the first model is mapped according to the size, and the tightness of the second model is adjusted to Fits the wrist circumference of said wrist.
  • the degree of fit between the second model and the wrist is simulated.
  • simulating the degree of fit between the second model and the wrist according to the material information of the strap part includes:
  • the second model can be closely fitted to the wrist.
  • simulating the degree of fit between the second model and the wrist according to the material information of the strap part includes:
  • the watch strap part is made of metal, a gap is left between the second model and the wrist, and a physical drape effect is produced under the action of its own gravity.
  • the reflective effect of the dial part and/or the rear strap part is provided in the AR space.
  • the three-dimensional model is moved following the change in the posture of the wrist.
  • the three-dimensional model also includes a third model obtained by modeling the hand part
  • the method also includes:
  • the third model is matched to the corresponding position of the second model for display, and an animation effect of the third model rotating with real time is provided.
  • the method further includes:
  • the current time information is displayed on the electronic display screen, and an animation effect is provided in which the time displayed on the electronic display screen changes with real time.
  • the method further includes:
  • the information content triggered by the click or slide operation is displayed on the touch screen in the AR space.
  • the three-dimensional model has a binding relationship with the three-dimensional wrist model of the standard posture.
  • the three-dimensional model is worn on the three-dimensional wrist model of the standard posture.
  • the three-dimensional wrist model of the standard posture is The wrist model is invisible;
  • the pose of the wrist identified from the real environment image stream includes: the rotation matrix and/or translation vector of the pose of the real wrist relative to the standard pose;
  • Mapping the three-dimensional model into the AR space according to the posture of the wrist includes:
  • the pose of the three-dimensional model of the watch-like object when projected into the AR space is determined.
  • the object list area is used to display at least one other similar object related to the target object and its corresponding AR display entrance;
  • the three-dimensional model displayed in the AR space is replaced with the three-dimensional model corresponding to the other similar objects.
  • An object display device including:
  • a request response unit configured to respond to a request to display a target object through augmented reality AR, load a three-dimensional model of the target object, and identify the pose of the wrist and the wrist from the collected real environment image stream.
  • wrist circumference the target object is a wrist-worn object
  • the wrist-worn object includes a dial part and a watch strap part, wherein the three-dimensional model includes a first model modeled according to the size of the dial part , and the second model obtained by modeling the strap part;
  • An AR display unit is configured to map the first model according to the size in the process of mapping the three-dimensional model into the AR space according to the pose of the wrist, and map the second model to The tightness is adjusted to fit the wrist circumference.
  • An electronic device including:
  • a memory associated with the one or more processors the memory being used to store program instructions that, when read and executed by the one or more processors, perform any of the foregoing methods.
  • independent three-dimensional modeling of the dial part and the watch strap part can be performed in advance to obtain the first model and the second model.
  • the first model can be mapped according to the actual size of the dial part, and all the The tightness of the second model is adjusted to fit the wrist circumference of the wrist.
  • the strap part can be adapted to the thickness of the wrist while ensuring that the display size of the dial part is not affected, thereby allowing users to try on wrist-worn product objects through AR. In this way, the experience is closer to that of actually trying on the actual product offline. In the product display scenario, it is more conducive to helping users make shopping decisions.
  • Figure 1 is a schematic diagram of the system architecture provided by the embodiment of the present application.
  • Figure 2 is a flow chart of the method provided by the embodiment of the present application.
  • FIG. 3 is a schematic diagram of the interface provided by the embodiment of the present application.
  • Figure 4 is a schematic diagram of a device provided by an embodiment of the present application.
  • Figure 5 is a schematic diagram of an electronic device provided by an embodiment of the present application.
  • the three-dimensional reconstruction of the product is performed in advance.
  • the real-time image stream in the real world can be collected through the camera of the terminal device, and the "table", "floor” and other planes in the image stream can be reconstructed.
  • Positioning projects the three-dimensional model of the product onto the location of such a plane in the real-world image stream, thereby showing the state of the product when it is actually "placed” in the real-world environment.
  • the above-mentioned solution of displaying product information through AR technology can allow users to more intuitively judge whether specific products are suitable for their real-world environment. For example, whether sofa-like household products are suitable for placement in their living room. And so on, thereby helping users make better shopping decisions.
  • the three-dimensional model of the product can usually only be placed in the AR space relatively mechanically.
  • the viewing angle can be changed by sliding the screen or rotating the phone to achieve a 360-degree view of the appearance of the product, and for products such as sofas and coffee tables, this level is basically enough to help users complete shopping Decision-making, however, for some other categories of goods, this simple mechanical AR placement is usually not enough.
  • the embodiments of this application mainly use watch products as an example
  • the user may What you want to see is the effect of "wearing" the 3D watch model on your wrist. Therefore, simply placing the 3D watch model on a certain plane in the AR space obviously cannot meet the user's needs.
  • the inventor of the present application discovered during the process of implementing the present application that although the user can place the wrist in front of the camera and identify the wrist from the image stream collected from the real environment, the three-dimensional model of the watch can be mapped to Display at the position of the wrist in the AR space to simulate the effect of wearing the watch on the wrist.
  • the display effect is usually Hard to secure.
  • One of the reasons is that when users wear the watch, they need to adjust the tightness of the watch strap according to the thickness of their wrist to make it fit their wrist.
  • the tightness can be adjusted by scaling the 3D model as a whole.
  • this overall scaling will cause the dial size to also scale, and ultimately The effect is: assuming that different people place their wrists at the same distance from the camera, but because the thickness of their wrists are different, the three-dimensional model of the same watch displays different dial sizes in the corresponding AR space. .
  • the dial displayed in the AR space will be relatively large. If the wrist of the person currently experiencing the experience is relatively thin, the dial displayed in the AR space will be relatively small. Obviously, this It will reduce the authenticity of the information.
  • the dial and the strap are independently modeled. That is to say, for a watch, its three-dimensional model can include at least two parts, one according to the dial.
  • the first model is obtained by modeling the actual size of the part
  • the second model is obtained by modeling the strap part.
  • the first model corresponding to the dial part can be mapped according to the actual size, that is, it does not need to be adapted to the thickness of the wrist;
  • the second model corresponding to the strap part is The tightness can be adjusted by zooming and other methods to adapt to the thickness of the wrist.
  • the strap part can be adapted to the wrist while avoiding the real impact on the display size of the dial part.
  • the hand part in addition to modeling the dial and strap parts separately, for some watches with hands, the hand part can also be modeled independently, that is, a third model corresponding to the hand part can also be included.
  • the third model of the hand part can be matched to the second model of the dial part according to the current time information to display the current time, and can also simulate Animation of watch hands moving over time.
  • the current time information can be displayed on the electronic display screen, and the specific displayed information can also change with the passage of real time.
  • the solution provided by the embodiment of this application may involve the client and the server in the product information service system.
  • the server is mainly used to provide a specific three-dimensional model of the product.
  • the three-dimensional model of the specific product can be generated by three-dimensional reconstruction according to the real size of the product.
  • the dial part and the strap part of the product can be independently modeled to generate the first model and the second model.
  • the client is mainly used to support AR display.
  • a high-performance AR rendering engine can be used to support the spliced rendering of the first model and the second model in the AR space, and to implement
  • the strap part can be adapted to the size of the wrist, and can also support the realization of a variety of dynamic effects, etc.
  • the embodiment of this application provides a product display method from the perspective of the aforementioned client. See Figure 2.
  • the method may specifically include:
  • S201 In response to a request to display the target object through the augmented reality AR method, load the three-dimensional model of the target object, and identify the pose of the wrist and the wrist circumference from the collected real environment image stream;
  • the target object is a wrist-worn object, and the wrist-worn object includes a dial part and a watch strap part, wherein the three-dimensional model includes a first model modeled according to the size of the dial part, and the watch strap part.
  • the second model obtained by modeling the belt part.
  • the specific target object can be a commodity, or it can also be other items, such as exhibits in a museum, etc.
  • the entrance to display products through AR can be provided through the product details page and other pages.
  • the above-mentioned access entrance can be provided in the main image display area of the product details page, etc.
  • the user can initiate a request for product display through AR through the access portal.
  • the above request can also be initiated in other ways.
  • products configured with three-dimensional models can also be aggregated into the same theme page, and an entrance to display each product through AR can be provided in the theme page, so that , users can directly initiate a request for AR display of one of the target products through the theme page, etc.
  • the specific interaction method during the AR display process is mainly introduced using commodities as an example.
  • an AR space After receiving a specific AR display request, an AR space can be created, a three-dimensional model of the target product can be loaded, and then the three-dimensional model can be rendered into the AR space for display.
  • the client detects the wrist image in the collected real environment image stream. After detecting the wrist image, it can also determine the pose (that is, the position and attitude) of the wrist. In addition, it can also The wrist circumference of the wrist is identified.
  • real-time three-dimensional reconstruction of the wrist can be performed based on the wrist image recognized in the real-world image stream to obtain the coordinates of multiple three-dimensional wrist key points. Then the posture and wrist circumference of the wrist can be determined based on the coordinates of these key points.
  • the recognition of real wrist images in real environment images can be realized through existing algorithm models.
  • the deep learning algorithm model that has been trained in advance can be used to identify the real wrist image.
  • Three-dimensional Mesh (grid) reconstruction of real wrist images are not key contents in the embodiments of this application, and therefore will not be described in detail here.
  • S202 In the process of mapping the three-dimensional model into the AR space according to the posture of the wrist, map the first model according to the size, and adjust the tightness of the second model. , to fit the wrist circumference of the wrist.
  • the three-dimensional model can be mapped to the AR space according to the posture of the wrist.
  • the first model can be mapped to the AR space according to the actual size.
  • the tightness of the second model can be adjusted according to the wrist circumference and then mapped to the AR space, so that the tightness of the strap fits the wrist circumference. match. This can make the effect displayed in the AR space closer to the effect of actually wearing a specific watch. That is to say, in the embodiment of the present application, the dial and the strap part can be modeled independently.
  • the two models are combined together, and the second model corresponding to the strap can be adapted to the wrist.
  • the first model corresponding to the dial part will not be affected by the thickness of the wrist and can be displayed according to the actual size. In this way, users can gain the experience of actually trying on a specific watch in the real world through the AR space.
  • the specific display effect can be shown in Figure 3(B).
  • different watch straps may have different materials, for example, some may be made of metal, and some may be made of leather. After straps of different materials are worn on the wrist, the specific fit to the wrist must be determined. Usually it's different. For example, metal watch straps usually leave a certain gap with the wrist and have a certain physical drape, while leather watch straps can fit the wrist more closely, etc.
  • information about the material type of the watch strap can also be saved in the three-dimensional model.
  • the second model and the second model can be compared according to the material information of the watch strap part. Simulate the fit of the wrist.
  • the strap part is made of leather, it can provide the effect of tight fitting between the second model and the wrist.
  • the watch strap part is made of metal, a gap is left between the second model and the wrist, and a physical drape effect is produced under the action of its own gravity.
  • the posture of the user's wrist may continue to change during the display process, including the user's active change for the purpose of changing the angle of view. posture, or it may be an inadvertent change in posture, etc.
  • the three-dimensional model can be moved following the change in the posture of the wrist. In other words, when the position or posture of the user's wrist changes, the three-dimensional model of the specific watch product can follow the change, showing the effect of the watch always being worn on the wrist.
  • the dial of a specific watch product has a hand part
  • the hand part when performing a three-dimensional modeling of the product, the hand part can be modeled separately to obtain a third model. That is to say, in this case, when generating a three-dimensional model of a specific watch product, the dial, strap, and watch hands can be modeled separately, and then combined to form a complete three-dimensional model when displayed. .
  • the current time information when displaying the third model of the watch hand part, the current time information can be obtained, and then, according to the current time information, the third model is matched to the corresponding position of the second model for display, and it can also be provided The animation effect of the third model rotating with real time.
  • the hands of the watch can point to the current time, and can also rotate so that the time pointed by the hands on the dial is consistent with the time in the real world.
  • the time keeps changing synchronously to improve the user experience.
  • the dial of the watch type product is equipped with an electronic display screen, since the specific time information is displayed on such an electronic display screen, the current time information can also be obtained during the display and the current time information can be obtained.
  • the time information is displayed on the electronic display screen, and at the same time, an animation effect in which the time displayed on the electronic display screen changes with real time can also be provided. That is to say, in the process of displaying the three-dimensional model of electronic watch products in the AR space, the current time information can also be displayed on the dial, and the time displayed on the dial can keep changing synchronously with the time in the real world.
  • different electronic watches may display different styles and layouts of time information on the display screen. During specific implementation, this display style, layout and other information can also be obtained, so that the displayed time information is consistent with the actual time information.
  • the display method of the actual product is the same.
  • the wrist-worn products described in the embodiments of this application may not only include traditional mechanical watches, electronic watches, etc., but may also include some smart watches, smart bracelets, etc.
  • the electronic display screen on the specific dial may be a touch screen.
  • the time and other information can be displayed.
  • you can switch the displayed content for example, you can display sports-related information, etc. Therefore, in this case, in the embodiment of the present application, the information content triggered by the click or sliding operation can be displayed through the touch screen in the AR space. That is to say, in this embodiment of the present application, users can not only view the wearing effect of specific watch products on their wrists, but also interact with specific three-dimensional models to view other functions of specific watches, and so on.
  • the state after the three-dimensional model is matched to the AR space is more accurate. Realistic and natural, it can reflect the effect of the 3D model being partially blocked by the wrist image. For example, assuming that the back of the user's hand is facing up, the first model corresponding to the dial can be matched to the side of the back of the wrist. At this time, only a part of the second model corresponding to the watch strap can be displayed and mapped to the second model on the side of the palm. Parts of the model can be obscured, etc.
  • a three-dimensional wrist model with a standard posture can be established in advance for the three-dimensional model of the target product.
  • the three-dimensional wrist model has a standard posture (the three-dimensional space corresponding to the three-dimensional model of the product can be alignment), and a standard wrist circumference, and the 3D model of a specific watch product can be worn on the standard 3D wrist model.
  • the relative positional relationship between the three-dimensional model of the watch product and the standard three-dimensional wrist model may be fixed, that is, when the standard three-dimensional wrist model moves, flips, etc., the three-dimensional model of the watch product The model will also move and flip accordingly.
  • the standard three-dimensional wrist model does not need to be displayed and can be invisible to the user.
  • the posture information of the wrist specifically identified from the real-world image stream in the AR space may include: the three-dimensional model of the real wrist relative to the standard three-dimensional wrist model. rotation matrix and/or translation vector.
  • the estimated rotation matrix and/or translation vector can be applied to the aforementioned standard three-dimensional wrist model, and then the rotation of the standard three-dimensional wrist model can be , translation situation, and determine the display posture of the three-dimensional model of the specific product.
  • the tightness of the watch strap can be adjusted according to the wrist circumference of the current user's wrist.
  • the depth of the wrist image in the AR space can also be estimated.
  • the size of the three-dimensional model of the watch product in the screen can be obtained more accurately. , not affected by the estimated wrist size. That is to say, in the process of AR displaying the three-dimensional model of a watch product through wrists with different wrist circumferences, if the depth of the wrist in the AR space is the same, the size of the displayed three-dimensional model of the product will be consistent. Improve the realism effect.
  • AR display entrances for other similar products related to the current product can also be provided in the interface of a specific AR space.
  • the current three-dimensional model displayed in the AR space can be replaced with the three-dimensional models corresponding to the other similar products.
  • watch products related to the product can be displayed in the AR space interface. list of.
  • other watch products here can be determined in a variety of ways. For example, they can be other similar products in the same store as the currently displayed product, or they can be recommended across stores, for example, they can be other stores. Watch products of the same price range as the currently displayed product, etc.
  • the specific recommended products need to be associated with a three-dimensional model. That is, only products with pre-established three-dimensional models will enter this kind of recommendation through AR space. range.
  • independent three-dimensional modeling of the dial part and the watch strap part can be performed in advance to obtain the first model and the second model.
  • the first model can be mapped according to the actual size of the dial part, and all the The tightness of the second model is adjusted to fit the wrist circumference of the wrist.
  • the strap part can be adapted to the thickness of the wrist while ensuring that the display size of the dial part is not affected, thereby allowing users to try on wrist-worn product objects through AR. In this way, the experience is closer to that of actually trying on the actual product offline. In the product display scenario, it is more conducive to helping users make shopping decisions.
  • embodiments of this application may involve the use of user data. In actual applications, this can be done in compliance with the applicable laws and regulations of the country where the user is located (for example, the user explicitly agrees, the user is effectively notified, etc.), use user-specific personal data in the scenarios described herein to the extent permitted by applicable laws and regulations.
  • inventions of the present application also provide an information display device. See Figure 4.
  • the device may include:
  • the request response unit 501 is configured to respond to a request to display a target object through augmented reality AR mode, load a three-dimensional model of the target object, and identify the posture of the wrist from the collected real environment image stream, and the wrist posture.
  • the target object is a wrist-worn object, and the wrist-worn object includes a dial part and a watch strap part, where the three-dimensional model includes a third model modeled according to the actual size of the dial part.
  • AR display unit configured to map the first model according to the actual size in the process of mapping the three-dimensional model into the AR space according to the pose of the wrist, and map the second model Adjust the tightness to fit the wrist circumference.
  • the device may also include:
  • a fit simulation unit is used to simulate the fit degree between the second model and the wrist according to the material information of the watch strap part.
  • the fit simulation unit can be used for:
  • the second model can be closely fitted to the wrist.
  • the watch strap part is made of metal, a gap is left between the second model and the wrist, and a physical drape effect is produced under the action of its own gravity.
  • the device may include:
  • An ambient light information acquisition unit is used to acquire ambient light information of the real environment
  • a reflective effect display unit configured to provide the reflective effect of the dial part and/or the rear strap part in the AR space according to the ambient light information.
  • the device may include:
  • a following motion unit is configured to move the three-dimensional model following the change in the wrist posture when a change in the wrist posture is detected.
  • the three-dimensional model also includes a third model obtained by modeling the hand part
  • the device may also include:
  • the current time acquisition unit is used to obtain current time information
  • a watch hand model matching unit is used to match the third model to the corresponding position of the second model for display according to the current time information, and provide an animation effect of the third model rotating with real time. .
  • the device may also include:
  • the current time acquisition unit is used to obtain current time information
  • a time display unit is used to display the current time information on the electronic display screen, and provide an animation effect in which the time displayed on the electronic display screen changes with real time.
  • the device may also include:
  • a display content switching unit configured to display content triggered by the click or slide operation on the touch screen in the AR space in response to a click or slide operation performed by the user on the touch screen. information.
  • the three-dimensional model may have a binding relationship with a three-dimensional wrist model in a standard posture.
  • the three-dimensional model In a default state, the three-dimensional model is worn on the three-dimensional wrist model in a standard posture.
  • the three-dimensional wrist model of the pose is invisible; at this time, the pose of the wrist recognized from the real environment image stream may include: the rotation matrix of the pose of the real wrist relative to the standard pose and /or translation vector;
  • the AR display unit can be used for:
  • the pose of the three-dimensional model of the watch-like object when projected into the AR space is determined.
  • the device may include:
  • An object list display unit configured to provide an AR display entrance for other similar objects related to the target object in the interface of the AR space
  • a model replacement display unit is configured to replace the three-dimensional model displayed in the AR space with the three-dimensional model corresponding to the other similar object after receiving an AR display request for the other similar objects through the AR display portal.
  • embodiments of the present application also provide a computer-readable storage medium on which a computer program is stored.
  • the program is executed by a processor, the steps of the method described in any one of the foregoing method embodiments are implemented.
  • an electronic device including:
  • a memory associated with the one or more processors is used to store program instructions.
  • the program instructions execute any one of the foregoing method embodiments. steps of the method.
  • Figure 5 exemplarily shows the architecture of an electronic device.
  • the device 500 can be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, or a personal digital assistant. , aircraft, etc.
  • device 500 may include one or more of the following components: processing component 502, memory 504, power supply component 506, multimedia component 508, audio component 510, input/output (I/O) interface 512, sensor component 514, and communications component 516.
  • Processing component 502 generally controls the overall operations of device 500, such as operations associated with display, phone calls, data communications, camera operations, and recording operations.
  • the processing element 502 may include one or more processors 520 to execute instructions to complete all or part of the steps of the method provided by the technical solution of the present disclosure.
  • processing component 502 may include one or more modules that facilitate interaction between processing component 502 and other components.
  • processing component 502 may include a multimedia module to facilitate interaction between multimedia component 508 and processing component 502.
  • Memory 504 is configured to store various types of data to support operations at device 500 . Examples of such data include instructions for any application or method operating on device 500, contact data, phonebook data, messages, pictures, videos, etc.
  • Memory 504 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EEPROM), Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EEPROM erasable programmable read-only memory
  • EPROM Programmable read-only memory
  • PROM programmable read-only memory
  • ROM read-only memory
  • magnetic memory flash memory, magnetic or optical disk.
  • Power supply component 506 provides power to the various components of device 500 .
  • Power supply components 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 500 .
  • Multimedia component 508 includes a screen that provides an output interface between device 500 and the user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. A touch sensor can not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action.
  • multimedia component 508 includes a front-facing camera and/or a rear-facing camera.
  • the front camera and/or the rear camera may receive external multimedia data.
  • Each front-facing camera and rear-facing camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.
  • Audio component 510 is configured to output and/or input audio signals.
  • audio component 510 includes a microphone (MIC) configured to receive external audio signals when device 500 is in operating modes, such as call mode, recording mode, and speech recognition mode. The received audio signals may be further stored in memory 504 or sent via communications component 516 .
  • audio component 510 also includes a speaker for outputting audio signals.
  • the I/O interface 512 provides an interface between the processing component 502 and a peripheral interface module, which may be a keyboard, a click wheel, a button, etc. These buttons may include, but are not limited to: Home button, Volume buttons, Start button, and Lock button.
  • Sensor component 514 includes one or more sensors that provide various aspects of status assessment for device 500 .
  • the sensor component 514 can detect the open/closed state of the device 500, the relative positioning of components, such as the display and keypad of the device 500, and the sensor component 514 can also detect a change in position of the device 500 or a component of the device 500. , the presence or absence of user contact with device 500 , device 500 orientation or acceleration/deceleration and temperature changes of device 500 .
  • Sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
  • Sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor component 514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • Communication component 516 is configured to facilitate wired or wireless communications between device 500 and other devices.
  • the device 500 can access a wireless network based on communication standards, such as WiFi, or a mobile communication network such as 2G, 3G, 4G/LTE, 5G, etc.
  • the communication component 516 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communications component 516 also includes a near field communications (NFC) module to facilitate short-range communications.
  • NFC near field communications
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • device 500 may be configured by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable Gate array (FPGA), controller, microcontroller, microprocessor or other electronic components are implemented for executing the above method.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable Gate array
  • controller microcontroller, microprocessor or other electronic components are implemented for executing the above method.
  • a non-transitory computer-readable storage medium including instructions such as a memory 504 including instructions.
  • the above instructions can be executed by the processor 520 of the device 500 to complete the method provided by the technical solution of the present disclosure.
  • the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
  • the present application can be implemented by means of software plus the necessary general hardware platform. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or that contributes to the existing technology.
  • the computer software product can be stored in a storage medium, such as ROM/RAM, disk , optical disk, etc., including a number of instructions to cause a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or certain parts of the embodiments of this application.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本申请实施例公开了信息展示方法、装置及电子设备，包括：响应于通过增强现实AR方式对目标对象进行展示的请求，加载所述目标对象的三维模型，并从采集到的现实环境图像流中识别腕部的位姿，以及腕部的腕围；所述目标对象为腕部佩戴类对象，其中，所述三维模型包括按照表盘部分的尺寸进行建模得到的第一模型，以及对表带部分进行建模得到的第二模型；在根据所述腕部的位姿将所述三维模型映射到AR空间中的过程中，按照所述尺寸对所述第一模型进行映射，并对所述第二模型的松紧程度进行调整，以适配所述腕部的腕围。通过本申请实施例，可以为用户提供更接近于在线下对商品实物对象进行实际试戴时的体验，帮助用户进行购物决策。

Description

信息展示方法、装置及电子设备
本申请要求于2022年09月09日提交中国专利局、申请号为202211103094.6、申请名称为“信息展示方法、装置及电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及增强现实技术领域，特别是涉及信息展示方法、装置及电子设备。
 背景技术
在商品信息服务系统中，图文、视频、直播等都是用于对商品进行描述的常见方式，用户可以通过这种描述信息获得关于商品的特征信息，进而帮助用户进行购买决策。近年来还出现了通过三维模型对商品信息进行展示的方案，也即，通过对商品进行三维重建，可以在商品信息服务系统的客户端为用户呈现出关于商品的三维动态效果，并且可以实现用户和商品的互动，例如，用户可以通过滑动屏幕等方式触发商品转动，从而从多种不同视角观看到商品的外观，等等。
但是，即使通过三维模型对商品进行展示，用户能够获得的信息仍然是比较有限的。因此，如何进一步为用户提供关于具体商品的更详细的信息，并使得用户获得更接近于在线下购买商品时的体验，成为需要本领域技术人员解决的技术问题。
发明内容
本申请提供了信息展示方法、装置及电子设备，可以为用户提供更接近于在线下对商品实物进行实际试戴时的体验，进而帮助用户进行购物决策。
本申请提供了如下方案：
一种信息展示方法，包括：
响应于通过增强现实AR方式对目标对象进行展示的请求，加载所述目标对象的三维模型，并从采集到的现实环境图像流中识别腕部的位姿，以及腕部的腕围；所述目标对象为腕部佩戴类对象，所述腕部佩戴类对象包括表盘部分以及表带部分，其中，所述三维模型包括按照表盘部分的尺寸进行建模得到的第一模型，以及对表带部分进行建模得到的第二模型；
在根据所述腕部的位姿将所述三维模型映射到AR空间中的过程中，按照所述尺寸对所述第一模型进行映射，并对所述第二模型的松紧程度进行调整，以适配所述腕部的腕围。
其中，还包括：
根据所述表带部分的材质信息，对所述第二模型与所述腕部的贴合程度进行模拟。
其中，所述根据所述表带部分的材质信息，对所述第二模型与所述腕部的贴合程度进行模拟，包括：
如果所述表带部分为皮类材质，则提供所述第二模型与所述腕部的紧密贴合的效果。
其中，所述根据所述表带部分的材质信息，对所述第二模型与所述腕部的贴合程度进行模拟，包括：
如果所述表带部分为金属材质，则提供所述第二模型与所述腕部之间留有缝隙，并在自身重力作用下产生的物理垂感效果。
其中，还包括：
获取所述现实环境的环境光信息；
根据所述环境光信息，在所述AR空间中提供所述表盘部分和/后表带部分的反光效果。
其中，还包括：
在检测到所述腕部的位姿发生变化时，将所述三维模型跟随所述腕部位姿的变化而运动。
其中，如果所述目标对象的表盘带有表针部件，则所述三维模型还包括通过对表针部分进行建模得到的第三模型；
所述方法还包括：
获取当前时间信息；
按照所述当前时间信息，将所述第三模型匹配到所述第二模型的对应位置处进行展示，并提供所述第三模型随着现实时间而转动的动画效果。
其中，如果所述目标对象的表盘部分带有电子显示屏，则所述方法还包括：
获取当前时间信息；
将所述当前时间信息展示在所述电子显示屏上，并提供所述电子显示屏上显示的时间随着现实时间而变化的动画效果。
其中，如果所述电子显示屏为触摸屏，则所述方法还包括：
响应于用户在所述AR空间中对所述触摸屏执行的点击或滑动操作，在所述AR空间中通过所述触摸屏展示出由所述点击或滑动操作所触发展示的信息内容。
其中，所述三维模型与标准位姿的三维腕部模型具有绑定关系，在默认状态下，所述三维模型佩戴在所述标准位姿的三维腕部模型上，所述标准位姿的三维腕部模型为不可见状态；
从所述现实环境图像流中识别出的腕部的位姿包括：真实腕部的位姿相对于所述标准位姿的旋转矩阵和/或平移向量；
所述根据所述腕部的位姿将所述三维模型映射到AR空间中，包括：
通过将所识别出的旋转矩阵和/或平移向量作用于与所述标准位姿的三维腕部模型，以确定手表类对象的三维模型投影到所述AR空间中时的位姿。
其中，还包括：
在所述AR空间的界面中提供对象列表区域，所述对象列表区域用于展示与所述目标对象相关的至少一个其他同类对象，及其对应的AR展示入口；
通过所述AR展示入口接收到对所述其他同类对象的AR展示请求后，将所述AR空间中展示的三维模型替换为所述其他同类对象对应的三维模型。
一种对象展示装置，包括：
请求响应单元，用于响应于通过增强现实AR方式对目标对象进行展示的请求，加载所述目标对象的三维模型，并从采集到的现实环境图像流中识别腕部的位姿，以及腕部的腕围；所述目标对象为腕部佩戴类对象，所述腕部佩戴类对象包括表盘部分以及表带部分，其中，所述三维模型包括按照表盘部分的尺寸进行建模得到的第一模型，以及对表带部分进行建模得到的第二模型；
AR展示单元，用于在根据所述腕部的位姿将所述三维模型映射到AR空间中的过程中，按照所述尺寸对所述第一模型进行映射，并对所述第二模型的松紧程度进行调整，以适配所述腕部的腕围。
一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现前述任一项所述的方法的步骤。
一种电子设备，包括：
一个或多个处理器；以及
与所述一个或多个处理器关联的存储器，所述存储器用于存储程序指令,所述程序指令在被所述一个或多个处理器读取执行时，执行前述任一项所述的方法的步骤。
根据本申请提供的具体实施例，本申请公开了以下技术效果：
通过本申请实施例，针对腕部佩戴类对象的AR展示，可以预先分别对表盘部分以及表带部分进行独立的三维建模，得到第一模型以及第二模型。这样，在根据从AR空间中识别出的腕部的位姿，将所述三维模型映射到AR空间中的过程中，可以按照表盘部分的实际尺寸对所述第一模型进行映射，并对所述第二模型的松紧程度进行调整，以适配所述腕部的腕围。也就是说，可以在实现表带部分与手腕的粗细相适配的同时，确保表盘部分的展示尺寸不受影响，从而可以使得用户在通过AR方式对腕部佩戴类商品对象进行试戴的过程中，获得更接近于在线下对商品实物进行实际试戴时的体验，在商品展示场景下，更有利于帮助用户进行购物决策。
当然，实施本申请的任一产品并不一定需要同时达到以上所述的所有优点。
 附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本申请实施例提供的系统架构的示意图；
图2是本申请实施例提供的方法的流程图；
图3是本申请实施例提供的界面的示意图；
图4是本申请实施例提供的装置的示意图；
图5是本申请实施例提供的电子设备的示意图。
 具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员所获得的所有其他实施例，都属于本申请保护的范围。
首先需要说明的是，为了提升商品等目标对象信息的真实感，一种方式是可以将商品的三维重建技术与AR(Augmented Reality，增强现实)技术相结合，用于对商品进行展示。在这种方案中，预先对商品进行三维重建，在客户端展示时，可以通过终端设备的摄像头采集现实世界中的实时图像流，并对图像流中的“桌子”、“地板”等平面进行定位，将商品的三维模型投影到现实世界图像流中这种平面所在的位置，从而呈现出该商品实际被“放置”在现实世界环境中时的状态。
上述通过AR技术进行商品信息进行展示的方案，可以使得用户可以更直观地判断具体的商品是否适合自己所处的真实世界环境，例如，沙发类的家居商品是否适合放置在自己家的客厅中，等等，进而帮助用户更好地进行购物决策。
但是，在现有技术中，在通过AR方式对商品信息进行展示时，通常只能比较机械地将商品的三维模型放置到AR空间中。虽然可以通过滑动屏幕或者旋转手机等方式来改变视角，以实现对商品外观的360度查看，并且，对于沙发、茶几等类目的商品而言，做到这种程度基本是足以帮助用户完成购物决策的，但是，对于一些其他类目的商品而言，这种简单机械的AR放置通常是不够的。
例如，对于手表、手环等类别的在手腕或者脚腕部佩戴的商品(可以称为腕部佩戴类商品，为便于描述，本申请实施例主要以手表类商品为例进行介绍)，用户可能希望看到的是将手表三维模型“佩戴”在自己的腕部上的效果，因此，简单的将手表三维模型放置在AR空间中某个平面上显然是无法满足用户需求的。另外，本申请发明人在实现本申请的过程中发现，虽然能够让用户将腕部放到镜头前，并从现实环境采集到的图像流中对腕部进行识别后，将手表三维模型映射到AR空间中该腕部所在的位置处展示，以此模拟出将手表佩戴在腕部上的效果，但是，如果只是将手表三维模型简单地匹配到腕部的位置处展示，则展示效果通常也难以得到保障。其中一方面原因在于，用户在佩戴手表的过程中，需要根据自己腕部的粗细情况，对手表表带的松紧程度进行调整，以使其适配自己的腕部。在将三维模型匹配到AR空间的过程中，可以通过将三维模型进行整体缩放的方式来实现对这种松紧程度的调整，但是，这种整体的缩放会使得表盘大小也随之一起缩放，最终的效果是：假设不同人将腕部放置在与镜头相同距离的位置，但是由于各自腕部的粗细不一样，导致同一款手表的三维模型在对应的AR空间中展示出的表盘大小是不同的。也即，如果当前体验的人腕部比较粗，则在AR空间中显示出的表盘比较大，如果当前体验的人腕部比较细，则在AR空间中显示出的表盘比较小，显然，这会降低信息的真实感。
基于上述情况，在本申请实施例中，采用了将表盘与表带分别独立建模的实现方式，也就是说，对于一款手表而言，其三维模型至少可以包括两部分，分别是按照表盘部分的实际尺寸进行建模得到的第一模型，以及对表带部分进行建模得到的第二模型。这样，在将三维模型映射到AR空间的过程中，表盘部分对应的第一模型可以按照实际尺寸进行映射，也即，不需要与腕部的粗细适配；表带部分对应的第二模型则可以通过缩放等方式，对松紧程度进行调整，以实现与腕部粗细的适配。这样，可以在实现表带部分与腕部适配的同时，避免表盘部分展示尺寸的真实感受到影响。
另外，除了可以将表盘与表带部分进行分开独立建模，对于一些有表针的手表，还可以单独对表针部分进行独立建模，也即，还可以包括与表针部分对应的第三模型。在将具体的模型匹配到AR空间中展示的过程中，可以根据当前时间信息，来将表针部分的第三模型匹配到表盘部分的第二模型上，以展示出当前的时间，还可以模拟出表针随时间运动的动画效果。对于具有电子显示屏的手表而言，则可以将当前时间信息展示在电子显示屏上，具体展示出的信息也可以随着现实时间的流逝而变化。
从系统架构角度而言，参见图1，本申请实施例提供的方案可以涉及到在商品信息服务系统中的客户端以及服务端。其中，服务端主要用于提供商品的具体三维模型，在本申请实施例中，具体商品的三维模型可以是按照商品的真实尺寸进行三维重建而生成的，为了提升展示过程中的真实感效果，具体可以将商品的表盘部分与表带部分分别进行独立建模，生成第一模型以及第二模型。客户端则主要用于实现AR展示方面的支持，为了提升展示效果的真实感，可以使用高性能的AR渲染引擎，以支持在AR空间中对第一模型与第二模型的拼接渲染，以及实现表带部分与腕部腕围大小的适配，还可以支持多种动效的实现，等等。
下面对本申请实施例提供的具体实现方案进行详细介绍。
首先，本申请实施例从前述客户端的角度，提供了一种商品展示方法，参见图2，该方法具体可以包括：
S201：响应于通过增强现实AR方式对目标对象进行展示的请求，加载所述目标对象的三维模型，并从采集到的现实环境图像流中识别腕部的位姿，以及腕部的腕围；所述目标对象为腕部佩戴类对象，所述腕部佩戴类对象包括表盘部分以及表带部分，其中，所述三维模型包括按照表盘部分的尺寸进行建模得到的第一模型，以及对表带部分进行建模得到的第二模型。
具体实现时，具体的目标对象可以是商品，或者，还可以是其他物品，例如，博物馆中的展品，等等。其中，在商品展示的场景下，可以通过商品详情页等页面提供通过AR方式对商品进行展示的入口，例如，具体可以在商品详情页的主图展示区域等，提供上述访问入口，等等。这样，用户在访问商品详情页的过程中，可以通过该访问入口发起通过AR方式进行商品展示的请求。当然，具体实现时，还可以通过其他方式发起上述请求，例如，还可以对配置了三维模型的商品聚合到同一主题页面中，在主题页面中提供通过AR方式对各个商品进行展示的入口，这样，用户可以直接通过该主题页面发起对其中某个目标商品以AR方式展示的请求，等等。在本申请实施例中，主要以商品为例对具体的AR展示过程中的交互方式进行介绍。
在接收到具体的AR展示请求后，可以创建AR空间，并加载目标商品的三维模型，然后将所述三维模型渲染到AR空间中进行展示。其中，具体在创建AR空间时，可以首先启动终端设备中的摄像头等组件，对现实世界进行图像采集，此时，还可以提示用户将腕部位伸到镜头前，例如，如图3(A)所示。这样，客户端在采集到的现实环境图像流中对腕部图像进行检测，在检测到腕部图像之后，还可以确定出腕部的位姿(也即，位置及姿态)，另外，还可以识别出腕部的腕围。
其中，具体在确定腕部的位姿以及腕围时，可以根据现实环境图像流中识别出的腕部图像，对腕部进行实时的三维重建，以获取到多个三维腕部关键点坐标，然后可以根据这些关键点坐标来确定腕部的位姿以及腕围。其中，关于现实环境图像中进行真实腕部图像识别，具体可以通过已有的算法模型来实现，另外，在识别出真实腕部图像之后，具体可以利用预先训练完成的深度学习算法模型对所述真实腕部图像进行三维Mesh(网格)重建。其中，关于上述用于进行腕部图像识别的算法模型，以及用于对腕部进行三维Mesh重建的算法模型，不属于本申请实施例中的重点内容，因此，这里不再详述。
S202：在根据所述腕部的位姿将所述三维模型映射到AR空间中的过程中，按照所述尺寸对所述第一模型进行映射，并对所述第二模型的松紧程度进行调整，以适配所述腕部的腕围。
[根据细则91更正 06.04.2023]
在确定出腕部的位姿以及腕围之后，可以根据所述腕部的位姿将所述三维模型映射到AR空间中，在此过程中，可以按照实际尺寸完成对第一模型向AR空间中的映射，而对于第二模型部分，则可以根据腕部的腕围对第二模型的松紧程度进行调整后再映射到AR空间中，以使得表带的松紧程度与腕部的腕围适配。这样可以使得AR空间中展示出的效果更接近于实际佩戴具体手表实物时的效果。也即，在本申请实施例中，可以对表盘与表带部分分别独立建模，在展示过程中，再将两个模型组合在一起，并且，表带对应的第二模型可以适配腕部的粗细，表盘部分对应的第一模型则不会受到腕部粗细的影响，按照实际尺寸进行展示即可，以此，使得用户通过AR空间获得在现实世界中实际试戴具体手表时的体验。例如，具体的展示效果可以如图3(B)所示。
其中，由于不同的表带可能会有不同的材质，例如，有的可能是金属材质，有的可能是皮类材质，不同材质的表带佩戴在腕部之后，具体与腕部的贴合度通常是不同的。例如，金属材质的表带通常会与腕部留有一定的缝隙，并且有一定的物理垂感，而皮类材质的表带则可以比较紧密的贴合在腕部，等等。
因此，为了进一步提升AR空间所展示信息的真实感，还可以在三维模型中保存关于表带材质类型的信息，这样，可以根据所述表带部分的材质信息，对所述第二模型与所述腕部的贴合程度进行模拟。其中，如果所述表带部分为皮类材质，可以提供所述第二模型与所述腕部的紧密贴合的效果。如果所述表带部分为金属材质，则可以提供所述第二模型与所述腕部之间留有缝隙，并在自身重力作用下产生的物理垂感效果。
为了进一步提升AR空间展示具体手表类商品三维模型过程中的真实感，为用户提供更接近于在现实世界中试戴手表类商品实物时的体验，还可以获取到现实环境的环境光信息，并根据所述环境光信息，在所述AR空间中提供所述表盘部分和/或表带部分的反光效果。其中，还可以在模型中保存具体表盘、表带的材质信息，根据具体材质的不同，具体的反光效果也可以不同。
另外，由于是将具体的三维模型匹配到腕部所在的位置进行展示，而在展示过程中，用户的腕部的位姿可能会不断发生变化，其中包括用户出于改变角度查看的目的主动改变的位姿，也可能是在不经意中产生的位姿变化，等等。具体实现时，还可以在在检测到所述腕部的位姿发生变化时，将所述三维模型跟随所述腕部位姿的变化而运动。也就是说，在用户腕部的位置或姿态发生变化的过程中，具体的手表类商品的三维模型都可以跟随该变化，展示出手表始终佩戴在腕部的效果。
再者，如果具体的手表类商品的表盘带有表针部件，则具体在对该商品进行三维建模时，还可以表针部分进行单独建模得到第三模型。也就是说，在这种情况下，具体在位手表类商品生成三维模型时，可以分别对表盘、表带以及表针部分进行单独建模，具体在展示时，再组合在一起形成完整的三维模型。其中，在展示表针部分的第三模型时，可以获取当前时间信息，然后，按照当前时间信息，将所述第三模型匹配到所述第二模型的对应位置处进行展示，并且，还可以提供所述第三模型随着现实时间而转动的动画效果。也就是说，通过这种方式，可以在将三维模型映射到AR空间中的腕部进行展示时，使得表针可以指向当前时间，并且，还可以转动，使得表盘中指针指向的时间与现实世界中的时间保持同步变化，以此提升用户的体验。
当然，如果所述手表类商品的表盘带有电子显示屏，则由于具体的时间信息是显示在这种电子显示屏上，因此，在展示时，也可以获取当前时间信息，并将所述当前时间信息展示在所述电子显示屏上，同时还可以提供所述电子显示屏上显示的时间随着现实时间而变化的动画效果。也即，在将电子手表类商品的三维模型展示到AR空间的过程中，也可以在表盘中展示出当前的时间信息，并且可以使得表盘中显示的时间与现实世界中的时间保持同步变化。当然，不同的电子手表中在显示屏展示时间信息的样式、排版方式等也可能不同，具体实现时，也可以获取到这种展示样式、排版方式等信息，从而使得展示出的时间信息与实际商品实物中的展示方式一致。
需要说明的是，本申请实施例中所述的腕部佩戴类商品，不仅可以包括传统的机械手表、电子手表等，还可以包括一些智能手表、智能手环等。对于这种智能手表、智能手环类的商品，具体表盘上的电子显示屏可能是触摸屏，在默认状态下，其中可以展示出时间等信息，在用户对触摸屏执行了的点击、滑动等操作后，可以对其中展示的内容进行切换，例如，可以展示出运动相关的信息，等等。因此，对于这种情况，在本申请实施例中，可以在所述AR空间中通过所述触摸屏展示出由所述点击或滑动操作所触发展示的信息内容。也就是说，在本申请实施例中，用户不仅可以查看具体手表类商品在自己腕部的佩戴效果，还可以与具体的三维模型进行交互，以查看具体手表的其他功能，等等。
另外需要说明的是，在具体实现时，为了在根据腕部的位姿来确定具体商品的三维模型在AR空间中的展示位姿的过程中，使得三维模型匹配到AR空间中之后的状态更真实、自然，可以体现出三维模型被腕部图像部分遮挡的效果。例如，假设用户手背朝上，则可以将表盘对应的第一模型匹配到腕部手背的一侧，此时，表带对应的第二模型可以仅展示出一部分，映射到手心一侧的第二模型的部分内容则可以处于被遮挡状态，等等。
为了达到上述目的，可以预先为目标商品的三维模型建立标准姿态的三维腕部模型，在默认状态下，该三维腕部模型具有标准的位姿(与商品三维模型建模时对应的三维空间可以进行对齐)，以及标准的腕围，并且，具体手表类商品的三维模型可以佩戴在该标准的三维腕部模型上。其中，手表类商品的三维模型与该标准的三维腕部模型之间相对位置关系可以是固定的，也即，当该标准的三维腕部模型发生移动、翻转等变化时，手表类商品的三维模型也会随之移动、翻转。当然，该标准的三维腕部模型并不需要展示出来，对于用户而言可以为不可见状态。
在上述存在标准的三维腕部模型的情况下，具体从AR空间的现实环境图像流中识别出的腕部的位姿信息可以包括：真实腕部的三维模型相对于所述标准三维腕部模型的旋转矩阵和/或平移向量。这样，具体在将三维模型展示到AR空间中时，可以将所估计出的旋转矩阵和/或平移向量作用于前述标准的三维腕部模型，然后，就可以根据标准的三维腕部模型的旋转、平移情况，确定出具体商品的三维模型的展示位姿。当然，在本申请实施例中，还可以在确定好具体商品的三维模型的展示位姿后，根据当前用户腕部的腕围对表带的松紧程度进行调整。
通过这种方式，可以更方便地体现出将手表类商品佩戴在腕部的状态下，腕部对商品造成的部分遮挡情况，同时还可以更好地保证商品随着腕部的运动而运动。另外，在上述对腕部进行位姿估计的过程中，还可以对腕部图像在AR空间中的深度进行估计，这样，可以更准确地得到手表类商品的三维模型在画面中应该呈现的尺寸，不受腕部腕围估计大小的影响。也即，在通过不同腕围的手腕对手表类商品的三维模型进行AR展示的过程中，如果腕部在AR空间中的深度相同，则呈现出的商品三维模型的尺寸是一致的，以此提升真实感效果。
另外，本申请实施例中，还可以在具体AR空间的界面中提供与当前商品相关的其他同类商品的AR展示入口。这样，通过这种AR展示入口接收到对其他同类商品的AR展示请求后，可以将所述AR空间中展示的当前三维模型替换为所述其他同类商品对应的三维模型。
例如，如图3(B)中的31处所示，在通过AR方式展示某款手表类商品的三维模型的过程中，可以在AR空间的界面中展示出与该商品相关的其他手表类商品的列表。其中，这里的其他手表类商品可以通过多种方式进行确定，例如，可以是与当前正在展示的商品所属同一店铺中的其他同类商品，或者，还可以跨店铺进行推荐，例如，可以是其他店铺中与当前正在展示的商品具有同等价位的手表类类商品，等等。具体实现时，具体的商品推荐策略可以有多种，当然，具体推荐出的商品需要关联有三维模型，也即，只有预先建立了三维模型的商品，才会进入到这种通过AR空间进行推荐的范围。
在通过AR空间的界面提供了上述商品推荐列表后，使得用户可以方便地发起对其他同类商品的AR展示请求。例如，在图3(B)所示的界面中，如果用户已经完成了对当前手表类商品的AR浏览，则可以直接通过点击该列表中的其他手表类商品，来将其他手表类商品的三维模型映射到当前的AR空间中，而不需要执行从当前界面退出，进入到某个其他手表类商品的详情页面重新发起AR展示请求，等等，因此，可以提升交互效率。
另外，在通过点击AR空间的界面中的商品推荐列表的商品，对AR空间中的三维模型进行替换的过程中，还可以实现基于相同AR空间中的现实环境图像，对不同商品的三维模型进行对比，以便于用户在多款不同的商品之间做出选择。
总之，通过本申请实施例，针对腕部佩戴类商品对象的AR展示，可以预先分别对表盘部分以及表带部分进行独立的三维建模，得到第一模型以及第二模型。这样，在根据从AR空间中识别出的腕部的位姿，将所述三维模型映射到AR空间中的过程中，可以按照表盘部分的实际尺寸对所述第一模型进行映射，并对所述第二模型的松紧程度进行调整，以适配所述腕部的腕围。也就是说，可以在实现表带部分与手腕的粗细相适配的同时，确保表盘部分的展示尺寸不受影响，从而可以使得用户在通过AR方式对腕部佩戴类商品对象进行试戴的过程中，获得更接近于在线下对商品实物进行实际试戴时的体验，在商品展示场景下，更有利于帮助用户进行购物决策。
需要说明的是，本申请实施例中可能会涉及到对用户数据的使用，在实际应用中，可以在符合所在国的适用法律法规要求的情况下(例如，用户明确同意，对用户切实通知，等)，在适用法律法规允许的范围内在本文描述的方案中使用用户特定的个人数据。
与前述方法实施例相对应，本申请实施例还提供了一种信息展示装置，参见图4，该装置可以包括：
请求响应单元501，用于响应于通过增强现实AR方式对目标对象进行展示的请求，加载所述目标对象的三维模型，并从采集到的现实环境图像流中识别腕部的位姿，以及腕部的腕围；所述目标对象为腕部佩戴类对象，所述腕部佩戴类对象包括表盘部分以及表带部分，其中，所述三维模型包括按照表盘部分的实际尺寸进行建模得到的第一模型，以及对表带部分进行建模得到的第二模型；
AR展示单元，用于在根据所述腕部的位姿将所述三维模型映射到AR空间中的过程中，按照所述实际尺寸对所述第一模型进行映射，并对所述第二模型的松紧程度进行调整，以适配所述腕部的腕围。
具体实现时，该装置还可以包括：
贴合度模拟单元，用于根据所述表带部分的材质信息，对所述第二模型与所述腕部的贴合程度进行模拟。
具体的，所述贴合度模拟单元具体可以用于：
如果所述表带部分为皮类材质，则提供所述第二模型与所述腕部的紧密贴合的效果。
或者，如果所述表带部分为金属材质，则提供所述第二模型与所述腕部之间留有缝隙，并在自身重力作用下产生的物理垂感效果。
另外，该装置还可以包括：
环境光信息获取单元，用于获取所述现实环境的环境光信息；
反光效果展示单元，用于根据所述环境光信息，在所述AR空间中提供所述表盘部分和/后表带部分的反光效果。
另外，该装置还可以包括：
跟随运动单元，用于在检测到所述腕部的位姿发生变化时，将所述三维模型跟随所述腕部位姿的变化而运动。
其中，如果所述目标对象的表盘带有表针部件，则所述三维模型还包括通过对表针部分进行建模得到的第三模型；
此时，该装置还可以包括：
当前时间获取单元，用于获取当前时间信息；
表针模型匹配单元，用于按照所述当前时间信息，将所述第三模型匹配到所述第二模型的对应位置处进行展示，并提供所述第三模型随着现实时间而转动的动画效果。
或者，如果所述目标对象的表盘部分带有电子显示屏，则所述装置还可以包括：
当前时间获取单元，用于获取当前时间信息；
时间展示单元，用于将所述当前时间信息展示在所述电子显示屏上，并提供所述电子显示屏上显示的时间随着现实时间而变化的动画效果。
另外，如果所述电子显示屏为触摸屏，则所述装置还可以包括：
展示内容切换单元，用于响应于用户在所述AR空间中对所述触摸屏执行的点击或滑动操作，在所述AR空间中通过所述触摸屏展示出由所述点击或滑动操作所触发展示的信息内容。
具体实现时，所述三维模型可以与标准位姿的三维腕部模型具有绑定关系，在默认状态下，所述三维模型佩戴在所述标准位姿的三维腕部模型上，所述标准位姿的三维腕部模型为不可见状态；此时，从所述现实环境图像流中识别出的腕部的位姿可以包括：真实腕部的位姿相对于所述标准位姿的旋转矩阵和/或平移向量；
此时，所述AR展示单元具体可以用于：
通过将所识别出的旋转矩阵和/或平移向量作用于与所述标准位姿的三维腕部模型，以确定手表类对象的三维模型投影到所述AR空间中时的位姿。
另外，该装置还可以包括：
对象列表展示单元，用于在所述AR空间的界面中提供与所述目标对象相关的其他同类对象的AR展示入口；
模型替换展示单元，用于通过所述AR展示入口接收到对所述其他同类对象的AR展示请求后，将所述AR空间中展示的三维模型替换为所述其他同类对象对应的三维模型。
另外，本申请实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现前述方法实施例中任一项所述的方法的步骤。
以及一种电子设备，包括：
一个或多个处理器；以及
与所述一个或多个处理器关联的存储器，所述存储器用于存储程序指令,所述程序指令在被所述一个或多个处理器读取执行时，执行前述方法实施例中任一项所述的方法的步骤。
其中，图5示例性的展示出了电子设备的架构，例如，设备500可以是移动电话，计算机，数字广播终端，消息收发设备，游戏控制台，平板设备，医疗设备，健身设备，个人数字助理，飞行器等。
参照图5，设备500可以包括以下一个或多个组件：处理组件502，存储器504，电源组件506，多媒体组件508，音频组件510，输入/输出(I/O)的接口512，传感器组件514，以及通信组件516。
处理组件502通常控制设备500的整体操作，诸如与显示，电话呼叫，数据通信，相机操作和记录操作相关联的操作。处理元件502可以包括一个或多个处理器520来执行指令，以完成本公开技术方案提供的方法的全部或部分步骤。此外，处理组件502可以包括一个或多个模块，便于处理组件502和其他组件之间的交互。例如，处理部件502可以包括多媒体模块，以方便多媒体组件508和处理组件502之间的交互。
存储器504被配置为存储各种类型的数据以支持在设备500的操作。这些数据的示例包括用于在设备500上操作的任何应用程序或方法的指令，联系人数据，电话簿数据，消息，图片，视频等。存储器504可以由任何类型的易失性或非易失性存储设备或者它们的组合实现，如静态随机存取存储器(SRAM)，电可擦除可编程只读存储器(EEPROM)，可擦除可编程只读存储器(EPROM)，可编程只读存储器(PROM)，只读存储器(ROM)，磁存储器，快闪存储器，磁盘或光盘。
电源组件506为设备500的各种组件提供电力。电源组件506可以包括电源管理系统，一个或多个电源，及其他与为设备500生成、管理和分配电力相关联的组件。
多媒体组件508包括在设备500和用户之间的提供一个输出接口的屏幕。在一些实施例中，屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板，屏幕可以被实现为触摸屏，以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。触摸传感器可以不仅感测触摸或滑动动作的边界，而且还检测与触摸或滑动操作相关的持续时间和压力。在一些实施例中，多媒体组件508包括一个前置摄像头和/或后置摄像头。当设备500处于操作模式，如拍摄模式或视频模式时，前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。
音频组件510被配置为输出和/或输入音频信号。例如，音频组件510包括一个麦克风(MIC)，当设备500处于操作模式，如呼叫模式、记录模式和语音识别模式时，麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器504或经由通信组件516发送。在一些实施例中，音频组件510还包括一个扬声器，用于输出音频信号。
I/O接口512为处理组件502和外围接口模块之间提供接口，上述外围接口模块可以是键盘，点击轮，按钮等。这些按钮可包括但不限于：主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件514包括一个或多个传感器，用于为设备500提供各个方面的状态评估。例如，传感器组件514可以检测到设备500的打开/关闭状态，组件的相对定位，例如所述组件为设备500的显示器和小键盘，传感器组件514还可以检测设备500或设备500一个组件的位置改变，用户与设备500接触的存在或不存在，设备500方位或加速/减速和设备500的温度变化。传感器组件514可以包括接近传感器，被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件514还可以包括光传感器，如CMOS或CCD图像传感器，用于在成像应用中使用。在一些实施例中，该传感器组件514还可以包括加速度传感器，陀螺仪传感器，磁传感器，压力传感器或温度传感器。
通信组件516被配置为便于设备500和其他设备之间有线或无线方式的通信。设备500可以接入基于通信标准的无线网络，如WiFi，或2G、3G、4G/LTE、5G等移动通信网络。在一个示例性实施例中，通信部件516经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中，所述通信部件516还包括近场通信(NFC)模块，以促进短程通信。例如，在NFC模块可基于射频识别(RFID)技术，红外数据协会(IrDA)技术，超宽带(UWB)技术，蓝牙(BT)技术和其他技术来实现。
在示例性实施例中，设备500可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现，用于执行上述方法。
在示例性实施例中，还提供了一种包括指令的非临时性计算机可读存储介质，例如包括指令的存储器504，上述指令可由设备500的处理器520执行以完成本公开技术方案提供的方法。例如，所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
通过以上的实施方式的描述可知，本领域的技术人员可以清楚地了解到本申请可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例或者实施例的某些部分所述的方法。
本说明书中的各个实施例均采用递进的方式描述，各个实施例之间相同相似的部分互相参见即可，每个实施例重点说明的都是与其他实施例的不同之处。尤其，对于系统或系统实施例而言，由于其基本相似于方法实施例，所以描述得比较简单，相关之处参见方法实施例的部分说明即可。以上所描述的系统及系统实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下，即可以理解并实施。
以上对本申请所提供的商品展示方法、装置及电子设备，进行了详细介绍，本文中应用了具体个例对本申请的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本申请的方法及其核心思想；同时，对于本领域的一般技术人员，依据本申请的思想，在具体实施方式及应用范围上均会有改变之处。综上所述，本说明书内容不应理解为对本申请的限制。

Claims (14)

  1. 一种信息展示方法，其特征在于，包括：
    响应于通过增强现实AR方式对目标对象进行展示的请求，加载所述目标对象的三维模型，并从采集到的现实环境图像流中识别腕部的位姿，以及腕部的腕围；所述目标对象为腕部佩戴类对象，所述腕部佩戴类对象包括表盘部分以及表带部分，其中，所述三维模型包括按照表盘部分的尺寸进行建模得到的第一模型，以及对表带部分进行建模得到的第二模型；
    在根据所述腕部的位姿将所述三维模型映射到AR空间中的过程中，按照所述尺寸对所述第一模型进行映射，并对所述第二模型的松紧程度进行调整，以适配所述腕部的腕围。
  2. 根据权利要求1所述的方法，其特征在于，还包括：
    根据所述表带部分的材质信息，对所述第二模型与所述腕部的贴合程度进行模拟。
  3. 根据权利要求2所述的方法，其特征在于，
    所述根据所述表带部分的材质信息，对所述第二模型与所述腕部的贴合程度进行模拟，包括：
    如果所述表带部分为皮类材质，则提供所述第二模型与所述腕部的紧密贴合的效果。
  4. 根据权利要求2所述的方法，其特征在于，
    所述根据所述表带部分的材质信息，对所述第二模型与所述腕部的贴合程度进行模拟，包括：
    如果所述表带部分为金属材质，则提供所述第二模型与所述腕部之间留有缝隙，并在自身重力作用下产生的物理垂感效果。
  5. 根据权利要求1所述的方法，其特征在于，还包括：
    获取所述现实环境的环境光信息；
    根据所述环境光信息，在所述AR空间中提供所述表盘部分和/后表带部分的反光效果。
  6. 根据权利要求1所述的方法，其特征在于，还包括：
    在检测到所述腕部的位姿发生变化时，将所述三维模型跟随所述腕部位姿的变化而运动。
  7. 根据权利要求1所述的方法，其特征在于，
    如果所述目标对象的表盘带有表针部件，则所述三维模型还包括通过对表针部分进行建模得到的第三模型；
    所述方法还包括：
    获取当前时间信息；
    按照所述当前时间信息，将所述第三模型匹配到所述第二模型的对应位置处进行展示，并提供所述第三模型随着现实时间而转动的动画效果。
  8. 根据权利要求1所述的方法，其特征在于，
    如果所述目标对象的表盘部分带有电子显示屏，则所述方法还包括：
    获取当前时间信息；
    将所述当前时间信息展示在所述电子显示屏上，并提供所述电子显示屏上显示的时间随着现实时间而变化的动画效果。
  9. 根据权利要求8所述的方法，其特征在于，
    如果所述电子显示屏为触摸屏，则所述方法还包括：
    响应于用户在所述AR空间中对所述触摸屏执行的点击或滑动操作，在所述AR空间中通过所述触摸屏展示出由所述点击或滑动操作所触发展示的信息内容。
  10. 根据权利要求1至9任一项所述的方法，其特征在于，
    所述三维模型与标准位姿的三维腕部模型具有绑定关系，在默认状态下，所述三维模型佩戴在所述标准位姿的三维腕部模型上，所述标准位姿的三维腕部模型为不可见状态；
    从所述现实环境图像流中识别出的腕部的位姿包括：真实腕部的位姿相对于所述标准位姿的旋转矩阵和/或平移向量；
    所述根据所述腕部的位姿将所述三维模型映射到AR空间中，包括：
    通过将所识别出的旋转矩阵和/或平移向量作用于与所述标准位姿的三维腕部模型，以确定手表类对象的三维模型投影到所述AR空间中时的位姿。
  11. 根据权利要求1至9任一项所述的方法，其特征在于，还包括：
    在所述AR空间的界面中提供对象列表区域，所述对象列表区域用于展示与所述目标对象相关的至少一个其他同类对象，及其对应的AR展示入口；
    通过所述AR展示入口接收到对所述其他同类对象的AR展示请求后，将所述AR空间中展示的三维模型替换为所述其他同类对象对应的三维模型。
  12. 一种对象展示装置，其特征在于，包括：
    请求响应单元，用于响应于通过增强现实AR方式对目标对象进行展示的请求，加载所述目标对象的三维模型，并从采集到的现实环境图像流中识别腕部的位姿，以及腕部的腕围；所述目标对象为腕部佩戴类对象，所述腕部佩戴类对象包括表盘部分以及表带部分，其中，所述三维模型包括按照表盘部分的尺寸进行建模得到的第一模型，以及对表带部分进行建模得到的第二模型；
    AR展示单元，用于在根据所述腕部的位姿将所述三维模型映射到AR空间中的过程中，按照所述尺寸对所述第一模型进行映射，并对所述第二模型的松紧程度进行调整，以适配所述腕部的腕围。
  13. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现权利要求1至11任一项所述的方法的步骤。
  14. 一种电子设备，其特征在于，包括：
    一个或多个处理器；以及
    与所述一个或多个处理器关联的存储器，所述存储器用于存储程序指令,所述程序指令在被所述一个或多个处理器读取执行时，执行权利要求1至11任一项所述的方法的步骤。
PCT/CN2023/071970 2022-09-09 2023-01-12 信息展示方法、装置及电子设备 WO2024051063A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211103094.6A CN115631321A (zh) 2022-09-09 2022-09-09 信息展示方法、装置及电子设备
CN202211103094.6 2022-09-09

Publications (1)

Publication Number Publication Date
WO2024051063A1 true WO2024051063A1 (zh) 2024-03-14

Family

ID=84903047

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/071970 WO2024051063A1 (zh) 2022-09-09 2023-01-12 信息展示方法、装置及电子设备

Country Status (2)

Country Link
CN (1) CN115631321A (zh)
WO (1) WO2024051063A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102156808A (zh) * 2011-03-30 2011-08-17 北京触角科技有限公司 增强现实实时虚拟饰品试戴系统及方法
CN104820498A (zh) * 2015-05-14 2015-08-05 周谆 手部虚拟饰品试戴的人机交互方法和系统
CN104851004A (zh) * 2015-05-12 2015-08-19 杨淑琪 一种饰品试戴的展示装置和展示方法
US20160178936A1 (en) * 2014-12-23 2016-06-23 Multimedia Image Solution Limited Method of Virtually Trying on Eyeglasses
WO2016179819A1 (zh) * 2015-05-14 2016-11-17 周谆 手部虚拟饰品试戴的人机交互方法和系统
CN106373085A (zh) * 2016-09-20 2017-02-01 福州大学 一种基于增强现实的智能终端3d手表试戴方法及系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102156808A (zh) * 2011-03-30 2011-08-17 北京触角科技有限公司 增强现实实时虚拟饰品试戴系统及方法
US20160178936A1 (en) * 2014-12-23 2016-06-23 Multimedia Image Solution Limited Method of Virtually Trying on Eyeglasses
CN104851004A (zh) * 2015-05-12 2015-08-19 杨淑琪 一种饰品试戴的展示装置和展示方法
CN104820498A (zh) * 2015-05-14 2015-08-05 周谆 手部虚拟饰品试戴的人机交互方法和系统
WO2016179819A1 (zh) * 2015-05-14 2016-11-17 周谆 手部虚拟饰品试戴的人机交互方法和系统
CN106373085A (zh) * 2016-09-20 2017-02-01 福州大学 一种基于增强现实的智能终端3d手表试戴方法及系统

Also Published As

Publication number Publication date
CN115631321A (zh) 2023-01-20

Similar Documents

Publication Publication Date Title
US11734959B2 (en) Activating hands-free mode on mirroring device
US20240104959A1 (en) Menu hierarchy navigation on electronic mirroring devices
US11798201B2 (en) Mirroring device with whole-body outfits
WO2020125785A1 (zh) 毛发渲染方法、装置、电子设备和存储介质
CN108038726B (zh) 物品展示方法及装置
US11809633B2 (en) Mirroring device with pointing based navigation
CN109920065A (zh) 资讯的展示方法、装置、设备及存储介质
US20240078703A1 (en) Personalized scene image processing method, apparatus and storage medium
US20220198603A1 (en) Recentering ar/vr content on an eyewear device
US20210042980A1 (en) Method and electronic device for displaying animation
WO2021073293A1 (zh) 动画文件的生成方法、装置及存储介质
CN111368114B (zh) 信息展示方法、装置、设备及存储介质
CN109658167B (zh) 试妆镜设备及其控制方法、装置
CN109074680A (zh) 基于通信的增强现实中实时图像和信号处理方法和系统
KR20230070505A (ko) 메시징에서의 ar 기반 메이크업 제품 세트들
WO2022212175A1 (en) Interface with haptic and audio feedback response
CN112783316A (zh) 基于增强现实的控制方法及装置、电子设备和存储介质
CN113902869A (zh) 三维头部网格生成方法、装置、电子设备和存储介质
WO2024051063A1 (zh) 信息展示方法、装置及电子设备
CN109544698A (zh) 图像展示方法、装置及电子设备
US20220319059A1 (en) User-defined contextual spaces
CN115527014A (zh) 信息展示方法及电子设备
CN113194329A (zh) 直播互动方法、装置、终端及存储介质
CN115936800A (zh) 商品展示方法及电子设备
CN116258544A (zh) 信息展示方法、装置及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23861775

Country of ref document: EP

Kind code of ref document: A1