WO2018072617A1 - 一种虚拟现实/增强现实空间环境中的数据对象交互方法及装置 - Google Patents

一种虚拟现实/增强现实空间环境中的数据对象交互方法及装置 Download PDF

Info

Publication number
WO2018072617A1
WO2018072617A1 PCT/CN2017/105359 CN2017105359W WO2018072617A1 WO 2018072617 A1 WO2018072617 A1 WO 2018072617A1 CN 2017105359 W CN2017105359 W CN 2017105359W WO 2018072617 A1 WO2018072617 A1 WO 2018072617A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
data object
information
voice
interaction
Prior art date
Application number
PCT/CN2017/105359
Other languages
English (en)
French (fr)
Inventor
张洁
Original Assignee
阿里巴巴集团控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司 filed Critical 阿里巴巴集团控股有限公司
Publication of WO2018072617A1 publication Critical patent/WO2018072617A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/12—Payment architectures specially adapted for electronic shopping systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/38—Payment protocols; Details thereof
    • G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/38—Payment protocols; Details thereof
    • G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G06Q20/401—Transaction verification
    • G06Q20/4014—Identity check for transactions
    • G06Q20/40145—Biometric identity checks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0603—Catalogue ordering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics

Definitions

  • the present application relates to the field of virtual reality/augmented reality technology, and in particular, to a data object interaction method and apparatus in a virtual reality/augmented reality space environment.
  • Virtual Reality is a computer simulation system that can create and experience virtual worlds.
  • the various virtual environments generated by such systems act on the user's visual, auditory, and tactile sensations, allowing users to feel immersive and immersed in them.
  • the so-called virtual world is a virtual environment or a collection of given simulation objects.
  • Virtual reality is a new technology developed in recent years.
  • Augmented Reality is a new technology that integrates real world information and virtual world information "seamlessly". It is an entity information that is difficult to experience in a certain time and space of the real world (visual). Information, sound, taste, touch, etc.), through computer and other science and technology, simulation and then superimposition, the virtual information is applied to the real world, perceived by the user, thus achieving a sensory experience beyond reality.
  • VR/AR technology is still in the development stage, and there is no virtual reality/augmented reality interaction system that can open the entire online shopping payment link.
  • the technical problem to be solved by the present invention is to provide a data object interaction method in a virtual reality/augmented reality space environment, which can completely release the user's hand operation when using the head display device, and provides the user with no manual operation.
  • the solution of completing the shopping payment can make the shopping experience of the virtual reality/augmented reality space environment closer to the offline physical store, providing the user with a one-stop immersive shopping experience.
  • the present invention also provides a data object interaction device in a virtual reality/augmented reality space environment to ensure the application and implementation of the above method in reality.
  • a data object interaction method in a virtual reality space environment includes:
  • the client provides a virtual reality store object internal space environment, where the store object internal space environment includes at least one interactive data object;
  • the information content related to the order confirmation includes: attribute information associated with the target data object and resource information to be paid;
  • Matching the user's voice with the pre-trained voiceprint model triggers the payment operation when the match is successful.
  • a second aspect of the present invention provides a data object interaction method in a virtual reality space environment, where the method includes:
  • the server saves the virtual reality store object internal space environment data, where the store object internal space environment data includes at least one interactive data object, the interactive data object corresponding to the interaction area range, and associated with the preset information content;
  • the information content related to the order confirmation includes: attribute information associated with the target data object and resource information to be paid; matching the voice of the user and the pre-trained voiceprint model, and triggering the payment operation when the matching is successful.
  • a data object interaction method in an augmented reality space environment comprising:
  • the client obtains a three-dimensional model of the internal space environment of the physical store; the physical store includes multiple pieces of goods;
  • the interactive area range information corresponding to the product is provided within a user's field of view of the AR device;
  • the information content related to the order confirmation includes: attribute information of the target item and resource information to be paid; matching the voice of the user and the pre-trained voiceprint model, when the matching is successful , trigger the payment operation.
  • a fourth aspect of the present invention provides a data object interaction method in an augmented reality space environment, where the method includes:
  • the server saves a three-dimensional space model of the internal space environment of the physical store, and the physical store includes multiple pieces of goods Products, corresponding interaction area range information, and interaction response information of data objects associated with each interaction area range;
  • Providing the three-dimensional space model to a client, so that the client is in a user view of the AR device after spatially matching the three-dimensional space model with the physical store through a preset augmented reality AR device Providing the range information of the interaction area corresponding to the product, determining the target item of interest to the user; providing information content related to the order confirmation, the information content related to the order confirmation includes: attribute information associated with the target item and The resource information to be paid; the matching user's voice and the pre-trained voiceprint model, when the matching is successful, triggers the payment operation.
  • a fifth aspect of the present invention provides a data object interaction apparatus in a virtual reality space environment, where the apparatus includes:
  • a virtual reality environment providing module configured to provide a virtual reality store object internal space environment, where the store object internal space environment includes at least one interactive data object;
  • a target data object determining module configured to determine a target data object of interest to the user
  • the order information providing module is configured to provide information content related to the order confirmation, where the information content related to the order confirmation includes: attribute information associated with the target data object and resource information to be paid;
  • the matching module is configured to match the voice of the user with the pre-trained voiceprint model, and trigger the payment operation when the matching is successful.
  • a sixth aspect of the present invention provides a data object interaction apparatus in a virtual reality space environment, where the apparatus includes:
  • An environment data storage module configured to save virtual reality store object internal space environment data, where the store object internal space environment data includes at least one interactive data object, where the interactive data object corresponds to an interaction area range, and the associated Information content;
  • An environment data providing module configured to provide the virtual reality store object internal space environment data to the client, so that the client provides the virtual reality store object internal space environment data, determines the target data object that the user is interested in; provides and orders Confirming related information content, the information content related to the order confirmation includes: attribute information associated with the target data object and resource information to be paid; matching the voice of the user and the pre-trained voiceprint model, and when the matching is successful, triggering Payment operation.
  • a seventh aspect of the present invention provides a data object interaction apparatus in an augmented reality space environment, the apparatus comprising:
  • a spatial model acquisition module configured to obtain a three-dimensional space model of an internal space environment of the physical store; the physical store The shop includes multiple items inside;
  • a space model matching module configured to provide an interaction corresponding to the goods within a user view range of the AR device after spatially matching the three-dimensional space model with the physical store by a preset augmented reality AR device Regional scope information;
  • a target item determination module for determining a target item of interest to the user
  • An order information providing module configured to provide information content related to the order confirmation, where the information content related to the order confirmation includes: attribute information associated with the target item and resource information to be paid;
  • the matching module is configured to match the voice of the user with the pre-trained voiceprint model, and trigger the payment operation when the matching is successful.
  • An eighth aspect of the present invention provides a data object interaction apparatus in an augmented reality space environment, where the apparatus includes:
  • a storage module configured to save a three-dimensional space model of the internal space environment of the physical store, where the physical store includes multiple pieces of goods, corresponding interaction area range information, and interaction response information of the data objects associated with each interaction area range;
  • a spatial model providing module configured to provide the three-dimensional space model to a client, so that the client performs spatial matching between the three-dimensional space model and the physical store through a preset augmented reality AR device, Providing the interactive area range information corresponding to the goods in the user's field of view of the AR device, determining the target item of interest to the user; providing information content related to the order confirmation, the information content related to the order confirmation includes: The attribute information associated with the target item and the information to be paid; the matching user's voice and the pre-trained voiceprint model, when the matching is successful, trigger the payment operation.
  • the internal space environment of the virtual reality store object can be provided, so that the user can obtain the experience of being in the three-dimensional space environment, and the specific interaction process can be realized by voice, for the user, only Need to talk to achieve interaction, without the need to manually enter the device by means of an external handle, the most important thing is that in the payment link, no manual payment is required, but the user's voiceprint feature is used to judge the legality of the payment operation, and then decide whether The payment is triggered to ensure the security of the user's payment in the virtual reality scenario.
  • the technical solution provided by the present invention can also be implemented based on augmented reality technology, and has the same advantages as described above.
  • FIG. 1 is a schematic structural diagram of a virtual reality device according to an embodiment of the present application.
  • FIG. 2 is a flow chart showing an example of a data object interaction method in a virtual reality space environment of a client provided by an embodiment of the present application;
  • 3-1 is a structural diagram of displaying related information of a data object according to an embodiment of the present application.
  • 3-2 is a diagram showing an example of displaying detailed information of a data object according to an embodiment of the present application.
  • FIG. 4 is a schematic diagram showing the display of “information content related to order confirmation information” provided by an embodiment of the present application.
  • 5-1 is a diagram showing an example of a primary navigation space of a virtual reality provided by an embodiment of the present application
  • FIG. 5-2 is a structural diagram of a graphic presentation provided by an embodiment of the present application.
  • FIG. 6 is a flow chart showing an example of a data object interaction method in a virtual reality space environment on the server side according to an embodiment of the present application
  • FIG. 7 is a schematic flowchart of a data object interaction method in an augmented reality space environment of a client provided by an embodiment of the present application;
  • FIG. 8 is a schematic flowchart of a data object interaction method in an augmented reality space environment on a server side according to an embodiment of the present application
  • FIG. 9 is a diagram showing an example of a structure of a data object interaction apparatus in a virtual reality space environment of a client provided by an embodiment of the present application.
  • FIG. 10 is a diagram showing an example of a structure of a data object interaction apparatus in a virtual reality space environment on a server side according to an embodiment of the present application;
  • FIG. 11 is a diagram showing an example of a structure of a data object interaction apparatus in an augmented reality space environment of a client provided by an embodiment of the present application;
  • FIG. 12 is a diagram showing an example of a structure of a data object interaction apparatus in an augmented reality space environment on a server side according to an embodiment of the present application.
  • the internal environment of the store object by means of virtual reality, which may include multiple interactive data.
  • Objects eg, product objects, etc.
  • the user can browse and interact with data objects in such a virtual reality space environment. Since the virtual reality space environment has a three-dimensional effect, the data object that the user sees is no longer a simple data object list, but like a physical store under the line, a three-dimensional space can be seen, which has a shelf. Etc., data objects can be placed on the shelf, users can remove specific data objects from the shelf to view their details, and so on, so that it can be closer to the actual online shopping experience in the physical store.
  • the user in order to further improve the user experience, in the process of interacting with the system, the user may not need to use an external input device such as a handle, but may determine the user's shopping intention by means of voice recognition, and further Realizing the interaction with the user, and further completing the payment operation by means of voiceprint feature recognition, so that the user can obtain the entity closer to the offline only through the voice interaction without the assistance of an external input device such as a handle.
  • the shopping experience in the store enhances the user's immersion.
  • the server is mainly used to provide data support, for example, virtual reality internal space environment data of multiple store objects can be realized and provided to customers.
  • the client is mainly used for front-end display of data and interaction with users.
  • the client may be a stand-alone application, or may be a function module in some comprehensive applications, for example, may be a function module in a mobile terminal App such as "Mobile Taobao" or "Taobao", etc. Wait.
  • a virtual reality device can be used first.
  • the virtual reality device can be an "integrated" virtual reality device that integrates functions such as storage, computing, and screen display, or can only have a screen display.
  • Functional "external” or “mobile” virtual reality device for the integrated virtual reality device, since it has functions such as storage and calculation, the aforementioned client program can be directly installed or built in such a virtual reality device.
  • the client program can be installed in the PC, and then the external virtual reality device The device is connected to the PC to implement a virtual reality space environment and interaction.
  • the "mobile” virtual reality device it needs to be used together with a smart mobile terminal device such as a mobile phone, for example, a "VR glasses box", etc., when used, a smart mobile terminal device such as a mobile phone can be placed.
  • a smart mobile terminal device such as a mobile phone
  • the client program may be installed or built into the smart mobile terminal device, and then the smart mobile terminal device and the mobile virtual reality device are connected. The functions in the embodiments of the present application.
  • a data object interaction method in a virtual reality space environment is first provided.
  • the method may include the following steps 201 to 205:
  • Step 201 The client provides a virtual reality store object internal space environment, where the store object internal space environment includes at least one interactive data object.
  • the so-called store object may refer to a "store” opened by an enterprise or the like in an online sales platform.
  • a store object may be associated with a physical store, such as a supermarket, a clothing store, or the like. Wait.
  • the simulation can be used to simulate the layout of the offline store, the way of displaying the products, etc., to generate the simulated internal space environment of the store, or to further enhance the authenticity of the environment, and also to the offline entity.
  • the way in which the video is recorded in the store is used to establish the internal space environment of the store object, and when the internal space environment of the store is provided to the user in the virtual reality device, the video can be played by means of playing the video, so that the user can obtain a more realistic reality. shopping experience.
  • the picture is integral, that is, each frame picture is a whole, therefore, in order to enable the user to Interact with the data objects in the screen to implement subsequent viewing details, purchases, etc., and also process the recorded video.
  • the specific processing process that is, marking the data objects appearing in the video, for example, the location of a certain product appears in the video screen, and the identification information such as the ID of the product can be input by means of a mouse click, etc.
  • the content information corresponding to the product ID can be determined through the database saved in the background.
  • the data objects appearing in the video picture can be made interactive.
  • the user After entering the space environment inside the store object, the user realizes the interaction with the data object, and can view the related information content of the data object, such as the detailed information of the data object.
  • the detailed information of the data object may include stereoscopic image information of the data object, and description information of the character nature. As shown in FIG. 3-1, it is also possible to demonstrate that the detailed information is changed from "small” to "large” from the position of the marked point of the data object. And, the detailed information may be centered on the stereoscopic image information, and the description information of the character property is displayed around the stereoscopic image.
  • the stereoscopic image information is displayed separately from the text information, and an operation control for rotating the stereoscopic image may also be provided, such that when the user's line of sight focus enters the range of the area in which the operation control is located, the The stereoscopic image is rotated to display a stereoscopic image of the data object at multiple viewing angles.
  • an operational control may include a plurality of operational controls for rotating in different directions, for example, two clockwise and counterclockwise rotational directions, and the like.
  • FIG. 3-2 after the user's line of sight is focused on an alarm clock, the detailed information of the alarm clock is displayed (divided into two left and right pictures, corresponding to the binocular vision of the human eye), visible, and detailed information.
  • a stereoscopic image of the alarm clock is included, which is located at a central location 301.
  • the surrounding 302 can display a plurality of detailed information such as the name and price of the data object.
  • two rotation controls 303 are provided below the central stereo image for rotating the stereoscopic image in a clockwise direction and a counterclockwise direction, respectively.
  • the content of the detailed information about the specific reality in FIG. 3-2 is not limited in the embodiment of the present application. Therefore, the clarity of the text or picture information displayed in the figure does not affect the protection of the embodiment of the present application. range.
  • the stereoscopic image of the data object may be generated by taking a photo obtained by photographing the actual product, and the photograph taken in real time may be multiple photos taken from multiple angles of view, and a three-dimensional display effect is synthesized, and the rotation may be performed by rotating the Stereoscopic images change the angle of view and understand the details of data objects from multiple angles.
  • the previous data processing operation may further include: the corresponding data object corresponding to the goods
  • the photographing angles are photographed, and photographs taken at a plurality of photographing angles are saved, so that when the user has a demand for viewing stereoscopic images of a plurality of angles, it can be provided according to the saved plurality of photographs.
  • Step 202 Determine a target data object that is of interest to the user
  • the user After entering the space environment inside the store object, the user can interact with the data object to determine their own shopping target. For the system, the user's shopping intention can be identified according to the user's interaction.
  • the embodiment of the present application may determine the user's shopping intention by means of the user's voice interaction, without using an external input device such as a handle, or by transmitting a certain ray through the VR device.
  • the user's shopping intention can be identified by identifying the user's line of sight focus position.
  • step 202 can be implemented as follows:
  • the user after viewing the detailed information of the data object, the user can input the voice through the recording component of the VR device, such as a microphone, and indicate the target data object of interest through voice interaction.
  • Customer The terminal receives the voice, and identifies the voice, and identifies whether the voice contains related information content of one or more interactive data objects in the internal space environment of the currently provided virtual reality store object, wherein one interactive data object
  • the relevant information content is the ability to clearly identify the content of the interactive data object.
  • the user's voice includes content capable of characterizing the meaning of the purchase intention
  • the content capable of characterizing the meaning of the purchase intention may include: words that represent the purchase intention, such as “join the shopping cart”, “immediately Buy”, and so on.
  • step 202 can be implemented as follows:
  • the data object is determined as the target data object of interest to the user.
  • the user If the user considers the details of the data object and thinks that the data object meets his or her own needs, the user will intent to purchase the data object. At this time, the user can focus the line of sight on the range of the interaction area where the data object is located, and After the line of sight focus stays for a certain period of time, the system can recognize the user's shopping intention.
  • an operation control for performing a purchase operation on the data object may be provided, such as the "Buy Now” button shown at 304 in FIG. 3-2.
  • the data object can be determined to be the target data object of interest to the user. That is to say, if the user thinks that the data object satisfies his own needs after viewing the details of the target data object, an intent to purchase the data object is generated. At this time, the user can focus the line of sight on "for the data.
  • the target data object of interest to the user may be determined in combination with the user's line of sight focus position and the user's voice; the data object of interest to the user is first determined according to the user's line of sight focus position, and then the user's voice is identified to be capable of being characterized.
  • the content of the meaning of the purchase is purchased, wherein the content capable of characterizing the meaning of the purchase intention may include words that characterize the purchase intention, such as "join the shopping cart", "buy immediately", and the like.
  • words that can represent the purchase intention can be collected in advance, and then, when the user's voice is recognized, the user's voice content is parsed, the voice content is converted into text content, the text content is segmented, and then the word shape and word meaning are matched. The way to identify.
  • Step 203 Providing information content related to the order confirmation, where the information content related to the order confirmation includes: attribute information associated with the target data object and resource information to be paid;
  • step 202 After step 202 identifies the user's shopping intention, relevant information for performing order confirmation is provided, such as The information content related to the order confirmation is displayed at 401 in FIG. 4, and the information content related to the order confirmation may include multiple aspects of information, which may specifically include determining the delivery address and the purchased data object. The name, the number of data objects purchased, whether or not to use a virtual resource such as a "coupon", and so on.
  • a first information panel may be provided, and the information content related to the order confirmation is provided on the first information panel.
  • the first information panel is closed when the user's line of sight focus position is removed from the first information panel.
  • the area of the first information panel may be smaller than the area of the user's field of view.
  • the user's line of sight focus can be tracked.
  • the first information panel can be closed, and correspondingly, the current information related to the order confirmation is no longer Show, users can continue to browse other data objects. That is to say, in this manner, it is not necessary to set an operation control such as a “close button” in the first information panel, and the user only needs to remove the line of sight focus from the area where the information panel is located, thereby triggering the first The information panel is closed so that it can be more user-friendly.
  • an operation control for confirming each piece of information may also be separately provided.
  • the information content related to the order confirmation may further include: a first operation control used to modify the order related information;
  • the first operation control can be triggered.
  • the triggering can also be performed by means of line-of-sight blowing. That is, when the user's line of sight focus enters the range of the area where the first operation control is located, and the time of stay reaches the preset time threshold, the second information panel is provided and provided in the second information panel. Modify the content of the order related information. If the user selects another receiving address, the second information panel is automatically closed. If the user does not need to modify after browsing the receiving address, the operating space can be operated through the close button in the second information panel. To close the second information panel, or to turn it off by voice control. At this point, the presentation of the first information panel continues.
  • the information content related to the order confirmation may further include: a second operation control for performing an increase/decrease operation on the target data object quantity;
  • the line of sight focus position enters the second operation control, and the time of staying does not leave after reaching the preset time threshold, continue to perform an add/subtract operation on the number of the target data objects, and continue to perform the addition.
  • the time interval of execution is less than the preset time threshold.
  • the following special processing may also be performed: if the line of sight focus position enters the second operation control, and the time of staying does not leave after reaching the preset time threshold, proceed to the The number of target data objects is subjected to a plus/minus one operation, and when the addition/subtraction operation is continued, the time interval of execution is less than the preset time threshold. That is to say, when the user's line of sight is focused on such a second operation control (for example, a control that performs an "increase" operation), the first fuse process is triggered, and after the preset time threshold is passed, the number of data objects is original. Add 1 to the base, then, if the line of sight does not leave, trigger the second blow.
  • a second operation control for example, a control that performs an "increase" operation
  • the number of data objects is increased by 1 on the original basis, and the time elapsed in each subsequent fuse process can be shortened.
  • the first time is 3S
  • the second time can be 2S
  • the third time can be 1S
  • the shortest time cannot be shorter than 1S, which means that the fourth and subsequent fuse processes can be the time of 1S.
  • the order After completing the confirmation operation of each information, the order can be submitted and the subsequent payment operation flow can be entered.
  • the client provides the information content related to the order confirmation
  • the user may directly perform step 204, or interact with the user in the following manner, first determine the confirmation of the user completing the order information, and then perform the steps. 204.
  • One way is to provide verification content, when the information content related to the order confirmation is provided, the verification content is generated according to at least part of the attribute information of the target data object; and then, identifying whether the user's voice includes the school If the content is verified, it is determined that the user has completed the confirmation of the order information.
  • the attribute information of the target data object refers to information related to the target data object that can represent the characteristics of the target data object, and may include: a product title, a product color, a product size, a model, a material, a brand, a configuration, a rating, a packaging capacity, and Production date, shelf life, usage, price, origin, etc., the verification content above is generated based on one or more attribute information of the target data object.
  • the target data object that the user is interested in is the golden ihpone7 mobile phone, as described above, Obtaining the attribute information of the target data object, and then generating the “check content” according to at least part of the attribute information, for example, the check content is “Golden iPhone 7 Plus 256 GB licensed”, and in the embodiment of the present application, the verification is provided for the user.
  • the content is mainly for the user to quickly confirm the goods that they want to purchase, and confirm the purchase behavior through voice interaction.
  • the user can also be prompted by text to read the check content to determine the order.
  • the system recognizes the user's voice and determines whether the voice contains the content of "Golden iphone7 Plus 256GB licensed”.
  • the user voice is confirmed to confirm the order information. .
  • the voice outputted by the user and the pre-trained voiceprint model need to be matched, which can ensure the reliability of the matching result, accelerate the matching efficiency, and simplify the user interaction. operating.
  • the client when providing the information content related to the order confirmation, the client also provides a check code; then, it is identified whether the check code is included in the voice of the user, and if so, it is determined that the user has completed the order information. confirm.
  • the check code may be randomly generated by the client.
  • another string of random numbers may be sent again to enable the user.
  • the operation of confirming the order information is re-executed according to the another string of random numbers. It can be seen that by sending the check code multiple times, the user is provided with the opportunity to confirm the order information multiple times, which has certain fault tolerance; for example, the user can be allowed to make N attempts, and N can be set according to actual needs. For example, it can be set to 3.
  • this method can effectively prevent others from illegally triggering the operation of confirming the order, and can effectively ensure the security of the order payment in the virtual reality scenario.
  • Another way is to determine the user's line of sight focus position; when the line of sight focus position enters the interactive area of the information content related to the order confirmation, and the time of stay reaches the preset time threshold, it is determined that the user has completed the order information. Confirmation.
  • the “fuse” mechanism may be triggered. That is, timing can be started by a timer. If the stay time in the range of the interaction area reaches a certain time threshold (for example, 3S), it can be determined that the user confirms the order content, and then the client performs step 204.
  • a certain time threshold for example, 3S
  • Still another way is to identify whether the user's voice contains a word that can characterize the confirmation order, and if so, determine that the user has completed the confirmation of the order information.
  • the client After the client provides the information content related to the order confirmation, the voice sent by the user after viewing the content of the information is obtained, and then the client identifies whether the voice contains a word that can represent the meaning of the confirmed order.
  • the words in which the meaning of the confirmed order can be characterized may include: "order”, “confirm”, “payment”, “ok” and the like.
  • Step 204 Match the voice of the user with the pre-trained voiceprint model, and trigger the payment operation when the matching is successful.
  • the payment operation involves the user's property and privacy
  • the user provides the bank card and manually enters the password by himself, or the user himself uses the smart terminal to perform online payment in person, and this payment behavior can ensure the legality of the user's payment operation.
  • the user is not able to perform such a payment behavior. Therefore, in this embodiment, the validity of the user identity is also verified to confirm the legality and security of the payment, so as to effectively avoid Malicious payment operation by the illegal person.
  • the voiceprint feature of the user Since each person's voiceprint features are unique and unique, it is generally difficult to be imitated by others. Therefore, the verification of the legality of the user identity by the voiceprint feature can ensure the reliability of the verification.
  • One way is to collect the user's voice, and then match the collected voice with the pre-trained voiceprint model. If all the collected voices match a pre-trained voiceprint model, the match is successful. Trigger a payment operation. When the payment is successful, the payment success information may also be provided. If the payment fails for some reason, the payment failure information may also be provided to prompt the user to fail the payment, for example, prompting the user that the account balance is insufficient, and the payment cannot be completed.
  • the voiceprint model corresponding to the device identifier is selected from the plurality of voiceprint models that are pre-trained or the voiceprint model corresponding to the user identifier is selected according to the device identifier or the user identifier of the client. Then match the user's voice with the selected voiceprint model.
  • the user's voice can be understood as all the voices that the user sends when using the VR device, so that the reliability of the matching result can be guaranteed.
  • the user's voice can also be the voice that the user sends after viewing the "information content related to the order confirmation", which can reduce the amount of matching operations.
  • the device identifier refers to a unique identifier of the client, such as a client ID.
  • the user identifier refers to a unique identifier that can identify the user, such as a user name and a user number.
  • the triggering payment operation may be understood as: the client may trigger the locally configured APP for completing the payment service, so that the APP completes the payment according to the related payment account information pre-registered by the user, for example, the user account. The funds are transferred to the merchant account.
  • the trigger payment operation can also be understood as, the client triggers In the server that completes the payment service, the server completes the payment according to the relevant payment account information registered by the user in advance.
  • the user's related payment account information may include: a user bank account and password, a user virtual resource account and a password, and the like.
  • the client can also provide payment result information to inform the user that the payment operation succeeds or fails.
  • the voiceprint model of the user needs to be trained in advance.
  • the training of the voiceprint model may be completed in advance through the following training methods, and the training manner includes:
  • the user can record his own voice through the mobile phone or other terminal, and upload the recorded voice to the voice collection system; of course, the user can directly record his own voice in the recording interface provided by the voice collection system;
  • the acquisition system first preprocesses the received speech.
  • the preprocessing is mainly to remove the non-speech signal and the silent speech signal, and perform framing processing on the speech signal to provide a data foundation for subsequent model training.
  • MFCC Mel Frequency Cepstrum Coefficient
  • the embodiment of the present application also provides a method for optimizing the voiceprint model.
  • the voice of the user in the virtual reality scene is collected, and the voiceprint model of the user is optimized by using the collected voice.
  • This optimization method does not need to collect the user's voice through a dedicated channel, and only utilizes the voice of the user in the virtual reality scene to optimize the voiceprint model, which is simple and feasible, and the reliability of the optimization effect is stronger.
  • only the voiceprint model of a specific user may be trained in advance, and only one user is provided with a service.
  • each user of the multiple users may also be pre-trained.
  • the store object internal space environment can be provided by using a virtual reality manner, where a plurality of interactive data objects can be included, and the user's shopping intention can be determined by the user voice, and then the user's voice is determined.
  • the pattern feature determines the user's payment intent and ensures the security of the payment operation. The entire process does not require external input devices such as a handle to simplify user operations, thereby improving the user's shopping payment experience.
  • the "mobile" virtual reality device for example, a VR glasses box
  • the client provided in the embodiment of the present application in a mobile terminal device such as a mobile phone, and then put the mobile phone into the VR glasses box.
  • there may be some configuration operations such as login, input delivery address, etc.
  • the user may include: login, adding a delivery address, payment account information, and the like before the user brings the glasses.
  • the related virtual reality portal can be accessed through the portal.
  • the delivery address, etc. if not, can guide the user to perform the login and add the delivery address.
  • the model of the mobile terminal device such as the mobile phone used by the user is supported, and if not, the prompt can be made.
  • the mobile phone may first enter the main navigation space, that is, the space environment for selecting the store object. It is equivalent to the home page of the website, but the difference is that the main navigation space in the system is a three-dimensional space, and the user can explore it by turning the head up and down and left and right.
  • the initial position of the line of sight may be a photo wall, and each dynamic photo on the wall represents a country in the world.
  • a store on a street in a city, the content displayed in the dynamic photos can also be a real-recorded storefront video, for example, including streetscapes outside the store's facade.
  • an operation layer may be added between the environment layer and the screen layer of such a main navigation space.
  • the environment layer can be understood as a virtual reality scene
  • the operation layer can be understood as a GUI
  • the screen layer can be understood as a client control.
  • a "Bounding Box" corresponding to the position and size of the dynamic picture of each shop object can be set, and the "Bounding Box" is used as the corresponding shop object.
  • the range of interaction areas so that users can focus on a store pair by focusing
  • the internal space environment entering the store object is triggered by a manner such as staying in the corresponding interaction area and staying for a period of time.
  • the client may request the server to obtain the virtual reality space environment data of the target store object, and perform operations such as parsing and rendering, so that the trigger enters the target store and actually displays the target store internal space environment.
  • the interface may go through a period of time.
  • the primary navigation space environment may also be switched to the cut video associated with the selected store object, wherein the cut video is used to display the selected store object.
  • the corresponding scenery that can be seen on the way to the offline store.
  • the "time and space shuttle" effect can be demonstrated, and the user can feel that he is coming from the current navigation room to the vehicle, to the street outside the specific store, finally to the store door, and the like.
  • each of them can correspond to different cut-off videos, so that the user can obtain a more realistic experience.
  • This embodiment is the same as the first embodiment, and the specific solution provided by the embodiment of the present application is introduced from the perspective of the server.
  • the second embodiment provides a data object interaction method in a virtual reality space environment, and the method may include the following steps:
  • Step 601 The server saves the virtual reality store object internal space environment data, where the store object internal space environment data includes at least one interactive data object, the interactive data object corresponding to the interaction area range, and associated with preset information content;
  • the server may collect related video data in the physical store, perform processing operations such as labeling, generate internal virtual environment data of the virtual reality store object, and save the data.
  • Step 602 The virtual reality store object internal space environment data is provided to the client, so that the client provides the virtual reality store object internal space environment data, determines the target data object that the user is interested in, and provides information related to the order confirmation.
  • Content the information content related to the order confirmation includes: attribute information associated with the target data object and resource information to be paid; matching the voice of the user and the pre-trained voiceprint model, and triggering the payment operation when the matching is successful.
  • the server may directly provide the generated virtual reality store object internal space environment data to the client, or may also provide relevant data to the client when receiving the request from the client, and after obtaining the corresponding data, the client obtains the corresponding data.
  • a virtual reality space environment can be provided, and interaction with the user can be realized based on the environment, and a complete shopping process can be realized.
  • each of the foregoing embodiments provides various specific solutions based on the virtual reality technology, and can be implemented based on the augmented reality technology when the specific implementation is implemented.
  • the difference between virtual reality and augmented reality technology can be simply understood as: in the virtual reality environment, the content displayed by the "environment layer” is a virtual environment provided by simulating or pre-recording video in the physical space, " The information of the operation layer, including the annotation of the scope of the interactive object, the display of the interactive response information, etc., is based on the content displayed in the virtual environment layer; and in the augmented reality space environment, the "environment layer "The displayed content is the actual content in the physical space, the information in the "operation layer", including the labeling information on the range of the operation area of the goods, etc., may be based on the pre-established three-dimensional space model, in the actual display, first The physical space is spatially matched with the three-dimensional space model, and then the computer vision capability of the AR device is used for positioning, and the annotation information saved in the three-
  • the three-dimensional space model may be created in advance for the offline physical store, and then the information interaction with the user is implemented based on the three-dimensional space model. .
  • an AR device such as an AR glasses may be used by a worker to enter the physical interior space of the store and walk in the store.
  • the AR device has a sensing device such as a camera, the sensing device can be used to scan the store and its internal layout during walking. After getting the scan results, you can import them into the development environment. This development environment usually supports the labeling of scan results, so the scan results can be labeled by the staff.
  • the store includes a plurality of shelves, and each shelf is used to place a specific storage object (for example, "goods", etc.)
  • the number of the shelf, the data object identifier (for example, the product ID, etc.) corresponding to the product may be Etc.
  • the system can save the information of each shelf number, corresponding product information, etc.
  • the system can automatically generate and save information about the position and coordinates of each shelf and goods, thereby generating a three-dimensional space model corresponding to the store.
  • the data object details and the like need to be provided, and the data object detail information database may be established in advance, and when the labeling is performed, the data object corresponding to the specific product may also be in the database.
  • the ID and other identifiers are marked so that the goods in the augmented reality space can be associated with the detailed information of the data objects stored in the database.
  • the Implement related clients including applications, or related functional modules, etc.
  • the client can be used in combination with AR devices in various forms.
  • the client can be directly installed in the AR device, so that the AR device has the embodiment of the present application. Interactivity in the middle.
  • the mobile AR device since the mobile AR device usually only undertakes a screen display task, in use, it is usually required to connect a mobile terminal device such as a mobile phone with the AR device, and therefore, in this case,
  • the client can be installed in a mobile terminal device such as a mobile phone.
  • the AR device can have the interactive function described in the embodiment of the present application.
  • the 3D space model is generated, it can be directly saved to the terminal device where the client is located, or can be stored in the server.
  • the client needs to interact, the third-dimensional space model corresponding to the current store is downloaded from the server. .
  • the AR device can implement specific interaction based on the client and the generated three-dimensional space model.
  • the third embodiment provides a data object interaction method in an augmented reality space environment, and the method may include the following steps:
  • Step 701 The client obtains a three-dimensional space model of the internal space environment of the physical store; the physical store includes multiple pieces of goods;
  • Step 702 After the three-dimensional space model is spatially matched with the physical store by the preset augmented reality AR device, the interaction area range information corresponding to the product is provided in a user view range of the AR device;
  • the relevant AR device (including an integrated AR device or a mobile AR device connected to the mobile terminal device) can be worn to enter the physical store, and then, Start the relevant client.
  • the initialization process may be performed first.
  • the method may include: spatially matching the three-dimensional space model with the physical store.
  • the so-called spatial matching that is, the three-dimensional space model can be matched with the actual physical store, so that the position in the three-dimensional space corresponds to the position, direction, and the like in the physical store, so that the "enhanced" information can be made accurate.
  • the display shows the location of the corresponding item within the field of view.
  • some feature points may be saved in a three-dimensional space model in advance, for example, four corner positions in a space, etc., and a consumer user wears AR glasses.
  • the application is first started. After that, the AR device can be used to look around the storage space while wearing the AR glasses.
  • the sensor device of the AR glasses can scan the storage space, and then the feature points can be utilized.
  • space matching can also be implemented in other ways, for example, automatic matching can be implemented, and the like, which will not be described in detail here.
  • the interaction area information corresponding to the goods may be provided in the user's field of view of the AR device, for example, by adding an “operation layer” in the scope of the view field, in the scope of the view field.
  • Display the operational areas of the shipment for example, display a "blue dot" at the location of each item, and so on.
  • Step 703 Determine a target item of interest to the user
  • Step 704 Providing information content related to the order confirmation, where the information content related to the order confirmation includes: attribute information associated with the target item and resource information to be paid;
  • Step 705 Match the voice of the user with the pre-trained voiceprint model, and trigger the payment operation when the matching is successful.
  • the fourth embodiment is the same as the three-phase embodiment, and is introduced from the perspective of the server. Specifically, referring to FIG. 8, the embodiment provides a data object interaction method in an augmented reality space environment, and the method may include:
  • Step 801 The server saves a three-dimensional space model of the internal space environment of the physical store, where the physical store includes multiple pieces of goods, corresponding interaction area range information, and interaction response information of the data objects associated with each interaction area range;
  • Step 802 Providing the three-dimensional space model to a client, so that the client performs spatial matching between the three-dimensional space model and the physical store through a preset augmented reality AR device on the AR device.
  • the three-dimensional model of the internal space environment of the physical store that the server can save is directly provided to the client, or, when receiving the request from the client, the related data is provided to the client, and after obtaining the corresponding data, the client obtains the corresponding data.
  • An augmented reality space environment can be provided, and interaction with the user can be realized based on the environment, and a complete shopping process can be realized.
  • the fifth embodiment is a device corresponding to the client method of the first embodiment.
  • the embodiment provides a data object interaction device in a virtual reality space environment, where the device is applied to a client,
  • the device includes:
  • a virtual reality environment providing module 901 configured to provide a virtual reality store object internal space environment, where the store object internal space environment includes at least one interactive data object;
  • a target data object determining module 902 configured to determine a target data object of interest to the user
  • the order information providing module 903 is configured to provide information content related to the order confirmation, where the information content related to the order confirmation includes: attribute information associated with the target data object and resource information to be paid;
  • the matching module 904 is configured to match the voice of the user with the pre-trained voiceprint model, and trigger the payment operation when the matching is successful.
  • the device may further include:
  • An order determination module for determining that the user has completed the confirmation of the order information.
  • the order determining module may include:
  • a verification content providing submodule configured to provide verification content when the information content related to the order confirmation is provided, where the verification content is generated according to at least part of the attribute information of the target data object;
  • the verification content identification sub-module is configured to identify whether the verification content is included in the voice of the user, and if yes, determine that the user has completed confirmation of the order information.
  • the matching module includes: a matching sub-module, configured to match a voice and a pre-trained voiceprint model sent by the user, including the verification content.
  • the order determining module may include:
  • a verification code providing sub-module for providing a verification code when providing information content related to the order confirmation
  • the check code identification sub-module is configured to identify whether the check code is included in the voice of the user, and if yes, determine that the user has completed the confirmation of the order information.
  • the check code is randomly generated by the client.
  • the matching module includes: a matching sub-module, configured to match a voice and a pre-trained voiceprint model sent by the user.
  • the check code identifying submodule is further configured to: when the check code is not included in the voice of the identifying user, trigger the verification code providing submodule, so that the verification code providing module provides another check Code, then the check code The identification sub-module then identifies whether the user's voice contains another check code, and if so, determines that the user has completed the confirmation of the order information.
  • the order determining module may include:
  • a line-of-sight focus position determining sub-module for determining a user's line of sight focus position
  • the order determining sub-module is configured to determine that the user has completed the confirmation of the order information when the line-of-sight focus position enters the interaction area of the information content related to the order confirmation, and the time of staying reaches the preset time threshold.
  • the order determining module may include:
  • the voice recognition sub-module is configured to identify whether the voice of the user includes content capable of characterizing the confirmation order, and if yes, determine that the user has completed the confirmation of the order information.
  • the target data object determining module may include:
  • a line-of-sight focus position determining sub-module for determining a user's line of sight focus position
  • a target data object determining submodule configured to determine the data object as a target data object of interest to the user when the line of sight focus position enters an interaction area of a certain data object and the time of stay reaches a preset time threshold .
  • the target data object determining module may include:
  • the voice recognition sub-module is configured to identify whether the voice of the user includes information content associated with a certain data object in the interactive data object, and if yes, use the data object as a target data object of interest to the user.
  • the device further includes:
  • the prompting module is configured to provide an information content for prompting the user to select invalid when the voice of the user does not include the information content associated with a certain data object in the interactive data object.
  • the matching module may include:
  • a voiceprint model selection submodule configured to select, according to a device identifier or a user identifier of the client, a voiceprint model corresponding to the device identifier from a plurality of pre-trained voiceprint models or select corresponding to the user identifier Voiceprint model;
  • Matching sub-module for matching the user's voice with the selected voiceprint model.
  • the device further includes: a voiceprint model training module,
  • the voiceprint model training module includes:
  • a voice collection sub-module for collecting multiple voices of a user
  • An extraction submodule configured to extract respective MFCC cepstrum coefficients of each of the plurality of speeches
  • a training submodule configured to obtain, according to the MFCC cepstrum coefficient, a voiceprint model corresponding to the user.
  • the device further includes: a voiceprint model optimization module, configured to optimize the voiceprint model of the user in the pre-trained voiceprint model by using the voice sent by the user.
  • a voiceprint model optimization module configured to optimize the voiceprint model of the user in the pre-trained voiceprint model by using the voice sent by the user.
  • the sixth embodiment is a device corresponding to the server-side method of the second embodiment.
  • the embodiment provides a data object interaction device in a virtual reality space environment, where the device is applied to a server,
  • the device includes:
  • the environment data storage module 1001 is configured to save virtual reality store object internal space environment data, where the store object internal space environment data includes at least one interactive data object, where the interactive data object corresponds to an interaction area range, and is associated with Preset information content;
  • the environment data providing module 1002 is configured to provide the virtual reality store object internal space environment data to the client, so that the client provides the virtual reality store object internal space environment data, and determines the target data object that the user is interested in; providing The order confirmation related information content, the information content related to the order confirmation includes: attribute information associated with the target data object and resource information to be paid; matching the voice of the user and the pre-trained voiceprint model, when the matching is successful, Trigger a payment operation.
  • the seventh embodiment is a device corresponding to the third client method.
  • the embodiment provides a data object interaction device in an augmented reality space environment, where the device is applied to a client,
  • the device includes:
  • the space model obtaining module 1101 is configured to obtain a three-dimensional space model of the internal space environment of the physical store; the physical store includes multiple pieces of goods;
  • the space model matching module 1102 is configured to provide the corresponding item in the user's field of view of the AR device after spatially matching the three-dimensional space model with the physical store by a preset augmented reality AR device.
  • Interactive area range information
  • a target item determination module 1103, configured to determine a target item of interest to the user
  • the order information providing module 1104 is configured to provide information content related to the order confirmation, which is related to the order confirmation
  • the information content of the information includes: attribute information associated with the target item and information about the resource to be paid;
  • the matching module 1105 is configured to match the voice of the user with the pre-trained voiceprint model, and trigger the payment operation when the matching is successful.
  • the eighth embodiment is a device corresponding to the server-side method of the fourth embodiment.
  • the embodiment provides a data object interaction device in an augmented reality space environment, where the device is applied to a server,
  • the device includes:
  • the storage module 1201 is configured to save a three-dimensional space model of the internal space environment of the physical store, where the physical store includes multiple pieces of goods, corresponding interaction area range information, and interaction response information of the data objects associated with each interaction area range;
  • a spatial model providing module 1202 configured to provide the three-dimensional space model to a client, after the client performs spatial matching between the three-dimensional space model and the physical store through a preset augmented reality AR device, Providing the interactive area range information corresponding to the goods in the user's field of view of the AR device, determining the target item of interest to the user; providing information content related to the order confirmation, wherein the information content related to the order confirmation includes: The attribute information associated with the target item and the information to be paid are matched; the matching user's voice and the pre-trained voiceprint model trigger the payment operation when the matching is successful.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Finance (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

一种虚拟现实/增强现实空间环境中的数据对象交互方法及装置，其中，虚拟现实的数据对象交互方法可以提供虚拟现实店铺对象内部空间环境，这样，用户可以获得置身于三维空间环境中的体验，并且，具体的交互流程可以通过语音来实现，对于用户而言，只需要说话即可实现交互，无需借助于外接的手柄等手动输入设备，最重要的是，在支付环节，无需手动支付，而是通过用户的声纹特征来判断支付操作的合法性，进而决定是否触发支付，保证了用户在虚拟现实场景下购物支付的安全性。基于增强现实技术实现的技术方案采用类似的技术思路，能达到相同的技术效果。

Description

一种虚拟现实/增强现实空间环境中的数据对象交互方法及装置
本申请要求2016年10月21日递交的申请号为201610921190.X、发明名称为“一种虚拟现实/增强现实空间环境中的数据对象交互方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及虚拟现实/增强现实技术领域，特别涉及一种虚拟现实/增强现实空间环境中的数据对象交互方法及装置。
背景技术
虚拟现实(Virtual Reality，简称VR)是一种可以创建和体验虚拟世界的计算机仿真系统。这种系统生成的各种虚拟环境，作用于用户的视觉、听觉、触觉，使用户产生身临其境的感觉，沉浸其中。而所谓的虚拟世界则是虚拟环境或者给定仿真对象的集合。虚拟现实是近年发展起来的一项新技术。
增强现实(Augmented Reality,简称AR)是一种将真实世界信息和虚拟世界信息“无缝”集成的新技术，是把原本在现实世界的一定时间空间范围内很难体验到的实体信息(视觉信息，声音，味道，触觉等)，通过电脑等科学技术，模拟仿真后再叠加，将虚拟的信息应用到真实世界，被用户所感知，从而达到超越现实的感官体验。
目前，VR/AR技术还处于开发阶段，尚无打通整个网络购物支付链路的虚拟现实/增强现实的互动体系。
发明内容
本发明所要解决的技术问题是提供一种虚拟现实/增强现实空间环境中的数据对象交互方法，该方法能够完全释放用户在使用头显设备时的手部操作，为用户提供了无需手部操作完成购物支付的方案，能够使得虚拟现实/增强现实空间环境的购物体验更接近于线下实体店铺，为用户提供一种一站沉浸式购物体验。
另外，本发明还提供了一种虚拟现实/增强现实空间环境中的数据对象交互装置，以保证上述方法在现实中的应用及实现。
在本发明第一方面提供了一种虚拟现实空间环境中的数据对象交互方法，所述方法 包括：
客户端提供虚拟现实店铺对象内部空间环境，所述店铺对象内部空间环境中包括至少一个可交互数据对象；
确定用户感兴趣的目标数据对象；
提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；
匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
在本发明第二方面提供了一种虚拟现实空间环境中的数据对象交互方法，所述方法包括：
服务器保存虚拟现实店铺对象内部空间环境数据，所述店铺对象内部空间环境数据中包括至少一个可交互数据对象，所述可交互数据对象对应有交互区域范围，并关联有预置的信息内容；
将所述虚拟现实店铺对象内部空间环境数据提供给客户端，以便所述客户端提供虚拟现实店铺对象内部空间环境数据，确定用户感兴趣的目标数据对象；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
在本发明第三方面提供了一种增强现实空间环境中的数据对象交互方法，所述方法包括：
客户端获得实体店铺内部空间环境的三维空间模型；所述实体店铺内部包括多件货品；
在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息；
确定用户感兴趣的目标货品；
提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
在本发明第四方面提供了一种增强现实空间环境中的数据对象交互方法，所述方法包括：
服务器保存实体店铺内部空间环境的三维空间模型，所述实体店铺内部包括多件货 品，各自对应的交互区域范围信息，以及与各交互区域范围关联的数据对象的交互响应信息；
将所述三维空间模型提供给客户端，以便所述客户端在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息，确定用户感兴趣的目标货品；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
在本发明第五方面提供了一种虚拟现实空间环境中的数据对象交互装置，所述装置包括：
虚拟现实环境提供模块，用于提供虚拟现实店铺对象内部空间环境，所述店铺对象内部空间环境中包括至少一个可交互数据对象；
目标数据对象确定模块，用于确定用户感兴趣的目标数据对象；
订单信息提供模块，用于提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；
匹配模块，用于匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
在本发明第六方面提供了一种虚拟现实空间环境中的数据对象交互装置，所述装置包括：
环境数据存储模块，用于保存虚拟现实店铺对象内部空间环境数据，所述店铺对象内部空间环境数据中包括至少一个可交互数据对象，所述可交互数据对象对应有交互区域范围，并关联有预置的信息内容；
环境数据提供模块，用于将所述虚拟现实店铺对象内部空间环境数据提供给客户端，以便所述客户端提供虚拟现实店铺对象内部空间环境数据，确定用户感兴趣的目标数据对象；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
在本发明第七方面提供了一种增强现实空间环境中的数据对象交互装置，所述装置包括：
空间模型获取模块，用于获得实体店铺内部空间环境的三维空间模型；所述实体店 铺内部包括多件货品；
空间模型匹配模块，用于在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息；
目标货品确定模块，用于确定用户感兴趣的目标货品；
订单信息提供模块，用于提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；
匹配模块，用于匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
在本发明第八方面提供了一种增强现实空间环境中的数据对象交互装置，所述装置包括：
存储模块，用于保存实体店铺内部空间环境的三维空间模型，所述实体店铺内部包括多件货品，各自对应的交互区域范围信息，以及与各交互区域范围关联的数据对象的交互响应信息；
空间模型提供模块，用于将所述三维空间模型提供给客户端，以便所述客户端在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息，确定用户感兴趣的目标货品；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
本发明提供的上述技术方案与现有技术相比，具有如下优点：
利用本发明提供的技术方案，可以提供虚拟现实店铺对象内部空间环境，这样，用户可以获得置身于三维空间环境中的体验，并且，具体的交互流程可以通过语音来实现，对于用户而言，只需要说话即可实现交互，无需借助于外接的手柄等手动输入设备，最重要的是，在支付环节，无需手动支付，而是通过用户的声纹特征来判断支付操作的合法性，进而决定是否触发支付，保证了用户在虚拟现实场景下购物支付的安全性。
另外，本发明提供的技术方案，还可以基于增强现实技术来实现，具有上述相同的优点。
附图说明
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1是本申请实施例提供的一种虚拟现实设备的结构示意图；
图2是本申请实施例提供的客户端的一种虚拟现实空间环境中的数据对象交互方法的流程示例图；
图3-1是本申请实施例提供的数据对象的相关信息的展示结构图；
图3-2是本申请实施例提供的数据对象的详细信息的展示示例图；
图4是本申请实施例提供的“与订单确认信息相关的信息内容”的展示示意图；
图5-1是本申请实施例提供的虚拟现实的主导航空间的示例图；
图5-2是本申请实施例提供的图形呈现结构图；
图6是本申请实施例提供的服务器端的一种虚拟现实空间环境中的数据对象交互方法的流程示例图；
图7是本申请实施例提供的客户端的一种增强现实空间环境中的数据对象交互方法的流程示意图；
图8是本申请实施例提供的服务器端的一种增强现实空间环境中的数据对象交互方法的流程示意图；
图9是本申请实施例提供的客户端的一种虚拟现实空间环境中的数据对象交互装置的结构示例图；
图10是本申请实施例提供的服务器端的一种虚拟现实空间环境中的数据对象交互装置的结构示例图；
图11是本申请实施例提供的客户端的一种增强现实空间环境中的数据对象交互装置的结构示例图；
图12是本申请实施例提供的服务器端的一种增强现实空间环境中的数据对象交互装置的结构示例图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基 于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
在本申请实施例中，为了使得用户的线上购物流程更逼近实际在线下实体店铺中的购物体验，提出了通过虚拟现实的方式提供店铺对象内部空间环境，其中可以包括多个可交互的数据对象(例如，商品对象等)，用户可以在这种虚拟现实空间环境中进行数据对象的浏览，并进行交互。由于虚拟现实空间环境具有三维立体的效果，因此，用户看到的数据对象不再是简单的数据对象列表，而是像线下的实体店铺中一样，可以看到三维立体的空间，其中具有货架等，数据对象可以摆放在货架上，用户可以从货架上取下具体的数据对象进行查看其详情，等等，因此，可以更接近实际在线下实体店铺中购物的体验。
另外，在本申请实施例中，为了进一步提升用户体验，在用户与系统进行交互的过程中，可以不必使用手柄等外部输入设备，而是可以语音识别的方式来判断用户的购物意图，并进而实现与用户之间的互动，更进一步地通过声纹特征识别的方式来完成支付操作，这样，在无手柄等外部输入设备辅助的情况下，用户仅通过语音交互就可以获得更接近线下实体店铺中购物的体验，增强用户的沉浸感。
为了实现上述技术方案，在软件方面，可以通过服务器-客户端的架构来实现，其中，服务器主要用于提供数据支持，例如，可以实现多个店铺对象的虚拟现实内部空间环境数据，并提供给客户端。客户端主要用于数据的前端展示，以及与用户之间进行互动。其中，该客户端可以是独立的应用程序，或者，还可以是一些综合性应用程序中的功能模块等，例如，可以是“手机淘宝”、“淘宝”等移动终端App中的功能模块，等等。
在硬件方面，首先可以用到一种虚拟现实设备，这种虚拟现实设备可以是集存储、计算、屏显等功能为一体的“一体式”虚拟现实设备，或者，还可以是仅具有屏显功能的“外接式”或者“移动式”虚拟现实设备。其中，对于一体式虚拟现实设备而言，由于其本身带有存储、计算等功能，因此，可以直接将前述客户端程序安装或者内置于这种虚拟现实设备中。而对于“外接式”虚拟现实设备而言，由于在实现时依赖于外接的PC(个人计算机)机等设备，因此，可以将客户端程序安装与这种PC机中，再将外接式虚拟现实设备连接到该PC机上，实现虚拟现实空间环境及互动。另外，对于“移动式”虚拟现实设备而言，在实现时需要与手机等智能移动终端设备配合使用，例如，“VR眼镜盒子”等，在使用时，可以将手机等智能移动终端设备放入眼镜盒子中，具体的存储、计算等功能由智能移动终端设备完成，“VR眼镜盒子”仅用于实现屏显的相关功能。 因此，参见图1，对于这种虚拟现实设备，可以将客户端程序安装或者内置与智能移动终端设备中，再将这种智能移动终端设备与移动式虚拟现实设备进行连接，两者相互配合实现本申请实施例中的功能。
下面首先从前述客户端的角度，对本申请实施例提供的具体实现方案进行详细介绍。
实施例一
在本申请实施例一中，首先提供了一种虚拟现实空间环境中的数据对象交互方法，参见图2，该方法可以包括以下步骤201至步骤205：
步骤201：客户端提供虚拟现实店铺对象内部空间环境，所述店铺对象内部空间环境中包括至少一个可交互数据对象；
其中，所谓的店铺对象可以是指商家等在在线销售平台中开设的“店铺”，在本申请实施例中，这种店铺对象在线下还可以关联有实体店铺，例如，超市、服装专卖店等等。具体实现时，可以通过建模的方式，模拟线下店铺中的布局、商品陈列方式等，生成模拟的店铺内部空间环境，或者，为了进一步提升环境的真实性体验，还可以通过到线下实体店铺中进行录制视频的方式，来建立店铺对象内部空间环境，在虚拟现实设备中向用户提供店铺内部空间环境时，可以通过播放这种视频的方式来进行，从而使得用户可以获得更接近现实的购物体验。
具体的，由于提供给用户观看的虚拟现实空间环境是通过录制的视频提供的，而录制的视频中，画面具有整体性，也即，每一帧画面都是一个整体，因此，为了使得用户能够与画面中的数据对象进行互动，以实现后续的查看详情、购买等流程，还可以对录制好的视频进行处理。具体的处理过程，也就是对视频中出现的数据对象进行标记，例如，在视频画面中出现某中商品的位置，可以通过鼠标点击等方式，输入该商品的ID等标识信息，这样，后续在与用户进行互动的过程中，可以通过后台保存的数据库，确定出该商品ID对应的详情信息等内容。这样，通过这种标记操作处理，可以使得视频画面中出现的数据对象具有可交互性。
用户在进入店铺对象内部的空间环境后，实现与数据对象的交互，能够查看到数据对象的关联的信息内容，如数据对象的详情信息。
例如，在一种具体实现方式下，数据对象的详细信息可以包括数据对象的立体图像信息，以及文字性质的描述信息。如图3-1所示，还可以展示出详情信息从该数据对象的标记点位置呈“发散状”由小变大的过程。并且，这些详情信息可以是以所述立体图像信息为中心，所述文字性质的描述信息显示在所述立体图像的周围。也就是说，可以 将立体图像信息与文字信息分开进行展示，并且，还可以提供用于对所述立体图像进行旋转的操作控件，这样，当用户视线焦点进入到该操作控件所在的区域范围时，可以将所述立体图像进行旋转操作，可以展示出该数据对象多个视角的立体图像。并且，这种操作控件可以包括用于向不同方向旋转的多个操作控件，例如，可以是顺时针和逆时针两个旋转方向，等等。
例如，如图3-2所示，其为用户视线焦点对准某闹钟后，呈现出的该闹钟的详情信息(分为左右两幅画面，对应人眼的双目视觉)，可见，详情信息中包括该闹钟的立体图像，其位于中央位置301处，周围302处可以展示出数据对象的名称、价格等多项详情信息。并且，在中央的立体图像下方，还提供了两个旋转控件303，分别用于向顺时针方向和逆时针方向旋转立体图像。需要说明的是，关于该图3-2中具体现实的详情信息内容，本申请实施例中并不进行限定，因此，图中显示文本或者图片信息的清晰程度不会影响本申请实施例的保护范围。
其中，数据对象的立体图像可以是通过对实际货品进行拍照获得的照片生成的，实拍的照片可以是从多个视角拍摄的多张照片，合成得到三维立体的展示效果，并且可以通过旋转该立体图像改变视角，从多个角度全方位的了解数据对象的详情。
在本申请实施例中，为了能够提供关于数据对象的360度的立体图像，并且使得立体图像具有真实性的展示效果，前期的数据处理操作还可以包括：将具体的数据对象对应的货品从多个拍摄角度进行拍照，并保存多个拍摄角度拍摄的照片，这样，后续在用户具有查看多个角度的立体图像的需求时，可以根据保存的多张照片来提供。
步骤202：确定用户感兴趣的目标数据对象；
在进入到店铺对象内部的空间环境后，用户可以与数据对象之间的交互，从而确定自己的购物目标，对于系统而言，根据用户的交互情况就可以识别用户的购物意图。
具体在识别用户意图时，本申请实施例可以不必借助手柄等外部输入设备，也不需要通过VR设备发射某种射线等方式来确定，而是可以通过用户语音交互的方式来确定用户的购物意图，或者，可以通过识别用户视线焦点位置来识别用户的购物意图。
在本申请实施例中，具体实现时，步骤202可以按照如下方式实现：
识别用户的语音是否包含所述可交互数据对象中的某一数据对象关联的信息内容，若是，则将该数据对象作为用户感兴趣的目标数据对象。
具体实现时，用户在查看了解了数据对象的详细信息后，可以通过VR设备的录音部件如麦克风，录入语音，通过语音交互的方式指出自己感兴趣的目标数据对象。客户 端接收到该语音，对该语音进行识别，识别该语音中是否包含当前提供的虚拟现实店铺对象内部空间环境中某一个或者多个可交互数据对象的相关信息内容，其中，一个可交互数据对象的相关信息内容是能够明确对应该可交互数据对象的内容。在实际应用中，也可以进一步识别用户的语音中是否包含能够表征购买意图含义的内容，其中，能够表征购买意图含义的内容可以包括：表征购买意图的词语，如“加入购物车”、“立即购买”，等等。
在本申请实施例中，具体实现时，步骤202可以按照如下方式实现：
确定用户视线焦点位置；以及，
当所述视线焦点位置进入某一数据对象的交互区域范围内，且停留的时间达到预置时间阈值时，将该数据对象确定为用户感兴趣的目标数据对象。
如果用户在查看数据对象的详细信息后，认为该数据对象满足自己的需求，则会产生购买该数据对象的意图，此时，用户可以将视线焦点对准该数据对象所在的交互区域范围，并在视线焦点停留一定时间后，系统即可识别出用户的该购物意图。
另外，在提供数据对象信息详情时，还可以提供用于对该数据对象执行购买操作的操作控件，如图3-2中304处所示的“立即购买”按钮等。当用户视线焦点进入到“立即购买”按钮所在的区域范围内，且停留的时间达到预置时间阈值时，则可以确定该数据对象为用户感兴趣的目标数据对象。也就是说，如果用户在查看目标数据对象的详情后，认为该数据对象满足自己的需求，则会产生购买该数据对象的意图，此时，用户可以将视线焦点对准“用于对该数据对象执行购买操作的操作控件”所在的区域范围，并在视线焦点停留一定时间后，系统即可识别出用户的该购买意图。
具体实现时，还可以结合用户视线焦点位置和用户语音来确定用户感兴趣的目标数据对象；根据用户视线焦点位置先确定用户感兴趣的数据对象，然后，再识别用户的语音中是否包含能够表征购买意图含义的内容，其中，能够表征购买意图含义的内容可以包括：表征购买意图的词语，如“加入购物车”、“立即购买”，等等。在实际应用中，可以预先收集能够表征购买意图的词语，然后，在识别用户语音时，解析用户语音内容，将语音内容转成文本内容，对文本内容进行分词处理，然后通过词形、词义匹配的方式来进行识别。
步骤203：提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；
经过步骤202识别出用户的购物意图后，就提供用于进行订单确认的相关信息，如 图4中401处所示的“与订单确认相关的信息内容”，具体实现时，与订单确认相关的信息内容，可以包括多方面的信息，具体可以包括确定收货地址、购买的数据对象的名称、购买的数据对象数量、是否使用某种“优惠券”等虚拟资源，等等。
具体实现时，可以提供第一信息面板，在该第一信息面板上提供所述与订单确认相关的信息内容。当用户视线焦点位置从所述第一信息面板移开时，将所述第一信息面板关闭。该第一信息面板的面积可以小于用户视域范围的面积，为了便于退出当前与订单确认相关的信息内容的展示，本申请实施例中还提供了相应的实现方式。
具体的，可以对用户的视线焦点进行跟踪，当用户视线焦点位置从该第一信息面板移开时，则可以将该第一信息面板关闭，相应的，当前与订单确认相关的信息内容不再展示，用户可以继续浏览其他的数据对象。也就是说，在这种方式下，可以不必在第一信息面板中设置“关闭按钮”等操作控件，用户只需要将视线焦点从该信息面板所在的区域内移开，即可触发该第一信息面板的关闭，从而可以更加方面用户的操作。
在展示该与订单确认相关的信息内容的页面上，还可以分别提供用于确认各项信息的操作控件。
具体实现时，所述与订单确认相关的信息内容还可以包括：用于对订单相关信息进行修改的第一操作控件；
当用户视线焦点进入到所述第一操作控件所在的区域范围内，且停留的时间达到预置时间阈值时，提供第二信息面板，并在所述第二信息面板中提供用于修改所述订单相关信息的内容。
例如，假设用户需要对当前默认的收货地址进行修改，则可以通过该第一操作控件进行触发。具体的，在本申请实施例中，同样可以通过视线熔断的方式来进行触发。也就是说，当用户视线焦点进入到所述第一操作控件所在的区域范围内，且停留的时间达到预置时间阈值时，提供第二信息面板，并在所述第二信息面板中提供用于修改所述订单相关信息的内容。其中，如果用户选择了其他的收货地址，则第二信息面板自动关闭，如果用户在浏览了各收货地址后，不需要修改，则可以通过该第二信息面板中的关闭按钮等操作空间，来关闭该第二信息面板，或者，通过语音控制关闭。此时，继续进行第一信息面板的展示。
具体实现时，所述与订单确认相关的信息内容还可以包括：用于对目标数据对象数量进行增加/减少操作的第二操作控件；
当用户视线焦点位置进入所述第二操作控件，且停留的时间达到预置时间阈值时， 将所述目标数据对象的数量在原值基础上执行加一/减一操作。
如果所述视线焦点位置进入所述第二操作控件，且停留的时间达到预置时间阈值后仍未离开，则继续对所述目标数据对象的数量执行加一/减一操作，且继续执行加一/减一操作时，执行的时间间隔小于所述预置时间阈值。
在实际应用中，可能具有购买多件的需求，此时，用户需要对这种第二操作控件连续操作多次，如果不做特殊处理，则用户需要先将视线焦点对准该第二操作控件，停留3S后，数据对象数量加1，然后将视线焦点从该控件移开，然后再进入该控件，以此类推，需要重复执行多次，显然，这会占用较多的时间，并且也会使用户觉得不够方便。
为此，在本申请实施例中，还可以进行以下特殊处理：如果所述视线焦点位置进入所述第二操作控件，且停留的时间达到预置时间阈值后仍未离开，则继续对所述目标数据对象的数量执行加一/减一操作，且继续执行加一/减一操作时，执行的时间间隔小于所述预置时间阈值。也就是说，用户视线聚焦在这种第二操作控件(例如，执行“增加”操作的控件)上时，触发第一次熔断过程，经历预置的时间阈值之后，将数据对象数量在原来的基础上加1，之后，如果视线未离开，则触发第二次熔断，每次熔断后，数据对象数量都在原来基础上再加1，并且，后续每次熔断过程经历的时间可以有所缩短，例如，第一次为3S，第二次可以为2S，第三次可以为1S，以此类推。当然，还可以对最短的熔断时间进行限制，例如，最短不能短于1S，则意味着第四次以及后续各次熔断过程都可以是经历1S的时间。
在完成各项信息的确认操作后，就可以提交订单，进入到后续的支付操作流程。客户端在提供与订单确认相关的信息内容之后，认为用户已知晓订单相关信息后，可以直接执行步骤204，也可以通过以下方式与用户交互，先确定用户完成订单信息的确认，然后再执行步骤204。
一种方式是，在提供与订单确认相关的信息内容时，还提供校验内容，所述校验内容根据目标数据对象的至少部分属性信息生成；然后，识别用户的语音中是否包含所述校验内容，若是，则确定用户已完成订单信息的确认。
其中，目标数据对象的属性信息是指与目标数据对象相关的能够表征目标数据对象特性的信息，可以包括：商品标题、商品颜色、商品尺寸、型号、材质、品牌、配置、等级、包装容量、生产日期、保质期、用途、价格、产地等等，则上文中的校验内容就是根据目标数据对象的一个或者多个属性信息而生成的。
例如：用户感兴趣的目标数据对象是金色的ihpone7手机，则按照上述方式，可以 获取该目标数据对象的属性信息，然后根据至少部分属性信息生成“校验内容”，例如，该校验内容是“金色iphone7 Plus 256GB行货”，在本申请实施例中，为用户提供该校验内容主要是方便用户快速确认自己要购买的商品，并通过语音交互方式确认此次购买行为。另外，还可以通过文字提示用户通过读取该校验内容来确定订单。用户查看到该校验内容，读出该校验内容，系统就会识别用户的语音，判断该语音中是否包含“金色iphone7 Plus 256GB行货”的内容，如果包含，则确定用户语音确认了订单信息。在后续匹配时，仅需要将用户输出的包含该校验内容的语音与预先训练的声纹模型进行匹配，这样既能保证匹配结果的可靠性，也能够加快匹配效率，还能够简化用户的交互操作。
另一种方式是，在提供与订单确认相关的信息内容时，客户端还提供一个校验码；然后，识别用户的语音中是否包含该校验码，若是，则确定用户已完成订单信息的确认。其中，所述校验码可以是由客户端随机生成的。
在实际应用中，可能会出现由于用户看错校验码或者发音不准，导致识别失败的情况，则针对这种情况，在具体实现时，还可以再发送另一串随机数，以使用户根据所述另一串随机数重新执行确认订单信息的操作。可以看出，通过多次发送校验码的方式，给用户提供多次确认订单信息的机会，具有一定的容错性；例如：可以允许用户做N次尝试，N可以根据实际需求而设定，如可以设置为3。
由于除了用户自己之外，他人很难看到该校验码，因此，通过该方式能够有效防止他人非法触发确认订单的操作，能够有效保障虚拟现实场景下的订单支付的安全性。
另一种方式是，确定用户视线焦点位置；当所述视线焦点位置进入该与订单确认相关的信息内容的交互区域范围内，且停留的时间达到预置时间阈值时，确定用户已完成订单信息的确认。
具体实现时，客户端在提供与订单确认相关的信息内容之后，在发现用户的视线焦点进入到该“与订单确认相关的信息内容”的交互区域范围内时，就可以触发“熔断”机制，也即，可以通过一个计时器开始进行计时，如果在该交互区域范围内的停留时间达到某时间阈值(例如，3S)，则可以确定用户确认了该订单内容，然后客户端就执行步骤204。
还有一种方式是，识别用户的语音中是否包含能够表征确认订单含义的词语，若是，则确定用户已完成订单信息的确认。
具体实现时，客户端提供了与订单确认相关的信息内容之后，获取用户在查看此信息内容后发出的语音，然后，客户端识别该语音中是否包含能够表征确认订单含义的词 语，其中，能够表征确认订单含义的词语可以包括：“下单”、“确认”、“支付”、“ok”等词语。
步骤204：匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
由于，支付操作涉及用户的财产和隐私，在真实世界中，用户提供银行卡并自己手动输入密码，或者用户自己使用智能终端当面进行网络支付，这种支付行为都能够保证用户支付操作的合法性，但在虚拟现实场景下，用户不能够实施这种支付行为，因此，本申请实施例中，还需要对用户身份合法性进行验证，以确认此次支付的合法性和安全性，以有效避免非法者的恶意支付操作。
在本申请实施例中，提出了利用用户的声纹特征对用户身份的合法性进行验证，由于每个人的声纹特征都是独特的，具有唯一性，一般情况下是很难被他人模仿，因此，通过声纹特征进行用户身份的合法性的验证能够保证验证的可靠性。
在本申请实施例中，关于步骤204中的如何匹配用户的语音与预先训练的声纹模型还提供了几种可选的方式，下面对这几种方式进行解释说明。
一种方式是，收集用户的语音，然后匹配收集到的语音与预先训练的声纹模型，如果，收集到的所有语音与预先训练的某一声纹模型相匹配，则表明匹配成功，此时，触发支付操作。在支付成功时，还可以提供支付成功信息，若由于某种原因导致支付失败时，也可以提供支付失败信息，以提示用户此次支付失败，例如，提示用户账户余额不足，无法完成支付等。
另一种方式是，根据客户端的设备标识或者用户标识，从预先训练的多个声纹模型中选定与所述设备标识对应的声纹模型或选定与所述用户标识对应的声纹模型；然后再匹配用户的语音与选定的声纹模型。
在这种方式中，用户的语音可以理解为用户在使用VR设备时发出的所有语音，这样，可以保证匹配结果的可靠性。该用户的语音也可以是用户在查看“与订单确认相关的信息内容”之后所发出的语音，这样可以减少匹配的运算量。
利用这种方式相比遍历性模型匹配，能够极大提高匹配效率。其中，设备标识是指客户端的唯一标识，如客户端ID等，用户标识是指能够识别用户的唯一标识，如用户名、用户编号等标识。
在本申请实施例中，关于触发支付操作可以理解为，客户端可以触发本地配置的用于完成支付业务的APP，使该APP根据用户预先注册的相关支付账户信息完成支付，例如，将用户账户的资金转移到商户账户。该触发支付操作也可以理解为，客户端触发用 于完成支付业务的服务器，该服务器根据用户预先注册的相关支付账户信息完成支付。用户的相关支付账户信息可以包括：用户银行账户和密码，用户虚拟资源账户和密码等。在完成支付之后，客户端还可以提供支付结果信息，以通知用户此次支付操作成功或者失败。
为了支持对用户身份合法性的验证，在本申请实施例中，需要预先训练得到用户的声纹模型，在实现时，可以通过以下训练方式预先完成声纹模型的训练，该训练方式包括：
采集用户的多条语音；
提取所述多条语音中的每条语音各自的MFCC倒谱系数；
根据所述MFCC倒谱系数训练得到所述用户对应的声纹模型。
在实际训练时，可以采用离线方式采集用户的多条语音，语音个数越多，训练的模型越可靠。在实现时，用户可以通过手机或者其他终端录制自己的语音，将录制好的语音上传到语音采集系统；当然，用户也可以在该语音采集系统提供的录音接口，直接录制自己的语音；该语音采集系统先对接收到的语音进行预处理，预处理主要是为了去除非语音信号和静默语音信号，并对语音信号进行分帧处理，以后续的模型训练提供数据基础。在训练之前先提取每一帧语音信号的(Mel Frequency Cepstrum Coefficient，MFCC)参数，MFCC，Mel频率倒谱系数的缩写，Mel频率是基于人耳听觉特性提出来的，它与Hz频率成非线性对应关系。MFCC则是利用它们之间的这种关系，计算得到的Hz频谱特征。每个人声音频谱是独特的，则MFCC能够唯一标识用户的声音特征。在声纹模型训练时，本发明可以采用高斯混合模型，利用用户上传的语音以及语音对应的MFCC参数，训练高斯混合模型，得到专属于该用户的声纹模型。
这里需要说明的是，为了使得预先训练的声纹模型能够真实地表征用户实际的声纹特征，本申请实施例还提供了关于对声纹模型进行优化的方法。
具体实现时，收集用户在虚拟现实场景下的语音，利用收集到的语音对该用户的声纹模型进行优化。这种优化方式无需通过专门的渠道采集用户的语音，仅利用用户在虚拟现实场景下的语音对声纹模型进行优化即可，该方式简单可行，且优化效果的可靠性更强。
在本申请实施例中，可以仅预先训练某个特定用户的声纹模型，则仅为这一个用户提供服务，当然，为了给多用户提供服务，也可以针对多用户中的每个用户预先训练专属于独立用户的声纹模型。
可见，通过本申请实施例，可以通过虚拟现实的方式提供店铺对象内部空间环境，其中可以包括多个可交互的数据对象，并且，可以通过用户语音来确定用户的购物意图，进而通过用户的声纹特征来确定用户的支付意图，确保支付操作的安全性，整个过程不需要借助于手柄等外部输入设备，简化用户操作，从而提高用户的购物支付体验。
需要说明的是，在实际应用中，在前述步骤S201之前，还可以进行一些前期的准备工作。例如，以“移动式”虚拟现实设备(例如，VR眼镜盒子)为例，可以在手机等移动终端设备中安装本申请实施例提供的客户端，然后，将手机放入VR眼镜盒子中。另外，在实际应用中，还可能存在一些登录、输入收货地址等前期的配置操作，在本申请实施例中，为了保证用户能够在带上VR眼镜盒子以后，顺畅地购物，可以将复杂的配置操作前置在用户带上眼镜之前，可以包括：登录、添加收货地址、支付账户信息等。例如，用户通过手机上的“手机淘宝”客户端查看“双11会场”页面时，发现其中包括相关的虚拟现实入口，则可以通过该入口进入，此时，可以判断用户是否登录，是否已经添加收货地址等，如果没有，则可以引导用户执行登录、添加收货地址的操作。另外，还可以提醒用户将手机横向放置，并且，还可以显示预置的小动画。需要说明的是，在实际应用中，除了判断用户是否登录等，还可以判断用户使用的手机等移动终端设备的机型是否支持，如果不支持，则可以进行提示。另外，还可以判断当前的客户端版本是否支持，如果不支持，可以引导用户进行客户端版本的升级，等等。在该流程的最后一步，可以将手机放入VR眼镜盒子。
由于具有以虚拟现实方式进行展示的店铺对象可能有多个，因此，手机置入VR眼镜盒子之后，还可以首先进入主导航空间，也即，用于选择店铺对象的空间环境。它相当于网站的首页，但不同的是，该体系中主导航空间是个三维空间，用户可以通过上下左右转动头部探索它。其中，在一种具体的实现方式下，如图5-1所示，在该主导航空间中，视线初始的位置可以是一堵照片墙，墙上每个动态的照片代表世界上某个国家某个城市某条街上的一家店铺，动态照片中展示的内容同样可以是真实录制的店面视频，例如，包括店铺门面外的街景等。
为了使得用户能够从主导航空间中选择目标店铺对象，可以在这种主导航空间的环境层与屏幕层之间添加操作层。其中，环境层可以理解为是虚拟现实场景，操作层可以理解为GUI，屏幕层可以理解为客户端控件。如图5-2所示，在该操作层中，可以设定有分别与各个店铺对象的动态图片的位置和大小相对应的“包围盒”，并将这种“包围盒”作为对应店铺对象的交互区域范围，这样，用户可以通过将视线聚焦在某个店铺对 象对应的交互区域范围内并停留一段时间等方式，来触发进入该店铺对象的内部空间环境。
触发进入目标店铺对象后，客户端可以向服务器请求获取该目标店铺对象的虚拟现实空间环境数据，并进行解析渲染等操作，因此，从触发进入目标店铺，到实际展示出该目标店铺内部空间环境界面，可能会经历一段时间。在本申请实施例中，在该时间内，还可以主导航空间环境切换为与所述选定的店铺对象关联的过场视频，其中，所述过场视频用于展示去往该选定的店铺对象对应的线下实体店铺途中所能观看到的景物。例如，可以展示出“时空穿梭”效果，用户可以感觉到从当前的导航房间来到交通工具上，又来到具体店铺外的街上，最后进入店门，等等。其中，对于不同的店铺对象，由于对应的线下实体店铺所在的地理位置各有不同，因此，可以各自对应不同的过场视频，使得用户可以获得更加真实的体验。
实施例二
该实施例二是与实施例一相对应的，从服务器的角度，对本申请实施例提供的具体方案进行介绍。
具体的，参见图6，该实施例二提供了一种虚拟现实空间环境中的数据对象交互方法，该方法可以包括以下步骤：
步骤601：服务器保存虚拟现实店铺对象内部空间环境数据，所述店铺对象内部空间环境数据中包括至少一个可交互数据对象，所述可交互数据对象对应有交互区域范围，并关联有预置的信息内容；
具体实现时，服务器可以采集实体店铺中的相关视频数据等，并进行标注等处理操作，生成虚拟现实店铺对象内部空间环境数据，并进行保存。
步骤602：将所述虚拟现实店铺对象内部空间环境数据提供给客户端，以便所述客户端提供虚拟现实店铺对象内部空间环境数据，确定用户感兴趣的目标数据对象；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
服务器可以将生成的虚拟现实店铺对象内部空间环境数据直接提供给客户端，或者，也可以在接收到客户端的请求时，再将相关的数据提供给客户端，客户端在获得相应的数据后，便可以提供虚拟现实空间环境，并基于该环境实现与用户之间的交互，可以实现完整的购物流程。
关于该实施例二中其他的具体实现可以参见前述实施例一中的介绍，这里不再赘述。
实施例三
前述各实施例均是基于虚拟现实技术提供了各种具体的解决方案，而在具体实现时，还可以基于增强现实技术来实现。其中，关于虚拟现实与增强现实技术之间的区别，可以简单的理解为：虚拟现实环境中，“环境层”显示的内容是通过模拟或者预先对实体空间拍摄视频等方式提供的虚拟环境，“操作层”的信息，包括对可交互对象操作范围的标注、对交互响应信息的展示等，是基于这种虚拟的环境层中展示的内容来实现的；而增强现实空间环境中，“环境层”显示的内容是实体空间中实际的内容，“操作层”中的信息，包括对货品操作区域范围的标注信息等，可以是基于预先建立的三维空间模型进行标注，在实际显示时，首先将实体空间与三维空间模型进行空间匹配，然后再通过AR设备的计算机视觉能力进行定位，将三维空间模型中保存的标注信息等，展示在AR设备的视域范围内，用户实际透过AR设备看到的内容包括实体空间内的环境，以及叠加在该环境之上的“增强”的信息。
因此，在本申请实施例中，如果是基于增强现实技术来提供相应的技术方案，则可以预先针对线下的实体店铺进行创建三维空间模型，然后，基于该三维空间模型实现与用户的信息交互。
其中，为了建立三维空间模型，具体的实现方式可以有多种，例如，在其中一种方式下，可以由工作人员佩戴AR眼镜等AR设备进入到实体的店铺内部空间中，并在店铺内行走。由于AR设备带有摄像头等传感设备，因此，可以在行走的过程中，利用这种传感设备对店铺及其内部布局进行扫描。在得到扫描结果后，可以导入到开发环境中。这种开发环境通常可以支持对扫描结果进行标注，因此，可以由工作人员对扫描结果进行标注。例如，如果店铺中包括多个货架，每个货架上用于放置具体的存放对象(例如，“货品”等)，则可以对货架的编号、货品对应的数据对象标识(例如商品ID等)信息等进行标注。标注完成之后，系统可以保存各个货架的编号、对应的货品信息等信息，同时，关于各个货架、货品的位置坐标等信息，系统可以自动生成并保存，以此生成该店铺对应的三维空间模型。另外，关于具体在与用户进行交互的过程中，需要提供出的数据对象详情等信息，可以预先建立数据对象详情信息数据库，在进行标注时，也可以根据具体货品对应的数据对象在该数据库中的ID等标识进行标注，这样，就可以将增强现实空间中的货品与数据库中保存的数据对象的详情信息之间建立起关联。
具体实现时，为了实现本申请实施例中提供的交互功能，在软件层面上，可以预先 实现相关的客户端(包括应用程序，或者相关的功能模块等)。客户端可以通过多种形式与AR设备进行配合使用。具体的，对于一体式的AR设备(也即，由AR设备独立承担屏显、计算、存储等任务)而言，可以直接将该客户端安装在AR设备中，使得AR设备具有本申请实施例中的交互功能。或者，对于移动式AR设备而言，由于移动式的AR设备通常仅承担屏显任务，在使用时，通常需要将手机等移动终端设备与该AR设备连接，因此，在这种情况下，也可以将客户端安装在手机等移动终端设备中，这样，安装了该客户端的移动终端设备被放置在AR设备中后，就可以使得AR设备具有本申请实施例中所述的交互功能。另外，三维空间模型生成后，可以直接保存到客户端所在的终端设备中，或者，也可以存储到服务器中，客户端在需要进行交互时，再从服务器中进行下载当前店铺对应的三维空间模型。总之，客户端无论是直接将客户端安装在AR设备中，还是安装在移动终端设备中，都可以使得AR设备基于这种客户端，结合前述生成的三维空间模型，实现具体的交互。
具体的，参见图7，该实施例三提供了一种增强现实空间环境中的数据对象交互方法，该方法可以包括以下步骤：
步骤701：客户端获得实体店铺内部空间环境的三维空间模型；所述实体店铺内部包括多件货品；
步骤702：在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息；
在消费者等用户需要到实体店铺中进行购物时，可以佩戴相关的AR设备(包括一体式的AR设备，或者连接了移动终端设备的移动式AR设备)，进入到实体店铺内，之后，可以启动相关的客户端。客户端被启动后，可以首先进行初始化处理，具体可以包括，将所述三维空间模型与所述实体店铺进行空间匹配。所谓的空间匹配，也就是说，可以将三维空间模型与实际的实体店铺进行匹配，使得三维空间中的位置与实体店铺中的位置、方向等相对应，这样才能够使得“增强”的信息准确的显示在视域范围内对应货品所在的位置。
具体进行空间匹配的方法可以有多种，例如，在一种方式下，可以是预先在三维空间模型中保存一些特征点，例如，空间内的四个墙角位置等等，消费者用户佩戴AR眼镜等AR设备进入到实体店铺后，首先启动应用程序，之后，可以在佩戴着AR眼镜的状态下在存放空间环顾一周，AR眼镜的传感器设备可以对存放空间进行扫描，之后，便可以利用特征点以及扫描结果，将特征点与存放空间中实际位置的点进行匹配，以便确 定出三维空间模型的位置、方向等，从而完成空间匹配，最终使得三维空间模型中各个点的位置，与对应到实体店铺中的实际位置、方向一致。当然，在具体实现时，还可以通过其他方式实现空间匹配，例如，可以实现自动的匹配，等等，这里不再一一详述。
在完成空间匹配后，就可以在所述AR设备的用户视域范围内提供所述货品对应的交互区域信息，例如，可以通过在视域范围内增加“操作层”等方式，在视域范围内展示出货品的可操作区域，例如，在每个货品所在的位置显示一个“蓝色圆点”，等等。
步骤703：确定用户感兴趣的目标货品；
步骤704：提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；
步骤705：匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
在提供出货品对应的交互区域信息后，后续的具体的交互过程中，关于用户感兴趣的目标货品的确定，各种交互响应信息的提供，以及各类型操作控件的提供及其交互方式相对于现有技术的改进，等等，均可以与虚拟现实空间中的实现方式类似，这里不再赘述。
实施例四
该实施例四是与实施例三相对应的，从服务器角度进行的介绍，具体的，参见图8，该实施例提供了一种增强现实空间环境中的数据对象交互方法，该方法可以包括：
步骤801：服务器保存实体店铺内部空间环境的三维空间模型，所述实体店铺内部包括多件货品，各自对应的交互区域范围信息，以及与各交互区域范围关联的数据对象的交互响应信息；
步骤802：将所述三维空间模型提供给客户端，以便所述客户端在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息，确定用户感兴趣的目标货品；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
服务器可以保存的实体店铺内部空间环境的三维空间模型直接提供给客户端，或者，也可以在接收到客户端的请求时，再将相关的数据提供给客户端，客户端在获得相应的数据后，便可以提供增强现实空间环境，并基于该环境实现与用户之间的交互，可以实现完整的购物流程。
关于上述实施例三和四，具体的信息交互过程中涉及到的实现细节，包括相对于现有技术中的改进点等等，均可以参见前述各个实施例中的记载，这里不再赘述。
实施例五
该实施例五是与实施例一客户端方法相对应的一种装置，参见图9，该实施例提供了一种虚拟现实空间环境中的数据对象交互装置，该装置应用于客户端，所述装置包括：
虚拟现实环境提供模块901，用于提供虚拟现实店铺对象内部空间环境，所述店铺对象内部空间环境中包括至少一个可交互数据对象；
目标数据对象确定模块902，用于确定用户感兴趣的目标数据对象；
订单信息提供模块903，用于提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；
匹配模块904，用于匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
在本申请实施例中，可选的，所述装置还可以包括：
订单确定模块，用于确定用户已完成订单信息的确认。
进一步，可选的，所述订单确定模块，可以包括：
校验内容提供子模块，用于在提供与订单确认相关的信息内容时，还提供校验内容，所述校验内容根据目标数据对象的至少部分属性信息生成；
校验内容识别子模块，用于识别用户的语音中是否包含所述校验内容，若是，则确定用户已完成订单信息的确认。
可选的，所述匹配模块，包括：匹配子模块，用于匹配用户发出的包含校验内容的语音与预先训练的声纹模型。
进一步，可选的，所述订单确定模块，可以包括：
验证码提供子模块，用于在提供与订单确认相关的信息内容时，提供一个校验码；
校验码识别子模块，用于识别用户的语音中是否包含该校验码，若是，则确定用户已完成订单信息的确认。
可选的，所述校验码是由客户端随机生成的。
可选的，所述匹配模块，包括：匹配子模块，用于匹配用户发出的包含校验码的语音与预先训练的声纹模型。
可选的，所述校验码识别子模块，还可以用于在识别用户的语音中不包含该校验码时，触发验证码提供子模块，以使该验证码提供模块提供另一个校验码，则所述校验码 识别子模块再识别用户的语音中是否包含另一个校验码，若是，则确定用户已完成订单信息的确认。
可选的，所述订单确定模块，可以包括：
视线焦点位置确定子模块，用于确定用户视线焦点位置；
订单确定子模块，用于当所述视线焦点位置进入该与订单确认相关的信息内容的交互区域范围内，且停留的时间达到预置时间阈值时，确定用户已完成订单信息的确认。
可选的，所述订单确定模块，可以包括：
语音识别子模块，用于识别用户的语音中是否包含能够表征确认订单含义的内容，若是，则确定用户已完成订单信息的确认。
可选的，所述目标数据对象确定模块，可以包括：
视线焦点位置确定子模块，用于确定用户视线焦点位置；
目标数据对象确定子模块，用于当所述视线焦点位置进入某一数据对象的交互区域范围内，且停留的时间达到预置时间阈值时，将该数据对象确定为用户感兴趣的目标数据对象。
可选的，所述目标数据对象确定模块，可以包括：
语音识别子模块，用于识别用户的语音是否包含所述可交互数据对象中的某一数据对象关联的信息内容，若是，则将该数据对象作为用户感兴趣的目标数据对象。
可选的，所述装置还包括：
提示模块，用于在识别用户的语音不包含所述可交互数据对象中的某一数据对象关联的信息内容时，提供用于提示用户选择无效的信息内容。
可选的，所述匹配模块，可以包括：
声纹模型选定子模块，用于根据客户端的设备标识或者用户标识，从预先训练的多个声纹模型中选定与所述设备标识对应的声纹模型或选定与所述用户标识对应的声纹模型；
匹配子模块，用于匹配用户的语音与选定的声纹模型。
可选的，所述装置还包括：声纹模型训练模块，
所述声纹模型训练模块，包括：
语音采集子模块，用于采集用户的多条语音；
提取子模块，用于提取所述多条语音中的每条语音各自的MFCC倒谱系数；
训练子模块，用于根据所述MFCC倒谱系数训练得到所述用户对应的声纹模型。
可选的，所述装置还包括：声纹模型优化模块，用于利用所述用户发出的语音对预先训练的声纹模型中该用户的声纹模型进行优化。
关于该实施例五中该装置的工作原理以及各个模块、子模块的具体实现可以参见前述实施例一中的介绍，这里不再赘述。
实施例六
该实施例六是与实施例二服务器端方法相对应的一种装置，参见图10，该实施例提供了一种虚拟现实空间环境中的数据对象交互装置，该装置应用于服务器端，所述装置包括：
环境数据存储模块1001，用于保存虚拟现实店铺对象内部空间环境数据，所述店铺对象内部空间环境数据中包括至少一个可交互数据对象，所述可交互数据对象对应有交互区域范围，并关联有预置的信息内容；
环境数据提供模块1002，用于将所述虚拟现实店铺对象内部空间环境数据提供给客户端，以便所述客户端提供虚拟现实店铺对象内部空间环境数据，确定用户感兴趣的目标数据对象；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
关于该实施例六中该装置的工作原理以及各个模块的具体实现可以参见前述实施例一、二中的介绍，这里不再赘述。
实施例七
该实施例七是与实施例三客户端方法相对应的一种装置，参见图11，该实施例提供了一种增强现实空间环境中的数据对象交互装置，该装置应用于客户端，所述装置包括：
空间模型获取模块1101，用于获得实体店铺内部空间环境的三维空间模型；所述实体店铺内部包括多件货品；
空间模型匹配模块1102，用于在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息；
目标货品确定模块1103，用于确定用户感兴趣的目标货品；
订单信息提供模块1104，用于提供与订单确认相关的信息内容，所述与订单确认相 关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；
匹配模块1105，用于匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
关于该实施例七中该装置的工作原理以及各个模块的具体实现可以参见前述实施例三中的介绍，这里不再赘述。
实施例八
该实施例八是与实施例四服务器端方法相对应的一种装置，参见图12，该实施例提供了一种增强现实空间环境中的数据对象交互装置，该装置应用于服务器端，所述装置包括：
存储模块1201，用于保存实体店铺内部空间环境的三维空间模型，所述实体店铺内部包括多件货品，各自对应的交互区域范围信息，以及与各交互区域范围关联的数据对象的交互响应信息；
空间模型提供模块1202，用于将所述三维空间模型提供给客户端，以便所述客户端在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息，确定用户感兴趣的目标货品；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
关于该实施例八中该装置的工作原理以及各个模块的具体实现可以参见前述实施例四中的介绍，这里不再赘述。
前述基于增强现实技术提供的各种具体解决方案与基于虚拟现实技术提供的各种具体解决方案其主要技术思想是相同的，可以相互参照。
需要说明的是，本说明书中的各个实施例均采用递进的方式描述，每个实施例重点说明的都是与其他实施例的不同之处，各个实施例之间相同相似的部分互相参见即可。对于装置类实施例而言，由于其与方法实施例基本相似，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。
最后，还需要说明的是，在本文中，诸如第一、第二、第三、第四等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含” 或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
以上对本申请所提供的一种虚拟现实空间环境中的数据对象交互方法、装置，以及一种增强现实空间环境中的数据对象交互方法、装置分别进行了详细介绍，本文中应用了具体个例对本申请的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本申请的方法及其核心思想；同时，对于本领域的一般技术人员，依据本申请的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本申请的限制。

Claims (22)

  1. 一种虚拟现实空间环境中的数据对象交互方法，其特征在于，所述方法包括：
    客户端提供虚拟现实店铺对象内部空间环境，所述店铺对象内部空间环境中包括至少一个可交互数据对象；
    确定用户感兴趣的目标数据对象；
    提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；
    匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
  2. 根据权利要求1所述的数据对象交互方法，其特征在于，在所述匹配用户的语音与预先训练的声纹模型之前，所述方法还包括：
    确定用户已完成订单信息的确认。
  3. 根据权利要求2所述的数据对象交互方法，其特征在于，所述确定用户已完成订单信息的确认，包括：
    在提供与订单确认相关的信息内容时，还提供校验内容，所述校验内容根据目标数据对象的至少部分属性信息生成；
    识别用户的语音中是否包含所述校验内容，若是，则确定用户已完成订单信息的确认。
  4. 根据权利要求2所述的数据对象交互方法，其特征在于，所述确定用户已完成订单信息的确认，包括：
    在提供与订单确认相关的信息内容时，还提供一个校验码；
    识别用户的语音中是否包含该校验码，若是，则确定用户已完成订单信息的确认。
  5. 根据权利要求4所述的数据对象交互方法，其特征在于，所述校验码是由客户端随机生成的。
  6. 根据权利要求4所述的数据对象交互方法，其特征在于，所述匹配用户的语音与预先训练的声纹模型，包括：
    匹配用户发出的包含校验码的语音与预先训练的声纹模型。
  7. 根据权利要求4所述的数据对象交互方法，其特征在于，当识别用户的语音中不包含该校验码时，所述方法还包括：
    提供另一个校验码，识别用户的语音中是否包含另一个校验码，若是，则确定用户已完成订单信息的确认。
  8. 根据权利要求2所述的数据对象交互方法，其特征在于，所述确定用户已完成订单信息的确认，包括：
    确定用户视线焦点位置；
    当所述视线焦点位置进入该与订单确认相关的信息内容的交互区域范围内，且停留的时间达到预置时间阈值时，确定用户已完成订单信息的确认。
  9. 根据权利要求2所述的数据对象交互方法，其特征在于，所述确定用户已完成订单信息的确认，包括：
    识别用户的语音中是否包含能够表征确认订单含义的内容，若是，则确定用户已完成订单信息的确认。
  10. 根据权利要求1所述的数据对象交互方法，其特征在于，所述确定用户感兴趣的目标数据对象，包括：
    确定用户视线焦点位置；
    当所述视线焦点位置进入某一数据对象的交互区域范围内，且停留的时间达到预置时间阈值时，将该数据对象确定为用户感兴趣的目标数据对象。
  11. 根据权利要求1所述的数据对象交互方法，其特征在于，所述确定用户感兴趣的目标数据对象，包括：
    识别用户的语音是否包含所述可交互数据对象中的某一数据对象关联的信息内容，若是，则将该数据对象作为用户感兴趣的目标数据对象。
  12. 根据权利要求11所述的数据对象交互方法，其特征在于，所述方法还包括：
    在识别用户的语音不包含所述可交互数据对象中的某一数据对象关联的信息内容时，提供用于提示用户选择无效的信息内容。
  13. 根据权利要求1所述的数据对象交互方法，其特征在于，所述匹配用户的语音与预先训练的声纹模型，包括：
    根据客户端的设备标识或者用户标识，从预先训练的多个声纹模型中选定与所述设备标识对应的声纹模型或选定与所述用户标识对应的声纹模型；
    匹配用户的语音与选定的声纹模型。
  14. 根据权利要求1所述的数据对象交互方法，其特征在于，所述方法还包括：通过以下方式预先训练得到声纹模型：
    采集用户的多条语音；
    提取所述多条语音中的每条语音各自的MFCC倒谱系数；
    根据所述MFCC倒谱系数训练得到所述用户对应的声纹模型。
  15. 根据权利要求1所述的数据对象交互方法，其特征在于，所述方法还包括：
    利用所述用户发出的语音对预先训练的声纹模型中该用户的声纹模型进行优化。
  16. 一种虚拟现实空间环境中的数据对象交互方法，其特征在于，所述方法包括：
    服务器保存虚拟现实店铺对象内部空间环境数据，所述店铺对象内部空间环境数据中包括至少一个可交互数据对象，所述可交互数据对象对应有交互区域范围，并关联有预置的信息内容；
    将所述虚拟现实店铺对象内部空间环境数据提供给客户端，以便所述客户端提供虚拟现实店铺对象内部空间环境数据，确定用户感兴趣的目标数据对象；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
  17. 一种增强现实空间环境中的数据对象交互方法，其特征在于，所述方法包括：
    客户端获得实体店铺内部空间环境的三维空间模型；所述实体店铺内部包括多件货品；
    在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息；
    确定用户感兴趣的目标货品；
    提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
  18. 一种增强现实空间环境中的数据对象交互方法，其特征在于，所述方法包括：
    服务器保存实体店铺内部空间环境的三维空间模型，所述实体店铺内部包括多件货品，各自对应的交互区域范围信息，以及与各交互区域范围关联的数据对象的交互响应信息；
    将所述三维空间模型提供给客户端，以便所述客户端在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息，确定用户感兴趣的目标货品；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发 支付操作。
  19. 一种虚拟现实空间环境中的数据对象交互装置，其特征在于，所述装置包括：
    虚拟现实环境提供模块，用于提供虚拟现实店铺对象内部空间环境，所述店铺对象内部空间环境中包括至少一个可交互数据对象；
    目标数据对象确定模块，用于确定用户感兴趣的目标数据对象；
    订单信息提供模块，用于提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；
    匹配模块，用于匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
  20. 一种虚拟现实空间环境中的数据对象交互装置，其特征在于，所述装置包括：
    环境数据存储模块，用于保存虚拟现实店铺对象内部空间环境数据，所述店铺对象内部空间环境数据中包括至少一个可交互数据对象，所述可交互数据对象对应有交互区域范围，并关联有预置的信息内容；
    环境数据提供模块，用于将所述虚拟现实店铺对象内部空间环境数据提供给客户端，以便所述客户端提供虚拟现实店铺对象内部空间环境数据，确定用户感兴趣的目标数据对象；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标数据对象关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
  21. 一种增强现实空间环境中的数据对象交互装置，其特征在于，所述装置包括：
    空间模型获取模块，用于获得实体店铺内部空间环境的三维空间模型；所述实体店铺内部包括多件货品；
    空间模型匹配模块，用于在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息；
    目标货品确定模块，用于确定用户感兴趣的目标货品；
    订单信息提供模块，用于提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；
    匹配模块，用于匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
  22. 一种增强现实空间环境中的数据对象交互装置，其特征在于，所述装置包括：
    存储模块，用于保存实体店铺内部空间环境的三维空间模型，所述实体店铺内部包括多件货品，各自对应的交互区域范围信息，以及与各交互区域范围关联的数据对象的交互响应信息；
    空间模型提供模块，用于将所述三维空间模型提供给客户端，以便所述客户端在通过预置的增强现实AR设备将所述三维空间模型与所述实体店铺进行空间匹配后，在所述AR设备的用户视域范围内提供所述货品对应的交互区域范围信息，确定用户感兴趣的目标货品；提供与订单确认相关的信息内容，所述与订单确认相关的信息内容包括：所述目标货品关联的属性信息和待支付资源信息；匹配用户的语音与预先训练的声纹模型，在匹配成功时，触发支付操作。
PCT/CN2017/105359 2016-10-21 2017-10-09 一种虚拟现实/增强现实空间环境中的数据对象交互方法及装置 WO2018072617A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610921190.X 2016-10-21
CN201610921190.XA CN107977834B (zh) 2016-10-21 2016-10-21 一种虚拟现实/增强现实空间环境中的数据对象交互方法及装置

Publications (1)

Publication Number Publication Date
WO2018072617A1 true WO2018072617A1 (zh) 2018-04-26

Family

ID=62003814

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/105359 WO2018072617A1 (zh) 2016-10-21 2017-10-09 一种虚拟现实/增强现实空间环境中的数据对象交互方法及装置

Country Status (2)

Country Link
CN (1) CN107977834B (zh)
WO (1) WO2018072617A1 (zh)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111178847A (zh) * 2019-12-31 2020-05-19 中国银行股份有限公司 基于vr技术的虚拟银行网点设备、控制装置及工作方法
CN111179001A (zh) * 2018-11-09 2020-05-19 阿里巴巴集团控股有限公司 内容处理方法、装置及系统
CN112162638A (zh) * 2020-10-09 2021-01-01 咪咕视讯科技有限公司 一种虚拟现实vr观影中的信息处理方法及服务器
CN113298598A (zh) * 2020-09-15 2021-08-24 阿里巴巴集团控股有限公司 提供店铺对象信息的方法、装置及电子设备
CN113298613A (zh) * 2021-04-23 2021-08-24 阿里巴巴新加坡控股有限公司 信息交互方法及装置
CN114898749A (zh) * 2022-05-30 2022-08-12 中国第一汽车股份有限公司 一种汽车电子手册交互方法、装置及车辆
CN115578520A (zh) * 2022-11-10 2023-01-06 一站发展(北京)云计算科技有限公司 用于沉浸式场景下的信息处理方法及系统
CN117079651A (zh) * 2023-10-08 2023-11-17 中国科学技术大学 一种基于大规模语言模型的语音交叉实时增强现实方法

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108563395A (zh) * 2018-05-07 2018-09-21 北京知道创宇信息技术有限公司 3d视角交互方法及装置
US10482674B1 (en) * 2018-06-27 2019-11-19 Beijing Jingdong Shangke Information Technology Co., Ltd. System and method for mobile augmented reality
US10290049B1 (en) * 2018-06-27 2019-05-14 Beijing Jingdong Shangke Information Technology Co., Ltd. System and method for multi-user augmented reality shopping
CN109583187B (zh) * 2018-11-16 2022-11-18 中共中央办公厅电子科技学院 一种增强现实验证码方法及应用
CN109726954B (zh) * 2018-12-11 2021-01-08 维沃移动通信有限公司 一种信息处理方法、装置及移动终端
CN109684490A (zh) * 2018-12-26 2019-04-26 成都明图通科技有限公司 室内导航及导购方法、装置
CN110176097A (zh) * 2019-04-29 2019-08-27 美佳亚太投资有限公司 一种自动贩卖系统
CN110348198B (zh) * 2019-06-21 2024-04-12 华为技术有限公司 仿真对象的身份识别方法、相关装置及系统
CN111243200A (zh) * 2019-12-31 2020-06-05 维沃移动通信有限公司 购物方法、穿戴式设备及介质
CN111340598B (zh) * 2020-03-20 2024-01-16 北京爱笔科技有限公司 一种添加交互标签的方法及装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008081411A1 (en) * 2006-12-30 2008-07-10 Kimberly-Clark Worldwide, Inc. Virtual reality system including smart objects
KR20110136029A (ko) * 2010-06-14 2011-12-21 주식회사 비즈모델라인 가상 진열대를 이용한 증강현실 매장 운영 시스템
CN103325037A (zh) * 2013-06-06 2013-09-25 上海讯联数据服务有限公司 一种基于语音识别的移动支付安全验证方法
US20140279191A1 (en) * 2013-03-14 2014-09-18 Sears Brands, L.L.C. Checkout and/or ordering systems and methods
CN105913277A (zh) * 2015-08-18 2016-08-31 金荣德 基于增强现实的购物信息提供系统及其控制方法
CN105913299A (zh) * 2015-06-15 2016-08-31 金荣德 基于3d全景影像的旅行地一站式购物系统及其控制方法

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070192203A1 (en) * 2006-02-16 2007-08-16 Di Stefano Michael V Virtual reality shopping system
WO2008081412A1 (en) * 2006-12-30 2008-07-10 Kimberly-Clark Worldwide, Inc. Virtual reality system including viewer responsiveness to smart objects
CN102054247B (zh) * 2009-11-04 2013-05-01 沈阳迅景科技有限公司 3d全景实景网络商务平台构建方法
CN103679452A (zh) * 2013-06-20 2014-03-26 腾讯科技（深圳）有限公司 支付验证方法、装置及系统
US20150012394A1 (en) * 2013-07-02 2015-01-08 Avenue Imperial UK Limited Virtual Shopping System
CN103617029A (zh) * 2013-11-20 2014-03-05 中网一号电子商务有限公司 一种3d即时通讯系统
CN103761667A (zh) * 2014-01-09 2014-04-30 贵州宝森科技有限公司 虚拟现实电子商务平台系统及其应用方法
KR102223278B1 (ko) * 2014-05-22 2021-03-05 엘지전자 주식회사 글래스 타입 단말기 및 이의 제어방법
US9524482B2 (en) * 2014-07-18 2016-12-20 Oracle International Corporation Retail space planning system
CN107818470A (zh) * 2014-08-25 2018-03-20 蒋超 用户访问云服务平台系统的方法、电子商务系统
US20160140553A1 (en) * 2014-11-17 2016-05-19 Visa International Service Association Authentication and transactions in a three-dimensional image enhancing display device
CN104599184A (zh) * 2014-12-09 2015-05-06 北京奇虎科技有限公司 股票资讯推送系统
TWI540522B (zh) * 2015-02-26 2016-07-01 宅妝股份有限公司 採用虛擬實境與擴增實境技術的虛擬購物系統與方法
CN104616190A (zh) * 2015-03-05 2015-05-13 广州新节奏智能科技有限公司 基于互联网和移动互联网的多终端3d体感购物方法及系统
CN106034063A (zh) * 2015-03-13 2016-10-19 阿里巴巴集团控股有限公司 一种在通信软件中通过语音启动业务的方法及相应装置
CN104820921A (zh) * 2015-03-24 2015-08-05 百度在线网络技术（北京）有限公司 一种用于在用户设备中进行交易的方法和装置
CN105824409A (zh) * 2016-02-16 2016-08-03 乐视致新电子科技（天津）有限公司 虚拟现实的交互控制方法及装置
CN105955471A (zh) * 2016-04-26 2016-09-21 乐视控股（北京）有限公司 虚拟现实交互的方法及装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008081411A1 (en) * 2006-12-30 2008-07-10 Kimberly-Clark Worldwide, Inc. Virtual reality system including smart objects
KR20110136029A (ko) * 2010-06-14 2011-12-21 주식회사 비즈모델라인 가상 진열대를 이용한 증강현실 매장 운영 시스템
US20140279191A1 (en) * 2013-03-14 2014-09-18 Sears Brands, L.L.C. Checkout and/or ordering systems and methods
CN103325037A (zh) * 2013-06-06 2013-09-25 上海讯联数据服务有限公司 一种基于语音识别的移动支付安全验证方法
CN105913299A (zh) * 2015-06-15 2016-08-31 金荣德 基于3d全景影像的旅行地一站式购物系统及其控制方法
CN105913277A (zh) * 2015-08-18 2016-08-31 金荣德 基于增强现实的购物信息提供系统及其控制方法

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111179001B (zh) * 2018-11-09 2023-07-04 阿里巴巴(深圳)技术有限公司 内容处理方法、装置及系统
CN111179001A (zh) * 2018-11-09 2020-05-19 阿里巴巴集团控股有限公司 内容处理方法、装置及系统
CN111178847A (zh) * 2019-12-31 2020-05-19 中国银行股份有限公司 基于vr技术的虚拟银行网点设备、控制装置及工作方法
CN111178847B (zh) * 2019-12-31 2023-08-22 中国银行股份有限公司 基于vr技术的虚拟银行网点设备、控制装置及工作方法
CN113298598A (zh) * 2020-09-15 2021-08-24 阿里巴巴集团控股有限公司 提供店铺对象信息的方法、装置及电子设备
CN112162638B (zh) * 2020-10-09 2023-09-19 咪咕视讯科技有限公司 一种虚拟现实vr观影中的信息处理方法及服务器
CN112162638A (zh) * 2020-10-09 2021-01-01 咪咕视讯科技有限公司 一种虚拟现实vr观影中的信息处理方法及服务器
CN113298613A (zh) * 2021-04-23 2021-08-24 阿里巴巴新加坡控股有限公司 信息交互方法及装置
CN114898749A (zh) * 2022-05-30 2022-08-12 中国第一汽车股份有限公司 一种汽车电子手册交互方法、装置及车辆
CN114898749B (zh) * 2022-05-30 2024-05-14 中国第一汽车股份有限公司 一种汽车电子手册交互方法、装置及车辆
CN115578520A (zh) * 2022-11-10 2023-01-06 一站发展(北京)云计算科技有限公司 用于沉浸式场景下的信息处理方法及系统
CN117079651A (zh) * 2023-10-08 2023-11-17 中国科学技术大学 一种基于大规模语言模型的语音交叉实时增强现实方法
CN117079651B (zh) * 2023-10-08 2024-02-23 中国科学技术大学 一种基于大规模语言模型的语音交叉实时增强现实方法

Also Published As

Publication number Publication date
CN107977834A (zh) 2018-05-01
CN107977834B (zh) 2022-03-18

Similar Documents

Publication Publication Date Title
WO2018072617A1 (zh) 一种虚拟现实/增强现实空间环境中的数据对象交互方法及装置
US11694280B2 (en) Systems/methods for identifying products for purchase within audio-visual content utilizing QR or other machine-readable visual codes
US10127724B2 (en) System and method for providing augmented reality on mobile devices
JP6401174B2 (ja) 仮想プラノグラム管理、システム及び方法
CN110096155A (zh) 一种基于虚拟现实的业务实现方法和装置
CN107430790A (zh) 用于提供交互式虚拟环境的系统和方法
US10650606B2 (en) Interactive virtual reality system
US20220129976A1 (en) Information providing apparatus, information providing system, and information providing method
US20160140553A1 (en) Authentication and transactions in a three-dimensional image enhancing display device
US20170309074A1 (en) Automatic vending machine having holographic products
CN113721804A (zh) 一种显示方法、装置、电子设备及计算机可读存储介质
CN110880139B (zh) 一种商品展示方法、装置、终端、服务器及存储介质
US20150106200A1 (en) Enhancing a user's experience by providing related content
US20200226668A1 (en) Shopping system with virtual reality technology
WO2022151667A1 (zh) 资源处理方法、装置、电子设备、存储介质及程序产品
US20180373884A1 (en) Method of providing contents, program for executing the method on computer, and apparatus for providing the contents
CN110889006A (zh) 推荐方法及装置
CN110858376A (zh) 服务提供方法、设备、系统及存储介质
KR102225494B1 (ko) Vr 기기를 이용한 가상 박람회 체험 방법 및 장치
CN114051168A (zh) 一种显示方法、装置、设备、存储介质及程序产品
CN113359984A (zh) 瓶体的特效呈现方法、装置、计算机设备及存储介质
CN113313840A (zh) 实时虚拟系统及实时虚拟交互方法
WO2018089966A1 (en) Media service with virtual reality capabilities
Wiley From Your Phone To Your Home: An Augmented Reality Brand Experience For High-End Furniture
KR102666849B1 (ko) 블록체인을 이용한 컨텐츠 생성 및 수수료 정산 방법 및 이를 지원하는 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17862396

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17862396

Country of ref document: EP

Kind code of ref document: A1