CN108307184B - Data interaction method and device - Google Patents

Data interaction method and device Download PDF

Info

Publication number
CN108307184B
CN108307184B CN201610655920.6A CN201610655920A CN108307184B CN 108307184 B CN108307184 B CN 108307184B CN 201610655920 A CN201610655920 A CN 201610655920A CN 108307184 B CN108307184 B CN 108307184B
Authority
CN
China
Prior art keywords
equipment
terminal display
picture
stereoscopic
coordinate information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610655920.6A
Other languages
Chinese (zh)
Other versions
CN108307184A (en
Inventor
袁成杰
陈应志
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Wuwei Translation Technology Co ltd
Original Assignee
Chengdu Wuwei Translation Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Wuwei Translation Technology Co ltd filed Critical Chengdu Wuwei Translation Technology Co ltd
Priority to CN201610655920.6A priority Critical patent/CN108307184B/en
Publication of CN108307184A publication Critical patent/CN108307184A/en
Application granted granted Critical
Publication of CN108307184B publication Critical patent/CN108307184B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A data interaction method and a data interaction device are applied to an AR/VR system, the AR/VR system comprises terminal display equipment and AR/VR equipment, and control modes of the AR/VR system comprise a first control mode and a second control mode. The method comprises the following steps: when the AR/VR system is in the first control mode: the terminal display equipment closes the authority of the AR/VR equipment to acquire the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment; the terminal display equipment sends the second image characteristic information in the current display stereo picture to the AR/VR equipment so that the AR/VR equipment can synchronously display the stereo picture; when the system is in the second control mode: the terminal display equipment opens the authority of the AR/VR equipment to acquire first image feature information in a stereoscopic picture displayed by the AR/VR equipment; and the terminal display equipment receives the first image characteristic information in the current displayed stereo picture returned by the AR/VR equipment and synchronously displays the stereo picture. Thereby effectively controlling the formation of data interactions resulting from shopping through the AR/VR.

Description

Data interaction method and device
Technical Field
The invention relates to the technical field of computer vision, in particular to a data interaction method and device.
Background
With the development and progress of scientific technology, the computing power of hardware equipment is gradually improved, so that the computing power required for realizing a real Virtual Reality (VR) technology or an Augmented Reality (AR) technology to present a real Virtual Reality picture is met.
Shopping using VR or AR technology is a hot spot that is currently of great interest. However, in the current prior art, when the business exhibition is performed by the virtual reality technology or the augmented reality technology, the salesperson cannot know the content seen by the customer on the AR/VR device, and needs to ask the customer to know the customer's requirement, so that the communication cost is high, and the user experience is not good.
Disclosure of Invention
In view of this, an object of the embodiments of the present invention is to provide a data interaction method and apparatus, so as to control data interaction generated when shopping is performed through a virtual reality technology or an augmented reality technology.
In a first aspect, a data interaction method provided in an embodiment of the present invention includes: when the AR/VR system is in the first control mode: the terminal display equipment closes the authority of the AR/VR equipment to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR equipment; and the terminal display equipment sends the second image characteristic information in the currently displayed stereo picture to the AR/VR equipment so that the AR/VR equipment synchronously displays the stereo picture. When the system is in the second control mode: the terminal display equipment opens the authority of the AR/VR equipment to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR equipment; and the terminal display equipment receives the first image characteristic information in the currently displayed stereoscopic picture returned by the AR/VR equipment and synchronously displays the stereoscopic picture.
In a second aspect, a data interaction method provided in an embodiment of the present invention includes: when the system is in the first control mode: the authority of the AR/VR equipment for acquiring the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment is closed by the terminal display equipment; and the AR/VR equipment receives the second image characteristic information in the current displayed stereoscopic picture of the terminal display equipment sent by the terminal display equipment, and synchronously displays the stereoscopic picture. When the system is in the second control mode: the authority of the AR/VR equipment for acquiring the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment is opened by the terminal display equipment; and the AR/VR equipment sends the first image characteristic information in the currently displayed stereoscopic picture to the terminal display equipment so that the terminal display equipment synchronously displays the stereoscopic picture.
In a third aspect, a data interaction method provided in an embodiment of the present invention includes: when the AR/VR system is in the first control mode: and the terminal display equipment closes the authority of the AR/VR equipment to acquire the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment. And the terminal display equipment sends the second image characteristic information in the currently displayed stereo picture to the AR/VR equipment. And the AR/VR equipment receives the second image characteristic information in the stereoscopic picture currently displayed by the terminal display equipment and sent by the terminal display equipment, so that the AR/VR equipment synchronously displays the stereoscopic picture. When the system is in the second control mode: and the terminal display equipment opens the authority of the AR/VR equipment for acquiring the first image feature information in the stereoscopic picture displayed by the AR/VR equipment. And the AR/VR equipment sends the first image characteristic information in the displayed stereoscopic picture to the terminal display equipment. And the terminal display equipment receives the first image characteristic information in the currently displayed stereoscopic picture returned by the AR/VR equipment and synchronously displays the stereoscopic picture.
In a fourth aspect, an embodiment of the present invention provides a data interaction apparatus, including: when the AR/VR system is in the first control mode: the terminal display equipment is used for closing the authority of the AR/VR equipment for acquiring the first image feature information in the stereoscopic picture displayed by the AR/VR equipment. And the first sending module is used for sending the second image characteristic information in the currently displayed stereo picture to the AR/VR equipment by the terminal display equipment so as to enable the AR/VR equipment to synchronously display the stereo picture. When the system is in the second control mode: the first control module is used for the terminal display equipment to open the authority of the AR/VR equipment to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR equipment. And the first receiving module is used for receiving the first image characteristic information in the currently displayed stereoscopic picture returned by the AR/VR equipment by the terminal display equipment and synchronously displaying the stereoscopic picture.
In a fifth aspect, an embodiment of the present invention provides a data interaction apparatus, including: when the system is in the first control mode: and the second control module is used for enabling the AR/VR equipment to obtain the authority of the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment to be closed by the terminal display equipment. And the second receiving module is used for receiving the second image characteristic information in the current stereoscopic picture displayed by the terminal display equipment and sent by the AR/VR equipment, and synchronously displaying the stereoscopic picture. When the system is in the second control mode: and the second control module is used for enabling the AR/VR equipment to acquire the authority of the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment to be opened by the terminal display equipment. And the second sending module is used for sending the first image characteristic information in the currently displayed stereoscopic picture to the terminal display equipment by the AR/VR equipment so as to enable the terminal display equipment to synchronously display the stereoscopic picture.
In a sixth aspect, an embodiment of the present invention provides a data interaction apparatus, including: when the AR/VR system is in the first control mode: the terminal display equipment is used for closing the authority of the AR/VR equipment to acquire first image feature information in a stereoscopic picture displayed by the AR/VR equipment; and the first sending module is used for sending the second image characteristic information in the currently displayed stereo picture to the AR/VR equipment by the terminal display equipment. And the second receiving module is used for receiving the second image characteristic information, which is sent by the terminal display device and is currently displayed by the terminal display device, in the stereoscopic picture by the AR/VR device, so that the AR/VR device synchronously displays the stereoscopic picture. When the system is in the second control mode: the first control module is used for the terminal display equipment to open the authority of the AR/VR equipment to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR equipment. And the second sending module is used for sending the first image characteristic information in the displayed stereoscopic picture to the terminal display equipment by the AR/VR equipment. And the first receiving module is used for receiving the first image characteristic information in the currently displayed stereoscopic picture returned by the AR/VR equipment by the terminal display equipment and synchronously displaying the stereoscopic picture.
Compared with the prior art, the data interaction method and the data interaction device provided by the invention have the beneficial effects that: by setting a first control mode and a second control mode, the terminal display device in the first control mode closes the authority of the AR/VR device to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR device. And the terminal display device sends the second image characteristic information in the stereoscopic picture currently displayed by the terminal display device to the AR/VR device so that the AR/VR device synchronously displays the stereoscopic picture. In the first control mode, the AR/VR system synchronously controls the same picture displayed by the AR/VR device through the display picture of the terminal display device, so that the interaction of data is controlled through the control of the picture. And in the second control mode, the terminal display equipment opens the authority of the AR/VR equipment to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR equipment. And the terminal display equipment receives the first image characteristic information in the current displayed stereoscopic picture returned by the AR/VR equipment, so that the terminal display equipment synchronously displays the stereoscopic picture. And in the second control mode, the AR/VR system enables the display screen of the terminal display device to be interacted with the display screen of the AR/VR device and keeps synchronization, so that the data interaction mode is realized by limiting the interaction mode of the screen. Therefore, effective control and limitation of data interaction generated by the virtual reality technology or the augmented reality technology when shopping are achieved.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a flowchart illustrating interaction between a terminal display device and a computing device in a data interaction method according to a preferred embodiment of the present invention;
fig. 2 is a flowchart of a terminal display device in a first control mode in a data interaction method according to a first embodiment of the present invention;
fig. 3 is a flowchart of a terminal display device in a second control mode in a data interaction method according to a first embodiment of the present invention;
fig. 4 is a flowchart of an AR/VR device in a first control mode in a data interaction method according to a second embodiment of the present invention;
fig. 5 is a flowchart of an AR/VR device in a second control mode in a data interaction method according to a second embodiment of the present invention;
fig. 6 is a flowchart illustrating interaction between a terminal display device and an AR/VR device in a first control mode in a data interaction method according to a third embodiment of the present invention;
fig. 7 is a flowchart illustrating interaction between a terminal display device and an AR/VR device in a second control mode in a data interaction method according to a third embodiment of the present invention;
fig. 8 is a view of an interactive application scene of a terminal display device and an AR/VR device in a data interaction method according to a preferred embodiment of the present invention;
FIG. 9 is a block diagram of a terminal display device in a data interaction apparatus according to a preferred embodiment of the present invention;
FIG. 10 is a block diagram of an AR/VR device in the data interaction device according to the preferred embodiment of the present invention;
FIG. 11 is a block diagram of a terminal display device and an AR/VR device in a data interaction apparatus according to a preferred embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present invention, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
The embodiment of the invention provides a data interaction method and device, which are applied to an AR/VR system. The AR/VR system in the embodiment of the invention is used for generating a three-dimensional virtual reality scene by using computer hardware such as a desktop PC, a mobile PC, a mainframe computer and a cloud computing computer (computing device) cluster as a computing main body and a terminal display device and an AR/VR device as display terminals through a software system for drawing an API based on 3D such as Directx or Opengl. Taking the sales exhibition virtual reality scenario as an example, the method comprises the following elements: and 3D graphical representation of the buyer, the seller and the sales shopping behavior in the virtual reality environment.
The AR/VR system includes: terminal display device, AR/VR equipment and computing device. The control modes of the AR/VR system include: a first control mode and a second control mode. And the terminal display equipment (PC end) and the AR/VR equipment share the 3D picture generated by the 3D graphic software according to the 3D scene and the object data.
The method comprises the steps that a terminal display device and an AR/VR device transfer a client used for displaying a virtual scene, when the terminal display device and the AR/VR device start the client, the client enters a default control mode, and the control mode comprises a first control mode and a second control mode.
When the AR/VR system is in a first control mode, the terminal display equipment can close the authority of the AR/VR equipment for acquiring first image feature information in a stereoscopic picture currently displayed by the AR/VR equipment; when the AR/VR system is in the second control mode, the terminal display device can open the authority of the AR/VR device for acquiring the first image feature information in the stereoscopic picture displayed by the AR/VR device.
Preferably, before the AR/VR system performs data interaction in the first control mode or the second control mode, both the terminal display device and the AR/VR device acquire data for interaction through the computing device.
The two modes can control the virtual reality scene and objects under different conditions (including local and remote control). The AR/VR equipment and the physical store combined exhibition and marketing solution is provided, the final effect of the product in the real environment can be simulated, and the what you see is what you get is the customer experience in the field; the problem of effective communication between the customer and the salesperson in the virtual environment is solved.
The switching of the first control mode and the second control mode may be performed by an administrator at a terminal display device. The terminal display equipment is also final picture computing equipment and background data access and management equipment. In the embodiment of the present invention, the first control mode may also be referred to as an administrator control mode, and the second control mode may also be referred to as a client control mode. The default mode of the system may be one of the modes, and in the marketing scenario, it is preferable to set the first control mode to the default mode.
The administrator may be extended in a real-world scenario to be representative of sellers, customer services, and other similar marketing scenarios. The customer is a buyer who determines a desire to consume through the AR/VR system in order to complete a purchase. The client may be a consumer or customer and a buyer in other similar marketing scenarios.
During the actual sale process, the administrator grants the client the autonomous action authority by switching to the client control mode according to the situation. The administrator can withdraw control by switching to "administrator control mode" at any time as required. In the administrator control mode, sales personnel can realize the related function of shopping guide for customers; under the client control mode, the client can observe and experience interested commodities in the AR/VR scene according to the intention of the client.
Referring to fig. 1, fig. 1 is a flowchart illustrating a terminal display device downloading data in a data interaction method of an AR/VR system. The method corresponding to fig. 1 is a flow that takes a terminal display device as an execution subject. In the embodiment of the present invention, preferably, the terminal display device performs data interaction with the AR/VR device after downloading and storing data in advance.
Specifically, the step of downloading data by the terminal display device includes: step S110 and step S120.
Step S110: and the terminal display equipment sends a login request to the computing equipment.
After the AR/VR system enters a use state, the terminal display device firstly logs in the computing device to obtain image data cache. The terminal display device enters a login state and sends a login request to the computing device in the login state.
Step S120: and the terminal display equipment receives an image data cache corresponding to the login request returned by the computing equipment, wherein the image data cache is data corresponding to a stereoscopic picture displayed by the terminal display equipment.
Each terminal display device has its own corresponding IP (internet protocol) address information, and after the terminal display device sends a login request to the computing device, the login request includes the IP address information of the terminal display device. Therefore, according to the IP address information contained in the login request, the terminal display equipment can receive the image data cache corresponding to the login request returned by the computing equipment. It can be understood that the image data cache received by the terminal display device matches the IP address information specific to the terminal display device itself. After the computing device receives the login request of the terminal display device, the computing device also receives the IP address information of the terminal display device contained in the login request. A plurality of image data caches are stored in a database of the computing device, each image data cache being marked by IP address information that matches the image data cache. Thus, according to the IP address information contained in the login request, the computing equipment matches the image data cache corresponding to the IP address information in the database. And after the image data cache is matched, the computing equipment sends the image data cache corresponding to the IP address information to the terminal display equipment. After the terminal display device receives the image data cache, the terminal display device caches and stores the image data. The terminal display device can display a stereoscopic screen with a stereoscopic simulation screen. The image data cache received by the terminal display device is data corresponding to the stereoscopic picture displayed by the terminal display device in the interaction process of the terminal display device, namely the image data cache corresponding to the terminal display device can be used for generating the stereoscopic picture displayed by the terminal display device.
Of course, the terminal display device may also obtain the stereoscopic image in real time through the network, and the specific embodiment of the present invention is not limited thereto.
In the embodiment of the present invention, a specific working process of the AR/VR device obtaining the image data cache from the computing device, and a specific working process of the computing device sending the image data cache to the AR/VR device and the terminal display device, respectively, may refer to corresponding processes in the foregoing method embodiments, and are not described herein again.
First embodiment
The first embodiment of the invention provides a specific method for data interaction of an AR/VR system in a first control mode. The data interaction method in the first embodiment is implemented by using a terminal display device as an execution main body.
Referring to fig. 2, fig. 2 is a flowchart illustrating a terminal display device in a first control mode according to a first embodiment of the present invention. In this embodiment, the terminal display device controls the AR/VR device by closing the authority of the AR/VR device to acquire its own data and sending the data to the AR/VR device, so that the picture displayed by the AR/VR device is the same as the picture displayed by the terminal display device itself.
Specifically, the process of the terminal display device in the first control mode includes: step S210, step S220.
Step S210: and the terminal display equipment closes the authority of the AR/VR equipment to acquire the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment.
In this embodiment, the stereoscopic picture displayed by the AR/VR device may be a picture of a portion of a virtual stereoscopic space displayed by the AR/VR device. That is, in the virtual stereo space, with a certain position (for example, a camera viewpoint position) in the virtual stereo space as a first observation point, a picture that the first observation point presents in the virtual stereo space at a certain observation angle (viewing angle direction) may be a stereo picture displayed by the AR/VR device. The first image feature information of the stereoscopic picture displayed by the AR/VR device may include: the first observation point is positioned at the position in the virtual three-dimensional space, and corresponds to first position coordinate information. Meanwhile, the first image feature information may also include: the first observation point observes the center point of the partial picture of the virtual three-dimensional space presented at the position at a certain observation angle and the corresponding first visual angle coordinate information. The virtual stereo space may have a plurality of stereo pictures, and each stereo picture corresponds to one first image characteristic information, i.e. each first image characteristic information enables the AR/VR device to display a specific picture in the virtual stereo space. When the first perspective coordinate information is changed, the viewing angle of the first viewpoint is changed, and thus the AR/VR device causes the stereoscopic picture to be changed by the change of the display angle. When the first position coordinate information is changed, the observation position of the first observation point is also changed, so that the AR/VR device causes the stereoscopic picture to be changed by the change of the display position.
In the initial state of the operation of the AR/VR system, the authority of the AR/VR system default terminal display device for closing the AR/VR device to acquire the first image feature information in the stereoscopic picture of the AR/VR device is in the initial state. It can be understood that the terminal display device closes the authority of the AR/VR device to acquire the first image feature information in its own stereoscopic picture, that is, the terminal display device controls the controller in the AR/VR device to disconnect the coupling between the controller in the AR/VR device and the sampler in the AR/VR device, and the controller in the AR/VR device cannot receive the first image feature information sampled by the sampler in the AR/VR device. And the AR/VR acquisition permission is closed through the terminal display equipment, and the AR/VR equipment cannot acquire the first image characteristic information of the AR/VR equipment.
Preferably, to prevent the dizziness associated with using AR/VR devices. In this embodiment, when the AR/VR system is in the first control mode, the terminal display device only closes the authority of the AR/VR device to acquire the first position coordinate information in its own stereoscopic picture.
Step S220: and the terminal display equipment sends the second image characteristic information in the currently displayed stereo picture to the AR/VR equipment so that the AR/VR equipment synchronously displays the stereo picture.
The terminal display equipment controls the AR/VR equipment to acquire the authority of the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment to be in a closed state, and at the moment, the terminal display equipment can convert the second image characteristic information in the stereoscopic picture displayed by the terminal display equipment into a coordinate matrix through a converter and send the coordinate matrix to the AR/VR equipment.
As one mode, the stereoscopic picture displayed by the terminal display device may be a picture in which the terminal display device displays a part of a virtual stereoscopic space. In this embodiment, the virtual stereo space displayed by the terminal display device is the same as the virtual stereo space displayed by the AR/VR device. In the virtual three-dimensional space, a certain position (for example, a camera viewpoint position) in the virtual three-dimensional space is also used as a second observation point, and a picture displayed in the virtual three-dimensional space by the virtual second observation point at a certain observation angle (viewing angle direction) may be a three-dimensional picture. The second image characteristic information of the stereoscopic picture may be second position coordinate information corresponding to a position of the second viewpoint in the virtual stereoscopic space. Meanwhile, the second image feature information may also be second view coordinate information corresponding to a central point of a partial picture of the virtual three-dimensional space, which is observed at the position by the second observation point at a certain observation angle. Therefore, the virtual stereo space may have a plurality of stereo pictures, and each stereo picture corresponds to one second image characteristic information, i.e. each second image characteristic information enables the terminal display device to display a specific stereo picture in one of the virtual stereo spaces.
When the second viewing angle coordinate information is changed, the viewing angle of the second viewing point is changed, so that the terminal display device causes the stereoscopic picture to be changed by the change of the display angle. When the second position coordinate information is changed, the observation position of the second observation point is also changed, so that the terminal display device causes the stereoscopic picture to be changed through the change of the display position.
When the terminal display device displays the current stereoscopic picture, a sampler of the terminal display device can collect second image characteristic information generated by the current stereoscopic picture. Namely, the sampler of the terminal display device can collect the current second position coordinate information and the second view coordinate information.
After the terminal display device collects the current second position coordinate information and the second view angle coordinate information through the sampler of the terminal display device, the terminal display device can acquire the second position coordinate information and the second view angle coordinate information. The current second position coordinate information and the second view angle coordinate information of the sampler are input into the converter. The converter converts the second position coordinate information and the second view coordinate information into coordinate matrixes respectively through analysis. And the terminal display equipment converts the second position coordinate information and the second visual angle coordinate information into a coordinate matrix and sends the coordinate matrix to the AR/VR equipment.
One second image characteristic information corresponds to only one specific stereoscopic picture. The virtual stereo space displayed by the terminal display device is the same as the virtual stereo space displayed by the AR/VR device, and when the terminal display device and the AR/VR device both display stereo pictures through the same second image feature information, it can be understood that the terminal display device and the AR/VR device both observe at the same position and at the same observation angle in the virtual stereo space. Therefore, after the terminal display device converts the second image characteristic information into the coordinate matrix through the converter and sends the coordinate matrix to the AR/VR device, the AR/VR device can display the same stereoscopic picture as the terminal display device.
And continuously sending the current second image characteristic information to the AR/VR equipment through the terminal display equipment, and when the stereo picture displayed by the terminal display equipment changes to cause the relative change of the second image characteristic information, synchronously changing the second image characteristic information sent to the AR/VR equipment. Therefore, when the AR/VR system is in the first control mode, the current second image feature information is continuously sent to the AR/VR equipment through the terminal display equipment, and the stereo picture displayed by the AR/VR equipment is synchronized with the terminal display equipment.
In this embodiment, when the AR/VR system is in the first control mode, the terminal display device may close the permission of the AR/VR device to acquire the first position coordinate information of the AR/VR device. The terminal display device can control the AR/VR device to synchronously display the stereoscopic picture and the stereoscopic picture with the changed observation position according to the second position coordinate information and the change of the second position coordinate information.
In one specific implementation mode, the terminal display device only closes the authority of the AR/VR device to acquire the first position coordinate information in the stereoscopic picture of the terminal display device. Therefore, the terminal display equipment can also receive the first visual angle coordinate information returned by the AR/VR equipment. The terminal display device receives the coordinate matrix information of the first visual angle coordinate information returned by the AR/VR device, and the terminal display device analyzes the coordinate matrix information of the first visual angle coordinate information through the receiving matrix. When the analyzed first visual angle coordinate information is the same as the analyzed second visual angle coordinate information, the display visual angle of the three-dimensional picture displayed by the terminal display equipment is kept unchanged; when the analyzed first visual angle coordinate information is different from the analyzed second visual angle coordinate information, the terminal display equipment adjusts the first visual angle coordinate information to be the same as the received second visual angle coordinate information, and therefore the terminal display equipment can enable the display visual angle in the stereoscopic picture to be synchronous with the display of the AR/VR equipment.
Therefore, in the first control mode, the terminal display device can control the AR/VR device to synchronously display the stereoscopic picture with the same observation visual angle and observation position as the stereoscopic picture by sending the second position coordinate information and the second visual angle coordinate information to the AR/VR device. And the terminal display equipment can receive the first visual angle coordinate information returned by the AR/VR equipment, so that the observation visual angle in the stereoscopic picture displayed by the terminal display equipment can be synchronously changed along with the change of the observation visual angle in the stereoscopic picture displayed by the AR/VR equipment.
The first embodiment of the invention also provides a specific method for data interaction of the AR/VR system in the second control mode. The data interaction method in the second control mode takes the terminal display device as an execution subject.
Referring to fig. 3, fig. 3 is a flowchart illustrating the terminal display device in the second control mode in the first embodiment. In this embodiment, after the terminal display device logs in, the initial control state is the first control mode by default due to the AR/VR system. And the terminal display equipment enables the AR/VR system to enter a second control mode by starting the authority of the AR/VR equipment to acquire the data of the terminal display equipment. When the AR/VR system is in the second control mode, the terminal display device can not only send the second image characteristic information to the AR/VR device, but also receive the first image characteristic information sent by the AR/VR device, so that the terminal display device can synchronously display the same stereoscopic picture as the stereoscopic picture displayed by the AR/VR device.
Specifically, the process of the terminal display device in the second control mode includes: step S310, step S320.
Step S310: and the terminal display equipment opens the authority of the AR/VR equipment for acquiring the first image feature information in the stereoscopic picture displayed by the AR/VR equipment.
And the AR/VR system is in a second control mode, and the terminal display equipment opens the authority of the AR/VR equipment to acquire the first image feature information in the self stereo picture in the second control mode. The terminal display device opens the authority of the AR/VR device to acquire the first image feature information in its own stereoscopic picture, that is, the terminal display device controls the controller in the AR/VR device again, so that the controller in the AR/VR device is coupled with the sampler in the AR/VR device, and the controller in the AR/VR device can receive the first image feature information sampled by the sampler in the AR/VR device. The AR/VR acquisition permission is opened through the terminal display device, and then the AR/VR device can acquire first image feature information of the AR/VR device.
Step S320: and the terminal display equipment receives the first image characteristic information in the currently displayed stereoscopic picture returned by the AR/VR equipment and synchronously displays the stereoscopic picture.
And when the stereo picture displayed by the terminal display device changes, the second image characteristic information is relatively changed, and the second image characteristic information sent to the AR/VR device is also synchronously changed. Therefore, when the AR/VR system is in the second control mode, the current second image feature information is continuously sent to the AR/VR equipment through the terminal display equipment, and the stereo picture displayed by the AR/VR equipment is synchronized with the terminal display equipment. And the terminal display equipment can open the authority of the AR/VR equipment for acquiring the first position coordinate information of the AR/VR equipment.
Therefore, the terminal display equipment can also receive the first image characteristic information returned by the AR/VR equipment. And the terminal display equipment receives the first image characteristic information returned by the AR/VR equipment as the coordinate matrix information of the first visual angle coordinate information and the coordinate matrix information of the first position coordinate information. And the terminal display equipment analyzes the coordinate matrix information of the first visual angle coordinate information and the coordinate matrix information of the first position coordinate information through the receiving matrix.
After the analysis, the first visual angle coordinate information and the first position coordinate information in the first image characteristic information are the same as the second visual angle coordinate information and the second position coordinate information in the second image characteristic information, and the three-dimensional picture displayed by the terminal display equipment is kept unchanged; after the analysis, if any one of the first perspective coordinate information and the first position coordinate information in the first image feature information is different from any one of the second perspective coordinate information and the second position coordinate information in the second image feature information, the terminal display device adjusts the second image feature information to be the same as the received first image feature information, so that the terminal display device can synchronize the display of the displayed stereoscopic picture with the display of the AR/VR device.
Therefore, in the second control mode, the terminal display device can control the AR/VR device to synchronously display the stereoscopic picture with the same observation visual angle and observation position as the stereoscopic picture by sending the second position coordinate information and the second visual angle coordinate information to the AR/VR device. And the terminal display equipment can receive the first visual angle coordinate information and the second visual angle coordinate information returned by the AR/VR equipment, so that the observation visual angle and the observation position in the three-dimensional picture displayed by the terminal display equipment can change synchronously along with the change of the observation visual angle and the observation position in the three-dimensional picture displayed by the AR/VR equipment, and further, the observation visual angle and the observation position in the three-dimensional picture displayed by the terminal display equipment are synchronous with the first three-dimensional surface displayed by the AR/VR equipment.
Second embodiment
The second embodiment of the invention provides a specific method for data interaction of the AR/VR system in the first control mode. The method of data interaction in the second embodiment is implemented by using an AR/VR device.
Referring to fig. 4, fig. 4 is a flowchart illustrating the AR/VR device in the first control mode according to the embodiment. In this embodiment, after the AR/VR device obtains the image data cache, data interaction can be performed. In the first control mode, the authority of the AR/VR device for acquiring the data is closed by the terminal display device, so that the AR/VR device can receive the pictures sent by the terminal display device and synchronously display the pictures same as the terminal display device.
Specifically, the flow of the AR/VR device in the first control mode includes: step S410, step S420.
And step S410, the authority of the AR/VR equipment for acquiring the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment is closed by the terminal display equipment.
In the initial state of the operation of the AR/VR system, the authority of the AR/VR system for acquiescing the first image feature information in the stereoscopic picture of the AR/VR system is closed to the initial state by the terminal display device. It can be understood that the authority of the AR/VR device to acquire the first image feature information in its own stereoscopic picture is turned off by the terminal display device, that is, the controller in the AR/VR device is controlled by the terminal display device, the coupling between the controller in the AR/VR device and the sampler in the AR/VR device is disconnected, and the controller in the AR/VR device cannot receive the first image feature information sampled by the sampler in the AR/VR device. And the AR/VR acquisition permission is closed through the terminal display equipment, and the AR/VR equipment cannot acquire the first image characteristic information of the AR/VR equipment.
Preferably, to prevent the dizziness associated with using AR/VR devices. In this embodiment, when the AR/VR system is in the first control mode, the authority of the AR/VR device to acquire the first position coordinate information in its own stereoscopic picture is turned off by the terminal display device. That is, the sampler in the AR/VR device can transmit the sampled first view coordinate information to the controller in the AR/VR device.
Step S420, the AR/VR device receives the second image feature information in the stereoscopic picture currently displayed by the terminal display device and sent by the terminal display device, and synchronously displays the stereoscopic picture.
The AR/VR system is in a second control mode, and the AR/VR equipment receives second image characteristic information which is sent by the terminal display equipment and corresponds to the current display of the terminal display equipment continuously. The AR/VR equipment compares the received second image characteristic information with the first image characteristic information generated by the AR/VR equipment after analysis. And when the AR/VR equipment compares the analyzed second image characteristic information with the first image characteristic information of the AR/VR equipment, the analyzed second image characteristic information is the same as the first image characteristic information of the AR/VR equipment, so that the stereoscopic picture displayed by the AR/VR equipment is the same as the stereoscopic picture displayed by the terminal display equipment. When the AR/VR equipment compares the analyzed second image characteristic information with the first image characteristic information of the AR/VR equipment, the AR/VR equipment adjusts the first image characteristic information of the AR/VR equipment to be the same as the second image characteristic information, so that the AR/VR equipment adjusts the displayed stereoscopic picture to be the same as the stereoscopic picture displayed by the terminal display equipment again, and the stereoscopic picture displayed by the AR/VR equipment and the stereoscopic picture displayed by the terminal display equipment can be kept the same. Therefore, when the AR/VR system is in the first control mode, the AR/VR device continuously receives the second image characteristic information which is sent by the terminal display device and is currently used for displaying, and the stereo picture displayed by the AR/VR device is synchronized with the terminal display device.
In this embodiment, when the AR/VR system is in the first control mode, the AR/VR device is turned off only by the terminal display device for the right to acquire the first position coordinate information of the AR/VR device. The AR/VR device is capable of displaying a stereoscopic picture in synchronization with the display of the terminal display device and a stereoscopic picture with a change in the observation position. However, the AR/VR device only has the authority of acquiring the first position coordinate information in the self stereo picture and is closed by the terminal display device. Therefore, the AR/VR device can also transmit the first perspective coordinate information to the terminal display device. When the observation angle in the displayed stereoscopic picture of the AR/VR device is not changed, the first visual angle coordinate information and the second visual angle coordinate information sent to the terminal display device by the AR/VR device are the same, and at the moment, the display picture of the AR/VR device is kept the same as that of the terminal display device. When the observation angle in the displayed stereoscopic picture of the AR/VR equipment changes, the first visual angle coordinate information and the second visual angle coordinate information sent to the terminal display equipment by the AR/VR equipment are different. In this state, the AR/VR device can cause the terminal display device to adjust the display screen to be the same as the current display screen of the AR/VR device itself.
Therefore, in the first control mode, the AR/VR device can transmit the second position coordinate information and the second view angle coordinate information through the receiving terminal display device, thereby synchronously displaying a stereoscopic picture having the same viewing angle and viewing position as the stereoscopic picture. The AR/VR device can send the first visual angle coordinate information to the terminal display device, so that the observation visual angle in the stereoscopic picture displayed by the terminal display device can be synchronously changed along with the change of the observation visual angle in the stereoscopic picture displayed by the AR/VR device.
The first embodiment of the invention also provides a specific method for data interaction of the AR/VR system in the second control mode. The data interaction method in the second control mode takes the terminal display device as an execution subject.
Referring to fig. 5, fig. 5 is a flowchart illustrating the AR/VR device in the second control mode in the second embodiment. In this embodiment, after the AR/VR device obtains the image data buffer, the initial control state is the first control mode by default due to the AR/VR system. And when the authority of the AR/VR device for acquiring the data is started by the terminal display device, the AR/VR system enters a second control mode. When the AR/VR system is in the second control mode, the AR/VR device can not only receive the second image characteristic information sent by the terminal display device, but also send the first image characteristic information to the terminal display device, so that the terminal display device can synchronously display the same stereoscopic picture as the stereoscopic picture displayed by the AR/VR device.
Specifically, the flow of the AR/VR device in the second control mode includes: step S510, step S520.
Step S510: and the authority of the AR/VR equipment for acquiring the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment is opened by the terminal display equipment.
And the AR/VR system is in a second control mode, and the authority of the AR/VR device for acquiring the first image feature information in the stereoscopic picture of the AR/VR device is opened by the terminal display device in the second control mode. The method can be understood that the authority of the AR/VR device to acquire the first image feature information in the stereoscopic picture of the AR/VR device is opened by the terminal display device, that is, the controller in the AR/VR device is coupled with the sampler in the AR/VR device in the secondary mode under the control of the terminal display device, and then the controller in the AR/VR device can receive the first image feature information sampled by the sampler in the AR/VR device and can send the first image feature information to the terminal display device.
Step S520: and the AR/VR equipment sends the first image characteristic information in the currently displayed stereoscopic picture to the terminal display equipment so that the terminal display equipment synchronously displays the stereoscopic picture.
The AR/VR system is in a second control mode, and the AR/VR equipment continuously receives the current second image characteristic information sent by the terminal display equipment. And the AR/VR equipment analyzes the received second image characteristic information to obtain coordinate matrix information of the second visual angle coordinate information and coordinate matrix information of the second position coordinate information. After the analysis, the second visual angle coordinate information and the second position coordinate information in the second image characteristic information are the same as the first visual angle coordinate information and the first position coordinate information in the first image characteristic information of the AR/VR equipment, and the three-dimensional picture displayed by the AR/VR equipment is kept unchanged; after the analysis, if any one of the second perspective coordinate information and the second position coordinate information in the second image feature information is different from any one of the first perspective coordinate information and the first position coordinate information in the first image feature information of the AR/VR device, the AR/VR device adjusts the first image feature information of the AR/VR device to be the same as the received second image feature information, so that the AR/VR device can synchronize the display of the displayed stereoscopic picture with the display of the terminal display device.
And the authority of the AR/VR equipment for acquiring the first position coordinate information of the AR/VR equipment is opened by the terminal display equipment. Therefore, the AR/VR device is also capable of transmitting the first image feature information to the terminal display device. When the stereo picture displayed by the AR/VR device changes, the first image characteristic information is relatively changed, and the first image characteristic information sent to the terminal display device is also changed synchronously. Therefore, when the AR/VR system is in the first control mode, the current first image feature information is continuously sent to the terminal display equipment through the AR/VR equipment, and the stereoscopic picture displayed by the terminal display equipment and the display of the AR/VR equipment are synchronous.
Therefore, in the second control mode, the AR/VR device can receive the second position coordinate information and the second view angle coordinate information sent by the terminal display device, so that the AR/VR device synchronously displays a stereoscopic picture with the same viewing angle and viewing position as the stereoscopic picture. And the AR/VR equipment can send the first visual angle coordinate information and the second visual angle coordinate information to the terminal display equipment, so that the observation visual angle and the observation position in the three-dimensional picture displayed by the terminal display equipment can change synchronously along with the change of the observation visual angle and the observation position in the three-dimensional picture displayed by the AR/VR equipment, and further, the observation visual angle and the observation position in the three-dimensional picture displayed by the terminal display equipment are synchronous with the first three-dimensional surface displayed by the AR/VR equipment.
Third embodiment
The third embodiment of the invention provides a specific method for data interaction between terminal display equipment and AR/VR equipment when an AR/VR system is in a first control mode.
Referring to fig. 6, fig. 6 is a flowchart illustrating interaction between a terminal display device and an AR/VR device in a first control mode in a third embodiment. Specifically, the method comprises the following steps: step S610, step S620, step S630; the following describes a specific flow of the data interaction method provided in the embodiment of the present invention in detail.
Step 610: and the terminal display equipment closes the authority of the AR/VR equipment to acquire the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment.
Step 620: and the terminal display equipment sends the second image characteristic information in the currently displayed stereo picture to the AR/VR equipment.
Step 630: and the AR/VR equipment receives the second image characteristic information in the stereoscopic picture currently displayed by the terminal display equipment and sent by the terminal display equipment, so that the AR/VR equipment synchronously displays the stereoscopic picture.
Referring to fig. 7, fig. 7 is a flowchart illustrating interaction between the terminal display device and the AR/VR device in the second control mode according to the embodiment. Specifically, the method comprises the following steps: step S710, step S720, step S730; the following describes a specific flow of the data interaction method provided in the embodiment of the present invention in detail.
Step S710: and the terminal display equipment opens the authority of the AR/VR equipment for acquiring the first image feature information in the stereoscopic picture displayed by the AR/VR equipment.
Step S720: and the AR/VR equipment sends the first image characteristic information in the displayed stereoscopic picture to the terminal display equipment.
Step S730: and the terminal display equipment receives the first image characteristic information in the currently displayed stereoscopic picture returned by the AR/VR equipment and synchronously displays the stereoscopic picture.
It should be noted that, as those skilled in the art can clearly understand, for convenience and brevity of description, the above-described interaction process may refer to the corresponding process in the foregoing method embodiment, and is not described herein again.
The following will specifically describe this embodiment by taking an interaction scenario of an actual application as an example.
Referring to fig. 8, fig. 8 shows an actual interaction flow of the terminal display device and the AR/VR device.
The AR/VR system enters an interactive mode, and the AR/VR system defaults to a first control mode in an initial state. At the moment, the terminal display device controls the display visual angle and the display position of the stereoscopic picture displayed by the terminal display device, so that the display visual angle and the display position of the AR/VR device are synchronously controlled. The AR/VR device can control the display visual angle of the stereoscopic picture displayed by the AR/VR device in the first control mode, and can also synchronously control the display visual angle of the stereoscopic picture displayed by the terminal display device.
And when the terminal display equipment authorizes the AR/VR equipment, the AR/VR system enters a second control mode. At the moment, the terminal display device controls the display visual angle and the display position of the stereoscopic picture displayed by the terminal display device, so that the display visual angle and the display position of the AR/VR device are synchronously controlled. The AR/VR device can control not only the display angle of the stereoscopic picture displayed by itself but also the display position of the stereoscopic picture displayed by itself in the second control mode, and can also synchronously control the display angle and the display position of the stereoscopic picture displayed by the terminal display device.
When the terminal display device withdraws authorization from the AR/VR device, the AR/VR system defaults to the first control mode again.
Referring to fig. 9, a data interaction device 100 according to an embodiment of the present invention is shown. The data interaction device 100 is provided with a first control mode and a second control mode. And in the first control mode and the second control mode, the interaction device 100 includes:
when the AR/VR system is in the first control mode: the first control module 110 is configured to turn off, by the terminal display device, an authority of the AR/VR device to acquire first image feature information in a stereoscopic picture displayed by the AR/VR device. A first sending module 120, configured to send, by the terminal display device, second image feature information in a stereoscopic picture currently displayed by the terminal display device to the AR/VR device, so that the AR/VR device displays the stereoscopic picture synchronously.
When the system is in the second control mode: the terminal display device further includes a first receiving module 130, configured to receive the first image feature information in the currently displayed stereoscopic image returned by the AR/VR device, and synchronously display the stereoscopic image.
Referring to fig. 10, a data interaction device 100 according to an embodiment of the present invention is shown. The data interaction device 100 is provided with a first control mode and a second control mode. And in the first control mode and the second control mode, the interaction device 100 includes:
when the system is in the first control mode: a second control module 140, configured to close, by the terminal display device, the authority of the AR/VR device to acquire the first image feature information in the stereoscopic image displayed by the AR/VR device. A second receiving module 150, configured to receive, by the AR/VR device, the second image feature information in the stereoscopic image currently displayed by the terminal display device sent by the terminal display device, and synchronously display the stereoscopic image.
When the system is in the second control mode: a second control module 140, configured to enable the AR/VR device to obtain the permission of the first image feature information in the stereoscopic image displayed by the AR/VR device, to be opened by the terminal display device. A second sending module 160, configured to send the first image feature information in the currently displayed stereoscopic picture to the terminal display device by the AR/VR device, so that the terminal display device displays the stereoscopic picture synchronously.
Referring to fig. 11, a data interaction device 100 according to an embodiment of the present invention is shown. The data interaction device 100 is provided with a first control mode and a second control mode. And in the first control mode and the second control mode, the interaction device 100 includes:
when the AR/VR system is in the first control mode: the first control module 110 is configured to turn off, by the terminal display device, an authority of the AR/VR device to acquire first image feature information in a stereoscopic picture displayed by the AR/VR device. A first sending module 120, configured to send, by the terminal display device, second image feature information in a currently displayed stereoscopic picture to the AR/VR device; a second receiving module 150, configured to receive, by the AR/VR device, the second image feature information in the stereoscopic picture currently displayed by the terminal display device, where the second image feature information is sent by the terminal display device, so that the AR/VR device displays the stereoscopic picture synchronously.
When the system is in the second control mode: a first control module 110, configured to open, by the terminal display device, an authority for the AR/VR device to acquire the first image feature information in the stereoscopic image displayed by the AR/VR device. A second sending module 160, configured to send, by the AR/VR device, the first image feature information in the displayed stereoscopic picture to the terminal display device. A first receiving module 130, configured to receive, by the terminal display device, the first image feature information in the currently displayed stereoscopic image returned by the AR/VR device, and synchronously display the stereoscopic image.
It should be noted that, as those skilled in the art can clearly understand, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In summary, the data interaction method and device provided by the invention have the beneficial effects that: by setting a first control mode and a second control mode, the terminal display device in the first control mode closes the authority of the AR/VR device to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR device. And the terminal display device sends the second image characteristic information in the stereoscopic picture currently displayed by the terminal display device to the AR/VR device so that the AR/VR device synchronously displays the stereoscopic picture. In the first control mode, the AR/VR system synchronously controls the same picture displayed by the AR/VR device through the display picture of the terminal display device, so that the interaction of data is controlled through the control of the picture. And in the second control mode, the terminal display equipment opens the authority of the AR/VR equipment to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR equipment. And the terminal display equipment receives the first image characteristic information in the current displayed stereoscopic picture returned by the AR/VR equipment, so that the terminal display equipment synchronously displays the stereoscopic picture. And in the second control mode, the AR/VR system enables the display screen of the terminal display device to be interacted with the display screen of the AR/VR device and keeps synchronization, so that the data interaction mode is realized by limiting the interaction mode of the screen. Therefore, effective control and limitation of data interaction generated by the virtual reality technology or the augmented reality technology when shopping are achieved.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, the functional modules in the embodiments of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a computing device, or a network device) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes. It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Image data caching
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (10)

1. A data interaction method is applied to an AR/VR system, the AR/VR system comprises a terminal display device and an AR/VR device, and the control modes of the AR/VR system comprise a first control mode and a second control mode, and the method comprises the following steps:
when the AR/VR system is in the first control mode:
the terminal display equipment closes the authority of the AR/VR equipment to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR equipment;
the terminal display equipment sends second image characteristic information in a currently displayed stereo picture to the AR/VR equipment so that the AR/VR equipment synchronously displays the stereo picture;
when the system is in the second control mode:
the terminal display equipment opens the authority of the AR/VR equipment to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR equipment;
the terminal display equipment receives the first image characteristic information in the currently displayed stereoscopic picture returned by the AR/VR equipment, and synchronously displays the stereoscopic picture;
wherein the second image feature information includes: the viewpoint position of the camera is currently in second position coordinate information of the virtual three-dimensional space; the camera shoots the stereoscopic picture in the virtual stereoscopic space according to the second position coordinate information and a visual angle direction; the second image feature information further includes: second visual angle coordinate information of the central point of the stereoscopic picture in the virtual stereoscopic space; the step that the terminal display equipment sends the second image characteristic information in the currently displayed stereo picture to the AR/VR equipment comprises the following steps:
the terminal display equipment acquires the second position coordinate information and the second visual angle coordinate information;
and the terminal display equipment sends the second position coordinate information and the second view angle coordinate information to the AR/VR equipment.
2. The method according to claim 1, wherein the second image feature information comprises: second position coordinate information of the viewpoint position of the camera in the virtual three-dimensional space; the camera shoots the stereoscopic picture in the virtual stereoscopic space according to the second position coordinate information and a visual angle direction; the second image feature information further includes: before the step of acquiring the second position coordinate information and the second view coordinate information by the terminal display device, the method further includes:
and the terminal display equipment generates second position coordinate information and second visual angle coordinate information corresponding to the displayed three-dimensional picture according to the displayed three-dimensional picture.
3. The method of claim 2, wherein the first image feature information comprises: the method comprises the following steps that first position coordinate information corresponding to the position of the three-dimensional picture when the three-dimensional picture is observed and first visual angle coordinate information corresponding to the center point of the three-dimensional picture are obtained, and the method further comprises the following steps:
and the terminal display equipment receives the first visual angle coordinate information returned by the AR/VR equipment so as to enable the display visual angle of the stereoscopic picture of the terminal display equipment to be synchronous with the AR/VR equipment.
4. The method of claim 1, further comprising:
the terminal display equipment sends a login request to the computing equipment;
and the terminal display equipment receives an image data cache corresponding to the login request returned by the computing equipment, wherein the image data cache is data corresponding to the stereoscopic picture displayed by the terminal display equipment.
5. A data interaction method is applied to an AR/VR system, the AR/VR system comprises a terminal display device and an AR/VR device, and control modes between the terminal display device and the AR/VR device comprise a first control mode and a second control mode, and the method comprises the following steps:
when the system is in the first control mode:
the authority of the AR/VR equipment for acquiring the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment is closed by the terminal display equipment;
the AR/VR equipment receives second image characteristic information in a stereoscopic picture currently displayed by the terminal display equipment and sent by the terminal display equipment, and synchronously displays the stereoscopic picture;
when the system is in the second control mode:
the authority of the AR/VR equipment for acquiring the first image characteristic information in the stereoscopic picture displayed by the AR/VR equipment is opened by the terminal display equipment;
the AR/VR equipment sends the first image characteristic information in the currently displayed stereoscopic picture to the terminal display equipment so that the terminal display equipment synchronously displays the stereoscopic picture;
wherein the second image feature information includes: the viewpoint position of the camera is currently in second position coordinate information of the virtual three-dimensional space; the camera shoots the stereoscopic picture in the virtual stereoscopic space according to the second position coordinate information and a visual angle direction; the second image feature information further includes: and the second visual angle coordinate information of the central point of the stereo picture in the virtual stereo space.
6. The method of claim 5, further comprising:
the AR/VR equipment sends an image data cache obtaining request to the computing equipment;
and the AR/VR equipment receives an image data cache corresponding to the image data cache obtaining request returned by the computing equipment, wherein the image data cache is data corresponding to the stereoscopic picture displayed by the AR/VR equipment.
7. A data interaction method is applied to an AR/VR system, the AR/VR system comprises a terminal display device and an AR/VR device, and the control modes of the AR/VR system comprise a first control mode and a second control mode, and the method comprises the following steps:
when the AR/VR system is in the first control mode:
the terminal display equipment closes the authority of the AR/VR equipment to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR equipment;
the terminal display equipment sends second image characteristic information in a currently displayed stereo picture to the AR/VR equipment;
the AR/VR equipment receives the second image characteristic information in the stereoscopic picture currently displayed by the terminal display equipment and sent by the terminal display equipment, so that the AR/VR equipment synchronously displays the stereoscopic picture;
when the system is in the second control mode:
the terminal display equipment opens the authority of the AR/VR equipment to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR equipment;
the AR/VR equipment sends the first image characteristic information in the displayed stereoscopic picture to the terminal display equipment;
the terminal display equipment receives the first image characteristic information in the currently displayed stereoscopic picture returned by the AR/VR equipment, and synchronously displays the stereoscopic picture;
wherein the second image feature information includes: the viewpoint position of the camera is currently in second position coordinate information of the virtual three-dimensional space; the camera shoots the stereoscopic picture in the virtual stereoscopic space according to the second position coordinate information and a visual angle direction; the second image feature information further includes: second visual angle coordinate information of the central point of the stereoscopic picture in the virtual stereoscopic space; the step that the terminal display device sends the second image characteristic information in the stereoscopic picture currently displayed by the terminal display device to an AR/VR device comprises the following steps:
the terminal display equipment acquires the second position coordinate information and the second visual angle coordinate information;
and the terminal display equipment sends the second position coordinate information and the second view angle coordinate information to the AR/VR equipment.
8. A data interaction device is applied to an AR/VR system, the control modes of the AR/VR system comprise a first control mode and a second control mode, and the device comprises:
when the AR/VR system is in the first control mode:
the terminal display device comprises a first control module, a second control module and a display module, wherein the first control module is used for the terminal display device to close the authority of the AR/VR device to acquire first image characteristic information in a three-dimensional picture displayed by the AR/VR device;
the terminal display equipment is used for sending second image characteristic information in a currently displayed stereo picture to the AR/VR equipment so as to enable the AR/VR equipment to synchronously display the stereo picture;
when the system is in the second control mode:
the terminal display device is used for opening the authority of the AR/VR device to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR device;
a first receiving module, configured to receive, by the terminal display device, the first image feature information in the currently displayed stereoscopic image returned by the AR/VR device, and synchronously display the stereoscopic image;
wherein the second image feature information includes: the viewpoint position of the camera is currently in second position coordinate information of the virtual three-dimensional space; the camera shoots the stereoscopic picture in the virtual stereoscopic space according to the second position coordinate information and a visual angle direction; the second image feature information further includes: second visual angle coordinate information of the central point of the stereoscopic picture in the virtual stereoscopic space;
the first sending module is configured to obtain, by the terminal display device, the second position coordinate information and the second view coordinate information; and the terminal display equipment sends the second position coordinate information and the second view angle coordinate information to the AR/VR equipment.
9. A data interaction device is applied to an AR/VR system, the AR/VR system comprises a terminal display device and an AR/VR device, and control modes between the terminal display device and the AR/VR device comprise a first control mode and a second control mode, and the device comprises:
when the system is in the first control mode:
the second control module is used for enabling the AR/VR equipment to obtain the authority of the first image feature information in the stereoscopic picture displayed by the AR/VR equipment to be closed by the terminal display equipment;
a second receiving module, configured to receive, by the AR/VR device, second image feature information in a stereoscopic picture currently displayed by the terminal display device, where the second image feature information is sent by the terminal display device, and synchronously display the stereoscopic picture;
when the system is in the second control mode:
the second control module is used for enabling the AR/VR equipment to acquire the authority of the first image feature information in the stereoscopic picture displayed by the AR/VR equipment to be opened by the terminal display equipment;
a second sending module, configured to send, by the AR/VR device, the first image feature information in the currently displayed stereoscopic picture to the terminal display device, so that the terminal display device displays the stereoscopic picture synchronously;
wherein the second image feature information includes: the viewpoint position of the camera is currently in second position coordinate information of the virtual three-dimensional space; the camera shoots the stereoscopic picture in the virtual stereoscopic space according to the second position coordinate information and a visual angle direction; the second image feature information further includes: and the second visual angle coordinate information of the central point of the stereo picture in the virtual stereo space.
10. A data interaction device is applied to an AR/VR system, the AR/VR system comprises a terminal display device and an AR/VR device, the control modes of the AR/VR system comprise a first control mode and a second control mode, and the device comprises:
when the AR/VR system is in the first control mode:
the terminal display equipment is used for closing the authority of the AR/VR equipment to acquire first image feature information in a stereoscopic picture displayed by the AR/VR equipment;
the first sending module is used for sending second image characteristic information in a currently displayed stereo picture to the AR/VR equipment by the terminal display equipment;
a second receiving module, configured to receive, by the AR/VR device, the second image feature information in the stereoscopic picture currently displayed by the terminal display device, where the second image feature information is sent by the terminal display device, so that the AR/VR device displays the stereoscopic picture synchronously;
when the system is in the second control mode:
the terminal display device is used for opening the authority of the AR/VR device to acquire the first image feature information in the stereoscopic picture displayed by the AR/VR device;
a second sending module, configured to send, by the AR/VR device, the first image feature information in the displayed stereoscopic picture to the terminal display device;
a first receiving module, configured to receive, by the terminal display device, the first image feature information in the currently displayed stereoscopic image returned by the AR/VR device, and synchronously display the stereoscopic image;
wherein the second image feature information includes: the viewpoint position of the camera is currently in second position coordinate information of the virtual three-dimensional space; the camera shoots the stereoscopic picture in the virtual stereoscopic space according to the second position coordinate information and a visual angle direction; the second image feature information further includes: second visual angle coordinate information of the central point of the stereoscopic picture in the virtual stereoscopic space;
the first sending module is configured to obtain, by the terminal display device, the second position coordinate information and the second view coordinate information; and the terminal display equipment sends the second position coordinate information and the second view angle coordinate information to the AR/VR equipment.
CN201610655920.6A 2016-08-11 2016-08-11 Data interaction method and device Active CN108307184B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610655920.6A CN108307184B (en) 2016-08-11 2016-08-11 Data interaction method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610655920.6A CN108307184B (en) 2016-08-11 2016-08-11 Data interaction method and device

Publications (2)

Publication Number Publication Date
CN108307184A CN108307184A (en) 2018-07-20
CN108307184B true CN108307184B (en) 2020-05-01

Family

ID=62871625

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610655920.6A Active CN108307184B (en) 2016-08-11 2016-08-11 Data interaction method and device

Country Status (1)

Country Link
CN (1) CN108307184B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1547131A (en) * 2003-12-03 2004-11-17 谭日辉 Virtual reality interactive control system
CN104035760A (en) * 2014-03-04 2014-09-10 苏州天魂网络科技有限公司 System capable of realizing immersive virtual reality over mobile platforms
CN104205857A (en) * 2012-03-26 2014-12-10 索尼公司 Information processing apparatus, information processing method, and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1547131A (en) * 2003-12-03 2004-11-17 谭日辉 Virtual reality interactive control system
CN104205857A (en) * 2012-03-26 2014-12-10 索尼公司 Information processing apparatus, information processing method, and program
CN104035760A (en) * 2014-03-04 2014-09-10 苏州天魂网络科技有限公司 System capable of realizing immersive virtual reality over mobile platforms

Also Published As

Publication number Publication date
CN108307184A (en) 2018-07-20

Similar Documents

Publication Publication Date Title
CN106210861B (en) Method and system for displaying bullet screen
US10200654B2 (en) Systems and methods for real time manipulation and interaction with multiple dynamic and synchronized video streams in an augmented or multi-dimensional space
US11075865B2 (en) Method and apparatus for transmitting business object
US20170192734A1 (en) Multi-interface unified displaying system and method based on virtual reality
EP4083929A1 (en) Information providing device, information providing system, information providing method, and information providing program
US11227437B2 (en) Three-dimensional model constructing method, apparatus, and system
CN108776917B (en) Synchronous processing method and device for virtual three-dimensional space
CN111414225A (en) Three-dimensional model remote display method, first terminal, electronic device and storage medium
JP2018513441A (en) Determination of region to be superimposed, image superimposition, image display method and apparatus
US10887195B2 (en) Computer system, remote control notification method and program
CN108765084B (en) Synchronous processing method and device for virtual three-dimensional space
KR20140068332A (en) Menu board advertising service system using recognition of augmented reality marker and method thereof
CN106302666B (en) Data push method and device
WO2018149321A1 (en) Method and device for providing interactive object information
CN108037904B (en) Visual data pushing method and system
US20190164323A1 (en) Method and program for generating virtual reality contents
KR101681667B1 (en) System and method for sharing information of goods on sale on real time
CN108307184B (en) Data interaction method and device
CN112533053A (en) Live broadcast interaction method and device, electronic equipment and storage medium
TWI705692B (en) Information sharing method and device in three-dimensional scene model
WO2016066056A1 (en) Image remote projection method, server and client
CN111538920A (en) Content presentation method, device, system, storage medium and electronic device
TW201812609A (en) System and method for file sharing based on virtual reality/augmented reality and instant message service
KR102674102B1 (en) Method for processing visual network service and apparatus for the same
AU2021104883A4 (en) Internet of things based intelligent system for providing online store for share and sale of virtual objects based on cloud computing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant