CN117971103A - Interaction method, device, electronic equipment and medium in augmented reality space - Google Patents
Interaction method, device, electronic equipment and medium in augmented reality space Download PDFInfo
- Publication number
- CN117971103A CN117971103A CN202211304828.7A CN202211304828A CN117971103A CN 117971103 A CN117971103 A CN 117971103A CN 202211304828 A CN202211304828 A CN 202211304828A CN 117971103 A CN117971103 A CN 117971103A
- Authority
- CN
- China
- Prior art keywords
- augmented reality
- reality space
- shared data
- sharing
- operation instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 176
- 230000003993 interaction Effects 0.000 title claims abstract description 108
- 238000000034 method Methods 0.000 title claims abstract description 69
- 230000004044 response Effects 0.000 claims abstract description 48
- 238000004891 communication Methods 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 17
- 230000002452 interceptive effect Effects 0.000 claims 1
- 230000008569 process Effects 0.000 description 18
- 238000010586 diagram Methods 0.000 description 11
- 230000000007 visual effect Effects 0.000 description 11
- 230000006870 function Effects 0.000 description 6
- 230000002093 peripheral effect Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0486—Drag-and-drop
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure provides an interaction method, an interaction device, an interaction electronic device and an interaction medium in an extended reality space, and relates to the technical field of extended reality, wherein an operation interface corresponding to first shared data is displayed in the extended reality space through the first shared data sent based on the shared device; receiving first response information generated by the sharing equipment based on the first operation instruction information; responding to the first operation instruction information in the augmented reality space based on the first response information. By adopting the mode, the interaction function between the augmented reality interaction device and the sharing device can be realized, the data sharing is realized, the sharing device can be operated in the augmented reality environment by a user, the switching between the augmented reality environment and the sharing device is avoided, and the user experience is improved.
Description
Technical Field
The disclosure relates to the technical field of augmented reality, and in particular relates to an interaction method, device, electronic equipment and medium in an augmented reality space.
Background
The augmented Reality refers to a Virtual environment that combines Reality and Virtual through a computer, so as to realize a human-computer interaction, and currently in the technical field of the augmented Reality, virtual Reality (VR) technology and augmented Reality (Augmented Reality, AR) technology have been widely applied to various industries in real life.
In the prior art, user interaction in an augmented reality environment is mainly achieved with augmented reality interaction devices (e.g., head mounted visual devices and handles).
Disclosure of Invention
In order to solve the technical problems described above or at least partially solve the technical problems described above, the present disclosure provides an interaction method, an apparatus, an electronic device, and a medium in an augmented reality space.
In a first aspect, the present disclosure provides an interaction method in an augmented reality space, including:
Based on first shared data sent by the sharing equipment, displaying an operation interface corresponding to the first shared data in an extended reality space;
receiving first response information generated by the sharing equipment based on first operation instruction information;
Responding to the first operation instruction information in the augmented reality space based on the first response information.
As an optional implementation manner of the embodiment of the present disclosure, before receiving the first response information generated by the sharing device based on the first operation instruction information, the method further includes:
acquiring first operation instruction information input based on the operation interface;
And sending the first operation instruction information to the sharing equipment.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining the first operation instruction information input based on the operation interface includes:
and acquiring first operation instruction information input through the augmented reality interaction device, the gesture or the voice.
As an optional implementation manner of the embodiment of the present disclosure, based on the first shared data sent by the sharing device, displaying an operation interface corresponding to the first shared data in an augmented reality space includes:
Receiving first shared data sent by the sharing equipment, and displaying prompt information in the augmented reality space;
and responding to the trigger of the prompt information, and displaying an operation interface corresponding to the first shared data.
As an alternative implementation of the embodiment of the present disclosure, further includes:
responding to the scaling operation of the user on the operation interface, and scaling the operation interface;
And/or the number of the groups of groups,
And responding to the adjustment operation of the user on the display position of the operation interface, and adjusting the display position of the operation interface.
As an optional implementation manner of the embodiment of the present disclosure, before displaying an operation interface corresponding to the first shared data in the augmented reality space, the method further includes:
a communication connection is established with the sharing device.
As an optional implementation manner of the embodiment of the disclosure, the establishing a communication connection with the sharing device includes:
And triggering a display setting panel in the augmented reality space, selecting the sharing equipment in the setting panel, and triggering the establishment of communication connection with the sharing equipment.
As an alternative implementation of the embodiment of the present disclosure, further includes:
Receiving a second operation instruction for second shared data sent by the sharing device, wherein the second shared data is used for being displayed in an augmented reality environment;
And responding to the second operation instruction, and processing the second shared data.
In a second aspect, the present disclosure provides an interaction device in an augmented reality space, comprising:
the display module is used for displaying an operation interface corresponding to the first shared data in the augmented reality space based on the first shared data sent by the sharing equipment;
the receiving module is used for receiving first response information generated by the sharing equipment based on the first operation instruction information;
And the response module is used for responding to the first operation instruction information in the augmented reality space based on the first response information.
In a third aspect, the present disclosure provides an electronic device comprising: one or more processors; a memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory; wherein the one or more processors, when executing the one or more computer programs, cause the electronic device to implement the interaction method in an augmented reality space as claimed in any one of the first aspects.
In a fourth aspect, the present disclosure provides a computer readable storage medium comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the interaction method in an augmented reality space according to any one of the first aspects.
In a fifth aspect, the present disclosure provides a computer program product, which when run on a computer causes the computer to perform the interaction method in an augmented reality space according to any one of the first aspects.
In the technical scheme provided by the embodiment of the disclosure, an operation interface corresponding to first shared data is displayed in an augmented reality space through the first shared data sent based on the shared equipment; first response information generated by the sharing device based on the first operation instruction information is received, and response is performed on the first operation instruction information in the augmented reality space based on the first response information. In the process, the first shared data sent by the sharing device can be received by the augmented reality interaction device, the corresponding operation interface is displayed in the augmented reality space, the first response information generated by the sharing device aiming at the first operation instruction information can be received, and the response is performed in the augmented reality space, so that the interaction function between the augmented reality interaction device and the sharing device is realized, the data sharing is realized, the user can operate the sharing device in the augmented reality environment, the switching between the augmented reality environment and the sharing device is avoided, and the user experience is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.
In order to more clearly illustrate the embodiments of the present disclosure or the solutions in the prior art, the drawings that are required for the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a schematic flow chart of an embodiment of an interaction method in an augmented reality space provided by the present disclosure;
fig. 2 is a schematic diagram of an application scenario of an interaction method in an augmented reality space according to an embodiment of the present disclosure;
FIG. 3 is a schematic flow chart of another embodiment of an interaction method in an augmented reality space provided by the present disclosure;
Fig. 4 is a schematic diagram of communication connection in an embodiment of an interaction method in an augmented reality space provided by the present disclosure;
FIG. 5 is a flow diagram of an embodiment of an interaction method in an augmented reality space provided by the present disclosure;
Fig. 6 is a schematic diagram of an application scenario in another embodiment of an interaction method in an augmented reality space provided by the present disclosure;
FIG. 7 is a schematic flow chart diagram of an embodiment of an interaction method in an augmented reality space according to the present disclosure;
Fig. 8 is a schematic diagram of an application scenario in an embodiment of an interaction method in an extended real space provided by the present disclosure;
fig. 9 is a schematic diagram of performing scaling operation processing on an operation interface in an embodiment of an interaction method in an augmented reality space provided by the present disclosure;
Fig. 10 is a schematic diagram of adjusting a display position of an operation interface in an embodiment of an interaction method in an augmented reality space according to the present disclosure;
Fig. 11 is a schematic structural diagram of an interaction device in an augmented reality space provided by the present disclosure.
Detailed Description
In order that the above objects, features and advantages of the present disclosure may be more clearly understood, a further description of aspects of the present disclosure will be provided below. It should be noted that, without conflict, the embodiments of the present disclosure and features in the embodiments may be combined with each other.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced otherwise than as described herein; it will be apparent that the embodiments in the specification are only some, but not all, embodiments of the disclosure.
User interaction in an augmented reality environment is achieved using an augmented reality interaction device (e.g., a head mounted visual device and a handle). However, in a practical application scenario, a user needs to operate some other devices during the process of using the augmented reality interaction device, for example, the user is watching a movie in an augmented reality environment, and when a phone is available, the user needs to pick up the augmented reality head-mounted visual device, answer an incoming call of the phone, and then wear the head-mounted visual device again to continue watching the movie after the end, and some other devices may also receive a message, etc., so that the user may need to frequently pick up the head-mounted visual device, thereby affecting the user experience.
The present disclosure provides an interaction processing method in an extended reality space, where the interaction processing method in the extended reality space enables an extended reality interaction device to receive first shared data sent by a sharing device by performing communication connection between the extended reality interaction device and the sharing device, and based on the first shared data sent by the sharing device, displays an operation interface corresponding to the first shared data in the extended reality space, and then receives first response information generated by the sharing device based on first operation instruction information, where the first operation instruction information is used for operating the operation interface; and finally responding to the first operation instruction information in the augmented reality space based on the first response information. In the process, the first shared data sent by the sharing device can be received by the augmented reality interaction device, the corresponding operation interface is displayed in the augmented reality space, and when the operation interface operates, the first response information generated by the sharing device aiming at the first operation instruction information can be received and responded in the augmented reality space, so that the interaction function between the augmented reality interaction device and the sharing device is realized by adopting the mode, data sharing is realized, a user can operate the sharing device in the augmented reality environment, switching between the augmented reality environment and the sharing device is avoided, and user experience is improved.
The interaction method in the augmented reality space provided by the disclosure can be applied to an interaction device in the augmented reality space, the device can be electronic equipment such as VR head display equipment and augmented reality (Augmented Reality, AR) equipment such as AR glasses, and optionally, the device can also be a functional module or a functional entity which can realize the interaction method in the augmented reality space in the electronic equipment.
The technical solutions of the present disclosure are described below in several specific embodiments.
Fig. 1 is a schematic flow chart of an embodiment of an interaction method in an augmented reality space, where, as shown in fig. 1, the method in this embodiment includes the following steps:
S11, based on the first shared data sent by the sharing device, displaying an operation interface corresponding to the first shared data in the augmented reality space.
The sharing device refers to an electronic device used for displaying data of the electronic device in an augmented reality space by an augmented reality interaction device, and the sharing device may be, for example, an electronic device capable of running an application program, such as a smart phone, a tablet computer, and a smart watch, but is not limited thereto. The first shared data refers to data displayed in the augmented reality space, and may be, for example, data corresponding to a current display interface of the sharing device, but is not limited thereto, and the present disclosure is not particularly limited. The augmented reality space refers to a simulated virtual space constructed using an augmented reality interaction device such as a head mounted visual device.
Specifically, after receiving the first shared data sent by the sharing device, the augmented reality interaction device displays, for the first shared data, a corresponding operation interface in an augmented reality space generated by the augmented reality interaction device.
For example, referring to fig. 2, a schematic diagram of an application scenario of an interaction method in an augmented reality space according to an embodiment of the present disclosure includes an augmented reality interaction device 100, such as a head-mounted visual device, and a sharing device 200, such as a smart phone, where the first shared data is data corresponding to a current display interface 201 of the sharing device 200, and after the augmented reality interaction device 100 receives the first shared data sent by the sharing device 200, the augmented reality interaction device 100 displays an operation interface 101 corresponding to the first shared data in the augmented reality space generated by using the augmented reality interaction device 100, which is not limited in this disclosure.
Optionally, on the basis of the above embodiment, in some embodiments of the present disclosure, as shown in fig. 3, before executing S11, the method further includes:
S31, establishing communication connection with the sharing equipment.
For example, in the foregoing embodiment, the manner of establishing the communication connection between the augmented reality interaction device and the 100 sharing device 200, such as a smart phone, may be a wireless bluetooth connection, a local area network connection, such as Wifi, but is not limited thereto, and the disclosure is not particularly limited thereto, and those skilled in the art may set up according to practical situations.
Alternatively, based on the above embodiments, in some embodiments of the present disclosure, an implementation of S31 may be:
Triggering a display setting panel in the augmented reality space, selecting sharing equipment in the setting panel, and establishing communication connection between the triggering and the sharing equipment.
For example, referring to fig. 4, when the sharing device 200 is communicatively connected to the augmented reality interaction device 100, the display setting panel 102 is triggered in the augmented reality space, wherein the setting panel 102 includes the sharing device 000, the sharing device 200, the sharing device 400, and the sharing device 600, and the user may select the sharing device 200 that needs to be communicatively connected to the augmented reality interaction device 100 in the setting panel 102 so that the sharing device 200 is communicatively connected to the augmented reality interaction device 100, but not limited thereto, the disclosure is not particularly limited, and those skilled in the art may specifically set according to actual situations.
Optionally, based on the above embodiments, in some embodiments of the present disclosure, another implementation manner of establishing a communication connection with the sharing device may further be:
the sharing device 200 can automatically establish a communication connection with the augmented reality interaction device 100 within a preset range of the augmented reality interaction device 100.
It should be noted that, this manner is implemented on the premise that the sharing device 200 has established a communication connection with the augmented reality interaction device 100, and by way of example, when the sharing device 200 establishes a communication connection with the augmented reality interaction device 100 for the first time, the identification information of the sharing device 200 is stored in the preset whitelist of the augmented reality interaction device 100, and when the sharing device 200 is next within the preset range of the augmented reality interaction device 100 and it is determined that the sharing device 200 exists in the preset whitelist of the augmented reality interaction device 100, the communication connection with the augmented reality interaction device 100 can be directly and automatically established, and by this manner, the sharing device 200 and the augmented reality interaction device 100 can be quickly made to perform the communication connection.
S12, first response information generated by the sharing device based on the first operation instruction information is received.
The first operation instruction information is used for operating an operation interface corresponding to the first shared data, and the operation interface corresponding to the first shared data can be an operation interface displayed in an extended reality space or an operation interface displayed on the shared device.
The first operation instruction may be input through, but is not limited to, the following possible implementation manners:
In one possible implementation, the first operation instruction information may be input through a sharing device, for example, the sharing device may be a smart phone, and the user may input the first operation instruction information by clicking a virtual key on the smart phone or the like. The operation of clicking the virtual key and the like can be projected into the augmented reality environment in the form of a cursor to serve as operation visual assistance, so that a user can conveniently operate on the shared device, for example, in some scenes, the user is in the augmented reality environment, the smart phone suddenly calls, but the user does not intend to exit the augmented reality environment, the user can perform blind answering on the smart phone, namely, the user can perform answering operation in a state of not watching a screen of the smart phone, in order to conveniently perform answering operation better, after the user touches the screen of the smart phone, a touch point can be projected onto a corresponding operation interface in the augmented reality environment in the form of the cursor to serve as operation visual assistance, so that the user can conveniently adjust an operation position, accurately perform answering operation and the like. In some scenarios, the first operation instruction information may also be input by other users through the sharing device. The present disclosure is not limited in this regard.
Another possible implementation: the first operation instruction information can be input through the peripheral corresponding to the sharing device. The peripheral device refers to a device which is in communication connection with the sharing device and can control the sharing device, and the peripheral device can be, for example, a handle, a remote controller, a keyboard, a mouse and the like, but is not limited thereto, and the disclosure is not particularly limited thereto.
For example, for a sharing device such as a smart tv, if the smart tv is controlled by a handle communicatively connected to the smart tv, the first operation instruction information can be input using the handle, but not limited thereto, the disclosure is not particularly limited.
In still another possible implementation, the first operation instruction information may be input by the user based on an operation interface displayed in the augmented reality environment. The first operation instruction may be, for example, a single click operation, a double click operation, or a zoom operation, a slide operation, etc. performed on the display interface, but is not limited thereto, and the disclosure is not particularly limited thereto.
Optionally, on the basis of the above embodiment, in some embodiments of the disclosure, as shown in fig. 5, before executing S12, further includes:
s51, acquiring first operation instruction information input based on an operation interface.
Specifically, the augmented reality interaction device acquires first operation instruction information input based on an operation interface in an augmented reality space.
For example, in connection with the above-described embodiment, referring to fig. 6, the first operation instruction information is dragging the progress bar 1011 from the a position to the B position in the operation interface 101 in the augmented reality space, but the present disclosure is not particularly limited thereto.
Optionally, on the basis of the foregoing embodiments, in some embodiments of the present disclosure, acquiring the first operation instruction information input based on the operation interface includes: and acquiring first operation instruction information input through the augmented reality interaction device, the gesture or the voice.
The first operation instruction information may be input by pressing a key set on the real handle by the user by using one or two real handles connected by the augmented reality interaction device, such as the head-mounted visual device, or may be input by recognizing a gesture of the user by using a camera set on the augmented reality interaction device, such as the head-mounted visual device, which is not limited thereto.
S52, sending first operation instruction information to the sharing device.
Specifically, after acquiring first operation instruction information input to an operation interface, the augmented reality interaction device sends the first operation instruction information to the sharing device.
When the first operation instruction information is input through the peripheral corresponding to the sharing device or is input through the sharing device, the sharing device does not need to send the first operation instruction information to the sharing device, and the sharing device can directly generate the first response information according to the obtained first operation instruction information.
In this way, the interaction method in the extended reality space provided by the embodiment can input the first operation instruction information through the extended reality interaction device, the gesture or the voice, and also can input the first operation instruction information through the peripheral corresponding to the sharing device.
And S13, responding to the first operation instruction information in the augmented reality space based on the first response information.
Specifically, the augmented reality interaction device displays a response generated for the first operation instruction information in the augmented reality space after acquiring the first response information.
For example, in connection with the above-described embodiment, referring to fig. 6, when the first operation instruction information is dragging the progress bar 1011 from the a position to the B position in the operation interface 101 in the augmented reality space, then the first operation instruction information is responded to, that is, the operation interface 103 generated based on the first operation instruction information is displayed in the augmented reality space, but not limited thereto, the present disclosure is not particularly limited.
In the technical scheme provided by the embodiment of the disclosure, an operation interface corresponding to first shared data is displayed in an augmented reality space through the first shared data sent based on the shared equipment; first response information generated by the sharing device based on the first operation instruction information is received, and response is performed on the first operation instruction information in the augmented reality space based on the first response information. In the process, the first shared data sent by the sharing device can be received by the augmented reality interaction device, the corresponding operation interface is displayed in the augmented reality space, the first response information generated by the sharing device aiming at the first operation instruction information can be received, and the response is performed in the augmented reality space, so that the interaction function between the augmented reality interaction device and the sharing device is realized, the data sharing is realized, the user can operate the sharing device in the augmented reality environment, the switching between the augmented reality environment and the sharing device is avoided, and the user experience is improved.
Optionally, when information is sent and received between the augmented reality interaction device and the shared device, encryption processing can be performed on the transmitted information, by this way, the security of the transmitted information can be improved, and the implementation of the encryption processing can refer to the prior art, which is not described in detail herein.
Alternatively, based on the above embodiments, in some embodiments of the present disclosure, as shown in fig. 7, one possible implementation of S11 may be:
and S71, receiving first shared data sent by the sharing equipment, and displaying prompt information in the augmented reality space.
The prompting information is information for prompting the user in the augmented reality space when the pointer receives the first shared data sent by the shared device, and the prompting information can be, but is not limited to, prompting the user in the augmented reality space in a pop-up window mode.
And S72, responding to the triggering of the prompt information, and displaying an operation interface corresponding to the first shared data.
Specifically, when receiving first shared data sent by the sharing device, the augmented reality interaction device displays prompt information for prompting a user in an augmented reality space, and the user triggers the prompt information, so that an operation interface corresponding to the first shared data is displayed in the augmented reality space.
Illustratively, with the above embodiment in mind, as shown in fig. 8, after receiving the first shared data sent by the sharing device 200, the augmented reality interaction device 100 pops up the first interface 104 in the augmented reality space, and displays "the sharing device sends the shared data to you, whether or not to display", where the lower right corner may select rejection or agreement. When the user selects "consent" after seeing the first interface 104, the augmented reality interaction device 100 displays the operation interface 101 corresponding to the first shared data in the augmented reality space generated using the augmented reality interaction device 100 in response to the trigger for the hint information, but is not limited thereto, and the present disclosure is not particularly limited.
In this way, according to the interaction method in the extended real space, when the first shared data sent by the sharing device is received, the prompt information is displayed in the extended real space to prompt the user, so that the user can respond to the first shared data according to own will, and the user experience is improved.
Optionally, on the basis of the foregoing embodiment, the embodiments of the present disclosure are further extended and optimized on the basis of the foregoing embodiment, where the operation interface may be operated according to a user's wish, and may include, but are not limited to, the following two implementation manners:
c: and responding to the zooming operation of the user on the operation interface, and performing zooming processing on the operation interface.
For example, referring to fig. 9, when receiving a zoom operation process of the operation interface 101 by the user, the augmented reality interaction device 100 responds to the zoom operation to zoom the operation interface 101, and displays the zoomed operation interface 105 in the augmented reality space, but the present disclosure is not limited thereto, and those skilled in the art may set according to the actual situation.
And D, adjusting the display position of the operation interface in response to the adjustment operation of the display position of the operation interface by the user.
For example, referring to fig. 10, when the augmented reality interaction device 100 receives an adjustment operation process of the display position of the operation interface 101 by the user, the adjusted operation interface 106 is displayed in the augmented reality space after the adjustment process of the display position of the operation interface 101, but the present disclosure is not limited thereto, and a person skilled in the art may set according to the actual situation.
In this way, the interaction method in the augmented reality space provided by the embodiment can respond and display in real time according to the movement and adjustment operation of the user to the operation interface, so that the requirements of the user in different scenes are met, and the user experience is improved.
Optionally, in some embodiments of the present disclosure, the data processing of the augmented reality interaction device may also be controlled by the sharing device, that is, the sharing device may send an operation instruction for sharing data to the augmented reality interaction device, so that the augmented reality interaction device processes the shared data according to the operation instruction sent by the sharing device, and specifically, on the basis of the foregoing embodiments, the method further includes:
And receiving a second operation instruction aiming at second shared data, which is sent by the sharing equipment. The second shared data is used for displaying in an augmented reality environment; and responding to the second operation instruction, and processing the second shared data.
Specifically, after receiving a second operation instruction for second shared data sent by the sharing device, the augmented reality interaction device responds to the second operation instruction to process the second shared data.
For example, assuming that the sharing device is a smart phone, the augmented reality interaction device is a head display device, the second sharing data is video data, the user a may control the head display device worn by the user B to play the video data through the smart phone, and the user a operates the video data on the smart phone, for example, clicks a play button, sends a play operation instruction to the head display device, and the head display device plays the video data in response to the play operation instruction.
In this way, in the interaction method in the augmented reality space provided by the embodiment of the disclosure, in the above process, the augmented reality interaction device can be controlled by executing the second operation instruction for the second shared data on the sharing device, so that the augmented reality interaction device responds to the second operation instruction to process the second shared data, and the user can control the augmented reality interaction device by using the sharing device, thereby improving user experience.
Fig. 11 is a schematic structural diagram of an interaction device in an augmented reality space provided by the present disclosure, and as shown in fig. 11, the device in this embodiment includes: a display module 11, a receiving module 12 and a response module 13, wherein,
The display module 11 is configured to display an operation interface corresponding to the first shared data in the augmented reality space based on the first shared data sent by the sharing device.
And a receiving module 12, configured to receive first response information generated by the sharing device based on the first operation instruction information.
A response module 13, configured to respond to the first operation instruction information in the augmented reality space based on the first response information.
Optionally, the apparatus further includes: the device comprises an acquisition module and a sending module, wherein the acquisition module is used for acquiring first operation instruction information input based on the operation interface. And the sending module is used for sending the first operation instruction information to the sharing equipment.
Optionally, the acquiring module is specifically configured to acquire first operation instruction information input through the augmented reality interaction device, a gesture or a voice.
Optionally, the display module 11 is specifically configured to receive the first shared data sent by the sharing device, and display a prompt message in the augmented reality space. And responding to the trigger of the prompt information, and displaying an operation interface corresponding to the first shared data.
Optionally, the response module 13 is further configured to perform a scaling process on the operation interface in response to a scaling operation performed on the operation interface by a user. And/or, responding to the adjustment operation of the display position of the operation interface by the user, and adjusting the display position of the operation interface.
Optionally, the apparatus further includes: and the communication connection establishment module is used for establishing communication connection with the sharing equipment.
Optionally, the communication connection establishment module is specifically configured to trigger a display setting panel in the augmented reality space, select the sharing device in the setting panel, and trigger establishment of communication connection with the sharing device.
Optionally, the receiving module 12 is further configured to receive a second operation instruction for second shared data sent by the sharing device, where the second shared data is used for being displayed in an augmented reality environment.
And the response module 13 is further configured to process the second shared data in response to the second operation instruction.
In this way, the display module of the embodiment of the disclosure displays the operation interface corresponding to the first shared data in the augmented reality space based on the first shared data sent by the sharing device. The receiving module receives first response information generated by the sharing device based on the first operation instruction information. A response module responds to the first operation instruction information in the augmented reality space based on the first response information. In the process, the first shared data sent by the sharing device can be received by the augmented reality interaction device, the corresponding operation interface is displayed in the augmented reality space, the first response information generated by the sharing device aiming at the first operation instruction information can be received, and the response is performed in the augmented reality space, so that the interaction function between the augmented reality interaction device and the sharing device is realized, the data sharing is realized, the user can operate the sharing device in the augmented reality environment, the switching between the augmented reality environment and the sharing device is avoided, and the user experience is improved.
The steps corresponding to the apparatus in this embodiment, which may be used to execute the foregoing method embodiments, implement similar principles and technical effects, and are not repeated herein.
The present disclosure also provides an electronic device, including: one or more processors; a memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory; the one or more processors, when executing the one or more computer programs, cause the electronic device to perform the steps of the method embodiments described above.
The present disclosure also provides a computer readable storage medium comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the steps of the method embodiments described above.
The present disclosure also provides a computer program product for causing a computer to perform the steps of the method embodiments as described above when the program contained in the computer program product is run on the computer.
In the above-described embodiments, all or part of the functions may be implemented by software, hardware, or a combination of software and hardware. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present disclosure are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium. Computer readable storage media can be any available media that can be accessed by a computer or data storage devices, such as servers, data centers, etc., that contain an integration of one or more available media. Usable media may be magnetic media (e.g., floppy disks, hard disks, magnetic tape), optical media (e.g., DVD), or semiconductor media (e.g., solid State Disk (SSD)) or the like.
It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing is merely a specific embodiment of the disclosure to enable one skilled in the art to understand or practice the disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown and described herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (12)
1. An interaction method in an augmented reality space, comprising:
Based on first shared data sent by the sharing equipment, displaying an operation interface corresponding to the first shared data in an extended reality space;
receiving first response information generated by the sharing equipment based on first operation instruction information;
Responding to the first operation instruction information in the augmented reality space based on the first response information.
2. The method of claim 1, wherein prior to receiving the first response information generated by the sharing device based on the first operation instruction information, further comprising:
acquiring first operation instruction information input based on the operation interface;
And sending the first operation instruction information to the sharing equipment.
3. The method according to claim 2, wherein the acquiring the first operation instruction information input based on the operation interface includes:
and acquiring first operation instruction information input through the augmented reality interaction device, the gesture or the voice.
4. A method according to any one of claims 1 to 3, wherein displaying, in the augmented reality space, an operation interface corresponding to the first shared data based on the first shared data transmitted by the sharing device, includes:
Receiving first shared data sent by the sharing equipment, and displaying prompt information in the augmented reality space;
and responding to the trigger of the prompt information, and displaying an operation interface corresponding to the first shared data.
5. A method according to any one of claims 1-3, further comprising:
responding to the scaling operation of the user on the operation interface, and scaling the operation interface;
And/or the number of the groups of groups,
And responding to the adjustment operation of the user on the display position of the operation interface, and adjusting the display position of the operation interface.
6. A method according to any one of claims 1 to 3, wherein, based on the first shared data sent by the sharing device, before displaying the operation interface corresponding to the first shared data in the augmented reality space, the method further comprises:
a communication connection is established with the sharing device.
7. The method of claim 6, wherein the establishing a communication connection with the shared device comprises:
And triggering a display setting panel in the augmented reality space, selecting the sharing equipment in the setting panel, and triggering the establishment of communication connection with the sharing equipment.
8. A method according to any one of claims 1-3, further comprising:
Receiving a second operation instruction for second shared data sent by the sharing device, wherein the second shared data is used for being displayed in an augmented reality environment;
And responding to the second operation instruction, and processing the second shared data.
9. An interactive apparatus in an augmented reality space, comprising:
the display module is used for displaying an operation interface corresponding to the first shared data in the augmented reality space based on the first shared data sent by the sharing equipment;
the receiving module is used for receiving first response information generated by the sharing equipment based on the first operation instruction information;
And the response module is used for responding to the first operation instruction information in the augmented reality space based on the first response information.
10. An electronic device, comprising: one or more processors; a memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory; wherein the one or more processors, when executing the one or more computer programs, cause the electronic device to implement the interaction method in the augmented reality space of any one of claims 1-8.
11. A computer readable storage medium comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the interaction method in an augmented reality space according to any one of claims 1-8.
12. A computer program product, characterized in that the program contained in the computer program product, when run on a computer, causes the computer to perform the interaction method in an augmented reality space according to any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211304828.7A CN117971103A (en) | 2022-10-24 | 2022-10-24 | Interaction method, device, electronic equipment and medium in augmented reality space |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211304828.7A CN117971103A (en) | 2022-10-24 | 2022-10-24 | Interaction method, device, electronic equipment and medium in augmented reality space |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117971103A true CN117971103A (en) | 2024-05-03 |
Family
ID=90863272
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211304828.7A Pending CN117971103A (en) | 2022-10-24 | 2022-10-24 | Interaction method, device, electronic equipment and medium in augmented reality space |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117971103A (en) |
-
2022
- 2022-10-24 CN CN202211304828.7A patent/CN117971103A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2023511195A (en) | Message presentation method and electronic device | |
| CN109068161B (en) | Equipment connection establishing method and device | |
| CN112099707A (en) | Display method and device and electronic equipment | |
| CN112134788B (en) | Event processing method, device, storage medium, mobile terminal and computer | |
| CN112911147B (en) | Display control method, display control device and electronic equipment | |
| WO2018184442A1 (en) | Terminal control method and device | |
| WO2023056766A1 (en) | Information display method and apparatus | |
| CN111651110A (en) | Group chat message display method and device, electronic equipment and storage medium | |
| CN112711366A (en) | Image generation method and device and electronic equipment | |
| CN113325980B (en) | Control method, control device, electronic equipment and readable storage medium | |
| CN112835506B (en) | Display device and control method thereof | |
| CN112291758B (en) | File sharing method, file sharing device and electronic equipment | |
| WO2024037419A1 (en) | Display control method and apparatus, electronic device, and readable storage medium | |
| CN113625921A (en) | Method, device, storage medium and electronic equipment for displaying target message | |
| US10613622B2 (en) | Method and device for controlling virtual reality helmets | |
| CN115967854A (en) | Photographing method and device and electronic equipment | |
| WO2022267433A1 (en) | Video resource processing method and apparatus | |
| CN117971103A (en) | Interaction method, device, electronic equipment and medium in augmented reality space | |
| CN105843504B (en) | A kind of window regulation method and electronic equipment | |
| CN105528163B (en) | A kind of control response method and electronic equipment | |
| CN114296587A (en) | Cursor control method and device, electronic equipment and storage medium | |
| CN109976549B (en) | Data processing method, device and machine readable medium | |
| CN113342243B (en) | Input method and input device, computer readable storage medium, and electronic apparatus | |
| CN108989661B (en) | Camera equipment control method, device and system | |
| CN106681630A (en) | Operation method and device of mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |