CN115268739A - Control method, device, electronic device and storage medium - Google Patents

Abstract

The present disclosure provides control methods, apparatuses, electronic devices, and storage media. The control method includes: receiving screen image data of a terminal device, and displaying a corresponding target image in a virtual reality scene of an extended reality device; acquiring user operation information for the target image, and determining control according to the user operation information information; sending the control information to the terminal device, so that the terminal device executes the corresponding event according to the control information. The method of the present disclosure can control the terminal device through the extended reality device, so as to realize the integrated operation of the extended reality device and the terminal device.

Description

Control method, device, electronic device and storage medium

technical field

The present disclosure relates to the technical field of smart terminals, and in particular, to a control method, device, electronic equipment, and storage medium.

Background technique

Extended Reality (XR for short) technology can combine reality and virtuality through computers to provide users with a virtual reality space that can interact with humans and computers. In the process of using the extended reality device, if the user encounters an incoming call from the mobile phone or receives a verification code, he needs to take off the extended reality device to operate the mobile phone, which causes great inconvenience.

Contents of the invention

This Summary is provided to introduce a simplified form of concepts that are described in detail later in the Detailed Description. This summary of the invention is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to be used to limit the scope of the claimed technical solution.

The present disclosure provides a manufacturing method, device, electronic equipment and storage medium.

The present disclosure adopts the following technical solutions.

In some embodiments, the present disclosure provides a control method, comprising:

Receive the screen image data of the terminal device, and display the corresponding target image in the virtual reality scene of the extended reality device;

acquiring user operation information for the target image, and determining control information according to the user operation information;

Send the control information to the terminal device, so that the terminal device executes a corresponding event according to the control information.

In some embodiments, the present disclosure provides a control device based on an extended reality device, including:

The first processing module is used to receive the screen image data of the terminal device, and display the corresponding target image in the virtual reality scene of the extended reality device;

A second processing module, configured to acquire user operation information for the target image, and determine control information according to the user operation information;

A third processing module, configured to send the control information to the terminal device, so that the terminal device executes a corresponding event according to the control information.

In some embodiments, the present disclosure provides an electronic device comprising: at least one memory and at least one processor;

Wherein, the memory is used to store program codes, and the processor is used to call the program codes stored in the memory to execute the above method.

In some embodiments, the present disclosure provides a computer-readable storage medium, the computer-readable storage medium is used for storing program code, and when the program code is executed by a processor, the processor is prompted to execute the above-mentioned method.

The control method provided by the embodiments of the present disclosure can receive the screen image data of the terminal device, and display the corresponding target image in the virtual reality scene of the extended reality device; acquire user operation information for the target image, and The information determines the control information; the control information is sent to the terminal device, so that the terminal device executes the corresponding event according to the control information, so that the terminal device can be controlled by the extended reality device, and the connection between the extended reality device and the terminal device can be realized. All-in-one operation.

Description of drawings

The above and other features, advantages and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic and elements and elements have not necessarily been drawn to scale.

FIG. 1 is a flowchart of a control method of an embodiment of the present disclosure.

FIG. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein; A more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for exemplary purposes only, and are not intended to limit the protection scope of the present disclosure.

It should be understood that various steps described in the method implementation manners of the present disclosure may be executed in sequence and/or in parallel. Additionally, method embodiments may include additional steps and/or omit performing illustrated steps. The scope of the present disclosure is not limited in this regard.

As used herein, the term "comprise" and its variations are open-ended, ie "including but not limited to". The term "based on" is "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one further embodiment"; the term "some embodiments" means "at least some embodiments." Relevant definitions of other terms will be given in the description below. The term "responsive to" and related terms means that one signal or event is affected to some extent, but not necessarily completely or directly, by another signal or event. If event x occurs "in response to" event y, then x may respond to y directly or indirectly. For example, the occurrence of y may eventually lead to the occurrence of x, but there may be other intermediate events and/or conditions. In other cases, y may not necessarily result in the occurrence of x, and x may occur even if y has not occurred. Furthermore, the term "responsive to" can also mean "responsive at least in part to".

The term "determining" broadly covers a wide variety of actions, which may include obtaining, calculating, computing, processing, deriving, investigating, looking up (e.g., looking up in a table, database, or other data structure), ascertaining, and the like, Also includes receiving (eg, receiving information), accessing (eg, accessing data in memory) and the like, as well as parsing, selecting, selecting, establishing, and the like, and the like. Relevant definitions of other terms will be given in the description below. Relevant definitions of other terms will be given in the description below.

It should be noted that concepts such as "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the sequence of functions performed by these devices, modules or units or interdependence.

It should be noted that the modification of "a" mentioned in the present disclosure is illustrative rather than restrictive, and those skilled in the art should understand that it should be understood as "one or more" unless the context clearly indicates otherwise.

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are used for illustrative purposes only, and are not used to limit the scope of these messages or information.

The solutions provided by the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

As shown in FIG. 1 , FIG. 1 is a flowchart of a control method in an embodiment of the present disclosure, including the following steps.

Step S01: receiving the screen image data of the terminal device, and displaying the corresponding target image in the virtual reality scene of the extended reality device;

In some embodiments, when the terminal device is woken up, the screen image data of the terminal device is received, and the corresponding target image is displayed in the virtual reality scene of the extended display device. Among them, the conditions for waking up the terminal device can be divided into natural wake-up and artificial wake-up; natural wake-up can be understood as the terminal device receiving an application notification, and artificial wake-up can be understood as the user currently using the extended reality device wakes up the terminal device through preset conditions. The assumption condition may be the operation information generated by the user for the extended reality device, and the operation information includes the operation generated for the operation part of the extended reality device and the voice command generated for the extended reality device.

Step S02: Obtain user operation information for the target image, and determine control information according to the user operation information;

In some embodiments, the operation information of the target image in the virtual reality scene provided by the user for the extended reality device is acquired, wherein the operation information includes clicks, touches and slides triggered by the user on the handheld part of the extended reality device. The operation information can also be the user's voice control command, which is collected through the sound receiving device of the extended reality device.

In some embodiments, determining the control information according to the user operation information includes: determining the control information for the user to control the terminal device according to the corresponding relationship between the user operation information and the object selection of the target image. The operation outputs computer-like terminal control information.

Step S03: Send the control information to the terminal device, so that the terminal device executes a corresponding event according to the control information.

In some embodiments, the event control module may receive the control information output by the controller, convert the control information into an application program event control instruction of the corresponding terminal device, and then transmit the application program event control instruction to the terminal device, so that the terminal The device executes corresponding application program control events according to the application program event control instructions.

The control method provided by the embodiments of the present disclosure can receive the screen image data of the terminal device, and display the corresponding target image in the virtual reality scene of the extended reality device; acquire user operation information for the target image, and The information determines the control information; sending the control information to the terminal device, so that the terminal device executes the corresponding event according to the control information, so that the extended reality device and the terminal device can be completely integrated, so that the user can In most scenarios where the extended reality device is used, there is no need to check the mobile phone, and any application program of the terminal device can be used through the extended reality device.

In some embodiments, the displaying the corresponding target image in the virtual reality scene of the extended reality device includes:

The target image is displayed in a preset area in the virtual reality scene of the extended reality device.

In some embodiments, the target image can be displayed at any location in the virtual scene of the extended reality device, and the position, size and transparency of the target image can all be set by the user operating the extended reality device.

In some embodiments, the receiving the screen image data of the terminal device and displaying the corresponding target image in the virtual reality scene of the extended reality device includes:

Receive the communication information of the terminal device, and display the corresponding communication information image in the virtual reality scene of the extended reality device; or,

The incoming call notification of the terminal device is received, and the corresponding incoming call notification image is displayed in the virtual reality scene of the extended reality device.

In some embodiments, receiving the screen image data of the terminal device includes receiving communication information of the terminal device, such as mobile phone text messages, mobile phone application message notifications, and displaying corresponding communication information images in the virtual reality scene of the extended reality device, such as mobile phone The text message window is displayed in the virtual reality scene of the extended reality device, or the message notification window of the mobile phone application is displayed in the virtual reality scene of the extended reality device.

In some embodiments, receiving the screen image data of the terminal device also includes receiving an incoming call notification of the terminal device, such as voice call, video call, conference video, etc., and displaying the corresponding incoming call notification image in the virtual reality scene of the extended reality device, for example The mobile phone incoming call window is displayed in the virtual scene of the extended reality device.

In some embodiments, the displaying the corresponding target image in the virtual reality scene of the extended reality device further includes:

In response to the user's first trigger operation, the target image is displayed synchronously on the terminal device and the extended reality device.

In some embodiments, when the corresponding target image is displayed in the virtual reality scene of the extended reality device, the screen of the terminal device may be set to display the target image synchronously.

In some embodiments, the displaying the corresponding target image in the virtual reality scene of the extended reality device further includes:

In response to the second trigger operation by the user, the target image display of the terminal device is turned off, and the corresponding target image is displayed in the virtual reality scene of the extended reality device.

In some embodiments, when the corresponding target image is displayed in the virtual reality scene of the extended reality device, the screen of the terminal device may be set to display the target image asynchronously. For example, in order to protect the privacy of the user, the target image is only displayed in the virtual reality scene of the extended reality device, but not displayed on the terminal device, and the terminal device may be in a locked screen state.

In some embodiments, also include:

After the terminal device executes a corresponding event according to the control information, the screen image data of the terminal device is received again and displayed by the extended reality device.

In some embodiments, after the terminal device executes the corresponding event according to the control information, the extended reality device receives the current screen image data of the terminal device again, and displays it in the virtual reality scene of the extended reality device, so as to realize feedback.

In some embodiments, the terminal device and the extended reality device transmit data through a user input reverse channel protocol.

In some embodiments, a user input back channel protocol UIBC (User Input Back Channel) is used to establish a control channel between the terminal device and the extended reality device, so that the user can control the mobile phone through the UIBC protocol. Among them, UIBC is a function that sends input commands from the receiver to the transmitter for processing. Thus, the user can interact naturally with the peripheral from the receiver. For example, an XR device connected to a receiver can be used as a command output, and an end device connected to a transmitter can be used as a command input.

In some embodiments, the extended reality device includes a wearable display component and an operating component;

The operation component includes a detection component, and the operation information of the user of the extended reality device is obtained through the detection component.

In some embodiments, basic communication is established between the terminal device and the extended reality device through bluetooth or wireless, wherein the extended reality device serves as the control terminal of the terminal device.

In some embodiments, the terminal device can also directly use the screen projection technology to mirror the screen to the extended reality device, so that the screen interface of the terminal device can be directly seen through the screen projection software in the virtual reality scene provided by the extended reality device . Among them, the screen projection technology establishes a communication connection (for example, a wireless network connection) between the screen projection sender and the screen projection receiver, and transmits data between the screen projection sender and the screen projection receiver according to the transmission protocol. For example, in a video projection scenario, video data can be transmitted between the projection sender and the projection receiver, so that the video can be played on the projection receiver on a larger display interface, improving user viewing experience.

An embodiment of the present disclosure also provides a control device based on an extended reality device, including

The first processing module is used to receive the screen image data of the terminal device, and display the corresponding target image in the virtual reality scene of the extended reality device;

A second processing module, configured to acquire user operation information for the target image, and determine control information according to the user operation information;

A third processing module, configured to send the control information to the terminal device, so that the terminal device executes a corresponding event according to the control information.

In some embodiments, the first processing module is specifically used for:

The target image is displayed in a preset area in the virtual reality scene of the extended reality device.

In some embodiments, the first processing module is further specifically configured to:

Receive the communication information of the terminal device, and display the corresponding communication information image in the virtual reality scene of the extended reality device; or,

The incoming call notification of the terminal device is received, and the corresponding incoming call notification image is displayed in the virtual reality scene of the extended reality device.

In some embodiments, the first processing module is further specifically configured to:

In response to the user's first trigger operation, the target image is displayed synchronously on the terminal device and the extended reality device.

In some embodiments, the first processing module is further specifically configured to:

In response to the second trigger operation by the user, the target image display of the terminal device is turned off, and the corresponding target image is displayed in the virtual reality scene of the extended reality device.

In some embodiments, it also includes: a fourth processing module, the fourth processing module is used for:

After the terminal device executes a corresponding event according to the control information, the screen image data of the terminal device is received again and displayed by the extended reality device.

In some embodiments, the terminal device and the extended reality device transmit data through a user input reverse channel protocol.

In some embodiments, the extended reality device includes a wearable display component and an operating component;

The operation component includes a detection component, and the operation information of the user of the extended reality device is obtained through the detection component.

As for the embodiment of the device, since it basically corresponds to the embodiment of the method, for relevant parts, please refer to part of the description of the embodiment of the method. The device embodiments described above are merely illustrative, wherein the modules described as separate modules may or may not be separate. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. It can be understood and implemented by those skilled in the art without creative effort.

The method and device of the present disclosure have been described above based on the embodiments and application examples. In addition, the present disclosure also provides an electronic device and a computer-readable storage medium, which will be described below.

Referring now to FIG. 2 , it shows a schematic structural diagram of an electronic device (such as a terminal device or a server) 800 suitable for implementing an embodiment of the present disclosure. The terminal equipment in the embodiment of the present disclosure may include but not limited to such as mobile phone, notebook computer, digital broadcast receiver, PDA (personal digital assistant), PAD (tablet computer), PMP (portable multimedia player), vehicle terminal (such as mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers and the like. The electronic device shown in the figure is just an example, and should not limit the functions and application scope of the embodiments of the present disclosure.

The electronic device 800 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 801, which may be loaded into a random access memory (RAM) 803 according to a program stored in a read-only memory (ROM) 802 or loaded from a storage device 808 Various appropriate actions and processing are performed by the program. In the RAM 803, various programs and data necessary for the operation of the electronic device 800 are also stored. The processing device 801 , ROM 802 , and RAM 803 are connected to each other through a bus 804 . An input/output (I/O) interface 805 is also connected to the bus 804 .

Typically, the following devices can be connected to the I/O interface 805: input devices 806 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speaker, vibration an output device 807 such as a computer; a storage device 808 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 809. The communication means 809 may allow the electronic device 800 to communicate with other devices wirelessly or by wire to exchange data. While the electronic device 800 is shown with various means, it is to be understood that implementing or having all the means shown is not a requirement. More or fewer means may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, where the computer program includes program codes for executing the methods shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via communication means 809 , or from storage means 808 , or from ROM 802 . When the computer program is executed by the processing device 801, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are performed.

It should be noted that the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. A computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device . Program code embodied on a computer readable medium may be transmitted by any appropriate medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

In some embodiments, the client and the server can communicate using any currently known or future-developed network protocols such as HTTP (HyperText Transfer Protocol, Hypertext Transfer Protocol), and can communicate with digital data in any form or medium (eg, communication network) interconnections. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), internetworks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device, or may exist independently without being incorporated into the electronic device.

The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device is made to execute the above-mentioned method of the present disclosure.

Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages, or combinations thereof, including object-oriented programming languages—such as Java, Smalltalk, C++, and conventional Procedural Programming Language - such as "C" or a similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (such as through an Internet Service Provider). Internet connection).

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.

The units involved in the embodiments described in the present disclosure may be implemented by software or by hardware. Wherein, the name of a unit does not constitute a limitation of the unit itself under certain circumstances.

The functions described herein above may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), System on Chips (SOCs), Complex Programmable Logical device (CPLD) and so on.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, a control method is provided, including:

Receive the screen image data of the terminal device, and display the corresponding target image in the virtual reality scene of the extended reality device;

acquiring user operation information for the target image, and determining control information according to the user operation information;

Send the control information to the terminal device, so that the terminal device executes a corresponding event according to the control information.

According to one or more embodiments of the present disclosure, a method for displaying a corresponding target image in a virtual reality scene of an extended reality device includes:

The target image is displayed in a preset area in the virtual reality scene of the extended reality device.

According to one or more embodiments of the present disclosure, a method for receiving screen image data of a terminal device and displaying a corresponding target image in a virtual reality scene of an extended reality device includes:

Receive the communication information of the terminal device, and display the corresponding communication information image in the virtual reality scene of the extended reality device; or,

The incoming call notification of the terminal device is received, and the corresponding incoming call notification image is displayed in the virtual reality scene of the extended reality device.

According to one or more embodiments of the present disclosure, a method for displaying a corresponding target image in a virtual reality scene of an extended reality device further includes:

In response to the user's first trigger operation, the target image is displayed synchronously on the terminal device and the extended reality device.

According to one or more embodiments of the present disclosure, a method for displaying a corresponding target image in a virtual reality scene of an extended reality device further includes:

In response to the second trigger operation by the user, the target image display of the terminal device is turned off, and the corresponding target image is displayed in the virtual reality scene of the extended reality device.

According to one or more embodiments of the present disclosure, there is provided a method, further comprising:

After the terminal device executes a corresponding event according to the control information, the screen image data of the terminal device is received again and displayed by the extended reality device.

According to one or more embodiments of the present disclosure, a method is provided, wherein the terminal device and the extended reality device transmit data through a user input reverse channel protocol.

According to one or more embodiments of the present disclosure, a method is provided, the extended reality device includes a wearable display component and an operation component;

The operation component includes a detection component, and the operation information of the user of the extended reality device is obtained through the detection component.

According to one or more embodiments of the present disclosure, a control device based on an extended reality device is provided, including:

The first processing module is used to receive the screen image data of the terminal device, and display the corresponding target image in the virtual reality scene of the extended reality device;

A second processing module, configured to acquire user operation information for the target image, and determine control information according to the user operation information;

A third processing module, configured to send the control information to the terminal device, so that the terminal device executes a corresponding event according to the control information.

According to one or more embodiments of the present disclosure, there is provided an electronic device, including: at least one memory and at least one processor;

Wherein, the at least one memory is used for storing program codes, and the at least one processor is used for invoking the program codes stored in the at least one memory to execute any one of the methods described above.

According to one or more embodiments of the present disclosure, there is provided a computer-readable storage medium, the computer-readable storage medium is used for storing program code, and when the program code is executed by a processor, the processor Execute the method above.

The above description is only a preferred embodiment of the present disclosure and an illustration of the applied technical principle. Those skilled in the art should understand that the disclosure scope involved in this disclosure is not limited to the technical solution formed by the specific combination of the above-mentioned technical features, but also covers the technical solutions formed by the above-mentioned technical features or Other technical solutions formed by any combination of equivalent features. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

In addition, while operations are depicted in a particular order, this should not be understood as requiring that the operations be performed in the particular order shown or performed in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while the above discussion contains several specific implementation details, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims (11)

1. A control method, characterized in that, comprising: Receive the screen image data of the terminal device, and display the corresponding target image in the virtual reality scene of the extended reality device; acquiring user operation information for the target image, and determining control information according to the user operation information; Send the control information to the terminal device, so that the terminal device executes a corresponding event according to the control information. 2. The method according to claim 1, wherein the displaying the corresponding target image in the virtual reality scene of the extended reality device comprises: The target image is displayed in a preset area in the virtual reality scene of the extended reality device. 3. The method according to claim 1, wherein the receiving the screen image data of the terminal device and displaying the corresponding target image in the virtual reality scene of the extended reality device comprises: Receive the communication information of the terminal device, and display the corresponding communication information image in the virtual reality scene of the extended reality device; or, The incoming call notification of the terminal device is received, and the corresponding incoming call notification image is displayed in the virtual reality scene of the extended reality device. 4. The method according to claim 1, wherein the displaying the corresponding target image in the virtual reality scene of the extended reality device further comprises: In response to the user's first trigger operation, the target image is displayed synchronously on the terminal device and the extended reality device. 5. The method according to claim 1, wherein the displaying the corresponding target image in the virtual reality scene of the extended reality device further comprises: In response to the second trigger operation by the user, the target image display of the terminal device is turned off, and the corresponding target image is displayed in the virtual reality scene of the extended reality device. 6. The method according to claim 1, further comprising: After the terminal device executes a corresponding event according to the control information, the screen image data of the terminal device is received again and displayed by the extended reality device. 7. The method according to claim 1, wherein the terminal device and the extended reality device transmit data through a user input reverse channel protocol. 8. The method according to claim 1, wherein the extended reality device comprises a wearable display part and an operating part; The operation component includes a detection component, and the operation information of the user of the extended reality device is obtained through the detection component. 9. A control device based on an extended reality device, comprising: The first processing module is used to receive the screen image data of the terminal device, and display the corresponding target image in the virtual reality scene of the extended reality device; A second processing module, configured to acquire user operation information for the target image, and determine control information according to the user operation information; A third processing module, configured to send the control information to the terminal device, so that the terminal device executes a corresponding event according to the control information. 10. An electronic device comprising: at least one memory and at least one processor; Wherein, the at least one memory is used to store program codes, and the at least one processor is used to invoke the program codes stored in the at least one memory to execute the method according to any one of claims 1 to 8. 11. A computer-readable storage medium, the computer-readable storage medium is used for storing program codes, and when the program codes are run by a computer device, the computer device is prompted to execute the program described in any one of claims 1 to 8. Methods.

Images