WO2024060890A1

WO2024060890A1 - Information prompting method and apparatus for virtual terminal device, device, medium, and product

Info

Publication number: WO2024060890A1
Application number: PCT/CN2023/113407
Authority: WO
Inventors: 李江磊
Original assignee: 北京字跳网络技术有限公司
Priority date: 2022-09-21
Filing date: 2023-08-16
Publication date: 2024-03-28
Also published as: CN117785085A

Abstract

An information prompting method and apparatus (600, 700) for a virtual terminal device (1), a device (800), a medium, and a product. The method comprises: in response to a screen mirroring state of the virtual terminal device (1) and an electronic device (2), acquiring a first page position of a target page of the virtual terminal device (1) in a screen mirroring page of the electronic device (2) during screen mirroring (201), wherein the first page position is page position coordinates, detected by the electronic device (2), corresponding to a click operation executed by a first user on the screen mirroring page; according to the first page position, determining a second page position corresponding to a prompt object in the target page (202); and displaying the prompt object at the second page position in the target page (203). The present disclosure solves the problem that an electronic device (2) only has a display function on a screen mirroring page of a virtual terminal device (1), which is not conducive to the operation and use of a user, realizes interactive prompting between the electronic device (2) and the virtual terminal device (1), and realizes a result of effective operation position prompting.

Description

Information prompting methods, devices, equipment, media and products for virtual terminal equipment

Cross-references to related applications

This application is required to be submitted to the State Intellectual Property Office of China on September 21, 2022. The application number is 202211153973. priority, the entire contents of which are incorporated herein by reference.

Technical field

Embodiments of the present disclosure relate to the field of computer technology, and in particular, to an information prompting method, device, electronic device, computer-readable storage medium, computer program product, and computer program for a virtual terminal device.

Background technique

Currently, virtual terminal equipment can project the display screen to electronic devices for display. Electronic devices can include televisions, mobile phones, computers and other devices. Among them, the virtual terminal device can display the target page. Project the target page to the electronic device for display, and the page displayed by the electronic device may be called the screen projection page. However, the user corresponding to the electronic device may not be able to operate the target page of the virtual terminal device, causing the electronic device to only have a display function for the screen projection page of the virtual terminal, which is not conducive to the user's operation.

Contents of the invention

Embodiments of the present disclosure provide an information prompting method, device, electronic device, computer-readable storage medium, computer program product, and computer program for a virtual terminal device to overcome the problem that the page projected onto the electronic device by the virtual terminal device only has a display function. Problems that are not conducive to user operation.

In a first aspect, embodiments of the present disclosure provide an information prompting method for a virtual terminal device, including:

In response to the screen projection status of the virtual terminal device and the electronic device, obtain the target page of the virtual terminal device and project it to the first page position in the screen projection page of the electronic device; the first page position is the electronic device. The device detects the page position coordinates corresponding to the click operation performed by the first user on the screen projection page;

According to the first page position, determine the second page position of the prompt object corresponding to the target page;

The prompt object is displayed at the second page position of the target page.

In a second aspect, an embodiment of the present disclosure provides an information prompting method of a virtual terminal device, comprising:

In response to the screen projection status of the virtual terminal device and the electronic device, display the screen projection page of the target page of the virtual terminal device;

Detect the page position coordinates corresponding to the click operation performed by the first user on the screen projection page, and obtain the first page position;

The first page position is sent to the virtual terminal device, and the first page position indicates that a prompt object is displayed at a second page position in a target page of the virtual terminal device.

In a third aspect, an embodiment of the present disclosure provides an information prompting device for a virtual terminal device, including:

A first response unit configured to, in response to the screen projection status of the virtual terminal device and the electronic device, determine that the target page of the virtual terminal device is projected to the first page position in the screen projection page of the electronic device; A page position is when the electronic device detects the page position coordinates corresponding to the click operation performed by the first user on the screen projection page;

A position determination unit configured to determine the second page position of the prompt object corresponding to the target page based on the first page position;

An object display unit is configured to display the prompt object at the second page position of the target page.

In a fourth aspect, embodiments of the present disclosure provide an information prompting device for a virtual terminal device, including:

The second response unit is configured to respond to the projection status of the virtual terminal device and the electronic device and display the projection page after the target page of the virtual terminal device is projected;

a position detection unit, configured to detect the page position coordinates corresponding to the click operation performed by the first user on the screen projection page, and obtain the first page position;

A position sending unit configured to send the first page position to the virtual terminal device, where the first page position indicates that a prompt object is displayed at a second page position in a target page of the virtual terminal device.

In a fifth aspect, embodiments of the present disclosure provide an electronic device, including: a processor and a memory;

The memory stores computer execution instructions;

The processor executes the computer execution instructions stored in the memory, so that the at least one processor executes the information prompting method of the virtual terminal device described in the first aspect and various possible designs of the first aspect.

In a sixth aspect, embodiments of the present disclosure provide a computer-readable storage medium. Computer-executable instructions are stored in the computer-readable storage medium. When the processor executes the computer-executable instructions, the above first aspect and the first aspect are implemented. There are various possible ways to design the information prompting method of the virtual terminal device.

In a seventh aspect, embodiments of the present disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the information of the virtual terminal device described in the first aspect and various possible designs of the first aspect. Tip method.

In an eighth aspect, embodiments of the present disclosure provide a computer program that, when executed by a processor, implements the information prompting method of a virtual terminal device as described in the first aspect and various possible designs of the first aspect.

In this embodiment, the virtual terminal device may obtain the first page position of the target page of the virtual terminal device and project it to the screen projection page of the electronic device in response to the screen projection status between the virtual terminal device and the electronic device. The first page position may be when the electronic device detects a click operation performed by the first user on the displayed screen projection page and obtains the corresponding page position coordinates. The target page can be mapped through the first page position. According to the first page position, determine the second page position of the prompt object corresponding to the target page. By displaying the prompt object at the second page position of the target page, interactive display of the prompt object from the user operation of the electronic device to the virtual terminal device can be realized. , realize accurate prompts for electronic devices, and improve the prompt efficiency and effectiveness of virtual terminal devices.

Description of drawings

In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, a brief introduction will be made below to the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description These are some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting any creative effort.

Figure 1 is an application network architecture diagram of an information prompting method for a virtual terminal device provided by an embodiment of the present disclosure.

FIG. 2 is a flow chart of an embodiment of an information prompting method for a virtual terminal device provided by an embodiment of the present disclosure.

FIG. 3 is a display example diagram of a virtual finger object provided by an embodiment of the present disclosure.

FIG. 4 is a display example diagram of a handle ray object provided by an embodiment of the present disclosure.

FIG. 5 is another schematic flowchart of an information prompting method for a virtual terminal device provided by an embodiment of the present disclosure.

FIG. 6 is a structural diagram of an information prompting method and apparatus for a virtual terminal device provided by an embodiment of the present disclosure.

FIG. 7 is another structural schematic diagram of an information prompting method device for a virtual terminal device provided by an embodiment of the present disclosure.

FIG8 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments It's this Some, but not all, embodiments are disclosed. Based on the embodiments in this disclosure, all other embodiments obtained by those of ordinary skill in the art without making creative efforts fall within the scope of protection of this disclosure.

The technical solution of the present disclosure can be applied in a screen projection scenario of a virtual terminal device. By using the triggered page position in the electronic device as the position of the target page of the virtual terminal device for object prompting, object prompting can be implemented for the virtual terminal device. Operation prompts to achieve effective prompts for operations and improve the efficiency of operation prompts.

In related technology, the virtual terminal device can display the target page. By establishing a screencasting association between the virtual terminal device and the electronic device, the target page of the virtual terminal device can be displayed on the electronic device. In order to distinguish the display page of the electronic device and the virtual terminal device, the page displayed by the electronic device may be called a screen projection page. The projection page and the target page can be the same page. Currently, the target page of the virtual terminal device is only displayed on the screen of the electronic device, and the prompting efficiency is low. The prompting efficiency is low for users who use the virtual terminal device, and it is inconvenient to use the screen.

In order to solve the above technical problem, the inventor considered prompting the operating location of the virtual terminal device. In the screencasting scenario, if the user of the electronic device can perform a click operation on the displayed screencasting page, the prompt object can be displayed at the same page position in the target page displayed by the virtual terminal device, realizing the transition from the operation of the electronic device to The display interaction of the virtual terminal device allows the user of the virtual terminal device to view the prompt object displayed on the target page, effectively prompt the items or buttons in the target page, and improve the page prompt efficiency.

In an embodiment of the present disclosure, the virtual terminal device may, in response to the screen projection status of the virtual terminal device and the electronic device, obtain the first page position in the screen projection page of the virtual terminal device and project it to the electronic device. The first page position may be when the electronic device detects a click operation performed by the first user on the displayed screen projection page and obtains the corresponding page position coordinates. The target page can be mapped through the first page position. According to the first page position, determine the second page position of the prompt object corresponding to the target page. By displaying the prompt object at the second page position of the target page, interactive display of the prompt object from the user operation of the electronic device to the virtual terminal device can be realized. , realize accurate prompts for electronic devices, and improve the prompt efficiency and effectiveness of virtual terminal devices.

The technical solution of the present invention and how the technical solution of the present invention solves the above-mentioned technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

Figure 1 is an application network architecture diagram of an information prompting method for a virtual terminal device according to the present disclosure. The application network architecture according to the embodiment of the present disclosure may include a virtual terminal device 1 and an electronic device 2 connected to the virtual terminal device through a local area network or a wide area network. It is assumed that the electronic device 2 may be a mobile phone, a tablet computer, or a personal computer. , smart home appliances, wearable devices and other terminal devices. This document does not limit the specific types of electronic devices too much. As shown in Figure 1, the target page displayed in the virtual terminal device 1 can be projected to the electronic device 2 for display. The screen projection page displayed on the electronic device can be triggered. The electronic device can detect whether the user is targeting the screencasting page. Trigger operation executed anywhere in the page to obtain the first page position. After obtaining the first page position, the virtual terminal device can determine its second page position on the target page. The prompt object can be displayed at the second page position of the target page to interactively prompt the first user's trigger point. Referring to FIG. 1 , assuming that the first page position clicked by the first user is, the first page position is at the second page position corresponding to the target page, and the highlight object 3 can be displayed at the second page position. The display of the highlight object can accurately prompt the click operation position of the first user corresponding to the electronic device, realize the prompting of the interactive position, and improve the prompting efficiency and accuracy of the target page.

As shown in Figure 2, it is a flow chart of an embodiment of an information prompting method for a virtual terminal device provided by an embodiment of the present disclosure. The information prompting method may include the following steps 201 to 203.

201: In response to the screen projection status of the virtual terminal device and the electronic device, obtain the target page of the virtual terminal device and project it to the first page position in the screen projection page of the electronic device; the first page position is where the electronic device detects the target of the first user. The page position coordinates corresponding to the click operation on the screencasting page.

For example, virtual terminal equipment may include VR (Virtual Reality, virtual reality) equipment, AR (Augmented Reality, augmented reality equipment), etc., specifically such as VR all-in-one machines, head-mounted VR equipment, etc. In this embodiment, the specific details of the virtual terminal equipment Types are not too restrictive.

Among them, the virtual terminal device and the electronic device can establish a screen projection association, and the target page of the virtual terminal device can be projected onto the screen of the electronic device for display. If it is determined that the target page of the virtual terminal device can be normally projected to the electronic device, it can be determined that the virtual terminal device and the electronic device are in a screen projection state.

Optionally, the display screen of the electronic device may be a touch screen, and the first user may perform a click operation on the touch screen. The electronic device can detect a click operation performed by the first user on the screen projection page displayed on the touch screen, and obtain the screen coordinates of the click operation. Convert the screen coordinates into the coordinate system corresponding to the screen projection page to obtain the first page position. The first page position may be the page position coordinates in the coordinate system of the projected page.

Optionally, the target page may refer to the page currently displayed on the display screen of the virtual terminal device, which may be a two-dimensional or three-dimensional page. The depth information of a two-dimensional target page can be 0. The depth information of the three-dimensional target page can be obtained by reading the page data of the target page. The page data of the target page can be generated when the target page is constructed.

The page displayed on the electronic device can be called a screen projection page. The projection page and the target page can be the same page. Different naming methods can be used to distinguish the pages displayed on different devices in terms of names. This does not mean that the two pages are different pages.

When projecting the target page to the electronic device for display, you can project the two-dimensional plane page corresponding to the target page to the electronic device for display. The coordinate system of the two-dimensional plane page can be the same as the coordinate system of the projected page.

202: Based on the first page position, determine the second page position of the prompt object corresponding to the target page.

The object indicated by the first page position on the projection page can be the same as the object indicated by the second page position on the target page. for the same object.

By determining that the first page position is at the second page position corresponding to the target page, conversion from the page position of the electronic device to the virtual terminal device can be realized, so as to transmit the interactive content between the first user and the electronic device to the virtual terminal device The prompt enables the second user of the virtual terminal device to know the location of the page executed by the first user, thereby achieving accurate prompting of the interactive location.

203: Display the prompt object at the second page position of the target page.

In one embodiment, displaying the prompt object at a second page position of the target page may include displaying the target page and modifying a visual indication of the element displayed at the second position of the target page. For example, when a page element is displayed in the second position of the target page, the visual indication of the page element can be modified, such as by highlighting the page element, so that the user can know the corresponding operation position.

Optionally, displaying the prompt object at the second page position of the target page may include: displaying the target page, and displaying the prompt object at the second position of the target page.

The prompt object may be a page element that prompts the location of the click operation performed by the first user, and may include objects such as cursor indications and special visual elements such as highlights and (handle) rays.

In the embodiment of the present disclosure, the virtual terminal device may obtain the first page position of the target page of the virtual terminal device and project it to the screen projection page of the electronic device in response to the screen projection state between the virtual terminal device and the electronic device. The first page position may be used by the electronic device to detect the page position coordinates corresponding to the click operation performed by the first user on the screen projection page. The first page position may be used to determine the second page position of the prompt object on the target page. The prompt object can be displayed at the second page position of the target page to realize the display of the prompt object from the interaction between the first user and the electronic device. Through the display of the prompt object, the first user's click operation can be performed on the target page of the virtual terminal device. Carry out corresponding prompts to achieve targeted location prompts and improve the efficiency and accuracy of location prompts.

In one possible design, information or signals can be forwarded between the virtual terminal device and the electronic device through a server. For example, the first page position of the electronic device may be forwarded by the server to the virtual terminal device.

In practical applications, in order to improve prompt efficiency, prompt objects include highlight objects.

Display prompt objects at the second page position of the target page, including:

Display the highlight object at the second page position of the target page.

Highlight objects can include images of dots and/or circles with glowing effects. The highlight object can be displayed in the upper window of the window layer where the target page is located. The second page position may be the display position of the highlight object. When drawing the highlight object, the second page position can be transferred as a drawing parameter to the drawing function of the highlight object to realize display of the highlight object at the second page position.

When using a highlight object to prompt the second page position of the target page, you can refer to the highlight object shown in Figure 1.

In the embodiment of the present disclosure, the highlight object can be displayed at the second page position of the target page, and the display of the highlight object can prompt the virtual terminal device for the page position triggered by the first user, thereby improving prompt efficiency and accuracy.

In practical applications, in order to provide a more vivid prompt, the prompt object can include a virtual finger object; the prompt object is displayed at the second page position of the target page, including:

The second page position of the target page is used as the fingertip key point of the virtual finger object, so that the virtual finger object is displayed correspondingly at the fingertip key point.

The virtual finger object may be a hand image drawn by points and lines, and the virtual finger object may include a two-dimensional hand image or a three-dimensional hand image. For two-dimensional or three-dimensional hand images, the second page position can be used as the position of the key point of the fingertip to achieve a more vivid prompt with the finger.

When prompted with a virtual finger object, as shown in FIG. 3 , the virtual finger object 4 may be displayed at the second position of the target page of the virtual terminal device.

In the embodiment of the present disclosure, a more three-dimensional position prompt can be achieved through the prompt of the virtual finger object, and the operating position of the virtual terminal device can be more effectively prompted to improve prompt efficiency.

When directly performing a location prompt, as an example, determining the second page location of the prompt object corresponding to the target page based on the first page location may include:

The first page position is used as the prompt object in the second page position of the target page.

The first page position may be directly used as the second page position of the prompt object on the target page.

Of course, in order to make the page position more accurate, the size difference between the display screen of the virtual terminal device and the display screen of the electronic device can be considered, and the corresponding position conversion relationship of the two display screens can be determined. Through the position conversion relationship, the first page can be The position is converted to the second page position. The position conversion relationship can refer to the length ratio and width ratio of the two display screens. The first abscissa of the first page position and the length ratio can be proportionally calculated to obtain the second abscissa; the first ordinate of the first page position and the width ratio can be proportionally calculated to obtain the second ordinate. The second page position corresponding to the second abscissa and the second ordinate can be determined.

In this embodiment, when a highlight object or a virtual finger object is used as the prompt target for prompting, the first page position can be directly used as the prompt object at the second page position of the target page, and the first user can be directly mapped through the direct mapping of the page position. The page position corresponding to the executed click operation is effectively prompted to improve the efficiency of page position prompting.

As another embodiment, the prompt object includes a handle ray prompt object;

Taking the second page position as the end point of the handle ray, combined with the starting point of the handle ray, determine the handle ray object;

Displays the handle ray object while displaying the target page.

The handle ray object may be a ray established through the handle, and the endpoint of the ray may be the second page position.

Referring to FIG. 4 , the handle ray 5 can be displayed on the display page of the virtual terminal device, and the prompt of the handle ray 5 can prompt the page position triggered by the first user.

In the disclosed embodiment, the handle ray object can be used as the prompt object of the target page to implement ray prompts that simulate user operations. The prompts of the ray objects can be more intuitive, thereby improving prompt efficiency.

The target page displayed by the virtual terminal device can be a three-dimensional graphics page to achieve three-dimensional display. The display screen of electronic equipment can generally display two-dimensional images. Therefore, it is necessary to add depth information when displaying handle rays.

As an embodiment, determining the second page position of the prompt object corresponding to the target page according to the first page position includes:

According to the depth coordinate corresponding to the first page position in the target page;

According to the abscissa and ordinate in the first page position, combined with the depth coordinate, the coordinates are combined to obtain the target coordinate point;

The target coordinate point is determined to be the second page position corresponding to the prompt object on the target page.

Optionally, the depth coordinate corresponding to the first page position of the target page can be determined by determining the first page position in the three-dimensional coordinate system corresponding to the target page. The first page position can be used as a point on the XY axis plane in the three-dimensional coordinate system, and the corresponding value of the point on the Z axis of the three-dimensional coordinate system can be used as the depth coordinate. The abscissa coordinate can be represented by X1, the ordinate coordinate can be represented by Y1, and the depth coordinate can be represented by Z1. Then the target coordinate point can be represented as (X1, Y1, Z1).

In the embodiment of the present disclosure, when obtaining the second page position, the depth coordinate of the first page position in the target page can be obtained, and the abscissa and vertical coordinates of the first page position are combined with the depth coordinate for coordinate combination to obtain the second page Location. The second page position can be used as a prompt object in the second page position of the target page. By obtaining the depth coordinates, an accurate three-dimensional position point can be obtained, which enables determination of the two-dimensional first page position to the three-dimensional second page position and improves the accuracy of the second page position.

In some embodiments, using the second page position as the end point of the handle ray and combining it with the starting point of the handle ray, determining the handle ray object includes:

Determine the second page position as the end point of the handle ray;

According to the handle ray end point and handle ray starting point, determine the handle ray length and handle ray direction;

Generate a handle ray object according to the handle ray length and handle ray direction.

The second page position can be the end point of the handle ray, that is, the end point of the handle ray.

The starting point of the handle ray can be determined based on the position point of the preset virtual handle. The virtual handle can be a handle image set in the virtual terminal device, which can be displayed or not displayed. The position point of the virtual handle can be set at any position on the target page. Of course, the position point of the virtual handle can be continuously updated by the movement operation of the second user.

In the embodiment of the present disclosure, the length of the handle ray and the direction of the handle ray can be determined based on the starting point of the handle ray and the end point of the handle ray, so as to obtain an accurate handle ray.

As shown in Figure 5, it is a flow chart of an embodiment of an information prompting method for a virtual terminal device provided by an embodiment of the present disclosure. The method may include the following steps:

501: In response to the projection status of the virtual terminal device and the electronic device, display the projection page of the target page of the virtual terminal device;

502: Detect the page position coordinates corresponding to the first user's click operation on the screen projection page, and obtain the first page position;

503: Send the first page position to the virtual terminal device, and the first page position indicates that the prompt object is displayed at the second page position in the target page of the virtual terminal device.

The virtual terminal device can project the target page to the electronic device for display. The technical solutions of the present disclosure can be executed by electronic devices. The output device of the electronic device may be a touch screen. The first user can log in to the electronic device using the first user account. The second user can log in to the virtual terminal device using the second user account. The first user account and the second user account may be different. Electronic devices and virtual terminal devices can establish communication connections through the global network.

In the embodiment of the present disclosure, the electronic device may display the projected screen page of the target page of the virtual terminal device when the virtual terminal device is in the screen casting state. The first user can perform a click operation on the screen projection page, and the electronic device can obtain the first page position by detecting the page position coordinates corresponding to the click operation. By obtaining the first page position, the first page position can be displayed as a prompt object at a second page position corresponding to the target page of the virtual terminal device. Realize the location prompt of the virtual terminal device through the interaction of the electronic device, improve the interactive prompt between the electronic device and the virtual terminal device, and improve the prompt efficiency.

As shown in Figure 6, it is a structural schematic diagram of an embodiment of an information prompting device for a virtual terminal device provided by an embodiment of the present disclosure. The information prompting device 600 may include the following units:

First response unit 601: configured to respond to the projection status of the virtual terminal device and the electronic device and determine that the target page of the virtual terminal device is projected to the first page position in the projection page of the electronic device; the first page position is the electronic device. The device detects the page position coordinates corresponding to the click operation performed by the first user on the screen projection page;

Position determining unit 602: used to determine the second page position of the prompt object corresponding to the target page according to the first page position;

Object display unit 603: used to display the prompt object at the second page position of the target page.

As an embodiment, the prompt object includes a highlight object; the object display unit includes:

The first display module is used to display the highlight object at the second page position of the target page.

As another embodiment, the prompt object includes a virtual finger object; the object display unit includes:

The second display module is configured to use the second page position of the target page as the fingertip key point of the virtual finger object, so as to display the virtual finger object correspondingly at the fingertip key point.

In some embodiments, the location determination unit includes:

The first determination module is configured to use the first page position as the prompt object in the second page position of the target page.

As another embodiment, the prompt object includes a handle ray prompt object;

Object display unit, comprising:

The object determination module is used to determine the handle ray object by taking the second page position as the end point of the handle ray and combining it with the starting point of the handle ray;

The third display module is used to display the handle ray object while displaying the target page.

In some embodiments, the location determination unit includes:

Depth acquisition module, used for depth coordinates corresponding to the position of the first page in the target page;

The second determination module is used to perform coordinate combination according to the abscissa and ordinate in the first page position and the depth coordinate. The obtained target coordinate point is the second page position corresponding to the prompt object on the target page.

As an example, the object determination module may include:

An end point determination submodule, used to determine the second page position as the end point of the handle ray;

The ray determination submodule is used to determine the handle ray length and handle ray direction based on the handle ray end point and handle ray starting point;

The object generation submodule is used to generate handle ray objects according to the handle ray length and handle ray direction.

As shown in Figure 7, it is a schematic structural diagram of another embodiment of an information prompting device for a virtual terminal device provided by an embodiment of the present disclosure. The information prompting device may include the following units:

The second response unit 701 is configured to respond to the projection status of the virtual terminal device and the electronic device and display the projection page of the target page of the virtual terminal device after projection;

Position detection unit 702: used to detect the page position coordinates corresponding to the first user's click operation on the screen projection page, and obtain the first page position;

Position sending unit 703: configured to send the first page position to the virtual terminal device, and the first page position indicates that the prompt object is displayed at the second page position in the target page of the virtual terminal device.

The device provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principles and technical effects are similar, and will not be described again in this embodiment.

In order to implement the above embodiments, embodiments of the present disclosure also provide an electronic device.

Referring to FIG. 8 , a schematic structural diagram of an electronic device 800 suitable for implementing an embodiment of the present disclosure is shown. The electronic device 800 may be a terminal device or a server. Terminal devices may include, but are not limited to, mobile phones, Laptops, digital broadcast receivers, personal digital assistants (PDAs), tablets (Portable Android Devices, PADs), portable media players (PMPs), vehicle-mounted terminals (such as car navigation mobile terminals), etc., as well as fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG. 8 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

As shown in Figure 8, the electronic device 800 may include a processing device (such as a central processing unit, a graphics processor, etc.) 801, which may process data according to a program stored in a read-only memory (Read Only Memory, ROM for short) 802 or from a storage device. 808 loads the program in Random Access Memory (RAM) 803 to perform various appropriate actions and processing. In the RAM 803, various programs and data required for the operation of the electronic device 800 are also stored. The processing device 801, ROM 802 and RAM 803 are connected to each other via a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.

Generally, the following devices can be connected to the I/O interface 805: input devices 806 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a Liquid Crystal Display (LCD). ), an output device 807 such as a speaker, a vibrator, etc.; a storage device 808 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 809. The communication device 809 may allow the electronic device 800 to communicate wirelessly or wiredly with other devices to exchange data. Although FIG. 8 illustrates an electronic device 800 having various means, it should be understood that implementation or availability of all illustrated means is not required. More or fewer means may alternatively be implemented or provided.

In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such embodiments, the computer program may be downloaded and installed from the network via communication device 809, or from storage device 808, or from ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmable read-only memory (Erasable Programmable Read Only Memory, EPROM or flash memory), optical fiber, portable compact disk read-only memory (Compact Disc Read Only Memory, CD-ROM), optical storage device, magnetic storage device, or any of the above The right combination. In this disclosure, a computer-readable storage medium may be any computer-readable storage medium containing or a tangible medium storing a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program code contained on a computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the above.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device.

The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device performs the method shown in the above embodiment.

Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved. It will also be noted that each block of the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or operations. , or can be implemented using a combination of specialized hardware and computer instructions.

The units involved in the embodiments of the present disclosure can be implemented in software or hardware. Among them, the name of a unit does not constitute a limitation on the unit itself under certain circumstances. For example, the first The acquisition unit may also be described as "a unit that acquires at least two Internet Protocol addresses."

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field-Programmable Gate Array (FPGA), Application Specific Integrated Circuit (Application Specific Integrated Circuit, ASIC), Application Specification Standard Product (Application Specification) Specific Standard Part (ASSP), System On Chip (SOC), Complex Programmable Logic Device (CPLD), etc.

In the context of this disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media may include an electrical connection based on one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

In a first aspect, according to one or more embodiments of the present disclosure, an information prompting method for a virtual terminal device is provided, including:

In response to the screen casting status of the virtual terminal device and the electronic device, obtain the target page of the virtual terminal device and cast it to the first page position in the screen casting page of the electronic device; the first page position is where the electronic device detects the first user's target for screen casting The page position coordinates corresponding to the click operation on the page;

According to the first page position, determine the prompt object's second page position corresponding to the target page;

Display the prompt object at the second page position of the target page.

According to one or more embodiments of the present disclosure, the prompt object includes a highlight object;

Display the highlight object at the second page position of the target page.

According to one or more embodiments of the present disclosure, the prompt object includes a virtual finger object; displaying the prompt object at the second page position of the target page includes:

According to one or more embodiments of the present disclosure, determining the second page position of the prompt object corresponding to the target page according to the first page position includes:

According to one or more embodiments of the present disclosure, the prompt object includes a handle ray prompt object;

Displays the handle ray object while displaying the target page.

The target coordinate point is determined to be the second page position of the prompt object corresponding to the target page.

According to one or more embodiments of the present disclosure, using the second page position as the end point of the handle ray, combined with the starting point of the handle ray, determining the handle ray object includes:

Determine the second page position as the end point of the handle ray;

In a second aspect, according to one or more embodiments of the present disclosure, an information prompting method for a virtual terminal device is provided, including:

Detecting the page position coordinates corresponding to a click operation performed by the first user on the projection page to obtain the first page position;

The first page position is sent to the virtual terminal device, and the first page position indicates that the prompt object is displayed at a second page position in the target page of the virtual terminal device.

In a third aspect, according to one or more embodiments of the present disclosure, an information prompting device for a virtual terminal device is provided, including:

The first response unit is configured to respond to the projection status of the virtual terminal device and the electronic device and determine that the target page of the virtual terminal device is projected to the first page position in the projection page of the electronic device; the first page position is the electronic device Detect the page position coordinates corresponding to the click operation performed by the first user on the screen projection page;

a position determination unit, configured to determine the second page position of the prompt object corresponding to the target page based on the first page position;

The object display unit is used to display the prompt object at the second page position of the target page.

In a fourth aspect, according to one or more embodiments of the present disclosure, an information prompting method for a virtual terminal device is provided, including:

The second response unit is configured to respond to the projection status of the virtual terminal device and the electronic device and display the projection page of the target page of the virtual terminal device after projection;

A position detection unit, used to detect the page position coordinates corresponding to the click operation performed by the first user on the screen projection page, and obtain the first page position;

The position sending unit is configured to send the first page position to the virtual terminal device, and the first page position indicates that the prompt object is displayed at the second page position in the target page of the virtual terminal device.

In a fifth aspect, according to one or more embodiments of the present disclosure, an electronic device is provided, including: at least one processor and a memory;

Memory stores instructions for execution by the computer;

At least one processor executes the computer execution instructions stored in the memory, so that the at least one processor executes the information prompting method of the virtual terminal device of the first aspect and various possible designs of the first aspect.

In a sixth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided. Computer-executable instructions are stored in the computer-readable storage medium. When the processor executes the computer-executed instructions, the first step above is implemented. Aspects and the first aspect include information prompting methods of various possible designs of virtual terminal devices.

In a seventh aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program. When the computer program is executed by a processor, the computer program implements the above first aspect and the virtualization of various possible designs of the first aspect. Information prompt method for terminal equipment.

In an eighth aspect, according to one or more embodiments of the present disclosure, a computer program is provided, which is executed by a processor to implement the information prompting method of a virtual terminal device of the first aspect and various possible designs of the first aspect. .

The above description is only a description of the preferred embodiments of the present disclosure and the technical principles applied. Those skilled in the art should understand that the disclosure scope involved in the present disclosure is not limited to technical solutions composed of specific combinations of the above technical features, but should also cover solutions composed of the above technical features or without departing from the above disclosed concept. Other technical solutions formed by any combination of equivalent features. For example, a technical solution is formed by replacing the above features with technical features with similar functions disclosed in this disclosure (but not limited to).

Furthermore, although operations are depicted in a specific order, this should not be understood as requiring that the operations be performed in the specific order shown, or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be used separately or in any suitable subcombination. The approach is implemented in multiple embodiments.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

An information prompting method for a virtual terminal device, including:

In response to the screen projection status of the virtual terminal device and the electronic device, obtain the target page of the virtual terminal device and project it to the first page position in the screen projection page of the electronic device; the first page position is the electronic device. The device detects the page position coordinates corresponding to the click operation performed by the first user on the screen projection page;

According to the first page position, determine the second page position of the prompt object corresponding to the target page;

The prompt object is displayed at the second page position of the target page.
The method according to claim 1, wherein the prompt object includes a highlight object;

Displaying the prompt object at the second page position of the target page includes:

The highlight object is displayed at a second page position of the target page.
The method according to claim 1, wherein the prompt object includes a virtual finger object; and displaying the prompt object at a second page position of the target page includes:

The second page position of the target page is used as the fingertip key point of the virtual finger object, so that the virtual finger object is displayed correspondingly at the fingertip key point.
The method according to claim 2 or 3, wherein determining, based on the first page position, the second page position of the prompt object corresponding to the target page comprises:

The first page position is used as a prompt object at the second page position of the target page.
The method according to claim 1, wherein the prompt object includes a handle ray prompt object;

Displaying the prompt object at the second page position of the target page includes:

Taking the second page position as the end point of the handle ray, combined with the starting point of the handle ray, determine the handle ray object;

The handle ray object is displayed while the target page is displayed.
The method according to claim 5, wherein determining the second page position of the prompt object corresponding to the target page according to the first page position comprises:

According to the depth coordinate corresponding to the first page position in the target page;

According to the abscissa coordinate and ordinate coordinate in the first page position, combined with the depth coordinate, coordinate combination is performed to obtain the target coordinate point;

The target coordinate point is determined to be the second page position of the prompt object corresponding to the target page.
The method according to claim 5, wherein determining the handle ray object by taking the second page position as the end point of the handle ray and combining it with the starting point of the handle ray includes:

Determine the second page position as the end point of the handle ray;

Determine the length of the handle ray and the direction of the handle ray according to the end point of the handle ray and the starting point of the handle ray;

The handle ray object is generated according to the handle ray length and the handle ray direction.
The method according to claim 1, wherein displaying the prompt object at a second page position of the target page includes:

Displays the target page and modifies the visual indication of the element displayed at a second position on the target page.
An information prompting method for a virtual terminal device, comprising:

In response to the screen projection status of the virtual terminal device and the electronic device, display the screen projection page of the target page of the virtual terminal device;

Detect the page position coordinates corresponding to the click operation performed by the first user on the screen projection page, and obtain the first page position;

The first page position is sent to the virtual terminal device, and the first page position indicates that a prompt object is displayed at a second page position in a target page of the virtual terminal device.
An information prompting device for virtual terminal equipment, including:

A first response unit configured to, in response to the screen projection status of the virtual terminal device and the electronic device, determine that the target page of the virtual terminal device is projected to the first page position in the screen projection page of the electronic device; A page position is when the electronic device detects the page position coordinates corresponding to the click operation performed by the first user on the screen projection page;

A position determination unit configured to determine the second page position of the prompt object corresponding to the target page based on the first page position;

An object display unit is configured to display the prompt object at the second page position of the target page.
An information prompting device for virtual terminal equipment, including:

The second response unit is configured to respond to the projection status of the virtual terminal device and the electronic device and display the projection page after the target page of the virtual terminal device is projected;

a position detection unit, configured to detect the page position coordinates corresponding to the click operation performed by the first user on the screen projection page, and obtain the first page position;

A position sending unit configured to send the first page position to the virtual terminal device, where the first page position indicates that a prompt object is displayed at a second page position in a target page of the virtual terminal device.
An electronic device, including: processor, memory;

The memory stores computer-executable instructions;

The processor executes the computer execution instructions stored in the memory, so that the processor executes the information prompting method of the virtual terminal device according to any one of claims 1 to 9.
A computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when a processor executes the computer-executable instructions, the information prompt method of a virtual terminal device according to any one of claims 1 to 9 is implemented.
A computer program product includes a computer program, wherein the computer program is executed by a processor to implement the information prompting method of a virtual terminal device according to any one of claims 1 to 9.
A computer program, which is executed by a processor to implement the information prompting method of a virtual terminal device according to any one of claims 1 to 9.