RU2816127C2 - Control method applied to screen projection scenario, and corresponding device - Google Patents

Abstract

FIELD: computer engineering.

SUBSTANCE: invention relates to computer technology. Control method applied to a mobile phone includes: sending content of a first screen to a display device, wherein the current navigation function of the mobile telephone is a navigation function different from the three-key navigation function; receiving a first message sent by a display device, generated in accordance with a first operation acting on a virtual navigation key, which is generated by the display device in response to the fact that the current navigation function of the mobile telephone is a navigation function different from the three-key navigation function; performing a navigation function corresponding to the virtual navigation key in accordance with the first message, and adjusting the content of the first screen to the content of the second screen; and sending the content of the second screen to the display device to cause the display device to display the content of the second screen in the projection area of the screen.

EFFECT: fewer errors and broader functionalities when controlling a mobile telephone with a display device other than a mobile telephone.

57 cl, 13 dwg

Description

TECHNICAL FIELD

This application relates to the field of computer technology and, in particular, to a control method applied to a screen projection scenario and a corresponding device.

BACKGROUND OF THE ART

With the advancement of computer technology, different types of devices (such as devices running different operating systems) can perform screen projection to realize screen sharing.

Using the mobile phone and computer screen projection scenario as an example, when the mobile phone is projected onto the computer, the computer can display the collaboration window. The contents of the mobile phone screen can be displayed in the collaboration window, that is, a mirror of the mobile phone is displayed on the computer. The user can control the mobile phone by performing keyboard and mouse operations in the computer collaboration window.

However, a mobile phone usually uses a touch screen as an input device, while a computer uses a keyboard and mouse as input devices. Simulating touch control using a mouse or keyboard has disadvantages, which affects the user's perception of the ability to control a mobile phone using a computer.

SUMMARY OF THE INVENTION

This application provides a control method applied to a screen projection scenario and a corresponding apparatus for implementing functions using keyboard and mouse operations in a screen projection scenario to replace functions that are difficult to simulate and implement using keyboard and mouse operations, thereby improving the operating experience user.

According to a first aspect, this application provides a control method applied to a screen projection scenario. The screen projection scenario may include a mobile phone and a display device. After the mobile phone and the display device establish a connection, the display device receives the contents of the first screen and the navigation target function ID sent by the mobile phone; generates a collaboration window including a screen projection area and a navigation bar (navigation bar) according to the navigation target function ID, and displays the contents of the first screen in the screen projection area; accepts keyboard and mouse operation affecting virtual navigation keys in the navigation bar; and generates a key instruction according to the operation of the keyboard and mouse, and sends the key instruction to the mobile phone to cause the mobile phone to perform a navigation function according to the key instruction, where the mobile phone can adjust the contents of the first screen to the contents of the second screen using the navigation function. The display device receives the second screen content sent by the mobile phone and displays the second screen content in a screen projection area.

The first screen content refers to the content displayed on the mobile phone screen when the mobile phone and the display device establish a connection. Target navigation functions include mobile phone navigation functions except the three-key navigation function. The navigation bar includes three virtual navigation keys, and the three virtual navigation keys respectively correspond to different navigation functions. For example, the three virtual navigation keys are, respectively, a menu key, a desktop key, and a return key, where the menu key is configured to enter the task menu, the desktop key is configured to return to the desktop, and the return key is configured to return to a higher level. It can be understood that the functions shown above are general navigation functions. In an actual application, the functions of the three virtual navigation keys may alternatively be set to other types of navigation functions, which is not limited herein.

In this application, if the mobile phone uses a navigation method other than three-key navigation, the display device sets a navigation bar on the collaboration window, and the user can perform the system navigation function on the mobile phone using the three virtual navigation keys on the navigation bar to provide synchronously updating the content of the mobile phone screen and the content of the collaboration window, thereby reducing the problem that the user is prone to touch by mistake when operating the mobile phone in a different navigation way, and improving the experience when the user uses the display device to control the mobile phone.

In a possible implementation, the current navigation function includes a gesture navigation function and/or an off-screen physical navigation function, and the off-screen physical navigation function is implemented using a physical key.

In another possible implementation, the method further includes: when the collaboration window mode is a maximized window mode and the pointer position is not located in the first target area, hiding the navigation bar, where the first target area is a part in the edge area for the screen projection area and corresponds to the navigation bar ; and when the collaboration window mode is a maximized window mode and the pointer position is located in the first target area, displaying a navigation bar in the first target area.

In another possible implementation, the collaboration window further includes a title bar; when the collaboration window mode is the maximized window mode and the pointer position is not located in the second target area, hiding the title bar, the second target area being a part in the edge region for the screen projection area and corresponding to the title bar; and when the collaboration window mode is a maximized window mode and the pointer position is located in the second target area, displaying a title bar in the second target area.

In another possible implementation, when the collaboration window is a portrait window, the navigation bar is located below or above the screen projection area, and the navigation bar is adjacent to the screen projection area; and when the collaboration window is a landscape window, the navigation bar is located on the right or left side of the screen projection area, and the navigation bar is adjacent to the screen projection area.

In another possible implementation, the method further includes: disabling a keyboard and mouse operation from simulating a navigation function corresponding to a target navigation function identifier in a collaboration window.

According to a second aspect, this application provides a control method applied to a screen projection scenario. The method includes the following steps: sending the contents of the first screen and the identifier of the navigation target function to the display device; receiving a key instruction sent by the display device; performing a navigation function corresponding to a key instruction according to a preset mapping, where the navigation function is used to adjust the contents of the first screen to the contents of the second screen; and sending the content of the second screen to the display device using the mobile phone to cause the display device to display the content of the second screen in the screen projection area of the collaboration window.

The key instruction is generated by the display device according to the operation of the keyboard and mouse. The navigation target function ID is used to identify the current navigation function, except for the three-key navigation function on a mobile phone. In a possible implementation, the current navigation function includes a gesture navigation function and/or an off-screen physical navigation function, and the off-screen physical navigation function is implemented using a physical key.

According to a third aspect, this application provides a display device whose function can implement the control method according to the first aspect or any implementation. The function may be implemented using hardware or may be implemented using hardware executing associated software. The hardware or software includes one or more modules corresponding to the above function.

According to a fourth aspect, this application provides a mobile phone whose function can implement a control method according to the second aspect or any implementation. The function may be implemented using hardware or may be implemented using hardware executing associated software. The hardware or software includes one or more modules corresponding to the above function.

According to a fifth aspect, this application provides a screen projection system. The screen projection system includes a display device in accordance with the third aspect or any implementation thereof and a mobile phone in accordance with the fourth aspect or any implementation thereof.

In accordance with a sixth aspect, this application provides a computer-readable storage medium on which instructions are stored, wherein the instructions, when executed on a computer, cause the computer to perform a method according to the first aspect or the second aspect.

In accordance with a seventh aspect, this application provides a computer program product, wherein the computer program product, when executed on a computer, causes the computer to perform a method according to the first aspect or the second aspect.

BRIEF DESCRIPTION OF THE DRAWINGS

Fig. 1 is a schematic illustration of a screen projection scenario according to this application;

Fig. 2 is a signaling interaction diagram of a control method applied to a screen projection scenario according to this application;

Fig. 3A is a schematic illustration of a collaboration window in accordance with this application;

Fig. 3B is a schematic illustration of a collaboration window that is a folded out portrait window in accordance with this application;

Fig. 3C is a schematic representation of a collaboration window that is an expanded landscape window in accordance with this application;

Fig. 3D is another schematic representation of a collaboration window representing an expanded landscape window in accordance with this application;

Fig. 3E is another schematic illustration of a collaboration window in accordance with this application;

Fig. 3F is another schematic illustration of a collaboration window in accordance with this application;

Fig. 4 is a schematic structural view of a display device according to this application;

Fig. 5 is a schematic structural representation of a mobile phone according to this application;

Fig. 6 is a schematic structural representation of a screen projection system in accordance with this application;

Fig. 7 is another schematic structural view of a display device in accordance with this application; And

Fig. 8 is another schematic structural view of a mobile phone according to this application.

Description of Embodiments

This application relates to a control method applied to a screen projection scenario.

Fig. 1 is a schematic diagram of a screen projection scenario. The screen projection scenario includes a mobile phone 10 and a display device 20. The mobile phone 10 and the display device 20 may be connected to each other via a radio link 30. Alternatively, the mobile phone 10 and the display device 20 may be connected in a wired manner, such as a data cable. After the mobile phone 10 and the display device 20 establish a connection, the display device 20 can generate a collaboration window 40 according to the content displayed on the screen of the mobile phone 10. User operation on the collaboration window 40 can synchronously update the contents of the screen of the mobile phone 10 and contents of the collaboration window 40.

Display device 20 refers to a computing device that performs input operation using a keyboard and/or mouse and has a display, such as a desktop computer or laptop. The mobile phone 10 is also referred to as a cell phone. The system navigation function on a mobile phone is also called the system navigation method. System navigation function includes gesture navigation, off-screen physical navigation, three-key navigation, etc.

Taking the display device 20 being a computer as an example, after projecting the mobile phone 10 onto the computer, if the mobile phone 10 uses gesture navigation, the user is unlikely to be able to accurately imitate the navigation operation of the mobile phone on the computer using the keyboard and mouse operation. For example, the desktop returns when you slide up from the bottom left edge of the mobile phone screen. The task menu opens by sliding up from the bottom left edge of the mobile phone screen and holding it for a certain period of time. The top level returns when swiping right from the far left edge of the mobile phone screen. Therefore, the user can easily trigger the navigation function by mistake when using the keyboard and mouse operation to navigate the computer. For example, when a user is about to enter the task menu, the return to desktop feature erroneously triggers when the mouse pointer slides up from the bottom left edge of the collaboration window.

Alternatively, if mobile phone 10 uses off-screen physical navigation, pressing the physical key once represents a return to the top level, and pressing the physical key twice quickly represents a return to the desktop. Erroneous touch is easily caused by the keyboard and mouse operation on the computer. For example, when the user intends to launch the return to desktop function, the return to top navigation function is launched with three mouse clicks.

As can be seen from the above, if the mobile phone uses gesture navigation or off-screen physical navigation, the user can easily initiate an erroneous touch when simulating the above navigation method using keyboard and mouse operation, so that the mobile phone cannot be precisely controlled to perform system navigation. resulting in a poor user experience.

To solve the problems existing in the above scenario, this application provides three virtual navigation keys on the computer to replace gesture navigation operations. Therefore, performing keyboard and mouse operations with the three virtual navigation keys of the navigation bar can reduce the case of mistakenly clicking on another navigation function and improve accuracy, thereby improving the user's experience when operating a mobile phone using another device.

The above control method in the screen projection scenario is described below. Referring to FIG. 2, an embodiment of the control method presented in this application includes the following steps:

Step 201: The display device receives the contents of the first screen and the navigation target ID sent by the mobile phone.

In this embodiment, the mobile phone may send the navigation target function identifier to the display device. The target navigation function ID is used to identify the current navigation function, with the exception of a three-key navigation function. In particular, the target navigation feature identifier may be a character string or a numeric number used to identify the current navigation feature. In a real application, the navigation target function identifier may alternatively be represented in another way, such as an image, symbol, or text. When the mobile phone sends the navigation target function identifier, the navigation target function identifier may be transmitted in the message.

The current navigation function includes, but is not limited to, a gesture navigation function and/or an off-screen physical navigation function, and an off-screen physical navigation function is implemented using a physical key. Three-key navigation function refers to three-key on-screen navigation function or three-key off-screen navigation function.

Optionally, the display device sends a request instruction to the mobile phone, and the mobile phone obtains the navigation target function ID according to the request instruction, and then sends the navigation target function ID to the display device.

It should be noted that the display device may receive the first screen content and the navigation target ID sent by the mobile phone at the same time or at different times.

Step 202. The display device generates a collaboration window including a screen projection area and a navigation bar according to the navigation target function ID, and displays the contents of the first screen in the screen projection area.

When the display device receives the navigation target function ID sent by the mobile phone, the display device can determine that the current navigation function corresponding to the navigation target function ID is not a three-key navigation function. That is, it indicates that simulating the navigation function currently used on a mobile phone on a computer using keyboard and mouse operation may cause an erroneous touch. If necessary, the mobile phone can send the service states of all navigation functions to the display device, and the display device can also determine the navigation function currently being used on the mobile phone according to the service states of the navigation functions.

The screen projection area is used to display according to the content of the mobile phone screen.

The navigation bar includes three virtual navigation keys. Three virtual navigation keys correspond to different navigation functions. For example, the three virtual navigation keys are, respectively, the menu key, the desktop key, and the return key. The menu key is configured to enter the task menu, the desktop key is configured to return to the desktop, and the return key is configured to return to a higher level. It can be understood that the functions shown above are general navigation functions. In an actual application, the functions of the three virtual navigation keys may alternatively be set to other types of navigation functions, which is not limited herein.

It should be noted that the display device may adjust the screen projection area and the navigation bar in the collaboration window at the same time or at different times. For example, when the display device receives the first screen content sent by the mobile phone, the display device forms a screen projection area in the collaboration window. When the display device receives the identifier of the navigation target, the display device generates a navigation bar in the collaboration window.

Step 203: The display device receives keyboard and mouse operations affecting the virtual navigation keys.

Keyboard and mouse operation refers to an operation input by a keyboard and/or an operation input by a mouse. For example, when the mouse pointer selects a virtual key, the virtual navigation key is clicked. The operation of the keyboard and mouse is not limited to the above example.

Step 204: The display device generates a key instruction in accordance with the operation of the keyboard and mouse.

When a keyboard and mouse operation is performed on a virtual navigation key, the display device may generate a key instruction corresponding to the virtual navigation key. For example, if the virtual navigation key is a menu key, a key instruction corresponding to the menu key is generated. If the virtual navigation key is a desktop key, a key instruction corresponding to the desktop key is generated. If the virtual navigation key is a return key, a key instruction corresponding to the return key is generated.

Step 205: The display device sends a key instruction to the mobile phone.

Step 206: The mobile phone executes a navigation function corresponding to the key instruction according to a predetermined mapping to match the contents of the first screen to the contents of the second screen.

Preset mapping refers to the mapping between key instructions from the display device and the navigation functions of the mobile phone. When the key instruction corresponds to the menu key, the navigation function performed on the mobile phone is to enter the task menu. When the key instruction matches the desktop key, the navigation function performed on the mobile phone should return to the desktop. When the key instruction matches the return key, the navigation function performed on the mobile phone should return to the top level. It can be understood that the functions of virtual navigation keys on a computer and the system navigation functions of a mobile phone are in a one-to-one correspondence.

Step 207: The display device receives the second screen content sent by the mobile phone.

Step 208: The display device displays the contents of the second screen in the screen projection area.

In this embodiment, if the mobile phone uses a navigation function other than the three-key navigation function, the display device sets the navigation bar on the collaboration window, and the user performs the system navigation function of the mobile phone using the three virtual navigation keys on the navigation bar to the content of the mobile phone screen and the content of the collaboration window were updated synchronously, thereby reducing the problem that the user is prone to erroneous touch when operating the mobile phone by other navigation method, and improving the experience when the user uses the display device to control the mobile phone.

Referring to FIG. 3A, the collaboration window 40 of this application may include a screen projection area 301, a navigation bar 302, and a title bar 303. The navigation bar 302 and title bar 303 may be hidden according to actual requirements.

The navigation bar 302 includes three virtual navigation keys, which are respectively a first virtual navigation key 3021, a second virtual navigation key 3022, and a third virtual navigation key 3023. Optionally, a first virtual navigation key 3021, a second virtual navigation key 3022, and a third virtual navigation key key 3023 are respectively a return key, a desktop key and a menu key. The functions of the virtual navigation keys and the sequence of the virtual navigation keys can be customized according to your actual requirements.

The navigation bar 302 may be located outside the screen projection area 301 or may be located within the screen projection area 301 . Optionally, when the collaboration window 40 is a maximized window, the navigation bar 302 is located in the screen projection area 301; and when the collaboration window 40 is not a maximized window, the navigation bar 302 is located outside the screen projection area 301.

The title bar 303 includes a minimized window key, a maximized window key, and a close window key. In addition, the title line 303 may further include a window name, a direction lock key, and the like, but is not limited to this.

The following describes a case where the collaboration window 40 is a maximized window and the navigation bar 302 is located in the screen projection area 301:

In another optional embodiment, when the mode of the collaboration window 40 is a maximized window mode and the pointer position is not located in the first target area, the navigation bar 302 is hidden, the first target area being a portion in the edge area for the screen projection area 301 and corresponding to the panel 302 navigation; and when the mode of the collaboration window 40 is the maximized window mode and the pointer position is located in the first target area, the navigation bar 302 is displayed in the first target area.

Specifically, the first target area may be one or a combination of a top edge area, a bottom edge area, a left edge area, or a right edge area for the screen projection area 301, or may be a part of any edge area above, which is not limited in this application.

Referring to FIG. 3B, in one case, the collaboration window 40 is a maximized window with a portrait orientation, and the first target area is the bottom edge of the screen projection area 301. When the pointer is positioned on the lower edge of the screen projection area 301, the navigation bar 302 is displayed on the lower edge of the screen projection area 301. When the pointer is not at the bottom edge of the screen projection area 301, the navigation bar 302 is hidden. The method for hiding the navigation bar 302 may be, but is not limited to: the navigation bar 302 moves down from the bottom edge of the screen projection area 301 and disappears, or the navigation bar 302 disappears directly.

Referring to FIG. 3C, in another case, the collaboration window 40 is a maximized landscape window and the first target area is the right edge of the screen projection area 301. If the collaboration window 40 is a maximized landscape window, the screen projection area 301 may be a full screen area. When the pointer is positioned on the right edge of the screen projection area 301, the navigation bar 302 is displayed on the right edge of the screen projection area 301. When the pointer is not on the right edge of the screen projection area 301, the navigation bar 302 is hidden. The method for hiding the navigation bar 302 may be, but is not limited to: the navigation bar 302 moves to the right of the right edge of the screen projection area 301 and disappears, or the navigation bar 302 disappears directly.

When the navigation bar 302 is displayed in the first target area in the screen projection area 301, the navigation bar 302 may block some of the displayed contents of the screen projection area 301. The background of the navigation bar 302 can be set to transparent to reduce blocking in the screen projection area 301.

When the mode of the collaboration window 40 is the maximized window mode and the pointer position is not located in the first target area, the contents of the mobile phone screen can be displayed in full screen mode by hiding the navigation bar 302. Thus, a method is provided to display the contents of a mobile phone screen in full screen mode on a computer, thereby improving the user experience when viewing the projected screen. There is also a navigation bar that can be hidden or expanded. When the user intends to navigate the system, the navigation bar can be brought up quickly, thereby providing convenient and quick access.

Referring to FIG. 3D, in another optional embodiment, the above method further includes: when the mode of the collaboration window 40 is a maximized window mode and the pointer position is not located in the second target area, hiding the title bar 303 where the second target area is part of the edge area for the area 301 screen projection and corresponds to title line 303; and when the mode of the collaboration window 40 is the maximized window mode and the pointer position is located in the second target area, displaying the title bar 303 in the second target area.

In this embodiment, the collaboration window 40 further includes a title line 303. In one case, the collaboration window 40 is a maximized window with a portrait orientation. In another case, the collaboration window 40 is a maximized window in a landscape orientation, and the screen projection area 301 in this case is a full screen area. Specifically, the second target area may be one or a combination of a top edge area, a bottom edge area, a left edge area, or a right edge area for the screen projection area 301, or may be a part of any edge area above, which is not limited in this application. It can be understood that the second target area and the first target area are generally defined as two separate areas.

When the mode of the collaboration window 40 is a maximized window mode and the pointer position is not located in the second target area, the contents of the mobile phone screen can be displayed in full screen mode by hiding the title bar 303 . Thus, a method is provided for displaying the contents of a mobile phone screen in full screen mode on a computer, thereby improving the user experience when viewing the projected screen. When the user intends to view the title bar 303 or configure the collaboration window 40, the title bar 303 can be called up quickly, thereby providing convenient and quick access.

The following describes a case where the navigation bar 302 is located outside the screen projection area 301:

Referring to FIG. 3E, in another optional embodiment, when the collaboration window 40 is a portrait window, the navigation bar 302 is located below the screen projection area 301, and the navigation bar 302 is adjacent to the screen projection area 301. These settings cater to the user's habit of using the three-key navigation function in portrait mode, thereby improving the user experience. When the collaboration window 40 is a portrait window, the navigation bar 302 may alternatively be located in a different orientation of the screen projection area 301, such as the above screen projection area 301.

Referring to FIG. 3F, in another optional embodiment, when the collaboration window 40 is a landscape window, the navigation bar 302 is located on the right side of the screen projection area 301, and the navigation bar 302 is adjacent to the screen projection area 301. These settings cater to the user's habit of using the three-key navigation function in landscape mode, thereby improving the user experience. When the collaboration window 40 is a landscape window, the navigation bar 302 may alternatively be located in a different orientation of the screen projection area 301, for example, on the left side of the screen projection area 301.

It should be noted that when the scaling operation is performed on the collaboration window 40, the display device may scale the screen projection area 301 and the navigation bar 302 in the same ratio in accordance with the scaling operation.

In the collaboration window 40 of this application, the display device may run multiple navigation functions at the same time, or may launch only one navigation function and disable other navigation functions.

In an optional embodiment, each navigation function in the collaboration window can be implemented using multiple types of keyboard and mouse operations.

For example, the navigation function of returning to the desktop is implemented through two keyboard and mouse operations. One of the keyboard and mouse operations is to press the desktop key, where the desktop key is a virtual navigation key. Another keyboard and mouse operation is sliding up from the bottom left edge of the collaboration window. The rest can be deduced by analogy, and the keyboard and mouse operations used to implement other navigation functions can be adjusted according to real-life situations.

When the display device runs multiple navigation functions, the user can select keyboard and mouse operations to implement navigation functions according to requirements, thereby providing implementation flexibility.

In another optional embodiment, the above method further includes: disabling a keyboard and mouse operation from simulating a navigation function corresponding to a target navigation function identifier in the collaboration window.

In this embodiment, when the mobile phone uses gesture navigation or off-screen physical navigation, the display device may prohibit the keyboard and mouse from simulating the above navigation function in the collaboration window. The display device only provides three-key navigation functionality, so the collaboration window can avoid erroneous touching caused by using the keyboard and mouse to simulate gesture navigation or off-screen physical navigation.

In another optional embodiment, the above method further includes: the display device sending a navigation function modification instruction to the mobile phone according to the target navigation function ID, and changing the mobile phone the current navigation function to a three-key screen navigation function in accordance with the function modification instruction navigation. In this embodiment, if the mobile phone uses another navigation function, the navigation function of the mobile phone is converted into a three-key on-screen navigation function. During screen projection, the three-key on-screen navigation bar is displayed on the mobile phone and the display device, and the mobile phone can be operated by the three-key on-screen navigation bar on the display device.

It should be noted that in addition to the mobile phone, the above control method can be further applied to other electronic device that uses gesture navigation or off-screen physical navigation.

The control method of this application has been described above, and related apparatus configured to implement the above-mentioned control method of this application will be described below. Referring to FIG. 4, the embodiment of the display equipment provided in this application includes:

a receiving module 401 configured to receive the contents of the first screen and a navigation target function ID sent by the mobile phone, wherein the navigation target function ID is used to identify the current navigation function except for a three-key navigation function on the mobile phone;

a display module 402 configured to generate a collaboration window including a screen projection area and a navigation bar according to a navigation target function identifier, the navigation bar including three virtual navigation keys; and displaying the contents of the first screen in the screen projection area;

an input module 403 configured to receive keyboard and mouse operations affecting the virtual navigation keys;

a processing unit 404, configured to generate a key instruction in accordance with the operation of the keyboard and mouse;

a transmitting module 405 configured to send a key instruction to the mobile phone to cause the mobile phone to perform a navigation function in accordance with the key instruction, wherein the navigation function is used to adjust the contents of the first screen to the contents of the second screen;

wherein the receiving module 401 is further configured to receive the content of the second screen sent by the mobile phone; And

the display module 402 is further configured to display the contents of the second screen in the collaboration window.

In an optional embodiment, the current navigation function includes a gesture navigation function and/or an off-screen physical navigation function, and the off-screen physical navigation function is implemented using a physical key.

In another optional embodiment

The display module 402 is further configured to: when the collaboration window mode is a maximized window mode and the pointer position is not located in the first target area, hide the navigation bar, the first target area being part of an edge area for the screen projection area and corresponding to the navigation bar ; and when the collaboration window mode is a maximized window mode and the pointer position is located in the first target area, display a navigation bar in the first target area.

In another optional embodiment, the collaboration window further includes a title bar; And

The display module 402 is further configured to: when the collaboration window mode is a maximized window mode and the pointer position is not located in the second target area, hide the title bar, wherein the second target area is part of an edge region for the screen projection area and corresponds to the title bar ; and when the collaboration window mode is a maximized window mode and the pointer position is located in the second target area, display a title bar in the second target area.

In another optional embodiment, the processing module 404 is further configured to prohibit keyboard and mouse operations from simulating a navigation function corresponding to the target navigation function identifier in the collaboration window.

Referring to FIG. 5, the mobile phone embodiment presented in this application includes:

a transmitting module 501 configured to send the contents of the first screen and a navigation target function identifier to the display device, wherein the navigation target function identifier is used to identify the current navigation function except for a three-key navigation function on the mobile phone;

a receiving module 502 configured to receive a key instruction sent by the display device, wherein the key instruction is generated by the display device in accordance with the operation of the keyboard and mouse;

a processing unit 503, configured to perform a navigation function corresponding to a key instruction according to a preset mapping, where the navigation function is used to adjust the contents of the first screen to the contents of the second screen; And

wherein the transmitting module 501 is further configured to send the contents of the second screen to the display device to cause the display device to display the contents of the second screen in the screen projection area of the collaboration window.

In an optional embodiment, the current navigation function includes a gesture navigation function and/or an off-screen physical navigation function, and the off-screen physical navigation function is implemented using a physical key.

Referring to FIG. 6, an embodiment of the screen projection system presented in this application includes:

the display device 20 and the mobile phone 10, where the mobile phone 10 and the display device 20 are connected to each other via a radio link 30;

the display device 20 is configured to: receive the contents of the first screen and the state of the navigation target function sent by the mobile phone 10, the navigation target function including the navigation functions of the mobile phone except the three-key navigation function; forming a collaboration window including a screen projection area and a navigation bar when the state of the target navigation function is a running state, and displaying the contents of the first screen in the screen projection area, the navigation bar including three virtual navigation keys; accept keyboard and mouse operation affecting virtual navigation keys; generate a key instruction according to the operation of the keyboard and mouse, and send the key instruction to the mobile phone to cause the mobile phone to perform a navigation function according to the key instruction; receive the contents of the second screen sent by the mobile phone; and display the contents of the second screen in the screen projection area; And

the mobile phone 10 is configured to: send the contents of the first screen and the state of the target navigation function to the display device 20; receive a key instruction sent by the display device when the navigation target function state is a running state; perform a navigation function in accordance with a key instruction, the navigation function being used to adjust the contents of the first screen to the contents of the second screen; and send the contents of the second screen to the display device.

In particular, the radio link may be a wireless link (wireless fidelity, Wi-Fi) or a Bluetooth link. The functions of the display device 20 may be the same as those of the display device in the embodiment shown in FIG. 4, or other optional embodiments. The functions of the mobile phone 10 may be the same as the mobile phone in the embodiment shown in FIG. 5, or other optional embodiments.

Referring to FIG. 7, another embodiment of the display device 20 provided in this application includes:

input equipment 701, display equipment 702, memory 703, processor 704, transceiver 705, and data interface 706, wherein input equipment 701, display equipment 702, memory 703, processor 704, transceiver 705, and data interface 706 may be connected via a bus.

The input hardware 701 may be a keyboard or a mouse.

The display equipment 702 may be a display, a projector, or other display device.

Memory 703 may be volatile memory or non-volatile memory, or may include volatile memory and non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable PROM (EPROM), electrically EPROM (EEPROM), or flash memory. Non-volatile memory can be random access memory (RAM) or used as an external cache. It should be noted that the memory described herein is intended to include, but is not limited to, these and any other suitable types of memory.

The above-mentioned processor 704 may be a general purpose processor, including a central processing unit (CPU), a network processor (NP), and the like; and may also be a digital signal processor (DSP), application specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other programmable logic device. The processor 704 is configured to implement the functions of the display device in the above embodiments by calling the program code in the memory 703.

The transceiver 705 is configured to send and receive data wirelessly. A component configured to implement a receiving function in the transceiver 705 may be considered a receiver, and a component configured to implement a sending function in a transceiver 705 may be considered a sender. That is, the transceiver 705 includes a receiver and a sender. The transceiver 705 may also be referred to as a transceiver machine or a transceiver circuit. A receiver may also sometimes be called a receiving machine or receiving circuit. The sender may also sometimes be called a sending machine or a sending circuit.

The data interface 706 is connected to the mobile phone in a wired manner.

The block diagram presented in this embodiment shows only a simplified structure of the display device 20. In an actual application, the display device 20 may include any number of input devices 701, display devices 702, memories 703, processors 704, transceivers 705, and data interfaces 706 to implement the functions or operations performed by the display device 20 in embodiments of this application, and all devices that this application may implement fall within the scope of protection of this application. Although not shown in the figure, the display device 20 may further include a power supply or the like. The power supply is configured to supply power to various components and may be logically connected to the processor 704 using a power management system, thereby implementing functions such as charging, discharging, and power management using the power management system.

Referring to FIG. 8, another variant of the mobile phone presented in this application includes:

components such as radio frequency (RF) circuit 810, memory 820, input unit 830, display unit 840, Bluetooth module 850, audio circuit 860, WiFi module 870, processor 880, and power supply 890. One skilled in the art can understand that the structure of a mobile phone shown in FIG. 8 is not a limitation for the mobile phone, and the mobile phone may include more or fewer components than shown in the figure, or some components may be combined, or a different deployment of components may be used.

Below is a detailed description of the components of the mobile phone with reference to FIGS. 8:

The RF circuit 810 may be configured to send and receive signals during a sending and receiving process or a calling process. Specifically, the RF circuit receives downlink information from the base station, then delivers the downlink information to processor 880 for processing, and sends the calculated uplink data to the base station. Typically, RF circuit 810 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, and the like. In addition, RF circuit 810 can also communicate with a network and another device via wireless communication. Wireless communications may use any communications standard or protocol, including, but not limited to, Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS) and things like that.

The memory 820 may be configured to store a program and a module. The processor 880 runs the program and module stored in the memory 820 to implement various functional applications and process mobile phone data. The memory 820 may generally include a program storage area and a data storage area. The program storage area may store an operating system, an application program required by at least one function (eg, a sound reproduction function and an image display function), and the like. In the data storage area, data (eg, audio data and address book) created in accordance with the use of a mobile phone and the like can be stored. In addition, memory 820 may include high speed RAM and may further include nonvolatile memory such as at least one magnetic disk storage device, flash memory, or other volatile solid state storage device.

The input unit 830 may be configured to receive information about entered numbers or symbols and generate a keypad input related to user configuration and control of mobile phone functions. In particular, the input unit 830 may include a touch pad 831 and another input device 832. The touch panel 831, which may also be referred to as a touch screen, may register a user's touch operations on or near the touch panel (e.g., user operations on or near the touch panel 831 using any suitable object, such as a finger or a stylus), and activate the corresponding connecting device in accordance with the specified program. Optionally, the touch panel 831 may include two parts: touch detection hardware and a touch controller. The touch detection hardware detects the user's touch position, detects the signal generated by the touch operation, and transmits the signal to the touch controller. The touch controller receives touch information from the touch detection hardware, converts the touch information into touch point coordinates, and transmits the touch point coordinates to processor 880. Additionally, the touch controller may receive an instruction transmitted by processor 880 and execute that instruction. In addition, the touch panel 831 may be implemented using various types, such as a resistive type, a capacitive type, an infrared type, and a surface acoustic wave type. In addition to the touch panel 831, the input unit 830 may further include another input device 832. In particular, the other input device 832 may include, but is not limited to, one or more function keys (such as a volume key or a shift key), a trackball, and a joystick.

The display unit 840 may be configured to display information entered by the user or information provided to the user and various menus of the mobile phone. The display unit 840 may include a display panel 841. Optionally, the display panel 841 may be configured using a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. In addition, the touch panel 831 may cover the display panel 841. Upon detecting a touch operation on or near a touchpad, touchpad 831 transmits the touch operation to processor 880 to determine the type of touch event. The processor 880 then provides the corresponding visual output on the display panel 841 in accordance with the type of touch event. Although in FIG. 8, the touch panel 831 and the display panel 841 are used as two separate parts to implement the input and output functions of the mobile phone, in some embodiments, the touch panel 831 and the display panel 841 may be combined to implement the input and output functions of the mobile phone.

The mobile phone may further include a Bluetooth module 850.

Audio circuit 860, speaker 861, and microphone 862 may provide audio interfaces between a user and a mobile phone. Audio circuit 860 may convert the received audio data into an electrical signal and transmit the electrical signal to a speaker 861. The speaker 861 converts the electrical signal into an audio signal for output. On the other hand, the microphone 862 converts the collected audio signal into an electrical signal. Audio circuit 860 receives the electrical signal and converts the electrical signal into audio data and outputs the audio data to processor 880 for processing. The processor then sends the audio data, for example, to another mobile phone using RF circuitry 810, or outputs the audio data to memory 820 for further processing.

WiFi is a technology for wireless data transmission over short distances. With the Wi-Fi module 870, the mobile phone can help the user send and receive email, surf the web, access streaming media, and the like. It provides wireless broadband Internet access to the user. Although in FIG. 8 shows the WiFi module 870, it can be understood that the WiFi module is not a necessary component of the mobile phone, and the WiFi module can be omitted as needed, provided that the scope of the present invention does not change.

The processor 880 is the control center of the mobile phone and is connected to various parts of the entire mobile phone using various interfaces and lines. By running or executing a program and/or module stored in the memory 820 and recalling data stored in the memory 820, the processor performs various functions of the mobile phone and performs data processing, thereby controlling the entire mobile phone. Optionally, processor 880 may include one or more processing units. For example, processor 880 may combine an application processor and a modem processor. The application processor mainly handles the operating system, user interface, application program, etc. The modem processor primarily handles wireless communications. It is clear that the modem processor may not be integrated into the 880 processor.

The mobile phone further includes a power source 890 (eg, a battery) for supplying power to the components. For example, a power supply may be logically connected to the processor 880 using a power management system, thereby implementing functions such as managing charging, discharging, and power consumption using the power management system.

Although not shown in the figure, the mobile phone may further include a camera, a sensor, or the like. The details are not described here again.

In embodiments of the present invention, by calling a program stored in the memory 820, the processor 880 included in the mobile phone can implement the functions of the mobile phone in the embodiment shown in FIG. 2, or other optional embodiments.

In this application, "several" means two or more, and the other quantifier is similar to this. "And/or" means that three relationships can exist. For example, A and/or B may represent the following three cases: there is only A, there are both A and B, and there is only B. It should be understood that the sequential numbers of the above-described processes do not indicate the order of execution in the various embodiments of the present invention. Process execution sequences should be determined in accordance with the functions and internal logic of the processes and should not be construed as any limitation on the processes for implementing embodiments of the present invention.

This application provides a computer storage medium including instructions, wherein the instructions, when executed on a computing device, cause the computing device to perform steps implemented by a display device in any embodiment described above.

This application further provides a computer storage medium including instructions, wherein the instructions, when executed on a computing device, cause the computing device to carry out the steps implemented by the mobile phone in any embodiment specified above.

This application further provides a computer program product, wherein the computer program product, when executed on a computing device, causes the computing device to perform steps implemented by a display device in any of the above embodiments.

This application further provides a computer program product, wherein the computer program product, when executed on a computing device, causes the computing device to perform the steps implemented by a mobile phone in any of the above embodiments.

All or some of the above embodiments may be implemented using software, hardware, firmware, or any combination thereof. When software is used for the implementation, the implementation may be in whole or in part embodied in the form of a computer software product.

A computer program product includes one or more computer instructions. When the instructions of a computer program are downloaded and executed on a display device or mobile phone, the procedure or functions according to this application are generated in whole or in part. The computer instructions may be stored on a computer-readable storage medium or may be transmitted from a computer-readable storage medium to another computer-readable storage medium. For example, computer instructions may be transmitted from a website, computer, server, or data center to another website, computer, server, or data center via a wired line (such as coaxial cable, fiber optic cable, or digital subscriber loop) or wirelessly. (eg infrared, radio or microwave). A computer-readable storage medium can be any usable medium accessible to a computer, or a data storage device, such as a server or data center, including one or more usable media. The media used may be magnetic media (eg, floppy disk, hard disk, or magnetic tape), optical media (eg, DVD), semiconductor media (eg, solid state disk (SSD)), or the like.

The above embodiments are intended only to describe the technical solutions of this application, but not to limit this application. Although this application has been described in detail with reference to the above embodiments, it will be understood by one skilled in the art that modifications may be made to the technical solutions recorded in the above embodiments, or equivalent substitutions may be made to some of the technical characteristics thereof, and these modifications or substitutions do not lead to a departure from the scope of the respective technical solutions from the scope of the technical solutions of the embodiments of this application.

Claims (115)

1. A control method applied to a mobile phone, including the steps of: sending the contents of the first screen to the display device, wherein the current navigation function of the mobile phone is a navigation function other than a three-key navigation function, wherein the three-key navigation function includes entering a task menu using a menu navigation key, returning to the desktop using the desktop navigation key and returning to a higher level using the return navigation key; receiving a first message sent by the display device, wherein the first message is generated by the display device in accordance with a first operation, wherein the first operation operates on a virtual navigation key, and the virtual navigation key is generated by the display device in response to the current navigation function of the mobile phone being a function navigation other than the three-key navigation function; performing a navigation function corresponding to the virtual navigation key according to the first message, and adjusting the contents of the first screen to the contents of the second screen; And sending the contents of the second screen to the display device to cause the display device to display the contents of the second screen in the screen projection area, the method further comprises the steps of: returning to the desktop when the mobile phone receives an upward sliding operation from the lower left end of the screen; or entering the task menu when the mobile phone receives the operation of sliding up from the lower left end of the screen and holding for a period of time; or returning to a higher level when the mobile phone receives a right sliding operation from the leftmost side of the mobile phone screen; or returning to a higher level when the mobile phone accepts that the number of presses of the off-screen physical key is greater than the first threshold value; or returning to the desktop when the mobile phone perceives that the number of presses of the off-screen physical key is greater than the second threshold value. 2. The method according to claim 1, wherein the method further comprises the step of: display the contents of the first screen before sending the contents of the first screen to the display device. 3. The method according to claim 1, wherein the method additionally comprises the step of: sending a navigation target function identifier to the display device before receiving a first message sent by the display device, wherein the navigation target function identifier is used to identify the current navigation function of the mobile phone as a navigation function in addition to a three-key navigation function. 4. The method of claim 1, wherein the virtual navigation key is provided in a navigation bar, and the navigation bar is formed for a navigation function other than a three-key navigation function of the display device in response to a current navigation function of the mobile phone; The navigation bar contains three virtual navigation keys, the first operation acts on one of the three virtual navigation keys. 5. The method of claim 1, wherein the first message contains a key instruction. 6. The method according to claim 1, wherein the three virtual navigation keys include a menu key, a desktop key and a return key, wherein the menu key corresponds to a navigation function for entering the task menu, the desktop key corresponds to a navigation function to return to the desktop , and the return key corresponds to the navigation function to return to a higher level. 7. The method according to claim 1, wherein the mobile phone and the display device are connected by wire or wireless. 8. The method of claim 1, wherein the first operation comprises a single click operation. 9. The method of claim 8, wherein the single-click operation is an operation of pressing a virtual navigation key with a mouse pointer. 10. The method of claim 1, wherein three virtual navigation keys are used to replace the current mobile phone navigation function on the display device. 11. The method according to claim 4, in which the navigation bar is located below the screen projection area. 12. The method of claim 1, wherein the current navigation function comprises a gesture navigation function or an off-screen physical navigation function, and the off-screen physical navigation function is implemented using a physical key. 13. The method of claim 1, wherein the display device is a desktop computer or a laptop. 14. The method of claim 1, wherein the first operation refers to an operation input by using a keyboard or an operation performed by using a mouse on the display device. 15. The method of claim 12, wherein the operation of the gesture navigation function comprises at least one of the following: the operation of sliding up from the lower left end of the mobile phone screen; the operation of sliding up from the lower left end of the mobile phone screen and holding for a period of time; And the operation of sliding to the right from the extreme left side of the mobile phone screen. 16. The method according to claim 1, wherein the method additionally contains the steps of: receiving a second message sent by the display device after adjusting the content of the first screen to the content of the second screen, wherein the second message is generated by the display device in accordance with the second operation, and the second operation is an operation that performs sliding inward from the edge of the projection area; the mobile phone performs a navigation function corresponding to the second operation in accordance with the second message, adjusting the contents of the second screen to the contents of the third screen. 17. The method according to claim 4, in which the projection area and the navigation bar are located in the same collaboration window. 18. The method according to claim 17, further comprising the steps of: in response to the keyboard and mouse operation that acts on pressing the desktop key of the collaboration window, the mobile phone returns to the desktop; And in response to the keyboard and mouse operation that slides up from the lower left end of the collaboration window, the mobile phone returns to the desktop. 19. The method of claim 17, wherein the collaboration window further includes a title bar, wherein the title bar includes a minimized window key, a maximized window key, and a close window key. 20. The method of claim 19, wherein the title bar is located above the screen projection area. 21. The method of claim 17, wherein when the collaboration window is a landscape window, the navigation bar is located to the right or left of the screen projection area. 22. The method according to claim 1, wherein the method additionally contains the following: when the first operation is a menu key operation, the content of the second screen is a task menu; or when the first operation is a desktop key operation, the content of the second screen is the desktop; or when the first operation is a return key operation, the content of the second screen is the higher level content. 23. The method of claim 3, wherein the navigation target function identifier includes any of a character string, a number, an image, a symbol, or text. 24. The method according to claim 1, in which in the case of a three-key navigation function, the mobile phone displays the contents of the fourth screen, and the contents of the fourth screen includes a three-key navigation screen; sending the contents of the fourth screen to the display device such that the display device displays the contents of the fourth screen in the projection area and does not display the navigation bar. 25. The method of claim 1, wherein the mobile phone displaying the contents of the second screen and the display device displaying the contents of the second screen are displayed synchronously. 26. A control method applied to a mobile phone, including the steps of: sending the contents of the first screen and a navigation target function identifier to the display device, wherein the navigation target function identifier is used to identify the current navigation function, except for a three-key navigation function on a mobile phone, wherein the three-key navigation function includes entering a task menu using the menu navigation key, returning to the desktop using the desktop navigation key, and returning to a higher level using the return navigation key; receiving a first key instruction sent by the display device, wherein the first key instruction is generated by the display device in accordance with the first operation of the keyboard and mouse; performing a navigation function corresponding to the first key instruction according to a preset mapping, wherein the navigation function is used to adjust the contents of the first screen to the contents of the second screen; And sending the contents of the second screen to the display device to cause the display device to display the contents of the second screen in the screen projection area of the collaboration window, the method further comprises the steps of: returning to the desktop when the mobile phone receives an upward sliding operation from the lower left end of the screen; or entering the task menu when the mobile phone receives the operation of sliding up from the lower left end of the screen and holding for a period of time; or returning to a higher level when the mobile phone receives a right sliding operation from the leftmost side of the mobile phone screen; or returning to a higher level when the mobile phone accepts that the number of presses of the off-screen physical key is greater than the first threshold value; or returning to the desktop when the mobile phone perceives that the number of presses of the off-screen physical key is greater than the second threshold value. 27. The method according to claim 26, wherein the method further comprises the step of: displaying the contents of the first screen before sending the contents of the first screen and the navigation target function identifier to the display device. 28. The method of claim 26, wherein the current navigation function comprises a gesture navigation function or an off-screen physical navigation function, and the off-screen physical navigation function is implemented using a physical key. 29. The method according to claim 26, in which the first operation of the keyboard and mouse operates on the virtual navigation key, the virtual navigation key is located in the navigation bar, the navigation bar is generated by the display device in response to the fact that the current navigation function of the mobile phone is a navigation function other than the three-key navigation function; The navigation bar contains three virtual navigation keys, the first keyboard and mouse operation acts on one of the three virtual navigation keys. 30. The method of claim 29, wherein the three virtual navigation keys include a menu key, a desktop key, and a return key, wherein the menu key corresponds to a navigation function for entering the task menu, and the desktop key corresponds to a navigation function to return to the desktop , and the return key corresponds to the navigation function to return to a higher level. 31. The method of claim 26, wherein the mobile phone and the display device are connected by wire or wireless. 32. The method of claim 26, wherein the first operation comprises a single click operation. 33. The method of claim 32, wherein the single-click operation is an operation of pressing a virtual navigation key with a mouse pointer. 34. The method of claim 29, wherein the three virtual navigation keys are used to replace the current mobile phone navigation function on the display device. 35. The method according to claim 29, in which the navigation bar is located below the screen projection area. 36. The method of claim 26, wherein the display device is a desktop computer or laptop. 37. The method of claim 26, wherein the first operation refers to an operation input by using a keyboard or an operation performed by using a mouse on the display device. 38. The method of claim 28, wherein the operation of the gesture navigation function comprises at least one of the following: the operation of sliding up from the lower left end of the mobile phone screen; the operation of sliding up from the lower left end of the mobile phone screen and holding for a period of time; And the operation of sliding to the right from the extreme left side of the mobile phone screen. 39. The method according to claim 26, wherein the method further comprises the steps of: receiving a second key instruction sent by the display device after adjusting the contents of the first screen to the contents of the second screen, wherein the second key instruction is generated by the display device in accordance with the second keyboard and mouse operation, and the second keyboard and mouse operation is an operation that slides inward from the edge of the area projection; the mobile phone performs a navigation function corresponding to the second operation of the keyboard and mouse in accordance with the second key instruction, adjusting the contents of the second screen to the contents of the third screen. 40. The method according to claim 26, in which in response to the keyboard and mouse operation that acts on pressing the desktop key of the collaboration window, the mobile phone returns to the desktop; And in response to the keyboard and mouse operation that slides up from the lower left end of the collaboration window, the mobile phone returns to the desktop. 41. The method of claim 26, wherein the projection area and the navigation bar are located in the same collaboration window. 42. The method of claim 27, wherein the collaboration window further includes a title bar, wherein the title bar includes a minimize window key, a maximized window key, and a close window key. 43. The method of claim 42, wherein the title bar is located above the screen projection area. 44. The method according to claim 38, wherein the method additionally contains the following: when the first operation is a menu key operation, the content of the second screen is a task menu; or when the first operation is a desktop key operation, the content of the second screen is the desktop; or when the first operation is a return key operation, the contents of the second screen are higher-level contents. 45. The method of claim 26, wherein the navigation target function identifier includes any of a character string, a number, an image, a symbol, or text. 46. The method according to claim 26, in which in the case of a three-key navigation function, the mobile phone displays the contents of the fourth screen, and the contents of the fourth screen includes a three-key navigation screen; sending the contents of the fourth screen to the display device such that the display device displays the contents of the fourth screen in the projection area and does not display the navigation bar. 47. The method of claim 26, wherein the mobile phone displaying the contents of the second screen and the display device displaying the contents of the second screen are displayed synchronously. 48. A control method applied to a screen projection scenario applied to a display device, including the steps of: receiving the first screen content sent by the mobile phone, wherein the current navigation function of the mobile phone is a navigation function other than a three-key navigation function, wherein the three-key navigation function includes entering a task menu using a menu navigation key, returning to the desktop table using the desktop navigation key and return to a higher level using the return navigation key, and the navigation function other than the three-key navigation function includes returning to the desktop when the mobile phone accepts the upward slide operation from the left bottom end screen; or entering the task menu when the mobile phone accepts the operation of sliding up from the bottom left end of the screen and holding for a period of time; or returning to a higher level when the mobile phone receives a right sliding operation from the extreme left side of the mobile phone screen; or returning to a higher level when the mobile phone accepts that the number of off-screen physical key presses is greater than the first threshold value; or returning to the desktop when the mobile phone perceives that the number of off-screen physical key presses is greater than the second threshold; generating a collaboration window including a screen projection area and a navigation bar in response to the fact that the current navigation function of the mobile phone is a navigation function other than a three-key navigation function, wherein the navigation bar includes at least one virtual navigation key; displaying the contents of the first screen in the screen projection area; generating a first message in accordance with the first operation in response to receiving the first operation acting on the virtual navigation key, sending a first message to the mobile phone to cause the mobile phone to perform a navigation function corresponding to the virtual navigation key in accordance with the first message, wherein the navigation function configured to adjust the contents of the first screen to the contents of the second screen; receiving second screen content sent by the mobile phone; And display the contents of the second screen in the screen projection area. 49. The method of claim 48, wherein generating a collaboration window comprising a screen projection area and a navigation bar in response to the fact that the current navigation function of the mobile phone is a navigation function other than a three-key navigation function, includes stages at which: receiving a navigation target function identifier sent by the mobile phone, wherein the navigation target function identifier is used to identify the current navigation function of the mobile phone as a navigation function in addition to a three-key navigation function; forming a collaboration window containing a screen projection area and a navigation bar in accordance with the identifier of the target navigation function. 50. The method of claim 48, wherein the navigation bar includes three virtual navigation keys, the first operation affecting one of the three virtual navigation keys. 51. The method of claim 48, wherein three virtual navigation keys are used to replace the current mobile phone navigation function on the display device. 52. The method of claim 48, wherein the first operation comprises a single click operation. 53. The method of claim 50, wherein the three virtual navigation keys include a menu key, a desktop key, and a return key, wherein the menu key corresponds to a navigation function for entering the task menu, and the desktop key corresponds to a navigation function to return to the desktop , and the return key corresponds to the navigation function to return to a higher level. 54. The method of claim 48, wherein the display device and the mobile phone are connected by wire or wireless. 55. The method of claim 48, wherein the first operation comprises a single click operation. 56. Mobile phone containing: one or more processors, one or more storage devices, one or more cameras, and one or more displays, wherein the computer program is stored in the storage device and can be executed on the processor, wherein the processor implements the method of any one of claims. 1-47 when executing a computer program. 57. A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program and, when the computer program is executed by the processor, the method according to any one of claims is implemented. 1-47.