CN104978156B - Multi-screen display method and multi-screen display processing device - Google Patents
Multi-screen display method and multi-screen display processing device Download PDFInfo
- Publication number
- CN104978156B CN104978156B CN201410131173.7A CN201410131173A CN104978156B CN 104978156 B CN104978156 B CN 104978156B CN 201410131173 A CN201410131173 A CN 201410131173A CN 104978156 B CN104978156 B CN 104978156B
- Authority
- CN
- China
- Prior art keywords
- electronic equipment
- electronic device
- windows
- task
- screen display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
A multi-screen display method and a multi-screen display processing device are disclosed, which are applied to electronic equipment, and the electronic equipment has a multi-task parallel operation capability. The multi-screen display method comprises the following steps: the electronic equipment runs at least two tasks in parallel; and one of the at least two tasks which is not displayed on the display screen of the electronic equipment is wirelessly projected to another electronic equipment. By using the wireless screen projection technology, at least two tasks running in parallel in the electronic equipment are displayed on the current electronic equipment and the other electronic equipment respectively, so that the application of the current electronic equipment can be favorably expanded.
Description
Technical Field
The present invention relates to the field of multi-screen display technologies, and in particular, to a multi-screen display method and a multi-screen display processing apparatus.
Background
At present, the Win8 operating system is becoming popular, but due to cost or other factors, many computers installed with Win8 do not have touch screens, such as traditional desktop and notebook personal computers, and therefore, users cannot fully experience the touch operation functions of Win 8. In addition, although current computer devices such as tablet computers, smart phones and digital personal assistants can support touch operation, the computer devices cannot support the classic desktop operation of Windows. Therefore, the exertion of the functions of the Win8 is greatly limited due to the hardware limitations of the operating system of the various computer devices Win 8.
Therefore, a display method capable of fully applying the functions of the Win8 operating system is required, which can support both the classic desktop operation of Windows and the touch operation of Windows Metro.
Disclosure of Invention
In order to solve the above technical problems, the present invention provides a multi-screen display method and a multi-screen display processing apparatus, which can advantageously expand applications of a current electronic device by displaying at least two tasks running in parallel in the electronic device on the current electronic device and another electronic device, respectively, using a wireless screen-casting technology.
According to an aspect of the present invention, a multi-screen display method is provided, which is applied to an electronic device, where the electronic device has a multitask parallel operation capability, and the method includes: the electronic equipment runs at least two tasks in parallel; and one of the at least two tasks which is not displayed on the display screen of the electronic equipment is wirelessly projected to another electronic equipment.
According to the embodiment of the invention, the multi-screen display method further comprises the following steps: receiving an operation command from the other electronic device; according to the received operation command, corresponding operation is executed on the task which is wirelessly projected to the other electronic equipment; and wirelessly projecting an operation result of the task wirelessly projected to the other electronic device.
According to another aspect of the present invention, there is provided a multi-screen display processing apparatus applied to an electronic device, where the electronic device runs at least two tasks in parallel, the multi-screen display processing apparatus including: and the wireless screen projection component is used for wirelessly projecting one of the tasks which are not displayed on the display screen of the electronic equipment to another electronic equipment.
According to an embodiment of the present invention, the multi-screen display processing apparatus further includes: an operation command receiving section for receiving an operation command from the other electronic device; the operation response component is used for executing corresponding operation on the task which is wirelessly projected to the other electronic equipment according to the received operation command; and the wireless screen projection component is also used for wirelessly projecting the operation result of the task which is wirelessly projected to the other electronic equipment.
According to the embodiment of the invention, the electronic equipment and the other electronic equipment are connected in a WiFi direct connection mode, and the wireless screen projection component performs wireless screen projection based on Miracast.
According to the embodiment of the invention, the electronic device runs a Windows8 operating system, the other electronic device supports touch operation, the at least two tasks comprise a Windows classic desktop and a Windows Metro desktop, the electronic device displays the Windows classic desktop, and the other electronic device displays the Windows Metro desktop.
In this case, according to the embodiment of the present invention, the operation interface of the Windows Metro desktop suitable for touch control is wirelessly projected onto the tablet computer, and the operation interface of the Windows classic desktop suitable for mouse control is displayed on the personal computer supporting mouse control, so that the operation interface of the Windows Metro desktop can be operated by touch control on the tablet computer, and the operation interface of the Windows classic desktop can be operated by mouse operation on the personal computer, thereby sufficiently performing the function of the operating system in the electronic device.
In addition, according to an embodiment of the present invention, the electronic device runs a desktop operating system, the at least two tasks include a work processing task and an image processing task, the electronic device displays a user interface of the work processing task, and the wireless screen projecting component wirelessly projects the user interface of the image processing task to the other electronic device, where the image processing task includes at least one of video playing, picture browsing, web browsing, and game processing.
In addition, according to an embodiment of the present invention, the electronic device is a smart phone, the at least two tasks include a phone communication task and an image processing task, the electronic device displays a user interface of the phone communication task, the wireless screen projecting component projects the user interface of the image processing task to the other electronic device wirelessly for display by the other electronic device, wherein the phone communication task includes at least one of a phone task, a short message task, and an instant messaging task, and the image processing task includes at least one of video playing, picture browsing, web browsing, and game processing.
Furthermore, according to an embodiment of the present invention, the electronic device is a tablet computer, and the another electronic device displays a user interface of a task that is currently running on the tablet computer but is not displayed on a screen of the tablet computer, where the task includes at least one of a game processing task, a video playing task, a web browsing task, a picture browsing task, and an application running task.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 illustrates a schematic flow chart of a multi-screen display method according to an embodiment of the invention;
FIG. 2 illustrates a further schematic flow chart of a multi-screen display method according to an embodiment of the invention;
FIG. 3 is a schematic diagram illustrating a display effect of a multi-screen display method according to an embodiment of the invention; and
fig. 4 illustrates a schematic block diagram of a multi-screen display processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, various embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. It is to be understood that the described embodiments are merely a few embodiments of the invention and are not necessarily all embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments described in the present application without inventive step, shall fall within the scope of protection of the present application.
Here, it is to be noted that, in the drawings, the same reference numerals are given to constituent parts having substantially the same or similar structures and functions, and repeated description thereof will be omitted.
A schematic flow chart of a multi-screen display method 100 according to an embodiment of the invention is shown in fig. 1. The multi-screen display method 100 according to the embodiment of the invention can be applied to an electronic device which has a multi-task parallel operation capability.
First, at step S110, at least two tasks are executed in parallel on the electronic device.
Then, in step S120, one of the at least two tasks that is not displayed on the display screen of the electronic device is wirelessly projected to another electronic device using a wireless screen projection technique.
Since wireless screen projection is required in step S120, in the multi-screen display method according to the embodiment of the invention, a wireless screen projection path also needs to be established between the electronic device and the other electronic device before step S120.
According to the embodiment of the invention, the electronic device and the other electronic device can establish connection in a WiFi Direct (WiFi Direct) mode. Further, for example, the wireless screen projection may be a Miracast-based wireless screen projection, the electronic device supports Miracast Source (wireless screen projection Source) function, and the other electronic device supports Miracast Display (wireless screen projection Display) function.
Specifically, the electronic device may discover the another electronic device supporting the Miracast Display function in a WiFi direct connection manner, and may implement WiFi direct connection between the electronic device and the another electronic device after the another electronic device agrees to establish WiFi direct connection. Means of how to implement WiFi direct connection between two electronic devices are well known to those skilled in the art and will not be described herein in detail.
In addition, according to the multi-screen display method of the embodiment of the invention, after the wireless screen projection is performed in step S120, an operation command may be received from the other electronic device, and accordingly, a corresponding operation is performed on the task of the wireless screen projection.
A further schematic flow chart of a multi-screen display method according to an embodiment of the invention is shown in FIG. 2.
After wirelessly projecting one of the tasks that is not displayed on the display screen of the electronic device to another electronic device using the wireless projection technology at step S120, the multi-screen display method according to an embodiment of the present invention may proceed to step S210.
In step S210, an operation command is received from the other electronic device.
In the case where the task that is wirelessly projected is, for example, a video play task, the operation command may be, for example, an operation command of fast forward, skip, rewind, pause, volume up, volume down, or the like.
In the case where the task to be wirelessly screened is, for example, a game task, the operation command may be, for example, a game operation instruction.
In step S220, according to the received operation command, corresponding operations are performed on the task that is wirelessly projected to the other electronic device.
Next, in step S230, the operation result of the task wirelessly screened to the other electronic device is wirelessly screened to the other electronic device.
Hereinafter, the operation of the multi-screen display method 200 according to the embodiment of the present invention will be described with reference to several specific examples.
First example
The electronic device may be a personal computer supporting mouse and keyboard operations, a Windows8 operating system is running on the electronic device, the other electronic device may be a tablet computer supporting touch operations, and the electronic device may run at least two different tasks in parallel, wherein a first task may be a Windows classic desktop, a second task may be a Windows Metro desktop, the electronic device displays the Windows classic desktop, and the other electronic device displays the Windows Metro desktop.
According to the multi-screen display method provided by the embodiment of the invention, the Windows classic desktop can be displayed on the personal computer, so that a user can operate on the personal computer through mouse and keyboard operation based on the Windows classic desktop. In addition, according to the multi-screen display method provided by the embodiment of the invention, the Windows Metro desktop can be wirelessly projected onto the tablet computer supporting touch operation through a wireless screen projection technology, so that a user can conveniently operate on the tablet computer based on the Windows Metro desktop.
Specifically, personal computer supports Miracast Source function, the tablet computer supports Miracast Display function, personal computer discovers through wiFi directly links that supports Miracast Display function the tablet computer to directly link through wiFi with the tablet computer establishes the connection.
Fig. 3 shows a schematic diagram of the display effect of the first example. As shown in fig. 3, two operation interfaces may be run in parallel on a conventional personal computer supporting mouse and keyboard operations, a conventional desktop operation interface (Windows classic desktop) is displayed on the personal computer, and the personal computer wirelessly projects a touch operation interface (Windows Metro desktop) suitable for touch operation onto a tablet computer through a wireless projection technology, so as to display the touch operation interface on the tablet computer.
Then, in step S220, the personal computer encodes the Windows Metro desktop running in the background into a transport stream, and transmits the encoded transport stream to the tablet pc through the WIFI direct connection, and the tablet pc displays the Windows Metro desktop according to the encoded transport stream.
Next, when the User operates the Windows Metro desktop on the tablet pc, for example, when the User touches an email icon on the tablet pc, the tablet pc feeds back the User's operation to the personal computer, for example, the tablet pc may feed back the User's operation to the personal computer through a User Input feedback Control (User Input feedback Control) protocol. Accordingly, the personal computer receives an operation command from the tablet computer at step S310.
In step S320, the personal computer opens the electronic mailbox in the Windows Metro desktop environment according to the received operation command, i.e., the operation command for opening the electronic mailbox.
Then, in step S330, the personal computer encodes an operation interface of the electronic mailbox opened in the Windows Metro desktop environment into a transport stream, and transmits the encoded transport stream to the tablet computer through a WIFI direct connection manner, so that the tablet computer displays the electronic mailbox opened in the Windows Metro desktop environment.
The multi-screen display method 200 according to the embodiment of the invention can be applied not only to the application shown in fig. 3, but also to various applications.
Second example
The electronic device may be a personal computer supporting mouse and keyboard operations, the other electronic device may be a large screen display (e.g., a television), the electronic device runs a desktop operating system (e.g., a Windows classic desktop), two different tasks may be run in parallel on the electronic device, the at least two tasks may include a work processing task and an image processing task, the electronic device displays a user interface for the work processing task, and the other electronic device displays a user interface for the image processing task.
For example, the work processing task may be, for example, a Microsoft Office application, and the image processing task may include, for example, at least one of video playing, photo browsing, web browsing, and game processing, and in this example, the image processing task may be, for example, a Windows Media Player application.
According to the multi-screen display method of the embodiment of the invention, the operation interface of the Microsoft Office application can be displayed on the personal computer, so that the user can perform document browsing and editing operations under the Microsoft Office application through mouse and keyboard operations on the personal computer. In addition, according to the multi-screen display method of the embodiment of the invention, the operation interface of the Windows Media Player application can be wirelessly projected to a large screen display such as a television through a wireless projection technology, so that the Windows Media Player application can be used for watching videos.
Specifically, the personal computer supports Miracast Source function, the television supports Miracast Display function, the personal computer discovers that supports Miracast Display function through the WiFI direct mode at first the television to through the WiFI direct with the television sets up the connection.
Then, in step S120, the personal computer encodes the graphical interface of the Windows Media Player running in the background into a transport stream, and transmits the encoded transport stream to the television through the WIFI direct connection, and the television displays the graphical interface of the Windows Media Player accordingly.
Next, when the User operates the graphic interface of the Windows Media Player on the tv set, for example, when the User performs fast forward, pause, rewind, etc. operations using a remote controller of the tv set, or when the User performs fast forward, pause, rewind, etc. operations using a USB mouse in the case where the tv set can support a USB mouse, the tv set feeds back the User's operations to the personal computer, for example, the tv set may feed back the User's operations to the personal computer through a User Input feedback Control (User Input feedback Control) protocol. Accordingly, the personal computer receives an operation command from the television at step S210.
In step S220, the personal computer performs corresponding operations on the currently played video of the Windows Media Player according to the received operation command.
Then, in step S230, the personal computer encodes the operated graphical interface of the Windows Media Player application into a transport stream and transmits the encoded transport stream to the television set in a WIFI direct mode, so that the television set displays the graphical interface of the Windows Media Player application adjusted according to the user' S operation.
Third example
The electronic device may be a tablet computer supporting touch operation, at least two different tasks may be run in parallel on the tablet computer, and the another electronic device displays a user interface of one of the tasks that the tablet computer is currently running but is not displayed on a screen of the tablet computer, where the task may include at least one of a game processing task, a video playing task, web browsing, a picture browsing task, and an application running task.
For example, the first task may be a web browser application and the second task may be a video player application.
According to the multi-screen display method provided by the embodiment of the invention, the operation interface of the web browser application can be displayed on the tablet personal computer, so that a user can perform web browsing operation on the tablet personal computer. In addition, according to the multi-screen display method of the embodiment of the invention, the operation interface of the media player application can be wirelessly projected to a large screen display, such as a television, through the wireless projection technology, so as to watch videos.
Specifically, the tablet computer supports Miracast Source function, the television supports Miracast Display function, the tablet computer firstly discovers that the television supports Miracast Display function through the WiFI direct connection mode, and establishes connection with the television through the WiFI direct connection.
Then, in step S120, the tablet computer encodes the graphical interface of the media player application running in the background into a transport stream, and transmits the encoded transport stream to the television through a WIFI direct connection method, so that the television displays the graphical interface of the media player application.
Next, when the User operates the graphical interface of the media player application on the television, for example, when the User uses a remote controller of the television to perform operations such as fast forward, pause, rewind, or the like, or when the User uses a USB mouse to perform operations such as fast forward, pause, rewind, or the like, in the case where the television can support a USB mouse, the television feeds back the User's operations to the personal computer, for example, the television may feed back the User's operations to the tablet computer through a User Input feedback Control (User Input feedback Control) protocol. Accordingly, the tablet computer receives an operation command from the television at step S210.
In step S220, the tablet computer performs corresponding operations on the video currently played by the media player according to the received operation command.
Then, in step S230, the tablet computer encodes the operated graphical interface of the media player application into a transport stream, and transmits the encoded transport stream to the television through a WIFI direct connection method, so that the television displays the graphical interface of the media player application adjusted according to the user' S operation.
Fourth example
The electronic device may be a smartphone, on which at least two different tasks may be run in parallel, where the at least two tasks may include a mobile communication task and an image processing task. The mobile phone communication task can be at least one of a telephone task, a short message task and an instant communication task. The image processing task may include, for example, at least one of video playing, picture browsing, web browsing, and game processing. The electronic device displays a user interface of a mobile phone communication task, and the other electronic device displays a user interface of an image processing task.
Specifically, according to the multi-screen display method provided by the embodiment of the invention, the operation interface of the mobile phone communication task can be displayed on the smart phone, so that a user can communicate by using the smart phone. In addition, according to the multi-screen display method of the embodiment of the invention, the operation interface of the image processing task can be wirelessly projected to a large-screen display, such as a television, through a wireless projection technology so as to watch videos.
Specifically, the smart phone supports the Miracast Source function, the television supports the Miracast Display function, the smart phone firstly finds the television supporting the Miracast Display function through the WiFI direct connection mode, and establishes a connection with the television through the WiFI direct connection.
Then, in step S120, the smart phone encodes the graphical interface of the image processing application running in the background into a transport stream, and transmits the encoded transport stream to the television through a WIFI direct connection method, where the television displays the graphical interface of the image processing application accordingly.
Next, when the User operates the graphical interface of the image processing application on the television, for example, when the User performs fast forward, pause, rewind, and the like of video playing using a remote controller of the television, or when the User performs fast forward, pause, rewind, and the like of video playing using a USB mouse in a case where the television can support a USB mouse, or when the User performs game operation using a gamepad in a case where the television can support a gamepad, the television feeds back the operation of the User to the smartphone, for example, the television may feed back the operation of the User to the smartphone through a User Input feedback Control (User Input feedback Control) protocol. Accordingly, the smartphone receives an operation command from the television set in step S210.
In step S220, the smartphone performs a corresponding operation on the image processing application according to the received operation command.
Then, in step S230, the smartphone encodes the operated graphical interface of the image processing application into a transport stream, and transmits the encoded transport stream to the television through a WIFI direct connection method, so that the television displays the graphical interface of the image processing application adjusted according to the operation of the user.
It should be understood that the multi-screen display method according to the embodiment of the present invention is not limited to the above example, and other application examples may exist as needed.
A schematic block diagram of a multi-screen display processing apparatus 400 according to an embodiment of the invention is shown in FIG. 4. The multi-screen display processing apparatus 400 according to the embodiment of the present invention can be applied to an electronic device, where the electronic device runs at least two tasks in parallel, and the multi-screen display processing apparatus includes: a wireless screen projection component 410.
The wireless screen projecting component 410 wirelessly projects one of the at least two tasks that is not displayed on the display screen of the electronic device to another electronic device.
Furthermore, the multi-screen display processing apparatus according to the embodiment of the present invention may further include: an operation command receiving part 420 and an operation response part 430.
The operation command receiving section 420 receives an operation command from the other electronic device. In the case where the task that is wirelessly projected is, for example, a video play task, the operation command may be, for example, an operation command of fast forward, skip, rewind, pause, volume up, volume down, or the like. In the case where the task to be wirelessly screened is, for example, a game task, the operation command may be, for example, a game operation instruction.
The operation response unit 430 performs a corresponding operation on the task that is wirelessly projected to the other electronic device according to the received operation command.
In this case, the wireless screen projecting part 440 also wirelessly screens an operation result of a task wirelessly projected to the other electronic device.
According to the embodiment of the invention, the electronic device and the other electronic device can establish connection in a WiFi Direct (WiFi Direct) mode. Further, for example, the wireless screen projection may be a Miracast-based wireless screen projection, the electronic device supports Miracast Source (wireless screen projection Source) function, and the other electronic device supports Miracast Display (wireless screen projection Display) function. Specifically, the wireless screen projection component 410 performs wireless screen projection based on WiFi direct connection.
Furthermore, the multi-screen display processing apparatus 400 according to the embodiment of the present invention may further include: a screen coding unit 440.
The screen encoding part 440 encodes the background-running Windows Metro desktop into a transport stream, and then the wireless screen projecting part 410 transmits the encoded transport stream to the other electronic device through a WIFI direct connection manner.
The other electronic device may feed back the operation of the User to the electronic device through a User Input feedback Control (User Input feedback Control) protocol, in other words, the operation command receiving part 420 may receive the operation command from the other electronic device according to the User Input feedback Control (User Input feedback Control) protocol.
First example
The electronic device may be a personal computer supporting mouse and keyboard operations, a Windows8 operating system is running on the electronic device, the other electronic device may be a tablet computer supporting touch operations, and the electronic device may run at least two different tasks in parallel, wherein a first task may be a Windows classic desktop, a second task may be a Windows Metro desktop, the electronic device displays the Windows classic desktop, and the other electronic device displays the Windows Metro desktop.
According to the multi-screen Display processing device provided by the embodiment of the invention, specifically, the personal computer supports a Miracast Source function, the tablet computer supports a Miracast Display function, and the personal computer establishes connection with the tablet computer in a WiFi direct connection mode.
The screen coding part 440 codes the Windows Metro desktop running in the background into a transport stream, and the wireless screen projection part 410 transmits the coded transport stream to the tablet computer in a WIFI direct connection manner, so that the tablet computer displays the Windows Metro desktop.
Next, when the User operates the Windows Metro desktop on the tablet pc, for example, when the User touches an email icon on the tablet pc, the operation command receiving part 420 receives an operation command from the tablet pc according to a User Input feedback Control (User Input back Control) protocol.
Then, the operation response part 430 opens the electronic mailbox in the Windows Metro desktop environment according to the received operation command, i.e., the operation command to open the electronic mailbox.
Then, the screen encoding part 440 encodes the operation interface of the electronic mailbox opened in the Windows Metro desktop environment into a transport stream, and the wireless screen projecting part 410 transmits the encoded transport stream to the tablet computer through a WIFI direct connection manner, so that the tablet computer displays the electronic mailbox opened in the Windows Metro desktop environment.
Second example
The electronic device may be a personal computer supporting mouse and keyboard operations, the other electronic device may be a large screen display (e.g., a television), the electronic device runs a desktop operating system (e.g., a Windows classic desktop), two different tasks may be run in parallel on the electronic device, the at least two tasks may include a work processing task and an image processing task, the electronic device displays a user interface for the work processing task, and the other electronic device displays a user interface for the image processing task.
For example, the work processing task may be a Microsoft Office application, and the image processing task may include at least one of video playing, photo browsing, web browsing, and game processing, and in this example, the image processing task may be specifically a Windows Media Player application.
According to the multi-screen Display processing device provided by the embodiment of the invention, specifically, the personal computer supports a Miracast Source function, the television supports a Miracast Display function, and the personal computer establishes connection with the television in a WiFI direct connection mode.
The screen coding part 440 codes the graphical interface of the Windows Media Player running in the background into a transport stream, and the wireless screen projecting part 410 transmits the coded transport stream to the television through the WIFI direct connection method, so that the television displays the graphical interface of the Windows Media Player.
Next, when the User operates the graphic interface of the Windows Media Player on the television, for example, when the User performs fast forward, pause, rewind, etc. operations using a remote controller of the television, or when the User performs fast forward, pause, rewind, etc. operations using a USB mouse in the case where the television can support the USB mouse, the operation command receiving part 420 receives an operation command from the television according to a User Input feedback Control (User Input back Control) protocol.
Then, the operation response part 430 performs corresponding operations on the video currently played by the Windows Media Player according to the received operation commands.
Then, the screen encoding part 440 encodes the graphical interface of the operated Windows Media Player application into a transport stream, and the wireless screen projecting part 410 transmits the encoded transport stream to the television set in a WIFI direct manner, whereby the television set displays the graphical interface of the Windows Media Player application adjusted according to the user's operation.
Third example
The electronic device may be a tablet computer supporting touch operation, at least two different tasks may be run in parallel on the tablet computer, and the another electronic device displays a user interface of one of the tasks that the tablet computer is currently running but is not displayed on a screen of the tablet computer, where the task may include at least one of a game processing task, a video playing task, web browsing, a picture browsing task, and an application running task. In particular, the at least two different tasks may be, for example, a web browser application and a video player application.
According to the multi-screen Display processing device provided by the embodiment of the invention, specifically, the tablet computer supports a Miracast Source function, the television supports a Miracast Display function, and the tablet computer establishes connection with the television in a WiFI direct connection mode.
The screen encoding part 440 encodes the graphical interface of the media player application running in the background into a transport stream, and the wireless screen projecting part 410 transmits the encoded transport stream to the television through a WIFI direct connection manner, so that the television displays the graphical interface of the media player application.
Next, when the User operates the graphic interface of the media player application on the television, for example, when the User performs fast forward, pause, rewind, and the like using a remote controller of the television, or when the User performs fast forward, pause, rewind, and the like using a USB mouse in a case where the television can support the USB mouse, the operation command receiving part 420 receives an operation command from the television according to a User Input feedback Control (User Input backed Control) protocol.
Then, the operation command receiving component 420 performs corresponding operations on the video currently played by the media player according to the received operation command.
Then, the screen encoding part 440 encodes the graphical interface of the operated media player application into a transport stream, and the wireless screen projecting part 410 transmits the encoded transport stream to the television through a WIFI direct connection manner, so that the television displays the graphical interface of the media player application adjusted according to the user's operation.
Fourth example
The electronic device may be a smartphone, on which at least two different tasks may be run in parallel, where the at least two tasks may include a mobile communication task and an image processing task. The mobile phone communication task can be at least one of a telephone task, a short message task and an instant communication task. The image processing task may include, for example, at least one of video playing, picture browsing, web browsing, and game processing. The electronic device displays a user interface of a mobile phone communication task, and the other electronic device displays a user interface of an image processing task.
Specifically, according to the multi-screen Display processing apparatus of the embodiment of the present invention, the smart phone supports a Miracast Source function, the television supports a Miracast Display function, and the smart phone establishes a connection with the television in a WiFI direct connection manner.
The screen encoding component 440 encodes the graphical interface of the image processing application running in the background into a transport stream, and the wireless screen projecting component 410 transmits the encoded transport stream to the television through a WIFI direct connection mode, so that the television displays the graphical interface of the image processing application.
Next, when the User operates the graphical interface of the image processing application on the television, for example, when the User performs fast-forward, pause, rewind, and the like of video playback using a remote controller of the television, or when the User performs fast-forward, pause, rewind, and the like of video playback using a USB mouse in the case where the television can support a USB mouse, or when the User performs game operation using a joystick in the case where the television can support a joystick, the operation command receiving section 420 receives an operation command from the television according to a User Input feedback Control (User Input feedback Control) protocol.
The operation response unit 430 performs corresponding operations on the image processing application according to the received operation command. Then, the screen encoding part 440 encodes the graphical interface of the operated image processing application into a transport stream, and the wireless screen projecting part 410 transmits the encoded transport stream to the television set in a WIFI direct manner, so that the television set displays the graphical interface of the image processing application adjusted according to the user's operation.
According to the multi-screen display method and the multi-screen display processing device provided by the embodiment of the invention, the application of the current electronic equipment can be favorably expanded by utilizing the wireless screen projection technology to display at least two tasks which run in parallel in the electronic equipment on the current electronic equipment and the other electronic equipment respectively.
More advantageously, according to the multi-screen display method and the multi-screen display processing apparatus of the embodiment of the invention, by using the wireless screen projection technology, a first operation interface suitable for touch control in at least two tasks running in parallel in the electronic device is wirelessly projected to the tablet computer, and a second operation interface suitable for mouse control is displayed on the personal computer supporting mouse control, so that the first operation interface can be operated by touch control operation on the tablet computer, and the second operation interface can be operated by mouse operation on the personal computer, thereby fully utilizing the functions of the operating system in the electronic device.
Through the above description of the embodiments, those skilled in the art will clearly understand that the present invention may be implemented by means of software plus a necessary hardware platform, and may also be implemented by software or hardware entirely. With this understanding in mind, all or part of the technical solutions of the present invention that contribute to the background can be embodied in the form of a software product, which can be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods according to the embodiments or some parts of the embodiments.
Various embodiments of the present invention are described in detail above. However, those skilled in the art will appreciate that various modifications, combinations, or sub-combinations of the embodiments may be made without departing from the spirit and principle of the invention, and such modifications are intended to be within the scope of the invention.
Claims (8)
1. A multi-screen display method is applied to electronic equipment, the electronic equipment has a multi-task parallel operation capability, and the multi-screen display method comprises the following steps:
the electronic equipment runs at least two tasks in parallel; and
one of the at least two tasks which is not displayed on the display screen of the electronic equipment is wirelessly projected to another electronic equipment;
wherein the content of the first and second substances,
the wireless screen projection is based on Miracast;
wherein, when the at least two tasks include a Windows classic desktop supporting mouse and keyboard operations and a Windows Metro desktop adapted for touch operations, the electronic device displays the Windows classic desktop for operation by a user on the electronic device using a mouse and a keyboard, and the other electronic device displays the Windows Metro desktop for touch operations by a user on the other electronic device.
2. A multi-screen display method as recited in claim 1, further comprising:
receiving an operation command from the other electronic device;
according to the received operation command, corresponding operation is executed on the task which is wirelessly projected to the other electronic equipment; and
and wirelessly projecting the operation result of the task which is wirelessly projected to the other electronic equipment.
3. A multi-screen display method according to claim 1,
and the electronic equipment and the other electronic equipment are connected in a WiFi direct connection mode.
4. A multi-screen display method according to claim 1,
the electronic equipment runs a Windows8 operating system, and the other electronic equipment supports touch operation.
5. A multi-screen display processing device is applied to electronic equipment, the electronic equipment runs at least two tasks in parallel, and the multi-screen display processing device comprises:
the wireless screen projection component is used for wirelessly projecting one of the tasks which are not displayed on the display screen of the electronic equipment to another electronic equipment;
wherein the content of the first and second substances,
the wireless screen projection component performs wireless screen projection based on Miracast;
wherein, when the at least two tasks include a Windows classic desktop supporting mouse and keyboard operations and a Windows Metro desktop adapted for touch operations, the electronic device displays the Windows classic desktop for operation by a user on the electronic device using a mouse and a keyboard, and the other electronic device displays the Windows Metro desktop for touch operations by a user on the other electronic device.
6. A multi-display processing apparatus according to claim 5, further comprising:
an operation command receiving section for receiving an operation command from the other electronic device;
the operation response component is used for executing corresponding operation on the task which is wirelessly projected to the other electronic equipment according to the received operation command; and
the wireless screen projection component is also used for wirelessly projecting the operation result of the task which is wirelessly projected to the other electronic equipment.
7. A multi-display processing apparatus according to claim 5,
and the electronic equipment and the other electronic equipment are connected in a WiFi direct connection mode.
8. A multi-display processing apparatus according to claim 5,
the electronic equipment runs a Windows8 operating system, and the other electronic equipment supports touch operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410131173.7A CN104978156B (en) | 2014-04-02 | 2014-04-02 | Multi-screen display method and multi-screen display processing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410131173.7A CN104978156B (en) | 2014-04-02 | 2014-04-02 | Multi-screen display method and multi-screen display processing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104978156A CN104978156A (en) | 2015-10-14 |
| CN104978156B true CN104978156B (en) | 2021-10-22 |
Family
ID=54274701
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410131173.7A Active CN104978156B (en) | 2014-04-02 | 2014-04-02 | Multi-screen display method and multi-screen display processing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104978156B (en) |
Families Citing this family (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105426178B (en) * | 2015-11-02 | 2019-03-08 | Oppo广东移动通信有限公司 | Display system, the display methods of terminal system of terminal |
| CN106933523A (en) * | 2015-12-30 | 2017-07-07 | 阿里巴巴集团控股有限公司 | A kind of multi-screen interaction method and device |
| CN106980479B (en) * | 2016-01-15 | 2020-07-14 | 阿里巴巴（中国）有限公司 | Multi-screen interaction method and device and server |
| CN105959782A (en) * | 2016-05-05 | 2016-09-21 | 王博 | Wireless screen projection device, system and method |
| EP3623932B1 (en) | 2017-06-09 | 2024-03-06 | Huawei Technologies Co., Ltd. | Display method and device |
| CN108702414B (en) * | 2017-06-16 | 2021-04-09 | 华为技术有限公司 | Screen locking method and device and computer readable storage medium |
| EP3617860B1 (en) | 2017-06-16 | 2023-05-17 | Huawei Technologies Co., Ltd. | Screen locking method and apparatus |
| CN108124173A (en) * | 2017-12-11 | 2018-06-05 | 深圳创维－Rgb电子有限公司 | A kind of one-to-many throw shields display methods, system and storage medium |
| CN108521591A (en) * | 2018-03-30 | 2018-09-11 | 广东工业大学 | A kind of throwing screen method, apparatus and system |
| CN108845778B (en) * | 2018-06-15 | 2021-09-24 | 广州视源电子科技股份有限公司 | Layout adjustment method and device for split screen picture, display device and storage medium |
| WO2020014880A1 (en) * | 2018-07-17 | 2020-01-23 | 华为技术有限公司 | Multi-screen interaction method and device |
| CN109144703B (en) * | 2018-09-10 | 2021-03-23 | 维沃移动通信有限公司 | Multitask processing method and terminal equipment thereof |
| CN113504851A (en) * | 2018-11-14 | 2021-10-15 | 华为技术有限公司 | Method for playing multimedia data and electronic equipment |
| CN110377250B (en) * | 2019-06-05 | 2021-07-16 | 华为技术有限公司 | Touch method in screen projection scene and electronic equipment |
| CN110515579A (en) * | 2019-08-28 | 2019-11-29 | 北京小米移动软件有限公司 | Throw screen method, apparatus, terminal and storage medium |
| CN110913254A (en) * | 2019-10-30 | 2020-03-24 | 深圳市亿联智能有限公司 | Low-cost delivery method for delivering webpage video to terminal equipment |
| CN112839130A (en) * | 2019-12-17 | 2021-05-25 | 毕齐齐 | Multifunctional screen projection system for smart phone |
| CN113031890A (en) * | 2019-12-25 | 2021-06-25 | 上海博泰悦臻电子设备制造有限公司 | Method and device for controlling mobile terminal to perform screen projection interaction |
| CN111415636B (en) * | 2020-03-31 | 2022-03-11 | 惠州华阳通用电子有限公司 | Picture sharing system and implementation method thereof |
| CN111634188B (en) * | 2020-05-29 | 2023-03-24 | 阿波罗智联(北京)科技有限公司 | Method and device for projecting screen |
| CN114756158A (en) * | 2020-12-29 | 2022-07-15 | 广州视源电子科技股份有限公司 | Application window screen-projection switching method, device, system, medium and electronic equipment |
| CN112799622A (en) * | 2021-01-22 | 2021-05-14 | 维沃移动通信（杭州）有限公司 | Application control method and device and electronic equipment |
| CN112905089B (en) * | 2021-02-07 | 2022-09-16 | 北京小米移动软件有限公司 | Equipment control method and device |
| CN115253285A (en) * | 2021-04-30 | 2022-11-01 | 华为技术有限公司 | Display method and related device |
| CN115202834B (en) * | 2021-05-27 | 2023-04-28 | 华为技术有限公司 | Task migration system and method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101202889A (en) * | 2006-12-11 | 2008-06-18 | 腾讯科技（深圳）有限公司 | Method and system for operating video play apparatus via mobile terminal |
| CN103150132A (en) * | 2013-02-21 | 2013-06-12 | 海信集团有限公司 | Screen transmission method and electronic equipment |
| CN103226458A (en) * | 2013-05-09 | 2013-07-31 | 上海斐讯数据通信技术有限公司 | Multi-screen display control method for intelligent mobile equipment |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006350581A (en) * | 2005-06-15 | 2006-12-28 | Nec Corp | Remote desktop system, terminal device and remote desktop environment construction method used for them |
| CN101620522A (en) * | 2009-07-20 | 2010-01-06 | 大道计算机技术(上海)有限公司 | Control method for operating mobile memory with screen projection function |
-
2014
- 2014-04-02 CN CN201410131173.7A patent/CN104978156B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101202889A (en) * | 2006-12-11 | 2008-06-18 | 腾讯科技（深圳）有限公司 | Method and system for operating video play apparatus via mobile terminal |
| CN103150132A (en) * | 2013-02-21 | 2013-06-12 | 海信集团有限公司 | Screen transmission method and electronic equipment |
| CN103226458A (en) * | 2013-05-09 | 2013-07-31 | 上海斐讯数据通信技术有限公司 | Multi-screen display control method for intelligent mobile equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104978156A (en) | 2015-10-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104978156B (en) | Multi-screen display method and multi-screen display processing device | |
| US10635379B2 (en) | Method for sharing screen between devices and device using the same | |
| US10613701B2 (en) | Customizable bladed applications | |
| US10956008B2 (en) | Automatic home screen determination based on display device | |
| WO2021143182A1 (en) | Game processing method and apparatus, electronic device, and computer-readable storage medium | |
| US9720567B2 (en) | Multitasking and full screen menu contexts | |
| CN106569758B (en) | Wireless screen projection method and device | |
| CN107220020B (en) | Display method and electronic equipment | |
| US8890769B2 (en) | Display system and control method | |
| US20170285813A1 (en) | Touch-Input Support for an External Touch-Capable Display Device | |
| CN105045823A (en) | Method and device for generating demo file of mobile terminal based on screen capture | |
| JP2013246639A (en) | Electronic apparatus, control method, and control program | |
| TWI702843B (en) | Television system operated with remote touch control | |
| CN102857726A (en) | Remote control method, terminal, opposite terminal and system based on synchronous display | |
| US20140215347A1 (en) | Portable device and control method thereof | |
| US9326306B2 (en) | Interactive remote windows between applications operating within heterogeneous operating systems on mobile and stationary devices | |
| US20130060975A1 (en) | Assistive Buffer Usage Techniques | |
| CN113704517A (en) | Multimedia file playing method and device | |
| JP2008040347A (en) | Image display device, image display method, and image display program | |
| KR20210001867A (en) | Display apparatus and the control method thereof | |
| CN110430228A (en) | A method of it is operated by mobile terminal to equipment is calculated | |
| TWI527444B (en) | Video data displaying system and video data displaying method | |
| CN113722036A (en) | Application relay method and device | |
| Chen et al. | Design of a smart remote controller framework based on Android mobile devices | |
| CN114756695A (en) | Multimedia resource processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |