WO2018120533A1 - Multi-screen display method and apparatus - Google Patents

Multi-screen display method and apparatus Download PDF

Info

Publication number
WO2018120533A1
WO2018120533A1 PCT/CN2017/081457 CN2017081457W WO2018120533A1 WO 2018120533 A1 WO2018120533 A1 WO 2018120533A1 CN 2017081457 W CN2017081457 W CN 2017081457W WO 2018120533 A1 WO2018120533 A1 WO 2018120533A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
gui
task
instruction
display object
Prior art date
Application number
PCT/CN2017/081457
Other languages
French (fr)
Chinese (zh)
Inventor
陈晓晓
陈浩
胡佳佳
易辉
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201780003587.3A priority Critical patent/CN108323197B/en
Publication of WO2018120533A1 publication Critical patent/WO2018120533A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels

Definitions

  • the embodiments of the present invention relate to the field of terminal technologies, and in particular, to a method and a device for displaying multiple screens.
  • Some terminals on the market have a front touch screen in addition to a front touch screen.
  • some terminals with double-sided touch screens can display different or the same content on their double-sided touch screens.
  • the double-sided touch screens of the terminals are independent of each other, and there is no interaction, that is, the touch screens of different faces display different contents, and no new changes and breakthroughs are brought about in human-computer interaction.
  • the present application provides a multi-screen display method and device, which can implement interaction between multiple display screens of a multi-screen terminal, and improve user experience in the process of human-computer interaction.
  • the present application provides a method for displaying a multi-screen display, which can be applied to a multi-screen terminal, where the multi-screen terminal includes a first display panel and a second display panel, and the method for displaying the multi-screen can include:
  • the first display panel displays a first graphical user interface (GUI), the first GUI includes a presentation icon and a first display object of the second display panel, and acquires a first instruction input by the user on the first GUI.
  • GUI graphical user interface
  • the first instruction is an instruction triggered by the first operation of the user, and the first operation is a continuous sliding operation in which the starting point coordinate of the sliding track is the coordinate position of the second display object and the coordinate of the end point is the coordinate position of the presentation icon; a first instruction, displaying, on the second display panel, a second GUI including a second display object, the second display object including all images of the first display object, or the second display object including a partial image of the first display object, or
  • the first display object includes at least two child display objects, and the second display object is one of the at least two child display objects .
  • the multi-screen terminal may display the second display panel on the second display panel in response to the first instruction input by the user when the first display panel displays the first GUI including the first display object.
  • the displaying the second GUI including the second display object may include: displaying, on the first GUI displayed by the first display panel, a center point of the starting point coordinate in response to the first instruction An image selection window is displayed, and an image surrounded by the image selection window is displayed on the second display panel, wherein the image surrounded by the image selection window is the second display object.
  • the multi-screen terminal can display an image selection window centered on the starting point coordinate on the first GUI when the user's finger touches the starting point coordinate of the sliding track, and then the first display object, the image selection window The enclosed image is determined to be the second display object.
  • the image selection window may be a display window of a preset shape, and the image selection window does not block the image of the image selection window at the position in the first GUI.
  • the image selection window is movable in the first GUI.
  • the method of the embodiment of the present invention may further include: acquiring the user in the a second instruction input on the first GUI, the second instruction is an instruction for triggering the multi-screen terminal to move the image selection window on the first display panel; and in response to the second instruction, according to the second instruction
  • the indicated movement track displays a dynamically moving image selection window on the first GUI displayed by the first display panel, and displays a third GUI including the third display object on the second display panel.
  • the third display object is an image surrounded by the image selection window at an end point coordinate of the movement track.
  • the second instruction may be a drag command of the user to select a window for the image displayed on the first display panel.
  • the multi-screen terminal can dynamically display the image selection window on the first GUI in the first display panel according to the second instruction, according to the second instruction, so that the image selection window is surrounded by the first GUI.
  • the image may change, such that the multi-screen terminal may display different details of the first GUI to the user on the second display panel in response to the second instruction.
  • the multi-screen terminal may display the second GUI including the dynamically changing second display object in the second display to improve the user visual experience.
  • the “displaying the second GUI including the second display object in the second display panel” may include: displaying, on the second display panel, a dynamic that includes the second display object gradually increasing from small to large a second GUI of the image; or, according to a linear distance between the start point coordinate and the end point coordinate, displaying, on the second display panel, a second GUI including a second display object having a size corresponding to the straight line distance, wherein The longer the linear distance is, the larger the second display object in the second GUI is, or the longer the linear distance is, the smaller the second display object in the second GUI is.
  • the method method of the present application may further include: on the first display panel, in the multi-screen terminal, in response to the first instruction Highlight the second display Show object.
  • the present application further provides a multi-screen terminal, where the multi-screen terminal includes: a first display module, an acquisition module, and a second display module.
  • the first display module is configured to display a first GUI, where the first GUI includes a presentation icon and a first display object of the second display panel, and an acquiring module, configured to acquire a user at the first Displaying, by the module, the first instruction input on the first GUI, the first instruction is an instruction triggered by a first operation of the user, and the first operation is a coordinate of a starting point of the sliding track being a coordinate of the second display object
  • the position and the end point coordinate are a continuous sliding operation of the coordinate position of the presentation icon;
  • the second display module is configured to display a second GUI including the second display object in response to the first instruction,
  • the second display object includes all images of the first display object displayed by the first display module, or the second display object includes a partial image of the first display object, or the first display object includes At least two child display objects, the second display object being one of
  • the second display object includes a partial image of the first display object.
  • the first display module is configured to display an image selection window with the starting point coordinate as a center point on the first GUI in response to the first instruction acquired by the acquiring module.
  • the second display module is configured to display an image surrounded by the image selection window in response to the first instruction acquired by the acquisition module, where the image surrounded by the image selection window is the second Display object.
  • the acquiring module is further configured to: when the second display module is responsive to the first instruction, display, including the After displaying the second GUI of the object, acquiring a second instruction input by the user on the first GUI, where the second instruction is used to trigger the multi-screen terminal to move the image on the first display panel Select the instruction of the window.
  • the first display module is further configured to display a dynamically moving image selection window on the first GUI according to the movement trajectory indicated by the second instruction, in response to the second instruction acquired by the acquisition module.
  • the second display module is further configured to display a third GUI that includes the third display object in response to the second instruction acquired by the acquiring module.
  • the third display object is an image surrounded by the image selection window at an end point coordinate of the movement track.
  • the foregoing “the second display module, configured to display the second GUI that includes the second display object” may include: a second display module, configured to: display a second GUI that includes the dynamic image that the second display object is gradually enlarged from a small size; or, according to a linear distance between the start point coordinate and the end point coordinate, the display includes The second GUI of the second display object of the corresponding size of the straight line. The longer the linear distance is, the larger the second display object in the second GUI is, or the longer the linear distance is, the smaller the second display object in the second GUI is.
  • the first display module is further configured to: when the first instruction is highlighted, highlight the second display object.
  • the present application provides a multi-screen terminal including: a first display panel, a second display panel, a processor, and a memory.
  • the memory is for storing computer program code, the computer program code comprising instructions, when the processor executes the instruction, the multi-screen terminal performs the multi-screen display method according to the first aspect,
  • the first display panel and the second display panel display a GUI.
  • the first display panel is configured to display a first GUI
  • the first GUI includes a presentation icon and a first display object of the second display panel.
  • a processor configured to acquire a first instruction input by the user on the first GUI displayed by the first display panel, where the first instruction is an instruction triggered by a first operation of the user, and the first operation is The starting point coordinate of the sliding track is a continuous sliding operation in which the coordinate position of the second display object and the coordinates of the end point are the coordinate positions of the presentation icon.
  • a second display panel configured to display, in response to the first instruction, a second GUI including the second display object, the second display object including all images of the first display object, or the second
  • the display object includes a partial image of the first display object, or the first display object includes at least two sub-display objects, and the second display object is one of the at least two sub-display objects.
  • the second display object includes a partial image of the first display object.
  • the first display panel is further configured to display, on the first GUI, an image selection window centered on the starting point coordinate in response to the first instruction.
  • the “second display panel for displaying the second GUI including the second display object in response to the first instruction” may include: the second display panel, in response to the first instruction, An image surrounded by the image selection window is displayed. The image surrounded by the image selection window is the second display object.
  • the processor is further configured to display, in the second display panel, the first instruction, including the first After displaying the second GUI of the object, acquiring a second instruction input by the user on the first GUI, where the second instruction is used to trigger the multi-screen terminal to move the image on the first display panel Select the instruction of the window.
  • the first display panel is further configured to display a dynamically moving image selection window on the first GUI according to the movement trajectory indicated by the second instruction in response to the second instruction.
  • the second display panel is further configured to display a third GUI that includes the third display object in response to the second instruction.
  • the third display object is an image surrounded by the image selection window at an end point coordinate of the movement track.
  • the “second display panel for displaying the second GUI that includes the second display object” may include: a second display panel, configured to display a second GUI that includes a dynamic image in which the second display object is gradually enlarged from a small size; or a second display panel, configured to use a linear distance from the start point coordinate and the end point coordinate, Displaying, on the second display panel, a second GUI that includes a second display object of a size corresponding to the linear distance, wherein the longer the linear distance is, the larger the second display object in the second GUI is. Or the longer the linear distance, the smaller the second display object in the second GUI.
  • the first display panel is further configured to highlight the second display object in response to the first instruction.
  • the first display module described in the second aspect of the present application is the first display panel of the first aspect and the third aspect
  • the second display module of the second aspect is the first aspect and the third aspect The second display panel.
  • the present application provides a computer storage medium, comprising: computer instructions, when the computer instruction is run on a multi-screen terminal, causing the multi-screen terminal to perform the first aspect or the first aspect A method of multi-screen display as described in any of the possible implementations.
  • the present application further provides a computer program product, when the computer program product is run on a computer, causing the computer to perform the above-described first aspect of the present application or any of the possible implementation manners of the first aspect Multi-screen display method.
  • the multi-screen terminal according to the second aspect, the multi-screen terminal of the third aspect, the computer storage medium of the fourth aspect, or the computer program product of the fifth aspect are all used for execution.
  • the corresponding methods provided above, and therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding methods provided above, and are not described herein again.
  • the present application provides a multi-screen display method, which can be applied to a multi-screen terminal, where the multi-screen terminal includes a first display panel and a second display panel, and the multi-screen display method can include: The display panel displays a first GUI including a first display object, the first display object is a display object in the first display task, and the first display task is a display task added to the first task window at a first time; The second display panel displays a second GUI including a second display object, the second display object is a display object in the second display task, the second display task is a display task in the second task window; acquiring the user in the first GUI a first instruction inputting, the first instruction is used to trigger the multi-screen terminal to display a GUI including a first display object currently displayed by the first display panel on the second display panel; and displayed on the second display panel in response to the first instruction A third GUI including the first display object is displayed, and a fourth GUI including the third display object is displayed on the first display panel.
  • the third display object is a display object corresponding to the third display task, and the third display task is added to the display task in the first task window at a second time, the second time is earlier than the first time, and the second time The time is later than the addition time of other display tasks in the first task window; or, the third display object is a preset display object.
  • two independent task windows can be set in the multi-screen terminal, and each task window corresponds to one display panel, for example, the first display panel is used to display the latest added in the first task window.
  • the GUI corresponding to the task is displayed, and the second display panel is configured to display a GUI corresponding to the newly added amount display task in the second task window.
  • the multi-screen terminal can display the GUI including the first display object currently displayed by the first display panel in the second display panel by switching the display task in the two task windows, and display the second display on the first display panel.
  • the GUI of the second display object currently displayed by the panel that is, the interaction between the two display screens of the multi-screen terminal can be realized, and the user experience in the process of human-computer interaction can be improved.
  • the foregoing first GUI may also include The icon of the second task window mentioned above.
  • the first instruction may be an instruction triggered by the first operation of the user, where the first operation is that the starting point coordinate of the sliding track is the coordinate position of the first display object, and the terminal coordinate is the coordinate position of the icon of the second task window. a sliding operation, the first instruction is used to instruct the multi-screen terminal to add the first display task to the second task window.
  • the first task window, the second GUI, the third GUI, and the fourth GUI may further include a first task window. Icon and second task window icon.
  • the multi-screen terminal may display a GUI including a dynamic image of the first display object on the first display panel and the second display panel.
  • the GUI may include: displaying, in response to the first instruction, a third GUI including the first dynamic image on the second display panel, and displaying a fourth GUI including the second dynamic image on the first display panel.
  • the first dynamic image is a dynamic image in which the first display object moves according to a first preset movement trajectory, and the first display object gradually increases from small to small during the movement, the first preset The starting point coordinate of the moving track is the coordinate position of the icon of the first task window in the third GUI, and the end point coordinate of the first preset moving track is used to display the display object in the third GUI.
  • a coordinate position the second dynamic image is a dynamic image in which the third display object moves according to a second preset movement trajectory, and the third display object gradually becomes larger during the movement, the second pre- The starting point coordinate of the moving track is the coordinate position of the icon of the first task window in the fourth GUI, and the end point coordinate of the second preset moving track is used to display the display object in the fourth GUI.
  • the coordinate position is a dynamic image in which the first display object moves according to a first preset movement trajectory, and the first display object gradually increases from small to small during the movement, the first preset The starting point coordinate of the moving track is the coordinate position of the icon of the
  • the user can determine the first display currently displayed by the first display panel.
  • the object is a display object corresponding to the display task of the first display panel, and is not a display object corresponding to the display task switched from the second display panel.
  • the starting point coordinate of the movement track of the first display object displayed on the second display panel by the second display panel is an icon of the first task window instead of the icon of the second task window; therefore, the user can determine the second display panel
  • the currently displayed first display object is not a display object corresponding to the display task of the second display panel, but a display object corresponding to the display task switched from the first display panel.
  • the display object is presented to the user in a dynamic manner, and the visual experience of the user can be improved.
  • the method of the present application further The method may include: acquiring a second instruction input by the user, where the second instruction is an instruction for triggering the multi-screen terminal to open the first application, where the first GUI is an interface of the first application;
  • the first GUI of the first display object may include: displaying, in the first display panel, a first GUI including the first display object in response to the second instruction.
  • the second instruction is further configured to trigger the multi-screen terminal to display the first on the first display panel.
  • the GUI, or the first display panel is a pre-configured display panel for displaying an interface of the first application.
  • the first task window is a first window stack, where the first window stack is used to save the press in accordance with the principle of advanced output a display task of the first window stack, the first display panel is configured to display a GUI corresponding to a display task of a stack top of the first window stack.
  • the second task window is a second window stack, and the second window stack is configured to save a display task pressed into the second window stack according to the principle of advanced output, and the second display panel is configured to display the top of the second window stack The GUI that displays the task.
  • the first display panel is configured to display a GUI corresponding to the display task of the top of the stack of the first window stack
  • the second display panel is configured to display a GUI corresponding to the display task of the top of the stack of the second window stack; therefore, the multi-screen terminal
  • the second display may be performed by stacking the display task of the top of the first window stack (ie, the first display task) from the first window stack and pushing the first display task onto the top of the second window stack.
  • the panel displays the GUI corresponding to the first display task, that is, the interaction between the first display panel and the second display panel can be implemented, and the interaction process between the first display panel and the second display panel can be simplified.
  • the application provides a multi-screen terminal, where the multi-screen terminal includes: a first display module, a second display module, and an acquisition module.
  • the first display module is configured to display a first user graphical interface GUI including a first display object, where the first display object is a display object in the first display task, and the first display task is added at a first time To the display task in the first task window.
  • the second display module is configured to display a second GUI that includes a second display object, the second display object is a display object in the second display task, and the second display task is a display task in the second task window.
  • An acquiring module configured to acquire a first instruction input by the user on the first GUI displayed by the first display module, where the first instruction is used to trigger the second display module to display the first display The GUI of the first display object currently displayed by the module.
  • the second display module is further configured to display a third GUI that includes the first display object in response to the first instruction acquired by the acquiring module.
  • the first display module is further configured to display a fourth GUI that includes the third display object in response to the first instruction acquired by the acquiring module.
  • the third display object is a display object corresponding to the third display task, and the third display task is a display task added to the first task window at a second time, the second time is earlier than the The first time, and the second time is later than the addition time of the other display tasks in the first task window; or the third display object is a preset display object.
  • the first GUI may further include an icon of the second task window.
  • the first instruction is an instruction triggered by a first operation of the user, where the first operation is that the coordinate of the starting point of the sliding track is the coordinate position of the first display object, and the coordinates of the terminal are the coordinates of the icon of the second task window. a continuous sliding operation of the location, the first instruction being used to instruct the multi-screen terminal to add the first display task to the second task window.
  • the foregoing first GUI, the second GUI, the third GUI, and the fourth GUI may further include an icon of the first task window and The icon for the second task window.
  • the “second display module, in response to the first instruction acquired by the acquiring module, displaying the third GUI including the first display object” may include: The second display module is configured to display a third GUI that includes the first dynamic image in response to the first instruction.
  • the “first display module, configured to display the fourth GUI including the third display object in response to the first instruction acquired by the acquisition module” may include: the first display module, configured to respond to the The first instruction displays a fourth GUI including the second dynamic image.
  • the acquiring module is further configured to acquire a user input before the first display module displays the first GUI.
  • a second instruction where the second instruction is an instruction for triggering the multi-screen terminal to open the first application, where the first GUI is an interface of the first application.
  • the “first display module, for displaying the first GUI” may include: the first display module, configured to display, according to the second instruction acquired by the acquiring module, a first display object A GUI.
  • the present application provides a multi-screen terminal, including: a first display panel, a second display panel, a processor, and a memory.
  • the memory is for storing computer program code, the computer program code comprising instructions, when the processor executes the instruction, the multi-screen terminal performs the multi-screen display method according to the sixth aspect,
  • the first display panel and the second display panel display a GUI.
  • the first display panel is configured to display a first user graphical interface GUI including a first display object, the first display object is a display object in the first display task, and the first display task is first Time is added to the display task in the first task window.
  • a second display panel configured to display a second GUI that includes a second display object, the second display object is a display object in the second display task, and the second display task is a display task in the second task window.
  • a processor configured to acquire a first instruction input by the user on the first GUI, where the first instruction is used to trigger the multi-screen terminal to display on the second display panel, including the current display of the first display panel The GUI of the first display object.
  • a second display panel configured to display a third GUI including the first display object in response to the first instruction.
  • the first display panel is configured to display a fourth GUI including the third display object in response to the first instruction.
  • the first GUI may further include an icon of the second task window.
  • the first instruction is an instruction triggered by the first operation of the user, where the first operation is that the starting point coordinate of the sliding track is the coordinate position of the first display object, and the terminal coordinate is the coordinate position of the icon of the second task window. a continuous sliding operation, the first instruction being used to instruct the multi-screen terminal to add the first display task to the second task window.
  • the first GUI, the second GUI, the third GUI, and the fourth GUI may further include the first task window. Icon and icon of the second task window.
  • the “second display panel for displaying the third GUI including the first display object in response to the first instruction” may include: the second display panel, configured to display in response to the first instruction A third GUI including the first dynamic image.
  • the “first display panel for displaying the fourth GUI including the third display object in response to the first instruction” may include: the first display panel for displaying the fourth GUI including the second dynamic image.
  • the foregoing processor may be further configured to display, by the first display panel, the first display object Before the first GUI, the second instruction input by the user is obtained, where the second instruction is an instruction for triggering the multi-screen terminal to open the first application, and the first GUI is an interface of the first application.
  • the third display object, the first dynamic image, the second dynamic image, the first task window, and the second task described in the seventh aspect and the eighth aspect of the present application or any one of the possible implementation manners of the present application For a detailed description of the window, reference may be made to related content in the sixth aspect, which is not described herein again.
  • the first display module described in the seventh aspect of the present application is the first display panel according to the sixth aspect and the eighth aspect
  • the second display module in the seventh aspect is the sixth aspect and the eighth aspect The second display panel.
  • the present application provides a computer storage medium, comprising: computer instructions, when the computer instruction is run on a multi-screen terminal, causing the multi-screen terminal to perform the sixth or sixth aspect A method of multi-screen display as described in any of the possible implementations.
  • the present application further provides a computer program product, when the computer program product is run on a computer, causing the computer to perform the above-mentioned sixth aspect of the present application or any of the possible implementation manners of the sixth aspect Multi-screen display method.
  • the multi-screen terminal according to the seventh aspect of the present invention the multi-screen terminal of the eighth aspect, the computer storage medium of the ninth aspect, or the computer program product of the tenth aspect are all used for execution.
  • the corresponding methods provided above, and therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding methods provided above, and are not described herein again.
  • the eleventh aspect provides a method for displaying a multi-screen display, which can be applied to a multi-screen terminal, where the multi-screen terminal includes a first display panel and a second display panel, and the method for displaying the multi-screen can include: Displaying a first GUI, the first GUI includes a first display object, and acquiring a first instruction input by the user, where the first instruction is used to trigger the multi-screen terminal to display the same as the first display panel in the second display panel. Displaying an object; in response to the first instruction, displaying a second GUI on the second display panel, wherein the second GUI includes the first display object.
  • the multi-screen terminal may display the same display object as the first display panel in the second display panel in response to the first instruction, that is, the two display screens of the multi-screen terminal may interact with each other instead of being independent of each other, Can improve the user experience in the process of human-computer interaction.
  • a twelfth aspect provides a multi-screen terminal, where the multi-screen terminal can include: a first display module, an acquisition module, and a second display module.
  • the first display module is configured to display a first user graphical interface GUI, and the first GUI includes a first display object.
  • an acquiring module configured to acquire a first instruction input by the user, where the first instruction is used to trigger the multi-screen terminal to display the same display object as the first display module in the second display module.
  • a second display module configured to display a second GUI, where the second GUI includes the first display object, in response to the first instruction acquired by the acquiring module.
  • the present application provides a multi-screen terminal, including: a first display panel, a second display panel, a processor, and a memory.
  • the memory is for storing computer program code, the computer program code comprising instructions, when the processor executes the instruction, the multi-screen terminal performs the multi-screen display method according to the sixth aspect, First display panel and said The second display panel displays the GUI.
  • the first display panel is configured to display a first GUI
  • the first GUI includes a first display object
  • the processor is configured to acquire a first instruction input by a user, where the first instruction is used to trigger a
  • the multi-screen terminal displays the same display object as the first display panel on the second display panel.
  • a second display panel configured to display a second GUI, where the second GUI includes the first display object, in response to the first instruction acquired by the processor.
  • the first display module of the twelfth aspect of the present invention is the first display panel of the eleventh aspect and the twelfth aspect, wherein the second display module of the twelfth aspect is the eleventh Aspect and the second display panel of the twelfth aspect.
  • the present application provides a computer storage medium, comprising: computer instructions, when the computer instruction is run on a multi-screen terminal, causing the multi-screen terminal to perform the eleventh or tenth A method of multi-screen display as described in any of the possible implementations of the aspect.
  • the present application further provides a computer program product, when the computer program product is run on a computer, causing the computer to perform any one of the possible implementation manners of the eleventh or eleventh aspect of the present application.
  • the method of multi-screen display is not limited to:
  • the multi-screen terminal according to the twelfth aspect, the multi-screen terminal according to the thirteenth aspect, the computer storage medium of the fourteenth aspect, or the computer program product of the fifteenth aspect are used to perform the corresponding methods provided above, and therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding methods provided above, and are not described herein again.
  • FIG. 1 is a schematic structural diagram of a double-sided touch screen of a dual-screen terminal according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a front and back structure of a mobile phone according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a hardware of a mobile phone according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram 1 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram 2 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention
  • FIG. 6 is a schematic diagram 3 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention
  • FIG. 7 is a schematic diagram 4 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention.
  • FIG. 8 is a flowchart 1 of a method for displaying multi-screen according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram 5 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram 6 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention
  • FIG. 11 is a schematic diagram 7 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention.
  • FIG. 12 is a flowchart 2 of a method for displaying multi-screen according to an embodiment of the present invention.
  • FIG. 13 is a schematic diagram 8 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention.
  • FIG. 14 is a flowchart 3 of a method for displaying a multi-screen according to an embodiment of the present invention.
  • FIG. 15 is a schematic diagram 9 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention.
  • FIG. 16 is a flowchart 4 of a method for displaying multi-screen according to an embodiment of the present invention.
  • FIG. 17 is a schematic diagram 10 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention.
  • FIG. 18 is a schematic diagram 11 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention.
  • FIG. 19 is a flowchart 5 of a method for displaying multi-screen according to an embodiment of the present invention.
  • 20 is a schematic diagram 12 of a graphical user interface displayed by a multi-screen terminal according to an embodiment of the present invention
  • FIG. 21 is a schematic diagram of an example of a task window according to an embodiment of the present invention.
  • FIG. 22 is a schematic diagram of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention.
  • FIG. 23 is a schematic diagram showing a graphical user interface of a multi-screen terminal according to an embodiment of the present invention.
  • FIG. 24 is a schematic diagram of an example of a window stack according to an embodiment of the present invention.
  • 25 is a schematic diagram of a graphical user interface displayed by a multi-screen terminal according to an embodiment of the present invention.
  • FIG. 26 is a schematic structural diagram 1 of a multi-screen terminal according to an embodiment of the present disclosure.
  • FIG. 27 is a schematic structural diagram 2 of a multi-screen terminal according to an embodiment of the present invention.
  • the embodiment of the present invention provides a method for displaying a multi-screen display, which can be applied to a multi-screen terminal, and can be specifically applied to a process in which multiple touch screens of a multi-screen terminal interactively display respective display contents.
  • the multi-screen terminal in the embodiment of the present invention may include multiple touch screens, which may display the same or different display content respectively.
  • the multi-screen terminal may be a dual-screen terminal, and the dual-screen terminal may include an A-side touch screen and a B-side touch screen.
  • the A-side touch screen and the B-side touch screen of the dual-screen terminal may be touch screens connected in the same physical attachment and in both forward and reverse directions; or, as shown in FIG. 1b,
  • the A-side touch screen and the B-side touch screen of the dual-screen terminal may be touch screens that are respectively connected to different physical accessories and present in both directions.
  • the A-side touch screen may be a front touch screen, and the B-side touch screen may be a reverse touch screen; or the A-side touch screen may be a reverse touch screen, and the B-side touch screen may be a front touch screen.
  • the direction indicated by the arrow in Fig. 1 is opposite to the display surface of the touch screen (A side touch screen or B side touch screen).
  • FIG. 1 only gives the setting manner of the A-side touch screen and the B-side touch screen of the dual-screen terminal by way of example, and the setting manners of the A-side touch screen and the B-side touch screen of the dual-screen terminal do not include but are not limited to those shown in FIG. 1 .
  • Setting method the A-side touch screen may be a front touch screen of a dual-screen terminal, and the B-side touch screen may be disposed at a side of the dual-screen terminal.
  • the specification parameters of the A-side touch screen and the specification parameters of the B-side touch screen may be the same or different.
  • the specification parameters of the touch screen may include: physical dimensions, resolution, model and other parameters of the touch screen.
  • the multi-screen terminal in the embodiment of the present invention may be various devices having a wireless communication function.
  • the multi-screen terminal may be a wearable electronic device (such as a smart watch or the like) having a wireless communication function, or may be
  • the mobile phone 300 shown in FIG. 3 may also be a tablet computer or the like.
  • the following embodiments do not specifically limit the specific form of the mobile device.
  • the mobile device in this embodiment may be the mobile phone 300.
  • 2a and 2b are schematic diagrams of the appearance of the mobile phone 300.
  • FIG. 2a is a front view of the mobile phone 300
  • FIG. 2b is a rear view of the mobile phone 300.
  • the embodiment will be specifically described below by taking the mobile phone 300 as an example.
  • the illustrated mobile phone 300 is merely an example of a mobile device, and the mobile phone 300 may have more or fewer components than those shown in the figures, two or more components may be combined, or Has a different component configuration.
  • the various components shown in FIG. 3 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
  • the mobile phone 300 includes an RF (Radio Frequency) circuit 310, a memory 320, an input unit 330, a display unit 340, a sensor 350, an audio circuit 360, a Wi-Fi module 370, a processor 380, and a power supply. 390 and other components.
  • RF Radio Frequency
  • the structure of the handset shown in FIG. 3 does not constitute a limitation to the handset, and may include more or less components than those illustrated, or some components may be combined, or different component arrangements.
  • the components of the mobile phone 300 will be specifically described below with reference to FIG. 3:
  • the RF circuit 310 can be used for transmitting and receiving information or during a call, and receiving and transmitting signals.
  • the downlink information of the base station can be received and processed by the processor 380.
  • the data related to the uplink is sent to the base station.
  • RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
  • RF circuitry 310 can also communicate with the network and other mobile devices via wireless communication.
  • the wireless communication can use any communication standard or protocol, including but not limited to global mobile communication systems, general packet radio services, code division multiple access, wideband code division multiple access, long term evolution, email, short message service, and the like.
  • Memory 320 can be used to store software programs and data.
  • the processor 380 executes various functions of the mobile phone 300 and data processing by running software programs and data stored in the memory 320.
  • the memory 320 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to The data created by the use of the mobile phone 300 (such as audio data, phone book, etc.) and the like.
  • memory 320 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the memory 320 stores an operating system that enables the mobile phone 300 to operate, such as that developed by Apple. Operating system, developed by Google Inc. Open source operating system, developed by Microsoft Corporation Operating system, etc.
  • Input unit 330 can be used to receive input numeric or character information, as well as to generate signal inputs related to user settings and function control of handset 300.
  • the input unit 330 may include a first touch panel 331 disposed on the front surface of the mobile phone 300.
  • the first touch panel 331 is also referred to as a first touch screen, and may collect touch operations on or near the user (such as user use).
  • a suitable object or accessory such as a finger or a stylus is operated on the first touch panel 331 or in the vicinity of the first touch panel 331, and the corresponding connecting device is driven according to a preset program.
  • the first touch panel 331 may include two parts (not shown) of the touch detection device and the touch controller.
  • the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 380 is provided and can receive instructions from the processor 380 and execute them.
  • the first touch panel 331 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the input unit 330 may further include a second touch panel 332 (also referred to as a second touch screen) disposed on the back of the mobile phone 300 , that is, the first touch panel 331 and the second touch panel 332 are disposed.
  • the second touch panel 332 can also adopt the same structure as the first touch panel 331 described above, and details are not described herein again.
  • the display unit 340 (i.e., display screen) can be used to display information input by the user or information provided to the user and a GUI of various menus of the mobile phone 300.
  • the display unit 340 may include a first display panel 341 (also referred to as a first display screen) disposed on the front of the mobile phone 300 and a second display panel 342 (also referred to as a second display screen) disposed on the back of the mobile phone 300. That is, the first display panel 341 and the second display panel 342 are disposed on opposite sides of the mobile phone 300.
  • the first display panel 341 can be configured in the form of a liquid crystal display, a light emitting diode, or the like; the second display panel 342 can be a screen made of an electronic ink display or other low-power display material, such as an electronic ink screen, so that The second display panel 342 is used to read e-books, magazines, and the like. Of course, the second display panel 342 can also adopt the same display material as the first display panel 341.
  • the mobile phone 300 includes a front side A and a back side B; at the bottom of the front side A, three optical touch buttons 201, 202, 203 may be disposed; and a first touch panel 331 is further disposed. And the first display panel 341, the first touch panel 331 is overlaid on the first display panel 341. When the first touch panel 331 detects a touch operation on or near it, it is transmitted to the processor 380 to determine a touch event, and then the processor 380 provides a corresponding visual output on the first display panel 341 according to the type of the touch event. .
  • the first touch panel 331 and the first display panel 341 are used as two independent components to implement the input and input functions of the mobile phone 300 in FIG. 3, in some embodiments, the first touch panel may be used.
  • the first display panel 341 is integrated with the first display panel 341 to implement the input and output functions of the mobile phone 300.
  • the integrated first touch panel 331 and the first display panel 341 may be simply referred to as the first touch screen 401.
  • a second touch panel 332 and a second display panel 342 are disposed, and the second touch panel 332 is overlaid on the second display panel 342.
  • the functions of the second touch panel 332 and the second display panel 342 are similar to those of the first touch panel 331 and the first display panel 341.
  • the second touch panel 332 and the second display panel 342 can be integrated to implement the input and output functions of the mobile phone 300, and the integrated second touch panel 332 and the The second display panel 342 may be simply referred to as the second touch screen 402.
  • the first touch panel 331 and the second touch panel 332 may further be provided with a pressure sensing sensor, so that when the user performs a touch operation on the touch panel, the touch panel can also detect the touch panel.
  • the pressure of the touch operation, and thus the mobile phone 300, can detect the touch operation more accurately.
  • the handset 300 can also include at least one sensor 350, such as a light sensor, motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein, as shown in FIG. 2a, the ambient light sensor 351 may adjust the brightness of the first display panel 341 and/or the second display panel 342 according to the brightness of the ambient light.
  • the proximity light sensor 352 is disposed on the front surface of the mobile phone 300. When the mobile phone 300 is moved to the ear, the mobile phone 300 turns off the power of the first display panel 341 according to the detection of the proximity light sensor 352, and may also close the second display panel 342 at the same time. Power, so the phone 300 can further save power.
  • the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the mobile phone 300 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.
  • the audio circuit 360, the speaker 361, and the microphone 362 can provide an audio interface between the user and the handset 300.
  • the audio circuit 360 can transmit the converted electrical data of the received audio data to the speaker 361 for conversion to the sound signal output by the speaker 361; on the other hand, the microphone 362 converts the collected sound signal into an electrical signal, by the audio circuit 360. After receiving, it is converted into audio data, and the audio data is output to the RF circuit 310 for transmission to, for example, another mobile phone, or the audio data is output to the memory 320 for further processing.
  • Wi-Fi is a short-range wireless transmission technology.
  • the mobile phone 300 can help users to send and receive emails, browse web pages, and access streaming media through the Wi-Fi module 370, which provides users with wireless broadband Internet access.
  • the processor 380 is a control center of the mobile phone 300, and connects various parts of the entire mobile phone by using various interfaces and lines, and executes the mobile phone 300 by running or executing a software program stored in the memory 320 and calling data stored in the memory 320. A variety of functions and processing data to monitor the phone as a whole.
  • processor 380 can include one or more processing units; processor 380 can also integrate an application processor and a modem processor, where the application processor primarily processes operating systems, user interfaces, applications, and the like The modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 180.
  • the Bluetooth module 381 is configured to perform information interaction with other devices through a short-range communication protocol such as Bluetooth.
  • the mobile phone 300 can establish a Bluetooth connection through a Bluetooth module 381 and a wearable electronic device (such as a smart watch) that also has a Bluetooth module, thereby performing data interaction.
  • the handset 300 also includes a power source 390 (such as a battery) that powers the various components.
  • the power supply can be logically coupled to the processor 380 through a power management system to manage functions such as charging, discharging, and power consumption through the power management system. It can be understood that in the following embodiments, the power supply 390 can be packaged. Two power supplies are used to supply power to the first display panel 341 and the first touch panel 331 , and the other power source is mainly used to supply power to the second display panel 342 and the second touch panel 332 .
  • the mobile phone 300 may further include a front camera 353, a rear camera 354, and the like, and details are not described herein again.
  • the first touch screen of the mobile phone 300 (such as the front touch screen) and the second touch screen (the touch screen of the mobile phone 300 except the front touch screen) may respectively display the same or different display contents.
  • the first touch screen and the second touch screen may serve as display interfaces of different applications or clients, or the first touch screen and the second touch screen may serve as the same application or a display interface of the client for displaying the same in the display interface of the application or the client.
  • Content or different content may be used to display contents.
  • the display interface may be a GUI; and the GUI includes a graphic option in the form of a text and an icon, and the graphical option in the form of the GUI text and the graphical option in the form of an icon may be used by the user through the touch screen (ie, the touch screen) or Other input devices (such as physical buttons) operate.
  • the GUI is a display interface in a terminal (such as a mobile phone) displayed in a graphical manner; the graphic options in the GUI may include a form of text and an icon, and the graphics are operable by the user, and the user sees and operates in the GUI.
  • the GUI is a display format of a display interface in which the user communicates with the terminal (such as a mobile phone), and allows the user to manipulate an option in the form of an icon or a text form on the touch screen through an input unit such as a touch screen to execute a command or call a file. , start a program, etc. or perform some other daily tasks.
  • the above GUI includes a window, a drop down menu, a dialog box and its corresponding control mechanism (such as the CPU of the terminal).
  • the GUI is standardized in a variety of new applications, that is, the same operation is always done in the same way; for example, any graphic form or icon form graphic option (hereinafter referred to as an option) in the GUI.
  • the operation can be that the user clicks on the option through the touch screen.
  • the embodiment of the present invention proposes a "mirror image” based on the "single screen mode” and the “independent mode” of the existing multi-screen terminal. "Display mode” and “demo mode” display modes, and extended “independent mode”.
  • the multi-screen terminal 300 can display various applications on the first touch screen thereof.
  • the icon (such as icon 403 represents the system application "Settings") and displays a predefined image on its second touch screen 402, such as "Hello, World”.
  • the second touch screen 402 of the multi-screen terminal 300 may be in a closed state or a standby state.
  • the user may also select the second touch screen 402 as the main working screen of the multi-screen terminal 300, and the first touch screen 401 serves as the auxiliary working screen of the multi-screen terminal 300.
  • the second touch screen 402 is used as the main working screen, and when the first touch screen 401 is used as the auxiliary working screen, the first For the control mode, the display mode, and the display content of the touch screen 401 and the second touch screen 402, reference may be made to the related description when the first touch screen 401 is used as the main working screen, and the second touch screen 402 is used as the auxiliary working screen, and details are not described herein again.
  • the user can apply the touch operation of the “Settings” icon 403 to the system shown in FIG. 2a to enter the “Double Screen Mode Selection” interface.
  • the first touch panel 331 of the multi-screen terminal 300 detects it or The nearby touch event is transmitted to the processor 380 to determine an instruction corresponding to the touch event, and then the processor 380 calls the system application "set” stored in the memory 320 according to the instruction, and displays the system on the first display panel 341.
  • Apply the GUI of "Settings” which displays the GUI as shown in Figure 4b.
  • the first touch panel 331 detects the touch event on or near it, and transmits it to the processor 380. Determining an instruction corresponding to the touch event, and then the processor 380 calls the "dual screen mode selection" application stored in the memory 320 according to the instruction, and displays the GUI of the "dual screen mode selection” application on the first display panel 341. Assuming that the current display mode of the multi-screen terminal 300 is "single screen mode", the first display panel 341 can display the GUI as shown in FIG. 4c. As shown in FIG. 4c, a "dual screen mode selection" menu 408 can be displayed on the first display panel 341.
  • the user can enter the "dual screen mode selection" interface through a pre-configured shortcut key.
  • a trigger operation command may be generated, and then the processor 380 may The trigger operation instruction invokes the "dual screen mode selection” application stored in the memory 320, and displays the GUI of the "dual screen mode selection” application on the first display panel 341, assuming that the current display mode of the multi-screen terminal 300 is "single screen” Mode", then the first display panel 341 can display the GUI as shown in FIG.
  • the multi-screen terminal 300 can respond to the touch event of the user on the first touch panel and/or the second touch panel, or the button event of the user to the physical key of the multi-screen terminal 300, from the “single screen mode”.
  • a default display mode is set in the four display modes of "independent mode", "mirror mode” and "demo mode". For example, as shown in FIG. 4c or FIG. 5, the default display mode of the multi-screen terminal 300 may be "single screen mode".
  • the multi-screen terminal provided by the embodiment of the present invention can also support different response modes, such as a first response mode (ie, a first touch panel response mode) and a second response mode. (ie, the second touch panel response mode), the dual screen response mode, and the partial response mode (ie, the second touch panel partial response mode).
  • a first response mode ie, a first touch panel response mode
  • a second response mode ie, the second touch panel response mode
  • the dual screen response mode ie, the second touch panel partial response mode
  • the multi-screen terminal can block the touch event of the user on the second touch panel in response to the user's touch event on the first touch panel.
  • the multi-screen terminal can respond to the user's touch event on the fingerprint recognition area of the second touch panel, and shield the user from fingerprint recognition on the second touch panel. Touch events from other areas outside the area.
  • the multi-screen terminal can respond to the user's touch on the second touch panel.
  • the event shields the user from the touch event of the first touch panel.
  • the multi-screen terminal can respond to the user's touch event to the second touch panel and only respond to the user's touch event on the three optical touch buttons 201, 202, 203 on the first touch panel, and shield the user from the first Touch events on the touch panel other than the above three optical touch buttons 201, 202, 203.
  • the multi-screen terminal can respond to the user's touch event to the first touch panel, and can respond to the user's touch event to the second touch panel; or the multi-screen terminal can set the user to the first touch
  • the touch event of the control panel and the user's touch event to the second touch panel are combined to respond as an overall input.
  • the multi-screen terminal can block the touch event of the user on the second touch panel except for the partial area in response to the touch event of the user on the partial area of the second touch panel, and block the touch event.
  • the user's touch event on the first touch panel may be an area on the second touch panel including the fingerprint recognition area.
  • the multi-screen terminal can respond to a part of the touch event of the second touch panel by the user, and shield the user from other touch events on the second touch panel except the part of the touch event, and respond to the user's touch on the first touch panel. Touch the event.
  • the partial touch event may be a preset touch event.
  • the partial touch event may be a single click event of the second touch panel, multiple consecutive click events of the user to the second touch panel within a predetermined time, and dragging of the user on the second touch panel. Any event or combination of events of events, long press events on the second touch panel, and the like.
  • the multi-screen terminal provided by the embodiment of the present invention can support the first response mode, that is, the first touch panel response mode.
  • the multi-screen terminal can support the first response mode, and the GUI corresponding to the touch event detected by the first touch panel is displayed on the first display panel; and the multi-screen terminal can also support the second response.
  • the mode ie, the second touch panel response mode
  • the "mirror mode” is taken as an example here, when the user's finger touches or approaches the "mirror mode” option in the “dual screen mode selection” menu 408 displayed on the first display panel 341 in FIG. 4c, Or when the user's finger touches or approaches the pull-down flag 502 of the "mirror mode” option in the “dual-screen mode selection” menu 408 on the first display panel 341 in FIG. 4c, the first touch panel 331 detects thereon. The nearby touch event is transmitted to the processor 380 to determine an instruction corresponding to the touch event, and then the processor 380 can invoke the "mirror mode” application stored in the memory 320 according to the instruction, and in the first display panel 341. The GUI of the "mirror mode” application is displayed, the response mode selection window 503 of the "mirror mode” is expanded, and the GUI as shown in FIG. 6 is displayed.
  • the multi-screen terminal 300 can respond to the touch event of the user on the first touch panel and/or the second touch panel, or the button event of the user to the physical key of the multi-screen terminal 300, from the “first response mode”.
  • a default response mode is set in the four response modes of "second response mode", "two-screen response mode” and "partial response mode".
  • the default display mode of the multi-screen terminal 300 may be "first response mode.”
  • the multi-screen terminal may not display as shown in FIG. 6.
  • the response mode of the illustrated "mirror mode” selects the window 503, but directly determines that the current response mode is the default response mode, such as the first response mode.
  • the response mode of the "mirror mode" is taken as an example of the first response mode, and the method for displaying the multi-screen provided by the embodiment of the present invention is illustrated as follows:
  • the multi-screen terminal 300 can control its second display panel 342 to continue to display a predefined image, such as "Hello, "World”.
  • the auxiliary work screen of the multi-screen terminal can display the same content as the main work screen, that is, the multi-screen terminal can perform the multi-screen display method as shown in FIG. 8, and is executed as shown in FIG.
  • a GUI as shown in FIG. 7b-1 is displayed on its first display panel 341
  • a GUI as shown in FIG. 7b-2 is displayed on its second display panel 342.
  • the method for displaying multiple screens provided by the embodiment of the present invention may include S801-S802:
  • the multi-screen terminal acquires a first instruction input by the user, and enters a mirroring mode in response to the first instruction.
  • the first finger may be a touch operation instruction for the user to the “mirror mode” option, and the first instruction is used to trigger the multi-screen terminal to display all the first GUIs currently displayed by the first display panel on the second display panel. image.
  • a user's touch operation command to the "mirror mode” option may be generated by the user in FIG. 7a-1 touching or touching the "mirror mode” option displayed in the "dual screen mode selection” menu 408 on the first display panel 341. Operation instructions.
  • the multi-screen terminal displays a first GUI on the first display panel, where the first GUI includes a first display object.
  • the multi-screen terminal can obtain an application startup instruction input by the user, and display the GUI of the application (ie, the first GUI) on the first display panel in response to the application startup instruction.
  • the application startup command may be used to trigger a multi-screen terminal to display a GUI of the application on the first display panel, or the first display panel is a pre-configured display panel for displaying an interface of the application.
  • S801 may be executed first, and then S802 is executed, that is, the multi-screen terminal may display the first GUI on the first display panel after entering the mirror mode; or may execute S802 first, and then execute S801, that is, multiple screens may be performed.
  • the terminal may enter the mirror mode after the first GUI is displayed on the first display panel.
  • the embodiment of the present invention does not limit the sequence of executing S801 and S802.
  • the multi-screen terminal acquires the first display object in the first GUI displayed by the first display panel.
  • the display screen where the first display panel is located is the main working screen of the multi-screen terminal.
  • the first display object can be all of the images in the first GUI.
  • the multi-screen terminal determines whether the resolution of the first display panel is the same as the resolution of the second display panel.
  • the table The second display panel can directly display the second GUI (ie, the first GUI) according to the resolution of the first display panel, and then can continue to execute S806; if the resolution of the first display panel is different from the resolution of the second display panel, It means that the second display panel cannot directly display the first GUI according to the resolution of the first display panel, but needs to perform resolution conversion, and then can continue to execute S805-S806:
  • the multi-screen terminal renders the first display object in the first GUI according to the resolution of the second display panel, to obtain a second GUI that includes the first display object.
  • the multi-screen terminal can render all the images of the first GUI according to the resolution of the second display panel, obtain a second GUI whose resolution conforms to the resolution specification of the second display panel, and then display the second GUI.
  • the multi-screen terminal displays a second GUI on the second display panel, where the second GUI type includes the first display object.
  • the multi-screen terminal may be displayed on the first display panel and the second display panel.
  • a GUI ie, the first GUI
  • icons for various applications are the same, as shown in FIGS. 7b-1 and 7b-2.
  • the multi-screen terminal can display a GUI as shown in FIG. 7b-1 on its first display panel 341 and a second display panel 342 on its second display panel 342.
  • the interaction process between the first display panel and the second display panel is exemplified when the multi-screen terminal is in the "mirror mode" with reference to FIG. 7 .
  • the second display panel displays the same content as the first display panel.
  • the first touch panel 331 of the multi-screen terminal 300 detects it or The nearby touch event is transmitted to the processor 380 to determine an instruction corresponding to the touch event.
  • the processor 380 calls the system application "photograph” stored in the memory 320 according to the instruction, and displays the same in the first display panel 341.
  • the system applies the GUI of the "photo” (ie, executes S802), that is, displays the GUI as shown in FIG.
  • the processor 380 can also The GUI of the system application "photo" is displayed on the second display panel 342 (ie, S803, S804, and S805 are executed), that is, the GUI as shown in FIG. 10b-2 is displayed.
  • the first touch panel 331 of the multi-screen terminal 300 detects that it is The touch event on or near is transmitted to the processor 380 to determine an instruction corresponding to the touch event, and then the processor 380 calls the photo "swan” stored in the memory 320 according to the instruction, and displays on the first display panel 341.
  • the GUI of the photo "Swan” displays the GUI as shown in FIG.
  • the processor 380 can also The GUI of the photo "Swan" is displayed on the second display panel 342, that is, the GUI as shown in FIG. 10d-2 is displayed (ie, S803, S804, and S805 are executed).
  • the first image panel may also display the first image identifier
  • the second display panel further A second image identifier can be displayed.
  • a mirror image identifier 409 such as "JX”
  • a mirror image identifier 410 such as "JX”
  • the image identifier 409 and the image identifier 410 may be the same or different.
  • An example of the image identifier is given by way of example in FIG. 7.
  • the specific shape of the image identifier and the position of the image identifier in the first display panel and the second display panel in the embodiment of the present invention include but do not show FIG. 7 The shape and location of the show.
  • the multi-screen display method provided by the embodiment of the present invention when the multi-screen terminal is in the "mirror mode", may display the same display object as the first display panel in the second display panel in response to the first instruction, that is, the multi-screen terminal
  • the two display screens can interact with each other instead of being independent of each other, thus improving the user experience during human-computer interaction.
  • the user can enter the "dual screen mode selection" interface as shown in FIG. 4c by applying a touch operation of the "set” icon 403 to the system as shown in FIG. 4a. Then, by switching the display mode in the "dual screen mode selection” interface as shown in FIG. 4c, switching from the above “mirror mode” to "independent mode", “demo mode” or “single screen mode” A display mode.
  • the user can control the multi-screen terminal to directly enter the “dual-screen mode selection” interface from the “mirror mode” through the pre-configured shortcut key, that is, the first display panel that controls the multi-screen terminal displays “dual screen”.
  • the Mode Selection interface is then selected by the Dual Screen Mode Selection interface to enter any of the "Independent Mode", “Demo Mode” or "Single Screen Mode” modes.
  • the multi-screen terminal directly enters the “dual-screen mode selection” interface by “mirror mode”, and then selects “demo mode” by the “dual-screen mode selection” interface as an example, and the method of the implementation manner is performed.
  • “dual-screen mode selection” interface by “mirror mode”
  • “demo mode” by the “dual-screen mode selection” interface
  • the user wants to display all or part of the details of the photo 412 in the second display panel.
  • the user can display the “dual screen mode selection” interface as shown in FIG. 11a-1 on the first display interface through the pre-configured shortcut keys.
  • the processor 380 can detect the corresponding key event to determine an instruction corresponding to the key event, and then the processor 380 calls the storage in the memory according to the instruction.
  • the "Dual Screen Mode Selection” application in 320, and the GUI of the "Double Screen Mode Selection” application is displayed on the first display panel 341.
  • the first display panel 341 can display the GUI as shown in FIG. 11a-1. Since the multi-screen terminal 300 is still in the "mirror mode" when the first display panel 341 can display the GUI as shown in FIG. 11a-1, the second display of the multi-screen terminal 300 is as shown in FIG. 11a-2.
  • the panel can display the same GUI as the first display interface.
  • the second display panel of the multi-screen terminal 300 can display the same content as the first display panel.
  • the first touch panel 331 detects the touch event on or near it, and transmits it to the processor 380 to determine an instruction corresponding to the touch event, and then the processor 380 calls the "demo mode” stored in the memory 320 according to the instruction.
  • the application displays and displays the GUI shown in FIG. 11c-1 on the first display panel 341.
  • the multi-screen terminal 300 can also control the second display panel to display other characters or images (such as the above-mentioned predefined image: "Hello, World”) instead of displaying the photo "Swan” as shown in FIG. 11c-2.
  • the embodiment of the present invention does not limit this.
  • the second display panel when the multi-screen terminal is in the "demo mode", can display the "demo mode” instead of displaying the same "photo” as the first display panel. "interface.
  • a demo icon 601 can also be displayed on the first display panel.
  • An example of a presentation icon is given by way of example only in FIG. 11.
  • the specific shape of the presentation icon and the position of the presentation icon in the first display panel and the second display panel in the embodiment of the present invention include but do not show FIG. The shape and location of the show.
  • the first display panel displays the GUI shown in FIG.
  • the second display panel of the multi-screen terminal can display the GUI as shown in FIG. 11c-2.
  • a demo icon 602 can also be displayed on the second display panel.
  • the presentation icon 601 and the presentation icon 602 may be the same or different.
  • the auxiliary work screen of the multi-screen terminal can display the same content as the main work screen, and can also display the content specified by the user in the main display screen.
  • the method for displaying multi-screen display provided by the embodiment of the present invention may include S1201-S1202:
  • the multi-screen terminal receives a touch operation instruction of the user for the “demo mode” option, and enters the demo mode.
  • the multi-screen terminal can enter the “demo mode” after receiving the touch operation instruction of the “demo mode” option by the user.
  • a user's touch operation command to the "demo mode” option may be generated by the user in FIG. 11b-1 touching or touching the "mirror mode” option displayed in the "dual screen mode selection” menu 408 on the first display panel 341. Operation instructions.
  • the multi-screen terminal displays a first GUI on the first display panel, and the first GUI may include a presentation icon (such as a presentation icon 601) of the second display panel and a first display object.
  • a presentation icon such as a presentation icon 601
  • S1201 may be executed first, and then S1202 is performed, that is, the multi-screen terminal may display the first GUI on the first display panel after entering the demonstration mode; or may execute S1202 first, and then execute S1201, that is, multiple screens may be performed.
  • the terminal can enter the demo mode after displaying the first GUI on the first display panel.
  • the embodiment of the present invention does not limit the order in which S1201 and S1202 are executed.
  • the multi-screen terminal acquires a first instruction input by the user on the first GUI, where the first instruction is an instruction triggered by the first operation of the user.
  • the first operation may be a continuous sliding operation in which the starting point coordinate of the sliding track is the coordinate position where the second display object is located and the end point coordinate is the coordinate position of the presentation icon.
  • the second display object may include all images of the first display object, or the second display object includes a partial image of the first display object, or the first display object includes at least two sub-display objects, and the second display object is the at least two A child display object in the display object.
  • the multi-screen terminal displays a second GUI including the second display object in the second display panel in response to the first instruction.
  • the second GUI may include all the image content displayed in the first GUI; when the second display object includes a partial image of the first display object, or the second When the display object is one of the at least two child display objects, the partial GUI content displayed in the first GUI may be included in the second GUI.
  • the multi-screen terminal may determine the second display object from the first display object in response to the first instruction, and then display the second GUI including the second display object in the second display panel.
  • the multi-screen terminal may also be in the first display panel.
  • a second display object is highlighted on a display object.
  • the second display object may include all images of the first display object.
  • the first display panel 341 currently displays a GUI (ie, a first GUI) including a photo 603 (ie, a first display object), as shown in FIG. 13a-2, and a second display.
  • Panel 342 currently displays a GUI that includes photo 1301.
  • the processor 380 receives the continuous sliding drag event (ie, execution 1203) on or near it can be detected.
  • the second display object includes a partial image of the first display object.
  • S1204 in FIG. 12 can be replaced with S1204a:
  • the multi-screen terminal displays an image selection window centered on the starting point coordinate on the first GUI displayed on the first display panel, and displays an image surrounded by the image selection window on the second display panel, in response to the first instruction.
  • the shape of the image selection window may be a rectangle, a circle, or a polygon, which is not limited in the embodiment of the present invention.
  • the size of the image selection window may be a fixed size pre-configured in the multi-screen terminal; or the initial size of the image selection window may be pre-configured in the multi-screen terminal, and the multi-screen terminal may display the image selection window according to the initial size. The user is then adjusted to the initial size to re-determine the size of the image selection window.
  • the embodiment of the present invention takes the image selection window as a circle as an example, as shown in FIG. 15a-1, when the user's finger touches or approaches a point on the photo 603 displayed on the first display panel 341 (referred to as a point).
  • Point O a point on the photo 603 displayed on the first display panel 341
  • the touch panel 331 can detect a continuous sliding drag event (ie, execution 1203) on or near it, the event is transmitted to the processor 380, and the processor 380 can determine the starting point coordinate of the sliding track (ie, O
  • the coordinates of the point are the center of the image selection window 604 having a radius of a predetermined radius, the GUI shown in FIG.
  • the GUI displayed by the first display panel includes an image selection window 604, and the GUI displayed by the second display panel includes an image surrounded by the image selection window 604.
  • the user can also drag the image selection window 604 displayed on the first display panel, and control the image selection window 604 to move on the first display panel so that the second display panel can be
  • the different details of the photo 603 are displayed on the top.
  • the method of the embodiment of the present invention may further include S1601:
  • the multi-screen terminal acquires a second instruction input by the user on the first GUI, where the second instruction is an instruction for triggering the multi-screen terminal to move the image selection window on the first display panel.
  • the multi-screen terminal displays a dynamically moving image selection window on the first GUI displayed by the first display panel according to the movement trajectory indicated by the second instruction, and displays the second display panel in the second display panel.
  • the third GUI of the third display object, the third display object is an image surrounded by the image selection window at the end point coordinates of the moving trajectory.
  • the first touch panel 331 of the multi-screen terminal can be detected on or near Drag event (ie, execution 1601); then, the drag event can be transmitted to the processor 380 to determine the coordinates of the drag track of the drag event on the first display panel, and the image is dynamically displayed on the first display panel. Selecting a window, and displaying an image selection window composed of a broken line as shown in FIG. 15c-1 at the end point coordinate of the moving track until the user's finger leaves the first display panel and displays the first display panel as shown in FIG. 15d-1.
  • the GUI in the second display panel, can display the GUI as shown in FIG. 15d-2 (ie, execute S1602).
  • the second display panel can display the same GUI as that of FIG. 15b-2.
  • the first display panel can display the GUI as shown in FIG. 15d-1
  • the second display panel can display the terminal screen as shown in FIG. 15d-2.
  • the first display object includes at least two child display objects, and the second display object is one of the at least two child display objects.
  • the first display object is a photo list in the mobile phone, and the at least two sub display objects are photos in the photo list.
  • the first display panel 341 displays a list of photos.
  • the first touch panel 331 detects the image on or near it.
  • the drag event is transmitted to the processor 380 to determine an instruction corresponding to the drag event; then, the processor 380 determines that the photo corresponding to the icon 701 is the second display object according to the instruction, and then displays the image on the first display panel.
  • the GUI shown in Fig. 17b-2 is displayed on the second display panel.
  • the first display panel can highlight the second display object.
  • the method for the multi-screen terminal to display the second GUI including the second display object on the second display panel may include: displaying, by the multi-screen terminal, the second display panel including the second display object from the small and gradually increasing dynamic image Two GUI.
  • the method for displaying, by the multi-screen terminal, the second GUI including the second display object on the second display panel may include: displaying, according to a linear distance between the start point coordinate and the end point coordinate of the sliding track, the second display panel includes a distance corresponding to the straight line distance
  • the foregoing first operation may also be an operation for the user to draw an image selection window on the first GUI.
  • the multi-screen terminal may determine, according to the first instruction, an image surrounded by the image selection window on the first display object as a second display object, and then display the second display panel in the second display panel. The second GUI of the display object.
  • the first touch panel 331 of the multi-screen terminal 300 detects that it is After the window selection event on or near the window (ie, execution 1203), the window selection event is transmitted to the processor 380 to determine the coordinates of the image selection window 604 corresponding to the window selection event on the first display panel to determine the enclosing An image selection window of some or all of the images in the first GUI. Then, the processor 380 can determine the image surrounded by the image selection window 604 on the photo 603 as the second display object and display on the second display panel while the first display panel displays the GUI as shown in FIG. 18b-1. The GUI shown in Figure 18b-2.
  • the first touch panel 331 of the multi-screen terminal can be detected on or near Drag event (ie, execution 1601); then, the drag event can be transmitted to the processor 380 to determine the coordinates of the drag track of the drag event on the first display panel, and the image is dynamically displayed on the first display panel. Selecting a window, and displaying an image selection window composed of a broken line as shown in FIG. 18c-1 at the end point coordinate of the moving track until the user's finger leaves the first display panel and controls the first display panel to display as shown in FIG. 18d-1.
  • the GUI displays a GUI as shown in FIG. 18d-2 on the second display panel (ie, executes S1209).
  • the multi-screen display method provided by the embodiment of the present invention when the multi-screen terminal is in the "demo mode", can control the second display panel to display all or part of the content displayed by the first display panel in response to the user's operation, that is, the plurality of The two display screens of the screen terminal can interact with each other instead of being independent of each other, which can improve the user experience in the process of human-computer interaction.
  • the multi-screen terminal may respectively set a task window for the first display panel and the second display panel, wherein the first task window is used to correspond to the first display panel for saving a display task of the content to be displayed on the first display panel, the second task window corresponding to the second display panel, configured to save a display task of the content to be displayed on the second display panel.
  • the multi-screen terminal can add the display task to the display policy according to a preset display policy or according to the user's selection.
  • the first task window or the second task window; and then the first display panel may preferentially display the GUI corresponding to the newly added display task according to the time sequence added by the display task in the first task window, and the second display panel may follow the first The time sequence in which the display tasks are added in the second task window, and the GUI corresponding to the newly added display task is preferentially displayed.
  • the method in the embodiment of the present invention may further include S1901-S1910:
  • the multi-screen terminal acquires a user's touch operation instruction for the "independent mode” option, and enters the independent mode.
  • the multi-screen terminal can enter the above-mentioned "independent mode” after receiving the user's touch operation instruction for the "independent mode” option.
  • the first display panel of the multi-screen terminal displays the GUI as shown in FIG. 20a-1, and the second display panel displays as shown in FIG. 20a-2.
  • the first display panel can display the icon 801 of the first task window and the icon 802 of the second task window as shown in FIG. 20a-1.
  • the second display panel can display the figure. The icon 801 of the first window stack and the icon 802 of the second window stack shown in 20a-2.
  • the multi-screen terminal acquires a second instruction input by the user, where the second instruction is an instruction for triggering the multi-screen terminal to open the first application.
  • the second instruction is a startup instruction of the first application. Because in the "independent mode", the multi-screen terminal can simultaneously support the first response mode (ie, the first touch panel response mode) and the second response mode (ie, the second touch panel response mode); therefore, the first application
  • the start command may be when the user touches or approaches the first display panel, and the first touch panel detects the touch event on or near the touch panel, and transmits the touch event to the processor, where the touch event determined by the processor corresponds.
  • the instruction of the first application may be when the user touches or approaches the second display panel, and the second touch panel detects the touch event on or near the touch panel, and transmits the touch event to the processor for processing.
  • the instruction corresponding to the touch event determined by the device may be when the user touches or approaches the second display panel, and the second touch panel detects the touch event on or near the touch panel, and transmits the touch event to the processor for processing.
  • the multi-screen terminal can support the first response mode, display the GUI corresponding to the touch event detected by the first touch panel on the first display panel, and support the second response mode.
  • the GUI corresponding to the touch event detected by the second touch panel is displayed on the second display panel.
  • the multi-screen terminal adds the first display task to the first task window in response to the second instruction, where the first display task is a display task corresponding to the first application.
  • the multi-screen terminal may generate the first display task and add the first display task to the first task window at the first time in response to the second instruction.
  • the multi-screen terminal Before the multi-screen terminal adds the first display task to the first task window, the multi-screen terminal may have added other display tasks (such as the third display task) in the first task window, and the third display task may be more
  • the screen terminal is added to the display task in the first task window at a second time, and the second time is earlier than the first time.
  • other display tasks may not be added in the first task window.
  • the first display task can be added to the first task window.
  • the multi-screen terminal may determine, according to the indication of the second instruction, that the designated display screen of the first application is the display screen where the first display panel is located, that is, the second instruction may also be used to trigger the multi-screen terminal in the first display panel.
  • the first GUI is displayed on the first GUI; or the corresponding relationship between the application and the first display panel and the second display panel may be pre-stored in the multi-screen terminal, and the multi-screen terminal may determine, according to the correspondence, that the first display panel is pre-configured.
  • a display panel for displaying an interface of the first application may be pre-configured.
  • the multi-screen terminal executes the first display task in the first task window, and displays a first GUI that includes the first display object in the first display panel, where the first GUI is an interface of the first application.
  • the multi-screen terminal may preferentially execute the display task newly added to the first task window (ie, the display task with the shortest time added to the first task window) according to the added time sequence of the display task in the first task window. Since the first display task is the display task newly added to the first task window, the multi-screen terminal can preferentially execute the first display task in the first task window. When the multi-screen terminal executes the first display task in the first task window, or the first display task is deleted from the first task window by the multi-screen terminal in response to the user operation, the multi-screen terminal may continue to perform the third display.
  • the task that is, the display task with the shortest time added to the first task window except the first display task in the first task window.
  • the multi-screen terminal acquires a third instruction input by the user, where the third instruction is an instruction for triggering the multi-screen terminal to open the second application.
  • the multi-screen terminal adds the second display task to the second task window, and the second display task is the display task corresponding to the second application, in response to the third instruction.
  • the multi-screen terminal may generate a second display task and add the second display task to the second task window at a third time in response to the third instruction.
  • the multi-screen terminal Before the second display task is added to the second task window by the multi-screen terminal, the multi-screen terminal may have added other display tasks (such as the fourth display task) in the second task window, and the fourth display task may be more The screen terminal is added to the display task in the second task window at the fourth time, and the fourth time is earlier than the third time.
  • other display tasks may not be added in the second task window.
  • the multi-screen terminal executes a second display task in the second task window, and displays a second GUI including the second display object on the second display panel.
  • the multi-screen terminal may preferentially execute the display task newly added to the second task window (ie, the display task with the shortest time added to the second task window) according to the added time sequence of the display task in the second task window. Since the second display task is the display task newly added to the second task window, the multi-screen terminal can preferentially execute the second display task in the second task window. When the multi-screen terminal executes the second display task in the second task window, or the second display task is deleted from the second task window by the multi-screen terminal in response to the user operation, the multi-screen terminal may continue to execute the fourth display.
  • the task that is, the shortest display task added to the second task window in addition to the second display task in the second task window.
  • the multi-screen terminal acquires a first instruction input by the user on the first GUI, where the first instruction is used to trigger the multi-screen terminal to display, in the second display panel, the first display currently displayed by the first display panel.
  • the GUI of the object is used to trigger the multi-screen terminal to display, in the second display panel, the first display currently displayed by the first display panel.
  • the first GUI may further include an icon of the second task window, where the first instruction may be an instruction triggered by the first operation of the user, and the first operation may be that the starting coordinate of the sliding track is the coordinate of the first display object.
  • the position and the terminal coordinate are continuous sliding operations of the coordinate position of the icon of the second task window, and the first instruction is used to instruct the multi-screen terminal to add the first display task to the second task window.
  • the multi-screen terminal deletes the first display task from the first task window and adds the first display task to the second task window in response to the first instruction.
  • the multi-screen terminal displays a third GUI including the first display object on the second display panel, and displays a fourth GUI including the third display object on the first display panel.
  • the multi-screen terminal can preferentially execute the first display task in the second task window, and display the third GUI including the first display object in the second display panel. And, since the first display task has been deleted from the first task window, the multi-screen terminal can continue to execute the third display task in the first task window (ie, in addition to the first display task in the first task window, The shortest display task added to the first task window) and displaying the fourth GUI including the third display object on the first display panel.
  • the first touch panel 331 detects the touch event on or near it, and transmits it to The processor 380 determines an instruction corresponding to the touch event (ie, executes S1902), and then the processor 380 calls the GUI of the "read” application stored in the memory 320 according to the instruction (ie, the "read” application start instruction) to generate And adding the first display task to the first task window (ie, executing S1903), and displaying the GUI as shown in FIG. 20b-1 on the first display panel (ie, executing S1904).
  • the first display task is specifically: displaying a GUI of the "reading" application.
  • the processor 380 is in accordance with the instruction (ie, the "photo" application startup instruction) (ie, execute S1905) Calling the GUI of the "photo” application stored in the memory, generating and adding the first display task to the second task window (ie, executing S1906), and displaying the GUI as shown in FIG. 20b-2 on the second display panel (ie, executing S1907) ).
  • the first display task is specifically: displaying a GUI of the "photo" application.
  • the multi-screen terminal can determine that the designated display screen of the “reading” application is the first display panel. Since the designated display screen of the “reading” application is the first display panel, the multi-screen terminal can add the first display task to the first task window (ie, execute S1903).
  • the "read” task is added to the first display task of the first task window at the first time, and the "video 1" task is added to the first task window for the second time.
  • Three display The first time is later than the second time; the "photo” task is added to the second display task of the second task window for the third time, and the "video 2" task is added to the fourth display of the second task window for the fourth time task.
  • the multi-screen terminal executes S1908-S1909, and the first display task ("reading" task) can be deleted from the first task window, and the first display task ("reading task") is added to the second task window, as shown in the figure.
  • 21a-1 to 21a-2, FIG. 21b-1 to FIG. 21b-2 are schematic diagrams showing examples of changes in display tasks in the first task window and the second task window after the S1908-S1909 is executed for the multi-screen terminal.
  • the first touch panel 331 detects the drag event on or near it, and transmits it to the processor 380 to determine an instruction corresponding to the drag event (ie, execute S1908), and then The processor 380 deletes the first display task ("read" task) from the first task window according to the instruction, and adds the first display task to the second task window (ie, executes S1909).
  • the newly added display task in the first task window is a “Video 1” task (ie, a third display task), as shown in FIG. 21b-2, and the latest addition in the second task window.
  • the display task is a "read" task (ie, the first display task); therefore, the GUI shown in FIG. 22b-1 can be displayed on the first display panel; the second display panel displays the GUI as shown in FIG. 22b-2.
  • the multi-screen terminal may also be in the first display panel (in response to the user's touch operation instruction on the icon 801 of the first task window or the icon 802 of the second task window on the first display panel (or the second display panel). Or displaying a display task list in the first task window on the second display panel, where the display task list includes identifiers of all display tasks in the first task window.
  • the first touch panel 331 detects the touch event on or near it, and transmits it to the processor 380 to determine an instruction corresponding to the touch event, and then the processor 380 calls the "first" stored in the memory 320 according to the instruction.
  • a task window "application GUI" and a GUI as shown in Figure 23b is displayed in the first display panel. As shown in FIG.
  • a display task list 804 of the first task window is displayed on the first display panel, and the display task list 804 includes identifiers of all display tasks in the first task window 801, such as a "reading" task. ID, the ID of the "Video 1" task.
  • the user may want to display the second display task corresponding to the first display panel.
  • GUI The method for displaying the GUI corresponding to the second display task in the first display panel of the multi-screen terminal is similar to the method for displaying the GUI corresponding to the first display task in the second display panel, and details are not described herein again.
  • the first task window may be a first window stack, where the first window stack may be used to save a display task pressed into the first window stack according to an advanced late-out principle, and the first display panel is configured to display the first The GUI of the display task at the top of the stack of the window stack.
  • the second task window may be a second window stack, and the second window stack is used to save the second window according to the principle of advanced output. The display task of the stack, the second display panel is used to display the GUI corresponding to the display task of the top of the stack of the second window stack.
  • FIG. 24a-1 it is assumed that two display tasks are pushed into the first window stack: a "read” task and a "video 1" task, and the "read” task is located at the top of the stack of the first window stack. That is, as shown in FIG. 22a-1, the first display panel is currently executing the "read” task, displaying the GUI of the "read” application.
  • the first touch panel 331 detects the drag event on or near it, and transmits it to the processor 380 to determine an instruction corresponding to the drag event (ie, execute S1908), and then The processor 380 pops the first display task ("reading task") from the first window stack window according to the instruction, as shown in FIG. 24a-1, as shown in FIG. 24b-1, and presses the first display task. Enter the second task window (ie execute S1909).
  • FIG. 22a-1 when the user's finger touches or approaches the reading window in the "read” GUI displayed on the first display panel 341, and drags the reading window in the "read” GUI to the second
  • the first touch panel 331 detects the drag event on or near it, and transmits it to the processor 380 to determine an instruction corresponding to the drag event (ie, execute S1908), and then The processor 380 pops the first display task ("reading task") from the first window stack window according to the instruction, as shown in FIG. 24a-1, as shown in FIG. 24b-1, and presses the first
  • the display task of the top of the stack of the first window stack is a "Video 1" task (ie, a third display task), as shown in FIG. 24b-2, the top of the second task window.
  • the display task is a "read” task (ie, the first display task); therefore, the GUI shown in FIG. 22b-1 can be displayed on the first display panel; the second display panel displays the GUI as shown in FIG. 22b-2.
  • the multi-screen terminal may display a GUI including a dynamic image on the first display panel and the second display panel in response to the first instruction to improve the visual experience of the user.
  • S1910 shown in FIG. 19 can be replaced with S1910a:
  • the multi-screen terminal displays a third GUI including the first dynamic image on the second display panel in response to the first instruction, and displays a fourth GUI including the second dynamic image on the first display panel.
  • the first moving image is a moving image in which the first display object moves according to the first preset moving trajectory, and the first display object gradually increases from small to small during the moving process
  • the starting point coordinate of the first preset moving trajectory is The coordinate position of the icon of the first window stack in the third GUI
  • the end point coordinate of the first preset movement track is a coordinate position for displaying the display object in the third GUI.
  • the second moving image is a moving image in which the third display object moves according to the second preset moving trajectory, and the third display object gradually becomes larger during the moving process, and the starting point coordinate of the second preset moving trajectory is in the fourth GUI.
  • the coordinate position of the icon of the first window stack is the coordinate position of the second preset movement track for displaying the display object.
  • the first touch panel 331 detects the drag event on or near it, and transmits it to the processor 380 to determine an instruction corresponding to the drag event (ie, execute S1908), the processor 380 then displays the GUI including the second dynamic image as shown in FIG. 25b-1 on the first display panel according to the instruction, and finally displays the GUI as shown in FIG. 25c-1 on the first display panel;
  • the second display panel displays a GUI including the first dynamic image as shown in FIG. 22b-2, and finally The second display panel displays the GUI as shown in Figure 25c-2.
  • the “video 1" currently displayed by the first display panel is a display object corresponding to the display task of the first display panel, and is not a display object corresponding to the display task switched from the second display panel. As shown in FIG. 25b-1, since the starting point coordinate of the moving track of the display object "Video 1" displayed on the first display panel by the first display panel is the icon 801 of the first task window, the user can determine The "video 1" currently displayed by the first display panel is a display object corresponding to the display task of the first display panel, and is not a display object corresponding to the display task switched from the second display panel. As shown in FIG.
  • the user can determine that the "reading content" currently displayed by the second display panel is not the display object corresponding to the display task of the second display panel, but the display object corresponding to the display task switched from the first display panel.
  • the multi-screen display method when the multi-screen terminal is in the "independent mode", two independent task windows can be set in the multi-screen terminal, and each task window corresponds to one display panel, such as the first display panel.
  • the GUI for displaying the latest added amount display task in the first task window, and the second display panel is for displaying the GUI corresponding to the newly added amount display task in the second task window.
  • the multi-screen terminal can display the GUI including the first display object currently displayed by the first display panel in the second display panel by switching the display task in the two task windows, and display the second display on the first display panel.
  • the GUI of the second display object currently displayed by the panel that is, the interaction between the two display screens of the multi-screen terminal can be realized, and the user experience in the process of human-computer interaction can be improved.
  • the photographing terminal includes function modules corresponding to performing respective functions.
  • the present application can be implemented in a combination of hardware or hardware and computer software in combination with the various exemplary multi-screen terminals and algorithm steps described in the embodiments disclosed herein. Whether a function is implemented in hardware or computer software to drive hardware depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present application.
  • the embodiment of the present application may divide the multi-screen terminal according to the foregoing method example. For example, each module or unit may be divided according to each function, or two or more functions may be integrated into one processing module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software modules or units.
  • the division of modules or units in the embodiments of the present application is schematic, and is only a logical function division, and may be further divided in actual implementation.
  • FIG. 26 is a schematic diagram showing a possible structure of the multi-screen terminal involved in the above embodiment.
  • the multi-screen terminal 2600 includes: a first display module 2601, a second display module 2602, and an acquisition module 2603.
  • the first display module 2601 described above is used to support S802 in the method embodiment, and/or other processes for the techniques described herein.
  • the second display module 2602 is for supporting S806 in the method embodiment, and/or other processes for the techniques described herein, acquiring the modulo Block 2603 is for supporting S801, S803, and/or other processes for the techniques described herein in the method embodiments.
  • the multi-screen terminal 2600 may further include a judging module and a rendering module.
  • the judging module is used to support S804 in the method embodiment, and/or other processes for the techniques described herein.
  • the first display module 2601 described above is used to support the display actions of the first display panel in S1202, S1204a, and S1602 in the method embodiment, and/or other processes for the techniques described herein.
  • the second display module 2602 is for supporting display actions of the second display panel in S1204, S1204a, and S1602 in the method embodiment, and/or other processes for the techniques described herein.
  • the acquisition module 2603 is for supporting S1201, S1203, S1601 in the method embodiment, and/or other processes for the techniques described herein.
  • the first display module 2601 described above is used to support the display actions of the first display panel in S1904, S1910 in the method embodiment, and/or other processes for the techniques described herein.
  • the second display module 2602 is for supporting display actions of the second display panel in S1907, S1910 in the method embodiment, and/or other processes for the techniques described herein.
  • the acquisition module 2603 is for supporting S1901, S1902, S1905, S1908 in the method embodiment, and/or other processes for the techniques described herein.
  • the multi-screen terminal 2600 may further include a task window management module.
  • the task window management module is used to support S1903, S1906, S1909 in the method embodiment, and/or other processes for the techniques described herein.
  • the multi-screen terminal 2600 includes, but is not limited to, the unit modules listed above.
  • the multi-screen terminal 2600 may further include a transmitting module for transmitting data or signals to other devices, for receiving data or signals sent by other devices. Receive module, storage module for storing data, and the like.
  • the functions that can be implemented by the foregoing modules include, but are not limited to, the functions corresponding to the method steps described in the foregoing examples.
  • the other units of the multi-screen terminal 2600 and the detailed description of each unit of the multi-screen terminal 2600 may refer to the corresponding method. The detailed description of the steps is not described herein again.
  • the above-mentioned acquisition module 2102, task window management module, and the like may be integrated into one processing unit, and the processing unit may be a processor or a controller, for example, a central processing unit (Central Processing Unit, CPU), general purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), Field Programmable Gate Array (FPGA) or other programmable logic Device, transistor logic device, hardware component, or any combination thereof. It is possible to implement or carry out the various illustrative logical blocks, modules and circuits described in connection with the present disclosure.
  • the processing unit may also be a combination of computing functions, such as one or more microprocessor combinations, a combination of a DSP and a microprocessor, and the like.
  • the above storage module may be a memory.
  • the first display module may be a first display panel
  • the second display module may be a second display panel
  • the first display panel and the second display panel may be different display panels.
  • the multi-screen terminal 2600 When the processing unit is a processor, the first display module 2601 is a first display panel, and the second display module 2602 is a second display panel.
  • the storage module is a memory
  • the multi-screen terminal 2600 according to the embodiment of the present application may be The multi-screen terminal 2700 shown in FIG.
  • the multi-screen terminal 2700 includes a processor 2701, a first display panel 2702, a second display panel 2703, a memory 2704, and a bus 2705.
  • the processor 2701, the first display panel 2702, the second display panel 2703, and the memory 2704 are connected to each other through a bus 2705.
  • the first display panel 2702 and the second display panel 2703 are used to display the GUI indicated by the processor 2701.
  • the memory 2704 is configured to store computer program code, the computer program code sequence including instructions, when the processor 2701 of the multi-screen terminal 2700 executes the instruction, the multi-screen terminal 2700 executes as shown in FIG. 8, FIG. 12, FIG. 14, FIG. 16, and FIG.
  • the method steps in any of the figures implement the method of multi-screen display in the above embodiments.
  • the bus 2705 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus.
  • PCI Peripheral Component Interconnect
  • EISA Extended Industry Standard Architecture
  • the bus 2705 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 27, but it does not mean that there is only one bus or one type of bus.
  • the embodiment of the present invention further provides a computer storage medium, where the computer program code is stored.
  • the processor 2701 of the multi-screen terminal 2700 executes the computer program code
  • the multi-screen terminal 2700 executes FIG. 8 and FIG. 12 .
  • the method steps in any of Figures 14, 16, and 19 implement the method of multi-screen display in the above embodiments.
  • the embodiment of the present invention further provides a computer program product, when the computer program product is run on a computer, causing the computer to execute the related method in any of FIG. 8, FIG. 12, FIG. 14, FIG. 16, and FIG.
  • the steps implement the method of multi-screen display in the above embodiment.
  • the multi-screen terminal, the computer storage medium, or the computer program product provided by the embodiments of the present invention are all used to perform the corresponding method provided above. Therefore, the beneficial effects that can be achieved can be referred to the corresponding ones provided above. The beneficial effects in the method are not described here.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the modules or units is only a logical function division.
  • there may be another division manner for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • a computer readable storage medium A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to perform all or part of the steps of the methods described in various embodiments of the present application.
  • the foregoing storage medium includes: a flash memory, a mobile hard disk, a read only memory, a random access memory, a magnetic disk, or an optical disk, and the like, which can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Provided by the present application are a method and device for multi-screen display, relating to the technical field of terminals, and which may carry out interaction between a plurality of display screens of a multi-screen terminal, thereby improving user experience in a process of human-machine interaction. The specific solution is: displaying, in a first display panel, a first graphical user interface (GUI) comprising a presentation icon of a second display panel and a first display object; acquiring a first instruction inputted by a user on the first GUI, the first instruction being an instruction triggered by a continuous sliding operation, wherein a starting point coordinate of a sliding track is a coordinate position of a second display object and an ending point coordinate is a coordinate position of the presentation icon; in response to the first instruction, displaying, in the second display panel, a second GUI comprising the second display object, the second display object comprising an entire image of the first display object, or the second display object comprising a partial image of the first display object, or the first display object comprising at least two display sub-objects, wherein the second display object is one of the display sub-objects among the at least two display sub-objects.

Description

一种多屏显示的方法和设备Method and device for multi-screen display
本申请要求于2016年12月27日提交中国专利局、申请号为201611225504.9、发明名称为“一种多屏显示的方法和设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。The present application claims priority to Chinese Patent Application No. 201611225504.9, entitled "Method and Apparatus for Multi-Screen Display", filed on December 27, 2016, the entire contents of which is incorporated herein by reference. In the application.
技术领域Technical field
本发明实施例涉及终端技术领域,尤其涉及一种多屏显示的方法和设备。The embodiments of the present invention relate to the field of terminal technologies, and in particular, to a method and a device for displaying multiple screens.
背景技术Background technique
随着智能终端的普及和扩展,现有终端已不满足于单面触摸屏,市场上已有部分终端除设有正面触摸屏外,还设有背面触摸屏。其中,一些具有双面触摸屏的终端可以在其双面触摸屏上分别显示不同或者相同的内容。With the popularization and expansion of smart terminals, existing terminals are no longer satisfied with single-sided touch screens. Some terminals on the market have a front touch screen in addition to a front touch screen. Among them, some terminals with double-sided touch screens can display different or the same content on their double-sided touch screens.
但是,现有技术中终端的双面触摸屏是相互独立的,没有交互,即不同面的触摸屏显示不同的内容,在人机交互上没有带来新的变化和突破。However, in the prior art, the double-sided touch screens of the terminals are independent of each other, and there is no interaction, that is, the touch screens of different faces display different contents, and no new changes and breakthroughs are brought about in human-computer interaction.
发明内容Summary of the invention
本申请提供一种多屏显示的方法和设备,可以实现多屏终端的多个显示屏之间的交互,提高人机交互过程中的用户体验。The present application provides a multi-screen display method and device, which can implement interaction between multiple display screens of a multi-screen terminal, and improve user experience in the process of human-computer interaction.
为达到上述目的,本申请采用如下技术方案:To achieve the above objectives, the present application adopts the following technical solutions:
第一方面,本申请提供一种多屏显示的方法,可以应用于多屏终端,该多屏终端包括第一显示面板和第二显示面板,该多屏显示的方法可以包括:多屏终端在第一显示面板显示第一图形用户界面(Graphical User Interface,GUI),该第一GUI中包括第二显示面板的演示图标和第一显示对象;获取用户在第一GUI上输入的第一指令,该第一指令为用户的第一操作触发的指令,该第一操作是滑动轨迹的起点坐标为第二显示对象所在坐标位置、终点坐标为演示图标所在坐标位置的连续性滑动操作;响应于所述第一指令,在第二显示面板显示包括第二显示对象的第二GUI,该第二显示对象包括第一显示对象的全部图像,或者第二显示对象包括第一显示对象的部分图像,或者第一显示对象包括至少两个子显示对象,该第二显示对象为至少两个子显示对象中的一个子显示对象。In a first aspect, the present application provides a method for displaying a multi-screen display, which can be applied to a multi-screen terminal, where the multi-screen terminal includes a first display panel and a second display panel, and the method for displaying the multi-screen can include: The first display panel displays a first graphical user interface (GUI), the first GUI includes a presentation icon and a first display object of the second display panel, and acquires a first instruction input by the user on the first GUI. The first instruction is an instruction triggered by the first operation of the user, and the first operation is a continuous sliding operation in which the starting point coordinate of the sliding track is the coordinate position of the second display object and the coordinate of the end point is the coordinate position of the presentation icon; a first instruction, displaying, on the second display panel, a second GUI including a second display object, the second display object including all images of the first display object, or the second display object including a partial image of the first display object, or The first display object includes at least two child display objects, and the second display object is one of the at least two child display objects .
本申请提供的多屏显示的方法中,多屏终端可以在第一显示面板显示包括第一显示对象的第一GUI时,响应于用户输入的第一指令,在第二显示面板上显示包括第一GUI中的第一显示对象的部分图像或者全部图像(即第二显示对象)的第二GUI。即第一显示面板和第二显示面板之间可以交互显示对方当前显示的内容,第一显示面板和第二显示面板所显示的内容是存在联系,可以实现多屏终端的多个显示屏之间的交互,可以提高人机交互过程中的用户体验。In the multi-screen display method provided by the present application, the multi-screen terminal may display the second display panel on the second display panel in response to the first instruction input by the user when the first display panel displays the first GUI including the first display object. A partial GUI of a first display object or a second GUI of all images (ie, second display objects) in a GUI. That is, the first display panel and the second display panel can interactively display the content currently displayed by the other party, and the content displayed by the first display panel and the second display panel is in contact with each other, and can be implemented between multiple display screens of the multi-screen terminal. The interaction can improve the user experience in the process of human-computer interaction.
结合第一方面,在第一种可能的实现方式中,当第二显示对象包括第一显示对象的部分图像时,上述“响应于所述第一指令,在所述第二显示面板显 示包括所述第二显示对象的第二GUI”可以包括:响应于所述第一指令,在所述第一显示面板所显示的所述第一GUI上显示以所述起点坐标为中心点的图像选择窗口,并在所述第二显示面板显示所述图像选择窗口所包围的图像。其中,所述图像选择窗口所包围的图像为所述第二显示对象。With reference to the first aspect, in a first possible implementation manner, when the second display object includes a partial image of the first display object, the foregoing “in response to the first instruction, displaying in the second display panel The displaying the second GUI including the second display object may include: displaying, on the first GUI displayed by the first display panel, a center point of the starting point coordinate in response to the first instruction An image selection window is displayed, and an image surrounded by the image selection window is displayed on the second display panel, wherein the image surrounded by the image selection window is the second display object.
可以理解,由于第一指令为用户的第一操作触发的指令,而第一操作是滑动轨迹的起点坐标为第二显示对象所在坐标位置、终点坐标为所述演示图标所在坐标位置的连续性滑动操作;因此,多屏终端可以在用户手指接触滑动轨迹的起点坐标时,便在第一GUI上显示以该起点坐标为中心点的图像选择窗口,然后将第一显示对象中、该图像选择窗口所包围的图像确定为第二显示对象。其中,上述图像选择窗口可以为一个预设形状的显示窗口,该图像选择窗口不会遮挡该图像选择窗口在第一GUI中所处位置处的图像。It can be understood that, because the first instruction is an instruction triggered by the first operation of the user, and the first operation is that the starting coordinate of the sliding track is the coordinate position of the second display object, and the coordinate of the end point is the continuity sliding of the coordinate position of the presentation icon. Operation; therefore, the multi-screen terminal can display an image selection window centered on the starting point coordinate on the first GUI when the user's finger touches the starting point coordinate of the sliding track, and then the first display object, the image selection window The enclosed image is determined to be the second display object. The image selection window may be a display window of a preset shape, and the image selection window does not block the image of the image selection window at the position in the first GUI.
结合第一方面的第一种可能的实现方式,在第二种可能的实现方式中,上述图像选择窗口在第一GUI中可移动。具体的,在上述“响应于所述第一指令,在所述第二显示面板显示包括所述第二显示对象的第二GUI”之后,本发明实施例的方法还可以包括:获取用户在所述第一GUI上输入的第二指令,该第二指令为用于触发多屏终端在第一显示面板上移动所述图像选择窗口的指令;响应于该第二指令,按照该第二指令所指示的移动轨迹,在所述第一显示面板所显示的第一GUI上显示动态移动的图像选择窗口,并在所述第二显示面板显示包括第三显示对象的第三GUI。其中,上述第三显示对象为所述图像选择窗口在所述移动轨迹的终点坐标处所包围的图像。例如,上述第二指令可以为用户对第一显示面板上显示的图像选择窗口的拖拽指令。In conjunction with the first possible implementation of the first aspect, in a second possible implementation, the image selection window is movable in the first GUI. Specifically, after the method of displaying the second GUI that includes the second display object in the second display panel in response to the first instruction, the method of the embodiment of the present invention may further include: acquiring the user in the a second instruction input on the first GUI, the second instruction is an instruction for triggering the multi-screen terminal to move the image selection window on the first display panel; and in response to the second instruction, according to the second instruction The indicated movement track displays a dynamically moving image selection window on the first GUI displayed by the first display panel, and displays a third GUI including the third display object on the second display panel. The third display object is an image surrounded by the image selection window at an end point coordinate of the movement track. For example, the second instruction may be a drag command of the user to select a window for the image displayed on the first display panel.
其中,多屏终端可以响应于该第二指令,按照第二指令对应的移动轨迹,在第一显示面板在第一GUI上动态显示图像选择窗口,如此,图像选择窗口在第一GUI中所包围的图像则会发生变化,如此,多屏终端便可以响应于上述第二指令,在第二显示面板上向用户展示第一GUI的不同细节。The multi-screen terminal can dynamically display the image selection window on the first GUI in the first display panel according to the second instruction, according to the second instruction, so that the image selection window is surrounded by the first GUI. The image may change, such that the multi-screen terminal may display different details of the first GUI to the user on the second display panel in response to the second instruction.
结合第一方面或者上述任一种可能的实现方式,在第三种可能的实现方式中,多屏终端可以在第二显示包括动态变化的第二显示对象的第二GUI,以提高用户视觉体验。具体的,上述“在所述第二显示面板显示包括所述第二显示对象的第二GUI”可以包括:在所述第二显示面板显示包括所述第二显示对象由小逐渐变大的动态图像的第二GUI;或者,根据所述起点坐标与所述终点坐标的直线距离,在所述第二显示面板显示包括与所述直线距离对应大小的第二显示对象的第二GUI,其中,直线距离越长,所述第二GUI中的所述第二显示对象则越大,或者所述直线距离越长,所述第二GUI中的第二显示对象则越小。In combination with the first aspect or any of the foregoing possible implementation manners, in a third possible implementation manner, the multi-screen terminal may display the second GUI including the dynamically changing second display object in the second display to improve the user visual experience. . Specifically, the “displaying the second GUI including the second display object in the second display panel” may include: displaying, on the second display panel, a dynamic that includes the second display object gradually increasing from small to large a second GUI of the image; or, according to a linear distance between the start point coordinate and the end point coordinate, displaying, on the second display panel, a second GUI including a second display object having a size corresponding to the straight line distance, wherein The longer the linear distance is, the larger the second display object in the second GUI is, or the longer the linear distance is, the smaller the second display object in the second GUI is.
结合第一方面和上述任一种可能的实现方式,在第四种可能的实现方式中,为了可以更加直观的在第一显示面板向用户提示多屏终端在第二显示面板所显示的显示对象是第一显示对象的哪部分图像。在多屏终端响应于所述第一指令,在所述第二显示面板显示包括所述第二显示对象的第二GUI之后,本申请的方法方法还可以包括:在所述第一显示面板上突出显示所述第二显 示对象。With reference to the first aspect and any of the foregoing possible implementation manners, in a fourth possible implementation manner, in order to more intuitively display the display object displayed by the multi-screen terminal on the second display panel to the user in the first display panel Which part of the image of the first display object is the image. After the second display panel displays the second GUI including the second display object, the method method of the present application may further include: on the first display panel, in the multi-screen terminal, in response to the first instruction Highlight the second display Show object.
第二方面,本申请还提供一种多屏终端,该多屏终端包括:第一显示模块、获取模块和第二显示模块。其中,第一显示模块,用于显示第一GUI,所述第一GUI中包括所述第二显示面板的演示图标和第一显示对象;获取模块,用于获取用户在所述所述第一显示模块所显示的所述第一GUI上输入的第一指令,所述第一指令为用户的第一操作触发的指令,所述第一操作是滑动轨迹的起点坐标为第二显示对象所在坐标位置、终点坐标为所述演示图标所在坐标位置的连续性滑动操作;所述第二显示模块,用于响应于所述第一指令,显示包括所述第二显示对象的第二GUI,所述第二显示对象包括所述第一显示模块所显示的所述第一显示对象的全部图像,或者所述第二显示对象包括所述第一显示对象的部分图像,或者所述第一显示对象包括至少两个子显示对象,所述第二显示对象为所述至少两个子显示对象中的一个子显示对象。In a second aspect, the present application further provides a multi-screen terminal, where the multi-screen terminal includes: a first display module, an acquisition module, and a second display module. The first display module is configured to display a first GUI, where the first GUI includes a presentation icon and a first display object of the second display panel, and an acquiring module, configured to acquire a user at the first Displaying, by the module, the first instruction input on the first GUI, the first instruction is an instruction triggered by a first operation of the user, and the first operation is a coordinate of a starting point of the sliding track being a coordinate of the second display object The position and the end point coordinate are a continuous sliding operation of the coordinate position of the presentation icon; the second display module is configured to display a second GUI including the second display object in response to the first instruction, The second display object includes all images of the first display object displayed by the first display module, or the second display object includes a partial image of the first display object, or the first display object includes At least two child display objects, the second display object being one of the at least two child display objects.
结合第二方面,在第一种可能的实现方式中,上述第二显示对象包括所述第一显示对象的部分图像。所述第一显示模块,用于响应于所述获取模块获取的所述第一指令,在所述第一GUI上显示以所述起点坐标为中心点的图像选择窗口。所述第二显示模块,用于响应于所述获取模块获取的所述第一指令,显示所述图像选择窗口所包围的图像;其中,所述图像选择窗口所包围的图像为所述第二显示对象。In conjunction with the second aspect, in a first possible implementation, the second display object includes a partial image of the first display object. The first display module is configured to display an image selection window with the starting point coordinate as a center point on the first GUI in response to the first instruction acquired by the acquiring module. The second display module is configured to display an image surrounded by the image selection window in response to the first instruction acquired by the acquisition module, where the image surrounded by the image selection window is the second Display object.
结合第二方面的第一种可能的实现方式,在第二种可能的实现方式中,上述获取模块,还用于在所述第二显示模块响应于所述第一指令,显示包括所述第二显示对象的第二GUI之后,获取用户在所述第一GUI上输入的第二指令,所述第二指令为用于触发所述多屏终端在所述第一显示面板上移动所述图像选择窗口的指令。所述第一显示模块,还用于响应于所述获取模块获取的所述第二指令,按照所述第二指令所指示的移动轨迹,在所述第一GUI上显示动态移动的图像选择窗口。所述第二显示模块,还用于响应于所述获取模块获取的所述第二指令,显示包括第三显示对象的第三GUI。其中,所述第三显示对象为所述图像选择窗口在所述移动轨迹的终点坐标处所包围的图像。With reference to the first possible implementation of the second aspect, in a second possible implementation, the acquiring module is further configured to: when the second display module is responsive to the first instruction, display, including the After displaying the second GUI of the object, acquiring a second instruction input by the user on the first GUI, where the second instruction is used to trigger the multi-screen terminal to move the image on the first display panel Select the instruction of the window. The first display module is further configured to display a dynamically moving image selection window on the first GUI according to the movement trajectory indicated by the second instruction, in response to the second instruction acquired by the acquisition module. . The second display module is further configured to display a third GUI that includes the third display object in response to the second instruction acquired by the acquiring module. The third display object is an image surrounded by the image selection window at an end point coordinate of the movement track.
结合第二方面或者上述任一种可能的实现方式,在第三种可能的实现方式中,上述“第二显示模块,用于显示包括所述第二显示对象的第二GUI”可以包括:上述第二显示模块,用于:显示包括所述第二显示对象由小逐渐变大的动态图像的第二GUI;或者,根据所述起点坐标与所述终点坐标的直线距离,显示包括与所述直线距离对应大小的第二显示对象的第二GUI。其中,直线距离越长,所述第二GUI中的所述第二显示对象则越大,或者所述直线距离越长,所述第二GUI中的第二显示对象则越小。With reference to the second aspect, or any one of the foregoing possible implementation manners, in the third possible implementation, the foregoing “the second display module, configured to display the second GUI that includes the second display object” may include: a second display module, configured to: display a second GUI that includes the dynamic image that the second display object is gradually enlarged from a small size; or, according to a linear distance between the start point coordinate and the end point coordinate, the display includes The second GUI of the second display object of the corresponding size of the straight line. The longer the linear distance is, the larger the second display object in the second GUI is, or the longer the linear distance is, the smaller the second display object in the second GUI is.
结合第二方面或者上述任一种可能的实现方式,在第四种可能的实现方式中,上述第一显示模块,还用于响应于所述第一指令,突出显示所述第二显示对象。 In conjunction with the second aspect, or any one of the foregoing possible implementations, in a fourth possible implementation, the first display module is further configured to: when the first instruction is highlighted, highlight the second display object.
第三方面,本申请提供一种多屏终端,该多屏终端包括:第一显示面板、第二显示面板、处理器和存储器。其中,存储器用于存储计算机程序代码,所述计算机程序代码包括指令,当所述处理器执行所述指令时,所述多屏终端执行如第一方面所述的多屏显示的方法,在所述第一显示面板和所述第二显示面板显示GUI。In a third aspect, the present application provides a multi-screen terminal including: a first display panel, a second display panel, a processor, and a memory. Wherein the memory is for storing computer program code, the computer program code comprising instructions, when the processor executes the instruction, the multi-screen terminal performs the multi-screen display method according to the first aspect, The first display panel and the second display panel display a GUI.
具体的,上述第一显示面板,用于显示第一GUI,所述第一GUI中包括所述第二显示面板的演示图标和第一显示对象。处理器,用于获取用户在所述所述第一显示面板所显示的第一GUI上输入的第一指令,所述第一指令为用户的第一操作触发的指令,所述第一操作是滑动轨迹的起点坐标为第二显示对象所在坐标位置、终点坐标为所述演示图标所在坐标位置的连续性滑动操作。第二显示面板,用于响应于所述第一指令,显示包括所述第二显示对象的第二GUI,所述第二显示对象包括所述第一显示对象的全部图像,或者所述第二显示对象包括所述第一显示对象的部分图像,或者所述第一显示对象包括至少两个子显示对象,所述第二显示对象为所述至少两个子显示对象中的一个子显示对象。Specifically, the first display panel is configured to display a first GUI, and the first GUI includes a presentation icon and a first display object of the second display panel. a processor, configured to acquire a first instruction input by the user on the first GUI displayed by the first display panel, where the first instruction is an instruction triggered by a first operation of the user, and the first operation is The starting point coordinate of the sliding track is a continuous sliding operation in which the coordinate position of the second display object and the coordinates of the end point are the coordinate positions of the presentation icon. a second display panel, configured to display, in response to the first instruction, a second GUI including the second display object, the second display object including all images of the first display object, or the second The display object includes a partial image of the first display object, or the first display object includes at least two sub-display objects, and the second display object is one of the at least two sub-display objects.
结合第三方面,在第一种可能的实现方式中,所述第二显示对象包括所述第一显示对象的部分图像。上述第一显示面板,还用于响应于所述第一指令,在所述第一GUI上显示以所述起点坐标为中心点的图像选择窗口。上述“第二显示面板,用于响应于所述第一指令,显示包括所述第二显示对象的第二GUI”可以包括:所述第二显示面板,用于响应于所述第一指令,显示所述图像选择窗口所包围的图像。其中,所述图像选择窗口所包围的图像为所述第二显示对象。In conjunction with the third aspect, in a first possible implementation, the second display object includes a partial image of the first display object. The first display panel is further configured to display, on the first GUI, an image selection window centered on the starting point coordinate in response to the first instruction. The “second display panel for displaying the second GUI including the second display object in response to the first instruction” may include: the second display panel, in response to the first instruction, An image surrounded by the image selection window is displayed. The image surrounded by the image selection window is the second display object.
结合第三方面的第一种可能的实现方式,在第二种可能的实现方式中,上述处理器,还用于在所述第二显示面板响应于所述第一指令,显示包括所述第二显示对象的第二GUI之后,获取用户在所述第一GUI上输入的第二指令,所述第二指令为用于触发所述多屏终端在所述第一显示面板上移动所述图像选择窗口的指令。上述第一显示面板,还用于响应于所述第二指令,按照所述第二指令所指示的移动轨迹,在所述第一GUI上显示动态移动的图像选择窗口。上述第二显示面板,还用于响应于所述第二指令,显示包括第三显示对象的第三GUI。其中,所述第三显示对象为所述图像选择窗口在所述移动轨迹的终点坐标处所包围的图像。In conjunction with the first possible implementation of the third aspect, in a second possible implementation, the processor is further configured to display, in the second display panel, the first instruction, including the first After displaying the second GUI of the object, acquiring a second instruction input by the user on the first GUI, where the second instruction is used to trigger the multi-screen terminal to move the image on the first display panel Select the instruction of the window. The first display panel is further configured to display a dynamically moving image selection window on the first GUI according to the movement trajectory indicated by the second instruction in response to the second instruction. The second display panel is further configured to display a third GUI that includes the third display object in response to the second instruction. The third display object is an image surrounded by the image selection window at an end point coordinate of the movement track.
结合第三方面或者上述任一种可能的实现方式,在第三种可能的实现方式中,上述“第二显示面板,用于显示包括所述第二显示对象的第二GUI”可以包括:第二显示面板,用于显示包括所述第二显示对象由小逐渐变大的动态图像的第二GUI;或者,第二显示面板,用于根据所述起点坐标与所述终点坐标的直线距离,在所述第二显示面板显示包括与所述直线距离对应大小的第二显示对象的第二GUI,其中,直线距离越长,所述第二GUI中的所述第二显示对象则越大,或者所述直线距离越长,所述第二GUI中的第二显示对象则越小。 With reference to the third aspect, or any one of the foregoing possible implementation manners, in the third possible implementation, the “second display panel for displaying the second GUI that includes the second display object” may include: a second display panel, configured to display a second GUI that includes a dynamic image in which the second display object is gradually enlarged from a small size; or a second display panel, configured to use a linear distance from the start point coordinate and the end point coordinate, Displaying, on the second display panel, a second GUI that includes a second display object of a size corresponding to the linear distance, wherein the longer the linear distance is, the larger the second display object in the second GUI is. Or the longer the linear distance, the smaller the second display object in the second GUI.
结合第三方面或者上述任一种可能的实现方式,在第四种可能的实现方式中,上述第一显示面板,还用于响应于所述第一指令,突出显示所述第二显示对象。In conjunction with the third aspect, or any one of the foregoing possible implementations, in a fourth possible implementation, the first display panel is further configured to highlight the second display object in response to the first instruction.
其中,本申请第二方面中所述的第一显示模块为第一方面和第三方面所述的第一显示面板,第二方面中所述的第二显示模块为第一方面和第三方面所述的第二显示面板。The first display module described in the second aspect of the present application is the first display panel of the first aspect and the third aspect, and the second display module of the second aspect is the first aspect and the third aspect The second display panel.
第四方面,本申请提供一种计算机存储介质,该计算机存储介质包括计算机指令,当所述计算机指令在多屏终端上运行时,使得所述多屏终端执行如第一方面或者第一方面的任一种可能的实现方式所述的多屏显示的方法。In a fourth aspect, the present application provides a computer storage medium, comprising: computer instructions, when the computer instruction is run on a multi-screen terminal, causing the multi-screen terminal to perform the first aspect or the first aspect A method of multi-screen display as described in any of the possible implementations.
第五方面,本申请还提供了一种计算机程序产品,当该计算机程序产品在计算机上运行时,使得计算机执行上述本申请第一方面或者第一方面的任一种可能的实现方式所述的多屏显示的方法。In a fifth aspect, the present application further provides a computer program product, when the computer program product is run on a computer, causing the computer to perform the above-described first aspect of the present application or any of the possible implementation manners of the first aspect Multi-screen display method.
可以理解地,上述提供的第二方面所述的多屏终端和第三方面所述的多屏终端、第四方面所述的计算机存储介质或者第五方面所述的计算机程序产品均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。It is to be understood that the multi-screen terminal according to the second aspect, the multi-screen terminal of the third aspect, the computer storage medium of the fourth aspect, or the computer program product of the fifth aspect are all used for execution. The corresponding methods provided above, and therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding methods provided above, and are not described herein again.
第六方面,本申请提供一种多屏显示的方法,可以应用于多屏终端,该多屏终端包括第一显示面板和第二显示面板,该多屏显示的方法可以包括:在上述第一显示面板显示包括第一显示对象的第一GUI,该第一显示对象是第一显示任务中的显示对象,该第一显示任务是第一时间添加至第一任务窗口中的显示任务;在第二显示面板显示包括第二显示对象的第二GUI,该第二显示对象是第二显示任务中的显示对象,该第二显示任务是第二任务窗口中的显示任务;获取用户在第一GUI上输入的第一指令,该第一指令用于触发多屏终端在第二显示面板显示包括第一显示面板当前显示的第一显示对象的GUI;响应于第一指令,在第二显示面板显示包括第一显示对象的第三GUI,并在第一显示面板显示包括第三显示对象的第四GUI。In a sixth aspect, the present application provides a multi-screen display method, which can be applied to a multi-screen terminal, where the multi-screen terminal includes a first display panel and a second display panel, and the multi-screen display method can include: The display panel displays a first GUI including a first display object, the first display object is a display object in the first display task, and the first display task is a display task added to the first task window at a first time; The second display panel displays a second GUI including a second display object, the second display object is a display object in the second display task, the second display task is a display task in the second task window; acquiring the user in the first GUI a first instruction inputting, the first instruction is used to trigger the multi-screen terminal to display a GUI including a first display object currently displayed by the first display panel on the second display panel; and displayed on the second display panel in response to the first instruction A third GUI including the first display object is displayed, and a fourth GUI including the third display object is displayed on the first display panel.
其中,上述第三显示对象是第三显示任务对应的显示对象,该第三显示任务是第二时间添加至上述第一任务窗口中的显示任务,第二时间早于第一时间,且第二时间晚于第一任务窗口中的其他显示任务的添加时间;或者,第三显示对象为预先设置的显示对象。The third display object is a display object corresponding to the third display task, and the third display task is added to the display task in the first task window at a second time, the second time is earlier than the first time, and the second time The time is later than the addition time of other display tasks in the first task window; or, the third display object is a preset display object.
本申请提供的多屏显示的方法,多屏终端中可以设置两个独立的任务窗口,每个任务窗口对应于一个显示面板,如第一显示面板用于显示第一任务窗口中的最新添加的额显示任务对应的GUI,第二显示面板用于显示第二任务窗口中的最新添加的额显示任务对应的GUI。如此,多屏终端便可以通过显示任务在上述两个任务窗口的切换,在第二显示面板显示包括第一显示面板当前显示的第一显示对象的GUI,在第一显示面板显示包括第二显示面板当前显示的第二显示对象的GUI,即可以实现该多屏终端的两个显示屏显示内容的交互,可以提高人机交互过程中的用户体验。In the multi-screen display method provided by the present application, two independent task windows can be set in the multi-screen terminal, and each task window corresponds to one display panel, for example, the first display panel is used to display the latest added in the first task window. The GUI corresponding to the task is displayed, and the second display panel is configured to display a GUI corresponding to the newly added amount display task in the second task window. In this way, the multi-screen terminal can display the GUI including the first display object currently displayed by the first display panel in the second display panel by switching the display task in the two task windows, and display the second display on the first display panel. The GUI of the second display object currently displayed by the panel, that is, the interaction between the two display screens of the multi-screen terminal can be realized, and the user experience in the process of human-computer interaction can be improved.
结合第六方面,在第一种可能的实现方式中,上述第一GUI中还可以包 括上述第二任务窗口的图标。上述第一指令可以是用户的第一操作触发的指令,该第一操作是滑动轨迹的起点坐标为上述第一显示对象所在坐标位置、终端坐标为上述第二任务窗口的图标所在坐标位置的连续性滑动操作,该第一指令用于指示多屏终端将第一显示任务添加至第二任务窗口。With reference to the sixth aspect, in the first possible implementation manner, the foregoing first GUI may also include The icon of the second task window mentioned above. The first instruction may be an instruction triggered by the first operation of the user, where the first operation is that the starting point coordinate of the sliding track is the coordinate position of the first display object, and the terminal coordinate is the coordinate position of the icon of the second task window. a sliding operation, the first instruction is used to instruct the multi-screen terminal to add the first display task to the second task window.
结合第六方面或者第六方面的第一种可能的实现方式,在第二种可能的实现方式中上述第一GUI、第二GUI、第三GUI和第四GUI中还可以包括第一任务窗口的图标和第二任务窗口的图标。在这种实现方式中,多屏终端可以在第一显示面板和第二显示面板显示包括第一显示对象的动态图像的GUI。具体的,上述“响应于所述第一指令,在所述第二显示面板显示包括所述第一显示对象的第三GUI,并在所述第一显示面板显示包括第三显示对象的第四GUI”可以包括:响应于所述第一指令,在所述第二显示面板显示包括第一动态图像的第三GUI,并在所述第一显示面板显示包括第二动态图像的第四GUI。其中,所述第一动态图像为所述第一显示对象按照第一预设移动轨迹移动、且所述第一显示对象在移动过程中由小逐渐变大的动态图像,所述第一预设移动轨迹的起点坐标为所述第三GUI中的所述第一任务窗口的图标所在的坐标位置,所述第一预设移动轨迹的终点坐标为所述第三GUI中用于显示显示对象的坐标位置;所述第二动态图像为所述第三显示对象按照第二预设移动轨迹移动、且所述第三显示对象在移动过程中由小逐渐变大的动态图像,所述第二预设移动轨迹的起点坐标为所述第四GUI中的所述第一任务窗口的图标所在的坐标位置,所述第二预设移动轨迹的终点坐标为所述第四GUI中用于显示显示对象的坐标位置。With reference to the sixth aspect, or the first possible implementation manner of the sixth aspect, in the second possible implementation manner, the first task window, the second GUI, the third GUI, and the fourth GUI may further include a first task window. Icon and second task window icon. In this implementation, the multi-screen terminal may display a GUI including a dynamic image of the first display object on the first display panel and the second display panel. Specifically, the foregoing “displaying, in response to the first instruction, a third GUI including the first display object on the second display panel, and displaying a fourth display object including the third display object on the first display panel The GUI may include: displaying, in response to the first instruction, a third GUI including the first dynamic image on the second display panel, and displaying a fourth GUI including the second dynamic image on the first display panel. The first dynamic image is a dynamic image in which the first display object moves according to a first preset movement trajectory, and the first display object gradually increases from small to small during the movement, the first preset The starting point coordinate of the moving track is the coordinate position of the icon of the first task window in the third GUI, and the end point coordinate of the first preset moving track is used to display the display object in the third GUI. a coordinate position; the second dynamic image is a dynamic image in which the third display object moves according to a second preset movement trajectory, and the third display object gradually becomes larger during the movement, the second pre- The starting point coordinate of the moving track is the coordinate position of the icon of the first task window in the fourth GUI, and the end point coordinate of the second preset moving track is used to display the display object in the fourth GUI. The coordinate position.
其中,由于第一显示面板所显示的第三显示对象在第一显示面板上的移动轨迹的起点坐标为第一任务窗口的图标,因此,用户可以确定第一显示面板当前所显示的第一显示对象是第一显示面板的显示任务对应的显示对象,而非从第二显示面板切换过来的显示任务对应的显示对象。Wherein, since the starting point coordinate of the movement track of the third display object displayed on the first display panel by the first display panel is the icon of the first task window, the user can determine the first display currently displayed by the first display panel. The object is a display object corresponding to the display task of the first display panel, and is not a display object corresponding to the display task switched from the second display panel.
由于第二显示面板所显示的第一显示对象在第二显示面板上的移动轨迹的起点坐标为第一任务窗口的图标,而非第二任务窗口的图标;因此,用户可以确定第二显示面板当前所显示的第一显示对象不是第二显示面板的显示任务对应的显示对象,而是从第一显示面板切换过来的显示任务对应的显示对象。The starting point coordinate of the movement track of the first display object displayed on the second display panel by the second display panel is an icon of the first task window instead of the icon of the second task window; therefore, the user can determine the second display panel The currently displayed first display object is not a display object corresponding to the display task of the second display panel, but a display object corresponding to the display task switched from the first display panel.
并且,在切换第一显示面板和第二显示面板的显示对象的过程中,通过动态的方式向用户呈现显示对象,可以提高用户的视觉体验。Moreover, in the process of switching the display objects of the first display panel and the second display panel, the display object is presented to the user in a dynamic manner, and the visual experience of the user can be improved.
结合第六方面或者上述任一种可能的实现方式,在第三种可能的实现方式中,在上述“在第一显示面板显示包括第一显示对象的第一GUI”之前,本申请的方法还可以包括:获取用户输入的第二指令,该第二指令为用于触发多屏终端打开第一应用的指令,上述第一GUI为该第一应用的界面;上述“在第一显示面板显示包括第一显示对象的第一GUI”可以包括:响应于所述第二指令,在所述第一显示面板显示包括第一显示对象的第一GUI。With reference to the sixth aspect, or any one of the foregoing possible implementation manners, in the third possible implementation manner, before the foregoing “displaying the first GUI including the first display object in the first display panel”, the method of the present application further The method may include: acquiring a second instruction input by the user, where the second instruction is an instruction for triggering the multi-screen terminal to open the first application, where the first GUI is an interface of the first application; The first GUI of the first display object may include: displaying, in the first display panel, a first GUI including the first display object in response to the second instruction.
其中,第二指令还用于触发所述多屏终端在第一显示面板上显示第一 GUI,或者,第一显示面板为预先配置的用于显示第一应用的界面的显示面板。The second instruction is further configured to trigger the multi-screen terminal to display the first on the first display panel. The GUI, or the first display panel is a pre-configured display panel for displaying an interface of the first application.
结合第六方面的第五种可能的实现方式,在第六种可能的实现方式中,上述第一任务窗口为第一窗口堆栈,该第一窗口堆栈用于按照先进后出的原则保存压入该第一窗口堆栈的显示任务,该第一显示面板用于显示第一窗口堆栈的栈顶的显示任务对应的GUI。上述第二任务窗口为第二窗口堆栈,该第二窗口堆栈用于按照先进后出的原则保存压入第二窗口堆栈的显示任务,上述第二显示面板用于显示第二窗口堆栈的栈顶的显示任务对应的GUI。With reference to the fifth possible implementation manner of the sixth aspect, in a sixth possible implementation, the first task window is a first window stack, where the first window stack is used to save the press in accordance with the principle of advanced output a display task of the first window stack, the first display panel is configured to display a GUI corresponding to a display task of a stack top of the first window stack. The second task window is a second window stack, and the second window stack is configured to save a display task pressed into the second window stack according to the principle of advanced output, and the second display panel is configured to display the top of the second window stack The GUI that displays the task.
其中,由于第一显示面板用于显示第一窗口堆栈的栈顶的显示任务对应的GUI,第二显示面板用于显示第二窗口堆栈的栈顶的显示任务对应的GUI;因此,多屏终端可以通过将第一窗口堆栈的栈顶的显示任务(即第一显示任务)从第一窗口堆栈出栈,并将第一显示任务压入第二窗口堆栈的栈顶,便可以在第二显示面板显示第一显示任务对应的GUI,即可以实现第一显示面板和第二显示面板的交互,并且可以简化第一显示面板和第二显示面板的交互过程。Wherein, the first display panel is configured to display a GUI corresponding to the display task of the top of the stack of the first window stack, and the second display panel is configured to display a GUI corresponding to the display task of the top of the stack of the second window stack; therefore, the multi-screen terminal The second display may be performed by stacking the display task of the top of the first window stack (ie, the first display task) from the first window stack and pushing the first display task onto the top of the second window stack. The panel displays the GUI corresponding to the first display task, that is, the interaction between the first display panel and the second display panel can be implemented, and the interaction process between the first display panel and the second display panel can be simplified.
第七方面,本申请提供一种多屏终端,该多屏终端包括:第一显示模块、第二显示模块和获取模块。其中,第一显示模块,用于显示包括第一显示对象的第一用户图形界面GUI,所述第一显示对象是第一显示任务中的显示对象,所述第一显示任务是第一时间添加至第一任务窗口中的显示任务。第二显示模块,用于显示包括第二显示对象的第二GUI,所述第二显示对象是第二显示任务中的显示对象,所述第二显示任务是第二任务窗口中的显示任务。获取模块,用于获取用户在所述第一显示模块所显示的所述第一GUI上输入的第一指令,所述第一指令用于触发所述第二显示模块显示包括所述第一显示模块当前显示的所述第一显示对象的GUI。所述第二显示模块,还用于响应于所述获取模块获取的所述第一指令,显示包括所述第一显示对象的第三GUI。所述第一显示模块,还用于响应于所述获取模块获取的所述第一指令,显示包括第三显示对象的第四GUI。其中,所述第三显示对象是第三显示任务对应的显示对象,所述第三显示任务是第二时间添加至所述第一任务窗口中的显示任务,所述第二时间早于所述第一时间,且所述第二时间晚于所述第一任务窗口中的其他显示任务的添加时间;或者,所述第三显示对象为预先设置的显示对象。In a seventh aspect, the application provides a multi-screen terminal, where the multi-screen terminal includes: a first display module, a second display module, and an acquisition module. The first display module is configured to display a first user graphical interface GUI including a first display object, where the first display object is a display object in the first display task, and the first display task is added at a first time To the display task in the first task window. The second display module is configured to display a second GUI that includes a second display object, the second display object is a display object in the second display task, and the second display task is a display task in the second task window. An acquiring module, configured to acquire a first instruction input by the user on the first GUI displayed by the first display module, where the first instruction is used to trigger the second display module to display the first display The GUI of the first display object currently displayed by the module. The second display module is further configured to display a third GUI that includes the first display object in response to the first instruction acquired by the acquiring module. The first display module is further configured to display a fourth GUI that includes the third display object in response to the first instruction acquired by the acquiring module. The third display object is a display object corresponding to the third display task, and the third display task is a display task added to the first task window at a second time, the second time is earlier than the The first time, and the second time is later than the addition time of the other display tasks in the first task window; or the third display object is a preset display object.
结合第七方面,在第一种可能的实现方式中,上述第一GUI中还可以包括所述第二任务窗口的图标。所述第一指令是用户的第一操作触发的指令,所述第一操作是滑动轨迹的起点坐标为所述第一显示对象所在坐标位置、终端坐标为所述第二任务窗口的图标所在坐标位置的连续性滑动操作,所述第一指令用于指示所述多屏终端将所述第一显示任务添加至所述第二任务窗口。In conjunction with the seventh aspect, in a first possible implementation, the first GUI may further include an icon of the second task window. The first instruction is an instruction triggered by a first operation of the user, where the first operation is that the coordinate of the starting point of the sliding track is the coordinate position of the first display object, and the coordinates of the terminal are the coordinates of the icon of the second task window. a continuous sliding operation of the location, the first instruction being used to instruct the multi-screen terminal to add the first display task to the second task window.
结合第七方面或者第一种可能的实现方式,在第二种可能的实现方式中,上述第一GUI、第二GUI、第三GUI和第四GUI中还可以包括第一任务窗口的图标和第二任务窗口的图标。上述“第二显示模块,用于响应于所述获取模块获取的所述第一指令,显示包括所述第一显示对象的第三GUI”可以包括: 所述第二显示模块,用于响应于所述第一指令,显示包括第一动态图像的第三GUI。上述“第一显示模块,用于响应于所述获取模块获取的所述第一指令,显示包括第三显示对象的第四GUI”可以包括:所述第一显示模块,用于响应于所述第一指令,显示包括第二动态图像的第四GUI。With reference to the seventh aspect or the first possible implementation manner, in the second possible implementation manner, the foregoing first GUI, the second GUI, the third GUI, and the fourth GUI may further include an icon of the first task window and The icon for the second task window. The “second display module, in response to the first instruction acquired by the acquiring module, displaying the third GUI including the first display object” may include: The second display module is configured to display a third GUI that includes the first dynamic image in response to the first instruction. The “first display module, configured to display the fourth GUI including the third display object in response to the first instruction acquired by the acquisition module” may include: the first display module, configured to respond to the The first instruction displays a fourth GUI including the second dynamic image.
结合第七方面或者上述任一种可能的实现方式,在第三种可能的实现方式中,上述获取模块,还用于在所述第一显示模块显示所述第一GUI之前,获取用户输入的第二指令,所述第二指令为用于触发所述多屏终端打开第一应用的指令,所述第一GUI为所述第一应用的界面。上述“第一显示模块,用于显示所述第一GUI”可以包括:所述第一显示模块,用于响应于所述获取模块获取的所述第二指令,显示包括第一显示对象的第一GUI。With reference to the seventh aspect, or any one of the foregoing possible implementation manners, in a third possible implementation, the acquiring module is further configured to acquire a user input before the first display module displays the first GUI. And a second instruction, where the second instruction is an instruction for triggering the multi-screen terminal to open the first application, where the first GUI is an interface of the first application. The “first display module, for displaying the first GUI” may include: the first display module, configured to display, according to the second instruction acquired by the acquiring module, a first display object A GUI.
第八方面,本申请提供一种多屏终端,该多屏终端包括:第一显示面板、第二显示面板、处理器和存储器。其中,存储器用于存储计算机程序代码,所述计算机程序代码包括指令,当所述处理器执行所述指令时,所述多屏终端执行如第六方面所述的多屏显示的方法,在所述第一显示面板和所述第二显示面板显示GUI。In an eighth aspect, the present application provides a multi-screen terminal, including: a first display panel, a second display panel, a processor, and a memory. Wherein the memory is for storing computer program code, the computer program code comprising instructions, when the processor executes the instruction, the multi-screen terminal performs the multi-screen display method according to the sixth aspect, The first display panel and the second display panel display a GUI.
具体的,上述第一显示面板,用于显示包括第一显示对象的第一用户图形界面GUI,所述第一显示对象是第一显示任务中的显示对象,所述第一显示任务是第一时间添加至第一任务窗口中的显示任务。第二显示面板,用于显示包括第二显示对象的第二GUI,所述第二显示对象是第二显示任务中的显示对象,所述第二显示任务是第二任务窗口中的显示任务。处理器,用于获取用户在所述第一GUI上输入的第一指令,所述第一指令用于触发所述多屏终端在所述第二显示面板显示包括所述第一显示面板当前显示的所述第一显示对象的GUI。第二显示面板,用于响应于所述第一指令,显示包括所述第一显示对象的第三GUI。第一显示面板,用于响应于所述第一指令,显示包括第三显示对象的第四GUI。Specifically, the first display panel is configured to display a first user graphical interface GUI including a first display object, the first display object is a display object in the first display task, and the first display task is first Time is added to the display task in the first task window. a second display panel, configured to display a second GUI that includes a second display object, the second display object is a display object in the second display task, and the second display task is a display task in the second task window. a processor, configured to acquire a first instruction input by the user on the first GUI, where the first instruction is used to trigger the multi-screen terminal to display on the second display panel, including the current display of the first display panel The GUI of the first display object. a second display panel, configured to display a third GUI including the first display object in response to the first instruction. The first display panel is configured to display a fourth GUI including the third display object in response to the first instruction.
结合第八方面,在第一种可能的实现方式中,上述第一GUI中还可以包括所述第二任务窗口的图标。上述第一指令是用户的第一操作触发的指令,所述第一操作是滑动轨迹的起点坐标为所述第一显示对象所在坐标位置、终端坐标为所述第二任务窗口的图标所在坐标位置的连续性滑动操作,所述第一指令用于指示所述多屏终端将所述第一显示任务添加至所述第二任务窗口。In conjunction with the eighth aspect, in a first possible implementation, the first GUI may further include an icon of the second task window. The first instruction is an instruction triggered by the first operation of the user, where the first operation is that the starting point coordinate of the sliding track is the coordinate position of the first display object, and the terminal coordinate is the coordinate position of the icon of the second task window. a continuous sliding operation, the first instruction being used to instruct the multi-screen terminal to add the first display task to the second task window.
结合第八方面或者第一种可能的实现方式,在第二种可能的实现方式中,上述第一GUI、第二GUI、第三GUI和第四GUI中还可以包括所述第一任务窗口的图标和所述第二任务窗口的图标。上述“第二显示面板,用于响应于所述第一指令,显示包括所述第一显示对象的第三GUI”可以包括:该第二显示面板,用于响应于所述第一指令,显示包括第一动态图像的第三GUI。上述“第一显示面板,用于响应于所述第一指令,显示包括第三显示对象的第四GUI”可以包括:该第一显示面板,用于显示包括第二动态图像的第四GUI。With reference to the eighth aspect, or the first possible implementation manner, in the second possible implementation manner, the first GUI, the second GUI, the third GUI, and the fourth GUI may further include the first task window. Icon and icon of the second task window. The “second display panel for displaying the third GUI including the first display object in response to the first instruction” may include: the second display panel, configured to display in response to the first instruction A third GUI including the first dynamic image. The “first display panel for displaying the fourth GUI including the third display object in response to the first instruction” may include: the first display panel for displaying the fourth GUI including the second dynamic image.
结合第八方面或者上述任一种可能的实现方式,在第三种可能的实现方式中,上述处理器,还可以用于在所述第一显示面板显示包括第一显示对象 的第一GUI之前,获取用户输入的第二指令,所述第二指令为用于触发所述多屏终端打开第一应用的指令,所述第一GUI为所述第一应用的界面。With reference to the eighth aspect, or any one of the foregoing possible implementation manners, in a third possible implementation, the foregoing processor may be further configured to display, by the first display panel, the first display object Before the first GUI, the second instruction input by the user is obtained, where the second instruction is an instruction for triggering the multi-screen terminal to open the first application, and the first GUI is an interface of the first application.
需要说明的是,本申请第七方面和第八方面或者其任一种可能的实现方式中所述的第三显示对象、第一动态图像、第二动态图像、第一任务窗口、第二任务窗口的详细描述可以参考第六方面中的相关内容,本申请这里不再赘述。It should be noted that the third display object, the first dynamic image, the second dynamic image, the first task window, and the second task described in the seventh aspect and the eighth aspect of the present application or any one of the possible implementation manners of the present application For a detailed description of the window, reference may be made to related content in the sixth aspect, which is not described herein again.
其中,本申请第七方面中所述的第一显示模块为第六方面和第八方面所述的第一显示面板,第七方面中所述的第二显示模块为第六方面和第八方面所述的第二显示面板。The first display module described in the seventh aspect of the present application is the first display panel according to the sixth aspect and the eighth aspect, and the second display module in the seventh aspect is the sixth aspect and the eighth aspect The second display panel.
第九方面,本申请提供一种计算机存储介质,该计算机存储介质包括计算机指令,当所述计算机指令在多屏终端上运行时,使得所述多屏终端执行如第六方面或者第六方面的任一种可能的实现方式所述的多屏显示的方法。In a ninth aspect, the present application provides a computer storage medium, comprising: computer instructions, when the computer instruction is run on a multi-screen terminal, causing the multi-screen terminal to perform the sixth or sixth aspect A method of multi-screen display as described in any of the possible implementations.
第十方面,本申请还提供了一种计算机程序产品,当该计算机程序产品在计算机上运行时,使得计算机执行上述本申请第六方面或者第六方面的任一种可能的实现方式所述的多屏显示的方法。In a tenth aspect, the present application further provides a computer program product, when the computer program product is run on a computer, causing the computer to perform the above-mentioned sixth aspect of the present application or any of the possible implementation manners of the sixth aspect Multi-screen display method.
可以理解地,上述提供的第七方面所述的多屏终端和第八方面所述的多屏终端、第九方面所述的计算机存储介质或者第十方面所述的计算机程序产品均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。It is to be understood that the multi-screen terminal according to the seventh aspect of the present invention, the multi-screen terminal of the eighth aspect, the computer storage medium of the ninth aspect, or the computer program product of the tenth aspect are all used for execution. The corresponding methods provided above, and therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding methods provided above, and are not described herein again.
第十一方面,提供一种多屏显示的方法,可以应用于多屏终端,该多屏终端包括第一显示面板和第二显示面板,该多屏显示的方法可以包括:在第一显示面板上显示第一GUI,该第一GUI中包括第一显示对象;获取用户输入的第一指令,该第一指令用于触发所述多屏终端在第二显示面板显示与第一显示面板相同的显示对象;响应于上述第一指令,在第二显示面板上显示第二GUI,该第二GUI中包括上述第一显示对象。The eleventh aspect provides a method for displaying a multi-screen display, which can be applied to a multi-screen terminal, where the multi-screen terminal includes a first display panel and a second display panel, and the method for displaying the multi-screen can include: Displaying a first GUI, the first GUI includes a first display object, and acquiring a first instruction input by the user, where the first instruction is used to trigger the multi-screen terminal to display the same as the first display panel in the second display panel. Displaying an object; in response to the first instruction, displaying a second GUI on the second display panel, wherein the second GUI includes the first display object.
其中,多屏终端可以响应于第一指令,在第二显示面板显示与第一显示面板相同的显示对象,即该多屏终端的两个显示屏之间可以相互交互,而不是彼此独立,因此可以提高人机交互过程中的用户体验。The multi-screen terminal may display the same display object as the first display panel in the second display panel in response to the first instruction, that is, the two display screens of the multi-screen terminal may interact with each other instead of being independent of each other, Can improve the user experience in the process of human-computer interaction.
第十二方面,提供一种多屏终端,该多屏终端可以包括:第一显示模块、获取模块和第二显示模块。其中,第一显示模块,用于显示第一用户图形界面GUI,所述第一GUI中包括第一显示对象。获取模块,用于获取用户输入的第一指令,所述第一指令用于触发所述多屏终端在第二显示模块显示与所述第一显示模块相同的显示对象。第二显示模块,用于响应于所述获取模块获取的所述第一指令,显示第二GUI,所述第二GUI中包括所述第一显示对象。A twelfth aspect provides a multi-screen terminal, where the multi-screen terminal can include: a first display module, an acquisition module, and a second display module. The first display module is configured to display a first user graphical interface GUI, and the first GUI includes a first display object. And an acquiring module, configured to acquire a first instruction input by the user, where the first instruction is used to trigger the multi-screen terminal to display the same display object as the first display module in the second display module. a second display module, configured to display a second GUI, where the second GUI includes the first display object, in response to the first instruction acquired by the acquiring module.
第十三方面,本申请提供一种多屏终端,该多屏终端包括:第一显示面板、第二显示面板、处理器和存储器。其中,存储器用于存储计算机程序代码,所述计算机程序代码包括指令,当所述处理器执行所述指令时,所述多屏终端执行如第六方面所述的多屏显示的方法,在所述第一显示面板和所述 第二显示面板显示GUI。In a thirteenth aspect, the present application provides a multi-screen terminal, including: a first display panel, a second display panel, a processor, and a memory. Wherein the memory is for storing computer program code, the computer program code comprising instructions, when the processor executes the instruction, the multi-screen terminal performs the multi-screen display method according to the sixth aspect, First display panel and said The second display panel displays the GUI.
具体的,上述第一显示面板,用于显示第一GUI,所述第一GUI中包括第一显示对象;处理器,用于获取用户输入的第一指令,所述第一指令用于触发所述多屏终端在所述第二显示面板显示与所述第一显示面板相同的显示对象。第二显示面板,用于响应于所述处理器获取的所述第一指令,显示第二GUI,所述第二GUI中包括所述第一显示对象。Specifically, the first display panel is configured to display a first GUI, the first GUI includes a first display object, and the processor is configured to acquire a first instruction input by a user, where the first instruction is used to trigger a The multi-screen terminal displays the same display object as the first display panel on the second display panel. a second display panel, configured to display a second GUI, where the second GUI includes the first display object, in response to the first instruction acquired by the processor.
其中,本申请第十二方面中所述的第一显示模块为第十一方面和第十二方面所述的第一显示面板,第十二方面中所述的第二显示模块为第十一方面和第十二方面所述的第二显示面板。The first display module of the twelfth aspect of the present invention is the first display panel of the eleventh aspect and the twelfth aspect, wherein the second display module of the twelfth aspect is the eleventh Aspect and the second display panel of the twelfth aspect.
第十四方面,本申请提供一种计算机存储介质,该计算机存储介质包括计算机指令,当所述计算机指令在多屏终端上运行时,使得所述多屏终端执行如第十一方面或者第十一方面的任一种可能的实现方式所述的多屏显示的方法。In a fourteenth aspect, the present application provides a computer storage medium, comprising: computer instructions, when the computer instruction is run on a multi-screen terminal, causing the multi-screen terminal to perform the eleventh or tenth A method of multi-screen display as described in any of the possible implementations of the aspect.
第十五方面,本申请还提供了一种计算机程序产品,当该计算机程序产品在计算机上运行时,使得计算机执行上述本申请第十一方面或者第十一方面的任一种可能的实现方式所述的多屏显示的方法。In a fifteenth aspect, the present application further provides a computer program product, when the computer program product is run on a computer, causing the computer to perform any one of the possible implementation manners of the eleventh or eleventh aspect of the present application. The method of multi-screen display.
可以理解地,上述提供的第十二方面所述的多屏终端和第十三方面所述的多屏终端、第十四方面所述的计算机存储介质或者第十五方面所述的计算机程序产品均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。The multi-screen terminal according to the twelfth aspect, the multi-screen terminal according to the thirteenth aspect, the computer storage medium of the fourteenth aspect, or the computer program product of the fifteenth aspect Both are used to perform the corresponding methods provided above, and therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding methods provided above, and are not described herein again.
附图说明DRAWINGS
图1为本发明实施例提供的一种双屏终端的双面触摸屏的结构示意图;1 is a schematic structural diagram of a double-sided touch screen of a dual-screen terminal according to an embodiment of the present invention;
图2为本发明实施例提供的一种手机的正面和背面结构组成示意图;2 is a schematic structural diagram of a front and back structure of a mobile phone according to an embodiment of the present invention;
图3为本发明实施例提供的一种手机硬件结构示意图;3 is a schematic structural diagram of a hardware of a mobile phone according to an embodiment of the present invention;
图4为本发明实施例提供的一种多屏终端显示的图形用户界面示意图一;4 is a schematic diagram 1 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention;
图5为本发明实施例提供的一种多屏终端显示的图形用户界面示意图二;FIG. 5 is a schematic diagram 2 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention; FIG.
图6为本发明实施例提供的一种多屏终端显示的图形用户界面示意图三;6 is a schematic diagram 3 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention;
图7为本发明实施例提供的一种多屏终端显示的图形用户界面示意图四;FIG. 7 is a schematic diagram 4 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention; FIG.
图8为本发明实施例提供的一种多屏显示的方法流程图一;FIG. 8 is a flowchart 1 of a method for displaying multi-screen according to an embodiment of the present invention;
图9为本发明实施例提供的一种多屏终端显示的图形用户界面示意图五;FIG. 9 is a schematic diagram 5 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention; FIG.
图10为本发明实施例提供的一种多屏终端显示的图形用户界面示意图六;10 is a schematic diagram 6 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention;
图11为本发明实施例提供的一种多屏终端显示的图形用户界面示意图七;FIG. 11 is a schematic diagram 7 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention; FIG.
图12为本发明实施例提供的一种多屏显示的方法流程图二;FIG. 12 is a flowchart 2 of a method for displaying multi-screen according to an embodiment of the present invention;
图13为本发明实施例提供的一种多屏终端显示的图形用户界面示意图八;FIG. 13 is a schematic diagram 8 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention; FIG.
图14为本发明实施例提供的一种多屏显示的方法流程图三; FIG. 14 is a flowchart 3 of a method for displaying a multi-screen according to an embodiment of the present invention;
图15为本发明实施例提供的一种多屏终端显示的图形用户界面示意图九;FIG. 15 is a schematic diagram 9 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention; FIG.
图16为本发明实施例提供的一种多屏显示的方法流程图四;FIG. 16 is a flowchart 4 of a method for displaying multi-screen according to an embodiment of the present invention;
图17为本发明实施例提供的一种多屏终端显示的图形用户界面示意图十;FIG. 17 is a schematic diagram 10 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention; FIG.
图18为本发明实施例提供的一种多屏终端显示的图形用户界面示意图十一;FIG. 18 is a schematic diagram 11 of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention; FIG.
图19为本发明实施例提供的一种多屏显示的方法流程图五;FIG. 19 is a flowchart 5 of a method for displaying multi-screen according to an embodiment of the present invention;
图20为本发明实施例提供的一种多屏终端显示的图形用户界面示意图十二;20 is a schematic diagram 12 of a graphical user interface displayed by a multi-screen terminal according to an embodiment of the present invention;
图21为本发明实施例提供的一种任务窗口的实例示意图;FIG. 21 is a schematic diagram of an example of a task window according to an embodiment of the present invention;
图22为本发明实施例提供的一种多屏终端显示的图形用户界面示意图十三;FIG. 22 is a schematic diagram of a graphical user interface for displaying a multi-screen terminal according to an embodiment of the present invention; FIG.
图23为本发明实施例提供的一种多屏终端显示的图形用户界面示意图十四;FIG. 23 is a schematic diagram showing a graphical user interface of a multi-screen terminal according to an embodiment of the present invention; FIG.
图24为本发明实施例提供的一种窗口堆栈的实例示意图;FIG. 24 is a schematic diagram of an example of a window stack according to an embodiment of the present invention;
图25为本发明实施例提供的一种多屏终端显示的图形用户界面示意图十五;25 is a schematic diagram of a graphical user interface displayed by a multi-screen terminal according to an embodiment of the present invention;
图26为本发明实施例提供的一种多屏终端的结构示意图一;FIG. 26 is a schematic structural diagram 1 of a multi-screen terminal according to an embodiment of the present disclosure;
图27为本发明实施例提供的一种多屏终端的结构示意图二。FIG. 27 is a schematic structural diagram 2 of a multi-screen terminal according to an embodiment of the present invention.
具体实施方式detailed description
本发明实施例提供一种多屏显示的方法可以应用于多屏终端上,具体可以应用于多屏终端的多个触摸屏交互显示各自的显示内容的过程中。The embodiment of the present invention provides a method for displaying a multi-screen display, which can be applied to a multi-screen terminal, and can be specifically applied to a process in which multiple touch screens of a multi-screen terminal interactively display respective display contents.
其中,本发明实施例中的多屏终端可以包括多个触摸屏,这多个触摸屏可以分别显示相同或者不同的显示内容。例如,该多屏终端可以为双屏终端,该双屏终端可以包括A面触摸屏和B面触摸屏。The multi-screen terminal in the embodiment of the present invention may include multiple touch screens, which may display the same or different display content respectively. For example, the multi-screen terminal may be a dual-screen terminal, and the dual-screen terminal may include an A-side touch screen and a B-side touch screen.
以下以双屏终端为例,介绍本发明实施例中的多屏终端:The dual-screen terminal is taken as an example to describe the multi-screen terminal in the embodiment of the present invention:
在本发明实施例中,如图1a所示,双屏终端的A面触摸屏和B面触摸屏可以为连接在同一物理附件上、呈现正反两个方向的触摸屏;或者,如图1b所示,双屏终端的A面触摸屏和B面触摸屏可以为分别连接在不同物理附件上、呈现正反两个方向的触摸屏。In the embodiment of the present invention, as shown in FIG. 1a, the A-side touch screen and the B-side touch screen of the dual-screen terminal may be touch screens connected in the same physical attachment and in both forward and reverse directions; or, as shown in FIG. 1b, The A-side touch screen and the B-side touch screen of the dual-screen terminal may be touch screens that are respectively connected to different physical accessories and present in both directions.
其中,A面触摸屏可以为正面触摸屏,B面触摸屏为反面触摸屏;或者,A面触摸屏可以为反面触摸屏,B面触摸屏为正面触摸屏。图1中箭头所指向的方向与触摸屏(A面触摸屏或者B面触摸屏)的显示面相对。The A-side touch screen may be a front touch screen, and the B-side touch screen may be a reverse touch screen; or the A-side touch screen may be a reverse touch screen, and the B-side touch screen may be a front touch screen. The direction indicated by the arrow in Fig. 1 is opposite to the display surface of the touch screen (A side touch screen or B side touch screen).
当然,图1仅仅以举例方式给出双屏终端的A面触摸屏和B面触摸屏的设置方式,双屏终端的A面触摸屏和B面触摸屏的设置方式不包括但不限于如图1所示的设置方式。例如,A面触摸屏可以为双屏终端的正面触摸屏,B面触摸屏可以设置在双屏终端的侧面。 Of course, FIG. 1 only gives the setting manner of the A-side touch screen and the B-side touch screen of the dual-screen terminal by way of example, and the setting manners of the A-side touch screen and the B-side touch screen of the dual-screen terminal do not include but are not limited to those shown in FIG. 1 . Setting method. For example, the A-side touch screen may be a front touch screen of a dual-screen terminal, and the B-side touch screen may be disposed at a side of the dual-screen terminal.
其中,A面触摸屏的规格参数和B面触摸屏的规格参数可以相同,也可以不同。触摸屏的规格参数可以包括:触摸屏的物理尺寸、分辨率、型号等参数。The specification parameters of the A-side touch screen and the specification parameters of the B-side touch screen may be the same or different. The specification parameters of the touch screen may include: physical dimensions, resolution, model and other parameters of the touch screen.
示例性的,本发明实施例中的多屏终端可以为具备无线通信功能的各种设备,例如,多屏终端可以为具备无线通信功能的可穿戴电子设备(例如智能手表等),也可以是图3所示的手机300,还可以是平板电脑等,以下实施例对移动设备的具体形式不做特殊限制。Illustratively, the multi-screen terminal in the embodiment of the present invention may be various devices having a wireless communication function. For example, the multi-screen terminal may be a wearable electronic device (such as a smart watch or the like) having a wireless communication function, or may be The mobile phone 300 shown in FIG. 3 may also be a tablet computer or the like. The following embodiments do not specifically limit the specific form of the mobile device.
以下实施例以手机作为例子来说明移动设备如何实现实施例中的具体技术方案。如图3所示,本实施例中的移动设备可以为手机300。如图2a、2b所示,为手机300的外观示意图,其中,图2a是手机300的正面示意图,图2b是手机300的背面示意图。下面以手机300为例对实施例进行具体说明。The following embodiments use a mobile phone as an example to illustrate how a mobile device implements a specific technical solution in the embodiment. As shown in FIG. 3, the mobile device in this embodiment may be the mobile phone 300. 2a and 2b are schematic diagrams of the appearance of the mobile phone 300. FIG. 2a is a front view of the mobile phone 300, and FIG. 2b is a rear view of the mobile phone 300. The embodiment will be specifically described below by taking the mobile phone 300 as an example.
应该理解的是,图示手机300仅仅是移动设备的一个范例,并且手机300可以具有比图中所示出的更过的或者更少的部件,可以组合两个或更多的部件,或者可以具有不同的部件配置。图3中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。It should be understood that the illustrated mobile phone 300 is merely an example of a mobile device, and the mobile phone 300 may have more or fewer components than those shown in the figures, two or more components may be combined, or Has a different component configuration. The various components shown in FIG. 3 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
如图3所示,手机300包括:RF(Radio Frequency,射频)电路310、存储器320、输入单元330、显示单元340、传感器350、音频电路360、Wi-Fi模块370、处理器380、以及电源390等部件。本领域技术人员可以理解,图3中示出的手机结构并不构成对手机的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。As shown in FIG. 3, the mobile phone 300 includes an RF (Radio Frequency) circuit 310, a memory 320, an input unit 330, a display unit 340, a sensor 350, an audio circuit 360, a Wi-Fi module 370, a processor 380, and a power supply. 390 and other components. It will be understood by those skilled in the art that the structure of the handset shown in FIG. 3 does not constitute a limitation to the handset, and may include more or less components than those illustrated, or some components may be combined, or different component arrangements.
下面结合图3对手机300的各个构成部件进行具体的介绍:The components of the mobile phone 300 will be specifically described below with reference to FIG. 3:
RF电路310可用于收发信息或通话过程中,信号的接收和发送,可以将基站的下行信息接收后,给处理器380处理;另外,将涉及上行的数据发送给基站。通常,RF电路包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等器件。此外,RF电路310还可以通过无线通信与网络和其他移动设备通信。所述无线通信可以使用任一通信标准或协议,包括但不限于全球移动通讯系统、通用分组无线服务、码分多址、宽带码分多址、长期演进、电子邮件、短消息服务等。The RF circuit 310 can be used for transmitting and receiving information or during a call, and receiving and transmitting signals. The downlink information of the base station can be received and processed by the processor 380. In addition, the data related to the uplink is sent to the base station. Typically, RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, RF circuitry 310 can also communicate with the network and other mobile devices via wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to global mobile communication systems, general packet radio services, code division multiple access, wideband code division multiple access, long term evolution, email, short message service, and the like.
存储器320可用于存储软件程序及数据。处理器380通过运行存储在存储器320的软件程序及数据,从而执行手机300的各种功能以及数据处理。存储器320可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机300的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器320可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。在以下实施例中,存储器320存储有使得手机300能运行的操作系统,例如苹果公司所开发的
Figure PCTCN2017081457-appb-000001
操作系统,谷歌公司所开发的
Figure PCTCN2017081457-appb-000002
开源操作系统,微软公司所开发的
Figure PCTCN2017081457-appb-000003
操作系统等。
Memory 320 can be used to store software programs and data. The processor 380 executes various functions of the mobile phone 300 and data processing by running software programs and data stored in the memory 320. The memory 320 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to The data created by the use of the mobile phone 300 (such as audio data, phone book, etc.) and the like. Moreover, memory 320 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. In the following embodiments, the memory 320 stores an operating system that enables the mobile phone 300 to operate, such as that developed by Apple.
Figure PCTCN2017081457-appb-000001
Operating system, developed by Google Inc.
Figure PCTCN2017081457-appb-000002
Open source operating system, developed by Microsoft Corporation
Figure PCTCN2017081457-appb-000003
Operating system, etc.
输入单元330(即触摸屏)可用于接收输入的数字或字符信息,以及产生与手机300的用户设置以及功能控制有关的信号输入。具体地,输入单元330可以包括设置在手机300正面的第一触控面板331,该第一触控面板331也称为第一触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在第一触控面板331上或在第一触控面板331附近的操作),并根据预先设定的程式驱动相应的连接装置。可选的,第一触控面板331可包括触摸检测装置和触摸控制器两个部分(图中未示出)。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器380,并能接收处理器380发来的指令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现第一触控面板331。除了第一触控面板331,输入单元330还可以包括设置在手机300背面的第二触控面板332(也称第二触摸屏),也即第一触控面板331与第二触控面板332设置在手机300相对的两个面上。具体地,第二触控面板332也可以采用与上述第一触控面板331相同的结构,在此不再赘述。Input unit 330 (i.e., a touch screen) can be used to receive input numeric or character information, as well as to generate signal inputs related to user settings and function control of handset 300. Specifically, the input unit 330 may include a first touch panel 331 disposed on the front surface of the mobile phone 300. The first touch panel 331 is also referred to as a first touch screen, and may collect touch operations on or near the user (such as user use). A suitable object or accessory such as a finger or a stylus is operated on the first touch panel 331 or in the vicinity of the first touch panel 331, and the corresponding connecting device is driven according to a preset program. Optionally, the first touch panel 331 may include two parts (not shown) of the touch detection device and the touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 380 is provided and can receive instructions from the processor 380 and execute them. In addition, the first touch panel 331 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the first touch panel 331 , the input unit 330 may further include a second touch panel 332 (also referred to as a second touch screen) disposed on the back of the mobile phone 300 , that is, the first touch panel 331 and the second touch panel 332 are disposed. On the opposite sides of the mobile phone 300. Specifically, the second touch panel 332 can also adopt the same structure as the first touch panel 331 described above, and details are not described herein again.
显示单元340(即显示屏)可用于显示由用户输入的信息或提供给用户的信息以及手机300的各种菜单的GUI。显示单元340可包括设置在手机300正面的第一显示面板341(也可称为第一显示屏)和设置在手机300背面的第二显示面板342(也可以称为第二显示屏),也即第一显示面板341与第二显示面板342设置在手机300相对的两个面上。其中,第一显示面板341可以采用液晶显示器、发光二极管等形式来配置;第二显示面板342可以采用电子墨水屏等用电子纸显示技术或其他低功耗显示材料制作成的屏幕,因此可以在第二显示面板342中来阅读电子书和杂志等。当然,该第二显示面板342也可以采用与第一显示面板341相同的显示材料。The display unit 340 (i.e., display screen) can be used to display information input by the user or information provided to the user and a GUI of various menus of the mobile phone 300. The display unit 340 may include a first display panel 341 (also referred to as a first display screen) disposed on the front of the mobile phone 300 and a second display panel 342 (also referred to as a second display screen) disposed on the back of the mobile phone 300. That is, the first display panel 341 and the second display panel 342 are disposed on opposite sides of the mobile phone 300. The first display panel 341 can be configured in the form of a liquid crystal display, a light emitting diode, or the like; the second display panel 342 can be a screen made of an electronic ink display or other low-power display material, such as an electronic ink screen, so that The second display panel 342 is used to read e-books, magazines, and the like. Of course, the second display panel 342 can also adopt the same display material as the first display panel 341.
如图2a和2b所示,在一些实施例中,手机300包括正面A和背面B;在正面A的底部可以设置有三个光学触摸按键201、202、203;还设置有第一触控面板331和第一显示面板341,第一触控面板331覆盖在第一显示面板341之上。当第一触控面板331检测到在其上或附近的触摸操作后,传送给处理器380以确定触摸事件,随后处理器380根据触摸事件的类型在第一显示面板341上提供相应的视觉输出。虽然在图3中,第一触控面板331与第一显示面板341是作为两个独立的部件来实现手机300的输入和输入功能,但是在某些实施例中,可以将第一触控面板331与第一显示面板341集成而实现手机300的输入和输出功能,集成后的第一触控面板331与第一显示面板341可以简称为第一触摸屏401。在背面B中,设置有第二触控面板332和第二显示面板342,第二触控面板332覆盖在第二显示面板342之上。第二触控面板332、第二显示面板342的功能与上述第一触控面板331、第一显示面板341的功能类似。在某些实施例中,可以将第二触控面板332与第二显示面板342集成而实现手机300的输入和输出功能,集成后的第二触控面板332与第 二显示面板342可以简称为第二触摸屏402。As shown in FIGS. 2a and 2b, in some embodiments, the mobile phone 300 includes a front side A and a back side B; at the bottom of the front side A, three optical touch buttons 201, 202, 203 may be disposed; and a first touch panel 331 is further disposed. And the first display panel 341, the first touch panel 331 is overlaid on the first display panel 341. When the first touch panel 331 detects a touch operation on or near it, it is transmitted to the processor 380 to determine a touch event, and then the processor 380 provides a corresponding visual output on the first display panel 341 according to the type of the touch event. . Although the first touch panel 331 and the first display panel 341 are used as two independent components to implement the input and input functions of the mobile phone 300 in FIG. 3, in some embodiments, the first touch panel may be used. The first display panel 341 is integrated with the first display panel 341 to implement the input and output functions of the mobile phone 300. The integrated first touch panel 331 and the first display panel 341 may be simply referred to as the first touch screen 401. In the back surface B, a second touch panel 332 and a second display panel 342 are disposed, and the second touch panel 332 is overlaid on the second display panel 342. The functions of the second touch panel 332 and the second display panel 342 are similar to those of the first touch panel 331 and the first display panel 341. In some embodiments, the second touch panel 332 and the second display panel 342 can be integrated to implement the input and output functions of the mobile phone 300, and the integrated second touch panel 332 and the The second display panel 342 may be simply referred to as the second touch screen 402.
在另外的一些实施例中,上述第一触控面板331和第二触控面板332还可以设置有压力感应传感器,这样用户在上述触控面板上进行触摸操作时,触控面板还能检测到该触摸操作的压力,进而手机300能够更准确地检测该触摸操作。In other embodiments, the first touch panel 331 and the second touch panel 332 may further be provided with a pressure sensing sensor, so that when the user performs a touch operation on the touch panel, the touch panel can also detect the touch panel. The pressure of the touch operation, and thus the mobile phone 300, can detect the touch operation more accurately.
手机300还可以包括至少一种传感器350,比如光传感器、运动传感器以及其他传感器。具体地,光传感器可包括环境光传感器及接近传感器,其中,如图2a所示,环境光传感器351可根据环境光线的明暗来调节第一显示面板341和/或第二显示面板342的亮度,接近光传感器352设置在手机300的正面,当在手机300移动到耳边时,根据接近光传感器352的检测,手机300关闭第一显示面板341的电源,也可以同时关闭第二显示面板342的电源,这样手机300可以进一步节省电量。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于手机300还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。The handset 300 can also include at least one sensor 350, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein, as shown in FIG. 2a, the ambient light sensor 351 may adjust the brightness of the first display panel 341 and/or the second display panel 342 according to the brightness of the ambient light. The proximity light sensor 352 is disposed on the front surface of the mobile phone 300. When the mobile phone 300 is moved to the ear, the mobile phone 300 turns off the power of the first display panel 341 according to the detection of the proximity light sensor 352, and may also close the second display panel 342 at the same time. Power, so the phone 300 can further save power. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the mobile phone 300 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.
音频电路360、扬声器361,麦克风362可提供用户与手机300之间的音频接口。音频电路360可将接收到的音频数据转换后的电信号,传输到扬声器361,由扬声器361转换为声音信号输出;另一方面,麦克风362将收集的声音信号转换为电信号,由音频电路360接收后转换为音频数据,再将音频数据输出至RF电路310以发送给比如另一手机,或者将音频数据输出至存储器320以便进一步处理。The audio circuit 360, the speaker 361, and the microphone 362 can provide an audio interface between the user and the handset 300. The audio circuit 360 can transmit the converted electrical data of the received audio data to the speaker 361 for conversion to the sound signal output by the speaker 361; on the other hand, the microphone 362 converts the collected sound signal into an electrical signal, by the audio circuit 360. After receiving, it is converted into audio data, and the audio data is output to the RF circuit 310 for transmission to, for example, another mobile phone, or the audio data is output to the memory 320 for further processing.
Wi-Fi属于短距离无线传输技术,手机300可以通过Wi-Fi模块370帮助用户收发电子邮件、浏览网页和访问流媒体等,它为用户提供了无线的宽带互联网访问。Wi-Fi is a short-range wireless transmission technology. The mobile phone 300 can help users to send and receive emails, browse web pages, and access streaming media through the Wi-Fi module 370, which provides users with wireless broadband Internet access.
处理器380是手机300的控制中心,利用各种接口和线路连接整个手机的各个部分,通过运行或执行存储在存储器320内的软件程序,以及调用存储在存储器320内的数据,执行手机300的各种功能和处理数据,从而对手机进行整体监控。在一些实施例中,处理器380可包括一个或多个处理单元;处理器380还可以集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器180中。The processor 380 is a control center of the mobile phone 300, and connects various parts of the entire mobile phone by using various interfaces and lines, and executes the mobile phone 300 by running or executing a software program stored in the memory 320 and calling data stored in the memory 320. A variety of functions and processing data to monitor the phone as a whole. In some embodiments, processor 380 can include one or more processing units; processor 380 can also integrate an application processor and a modem processor, where the application processor primarily processes operating systems, user interfaces, applications, and the like The modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 180.
蓝牙模块381,用于通过蓝牙这种短距离通讯协议来与其他设备进行信息交互。例如,手机300可以通过蓝牙模块381与同样具备蓝牙模块的可穿戴电子设备(例如智能手表)建立蓝牙连接,从而进行数据交互。The Bluetooth module 381 is configured to perform information interaction with other devices through a short-range communication protocol such as Bluetooth. For example, the mobile phone 300 can establish a Bluetooth connection through a Bluetooth module 381 and a wearable electronic device (such as a smart watch) that also has a Bluetooth module, thereby performing data interaction.
手机300还包括给各个部件供电的电源390(比如电池)。电源可以通过电源管理系统与处理器380逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗等功能。可以理解的是,在以下实施例中,电源390可以包 括两个:一个电源主要用于给第一显示面板341及第一触控面板331供电,另一个电源主要用于给第二显示面板342和第二触控面板332供电。The handset 300 also includes a power source 390 (such as a battery) that powers the various components. The power supply can be logically coupled to the processor 380 through a power management system to manage functions such as charging, discharging, and power consumption through the power management system. It can be understood that in the following embodiments, the power supply 390 can be packaged. Two power supplies are used to supply power to the first display panel 341 and the first touch panel 331 , and the other power source is mainly used to supply power to the second display panel 342 and the second touch panel 332 .
手机300还可以包括前置摄像头353、后置摄像头354等,在此不再赘述。The mobile phone 300 may further include a front camera 353, a rear camera 354, and the like, and details are not described herein again.
其中,手机300的第一触摸屏(如正面触摸屏)和第二触摸屏(手机300除正面触摸屏之外的触摸屏)可以分别显示相同或者不同的显示内容。例如,第一触摸屏和第二触摸屏可以作为不同应用或者客户端的显示界面,或者第一触摸屏和第二触摸屏可以作为同一应用或者客户端的显示界面,用于显示该应用或者客户端的显示界面中的相同内容或者不同内容。The first touch screen of the mobile phone 300 (such as the front touch screen) and the second touch screen (the touch screen of the mobile phone 300 except the front touch screen) may respectively display the same or different display contents. For example, the first touch screen and the second touch screen may serve as display interfaces of different applications or clients, or the first touch screen and the second touch screen may serve as the same application or a display interface of the client for displaying the same in the display interface of the application or the client. Content or different content.
其中,上述显示界面可以是一种GUI;并且该GUI中包括文字形式和图标形式的图形选项,该GUI文字形式的图形选项和图标形式的图形选项均可以由用户通过触摸屏(即触摸屏)或者用其他输入设备(例如物理按键)进行操作。The display interface may be a GUI; and the GUI includes a graphic option in the form of a text and an icon, and the graphical option in the form of the GUI text and the graphical option in the form of an icon may be used by the user through the touch screen (ie, the touch screen) or Other input devices (such as physical buttons) operate.
GUI是采用图形方式显示的终端(如手机)中的显示界面;GUI中的图形选项可以包括文字的形式和图标的形式,且这些图形是可以由用户操作的,且GUI中用户看到和操作的可以是图形。具体的,GUI是一种用户与终端(如手机)通信的显示界面的显示格式,允许用户通过触屏等输入单元操纵触摸屏上的图标形式的选项或文字形式的选项,以进行命令、调用文件、启动程序等操作或执行其它一些日常任务。上述GUI包括窗口、下拉菜单、对话框及其相应的控制机制(如该终端的CPU)。同时,GUI在各种新式应用程序中都是标准化的,即相同的操作总是以同样的方式来完成;如对该GUI中的任一文字形式或图标形式的图形选项(以下称为选项)进行操作,可以是用户通过触屏点击该选项。The GUI is a display interface in a terminal (such as a mobile phone) displayed in a graphical manner; the graphic options in the GUI may include a form of text and an icon, and the graphics are operable by the user, and the user sees and operates in the GUI. Can be a graphic. Specifically, the GUI is a display format of a display interface in which the user communicates with the terminal (such as a mobile phone), and allows the user to manipulate an option in the form of an icon or a text form on the touch screen through an input unit such as a touch screen to execute a command or call a file. , start a program, etc. or perform some other daily tasks. The above GUI includes a window, a drop down menu, a dialog box and its corresponding control mechanism (such as the CPU of the terminal). At the same time, the GUI is standardized in a variety of new applications, that is, the same operation is always done in the same way; for example, any graphic form or icon form graphic option (hereinafter referred to as an option) in the GUI. The operation can be that the user clicks on the option through the touch screen.
以下实施例中的方法均可以在具有上述硬件结构的手机300中实现。The methods in the following embodiments can all be implemented in the mobile phone 300 having the above hardware structure.
本发明实施例为了解决现有技术中多屏终端的多面触摸屏相互独立的,没有交互的问题,在现有多屏终端的“单屏模式”和“独立模式”的基础上,提出了“镜像模式”和“演示模式”这两种显示模式,并对“独立模式”进行了扩展。In order to solve the problem that the multi-faceted touch screen of the multi-screen terminal in the prior art is independent of each other and has no interaction problem, the embodiment of the present invention proposes a "mirror image" based on the "single screen mode" and the "independent mode" of the existing multi-screen terminal. "Display mode" and "demo mode" display modes, and extended "independent mode".
示例性的,如图2所示,当用户选择采用多屏终端300(例如手机300)的第一触摸屏401(如图2a所示的正面触摸屏)作为该多屏终端300的主工作屏,第二触摸屏402(即除正面触摸屏之外的触摸触摸屏,如图2b所示的背面触摸屏)作为该多屏终端300的辅工作屏时,多屏终端300可以在其第一触摸屏显示各种应用程序的图标(如图标403表示系统应用“设置”),并在其第二触摸屏402显示预定义的图像,例如“Hello,World”字样。当然,当用户选择采用多屏终端300的第一触摸屏401作为工作屏时,多屏终端300的第二触摸屏402可以处于关闭状态或者待机状态。Exemplarily, as shown in FIG. 2, when the user selects the first touch screen 401 (such as the front touch screen shown in FIG. 2a) using the multi-screen terminal 300 (for example, the mobile phone 300) as the main working screen of the multi-screen terminal 300, When the two touch screens 402 (ie, the touch touch screen other than the front touch screen, such as the back touch screen shown in FIG. 2b) serve as the auxiliary work screen of the multi-screen terminal 300, the multi-screen terminal 300 can display various applications on the first touch screen thereof. The icon (such as icon 403 represents the system application "Settings") and displays a predefined image on its second touch screen 402, such as "Hello, World". Of course, when the user selects the first touch screen 401 of the multi-screen terminal 300 as the work screen, the second touch screen 402 of the multi-screen terminal 300 may be in a closed state or a standby state.
其中,用户也可以选择采用多屏终端300第二触摸屏402作为该多屏终端300的主工作屏,第一触摸屏401作为该多屏终端300的辅工作屏。其中,采用第二触摸屏402作为主工作屏,第一触摸屏401作为辅工作屏时,第一 触摸屏401和第二触摸屏402的控制方式、显示方式以及显示内容可以参考采用第一触摸屏401作为主工作屏,第二触摸屏402作为辅工作屏时的相关描述,此处不再赘述。The user may also select the second touch screen 402 as the main working screen of the multi-screen terminal 300, and the first touch screen 401 serves as the auxiliary working screen of the multi-screen terminal 300. Wherein, the second touch screen 402 is used as the main working screen, and when the first touch screen 401 is used as the auxiliary working screen, the first For the control mode, the display mode, and the display content of the touch screen 401 and the second touch screen 402, reference may be made to the related description when the first touch screen 401 is used as the main working screen, and the second touch screen 402 is used as the auxiliary working screen, and details are not described herein again.
在一种实现方式中,用户可以对如图2a所示的系统应用“设置”图标403的触控操作,进入“双屏模式选择”界面。例如,如图4a所示,当用户手指触摸或接近显示在第一显示面板341上的图标403(即“设置”)时,多屏终端300的第一触控面板331检测到在其上或附近的该触摸事件,传送给处理器380以确定触摸事件所对应的指令,随后处理器380根据该指令调用存储在存储器320里的系统应用“设置”,并在第一显示面板341显示该系统应用“设置”的GUI,即显示如图4b所示的GUI。In one implementation, the user can apply the touch operation of the “Settings” icon 403 to the system shown in FIG. 2a to enter the “Double Screen Mode Selection” interface. For example, as shown in FIG. 4a, when the user's finger touches or approaches the icon 403 (ie, "set") displayed on the first display panel 341, the first touch panel 331 of the multi-screen terminal 300 detects it or The nearby touch event is transmitted to the processor 380 to determine an instruction corresponding to the touch event, and then the processor 380 calls the system application "set" stored in the memory 320 according to the instruction, and displays the system on the first display panel 341. Apply the GUI of "Settings", which displays the GUI as shown in Figure 4b.
随后,当用户手指触摸或接近显示在第一显示面板341上的“双屏模式选择”选项407时,第一触控面板331检测到在其上或附近的该触摸事件,传送给处理器380以确定该触摸事件所对应的指令,随后处理器380根据该指令调用存储在存储器320里的“双屏模式选择”应用,并在第一显示面板341显示该”双屏模式选择”应用的GUI,假设多屏终端300的当前显示模式为“单屏模式”,那么第一显示面板341便可以显示如图4c所示的GUI。如图4c所示,第一显示面板341上可以显示“双屏模式选择”菜单408。Subsequently, when the user's finger touches or approaches the "dual screen mode selection" option 407 displayed on the first display panel 341, the first touch panel 331 detects the touch event on or near it, and transmits it to the processor 380. Determining an instruction corresponding to the touch event, and then the processor 380 calls the "dual screen mode selection" application stored in the memory 320 according to the instruction, and displays the GUI of the "dual screen mode selection" application on the first display panel 341. Assuming that the current display mode of the multi-screen terminal 300 is "single screen mode", the first display panel 341 can display the GUI as shown in FIG. 4c. As shown in FIG. 4c, a "dual screen mode selection" menu 408 can be displayed on the first display panel 341.
在另一种实现方式中,用户可以通过预先配置的快捷键进入“双屏模式选择”界面。例如,当多屏终端300的处理器308检测到用户同时触发如图2a所示的“音量-键”405和“光学触摸按键201”时,可以生成触发操作指令,然后处理器380可以根据该触发操作指令调用存储在存储器320里的“双屏模式选择”应用,并在第一显示面板341显示该“双屏模式选择”应用的GUI,假设多屏终端300的当前显示模式为“单屏模式”,那么第一显示面板341便可以显示如图5所示的GUI。In another implementation, the user can enter the "dual screen mode selection" interface through a pre-configured shortcut key. For example, when the processor 308 of the multi-screen terminal 300 detects that the user simultaneously triggers the "volume-key" 405 and the "optical touch button 201" as shown in FIG. 2a, a trigger operation command may be generated, and then the processor 380 may The trigger operation instruction invokes the "dual screen mode selection" application stored in the memory 320, and displays the GUI of the "dual screen mode selection" application on the first display panel 341, assuming that the current display mode of the multi-screen terminal 300 is "single screen" Mode", then the first display panel 341 can display the GUI as shown in FIG.
其中,多屏终端300可以响应于用户在上述第一触控面板和/或第二触控面板上的触摸事件,或者用户对多屏终端300的物理键的按键事件,从“单屏模式”、“独立模式”、“镜像模式”和“演示模式”这四种显示模式中设置一个默认显示模式。例如,如图4c或者图5所示,多屏终端300的默认显示模式可以为“单屏模式”。The multi-screen terminal 300 can respond to the touch event of the user on the first touch panel and/or the second touch panel, or the button event of the user to the physical key of the multi-screen terminal 300, from the “single screen mode”. A default display mode is set in the four display modes of "independent mode", "mirror mode" and "demo mode". For example, as shown in FIG. 4c or FIG. 5, the default display mode of the multi-screen terminal 300 may be "single screen mode".
在“单屏模式”和“镜像模式”下,本发明实施例提供的多屏终端还可以支持不同的响应模式,如第一响应模式(即第一触控面板响应模式)、第二响应模式(即第二触控面板响应模式)、双屏响应模式和部分响应模式(即第二触控面板部分响应模式)。In the "single screen mode" and the "mirror mode", the multi-screen terminal provided by the embodiment of the present invention can also support different response modes, such as a first response mode (ie, a first touch panel response mode) and a second response mode. (ie, the second touch panel response mode), the dual screen response mode, and the partial response mode (ie, the second touch panel partial response mode).
其中,在上述第一响应模式下,多屏终端可以响应用户对第一触控面板的触摸事件,屏蔽用户对第二触控面板的触摸事件。但是,如果第二触控面板上设置有指纹识别区域,那么该多屏终端则可以响应用户对第二触控面板的指纹识别区域的触摸事件,屏蔽用户对第二触控面板上除指纹识别区域之外的其他区域的触摸事件。In the first response mode, the multi-screen terminal can block the touch event of the user on the second touch panel in response to the user's touch event on the first touch panel. However, if the fingerprint recognition area is disposed on the second touch panel, the multi-screen terminal can respond to the user's touch event on the fingerprint recognition area of the second touch panel, and shield the user from fingerprint recognition on the second touch panel. Touch events from other areas outside the area.
在上述第二响应模式下,多屏终端可以响应用户对第二触控面板的触摸 事件,屏蔽用户对第一触控面板的触摸事件。或者,多屏终端可以响应用户对第二触控面板的触摸事件,并且只响应用户对第一触控面板上的三个光学触摸按键201、202、203的触摸事件,而屏蔽用户对第一触控面板上除了上述三个光学触摸按键201、202、203之外的其他区域的触摸事件。In the second response mode, the multi-screen terminal can respond to the user's touch on the second touch panel. The event shields the user from the touch event of the first touch panel. Alternatively, the multi-screen terminal can respond to the user's touch event to the second touch panel and only respond to the user's touch event on the three optical touch buttons 201, 202, 203 on the first touch panel, and shield the user from the first Touch events on the touch panel other than the above three optical touch buttons 201, 202, 203.
在上述双屏响应模式下,多屏终端可以响应用户对第一触控面板的触摸事件,并且可以响应用户对第二触控面板的触摸事件;或者,多屏终端可以将用户对第一触控面板的触摸事件和用户对第二触控面板的触摸事件结合起来,作为整体输入来响应。In the above dual-screen response mode, the multi-screen terminal can respond to the user's touch event to the first touch panel, and can respond to the user's touch event to the second touch panel; or the multi-screen terminal can set the user to the first touch The touch event of the control panel and the user's touch event to the second touch panel are combined to respond as an overall input.
在上述部分响应模式下,多屏终端可以响应用户对第二触控面板的部分区域的触摸事件,屏蔽用户对第二触控面板上除了该部分区域之外的其他区域的触摸事件,并屏蔽用户对第一触控面板的触摸事件。例如,上述部分区域可以为第二触控面板上包括指纹识别区域的区域。或者,多屏终端可以响应用户对第二触控面板的部分触摸事件,屏蔽用户对第二触控面板上除了该部分触摸事件之外的其他触摸事件,并响应用户对第一触控面板的触摸事件。In the partial response mode, the multi-screen terminal can block the touch event of the user on the second touch panel except for the partial area in response to the touch event of the user on the partial area of the second touch panel, and block the touch event. The user's touch event on the first touch panel. For example, the partial area may be an area on the second touch panel including the fingerprint recognition area. Alternatively, the multi-screen terminal can respond to a part of the touch event of the second touch panel by the user, and shield the user from other touch events on the second touch panel except the part of the touch event, and respond to the user's touch on the first touch panel. Touch the event.
其中,上述部分触摸事件可以为预先设定的触摸事件。例如,该部分触摸事件可以为用户在第二触控面板的单次点击事件、用户在预定时间内对第二触控面板的多次连续点击事件、用户在第二触控面板上的拖拽事件、用户在第二触控面板上的长按事件等事件中的任一事件或者多个事件的组合。The partial touch event may be a preset touch event. For example, the partial touch event may be a single click event of the second touch panel, multiple consecutive click events of the user to the second touch panel within a predetermined time, and dragging of the user on the second touch panel. Any event or combination of events of events, long press events on the second touch panel, and the like.
在“演示模式”下,本发明实施例提供的多屏终端可以支持上述第一响应模式,即第一触控面板响应模式。In the "demo mode", the multi-screen terminal provided by the embodiment of the present invention can support the first response mode, that is, the first touch panel response mode.
在“独立模式”下,多屏终端可以支持上述第一响应模式,在第一显示面板显示第一触控面板检测到的触摸事件对应的GUI;同时,多屏终端还可以支持上述第二响应模式(即第二触控面板响应模式),在第二显示面板显示第二触控面板检测到的触摸事件对应的GUI。In the "independent mode", the multi-screen terminal can support the first response mode, and the GUI corresponding to the touch event detected by the first touch panel is displayed on the first display panel; and the multi-screen terminal can also support the second response. The mode (ie, the second touch panel response mode) displays a GUI corresponding to the touch event detected by the second touch panel on the second display panel.
示例性的,本发明实施例这里“镜像模式”为例,当用户手指触摸或接近图4c中显示在第一显示面板341上的“双屏模式选择”菜单408中的“镜像模式”选项,或者用户手指触摸或接近图4c中显示在第一显示面板341上的“双屏模式选择”菜单408中的“镜像模式”选项的下拉标识502时,第一触控面板331检测到在其上或附近的该触摸事件,传送给处理器380以确定该触摸事件所对应的指令,随后处理器380可以根据该指令调用存储在存储器320里的“镜像模式”应用,并在第一显示面板341显示该“镜像模式”应用的GUI,展开“镜像模式”的响应模式选择窗口503,并显示如图6所示的GUI。Exemplarily, the "mirror mode" is taken as an example here, when the user's finger touches or approaches the "mirror mode" option in the "dual screen mode selection" menu 408 displayed on the first display panel 341 in FIG. 4c, Or when the user's finger touches or approaches the pull-down flag 502 of the "mirror mode" option in the "dual-screen mode selection" menu 408 on the first display panel 341 in FIG. 4c, the first touch panel 331 detects thereon. The nearby touch event is transmitted to the processor 380 to determine an instruction corresponding to the touch event, and then the processor 380 can invoke the "mirror mode" application stored in the memory 320 according to the instruction, and in the first display panel 341. The GUI of the "mirror mode" application is displayed, the response mode selection window 503 of the "mirror mode" is expanded, and the GUI as shown in FIG. 6 is displayed.
其中,多屏终端300可以响应于用户在上述第一触控面板和/或第二触控面板上的触摸事件,或者用户对多屏终端300的物理键的按键事件,从“第一响应模式”、“第二响应模式”、“双屏响应模式”和“部分响应模式”这四种响应模式中设置一个默认响应模式。例如,如图6所示,多屏终端300的默认显示模式可以为“第一响应模式”。The multi-screen terminal 300 can respond to the touch event of the user on the first touch panel and/or the second touch panel, or the button event of the user to the physical key of the multi-screen terminal 300, from the “first response mode”. A default response mode is set in the four response modes of "second response mode", "two-screen response mode" and "partial response mode". For example, as shown in FIG. 6, the default display mode of the multi-screen terminal 300 may be "first response mode."
当然,当用户手指触摸或接近图4c中显示在第一显示面板341上的“双屏模式选择”菜单408中的“镜像模式”选项时,多屏终端可以不显示如图6所 示的“镜像模式”的响应模式选择窗口503,而是直接确定当前的响应模式为默认的响应模式,如第一响应模式。Of course, when the user's finger touches or approaches the "mirror mode" option displayed in the "dual screen mode selection" menu 408 on the first display panel 341 in FIG. 4c, the multi-screen terminal may not display as shown in FIG. 6. The response mode of the illustrated "mirror mode" selects the window 503, but directly determines that the current response mode is the default response mode, such as the first response mode.
本发明实施例以“镜像模式”的响应模式为第一响应模式为例,对本发明实施例提供的多屏显示的方法举例说明:In the embodiment of the present invention, the response mode of the "mirror mode" is taken as an example of the first response mode, and the method for displaying the multi-screen provided by the embodiment of the present invention is illustrated as follows:
以如图4c所示的GUI为例,如图7a-1所示,当用户手指触摸或接近图4c中显示在第一显示面板341上的“双屏模式选择”菜单408中的“镜像模式”选项时,由于多屏终端300还未进入“镜像模式”,因此,如图7a-2所示,多屏终端300可以控制其第二显示面板342继续显示预定义的图像,例如“Hello,World”字样。Taking the GUI as shown in FIG. 4c as an example, as shown in FIG. 7a-1, when the user's finger touches or approaches the "mirror mode" displayed in the "dual screen mode selection" menu 408 on the first display panel 341 in FIG. 4c. In the option, since the multi-screen terminal 300 has not entered the "mirror mode", as shown in FIG. 7a-2, the multi-screen terminal 300 can control its second display panel 342 to continue to display a predefined image, such as "Hello, "World".
其中,在“镜像模式”下,多屏终端的辅工作屏可以显示与其主工作屏相同的内容,即多屏终端可以执行如图8所示的多屏显示的方法,并在执行如图8所示的多屏显示的方法后,在其第一显示面板341显示如图7b-1所示的GUI,在其第二显示面板342显示如图7b-2所示的GUI。具体的,如图8所示,本发明实施例提供的多屏显示的方法可以包括S801-S802:In the "mirror mode", the auxiliary work screen of the multi-screen terminal can display the same content as the main work screen, that is, the multi-screen terminal can perform the multi-screen display method as shown in FIG. 8, and is executed as shown in FIG. After the illustrated multi-screen display method, a GUI as shown in FIG. 7b-1 is displayed on its first display panel 341, and a GUI as shown in FIG. 7b-2 is displayed on its second display panel 342. Specifically, as shown in FIG. 8, the method for displaying multiple screens provided by the embodiment of the present invention may include S801-S802:
S801:多屏终端获取用户输入的第一指令,并响应于上述第一指令,进入镜像模式。S801: The multi-screen terminal acquires a first instruction input by the user, and enters a mirroring mode in response to the first instruction.
其中,第一指可以令为用户对“镜像模式”选项的触摸操作指令,该第一指令用于触发多屏终端在第二显示面板显示第一显示面板当前所显示的第一GUI中的全部图像。The first finger may be a touch operation instruction for the user to the “mirror mode” option, and the first instruction is used to trigger the multi-screen terminal to display all the first GUIs currently displayed by the first display panel on the second display panel. image.
例如,用户对“镜像模式”选项的触摸操作指令可以为图7a-1中用户触摸或者触摸显示在第一显示面板341上的“双屏模式选择”菜单408中的“镜像模式”选项产生的操作指令。For example, a user's touch operation command to the "mirror mode" option may be generated by the user in FIG. 7a-1 touching or touching the "mirror mode" option displayed in the "dual screen mode selection" menu 408 on the first display panel 341. Operation instructions.
S802:多屏终端在第一显示面板显示第一GUI,该第一GUI包括第一显示对象。S802: The multi-screen terminal displays a first GUI on the first display panel, where the first GUI includes a first display object.
其中,多屏终端可以获取用户输入的应用启动指令,响应于该应用启动指令,在第一显示面板上显示该应用的GUI(即第一GUI)。The multi-screen terminal can obtain an application startup instruction input by the user, and display the GUI of the application (ie, the first GUI) on the first display panel in response to the application startup instruction.
示例性的,上述应用启动指令还可以用于触发多屏终端在第一显示面板显示该应用的GUI,或者,第一显示面板为预先配置的用于显示该应用的界面的显示面板。Exemplarily, the application startup command may be used to trigger a multi-screen terminal to display a GUI of the application on the first display panel, or the first display panel is a pre-configured display panel for displaying an interface of the application.
本发明实施例中可以先执行S801,再执行S802,即多屏终端可以在进入镜像模式后,在第一显示面板显示第一GUI;或者还可以先执行S802,再执行S801,即可以多屏终端可以在第一显示面板显示第一GUI后,再进入镜像模式。本发明实施例对于执行S801和S802的先后顺序不做限制。In the embodiment of the present invention, S801 may be executed first, and then S802 is executed, that is, the multi-screen terminal may display the first GUI on the first display panel after entering the mirror mode; or may execute S802 first, and then execute S801, that is, multiple screens may be performed. The terminal may enter the mirror mode after the first GUI is displayed on the first display panel. The embodiment of the present invention does not limit the sequence of executing S801 and S802.
S803:多屏终端获取第一显示面板所显示的第一GUI中的第一显示对象。S803: The multi-screen terminal acquires the first display object in the first GUI displayed by the first display panel.
其中,第一显示面板所在的显示屏为多屏终端的主工作屏。该第一显示对象可以为第一GUI中的全部图像。The display screen where the first display panel is located is the main working screen of the multi-screen terminal. The first display object can be all of the images in the first GUI.
S804:多屏终端判断第一显示面板的分辨率与第二显示面板的分辨率是否相同。S804: The multi-screen terminal determines whether the resolution of the first display panel is the same as the resolution of the second display panel.
其中,如果第一显示面板的分辨率与第二显示面板的分辨率相同,则表 示第二显示面板可以按照第一显示面板的分辨率直接显示第二GUI(即第一GUI),则可以继续执行S806;如果第一显示面板的分辨率与第二显示面板的分辨率不同,则表示第二显示面板不能按照第一显示面板的分辨率直接显示第一GUI,而是需要进行分辨率的转化,则可以继续执行S805-S806:Wherein, if the resolution of the first display panel is the same as the resolution of the second display panel, the table The second display panel can directly display the second GUI (ie, the first GUI) according to the resolution of the first display panel, and then can continue to execute S806; if the resolution of the first display panel is different from the resolution of the second display panel, It means that the second display panel cannot directly display the first GUI according to the resolution of the first display panel, but needs to perform resolution conversion, and then can continue to execute S805-S806:
S805:多屏终端按照第二显示面板的分辨率渲染第一GUI中的第一显示对象,得到包括该第一显示对象的第二GUI。S805: The multi-screen terminal renders the first display object in the first GUI according to the resolution of the second display panel, to obtain a second GUI that includes the first display object.
其中,多屏终端可以按照第二显示面板的分辨率渲染第一GUI的全部图像,得到分辨率符合第二显示面板的分辨率规格的第二GUI,然后再显示第二GUI。The multi-screen terminal can render all the images of the first GUI according to the resolution of the second display panel, obtain a second GUI whose resolution conforms to the resolution specification of the second display panel, and then display the second GUI.
S806:多屏终端在第二显示面板显示第二GUI,该第二GUI种包括第一显示对象。S806: The multi-screen terminal displays a second GUI on the second display panel, where the second GUI type includes the first display object.
例如,当第一显示面板的分辨率和第二显示面板的分辨率相同时,如图7b-1和图7b-2所示,多屏终端可以在第一显示面板和第二显示面板上显示包括各种应用程序的图标的GUI(即第一GUI)。For example, when the resolution of the first display panel and the resolution of the second display panel are the same, as shown in FIGS. 7b-1 and 7b-2, the multi-screen terminal may be displayed on the first display panel and the second display panel. A GUI (ie, the first GUI) that includes icons for various applications.
在一种情况下,由于第一显示面板和第二显示面板的尺寸可能不同,会导致第一显示面板的分辨率和第二显示面板的分辨率不同。多屏终端执行如图8所示的多屏显示的方法后,多屏终端可以在其第一显示面板341显示如图7b-1所示的GUI,在其第二显示面板342显示如图9b所示的GUI。即图9a可以替换图7a-2,图9b可以替换图7b-2。In one case, since the sizes of the first display panel and the second display panel may be different, the resolution of the first display panel and the resolution of the second display panel may be different. After the multi-screen terminal performs the multi-screen display method as shown in FIG. 8, the multi-screen terminal can display a GUI as shown in FIG. 7b-1 on its first display panel 341 and a second display panel 342 on its second display panel 342. The GUI shown. That is, FIG. 9a can replace FIG. 7a-2, and FIG. 9b can replace FIG. 7b-2.
以下结合图7对多屏终端处于“镜像模式”时,第一显示面板和第二显示面板的交互过程进行举例说明。The interaction process between the first display panel and the second display panel is exemplified when the multi-screen terminal is in the "mirror mode" with reference to FIG. 7 .
多屏终端处于“镜像模式”时,如图10a-1和图10a-2所示,第二显示面板显示与第一显示面板相同的内容。如图10a-1所示,当用户手指触摸或接近显示在第一显示面板341上的图标411(即“照片”)时,多屏终端300的第一触控面板331检测到在其上或附近的该触摸事件,传送给处理器380以确定触摸事件所对应的指令,随后,处理器380根据该指令调用存储在存储器320里的系统应用“照片”,并在第一显示面板341显示该系统应用“照片”的GUI(即执行S802),即显示如图10b-1所示的GUI;同时,假设第一显示面板的分辨率和第二显示面板的分辨率相同,处理器380还可以在第二显示面板342显示该系统应用“照片”的GUI(即执行S803、S804和S805),即显示如图10b-2所示的GUI。When the multi-screen terminal is in the "mirror mode", as shown in FIGS. 10a-1 and 10a-2, the second display panel displays the same content as the first display panel. As shown in FIG. 10a-1, when the user's finger touches or approaches the icon 411 (ie, "photo") displayed on the first display panel 341, the first touch panel 331 of the multi-screen terminal 300 detects it or The nearby touch event is transmitted to the processor 380 to determine an instruction corresponding to the touch event. Subsequently, the processor 380 calls the system application "photograph" stored in the memory 320 according to the instruction, and displays the same in the first display panel 341. The system applies the GUI of the "photo" (ie, executes S802), that is, displays the GUI as shown in FIG. 10b-1; meanwhile, if the resolution of the first display panel and the resolution of the second display panel are the same, the processor 380 can also The GUI of the system application "photo" is displayed on the second display panel 342 (ie, S803, S804, and S805 are executed), that is, the GUI as shown in FIG. 10b-2 is displayed.
类似的,如图10c-1所示,当用户手指触摸或接近显示在第一显示面板341上的图标412(“天鹅”)时,多屏终端300的第一触控面板331检测到在其上或附近的该触摸事件,传送给处理器380以确定触摸事件所对应的指令,随后,处理器380根据该指令调用存储在存储器320里的照片“天鹅”,并在第一显示面板341显示该照片“天鹅”的GUI,即显示如图10d-1所示的GUI(即执行S802);同时,假设第一显示面板的分辨率和第二显示面板的分辨率相同,处理器380还可以在第二显示面板342显示该照片“天鹅”的GUI,即显示如图10d-2所示的GUI(即执行S803、S804和S805)。 Similarly, as shown in FIG. 10c-1, when the user's finger touches or approaches the icon 412 ("Swan") displayed on the first display panel 341, the first touch panel 331 of the multi-screen terminal 300 detects that it is The touch event on or near is transmitted to the processor 380 to determine an instruction corresponding to the touch event, and then the processor 380 calls the photo "swan" stored in the memory 320 according to the instruction, and displays on the first display panel 341. The GUI of the photo "Swan" displays the GUI as shown in FIG. 10d-1 (ie, executes S802); meanwhile, if the resolution of the first display panel is the same as the resolution of the second display panel, the processor 380 can also The GUI of the photo "Swan" is displayed on the second display panel 342, that is, the GUI as shown in FIG. 10d-2 is displayed (ie, S803, S804, and S805 are executed).
进一步的,为了区别多屏终端的“镜像模式”和“单屏模式”,当多屏终端处于“镜像模式”时,第一显示面板上还可以显示第一镜像标识,第二显示面板上还可以显示第二镜像标识。如图7b-1所示,第一显示面板上还可以显示镜像标识409,如“JX”,如图7b-2所示,第二显示面板上也可以显示镜像标识410,如“JX”。其中,镜像标识409和镜像标识410可以相同也可以不同。图7中仅以举例方式给出镜像标识的一种实例,本发明实施例中的镜像标识的具体形状以及镜像标识在第一显示面板和第二显示面板中的位置包括但不显示图7所示的形状和位置。Further, in order to distinguish the "mirror mode" and the "single screen mode" of the multi-screen terminal, when the multi-screen terminal is in the "mirror mode", the first image panel may also display the first image identifier, and the second display panel further A second image identifier can be displayed. As shown in FIG. 7b-1, a mirror image identifier 409, such as "JX", may be displayed on the first display panel. As shown in FIG. 7b-2, a mirror image identifier 410, such as "JX", may also be displayed on the second display panel. The image identifier 409 and the image identifier 410 may be the same or different. An example of the image identifier is given by way of example in FIG. 7. The specific shape of the image identifier and the position of the image identifier in the first display panel and the second display panel in the embodiment of the present invention include but do not show FIG. 7 The shape and location of the show.
本发明实施例提供的多屏显示的方法,多屏终端处于“镜像模式”时,可以响应于第一指令,在第二显示面板显示与第一显示面板相同的显示对象,即该多屏终端的两个显示屏之间可以相互交互,而不是彼此独立,因此可以提高人机交互过程中的用户体验。The multi-screen display method provided by the embodiment of the present invention, when the multi-screen terminal is in the "mirror mode", may display the same display object as the first display panel in the second display panel in response to the first instruction, that is, the multi-screen terminal The two display screens can interact with each other instead of being independent of each other, thus improving the user experience during human-computer interaction.
在一种实现方式中,用户可以通过对如图4a所示的系统应用“设置”图标403的触控操作,进入如图4c所示的“双屏模式选择”界面。然后,通过在如图4c所示的“双屏模式选择”界面中进行显示模式的切换,由上述“镜像模式”切换至“独立模式”、“演示模式”或者“单屏模式”中的任一显示模式。In one implementation, the user can enter the "dual screen mode selection" interface as shown in FIG. 4c by applying a touch operation of the "set" icon 403 to the system as shown in FIG. 4a. Then, by switching the display mode in the "dual screen mode selection" interface as shown in FIG. 4c, switching from the above "mirror mode" to "independent mode", "demo mode" or "single screen mode" A display mode.
可以理解的是,通过对如图4a所示的系统应用“设置”图标403的触控操作,进入如图4c所示的“双屏模式选择”界面,然后在如图4c所示的“双屏模式选择”界面中选择进入“独立模式”、“演示模式”或者“单屏模式”中的任一显示模式的方法与上述实施例中进入“镜像模式”的方法类似,本发明实施例这里不再赘述。It can be understood that by applying the touch operation of the "Settings" icon 403 to the system as shown in FIG. 4a, the "Double Screen Mode Selection" interface as shown in FIG. 4c is entered, and then "double" as shown in FIG. 4c. The method of selecting to enter any of the "independent mode", "demo mode" or "single screen mode" in the interface mode selection interface is similar to the method of entering the "mirror mode" in the above embodiment, and the embodiment of the present invention is here. No longer.
在另一种实现方式中,用户可以通过预先配置的快捷键,控制多屏终端直接由“镜像模式”进入“双屏模式选择”界面,即控制多屏终端的第一显示面板显示“双屏模式选择”界面,然后再由“双屏模式选择”界面选择进入“独立模式”、“演示模式”或者“单屏模式”中的任一显示模式。In another implementation manner, the user can control the multi-screen terminal to directly enter the “dual-screen mode selection” interface from the “mirror mode” through the pre-configured shortcut key, that is, the first display panel that controls the multi-screen terminal displays “dual screen”. The Mode Selection interface is then selected by the Dual Screen Mode Selection interface to enter any of the "Independent Mode", "Demo Mode" or "Single Screen Mode" modes.
示例性的,此处以多屏终端直接由“镜像模式”进入“双屏模式选择”界面,然后再由“双屏模式选择”界面选择进入“演示模式”为例,对该实现方式的方法进行详细说明:Exemplarily, the multi-screen terminal directly enters the “dual-screen mode selection” interface by “mirror mode”, and then selects “demo mode” by the “dual-screen mode selection” interface as an example, and the method of the implementation manner is performed. Detailed description:
如图10d-1所示,假设当多屏终端的第一显示面板显示照片412时,用户想要在第二显示面板显示该照片412的全部或者部分细节。此时,该用户则可以通过预先配置的快捷键在第一显示界面显示如图11a-1所示的“双屏模式选择”界面。其中,当用户按下预设快捷键或者快捷键的组合时,处理器380可以检测到对应的按键事件,以确定该按键事件所对应的指令,随后,处理器380根据该指令调用存储在存储器320里的“双屏模式选择”应用,并在第一显示面板341显示该“双屏模式选择”应用的GUI。由于多屏终端300的当前显示模式为“镜像模式”,那么第一显示面板341便可以显示如图11a-1所示的GUI。由于当第一显示面板341便可以显示如图11a-1所示的GUI时,多屏终端300仍处于“镜像模式”,因此,如图11a-2所示,多屏终端300的第二显示面板则可以显示与第一显示界面相同的GUI。 As shown in FIG. 10d-1, it is assumed that when the first display panel of the multi-screen terminal displays the photo 412, the user wants to display all or part of the details of the photo 412 in the second display panel. At this time, the user can display the “dual screen mode selection” interface as shown in FIG. 11a-1 on the first display interface through the pre-configured shortcut keys. When the user presses the preset shortcut key or the combination of the shortcut keys, the processor 380 can detect the corresponding key event to determine an instruction corresponding to the key event, and then the processor 380 calls the storage in the memory according to the instruction. The "Dual Screen Mode Selection" application in 320, and the GUI of the "Double Screen Mode Selection" application is displayed on the first display panel 341. Since the current display mode of the multi-screen terminal 300 is "mirror mode", the first display panel 341 can display the GUI as shown in FIG. 11a-1. Since the multi-screen terminal 300 is still in the "mirror mode" when the first display panel 341 can display the GUI as shown in FIG. 11a-1, the second display of the multi-screen terminal 300 is as shown in FIG. 11a-2. The panel can display the same GUI as the first display interface.
如图11b-1所示,当用户手指触摸或接近显示在第一显示面板341上的“双屏模式选择”菜单408中的“演示模式”选项时,由于多屏终端300仍处于“镜像模式”,因此,如图11b-2所示,多屏终端300的第二显示面板则可以显示与第一显示面板相同的内容。第一触控面板331检测到在其上或附近的该触摸事件,传送给处理器380以确定该触摸事件所对应的指令,随后处理器380根据该指令调用存储在存储器320里的“演示模式”应用,并在第一显示面板341显示显示图11c-1所示的GUI。As shown in FIG. 11b-1, when the user's finger touches or approaches the "demo mode" option displayed in the "dual screen mode selection" menu 408 on the first display panel 341, since the multi-screen terminal 300 is still in the "mirror mode" Therefore, as shown in FIG. 11b-2, the second display panel of the multi-screen terminal 300 can display the same content as the first display panel. The first touch panel 331 detects the touch event on or near it, and transmits it to the processor 380 to determine an instruction corresponding to the touch event, and then the processor 380 calls the "demo mode" stored in the memory 320 according to the instruction. The application displays and displays the GUI shown in FIG. 11c-1 on the first display panel 341.
当然,多屏终端300也可以控制第二显示面板显示其他的文字或者图像(如上述预定义的图像:“Hello,World”字样),而不是显示如图11c-2所示的照片“天鹅”,本发明实施例对此不做限制。例如,如图14a-1和图14a-2所示,当多屏终端处于“演示模式”时,第二显示面板可以显示“演示模式”字样,而不是显示与第一显示面板相同的“照片”界面。Of course, the multi-screen terminal 300 can also control the second display panel to display other characters or images (such as the above-mentioned predefined image: "Hello, World") instead of displaying the photo "Swan" as shown in FIG. 11c-2. The embodiment of the present invention does not limit this. For example, as shown in FIG. 14a-1 and FIG. 14a-2, when the multi-screen terminal is in the "demo mode", the second display panel can display the "demo mode" instead of displaying the same "photo" as the first display panel. "interface.
可选的,为了在多屏终端处于“演示模式”和“单屏模式”显示相同内容时,区别多屏终端是处于“演示模式”,还是处于“单屏模式”;当多屏终端处于“演示模式”时,如图11c-1所示,第一显示面板上还可以显示一个演示图标601。图11中仅以举例方式给出演示图标的一种实例,本发明实施例中的演示图标的具体形状以及演示图标在第一显示面板和第二显示面板中的位置包括但不显示图11所示的形状和位置。其中,在第一显示面板显示图11c-1所示的GUI的同时,多屏终端的第二显示面板可以显示如图11c-2所示的GUI。如图11c-2所示,第二显示面板上也可以显示一个演示图标602。演示图标601和演示图标602可以相同也可以不同。Optionally, in order to display the same content in the "demo mode" and the "single screen mode" of the multi-screen terminal, distinguish whether the multi-screen terminal is in the "demo mode" or in the "single screen mode"; when the multi-screen terminal is in the "multi-screen terminal" In the demo mode, as shown in FIG. 11c-1, a demo icon 601 can also be displayed on the first display panel. An example of a presentation icon is given by way of example only in FIG. 11. The specific shape of the presentation icon and the position of the presentation icon in the first display panel and the second display panel in the embodiment of the present invention include but do not show FIG. The shape and location of the show. Wherein, the first display panel displays the GUI shown in FIG. 11c-1, and the second display panel of the multi-screen terminal can display the GUI as shown in FIG. 11c-2. As shown in FIG. 11c-2, a demo icon 602 can also be displayed on the second display panel. The presentation icon 601 and the presentation icon 602 may be the same or different.
其中,在“演示模式”下,多屏终端的辅工作屏可以显示与其主工作屏相同的内容,也可以显示其主显示屏中用户指定的内容。具体的,如图12所示,本发明实施例提供的多屏显示的方法可以包括S1201-S1202:Among them, in the "demo mode", the auxiliary work screen of the multi-screen terminal can display the same content as the main work screen, and can also display the content specified by the user in the main display screen. Specifically, as shown in FIG. 12, the method for displaying multi-screen display provided by the embodiment of the present invention may include S1201-S1202:
S1201:多屏终端接收用户对“演示模式”选项的触摸操作指令,进入演示模式。S1201: The multi-screen terminal receives a touch operation instruction of the user for the “demo mode” option, and enters the demo mode.
其中,多屏终端在接收用户对“演示模式”选项的触摸操作指令后,便可以进入上述“演示模式”。The multi-screen terminal can enter the “demo mode” after receiving the touch operation instruction of the “demo mode” option by the user.
例如,用户对“演示模式”选项的触摸操作指令可以为图11b-1中用户触摸或者触摸显示在第一显示面板341上的“双屏模式选择”菜单408中的“镜像模式”选项产生的操作指令。For example, a user's touch operation command to the "demo mode" option may be generated by the user in FIG. 11b-1 touching or touching the "mirror mode" option displayed in the "dual screen mode selection" menu 408 on the first display panel 341. Operation instructions.
S1202:多屏终端在第一显示面板显示第一GUI,该第一GUI可以包括第二显示面板的演示图标(如演示图标601)和第一显示对象。S1202: The multi-screen terminal displays a first GUI on the first display panel, and the first GUI may include a presentation icon (such as a presentation icon 601) of the second display panel and a first display object.
本发明实施例中可以先执行S1201,再执行S1202,即多屏终端可以在进入演示模式后,在第一显示面板显示第一GUI;或者还可以先执行S1202,再执行S1201,即可以多屏终端可以在在第一显示面板显示第一GUI后,再进入演示模式。本发明实施例对于执行S1201和S1202的先后顺序不做限制。In the embodiment of the present invention, S1201 may be executed first, and then S1202 is performed, that is, the multi-screen terminal may display the first GUI on the first display panel after entering the demonstration mode; or may execute S1202 first, and then execute S1201, that is, multiple screens may be performed. The terminal can enter the demo mode after displaying the first GUI on the first display panel. The embodiment of the present invention does not limit the order in which S1201 and S1202 are executed.
S1203:多屏终端获取用户在第一GUI上输入的第一指令,该第一指令为用户的第一操作触发的指令。 S1203: The multi-screen terminal acquires a first instruction input by the user on the first GUI, where the first instruction is an instruction triggered by the first operation of the user.
示例性的,第一操作可以是滑动轨迹的起点坐标为第二显示对象所在坐标位置、终点坐标为上述演示图标所在坐标位置的连续性滑动操作。Exemplarily, the first operation may be a continuous sliding operation in which the starting point coordinate of the sliding track is the coordinate position where the second display object is located and the end point coordinate is the coordinate position of the presentation icon.
上述第二显示对象可以包括第一显示对象的全部图像,或者第二显示对象包括第一显示对象的部分图像,或者第一显示对象包括至少两个子显示对象,第二显示对象为所述至少两个子显示对象中的一个子显示对象。The second display object may include all images of the first display object, or the second display object includes a partial image of the first display object, or the first display object includes at least two sub-display objects, and the second display object is the at least two A child display object in the display object.
S1204:多屏终端响应于第一指令,在第二显示面板显示包括第二显示对象的第二GUI。S1204: The multi-screen terminal displays a second GUI including the second display object in the second display panel in response to the first instruction.
其中,当第二显示对象包括第一显示对象的全部图像时,第二GUI中可以包括第一GUI中显示的全部图像内容;当第二显示对象包括第一显示对象的部分图像,或者第二显示对象为至少两个子显示对象中的一个子显示对象时,第二GUI中可以包括第一GUI中显示的部分图像内容。Wherein, when the second display object includes all the images of the first display object, the second GUI may include all the image content displayed in the first GUI; when the second display object includes a partial image of the first display object, or the second When the display object is one of the at least two child display objects, the partial GUI content displayed in the first GUI may be included in the second GUI.
示例性的,多屏终端可以响应于第一指令,从第一显示对象中确定出第二显示对象,然后再在第二显示面板显示包括第二显示对象的第二GUI。Exemplarily, the multi-screen terminal may determine the second display object from the first display object in response to the first instruction, and then display the second GUI including the second display object in the second display panel.
可选的,为了更加直观的突出所述第二显示面板所显示的第二显示对象与第一显示面板所显示的第一显示对象的关系,多屏终端还可以在第一显示面板中的第一显示对象上突出显示第二显示对象。Optionally, in order to more intuitively highlight the relationship between the second display object displayed by the second display panel and the first display object displayed by the first display panel, the multi-screen terminal may also be in the first display panel. A second display object is highlighted on a display object.
在“演示模式”的第一种应用场景中,第二显示对象可以包括第一显示对象的全部图像。In the first application scenario of the "demo mode", the second display object may include all images of the first display object.
示例性的,如图13a-1所示,假设第一显示面板341当前显示包括照片603(即第一显示对象)的GUI(即第一GUI),如图13a-2所示,第二显示面板342当前显示包括照片1301的GUI。如图13a-1所示,当用户手指触摸或接近显示在第一显示面板341上的照片603,并将照片603拖拽至演示图标601处时,多屏终端300的第一触控面板331可以检测到在其上或附近的连续性滑动拖拽事件(即执行1203)后,将事件传送给处理器380,以在第二显示面板显示如图13b-2所示的GUI(即执行S1204)。Exemplarily, as shown in FIG. 13a-1, it is assumed that the first display panel 341 currently displays a GUI (ie, a first GUI) including a photo 603 (ie, a first display object), as shown in FIG. 13a-2, and a second display. Panel 342 currently displays a GUI that includes photo 1301. As shown in FIG. 13a-1, when the user's finger touches or approaches the photo 603 displayed on the first display panel 341 and drags the photo 603 to the presentation icon 601, the first touch panel 331 of the multi-screen terminal 300 After the continuous sliding drag event (ie, execution 1203) on or near it can be detected, the event is transmitted to the processor 380 to display the GUI as shown in FIG. 13b-2 on the second display panel (ie, execute S1204) ).
在“演示模式”的第二种应用场景中,第二显示对象包括第一显示对象的部分图像。在这种应用场景中,如图14所示,图12中的S1204可以替换为S1204a:In a second application scenario of the "demo mode", the second display object includes a partial image of the first display object. In this application scenario, as shown in FIG. 14, S1204 in FIG. 12 can be replaced with S1204a:
S1204a:多屏终端响应于第一指令,在第一显示面板所显示的第一GUI上显示以起点坐标为中心点的图像选择窗口,并在第二显示面板显示图像选择窗口所包围的图像。S1204a: The multi-screen terminal displays an image selection window centered on the starting point coordinate on the first GUI displayed on the first display panel, and displays an image surrounded by the image selection window on the second display panel, in response to the first instruction.
其中,上述图像选择窗口的形状可以为矩形、圆形或者多边形,本发明实施例对此不做限定。并且,该图像选择窗口的尺寸可以是预先配置在多屏终端中的固定尺寸;或者,多屏终端中可以预先配置图像选择窗口的初始尺寸,多屏终端可以按照该初始尺寸显示图像选择窗口,然后接收用户对该初始尺寸的调节操作,重新确定图像选择窗口的尺寸。The shape of the image selection window may be a rectangle, a circle, or a polygon, which is not limited in the embodiment of the present invention. Moreover, the size of the image selection window may be a fixed size pre-configured in the multi-screen terminal; or the initial size of the image selection window may be pre-configured in the multi-screen terminal, and the multi-screen terminal may display the image selection window according to the initial size. The user is then adjusted to the initial size to re-determine the size of the image selection window.
示例性的,本发明实施例这里以图像选择窗口为圆形为例,如图15a-1所示,当用户手指触摸或接近显示在第一显示面板341上的照片603上的一点(称为点O),并将照片603拖拽至演示图标601处时,多屏终端300的第 一触控面板331可以检测到在其上或附近的连续性滑动拖拽事件(即执行1203)后,将事件传送给处理器380,处理器380可以确定出以滑动轨迹的起点坐标(即O点的坐标)为圆心,半径为预设半径的图像选择窗口604,在第一显示面板显示如图15b-1所示的GUI,在第二显示面板显示如图15b-2所示的GUI。其中,如图15b-1所示,第一显示面板显示的GUI中包括图像选择窗口604,第二显示面板显示的GUI中包括图像选择窗口604所包围的图像。Exemplarily, the embodiment of the present invention takes the image selection window as a circle as an example, as shown in FIG. 15a-1, when the user's finger touches or approaches a point on the photo 603 displayed on the first display panel 341 (referred to as a point). Point O), and drag the photo 603 to the presentation icon 601, the first of the multi-screen terminal 300 After the touch panel 331 can detect a continuous sliding drag event (ie, execution 1203) on or near it, the event is transmitted to the processor 380, and the processor 380 can determine the starting point coordinate of the sliding track (ie, O The coordinates of the point are the center of the image selection window 604 having a radius of a predetermined radius, the GUI shown in FIG. 15b-1 is displayed on the first display panel, and the GUI shown in FIG. 15b-2 is displayed on the second display panel. As shown in FIG. 15b-1, the GUI displayed by the first display panel includes an image selection window 604, and the GUI displayed by the second display panel includes an image surrounded by the image selection window 604.
在“演示模式”的第二种应用场景中,用户还可以拖拽第一显示面板上显示的图像选择窗口604,控制图像选择窗口604在第一显示面板上移动,以便可以在第二显示面板上显示照片603的不同细节内容。如图16所示,在图14所示的S1204a之后,本发明实施例的方法还可以包括S1601:In the second application scenario of the "demo mode", the user can also drag the image selection window 604 displayed on the first display panel, and control the image selection window 604 to move on the first display panel so that the second display panel can be The different details of the photo 603 are displayed on the top. As shown in FIG. 16, after S1204a shown in FIG. 14, the method of the embodiment of the present invention may further include S1601:
S1601:多屏终端获取用户在第一GUI上输入的第二指令,该第二指令为用于触发多屏终端在第一显示面板上移动图像选择窗口的指令。S1601: The multi-screen terminal acquires a second instruction input by the user on the first GUI, where the second instruction is an instruction for triggering the multi-screen terminal to move the image selection window on the first display panel.
S1602:多屏终端响应于第二指令,按照第二指令所指示的移动轨迹,在第一显示面板所显示的第一GUI上显示动态移动的图像选择窗口,并在第二显示面板显示包括第三显示对象的第三GUI,第三显示对象为图像选择窗口在移动轨迹的终点坐标处所包围的图像。S1602: The multi-screen terminal displays a dynamically moving image selection window on the first GUI displayed by the first display panel according to the movement trajectory indicated by the second instruction, and displays the second display panel in the second display panel. The third GUI of the third display object, the third display object is an image surrounded by the image selection window at the end point coordinates of the moving trajectory.
示例性的,如图15c-1所示,当用户手指拖拽显示在第一显示面板341上的图像选择窗口604时,多屏终端的第一触控面板331可以检测到在其上或附近的拖拽事件(即执行1601);而后,可以将该拖拽事件传送给处理器380,以确定该拖拽事件的移动轨迹在第一显示面板上的坐标,在第一显示面板动态显示图像选择窗口,并在移动轨迹的终点坐标显示如图15c-1所示的由虚线构成的图像选择窗口,直至用户手指离开第一显示面板后在第一显示面板显示如图15d-1所示的GUI,在第二显示面板可以显示如图15d-2所示的GUI(即执行S1602)。Exemplarily, as shown in FIG. 15c-1, when the user's finger drags and displays the image selection window 604 displayed on the first display panel 341, the first touch panel 331 of the multi-screen terminal can be detected on or near Drag event (ie, execution 1601); then, the drag event can be transmitted to the processor 380 to determine the coordinates of the drag track of the drag event on the first display panel, and the image is dynamically displayed on the first display panel. Selecting a window, and displaying an image selection window composed of a broken line as shown in FIG. 15c-1 at the end point coordinate of the moving track until the user's finger leaves the first display panel and displays the first display panel as shown in FIG. 15d-1. The GUI, in the second display panel, can display the GUI as shown in FIG. 15d-2 (ie, execute S1602).
可以理解的是,在用户手指拖拽显示在第一显示面板341上的图像选择窗口604的过程中,由于用户并未确定图像选择窗口604在第一显示面板中的位置,因此,如图15c-2所示,第二显示面板可以显示与图15b-2相同的GUI。在用户手指离开第一显示面板,第以显示面板可以显示如图15d-1所示的GUI时,第二显示面板则可以显示如图15d-2所示的终端画面。It can be understood that, in the process of the user's finger dragging and dropping the image selection window 604 displayed on the first display panel 341, since the user does not determine the position of the image selection window 604 in the first display panel, as shown in FIG. 15c As shown in FIG. 2, the second display panel can display the same GUI as that of FIG. 15b-2. When the user's finger leaves the first display panel, and the first display panel can display the GUI as shown in FIG. 15d-1, the second display panel can display the terminal screen as shown in FIG. 15d-2.
在“演示模式”的第三种应用场景中,第一显示对象包括至少两个子显示对象,第二显示对象为至少两个子显示对象中的一个子显示对象。In a third application scenario of the "demo mode", the first display object includes at least two child display objects, and the second display object is one of the at least two child display objects.
示例性的,以第一显示对象为手机中的照片列表,至少两个子显示对象为照片列表中的照片为例。如果17a-1所示,第一显示面板341显示照片列表,当用户手指拖拽第一显示面板341上的图标701至演示图标601,第一触控面板331检测到在其上或附近的该拖拽事件,传送给处理器380以确定拖拽事件所对应的指令;随后,处理器380根据该指令确定图标701对应的照片为第二显示对象,而后,可以在第一显示面板显示如图17b-1所示的GUI的同时,在第二显示面板显示如图17b-2所示的GUI。其中,如图17b-1所示, 第一显示面板可以突出显示第二显示对象。Exemplarily, the first display object is a photo list in the mobile phone, and the at least two sub display objects are photos in the photo list. If 17a-1 is shown, the first display panel 341 displays a list of photos. When the user drags the icon 701 on the first display panel 341 to the presentation icon 601, the first touch panel 331 detects the image on or near it. The drag event is transmitted to the processor 380 to determine an instruction corresponding to the drag event; then, the processor 380 determines that the photo corresponding to the icon 701 is the second display object according to the instruction, and then displays the image on the first display panel. At the same time as the GUI shown in 17b-1, the GUI shown in Fig. 17b-2 is displayed on the second display panel. Where, as shown in Figure 17b-1, The first display panel can highlight the second display object.
进一步的,多屏终端在第二显示面板显示包括第二显示对象的第二GUI的方法可以包括:多屏终端在第二显示面板显示包括第二显示对象由小逐渐变大的动态图像的第二GUI。或者,多屏终端在第二显示面板显示包括第二显示对象的第二GUI的方法可以包括:根据上述滑动轨迹的起点坐标与终点坐标的直线距离,在第二显示面板显示包括与直线距离对应大小的第二显示对象的第二GUI,上述直线距离越长,第二GUI中的第二显示对象则越大,或者上述直线距离越长,第二GUI中的第二显示对象则越小。Further, the method for the multi-screen terminal to display the second GUI including the second display object on the second display panel may include: displaying, by the multi-screen terminal, the second display panel including the second display object from the small and gradually increasing dynamic image Two GUI. Alternatively, the method for displaying, by the multi-screen terminal, the second GUI including the second display object on the second display panel may include: displaying, according to a linear distance between the start point coordinate and the end point coordinate of the sliding track, the second display panel includes a distance corresponding to the straight line distance The second GUI of the second display object of a size, the longer the linear distance is, the larger the second display object in the second GUI is, or the longer the linear distance is, the smaller the second display object in the second GUI is.
可选的,上述第一操作还可以为用户在第一GUI上绘出图像选择窗口的操作。在这种情况下,多屏终端可以响应于第一指令,将所述第一显示对象上所述图像选择窗口所包围的图像确定为第二显示对象,然后在第二显示面板显示包括第二显示对象的第二GUI。Optionally, the foregoing first operation may also be an operation for the user to draw an image selection window on the first GUI. In this case, the multi-screen terminal may determine, according to the first instruction, an image surrounded by the image selection window on the first display object as a second display object, and then display the second display panel in the second display panel. The second GUI of the display object.
例如,如图18a-1所示,当用户手指触摸或接近显示在第一显示面板341上的照片603,形成图像选择窗口604时,多屏终端300的第一触控面板331检测到在其上或附近的该窗口选择事件(即执行1203)后,将该窗口选择事件传送给处理器380,以确定该窗口选择事件对应的图像选择窗口604在第一显示面板上的坐标,确定出包围第一GUI中的部分或者全部图像的图像选择窗口。而后,处理器380可以在第一显示面板显示如图18b-1所示的GUI的同时,将照片603上图像选择窗口604所包围的图像确定为第二显示对象,并在第二显示面板显示如图18b-2所示的GUI。For example, as shown in FIG. 18a-1, when the user's finger touches or approaches the photo 603 displayed on the first display panel 341 to form the image selection window 604, the first touch panel 331 of the multi-screen terminal 300 detects that it is After the window selection event on or near the window (ie, execution 1203), the window selection event is transmitted to the processor 380 to determine the coordinates of the image selection window 604 corresponding to the window selection event on the first display panel to determine the enclosing An image selection window of some or all of the images in the first GUI. Then, the processor 380 can determine the image surrounded by the image selection window 604 on the photo 603 as the second display object and display on the second display panel while the first display panel displays the GUI as shown in FIG. 18b-1. The GUI shown in Figure 18b-2.
示例性的,如图18c-1所示,当用户手指拖拽显示在第一显示面板341上的图像选择窗口604时,多屏终端的第一触控面板331可以检测到在其上或附近的拖拽事件(即执行1601);而后,可以将该拖拽事件传送给处理器380,以确定该拖拽事件的移动轨迹在第一显示面板上的坐标,在第一显示面板动态显示图像选择窗口,并在移动轨迹的终点坐标显示如图18c-1所示的由虚线构成的图像选择窗口,直至用户手指离开第一显示面板后控制第一显示面板显示如图18d-1所示的GUI,在第二显示面板显示如图18d-2所示的GUI(即执行S1209)。Exemplarily, as shown in FIG. 18c-1, when the user drags and drops the image selection window 604 displayed on the first display panel 341, the first touch panel 331 of the multi-screen terminal can be detected on or near Drag event (ie, execution 1601); then, the drag event can be transmitted to the processor 380 to determine the coordinates of the drag track of the drag event on the first display panel, and the image is dynamically displayed on the first display panel. Selecting a window, and displaying an image selection window composed of a broken line as shown in FIG. 18c-1 at the end point coordinate of the moving track until the user's finger leaves the first display panel and controls the first display panel to display as shown in FIG. 18d-1. The GUI displays a GUI as shown in FIG. 18d-2 on the second display panel (ie, executes S1209).
本发明实施例提供的多屏显示的方法,多屏终端处于“演示模式”时,可以响应于用户的操作,控制第二显示面板显示第一显示面板所显示的全部或者部分内容,即该多屏终端的两个显示屏之间可以相互交互,而不是彼此独立,可以提高人机交互过程中的用户体验。The multi-screen display method provided by the embodiment of the present invention, when the multi-screen terminal is in the "demo mode", can control the second display panel to display all or part of the content displayed by the first display panel in response to the user's operation, that is, the plurality of The two display screens of the screen terminal can interact with each other instead of being independent of each other, which can improve the user experience in the process of human-computer interaction.
其中,多屏终端进入“独立模式”的方式与该多屏终端进入上述“镜像模式”或者“演示模式”的方式类似,本发明实施例这里不再赘述。The manner in which the multi-screen terminal enters the "independent mode" is similar to the manner in which the multi-screen terminal enters the "mirror mode" or the "demo mode", and details are not described herein again.
本发明实施例提供的“独立模式”中,多屏终端可以为第一显示面板和第二显示面板分别设置一个任务窗口,其中,第一任务窗口用于对应于第一显示面板,用于保存第一显示面板待显示的内容的显示任务,第二任务窗口对应于第二显示面板,用于保存第二显示面板待显示的内容的显示任务。多屏终端可以根据预先设定的显示策略或者根据用户的选择,将显示任务添加至 上述第一任务窗口或者第二任务窗口;而后,第一显示面板可以按照第一任务窗口中的显示任务添加的时间顺序,优先显示最新添加的显示任务对应的GUI,第二显示面板可以按照第二任务窗口中的显示任务添加的时间顺序,优先显示最新添加的显示任务对应的GUI。具体的,如图19所示,本发明实施例的方法还可以包括S1901-S1910:In the "independent mode" provided by the embodiment of the present invention, the multi-screen terminal may respectively set a task window for the first display panel and the second display panel, wherein the first task window is used to correspond to the first display panel for saving a display task of the content to be displayed on the first display panel, the second task window corresponding to the second display panel, configured to save a display task of the content to be displayed on the second display panel. The multi-screen terminal can add the display task to the display policy according to a preset display policy or according to the user's selection. The first task window or the second task window; and then the first display panel may preferentially display the GUI corresponding to the newly added display task according to the time sequence added by the display task in the first task window, and the second display panel may follow the first The time sequence in which the display tasks are added in the second task window, and the GUI corresponding to the newly added display task is preferentially displayed. Specifically, as shown in FIG. 19, the method in the embodiment of the present invention may further include S1901-S1910:
S1901:多屏终端获取用户对“独立模式”选项的触摸操作指令,进入独立模式。S1901: The multi-screen terminal acquires a user's touch operation instruction for the "independent mode" option, and enters the independent mode.
其中,多屏终端在接收用户对“独立模式”选项的触摸操作指令后,便可以进入上述“独立模式”。Wherein, the multi-screen terminal can enter the above-mentioned "independent mode" after receiving the user's touch operation instruction for the "independent mode" option.
示例性的,如图20所示,假设多屏终端在进入独立模式后,该多屏终端的第一显示面板显示如图20a-1所示的GUI,第二显示面板显示如图20a-2所示的GUI。其中,在“独立模式”下,第一显示面板可以显示如图20a-1所示的第一任务窗口的图标801和第二任务窗口的图标802,同样的,第二显示面板可以显示如图20a-2所示的第一窗口堆栈的图标801和第二窗口堆栈的图标802。Exemplarily, as shown in FIG. 20, after the multi-screen terminal enters the independent mode, the first display panel of the multi-screen terminal displays the GUI as shown in FIG. 20a-1, and the second display panel displays as shown in FIG. 20a-2. The GUI shown. In the "independent mode", the first display panel can display the icon 801 of the first task window and the icon 802 of the second task window as shown in FIG. 20a-1. Similarly, the second display panel can display the figure. The icon 801 of the first window stack and the icon 802 of the second window stack shown in 20a-2.
S1902:多屏终端获取用户输入的第二指令,该第二指令为用于触发多屏终端打开第一应用的指令。S1902: The multi-screen terminal acquires a second instruction input by the user, where the second instruction is an instruction for triggering the multi-screen terminal to open the first application.
其中,第二指令为第一应用的启动指令。由于在“独立模式”下,多屏终端可以同时支持第一响应模式(即第一触控面板响应模式)和第二响应模式(即第二触控面板响应模式);因此,该第一应用的启动指令可以为用户手指触摸或接近显示在第一显示面板时,第一触控面板检测到在其上或附近的该触摸事件,传送给处理器,由处理器确定的该触摸事件所对应的指令;或者,第一应用的启动指令可以为用户手指触摸或接近显示在第二显示面板时,第二触控面板检测到在其上或附近的该触摸事件,传送给处理器,由处理器确定的该触摸事件所对应的指令。The second instruction is a startup instruction of the first application. Because in the "independent mode", the multi-screen terminal can simultaneously support the first response mode (ie, the first touch panel response mode) and the second response mode (ie, the second touch panel response mode); therefore, the first application The start command may be when the user touches or approaches the first display panel, and the first touch panel detects the touch event on or near the touch panel, and transmits the touch event to the processor, where the touch event determined by the processor corresponds. The instruction of the first application may be when the user touches or approaches the second display panel, and the second touch panel detects the touch event on or near the touch panel, and transmits the touch event to the processor for processing. The instruction corresponding to the touch event determined by the device.
并且,在“独立模式”下,多屏终端可以支持上述第一响应模式,在第一显示面板上显示第一触控面板检测到的触摸事件对应的GUI,支持上述第二响应模式,在第二显示面板上显示第二触控面板检测到的触摸事件对应的GUI。In addition, in the "independent mode", the multi-screen terminal can support the first response mode, display the GUI corresponding to the touch event detected by the first touch panel on the first display panel, and support the second response mode. The GUI corresponding to the touch event detected by the second touch panel is displayed on the second display panel.
S1903:多屏终端响应于第二指令,将第一显示任务添加至第一任务窗口,第一显示任务为第一应用对应的显示任务。S1903: The multi-screen terminal adds the first display task to the first task window in response to the second instruction, where the first display task is a display task corresponding to the first application.
其中,多屏终端可以响应于第二指令,生成第一显示任务并在第一时间将第一显示任务添加至第一任务窗口。The multi-screen terminal may generate the first display task and add the first display task to the first task window at the first time in response to the second instruction.
在多屏终端将第一显示任务添加至第一任务窗口之前,多屏终端可能已经在第一任务窗口中添加了其他的显示任务(如第三显示任务),该第三显示任务可以是多屏终端在第二时间添加至第一任务窗口中的显示任务,第二时间早于第一时间。当然,在多屏终端将第一显示任务添加至第一任务窗口之前,第一任务窗口中也可能并未添加其他的显示任务。Before the multi-screen terminal adds the first display task to the first task window, the multi-screen terminal may have added other display tasks (such as the third display task) in the first task window, and the third display task may be more The screen terminal is added to the display task in the first task window at a second time, and the second time is earlier than the first time. Of course, before the first display task is added to the first task window by the multi-screen terminal, other display tasks may not be added in the first task window.
其中,当上述第一应用的指定显示屏是第一显示面板所在的显示屏时, 则可以将第一显示任务添加至第一任务窗口。Wherein, when the designated display screen of the first application is the display screen where the first display panel is located, The first display task can be added to the first task window.
示例性的,多屏终端可以根据第二指令的指示确定第一应用的指定显示屏是第一显示面板所在的显示屏,即上述第二指令还可以用于触发多屏终端在第一显示面板上显示第一GUI;或者,多屏终端中可以预先存储各个应用程序与第一显示面板以及第二显示面板的对应关系,多屏终端可以根据该对应关系确定第一显示面板为预先配置的用于显示第一应用的界面的显示面板。Exemplarily, the multi-screen terminal may determine, according to the indication of the second instruction, that the designated display screen of the first application is the display screen where the first display panel is located, that is, the second instruction may also be used to trigger the multi-screen terminal in the first display panel. The first GUI is displayed on the first GUI; or the corresponding relationship between the application and the first display panel and the second display panel may be pre-stored in the multi-screen terminal, and the multi-screen terminal may determine, according to the correspondence, that the first display panel is pre-configured. A display panel for displaying an interface of the first application.
S1904:多屏终端执行第一任务窗口中的第一显示任务,在第一显示面板显示包括第一显示对象的第一GUI,第一GUI为第一应用的界面。S1904: The multi-screen terminal executes the first display task in the first task window, and displays a first GUI that includes the first display object in the first display panel, where the first GUI is an interface of the first application.
其中,多屏终端可以按照第一任务窗口中的显示任务的添加的时间顺序,优先执行最新添加至第一任务窗口的显示任务(即添加至第一任务窗口的时间最短的显示任务)。由于第一显示任务是最新添加至第一任务窗口的显示任务,因此多屏终端可以优先执行第一任务窗口中的第一显示任务。当多屏终端执行完第一任务窗口中的第一显示任务,或者第一显示任务被多屏终端响应于用户操作从第一任务窗口中删除时,该多屏终端则可以继续执行第三显示任务,即第一任务窗口中除第一显示任务之外、添加至第一任务窗口的时间最短的显示任务。The multi-screen terminal may preferentially execute the display task newly added to the first task window (ie, the display task with the shortest time added to the first task window) according to the added time sequence of the display task in the first task window. Since the first display task is the display task newly added to the first task window, the multi-screen terminal can preferentially execute the first display task in the first task window. When the multi-screen terminal executes the first display task in the first task window, or the first display task is deleted from the first task window by the multi-screen terminal in response to the user operation, the multi-screen terminal may continue to perform the third display. The task, that is, the display task with the shortest time added to the first task window except the first display task in the first task window.
S1905:多屏终端获取用户输入的第三指令,该第三指令为用于触发多屏终端打开第二应用的指令。S1905: The multi-screen terminal acquires a third instruction input by the user, where the third instruction is an instruction for triggering the multi-screen terminal to open the second application.
S1906:多屏终端响应于第三指令,将第二显示任务添加至第二任务窗口,第二显示任务为第二应用对应的显示任务。S1906: The multi-screen terminal adds the second display task to the second task window, and the second display task is the display task corresponding to the second application, in response to the third instruction.
其中,多屏终端可以响应于第三指令,生成第二显示任务并在第三时间将第二显示任务添加至第二任务窗口。The multi-screen terminal may generate a second display task and add the second display task to the second task window at a third time in response to the third instruction.
在多屏终端将第二显示任务添加至第二任务窗口之前,多屏终端可能已经在第二任务窗口中添加了其他的显示任务(如第四显示任务),该第四显示任务可以是多屏终端在第四时间添加至第二任务窗口中的显示任务,第四时间早于第三时间。当然,在多屏终端将第二显示任务添加至第二任务窗口之前,第二任务窗口中也可能并未添加其他的显示任务。Before the second display task is added to the second task window by the multi-screen terminal, the multi-screen terminal may have added other display tasks (such as the fourth display task) in the second task window, and the fourth display task may be more The screen terminal is added to the display task in the second task window at the fourth time, and the fourth time is earlier than the third time. Of course, before the second display task is added to the second task window by the multi-screen terminal, other display tasks may not be added in the second task window.
S1907:多屏终端执行第二任务窗口中的第二显示任务,在第二显示面板显示包括第二显示对象的第二GUI。S1907: The multi-screen terminal executes a second display task in the second task window, and displays a second GUI including the second display object on the second display panel.
其中,多屏终端可以按照第二任务窗口中的显示任务的添加的时间顺序,优先执行最新添加至第二任务窗口的显示任务(即添加至第二任务窗口的时间最短的显示任务)。由于第二显示任务是最新添加至第二任务窗口的显示任务,因此多屏终端可以优先执行第二任务窗口中的第二显示任务。当多屏终端执行完第二任务窗口中的第二显示任务,或者第二显示任务被多屏终端响应于用户操作从第二任务窗口中删除时,该多屏终端则可以继续执行第四显示任务,即第二任务窗口中除第二显示任务之外、添加至第二任务窗口的时间最短的显示任务。The multi-screen terminal may preferentially execute the display task newly added to the second task window (ie, the display task with the shortest time added to the second task window) according to the added time sequence of the display task in the second task window. Since the second display task is the display task newly added to the second task window, the multi-screen terminal can preferentially execute the second display task in the second task window. When the multi-screen terminal executes the second display task in the second task window, or the second display task is deleted from the second task window by the multi-screen terminal in response to the user operation, the multi-screen terminal may continue to execute the fourth display. The task, that is, the shortest display task added to the second task window in addition to the second display task in the second task window.
S1908:多屏终端获取用户在第一GUI上输入的第一指令,该第一指令用于触发多屏终端在第二显示面板显示包括第一显示面板当前显示的第一显 示对象的GUI。S1908: The multi-screen terminal acquires a first instruction input by the user on the first GUI, where the first instruction is used to trigger the multi-screen terminal to display, in the second display panel, the first display currently displayed by the first display panel. The GUI of the object.
可选的,第一GUI中还可以包括第二任务窗口的图标,第一指令可以是用户的第一操作触发的指令,该第一操作可以是滑动轨迹的起点坐标为第一显示对象所在坐标位置、终端坐标为第二任务窗口的图标所在坐标位置的连续性滑动操作,所述第一指令用于指示所述多屏终端将所述第一显示任务添加至所述第二任务窗口。Optionally, the first GUI may further include an icon of the second task window, where the first instruction may be an instruction triggered by the first operation of the user, and the first operation may be that the starting coordinate of the sliding track is the coordinate of the first display object. The position and the terminal coordinate are continuous sliding operations of the coordinate position of the icon of the second task window, and the first instruction is used to instruct the multi-screen terminal to add the first display task to the second task window.
S1909:多屏终端响应于第一指令,从第一任务窗口中删除第一显示任务,并将第一显示任务添加至第二任务窗口。S1909: The multi-screen terminal deletes the first display task from the first task window and adds the first display task to the second task window in response to the first instruction.
S1910:多屏终端在第二显示面板显示包括第一显示对象的第三GUI,并在第一显示面板显示包括第三显示对象的第四GUI。S1910: The multi-screen terminal displays a third GUI including the first display object on the second display panel, and displays a fourth GUI including the third display object on the first display panel.
由于第一显示任务是最新添加至第二任务窗口的显示任务,因此多屏终端可以优先执行第二任务窗口中的第一显示任务,在第二显示面板显示包括第一显示对象的第三GUI;并且,由于第一显示任务已经从第一任务窗口中删除,因此多屏终端则可以继续执行第一任务窗口中的第三显示任务(即第一任务窗口中除第一显示任务之外、添加至第一任务窗口的时间最短的显示任务),并在第一显示面板显示包括第三显示对象的第四GUI。Since the first display task is the latest display task added to the second task window, the multi-screen terminal can preferentially execute the first display task in the second task window, and display the third GUI including the first display object in the second display panel. And, since the first display task has been deleted from the first task window, the multi-screen terminal can continue to execute the third display task in the first task window (ie, in addition to the first display task in the first task window, The shortest display task added to the first task window) and displaying the fourth GUI including the third display object on the first display panel.
示例性的,以下结合图20对多屏终端处于“独立模式”时,多屏终端执行如图19所示的多屏显示的方法的过程进行举例说明:Exemplarily, the process of the multi-screen terminal performing the multi-screen display method shown in FIG. 19 when the multi-screen terminal is in the "independent mode" is exemplified below with reference to FIG. 20:
如图20a-1所示,当用户手指触摸或接近显示在第一显示面板341上的“阅读”图标803时,第一触控面板331检测到在其上或附近的该触摸事件,传送给处理器380以确定该触摸事件所对应的指令(即执行S1902),随后处理器380根据该指令(即“阅读”应用的启动指令)调用存储在存储器320里的“阅读”应用的GUI,生成并添加第一显示任务至第一任务窗口(即执行S1903),在第一显示面板显示如图20b-1所示的GUI(即执行S1904)。该第一显示任务具体为:显示“阅读”应用的GUI。As shown in FIG. 20a-1, when the user's finger touches or approaches the "read" icon 803 displayed on the first display panel 341, the first touch panel 331 detects the touch event on or near it, and transmits it to The processor 380 determines an instruction corresponding to the touch event (ie, executes S1902), and then the processor 380 calls the GUI of the "read" application stored in the memory 320 according to the instruction (ie, the "read" application start instruction) to generate And adding the first display task to the first task window (ie, executing S1903), and displaying the GUI as shown in FIG. 20b-1 on the first display panel (ie, executing S1904). The first display task is specifically: displaying a GUI of the "reading" application.
在如图20a-1所示用户操作第一显示面板的同时,如图20a-2所示,如果用户手指触摸或接近显示在第二显示面板上的“照片”图标701,第二触控面板则可以检测到在其上或附近的该触摸事件,传送给处理器以确定该触摸事件所对应的指令,随后处理器380根据该指令(即“照片”应用的启动指令)(即执行S1905)调用存储在存储器里的“照片”应用的GUI,生成并添加第而显示任务至第二任务窗口(即执行S1906),在第二显示面板显示如图20b-2所示的GUI(即执行S1907)。该第一显示任务具体为:显示“照片”应用的GUI。While the user operates the first display panel as shown in FIG. 20a-1, as shown in FIG. 20a-2, if the user's finger touches or approaches the "photograph" icon 701 displayed on the second display panel, the second touch panel Then, the touch event on or near the device can be detected and transmitted to the processor to determine an instruction corresponding to the touch event, and then the processor 380 is in accordance with the instruction (ie, the "photo" application startup instruction) (ie, execute S1905) Calling the GUI of the "photo" application stored in the memory, generating and adding the first display task to the second task window (ie, executing S1906), and displaying the GUI as shown in FIG. 20b-2 on the second display panel (ie, executing S1907) ). The first display task is specifically: displaying a GUI of the "photo" application.
可以理解,由于“阅读”应用的启动指令是第一触控面板检测到的,因此多屏终端可以确定该“阅读”应用的指定显示屏为第一显示面板。由于“阅读”应用的指定显示屏为第一显示面板,因此多屏终端可以将第一显示任务添加至第一任务窗口(即执行S1903)。It can be understood that since the startup command of the “reading” application is detected by the first touch panel, the multi-screen terminal can determine that the designated display screen of the “reading” application is the first display panel. Since the designated display screen of the "reading" application is the first display panel, the multi-screen terminal can add the first display task to the first task window (ie, execute S1903).
如图21a-1和图21b-1所示,“阅读”任务为第一时间添加至第一任务窗口的第一显示任务,“视频1”任务为第二时间添加至第一任务窗口的第三显示任 务,第一时间晚于第二时间;“照片”任务为第三时间添加至第二任务窗口的第二显示任务,“视频2”任务为第四时间添加至第二任务窗口的第四显示任务。多屏终端执行S1908-S1909,可以将上述第一显示任务(“阅读”任务)从第一任务窗口删除,并将第一显示任务(“阅读”任务)添加至第二任务窗口,由如图21a-1到图21a-2,图21b-1至图21b-2所示,为多屏终端执行S1908-S1909后,第一任务窗口和第二任务窗口中的显示任务的变化实例示意图。As shown in FIG. 21a-1 and FIG. 21b-1, the "read" task is added to the first display task of the first task window at the first time, and the "video 1" task is added to the first task window for the second time. Three display The first time is later than the second time; the "photo" task is added to the second display task of the second task window for the third time, and the "video 2" task is added to the fourth display of the second task window for the fourth time task. The multi-screen terminal executes S1908-S1909, and the first display task ("reading" task) can be deleted from the first task window, and the first display task ("reading task") is added to the second task window, as shown in the figure. 21a-1 to 21a-2, FIG. 21b-1 to FIG. 21b-2 are schematic diagrams showing examples of changes in display tasks in the first task window and the second task window after the S1908-S1909 is executed for the multi-screen terminal.
结合图21,假设第一显示面板当前正在执行第一显示任务,显示“阅读”的GUI,第二显示面板当前正在执行第二显示任务,显示“视频2”的GUI。如图22a-1所示,当用户手指触摸或接近显示在第一显示面板341上的“阅读”的GUI中的阅读窗口,并将该“阅读”的GUI中的阅读窗口拖拽至第二任务窗口的图标802的位置时,第一触控面板331检测到在其上或附近的该拖拽事件,传送给处理器380以确定该拖拽事件所对应的指令(即执行S1908),随后处理器380根据该指令,将第一显示任务(“阅读”任务)从第一任务窗口删除,并将第一显示任务添加至第二任务窗口(即执行S1909)。此时,如图21a-2所示,第一任务窗口中最新添加的显示任务为“视频1”任务(即第三显示任务),如图21b-2所示,第二任务窗口中最新添加的显示任务为“阅读”任务(即第一显示任务);因此,可以在第一显示面板显示如图22b-1所示的GUI;第二显示面板显示如图22b-2所示的GUI。21, assuming that the first display panel is currently executing the first display task, displaying a "read" GUI, the second display panel is currently executing the second display task, displaying the GUI of "Video 2". As shown in FIG. 22a-1, when the user's finger touches or approaches the reading window in the "read" GUI displayed on the first display panel 341, and drags the reading window in the "read" GUI to the second When the location of the icon 802 of the task window is detected, the first touch panel 331 detects the drag event on or near it, and transmits it to the processor 380 to determine an instruction corresponding to the drag event (ie, execute S1908), and then The processor 380 deletes the first display task ("read" task) from the first task window according to the instruction, and adds the first display task to the second task window (ie, executes S1909). At this time, as shown in FIG. 21a-2, the newly added display task in the first task window is a “Video 1” task (ie, a third display task), as shown in FIG. 21b-2, and the latest addition in the second task window. The display task is a "read" task (ie, the first display task); therefore, the GUI shown in FIG. 22b-1 can be displayed on the first display panel; the second display panel displays the GUI as shown in FIG. 22b-2.
其中,多屏终端还可以响应于用户对第一显示面板(或者第二显示面板)上的第一任务窗口的图标801或者第二任务窗口的图标802的触摸操作指令,在第一显示面板(或者第二显示面板)上显示第一任务窗口中的显示任务列表,该显示任务列表中包括该第一任务窗口内的所有显示任务的标识。The multi-screen terminal may also be in the first display panel (in response to the user's touch operation instruction on the icon 801 of the first task window or the icon 802 of the second task window on the first display panel (or the second display panel). Or displaying a display task list in the first task window on the second display panel, where the display task list includes identifiers of all display tasks in the first task window.
例如,如图23a所示,以如图20b-1所示的第一显示面板显示的内容为例,当用户手指触摸或接近显示在第一显示面板341上的第一任务窗口的图标801时,第一触控面板331检测到在其上或附近的该触摸事件,传送给处理器380以确定该触摸事件所对应的指令,随后处理器380根据该指令调用存储在存储器320里的“第一任务窗口”应用的GUI,并在第一显示面板显示如图23b所示的GUI。如图23b所示,第一显示面板上显示有第一任务窗口的显示任务列表804,该显示任务列表804中包括该第一任务窗口801内的所有显示任务的标识,如“阅读”任务的标识、“视频1”任务的标识。For example, as shown in FIG. 23a, taking the content displayed by the first display panel as shown in FIG. 20b-1 as an example, when the user's finger touches or approaches the icon 801 of the first task window displayed on the first display panel 341, The first touch panel 331 detects the touch event on or near it, and transmits it to the processor 380 to determine an instruction corresponding to the touch event, and then the processor 380 calls the "first" stored in the memory 320 according to the instruction. A task window "application GUI" and a GUI as shown in Figure 23b is displayed in the first display panel. As shown in FIG. 23b, a display task list 804 of the first task window is displayed on the first display panel, and the display task list 804 includes identifiers of all display tasks in the first task window 801, such as a "reading" task. ID, the ID of the "Video 1" task.
进一步的,当第一显示面板显示第一显示任务对应的GUI,第二显示面板显示第二显示任务对应的GUI的过程中,用户可能会想要在第一显示面板显示第二显示任务对应的GUI。多屏终端在第一显示面板显示第二显示任务对应的GUI的方法与在第二显示面板显示第一显示任务对应的GUI的方法类似,本发明实施例这里不再赘述。Further, in the process that the first display panel displays the GUI corresponding to the first display task and the second display panel displays the GUI corresponding to the second display task, the user may want to display the second display task corresponding to the first display panel. GUI. The method for displaying the GUI corresponding to the second display task in the first display panel of the multi-screen terminal is similar to the method for displaying the GUI corresponding to the first display task in the second display panel, and details are not described herein again.
可选的,上述第一任务窗口可以为第一窗口堆栈,该第一窗口堆栈可以用于按照先进后出的原则保存压入第一窗口堆栈的显示任务,第一显示面板用于显示第一窗口堆栈的栈顶的显示任务对应的GUI。第二任务窗口可以为第二窗口堆栈,该第二窗口堆栈用于按照先进后出的原则保存压入第二窗口 堆栈的显示任务,第二显示面板用于显示第二窗口堆栈的栈顶的显示任务对应的GUI。Optionally, the first task window may be a first window stack, where the first window stack may be used to save a display task pressed into the first window stack according to an advanced late-out principle, and the first display panel is configured to display the first The GUI of the display task at the top of the stack of the window stack. The second task window may be a second window stack, and the second window stack is used to save the second window according to the principle of advanced output. The display task of the stack, the second display panel is used to display the GUI corresponding to the display task of the top of the stack of the second window stack.
示例性的,如图24a-1所示,假设第一窗口堆栈中压入了两个显示任务:“阅读”任务和“视频1”任务,“阅读”任务位于第一窗口堆栈的栈顶,即如图22a-1所示,第一显示面板当前正在执行该“阅读”任务,显示“阅读”应用的GUI。Exemplarily, as shown in FIG. 24a-1, it is assumed that two display tasks are pushed into the first window stack: a "read" task and a "video 1" task, and the "read" task is located at the top of the stack of the first window stack. That is, as shown in FIG. 22a-1, the first display panel is currently executing the "read" task, displaying the GUI of the "read" application.
如图24b-1所示,假设第二窗口堆栈中压入了两个显示任务:“照片”任务、和“视频2”任务,“照片”任务位于第二窗口堆栈的栈顶,即如图22a-2所示,第二显示面板当前正在执行该“照片”任务,显示“照片”应用的GUI。As shown in Figure 24b-1, assume that two display tasks are pushed into the second window stack: the "Photo" task, and the "Video 2" task. The "Photo" task is located on the top of the stack of the second window stack. As shown in 22a-2, the second display panel is currently executing the "photo" task, displaying the GUI of the "photo" application.
如图22a-1所示,当用户手指触摸或接近显示在第一显示面板341上的“阅读”的GUI中的阅读窗口,并将该“阅读”的GUI中的阅读窗口拖拽至第二任务窗口的图标802的位置时,第一触控面板331检测到在其上或附近的该拖拽事件,传送给处理器380以确定该拖拽事件所对应的指令(即执行S1908),随后处理器380根据该指令,如图24a-1所示,将第一显示任务(“阅读”任务)从第一窗口堆栈窗口出栈,如图24b-1所示,并将第一显示任务压入第二任务窗口(即执行S1909)。此时,如图24a-2所示,第一窗口堆栈的栈顶的显示任务为“视频1”任务(即第三显示任务),如图24b-2所示,第二任务窗口的栈顶的显示任务为“阅读”任务(即第一显示任务);因此,可以在第一显示面板显示如图22b-1所示的GUI;第二显示面板显示如图22b-2所示的GUI。As shown in FIG. 22a-1, when the user's finger touches or approaches the reading window in the "read" GUI displayed on the first display panel 341, and drags the reading window in the "read" GUI to the second When the location of the icon 802 of the task window is detected, the first touch panel 331 detects the drag event on or near it, and transmits it to the processor 380 to determine an instruction corresponding to the drag event (ie, execute S1908), and then The processor 380 pops the first display task ("reading task") from the first window stack window according to the instruction, as shown in FIG. 24a-1, as shown in FIG. 24b-1, and presses the first display task. Enter the second task window (ie execute S1909). At this time, as shown in FIG. 24a-2, the display task of the top of the stack of the first window stack is a "Video 1" task (ie, a third display task), as shown in FIG. 24b-2, the top of the second task window. The display task is a "read" task (ie, the first display task); therefore, the GUI shown in FIG. 22b-1 can be displayed on the first display panel; the second display panel displays the GUI as shown in FIG. 22b-2.
进一步的,多屏终端可以响应于第一指令,在第一显示面板和第二显示面板显示包括动态图像的GUI,以提高用户视觉体验。具体的,图19所示的S1910可以替换为S1910a:Further, the multi-screen terminal may display a GUI including a dynamic image on the first display panel and the second display panel in response to the first instruction to improve the visual experience of the user. Specifically, S1910 shown in FIG. 19 can be replaced with S1910a:
S1910a:多屏终端响应于第一指令,在第二显示面板显示包括第一动态图像的第三GUI,并在第一显示面板显示包括第二动态图像的第四GUI。S1910a: The multi-screen terminal displays a third GUI including the first dynamic image on the second display panel in response to the first instruction, and displays a fourth GUI including the second dynamic image on the first display panel.
其中,上述第一动态图像为第一显示对象按照第一预设移动轨迹移动、且第一显示对象在移动过程中由小逐渐变大的动态图像,第一预设移动轨迹的起点坐标为第三GUI中的第一窗口堆栈的图标所在的坐标位置,第一预设移动轨迹的终点坐标为第三GUI中用于显示显示对象的坐标位置。The first moving image is a moving image in which the first display object moves according to the first preset moving trajectory, and the first display object gradually increases from small to small during the moving process, and the starting point coordinate of the first preset moving trajectory is The coordinate position of the icon of the first window stack in the third GUI, and the end point coordinate of the first preset movement track is a coordinate position for displaying the display object in the third GUI.
第二动态图像为第三显示对象按照第二预设移动轨迹移动、且第三显示对象在移动过程中由小逐渐变大的动态图像,第二预设移动轨迹的起点坐标为第四GUI中的第一窗口堆栈的图标所在的坐标位置,第二预设移动轨迹的终点坐标为第四GUI中用于显示显示对象的坐标位置。The second moving image is a moving image in which the third display object moves according to the second preset moving trajectory, and the third display object gradually becomes larger during the moving process, and the starting point coordinate of the second preset moving trajectory is in the fourth GUI. The coordinate position of the icon of the first window stack is the coordinate position of the second preset movement track for displaying the display object.
示例性的,如图25a-1所示,当用户手指触摸或接近显示在第一显示面板341上的“阅读”的GUI中的阅读窗口,并将该“阅读”的GUI中的阅读窗口拖拽至第二任务窗口的图标802的位置时,第一触控面板331检测到在其上或附近的该拖拽事件,传送给处理器380以确定该拖拽事件所对应的指令(即执行S1908),随后处理器380根据该指令在第一显示面板显示如图25b-1所示的包括第二动态图像的GUI,最后在第一显示面板显示如图25c-1所示的GUI;第二显示面板显示如图22b-2所示的包括第一动态图像的GUI,最后在 第二显示面板显示如图25c-2所示的GUI。Illustratively, as shown in FIG. 25a-1, when the user's finger touches or approaches the reading window in the "read" GUI displayed on the first display panel 341, and drags the reading window in the "reading" GUI When the location of the icon 802 of the second task window is reached, the first touch panel 331 detects the drag event on or near it, and transmits it to the processor 380 to determine an instruction corresponding to the drag event (ie, execute S1908), the processor 380 then displays the GUI including the second dynamic image as shown in FIG. 25b-1 on the first display panel according to the instruction, and finally displays the GUI as shown in FIG. 25c-1 on the first display panel; The second display panel displays a GUI including the first dynamic image as shown in FIG. 22b-2, and finally The second display panel displays the GUI as shown in Figure 25c-2.
其中,如图25b-1所示,由于第一显示面板所显示的显示对象“视频1”在第一显示面板上的移动轨迹的起点坐标为第一任务窗口的图标801,因此,用户可以确定第一显示面板当前所显示的“视频1”是第一显示面板的显示任务对应的显示对象,而非从第二显示面板切换过来的显示任务对应的显示对象。如图25b-2所示,由于第二显示面板所显示的显示对象“读物内容”在第二显示面板上的移动轨迹的起点坐标为第一任务窗口的图标801,而非第二任务窗口的图标802,因此,用户可以确定第二显示面板当前所显示的“读物内容”不是第二显示面板的显示任务对应的显示对象,而是从第一显示面板切换过来的显示任务对应的显示对象。As shown in FIG. 25b-1, since the starting point coordinate of the moving track of the display object "Video 1" displayed on the first display panel by the first display panel is the icon 801 of the first task window, the user can determine The "video 1" currently displayed by the first display panel is a display object corresponding to the display task of the first display panel, and is not a display object corresponding to the display task switched from the second display panel. As shown in FIG. 25b-2, since the starting point coordinate of the movement track of the display object "reading content" displayed on the second display panel by the second display panel is the icon 801 of the first task window, instead of the second task window The icon 802, therefore, the user can determine that the "reading content" currently displayed by the second display panel is not the display object corresponding to the display task of the second display panel, but the display object corresponding to the display task switched from the first display panel.
本发明实施例提供的多屏显示的方法,多屏终端处于“独立模式”时,多屏终端中可以设置两个独立的任务窗口,每个任务窗口对应于一个显示面板,如第一显示面板用于显示第一任务窗口中的最新添加的额显示任务对应的GUI,第二显示面板用于显示第二任务窗口中的最新添加的额显示任务对应的GUI。如此,多屏终端便可以通过显示任务在上述两个任务窗口的切换,在第二显示面板显示包括第一显示面板当前显示的第一显示对象的GUI,在第一显示面板显示包括第二显示面板当前显示的第二显示对象的GUI,即可以实现该多屏终端的两个显示屏显示内容的交互,可以提高人机交互过程中的用户体验。The multi-screen display method provided by the embodiment of the present invention, when the multi-screen terminal is in the "independent mode", two independent task windows can be set in the multi-screen terminal, and each task window corresponds to one display panel, such as the first display panel. The GUI for displaying the latest added amount display task in the first task window, and the second display panel is for displaying the GUI corresponding to the newly added amount display task in the second task window. In this way, the multi-screen terminal can display the GUI including the first display object currently displayed by the first display panel in the second display panel by switching the display task in the two task windows, and display the second display on the first display panel. The GUI of the second display object currently displayed by the panel, that is, the interaction between the two display screens of the multi-screen terminal can be realized, and the user experience in the process of human-computer interaction can be improved.
上述主要从多屏终端的控制多屏终端的第一显示面板和第二显示面板交互过程的角度对本申请实施例提供的方案进行了介绍。可以理解的是,拍摄终端为了实现上述功能,其包含了执行各个功能相应的功能模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的多屏终端及算法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。The solution provided by the embodiment of the present application is mainly introduced from the perspective of the interaction process between the first display panel and the second display panel of the multi-screen terminal of the multi-screen terminal. It can be understood that, in order to realize the above functions, the photographing terminal includes function modules corresponding to performing respective functions. Those skilled in the art will readily appreciate that the present application can be implemented in a combination of hardware or hardware and computer software in combination with the various exemplary multi-screen terminals and algorithm steps described in the embodiments disclosed herein. Whether a function is implemented in hardware or computer software to drive hardware depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present application.
本申请实施例可以根据上述方法示例对多屏终端进行划分,例如,可以对应各个功能划分各个模块或者单元,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件模块或者单元的形式实现。其中,本申请实施例中对模块或者单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。The embodiment of the present application may divide the multi-screen terminal according to the foregoing method example. For example, each module or unit may be divided according to each function, or two or more functions may be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or in the form of software modules or units. The division of modules or units in the embodiments of the present application is schematic, and is only a logical function division, and may be further divided in actual implementation.
图26示出了上述实施例中所涉及的多屏终端的一种可能的结构示意图。如图21所示,该多屏终端2600包括:第一显示模块2601、第二显示模块2602和获取模块2603。FIG. 26 is a schematic diagram showing a possible structure of the multi-screen terminal involved in the above embodiment. As shown in FIG. 21, the multi-screen terminal 2600 includes: a first display module 2601, a second display module 2602, and an acquisition module 2603.
其中,在第一种情况下,上述第一显示模块2601用于支持方法实施例中的S802,和/或用于本文所描述的技术的其它过程。第二显示模块2602用于支持方法实施例中的S806,和/或用于本文所描述的技术的其它过程,获取模 块2603用于支持方法实施例中的S801、S803,和/或用于本文所描述的技术的其它过程。Wherein, in the first case, the first display module 2601 described above is used to support S802 in the method embodiment, and/or other processes for the techniques described herein. The second display module 2602 is for supporting S806 in the method embodiment, and/or other processes for the techniques described herein, acquiring the modulo Block 2603 is for supporting S801, S803, and/or other processes for the techniques described herein in the method embodiments.
进一步的,在第一种情况下,多屏终端2600还可以包括判断模块和渲染模块。其中,判断模块,用于支持方法实施例中的S804,和/或用于本文所描述的技术的其它过程。渲染模块,用于支持方法实施例中的S805,和/或用于本文所描述的技术的其它过程。Further, in the first case, the multi-screen terminal 2600 may further include a judging module and a rendering module. Wherein, the judging module is used to support S804 in the method embodiment, and/or other processes for the techniques described herein. A rendering module for supporting S805 in a method embodiment, and/or other processes for the techniques described herein.
在第二种情况下,上述第一显示模块2601用于支持方法实施例中的S1202,S1204a和S1602中第一显示面板的显示动作,和/或用于本文所描述的技术的其它过程。第二显示模块2602用于支持方法实施例中的S1204,S1204a和S1602中第二显示面板的显示动作,和/或用于本文所描述的技术的其它过程。获取模块2603,用于支持方法实施例中的S1201、S1203、S1601,和/或用于本文所描述的技术的其它过程。In the second case, the first display module 2601 described above is used to support the display actions of the first display panel in S1202, S1204a, and S1602 in the method embodiment, and/or other processes for the techniques described herein. The second display module 2602 is for supporting display actions of the second display panel in S1204, S1204a, and S1602 in the method embodiment, and/or other processes for the techniques described herein. The acquisition module 2603 is for supporting S1201, S1203, S1601 in the method embodiment, and/or other processes for the techniques described herein.
在第三种情况下,上述第一显示模块2601用于支持方法实施例中的S1904、S1910中第一显示面板的显示动作,和/或用于本文所描述的技术的其它过程。第二显示模块2602用于支持方法实施例中的S1907、S1910中第二显示面板的显示动作,和/或用于本文所描述的技术的其它过程。获取模块2603,用于支持方法实施例中的S1901、S1902、S1905、S1908,和/或用于本文所描述的技术的其它过程。In the third case, the first display module 2601 described above is used to support the display actions of the first display panel in S1904, S1910 in the method embodiment, and/or other processes for the techniques described herein. The second display module 2602 is for supporting display actions of the second display panel in S1907, S1910 in the method embodiment, and/or other processes for the techniques described herein. The acquisition module 2603 is for supporting S1901, S1902, S1905, S1908 in the method embodiment, and/or other processes for the techniques described herein.
进一步的,在第三种情况下,多屏终端2600还可以包括任务窗口管理模块。其中,任务窗口管理模块,用于支持方法实施例中的S1903、S1906、S1909,和/或用于本文所描述的技术的其它过程Further, in the third case, the multi-screen terminal 2600 may further include a task window management module. The task window management module is used to support S1903, S1906, S1909 in the method embodiment, and/or other processes for the techniques described herein.
当然,多屏终端2600包括但不限于上述所列举的单元模块,例如,多屏终端2600还可以包括用于向其他设备发送数据或者信号的发送模块,用于接收其他设备发来的数据或者信号的接收模块,用于存储数据的存储模块等。并且,上述模块的具体所能够实现的功能也包括但不限于上述实例所述的方法步骤对应的功能,多屏终端2600的其他单元以及多屏终端2600的各个单元详细描述可以参考其所对应方法步骤的详细描述,本申请实施例这里不再赘述。Of course, the multi-screen terminal 2600 includes, but is not limited to, the unit modules listed above. For example, the multi-screen terminal 2600 may further include a transmitting module for transmitting data or signals to other devices, for receiving data or signals sent by other devices. Receive module, storage module for storing data, and the like. Moreover, the functions that can be implemented by the foregoing modules include, but are not limited to, the functions corresponding to the method steps described in the foregoing examples. The other units of the multi-screen terminal 2600 and the detailed description of each unit of the multi-screen terminal 2600 may refer to the corresponding method. The detailed description of the steps is not described herein again.
在采用集成的单元的情况下,上述获取模块2102、任务窗口管理模块等可以集成在一个处理单元中实现,该处理单元可以是处理器或控制器,例如可以是中央处理器(Central Processing Unit,CPU),通用处理器,数字信号处理器(Digital Signal Processor,DSP),专用集成电路(Application-Specific Integrated Circuit,ASIC),现场可编程门阵列(Field Programmable Gate Array,FPGA)或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种举例说明逻辑方框,模块和电路。所述处理单元也可以是实现计算功能的组合,例如包含一个或多个微处理器组合,DSP和微处理器的组合等等。上述存储模块可以是存储器。上述第一显示模块可以为第一显示面板,第二显示模块可以为第二显示面板,该第一显示面板和第二显示面板可以为不同的显示面板。 In the case of an integrated unit, the above-mentioned acquisition module 2102, task window management module, and the like may be integrated into one processing unit, and the processing unit may be a processor or a controller, for example, a central processing unit (Central Processing Unit, CPU), general purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), Field Programmable Gate Array (FPGA) or other programmable logic Device, transistor logic device, hardware component, or any combination thereof. It is possible to implement or carry out the various illustrative logical blocks, modules and circuits described in connection with the present disclosure. The processing unit may also be a combination of computing functions, such as one or more microprocessor combinations, a combination of a DSP and a microprocessor, and the like. The above storage module may be a memory. The first display module may be a first display panel, and the second display module may be a second display panel, and the first display panel and the second display panel may be different display panels.
当所述处理单元为处理器,第一显示模块2601为第一显示面板,第二显示模块2602为第二显示面板,存储模块为存储器时,本申请实施例所涉及的多屏终端2600可以为图27所示的多屏终端2700。该多屏终端2700包括:处理器2701、第一显示面板2702、第二显示面板2703、存储器2704和总线2705。其中,处理器2701、第一显示面板2702、第二显示面板2703、存储器2704通过总线2705相互连接。When the processing unit is a processor, the first display module 2601 is a first display panel, and the second display module 2602 is a second display panel. When the storage module is a memory, the multi-screen terminal 2600 according to the embodiment of the present application may be The multi-screen terminal 2700 shown in FIG. The multi-screen terminal 2700 includes a processor 2701, a first display panel 2702, a second display panel 2703, a memory 2704, and a bus 2705. The processor 2701, the first display panel 2702, the second display panel 2703, and the memory 2704 are connected to each other through a bus 2705.
其中,第一显示面板2702和第二显示面板2703用于显示所述处理器2701所指示的GUI。存储器2704用于存储计算机程序代码,该计算机程序代码序包括指令,当多屏终端2700的处理器2701执行指令时,多屏终端2700执行如图8、图12、图14、图16和图19中任一附图中的相关方法步骤实现上述实施例中的多屏显示的方法。The first display panel 2702 and the second display panel 2703 are used to display the GUI indicated by the processor 2701. The memory 2704 is configured to store computer program code, the computer program code sequence including instructions, when the processor 2701 of the multi-screen terminal 2700 executes the instruction, the multi-screen terminal 2700 executes as shown in FIG. 8, FIG. 12, FIG. 14, FIG. 16, and FIG. The method steps in any of the figures implement the method of multi-screen display in the above embodiments.
其中,总线2705可以是外设部件互连标准(Peripheral Component Interconnect,PCI)总线或扩展工业标准结构(Extended Industry Standard Architecture,EISA)总线等。所述总线2705可以分为地址总线、数据总线、控制总线等。为便于表示,图27中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。The bus 2705 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus 2705 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 27, but it does not mean that there is only one bus or one type of bus.
本发明实施例还提供一种计算机存储介质,该计算机存储介质中存储有计算机程序代码,当多屏终端2700的处理器2701执行该计算机程序代码时,该多屏终端2700执行图8、图12、图14、图16和图19中任一附图中的相关方法步骤实现上述实施例中的多屏显示的方法。The embodiment of the present invention further provides a computer storage medium, where the computer program code is stored. When the processor 2701 of the multi-screen terminal 2700 executes the computer program code, the multi-screen terminal 2700 executes FIG. 8 and FIG. 12 . The method steps in any of Figures 14, 16, and 19 implement the method of multi-screen display in the above embodiments.
本发明实施例还提供了一种计算机程序产品,当该计算机程序产品在计算机上运行时,使得计算机执行图8、图12、图14、图16和图19中任一附图中的相关方法步骤实现上述实施例中的多屏显示的方法。The embodiment of the present invention further provides a computer program product, when the computer program product is run on a computer, causing the computer to execute the related method in any of FIG. 8, FIG. 12, FIG. 14, FIG. 16, and FIG. The steps implement the method of multi-screen display in the above embodiment.
其中,本发明实施例提供的多屏终端、计算机存储介质或者计算机程序产品均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。The multi-screen terminal, the computer storage medium, or the computer program product provided by the embodiments of the present invention are all used to perform the corresponding method provided above. Therefore, the beneficial effects that can be achieved can be referred to the corresponding ones provided above. The beneficial effects in the method are not described here.
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of the above functional modules is illustrated. In practical applications, the above functions can be allocated according to needs. It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. For the specific working process of the system, the device and the unit described above, reference may be made to the corresponding process in the foregoing method embodiments, and details are not described herein again.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。 In the several embodiments provided by the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application, in essence or the contribution to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to perform all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a flash memory, a mobile hard disk, a read only memory, a random access memory, a magnetic disk, or an optical disk, and the like, which can store program codes.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。 The foregoing is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present application should be covered by the scope of the present application. . Therefore, the scope of protection of the present application should be determined by the scope of the claims.

Claims (25)

  1. 一种多屏显示的方法,其特征在于,应用于多屏终端,所述多屏终端包括第一显示面板和第二显示面板,所述方法包括:A method for displaying a multi-screen, which is applied to a multi-screen terminal, the multi-screen terminal comprising a first display panel and a second display panel, the method comprising:
    在所述第一显示面板显示第一用户图形界面GUI,所述第一GUI中包括所述第二显示面板的演示图标和第一显示对象;Displaying, by the first display panel, a first user graphical interface GUI, where the first GUI includes a presentation icon and a first display object of the second display panel;
    获取用户在所述第一GUI上输入的第一指令,所述第一指令为用户的第一操作触发的指令,所述第一操作是滑动轨迹的起点坐标为第二显示对象所在坐标位置、终点坐标为所述演示图标所在坐标位置的连续性滑动操作;Obtaining a first instruction input by the user on the first GUI, where the first instruction is an instruction triggered by a first operation of the user, and the first operation is that a coordinate of a starting point of the sliding track is a coordinate position of the second display object, The end point coordinate is a continuous sliding operation of the coordinate position of the presentation icon;
    响应于所述第一指令,在所述第二显示面板显示包括所述第二显示对象的第二GUI,所述第二显示对象包括所述第一显示对象的全部图像,或者所述第二显示对象包括所述第一显示对象的部分图像,或者所述第一显示对象包括至少两个子显示对象,所述第二显示对象为所述至少两个子显示对象中的一个子显示对象。Displaying, in the second display panel, a second GUI including the second display object, the second display object including all images of the first display object, or the second The display object includes a partial image of the first display object, or the first display object includes at least two sub-display objects, and the second display object is one of the at least two sub-display objects.
  2. 根据权利要求1所述的方法,其特征在于,所述第二显示对象包括所述第一显示对象的部分图像;The method of claim 1, wherein the second display object comprises a partial image of the first display object;
    所述响应于所述第一指令,在所述第二显示面板显示包括所述第二显示对象的第二GUI,包括:And displaying, in the second display panel, the second GUI that includes the second display object, in response to the first instruction,
    响应于所述第一指令,在所述第一显示面板所显示的所述第一GUI上显示以所述起点坐标为中心点的图像选择窗口,并在所述第二显示面板显示所述图像选择窗口所包围的图像;And responsive to the first instruction, displaying an image selection window centered on the starting point coordinate on the first GUI displayed by the first display panel, and displaying the image on the second display panel Select the image enclosed by the window;
    其中,所述图像选择窗口所包围的图像为所述第二显示对象。The image surrounded by the image selection window is the second display object.
  3. 根据权利要求2所述的方法,其特征在于,在所述响应于所述第一指令,在所述第二显示面板显示包括所述第二显示对象的第二GUI之后,所述方法还包括:The method according to claim 2, wherein in the responsive to the first instruction, after the second display panel displays the second GUI including the second display object, the method further includes :
    获取用户在所述第一GUI上输入的第二指令,所述第二指令为用于触发所述多屏终端在所述第一显示面板上移动所述图像选择窗口的指令;Acquiring a second instruction input by the user on the first GUI, where the second instruction is an instruction for triggering the multi-screen terminal to move the image selection window on the first display panel;
    响应于所述第二指令,按照所述第二指令所指示的移动轨迹,在所述第一显示面板所显示的第一GUI上显示动态移动的图像选择窗口,并在所述第二显示面板显示包括第三显示对象的第三GUI;And in response to the second instruction, displaying a dynamically moving image selection window on the first GUI displayed by the first display panel according to the movement trajectory indicated by the second instruction, and in the second display panel Displaying a third GUI including a third display object;
    其中,所述第三显示对象为所述图像选择窗口在所述移动轨迹的终点坐标处所包围的图像。The third display object is an image surrounded by the image selection window at an end point coordinate of the movement track.
  4. 根据权利要求1-3中任一项所述的方法,其特征在于,所述在所述第二显示面板显示包括所述第二显示对象的第二GUI,包括:The method according to any one of claims 1-3, wherein the displaying, by the second display panel, the second GUI including the second display object comprises:
    在所述第二显示面板显示包括所述第二显示对象由小逐渐变大的动态图像的第二GUI;Displaying, on the second display panel, a second GUI including the dynamic image in which the second display object is gradually enlarged from small;
    或者,or,
    根据所述起点坐标与所述终点坐标的直线距离,在所述第二显示面板显示包括与所述直线距离对应大小的第二显示对象的第二GUI,And displaying, on the second display panel, a second GUI that includes a second display object having a size corresponding to the linear distance according to a linear distance between the start point coordinate and the end point coordinate,
    其中,直线距离越长,所述第二GUI中的所述第二显示对象则越大,或者 所述直线距离越长,所述第二GUI中的第二显示对象则越小。Wherein, the longer the linear distance is, the larger the second display object in the second GUI is, or The longer the linear distance is, the smaller the second display object in the second GUI is.
  5. 根据权利要求1-4中任一项所述的方法,其特征在于,在所述响应于所述第一指令,在所述第二显示面板显示包括所述第二显示对象的第二GUI之后,所述方法还包括:The method according to any one of claims 1 to 4, wherein, after the second display panel displays the second GUI including the second display object, in response to the first instruction The method further includes:
    在所述第一显示面板上突出显示所述第二显示对象。The second display object is highlighted on the first display panel.
  6. 一种多屏显示的方法,其特征在于,应用于多屏终端,所述多屏终端包括第一显示面板和第二显示面板,所述方法包括:A method for displaying a multi-screen, which is applied to a multi-screen terminal, the multi-screen terminal comprising a first display panel and a second display panel, the method comprising:
    在所述第一显示面板显示包括第一显示对象的第一用户图形界面GUI,所述第一显示对象是第一显示任务中的显示对象,所述第一显示任务是第一时间添加至第一任务窗口中的显示任务;Displaying, by the first display panel, a first user graphical interface GUI including a first display object, wherein the first display object is a display object in the first display task, and the first display task is added to the first time a display task in a task window;
    在所述第二显示面板显示包括第二显示对象的第二GUI,所述第二显示对象是第二显示任务中的显示对象,所述第二显示任务是第二任务窗口中的显示任务;Displaying, by the second display panel, a second GUI that includes a second display object, the second display object is a display object in the second display task, and the second display task is a display task in the second task window;
    获取用户在所述第一GUI上输入的第一指令,所述第一指令用于触发所述多屏终端在所述第二显示面板显示包括所述第一显示面板当前显示的所述第一显示对象的GUI;Acquiring a first instruction input by the user on the first GUI, where the first instruction is used to trigger the multi-screen terminal to display the first display currently displayed by the first display panel on the second display panel Display the GUI of the object;
    响应于所述第一指令,在所述第二显示面板显示包括所述第一显示对象的第三GUI,并在所述第一显示面板显示包括第三显示对象的第四GUI;In response to the first instruction, displaying a third GUI including the first display object on the second display panel, and displaying a fourth GUI including a third display object on the first display panel;
    其中,所述第三显示对象是第三显示任务对应的显示对象,所述第三显示任务是第二时间添加至所述第一任务窗口中的显示任务,所述第二时间早于所述第一时间,且所述第二时间晚于所述第一任务窗口中的其他显示任务的添加时间;或者,所述第三显示对象为预先设置的显示对象。The third display object is a display object corresponding to the third display task, and the third display task is a display task added to the first task window at a second time, the second time is earlier than the The first time, and the second time is later than the addition time of the other display tasks in the first task window; or the third display object is a preset display object.
  7. 根据权利要求6所述的方法,其特征在于,所述第一GUI中还包括所述第二任务窗口的图标;The method according to claim 6, wherein the first GUI further includes an icon of the second task window;
    所述第一指令是用户的第一操作触发的指令,所述第一操作是滑动轨迹的起点坐标为所述第一显示对象所在坐标位置、终端坐标为所述第二任务窗口的图标所在坐标位置的连续性滑动操作,所述第一指令用于指示所述多屏终端将所述第一显示任务添加至所述第二任务窗口。The first instruction is an instruction triggered by a first operation of the user, where the first operation is that the coordinate of the starting point of the sliding track is the coordinate position of the first display object, and the coordinates of the terminal are the coordinates of the icon of the second task window. a continuous sliding operation of the location, the first instruction being used to instruct the multi-screen terminal to add the first display task to the second task window.
  8. 根据权利要求6或7所述的方法,其特征在于,所述第一GUI、所述第二GUI、所述第三GUI和所述第四GUI中还包括所述第一任务窗口的图标和所述第二任务窗口的图标;The method according to claim 6 or 7, wherein the first GUI, the second GUI, the third GUI, and the fourth GUI further include icons of the first task window and An icon of the second task window;
    所述响应于所述第一指令,在所述第二显示面板显示包括所述第一显示对象的第三GUI,并在所述第一显示面板显示包括第三显示对象的第四GUI,包括:In response to the first instruction, displaying a third GUI including the first display object on the second display panel, and displaying a fourth GUI including a third display object on the first display panel, including :
    响应于所述第一指令,在所述第二显示面板显示包括第一动态图像的第三GUI,并在所述第一显示面板显示包括第二动态图像的第四GUI;In response to the first instruction, displaying a third GUI including a first dynamic image on the second display panel, and displaying a fourth GUI including the second dynamic image on the first display panel;
    其中,所述第一动态图像为所述第一显示对象按照第一预设移动轨迹移动、且所述第一显示对象在移动过程中由小逐渐变大的动态图像,所述第一预设移动轨迹的起点坐标为所述第三GUI中的所述第一任务窗口的图标所在的坐标 位置,所述第一预设移动轨迹的终点坐标为所述第三GUI中用于显示显示对象的坐标位置;The first dynamic image is a dynamic image in which the first display object moves according to a first preset movement trajectory, and the first display object gradually increases from small to small during the movement, the first preset The starting point coordinate of the moving track is the coordinate of the icon of the first task window in the third GUI Position, the end point coordinate of the first preset movement track is a coordinate position in the third GUI for displaying the display object;
    所述第二动态图像为所述第三显示对象按照第二预设移动轨迹移动、且所述第三显示对象在移动过程中由小逐渐变大的动态图像,所述第二预设移动轨迹的起点坐标为所述第四GUI中的所述第一任务窗口的图标所在的坐标位置,所述第二预设移动轨迹的终点坐标为所述第四GUI中用于显示显示对象的坐标位置。The second moving image is a moving image in which the third display object moves according to the second preset moving trajectory, and the third display object gradually increases from small to small during the moving process, and the second preset moving trajectory The starting point coordinate is a coordinate position of the icon of the first task window in the fourth GUI, and the end point coordinate of the second preset moving track is a coordinate position for displaying the display object in the fourth GUI. .
  9. 根据权利要求6-8中任一项所述的方法,其特征在于,在所述第一显示面板显示包括第一显示对象的第一GUI之前,所述方法还包括:The method according to any one of claims 6-8, wherein before the first display panel displays the first GUI including the first display object, the method further includes:
    获取用户输入的第二指令,所述第二指令为用于触发所述多屏终端打开第一应用的指令,所述第一GUI为所述第一应用的界面;Obtaining a second instruction input by the user, where the second instruction is an instruction for triggering the multi-screen terminal to open the first application, where the first GUI is an interface of the first application;
    在所述第一显示面板显示包括第一显示对象的第一GUI,包括:Displaying, by the first display panel, a first GUI that includes a first display object, including:
    响应于所述第二指令,在所述第一显示面板显示包括第一显示对象的第一GUI。A first GUI including the first display object is displayed on the first display panel in response to the second instruction.
  10. 根据权利要求6-9中任一项所述的方法,其特征在于,所述第一任务窗口为第一窗口堆栈,所述第一窗口堆栈用于按照先进后出的原则保存压入所述第一窗口堆栈的显示任务,所述第一显示面板用于显示所述第一窗口堆栈的栈顶的显示任务对应的GUI;The method according to any one of claims 6 to 9, wherein the first task window is a first window stack, and the first window stack is used to save the press in accordance with the principle of advanced exit a display task of the first window stack, the first display panel is configured to display a GUI corresponding to the display task of the top of the stack of the first window stack;
    所述第二任务窗口为第二窗口堆栈,所述第二窗口堆栈用于按照先进后出的原则保存压入所述第二窗口堆栈的显示任务,所述第二显示面板用于显示所述第二窗口堆栈的栈顶的显示任务对应的GUI。The second task window is a second window stack, and the second window stack is configured to save a display task pressed into the second window stack according to a principle of advanced exit, the second display panel is configured to display the The GUI of the display task at the top of the stack of the second window stack.
  11. 一种多屏显示的方法,其特征在于,应用于多屏终端,所述多屏终端包括第一显示面板和第二显示面板,所述方法包括:A method for displaying a multi-screen, which is applied to a multi-screen terminal, the multi-screen terminal comprising a first display panel and a second display panel, the method comprising:
    在所述第一显示面板上显示第一用户图形界面GUI,所述第一GUI中包括第一显示对象;Displaying, on the first display panel, a first user graphical interface GUI, where the first GUI includes a first display object;
    获取用户输入的第一指令,所述第一指令用于触发所述多屏终端在所述第二显示面板显示与所述第一显示面板相同的显示对象;Obtaining a first instruction input by the user, where the first instruction is used to trigger the multi-screen terminal to display the same display object as the first display panel on the second display panel;
    响应于所述第一指令,在所述第二显示面板上显示第二GUI,所述第二GUI中包括所述第一显示对象。In response to the first instruction, displaying a second GUI on the second display panel, the second GUI including the first display object.
  12. 一种多屏终端,其特征在于,包括:A multi-screen terminal, comprising:
    第一显示模块,用于显示第一用户图形界面GUI,所述第一GUI中包括所述第二显示面板的演示图标和第一显示对象;a first display module, configured to display a first user graphical interface GUI, where the first GUI includes a presentation icon and a first display object of the second display panel;
    获取模块,用于获取用户在所述所述第一显示模块所显示的所述第一GUI上输入的第一指令,所述第一指令为用户的第一操作触发的指令,所述第一操作是滑动轨迹的起点坐标为第二显示对象所在坐标位置、终点坐标为所述演示图标所在坐标位置的连续性滑动操作;An acquiring module, configured to acquire a first instruction input by the user on the first GUI displayed by the first display module, where the first instruction is an instruction triggered by a first operation of the user, the first The operation is a continuous sliding operation of the starting point coordinate of the sliding track being the coordinate position of the second display object and the coordinate of the end point being the coordinate position of the presentation icon;
    第二显示模块,用于响应于所述第一指令,显示包括所述第二显示对象的第二GUI,所述第二显示对象包括所述第一显示模块所显示的所述第一显示对象的全部图像,或者所述第二显示对象包括所述第一显示对象的部分图像,或 者所述第一显示对象包括至少两个子显示对象,所述第二显示对象为所述至少两个子显示对象中的一个子显示对象。a second display module, configured to display, according to the first instruction, a second GUI that includes the second display object, where the second display object includes the first display object displayed by the first display module All of the images, or the second display object includes a partial image of the first display object, or The first display object includes at least two child display objects, and the second display object is one of the at least two child display objects.
  13. 根据权利要求12所述的多屏终端,其特征在于,所述第二显示对象包括所述第一显示对象的部分图像;The multi-screen terminal according to claim 12, wherein the second display object comprises a partial image of the first display object;
    所述第一显示模块,用于响应于所述获取模块获取的所述第一指令,在所述第一GUI上显示以所述起点坐标为中心点的图像选择窗口;The first display module is configured to display an image selection window with the starting point coordinate as a center point on the first GUI in response to the first instruction acquired by the acquiring module;
    所述第二显示模块,用于响应于所述获取模块获取的所述第一指令,显示所述图像选择窗口所包围的图像;The second display module is configured to display an image surrounded by the image selection window in response to the first instruction acquired by the acquiring module;
    其中,所述图像选择窗口所包围的图像为所述第二显示对象。The image surrounded by the image selection window is the second display object.
  14. 根据权利要求13所述的多屏终端,其特征在于,所述获取模块,还用于在所述第二显示模块响应于所述第一指令,显示包括所述第二显示对象的第二GUI之后,获取用户在所述第一GUI上输入的第二指令,所述第二指令为用于触发所述多屏终端在所述第一显示面板上移动所述图像选择窗口的指令;The multi-screen terminal according to claim 13, wherein the obtaining module is further configured to display, in response to the first instruction, the second GUI including the second display object, in the second display module Afterwards, acquiring a second instruction input by the user on the first GUI, where the second instruction is an instruction for triggering the multi-screen terminal to move the image selection window on the first display panel;
    所述第一显示模块,还用于响应于所述获取模块获取的所述第二指令,按照所述第二指令所指示的移动轨迹,在所述第一GUI上显示动态移动的图像选择窗口;The first display module is further configured to display a dynamically moving image selection window on the first GUI according to the movement trajectory indicated by the second instruction, in response to the second instruction acquired by the acquisition module. ;
    所述第二显示模块,还用于响应于所述获取模块获取的所述第二指令,显示包括第三显示对象的第三GUI;The second display module is further configured to display a third GUI that includes a third display object in response to the second instruction acquired by the acquiring module;
    其中,所述第三显示对象为所述图像选择窗口在所述移动轨迹的终点坐标处所包围的图像。The third display object is an image surrounded by the image selection window at an end point coordinate of the movement track.
  15. 根据权利要求12-14中任一项所述的多屏终端,其特征在于,所述第二显示模块,用于显示包括所述第二显示对象的第二GUI,包括:The multi-screen terminal according to any one of claims 12-14, wherein the second display module is configured to display a second GUI that includes the second display object, including:
    所述第二显示模块,用于:The second display module is configured to:
    显示包括所述第二显示对象由小逐渐变大的动态图像的第二GUI;Displaying a second GUI including the dynamic image in which the second display object is gradually enlarged from small;
    或者,or,
    根据所述起点坐标与所述终点坐标的直线距离,显示包括与所述直线距离对应大小的第二显示对象的第二GUI,Displaying, according to a linear distance between the start point coordinate and the end point coordinate, a second GUI including a second display object having a size corresponding to the straight line distance,
    其中,直线距离越长,所述第二GUI中的所述第二显示对象则越大,或者所述直线距离越长,所述第二GUI中的第二显示对象则越小。The longer the linear distance is, the larger the second display object in the second GUI is, or the longer the linear distance is, the smaller the second display object in the second GUI is.
  16. 根据权利要求12-15中任一项所述的多屏终端,其特征在于,所述第一显示模块,还用于响应于所述第一指令,突出显示所述第二显示对象。The multi-screen terminal according to any one of claims 12-15, wherein the first display module is further configured to highlight the second display object in response to the first instruction.
  17. 一种多屏终端,其特征在于,包括:A multi-screen terminal, comprising:
    第一显示模块,用于显示包括第一显示对象的第一用户图形界面GUI,所述第一显示对象是第一显示任务中的显示对象,所述第一显示任务是第一时间添加至第一任务窗口中的显示任务;a first display module, configured to display a first user graphical interface GUI including a first display object, wherein the first display object is a display object in the first display task, and the first display task is added to the first time a display task in a task window;
    第二显示模块,用于显示包括第二显示对象的第二GUI,所述第二显示对象是第二显示任务中的显示对象,所述第二显示任务是第二任务窗口中的显示任务; a second display module, configured to display a second GUI that includes a second display object, the second display object is a display object in the second display task, and the second display task is a display task in the second task window;
    获取模块,用于获取用户在所述第一显示模块所显示的所述第一GUI上输入的第一指令,所述第一指令用于触发所述第二显示模块显示包括所述第一显示模块当前显示的所述第一显示对象的GUI;An acquiring module, configured to acquire a first instruction input by the user on the first GUI displayed by the first display module, where the first instruction is used to trigger the second display module to display the first display a GUI of the first display object currently displayed by the module;
    所述第二显示模块,还用于响应于所述获取模块获取的所述第一指令,显示包括所述第一显示对象的第三GUI;The second display module is further configured to display a third GUI that includes the first display object in response to the first instruction acquired by the acquiring module;
    所述第一显示模块,还用于响应于所述获取模块获取的所述第一指令,显示包括第三显示对象的第四GUI;The first display module is further configured to display a fourth GUI including a third display object in response to the first instruction acquired by the acquiring module;
    其中,所述第三显示对象是第三显示任务对应的显示对象,所述第三显示任务是第二时间添加至所述第一任务窗口中的显示任务,所述第二时间早于所述第一时间,且所述第二时间晚于所述第一任务窗口中的其他显示任务的添加时间;或者,所述第三显示对象为预先设置的显示对象。The third display object is a display object corresponding to the third display task, and the third display task is a display task added to the first task window at a second time, the second time is earlier than the The first time, and the second time is later than the addition time of the other display tasks in the first task window; or the third display object is a preset display object.
  18. 根据权利要求17所述的多屏终端,其特征在于,所述第一GUI中还包括所述第二任务窗口的图标;The multi-screen terminal according to claim 17, wherein the first GUI further includes an icon of the second task window;
    所述第一指令是用户的第一操作触发的指令,所述第一操作是滑动轨迹的起点坐标为所述第一显示对象所在坐标位置、终端坐标为所述第二任务窗口的图标所在坐标位置的连续性滑动操作,所述第一指令用于指示所述多屏终端将所述第一显示任务添加至所述第二任务窗口。The first instruction is an instruction triggered by a first operation of the user, where the first operation is that the coordinate of the starting point of the sliding track is the coordinate position of the first display object, and the coordinates of the terminal are the coordinates of the icon of the second task window. a continuous sliding operation of the location, the first instruction being used to instruct the multi-screen terminal to add the first display task to the second task window.
  19. 根据权利要求17或18所述的多屏终端,其特征在于,所述第一GUI、所述第二GUI、所述第三GUI和所述第四GUI中还包括所述第一任务窗口的图标和所述第二任务窗口的图标;The multi-screen terminal according to claim 17 or 18, wherein the first GUI, the second GUI, the third GUI, and the fourth GUI further include the first task window. An icon and an icon of the second task window;
    所述第二显示模块,用于响应于所述获取模块获取的所述第一指令,显示包括所述第一显示对象的第三GUI,包括:The displaying, by the second display module, the third GUI that includes the first display object, in response to the first instruction acquired by the acquiring module, includes:
    所述第二显示模块,用于响应于所述第一指令,显示包括第一动态图像的第三GUI,所述第一动态图像为所述第一显示对象按照第一预设移动轨迹移动、且所述第一显示对象在移动过程中由小逐渐变大的动态图像,所述第一预设移动轨迹的起点坐标为所述第三GUI中的所述第一任务窗口的图标所在的坐标位置,所述第一预设移动轨迹的终点坐标为所述第三GUI中用于显示显示对象的坐标位置;The second display module is configured to display, according to the first instruction, a third GUI that includes a first dynamic image, where the first dynamic image is moved by the first display object according to a first preset movement trajectory, And the first display object is a dynamic image that gradually becomes larger during the moving process, and the starting point coordinate of the first preset moving track is a coordinate of the icon of the first task window in the third GUI. Position, the end point coordinate of the first preset movement track is a coordinate position in the third GUI for displaying the display object;
    所述第一显示模块,用于响应于所述获取模块获取的所述第一指令,显示包括第三显示对象的第四GUI,包括:The first display module is configured to display, according to the first instruction acquired by the acquiring module, a fourth GUI that includes a third display object, including:
    所述第一显示模块,用于响应于所述第一指令,显示包括第二动态图像的第四GUI,所述第二动态图像为所述第三显示对象按照第二预设移动轨迹移动、且所述第三显示对象在移动过程中由小逐渐变大的动态图像,所述第二预设移动轨迹的起点坐标为所述第四GUI中的所述第一任务窗口的图标所在的坐标位置,所述第二预设移动轨迹的终点坐标为所述第四GUI中用于显示显示对象的坐标位置。The first display module is configured to display, according to the first instruction, a fourth GUI that includes a second dynamic image, where the second dynamic image is moved by the third display object according to a second preset movement trajectory, And the third display object is a dynamic image that gradually becomes larger during the moving process, and the starting point coordinate of the second preset moving track is a coordinate of the icon of the first task window in the fourth GUI. The position, the end point coordinate of the second preset movement track is a coordinate position in the fourth GUI for displaying the display object.
  20. 根据权利要求17-19中任一项所述的多屏终端,其特征在于,所述获取模块,还用于在所述第一显示模块显示所述第一GUI之前,获取用户输入的第二指令,所述第二指令为用于触发所述多屏终端打开第一应用的指令,所述 第一GUI为所述第一应用的界面;The multi-screen terminal according to any one of claims 17 to 19, wherein the acquiring module is further configured to acquire a second input by the user before the first display module displays the first GUI. An instruction, where the second instruction is an instruction for triggering the multi-screen terminal to open the first application, The first GUI is an interface of the first application;
    所述第一显示模块,用于显示所述第一GUI,包括:The first display module is configured to display the first GUI, including:
    所述第一显示模块,用于响应于所述获取模块获取的所述第二指令,显示包括第一显示对象的第一GUI。The first display module is configured to display a first GUI that includes a first display object in response to the second instruction acquired by the acquiring module.
  21. 根据权利要求17-20中任一项所述的多屏终端,其特征在于,所述第一任务窗口为第一窗口堆栈,所述第一窗口堆栈用于按照先进后出的原则保存压入所述第一窗口堆栈的显示任务,所述第一显示模块用于显示所述第一窗口堆栈的栈顶的显示任务对应的GUI;The multi-screen terminal according to any one of claims 17 to 20, wherein the first task window is a first window stack, and the first window stack is used to save the press in accordance with the principle of advanced output. a display task of the first window stack, the first display module is configured to display a GUI corresponding to a display task of a stack top of the first window stack;
    所述第二任务窗口为第二窗口堆栈,所述第二窗口堆栈用于按照先进后出的原则保存压入所述第二窗口堆栈的显示任务,所述第二显示模块用于显示所述第二窗口堆栈的栈顶的显示任务对应的GUI。The second task window is a second window stack, and the second window stack is configured to save a display task pressed into the second window stack according to a principle of advanced exit, the second display module is configured to display the The GUI of the display task at the top of the stack of the second window stack.
  22. 一种多屏终端,其特征在于,包括:A multi-screen terminal, comprising:
    第一显示模块,用于显示第一用户图形界面GUI,所述第一GUI中包括第一显示对象;a first display module, configured to display a first user graphical interface GUI, where the first GUI includes a first display object;
    获取模块,用于获取用户输入的第一指令,所述第一指令用于触发所述多屏终端在第二显示模块显示与所述第一显示模块相同的显示对象;An acquiring module, configured to acquire a first instruction input by the user, where the first instruction is used to trigger the multi-screen terminal to display the same display object as the first display module in the second display module;
    第二显示模块,用于响应于所述获取模块获取的所述第一指令,显示第二GUI,所述第二GUI中包括所述第一显示对象。a second display module, configured to display a second GUI, where the second GUI includes the first display object, in response to the first instruction acquired by the acquiring module.
  23. 一种多屏终端,其特征在于,所述多屏终端包括:第一显示面板、第二显示面板、处理器和存储器;A multi-screen terminal, comprising: a first display panel, a second display panel, a processor, and a memory;
    所述第一显示面板、所述第二显示面板、所述处理器和所述存储器通过总线相连,所述存储器用于存储计算机程序代码,所述计算机程序代码包括指令,当所述处理器执行所述指令时,所述多屏终端执行如权利要求1-5、6-10或者11中任一项所述的多屏显示的方法,在所述第一显示面板和所述第二显示面板显示用户图形界面GUI。The first display panel, the second display panel, the processor, and the memory are connected by a bus, the memory is for storing computer program code, and the computer program code includes instructions when the processor executes The multi-screen terminal performing the multi-screen display method according to any one of claims 1-5, 6-10 or 11 at the first display panel and the second display panel Display the user graphical interface GUI.
  24. 一种计算机存储介质,其特征在于,包括计算机指令,当所述计算机指令在多屏终端上运行时,使得所述多屏终端执行如权利要求1-5、6-10或者11中任一项所述的多屏显示的方法。A computer storage medium, comprising computer instructions that, when executed on a multi-screen terminal, cause the multi-screen terminal to perform any of claims 1-5, 6-10 or 11 The method of multi-screen display.
  25. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1-5、6-10或者11中任一项所述的多屏显示的方法。 A computer program product, wherein the computer program product, when run on a computer, causes the computer to perform multi-screen display as claimed in any one of claims 1-5, 6-10 or method.
PCT/CN2017/081457 2016-12-27 2017-04-21 Multi-screen display method and apparatus WO2018120533A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201780003587.3A CN108323197B (en) 2016-12-27 2017-04-21 Multi-screen display method and equipment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611225504.9 2016-12-27
CN201611225504 2016-12-27

Publications (1)

Publication Number Publication Date
WO2018120533A1 true WO2018120533A1 (en) 2018-07-05

Family

ID=62707791

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/081457 WO2018120533A1 (en) 2016-12-27 2017-04-21 Multi-screen display method and apparatus

Country Status (2)

Country Link
CN (1) CN108323197B (en)
WO (1) WO2018120533A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109117073A (en) * 2018-07-27 2019-01-01 努比亚技术有限公司 A kind of terminal display control method, terminal and computer readable storage medium
CN110708426A (en) * 2019-09-30 2020-01-17 上海闻泰电子科技有限公司 Double-screen synchronous display method and device, server and storage medium
TWI705361B (en) * 2018-10-29 2020-09-21 華碩電腦股份有限公司 Control method, electronic device and non-transitory computer readable storage medium device
CN114237778A (en) * 2020-09-09 2022-03-25 华为技术有限公司 Interface display method and electronic equipment
CN116055773A (en) * 2019-12-17 2023-05-02 华为技术有限公司 Multi-screen collaboration method, system and electronic equipment
EP4224298A4 (en) * 2021-12-25 2024-06-05 Honor Device Co., Ltd. Screen display method and electronic device

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109375890B (en) * 2018-09-17 2022-12-09 维沃移动通信有限公司 Screen display method and multi-screen electronic equipment
CN110928473A (en) * 2018-09-20 2020-03-27 中兴通讯股份有限公司 Display control method, device and equipment of display screen and readable storage medium
CN109408171B (en) * 2018-09-27 2021-06-22 维沃移动通信有限公司 Display control method and terminal
CN109254746B (en) * 2018-09-30 2020-05-26 珠海格力电器股份有限公司 Method, device and system for realizing multi-screen communication and electric equipment
CN111124217A (en) * 2018-10-31 2020-05-08 中兴通讯股份有限公司 Information processing method, terminal and storage medium
CN109862177A (en) * 2018-12-28 2019-06-07 努比亚技术有限公司 A kind of double screen terminal control method, double screen terminal and computer readable storage medium
CN110069456A (en) * 2019-03-15 2019-07-30 维沃移动通信有限公司 File management method, device, mobile terminal and storage medium
CN110401771A (en) * 2019-07-19 2019-11-01 努比亚技术有限公司 A kind of double screen method for handover control, terminal and computer readable storage medium
CN110928614B (en) * 2019-10-11 2021-06-29 广州视源电子科技股份有限公司 Interface display method, device, equipment and storage medium
CN110825474B (en) * 2019-10-31 2023-03-31 维沃移动通信有限公司 Interface display method and device and electronic equipment
CN112306298B (en) * 2020-10-30 2022-05-31 联想(北京)有限公司 Display, electronic equipment and information processing method
CN112667074A (en) * 2020-12-23 2021-04-16 北京小米移动软件有限公司 Display method, display device and storage medium
CN112988094B (en) * 2021-02-05 2021-10-01 深圳市迈特瑞光电科技有限公司 Intelligent connection system for spliced screen
CN116204143A (en) * 2021-11-30 2023-06-02 华为技术有限公司 Interface display method and device
WO2023125864A1 (en) * 2021-12-31 2023-07-06 华为技术有限公司 Screen projection display method and system, and electronic device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101184300A (en) * 2007-12-06 2008-05-21 中兴通讯股份有限公司 Window management method in mobile phone graphic system
CN101872598A (en) * 2009-04-24 2010-10-27 环达电脑(上海)有限公司 Partial amplifying device and method of picture
CN103365342A (en) * 2012-03-28 2013-10-23 联想(北京)有限公司 Electronic equipment
CN105302285A (en) * 2014-08-01 2016-02-03 福州瑞芯微电子股份有限公司 Multi-screen display method, equipment and system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9213365B2 (en) * 2010-10-01 2015-12-15 Z124 Method and system for viewing stacked screen displays using gestures
US9182937B2 (en) * 2010-10-01 2015-11-10 Z124 Desktop reveal by moving a logical display stack with gestures
US9207717B2 (en) * 2010-10-01 2015-12-08 Z124 Dragging an application to a screen using the application manager
CN101980144B (en) * 2010-11-05 2012-01-18 深圳市合正汽车电子有限公司 On-board computer multi-screen display method and system
CN103067569B (en) * 2012-12-10 2015-01-14 广东欧珀移动通信有限公司 Method and device of multi-window displaying of smart phone
KR102213212B1 (en) * 2014-01-02 2021-02-08 삼성전자주식회사 Controlling Method For Multi-Window And Electronic Device supporting the same
CN106227480B (en) * 2016-07-22 2020-02-07 上海资文建设工程咨询有限公司 Server, client and multi-screen interaction method and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101184300A (en) * 2007-12-06 2008-05-21 中兴通讯股份有限公司 Window management method in mobile phone graphic system
CN101872598A (en) * 2009-04-24 2010-10-27 环达电脑(上海)有限公司 Partial amplifying device and method of picture
CN103365342A (en) * 2012-03-28 2013-10-23 联想(北京)有限公司 Electronic equipment
CN105302285A (en) * 2014-08-01 2016-02-03 福州瑞芯微电子股份有限公司 Multi-screen display method, equipment and system

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109117073A (en) * 2018-07-27 2019-01-01 努比亚技术有限公司 A kind of terminal display control method, terminal and computer readable storage medium
CN109117073B (en) * 2018-07-27 2021-10-15 努比亚技术有限公司 Terminal display control method, terminal and computer readable storage medium
TWI705361B (en) * 2018-10-29 2020-09-21 華碩電腦股份有限公司 Control method, electronic device and non-transitory computer readable storage medium device
CN110708426A (en) * 2019-09-30 2020-01-17 上海闻泰电子科技有限公司 Double-screen synchronous display method and device, server and storage medium
CN116055773A (en) * 2019-12-17 2023-05-02 华为技术有限公司 Multi-screen collaboration method, system and electronic equipment
US12019942B2 (en) 2019-12-17 2024-06-25 Huawei Technologies Co., Ltd. Multi-screen collaboration method and system, and electronic device
CN114237778A (en) * 2020-09-09 2022-03-25 华为技术有限公司 Interface display method and electronic equipment
EP4224298A4 (en) * 2021-12-25 2024-06-05 Honor Device Co., Ltd. Screen display method and electronic device

Also Published As

Publication number Publication date
CN108323197A (en) 2018-07-24
CN108323197B (en) 2021-01-15

Similar Documents

Publication Publication Date Title
WO2018120533A1 (en) Multi-screen display method and apparatus
TWI672629B (en) Emoticon display method, apparatus and computer-readable storage medium
EP3039563B1 (en) Multi display method, storage medium, and electronic device
WO2019228294A1 (en) Object sharing method and mobile terminal
WO2019141243A1 (en) Method for starting application program and mobile terminal
WO2021012931A1 (en) Icon management method and terminal
WO2020151460A1 (en) Object processing method and terminal device
CN110007835B (en) Object management method and mobile terminal
WO2019206036A1 (en) Message management method and terminal
CN105975190B (en) Graphical interface processing method, device and system
CN107728886B (en) A kind of one-handed performance method and apparatus
CN106445340B (en) Method and device for displaying stereoscopic image by double-screen terminal
CN109683802B (en) Icon moving method and terminal
WO2020001604A1 (en) Display method and terminal device
CN108228902B (en) File display method and mobile terminal
WO2020215969A1 (en) Content input method and terminal device
WO2020078234A1 (en) Display control method and terminal
US11669237B2 (en) Operation method and terminal device
WO2020211596A1 (en) Control method and terminal device
WO2021031868A1 (en) Interface display method and terminal
US20230051076A1 (en) Method for cross-application processing for multimedia content, and electronic device
WO2020156113A1 (en) Interface display control method and mobile terminal
CN107479799B (en) Method and device for displaying window
WO2019047129A1 (en) Method for moving application icons, and terminal
WO2018137276A1 (en) Method for processing data and mobile device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17888608

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17888608

Country of ref document: EP

Kind code of ref document: A1