US20190339854A1 - Multi-screen interaction touch display method, apparatus, storage medium and terminal - Google Patents

Multi-screen interaction touch display method, apparatus, storage medium and terminal Download PDF

Info

Publication number
US20190339854A1
US20190339854A1 US16/098,616 US201716098616A US2019339854A1 US 20190339854 A1 US20190339854 A1 US 20190339854A1 US 201716098616 A US201716098616 A US 201716098616A US 2019339854 A1 US2019339854 A1 US 2019339854A1
Authority
US
United States
Prior art keywords
screen
touch
touch point
point
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/098,616
Other languages
English (en)
Inventor
Zhanting Wei
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Assigned to ZTE CORPORATION reassignment ZTE CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: WEI, Zhanting
Publication of US20190339854A1 publication Critical patent/US20190339854A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen

Definitions

  • the present application relates to, but is not limited to, the field of multi-screen display technology, and in particular, to a method, a device, a storage medium and a terminal for multi-screen interactive touch display.
  • a resistive touch screen may be understood as a sensor, usually a combination of film and glass.
  • the adjacent side of the film and glass is coated with a coating of ITO (Indium Tin Oxides) with excellent conductivity and transparency.
  • ITO Indium Tin Oxides
  • the ITO coating on the lower layer of the film contacts the ITO coating on the upper layer of the glass, and the corresponding electrical signal is transmitted through the inductor, sent to the processor via the conversion circuit, and converted into X, Y values on the screen through calculation, thus completing the action of clicking and presenting on the screen.
  • the embodiment of the present application provides a method, a device, a storage medium, and a terminal for multi-screen interactive touch display.
  • An embodiment of the present application provides a method for multi-screen interactive touch display, applied to an electronic device, the electronic device including at least two screens; the method including:
  • the displaying a response result on the main screen may include displaying the response result at the determined location on the main screen.
  • the auxiliary screen may be configured to at least implement control of the main screen according to an external touch operation
  • the main screen may be configured to at least display according to the control of the auxiliary screen.
  • displaying a response result on the main screen may include at least one of:
  • the method may further include:
  • determining whether the touch operation has ended if it is determined that the touch operation has ended, providing a corresponding instruction or responding to the function prompt information at the indication graphic.
  • the method may further include:
  • acquiring a touch parameter of each of the multiple touch points, comparing the touch parameter with a preset condition, and determining an effective touch point according to the comparison result may include:
  • acquiring a touch parameter of each of the multiple touch points, comparing the touch parameter with a preset condition, and determining an effective touch point according to the comparison result may include:
  • each touch point when each touch point is stationary, acquiring a pressure value of each stationary touch point; if the pressure value of only one touch point is greater than a second threshold, determining the touch point to be an effective touch point, and tracking the movement trajectory of the determined effective touch point; or if the pressure value of more than one touch point is greater than the second threshold, determining that the touch point with the largest pressure value is an effective touch point, and tracking the movement trajectory of the effective touch point; and
  • the pressure value of the new touch point other than the effective touch point is greater than the second threshold, determining that the new touch point is an effective touch point, and tracking the new effective touch points instead.
  • acquiring a touch parameter of each of the multiple touch points, comparing the touch parameter with a preset condition, and determining an effective touch point according to the comparison result may include:
  • determining the movement trajectory of each touch point if the movement trajectory of the touch point is a preset movement trajectory, determining the touch point to be an effective touch point;
  • determining a touch fingerprint corresponding to each touch point if the touch fingerprint corresponding to the touch point is a preset touch fingerprint, determining the touch point to be an effective touch point.
  • the method may further include:
  • the display mode includes: a single screen display and a multi-screen display.
  • the at least two screens may have the same size or different sizes; the angle between the at least two screens may be greater than 0 degrees and less than or equal to 360 degrees.
  • the at least one screen is an ink screen or a flexible screen.
  • An embodiment of the present application also provides a device for multi-screen interactive touch display, applied to an electronic device, the electronic device including at least two screens; and the device including:
  • a screen determining module configured to determine that at least one screen is an auxiliary screen, and at least one screen other than the auxiliary screen is a main screen;
  • an acquiring module configured to acquire a touch operation on the auxiliary screen, and determine a position on the main screen corresponding to the touch operation based on the preset correspondence relationship of touch coordinates
  • a processing module configured to respond to an instruction corresponding to the touch operation at the determined position on the main screen, and display the response result on the main screen.
  • the device may further include: a touch point determining module configured to:
  • a touch point that starts moving from a preset position as an effective touch point, and track a movement trajectory of the effective touch point; if the effective touch point is stationary, and there is a new touch point other than the effective touch point that starts to move from the preset position, determine that the new touch point is an effective touch point, and track the new effective touch point instead.
  • the device may further include: a setting module configured to, at the same time when the screen determining module determines at least one screen as the auxiliary screen and at least one screen as the main screen, or before the screen determining module determines at least one screen as the auxiliary screen and at least one screen as the main screen, set a display mode of the screen, wherein the display mode includes: a single screen display and a multi-screen display.
  • a setting module configured to, at the same time when the screen determining module determines at least one screen as the auxiliary screen and at least one screen as the main screen, or before the screen determining module determines at least one screen as the auxiliary screen and at least one screen as the main screen, set a display mode of the screen, wherein the display mode includes: a single screen display and a multi-screen display.
  • An embodiment of the present application also provides a storage medium storing a computer program, the computer program being executed by a processor to implement:
  • An embodiment of the present application also provides a terminal including a memory, a processor, and a computer program stored on the memory and operative on the processor, the processor executing the computer program to implement:
  • the method, the device, the storage medium and the terminal for multi-screen interactive touch display provided by the embodiment of the present application are applied to an electronic device including at least two screens, including: determining at least one screen as an auxiliary screen, and at least one screen other than the auxiliary screen as a main screen; acquiring a touch operation on the auxiliary screen, and determining a position on the main screen corresponding to the touch operation based on a preset correspondence relationship of touch coordinates; and responding to an instruction corresponding to the touch operation at the determined position on the main screen, and displaying a response result on the main screen.
  • the touch operation on the determined auxiliary screen realizes response and display the touch operation result on the main screen, thereby satisfying the requirements of convenience of operation and the flexibility of display for the multi-screen and the large-size screen.
  • FIG. 1 is a schematic flowchart of a method for multi-screen interactive touch display according to an embodiment of the present application
  • FIG. 2 is a schematic structural diagram of a device for multi-screen interactive touch display according to an embodiment of the present application
  • FIG. 3 is a schematic structural diagram of a processing module of FIG. 2 ;
  • FIG. 4 is a second schematic structural diagram of a device for multi-screen interactive touch display according to an embodiment of the present application.
  • FIG. 5 is a third schematic structural diagram of a device for multi-screen interactive touch display according to an embodiment of the present application.
  • FIG. 6 is a first flowchart of a method for determining an effective touch point when a screen is touched at multiple points according to an embodiment of the present application
  • FIG. 7 is a second flowchart of a method for determining an effective touch point when a screen is touched at multiple points according to an embodiment of the present application
  • FIG. 8 is a third flowchart of a method for determining an effective touch point when a screen is touched at multiple points according to an embodiment of the present application.
  • FIG. 9 is a fourth flowchart of a method for determining an effective touch point when a screen is touched at multiple points according to an embodiment of the present application.
  • FIG. 1 is a schematic flowchart diagram of a method for multi-screen interactive touch display according to an embodiment of the present application.
  • the method provided in this embodiment is applied to an electronic device, and the electronic device includes at least two screens.
  • the method provided in this embodiment includes the following steps.
  • Step 101 at least one screen is determined as an auxiliary screen, and at least one screen other than the auxiliary screen is determined as a main screen.
  • Step 102 a touch operation on the auxiliary screen is acquired, and a position on the main screen corresponding to the touch operation is determined based on a preset correspondence relationship of touch coordinates.
  • Step 103 an instruction corresponding to the touch operation at the determined position on the main screen is responded to, a response result is displayed on the main screen.
  • the auxiliary screen is used to implement a touch function, and the main screen is at least used to implement a display function.
  • the electronic device may be a dual-screen mobile phone, or may be a multi-faceted screen including two or more screens, a folding screen or a stretch screen and so on.
  • the touch operation on the determined auxiliary screen realizes response and displays the touch operation result on the main screen, thereby satisfying the requirements of convenience of operation and the flexibility of display for the multi-screen and the large-size screen.
  • the displaying the response result on the main screen may include: displaying the response result at the determined location on the main screen.
  • the method of the embodiment further includes: setting a touch coordinate correspondence relationship.
  • Setting the touch coordinate correspondence relationship may include:
  • the determining at least one screen as an auxiliary screen, and the remaining screen as a main screen may include:
  • the main screen and the auxiliary screen are determined according to the positions of the screens, such as: the upward screen is the main screen, and the downward screen is the auxiliary screen.
  • the main screen and the auxiliary screen may be determined by a sensing device such as a gravity sensor or a gyroscope.
  • the auxiliary screen may be used at least for controlling the main screen with an external touch operation; the main screen may be at least used for displaying according to the control of the auxiliary screen.
  • the displaying the response result on the main screen may include at least one of the following:
  • the preset indication graphic may include: a dot, a meteor line or an animation effect, and the like.
  • a dot is displayed on the corresponding point of the main screen; long pressing on the auxiliary screen causes displaying a circle on the corresponding point of the main screen; sliding on the auxiliary screen causes displaying a meteor line on the main screen; pressing on the auxiliary screen causes displaying an animation effect that a ring gradually becomes larger on the main screen.
  • the touch operation may include at least one of the following: a click, a long press, a slide on the screen, a multi-touch, a gesture, a pressure, and the like.
  • the method of the embodiment may further include:
  • the function prompt information corresponding to the point may pop up at the corresponding point on the main screen. If the function prompt information is an operation required by the user, the finger may leave the screen and respond to the instruction corresponding to the function prompt information. If the function prompt information is not the operation required by the user, the finger does not leave the screen and does not respond to the operation.
  • the method in this embodiment may further include:
  • the determining an effective touch point from the multiple touch points may include:
  • the touch parameter may include: a moving speed, a pressure value or a moving trajectory, and the like.
  • the acquiring a touch parameter of each of the multiple touch points, comparing the touch parameter with a preset condition, and determining an effective touch point according to the comparison result may include:
  • determining the moving speed of each touch point if the moving speed of only one touch point is greater than a first threshold, determining that the touch point is an effective touch point; or if the moving speed of each touch point is greater than the first threshold value, determining that the touch point with the largest moving speed is an effective touch point;
  • the determining an effective touch point from the multiple touch points may include:
  • the acquiring a touch parameter of each of the multiple touch points, comparing the touch parameter with a preset condition, and determining an effective touch point according to the comparison result may include:
  • each touch point when each touch point is stationary, acquiring a pressure value of each stationary touch point; if the pressure value of only one touch point is greater than a second threshold, determining the touch point to be an effective touch point, and tracking the movement trajectory of the determined effective touch point; or if the pressure value of more than one touch point is greater than the second threshold, determining that the touch point with the largest pressure value is an effective touch point, and tracking the movement trajectory of the effective touch point;
  • the pressure value of the new touch point other than the effective touch point is greater than the second threshold, determining that the new touch point is an effective touch point, and tracking the new effective touch points instead.
  • the effective touch point is determined again based on the pressure value of each touch point.
  • the determining an effective touch point from the multiple touch points may include:
  • the effective touch point is re-determined.
  • the preset position may be: a screen edge or a certain fixed point.
  • the acquiring a touch parameter of each of the multiple touch points, comparing the touch parameter with a preset condition, and determining an effective touch point according to the comparison result may include:
  • the preset movement trajectory may be a circle or an ellipse, or other preset shapes, and the like.
  • an effective touch point is determined again according to the preset movement trajectory.
  • the acquiring a touch parameter of each of the multiple touch points, comparing the touch parameter with a preset condition, and determining an effective touch point according to the comparison result may include:
  • determining a touch fingerprint corresponding to each touch point if the touch fingerprint corresponding to the touch point is a preset touch fingerprint, determining the touch point to be an effective touch point.
  • the acquiring the touch on the auxiliary screen includes: acquiring a touch operation corresponding to each touch point on the auxiliary screen.
  • the method of the embodiment may further include:
  • the display mode includes: a single screen display and a multi-screen display. If it is set to single screen display, a valid screen is determined from a plurality of screens.
  • one or more switches may be set. When it is determined to be a single screen display, only one screen is turned on (valid), and other screens are turned off.
  • the at least two screens may have the same size or different sizes; the angle between the at least two screens may be greater than 0 degrees and less than or equal to 360 degrees.
  • the two screens are respectively located on the front and back of the terminal (for example, a mobile phone).
  • the at least one screen may be an ink screen or a flexible screen.
  • the determining a position on the main screen corresponding to the touch operation based on a preset correspondence relationship of touch coordinates may include:
  • the small screen is an auxiliary screen, and the position of the touch operation is (X, Y), it is determined that the position on the corresponding main screen is ( ⁇ aX, bY).
  • the large screen is an auxiliary screen, and the position of the touch operation is (X, Y), it is determined that the position on the corresponding main screen is ( ⁇ X/a, Y/b).
  • X, Y are positive integers, and the determination rules of the origin positions of the two screens are the same.
  • the embodiment of the present application further provides a computer readable storage medium, where the storage medium stores a computer program.
  • the program code that implements the steps described above when the computer program is executed by a processor.
  • the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk, and a variety of media that may store program codes.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • mobile hard disk a magnetic disk
  • magnetic disk a magnetic disk
  • optical disk a variety of media that may store program codes.
  • the embodiment of the present application further provides a device for multi-screen interactive touch display, which is applied to an electronic device including at least two screens for implementing the above embodiments and exemplary embodiments, repeated description will be omitted.
  • the term “module” may be implemented in software, hardware, or a combination of software and hardware for a predetermined function.
  • the devices described in the following embodiments are preferably implemented in software, hardware, or a combination of software and hardware is also possible and contemplated.
  • the device provided in this embodiment includes:
  • a screen determining module 201 configured to determine that at least one screen is an auxiliary screen, and at least one screen other than the auxiliary screen is a main screen; wherein the auxiliary screen is used to implement a touch function, and the main screen is used at least to implement display function;
  • an acquiring module 203 configured to acquire a touch operation on the auxiliary screen, and determine a position on the main screen corresponding to the touch operation based on the preset correspondence relationship of touch coordinates;
  • a processing module 204 configured to respond to an instruction corresponding to the touch operation at the determined position on the main screen, and display the response result on the main screen.
  • the auxiliary screen is used to implement a touch function, and the main screen is at least used to implement a display function.
  • the electronic device may be a dual-screen mobile phone, or may be a multi-faceted screen including two or more screens, a folding screen or a stretch screen and so on.
  • the touch operation on the determined auxiliary screen realizes response and displays the touch operation result on the main screen, thereby satisfying the requirements of convenience of operation and the flexibility of display for the multi-screen and the large-size screen.
  • the device of this embodiment may further include: a location determining module 202 configured to, after the screen determining module 201 determines the main screen and the auxiliary screen, and before the acquiring module 203 acquires the touch operation on the auxiliary screen, determine position coordinates of each point on the main screen and the auxiliary screen; and determine the mapping relationship between the position coordinates of each point on the main screen and the position coordinates of each point on the auxiliary screen.
  • a location determining module 202 configured to, after the screen determining module 201 determines the main screen and the auxiliary screen, and before the acquiring module 203 acquires the touch operation on the auxiliary screen, determine position coordinates of each point on the main screen and the auxiliary screen; and determine the mapping relationship between the position coordinates of each point on the main screen and the position coordinates of each point on the auxiliary screen.
  • the screen determining module 201 is configured to determine that the at least one screen is an auxiliary screen and the remaining screen is a main screen by the following manner
  • the main screen and the auxiliary screen are determined according to the positions of the screens, such as the upward screen is the main screen, and the downward screen is the auxiliary screen.
  • the main screen and the auxiliary screen may be determined by a sensing device such as a gravity sensor or a gyroscope.
  • the auxiliary screen is configured to at least control the main screen with an external touch operation; the main screen is at least used for displaying according to the control of the auxiliary screen.
  • the processing module 204 may include:
  • a response unit 2041 configured to respond to an instruction corresponding to the touch operation at the determined position on the main screen
  • a display unit 2042 is configured to display the response result on the main screen.
  • the display unit 2042 is configured to perform at least one of the following:
  • the preset indication graphic may include: a dot, a meteor line or an animation effect, and the like.
  • a dot is displayed on the corresponding point of the main screen; long pressing on the auxiliary screen causes displaying a circle on the corresponding point of the main screen; sliding on the auxiliary screen causes displaying a meteor line on the main screen; pressing on the auxiliary screen causes displaying an animation effect that a ring gradually becomes larger on the main screen.
  • the touch operation may include: a click, a long press, a slide on the screen, a multi-touch, a gesture, a pressure, and the like.
  • the display unit 2042 may further be configured to determine whether the touch operation has ended, and notify the determination result to the response unit 2041 .
  • the response unit 2041 may be further configured to: after receiving the notification that the touch operation has ended, provide a corresponding instruction or respond to the function prompt information at the indication graphic; otherwise, continue the current processing.
  • the function prompt information corresponding to the point may pop up at the corresponding point on the main screen. If the function prompt information is an operation required by the user, the finger leaves the screen and responds to the instruction corresponding to the function prompt information. If the function prompt information is not an operation required by the user, the finger does not leave the screen and does not respond to the operation.
  • the device in this embodiment may further include: a touch point determining module 205 configured to, when the touch operation is multi-touching the auxiliary screen, and the main screen supports only a single touch, determine an effective touch point from the multiple touch points.
  • a touch point determining module 205 configured to, when the touch operation is multi-touching the auxiliary screen, and the main screen supports only a single touch, determine an effective touch point from the multiple touch points.
  • the touch point determining module 205 may be configured to determine an effective touch point from the multiple touch points by:
  • the preset position may be: a screen edge or a certain fixed point.
  • the touch point determining module 205 may be configured to acquire a touch parameter of each of the multiple touch points, compare the touch parameter with a preset condition, and determine an effective touch point according to the comparison result by:
  • determining the moving speed of each touch point if the moving speed of only one touch point is greater than a first threshold, determining that the touch point is an effective touch point; or if the moving speed of each touch point is greater than the first threshold value, determining that the touch point with the largest moving speed is an effective touch point;
  • the touch point determining module 205 may be configured to acquire a touch parameter of each of the multiple touch points, compare the touch parameter with a preset condition, and determine an effective touch point according to the comparison result by:
  • each touch point when each touch point is stationary, acquiring a pressure value of each stationary touch point; if the pressure value of only one touch point is greater than a second threshold, determining the touch point to be an effective touch point, and tracking the movement trajectory of the determined effective touch point; or if the pressure value of more than one touch point is greater than the second threshold, determining that the touch point with the largest pressure value is an effective touch point, and tracking the movement trajectory of the effective touch point;
  • the pressure value of the new touch point other than the effective touch point is greater than the second threshold, determining that the new touch point is an effective touch point, and tracking the new effective touch points instead.
  • the touch point determining module 205 may be configured to acquire a touch parameter of each of the multiple touch points, compare the touch parameter with a preset condition, and determine an effective touch point according to the comparison result by:
  • determining the movement trajectory of each touch point if the movement trajectory of the touch point is a preset movement trajectory, determining the touch point to be an effective touch point;
  • determining a touch fingerprint corresponding to each touch point if the touch fingerprint corresponding to the touch point is a preset touch fingerprint, determining the touch point to be an effective touch point.
  • the preset movement trajectory may include a circle or an ellipse, or other preset shapes, and the like.
  • the main screen supports single touch and multi-touch
  • the acquiring module 203 may be configured to acquire a touch operation corresponding to each touch point on the auxiliary screen, and determine a position on the main screen corresponding to the touch operation corresponding to each touch point based on the position coordinates of the touch operation corresponding to each touch point on the auxiliary screen and a mapping relationship between position coordinates of each point on each main screen and the position coordinates of each point on the auxiliary screen
  • the device of this embodiment may further include:
  • a setting module 206 configured to, at the same time when the screen determining module 201 determines at least one screen as the auxiliary screen and at least one screen as the main screen, or before the screen determining module 201 determines at least one screen as the auxiliary screen and at least one screen as the main screen, set a display mode of the screen, wherein the display mode includes: a single screen display and a multi-screen display. If it is set to single screen display, a valid screen is determined from a plurality of screens.
  • one or more switches may be set. When it is determined to be a single screen display, only one screen is turned on (valid), and other screens are turned off.
  • the modules in the above devices may all be implemented by the same processor; or, the above modules are respectively implemented by multiple processors.
  • the embodiment of the present application further provides a terminal, including a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor executing the computer program to implement the following steps:
  • Embodiment 1 A touch display method of a symmetric double-sided screen.
  • the front and back sides of the mobile phone are respectively configured with one screen, the main screen is a liquid screen, and the auxiliary screen is an ink screen.
  • the two screens are completely symmetrical, and the center point of the main screen may be determined as A (0, 0), the center point of the auxiliary screen is B (0, 0).
  • a point (X, Y) on the auxiliary screen is symmetrically mapped to a corresponding point ( ⁇ X, Y) on the main screen.
  • the phone When the finger touches a point (X, Y) on the auxiliary screen, the phone responds to the function instruction at the symmetry point ( ⁇ X, Y) on the main screen.
  • a dot may be displayed at the corresponding point of the main screen.
  • a circle may be displayed at the corresponding point of the main screen.
  • a meteor line may be displayed at the corresponding position on the main screen.
  • one or more switches may be provided for controlling single screen operation or dual screen operation.
  • the current running screen is selected.
  • Embodiment 2 A touch display method for symmetric double screens of an equal size.
  • two identical screens are arranged on the front and back sides of the mobile phone, and the main and auxiliary screens are determined according to the principle of gravity sensing.
  • the upward side is determined as the main screen, and the downward side is determined as the auxiliary screen.
  • the main screen is used for both of the display and touch functions, and the auxiliary screen is only used for touch function.
  • the two screens are completely symmetrical, the center point (0, 0) of the main screen is determined, and the center point (0, 0) of the auxiliary screen is determined.
  • the lines of the two center points are perpendicular to the two screens.
  • a point (X, Y) on the auxiliary screen is symmetrically mapped to a corresponding point ( ⁇ X, Y) on the main screen.
  • the phone When the finger touches a point (X, Y) on the auxiliary screen, the phone responds to a function instruction at a point ( ⁇ X, Y) on the main screen.
  • the finger performs a gesture operation on the auxiliary screen, and the main screen responds to the function instruction corresponding to the gesture. For example, when a click, a long press, a screen sliding, a multi-touch, a gesture, a pressure, etc. are touched at a certain point on the auxiliary screen, an instruction corresponding to the point is popped up on the corresponding point on the main screen.
  • the instruction is an operation required by the user, the finger leaves the screen, and the corresponding function prompt information corresponding to the click, long press, screen sliding, multi-touch, gesture, pressure, etc. is responded; otherwise, the finger does not leave the screen and the operation is not responded.
  • a dot may be displayed at the corresponding point of the main screen.
  • a circle may be displayed at the corresponding point of the main screen.
  • a meteor line may be displayed at the corresponding position on the main screen.
  • one or more switches may be provided for controlling single screen operation or dual screen operation.
  • the current running screen is selected.
  • Embodiment 3 A touch display method with two screens of different sizes.
  • two screens are arranged on the front and back sides of the mobile phone, and the main and auxiliary screens are determined according to the principle of gravity sensing.
  • the upward side is determined as the main screen, and the downward side is determined as the auxiliary screen.
  • the planes of the two screens are parallel to each other and have the same shape, but the screen sizes are not equal.
  • the length and width of the screens are a:1 and b:1, respectively.
  • the center point (0, 0) of the main screen may be determined and the center point (0, 0) of the auxiliary screen may be determined.
  • a point (x, y) on the auxiliary screen is symmetrically mapped to a corresponding point on the main screen ( ⁇ ax, by).
  • the phone responds to the function instructions at the point ( ⁇ ax, by) on the main screen.
  • the corresponding point ( ⁇ ax, by) on the main screen of the mobile phone responds to the click, long press, and sliding, gesture, etc.
  • a point (x, y) on the auxiliary screen is symmetrically mapped to a corresponding point on the main screen ( ⁇ x/a, y/b); the finger touches the point on the auxiliary screen (x, y), the phone responds to the function instructions at the points ( ⁇ x/a, y/b) on the main screen.
  • a dot may be displayed at the corresponding point of the main screen.
  • a circle may be displayed at the corresponding point of the main screen.
  • a meteor line may be displayed at the corresponding position on the main screen.
  • one or more switches may be provided for controlling single screen operation or dual screen operation.
  • the current running screen is selected.
  • Embodiment 4 A touch display method with two screens of different sizes.
  • two screens are arranged on the front and back sides of the mobile phone, and the main and auxiliary screens are determined according to the principle of gravity sensing.
  • the upward side is determined as the main screen, and the downward side is determined as the auxiliary screen.
  • the two screens have the same shape.
  • the length and width of the screens are a:1 and b:1, respectively.
  • the large screen is the main screen
  • it is displayed by pixel A.
  • the small screen is the main screen
  • it is displayed by pixel B.
  • the center point (0, 0) of the main screen may be determined and the center point (0, 0) of the auxiliary screen may be determined.
  • a point (x, y) on the auxiliary screen is symmetrically mapped to a corresponding point on the main screen ( ⁇ ax, by).
  • the phone responds to the function instructions at the point ( ⁇ ax, by) on the main screen.
  • the corresponding point ( ⁇ ax, by) on the main screen of the mobile phone responds to the click, long press, and sliding, etc.
  • each point (x, y) on the auxiliary screen is symmetrically mapped to a corresponding point on the main screen ( ⁇ x/a, y/b); the finger touches the point on the auxiliary screen (x, y), the phone responds to the function instructions at the points ( ⁇ x/a, y/b) on the main screen.
  • a dot may be displayed at the corresponding point of the main screen.
  • a circle may be displayed at the corresponding point of the main screen.
  • a meteor line may be displayed at the corresponding position on the main screen.
  • one or more switches may be provided for controlling single screen operation or dual screen operation.
  • the current running screen is selected.
  • Embodiment 5 Folding multi-screen display method, applicable for wristwatches and super large screens.
  • the terminal is configured with multiple screens A, B, C, D, and E; and the plurality of screens are transparent and foldable.
  • the multiple screens, when being spread may be on the same plane.
  • the multiple screens may be tiled together.
  • the content may be presented on the A, B, C, D, E screens according to the total size of the screens of A, B, C, D, E for example, and the pixel position of each point on the screen.
  • the processing method may be referred to the processing method for the double screens, and will not be described here.
  • the user may perform a touch operation on the screen to complete operations such as clicking, long pressing, sliding, gesture, and the like.
  • Embodiment 6 Display method of a stretch screen.
  • the mobile phone is configured with a stretch screen.
  • the screen is stretched, the screen becomes large, and each point on the screen has its own relative position (X, Y).
  • the content may be presented on the screens according to the total size of the screens and the pixel position (X, Y) of each point.
  • X, Y the pixel position of the double screens
  • the user may perform a touch operation on the screen to complete operations such as clicking, long pressing, sliding, gesture, and the like.
  • Embodiment 7 360-degree full-screen interactive touch and display method.
  • the mobile phone is configured with a full screen of 360 degrees; the main and auxiliary screens are determined according to gravity sensing, the upward screen is the main screen, and the downward screen is the auxiliary screen.
  • the two screens are completely symmetrical, and the center point of the main screen may be determined as A (0, 0), the center point of the auxiliary screen is B (0, 0).
  • a point (X, Y) on the auxiliary screen is symmetrically mapped to a corresponding point ( ⁇ X, Y) on the main screen.
  • a finger touches a point on the auxiliary screen and an indication point is displayed on the corresponding point on the main screen.
  • the finger touches the point (X, Y) on the auxiliary screen and the phone responds to the function instruction at the point ( ⁇ X, Y) on the main screen.
  • a dot may be displayed at the corresponding point of the main screen.
  • a circle may be displayed at the corresponding point of the main screen.
  • a meteor line may be displayed at the corresponding position on the main screen.
  • the ineffective touch points are excluded, and the effective touch points are determined, which may include the following solutions.
  • the touch point moving speed threshold is set to 500 PPI (Pixels Per Inch)/S.
  • PPI Pixel Per Inch
  • the operation is not responded.
  • the moving speed of one touch point is larger than a threshold, it is confirmed that the point is an effective touch point.
  • the point with the maximum speed is determined as the effective touch point, and the movement trajectory of the point is tracked.
  • the new touch point is tracked instead.
  • the relevant processing flow is shown in FIG. 6 .
  • solution 2 for a function interface that only supports single-touch, when multi-touch is operated, only one point is moved, and other points are stationary, it is determined that the moving point is an effective touch point, and the movement trajectory of the effective touch point is tracked.
  • the relevant processing flow is shown in FIG. 6 .
  • all touch points are determined as effective touch points, consistent with single-sided screen processing techniques.
  • the pressure value of each touch point at the time when the mobile phone is held may be collected, a daily touch pressure value is determined, and the pressure threshold is determined based on the pressure value.
  • the touch point that starts moving from the edge of the screen or a fixed point is determined as an effective touch point, and the movement trajectory of the effective touch point is tracked.
  • a touch point, a long press, a screen sliding, a multi-touch, a gesture, a pressure, etc. are touched at a certain point on the auxiliary screen, an instruction corresponding to the point is popped up at the corresponding point on the main screen.
  • the instruction is an operation required by the user, the finger leaves the screen, and the corresponding function prompt information corresponding to the click, long press, screen sliding, multi-touch, gesture, pressure, etc. is responded; otherwise, the finger does not leave the screen and the operation is not responded.
  • the relevant processing flow is shown in FIG. 7 .
  • the above solutions may be applied and executed independently, in parallel, or in a crossing manner.
  • one or more switches may be provided for controlling single screen operation or dual screen operation.
  • the current running screen is selected.
  • a user of a 360 degree screen may customize the functions that need to be displayed, and display the content on a flat surface according to each screen size and pixel bit.
  • embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the application may take the form of a hardware embodiment, a software embodiment, or an embodiment in combination with software and hardware. Moreover, the application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) in which computer usable program code is embodied.
  • computer-usable storage media including but not limited to disk storage and optical storage, etc.
  • the computer program instructions may also be stored in a computer readable memory that may direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions may also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in a block or blocks of a flow or a flow and/or a block diagram of a flowchart.
  • computer storage medium includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device, or may be any other medium used to store the desired information and that may be accessed by a computer.
  • communication media typically comprise computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and may include any information delivery media.
  • the embodiment of the present disclosure provides a method and a device for multi-screen interactive touch display, which meets the requirements of multi-screen and large-size screen for operation convenience and display flexibility.
US16/098,616 2017-01-18 2017-07-24 Multi-screen interaction touch display method, apparatus, storage medium and terminal Abandoned US20190339854A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201710040538.9 2017-01-18
CN201710040538.9A CN108319422A (zh) 2017-01-18 2017-01-18 一种多屏互动触控显示方法、装置、存储介质和终端
PCT/CN2017/094149 WO2018133357A1 (zh) 2017-01-18 2017-07-24 一种多屏互动触控显示方法、装置、存储介质和终端

Publications (1)

Publication Number Publication Date
US20190339854A1 true US20190339854A1 (en) 2019-11-07

Family

ID=62892358

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/098,616 Abandoned US20190339854A1 (en) 2017-01-18 2017-07-24 Multi-screen interaction touch display method, apparatus, storage medium and terminal

Country Status (4)

Country Link
US (1) US20190339854A1 (zh)
EP (1) EP3447625A4 (zh)
CN (1) CN108319422A (zh)
WO (1) WO2018133357A1 (zh)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190056857A1 (en) * 2017-08-18 2019-02-21 Microsoft Technology Licensing, Llc Resizing an active region of a user interface
CN111818372A (zh) * 2020-06-12 2020-10-23 深圳市战音科技有限公司 图像显示方法、系统、显示设备及存储介质
CN112328163A (zh) * 2020-11-10 2021-02-05 四川长虹电器股份有限公司 一种双屏显示设备的触摸控制方法
US11237699B2 (en) 2017-08-18 2022-02-01 Microsoft Technology Licensing, Llc Proximal menu generation
US11301124B2 (en) 2017-08-18 2022-04-12 Microsoft Technology Licensing, Llc User interface modification using preview panel

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108958615B (zh) * 2018-07-25 2021-03-02 维沃移动通信有限公司 一种显示控制方法、终端及计算机可读存储介质
CN111104000A (zh) * 2018-10-26 2020-05-05 中兴通讯股份有限公司 一种操作映射方法、装置、终端及存储介质
CN112789587A (zh) * 2018-10-30 2021-05-11 深圳市柔宇科技股份有限公司 交互方法、电子装置和计算机设备
CN110413143B (zh) * 2018-11-20 2020-04-28 中天智领（北京）科技有限公司 基于激光雷达的人机交互方法
CN109582266A (zh) * 2018-11-30 2019-04-05 维沃移动通信有限公司 一种显示屏操作方法及终端设备
CN109710157A (zh) * 2018-12-29 2019-05-03 联想(北京)有限公司 电子设备的显示方法、装置和存储介质
CN110069228A (zh) * 2019-04-15 2019-07-30 珠海格力电器股份有限公司 一种折叠屏显示方法及装置
CN110312151A (zh) * 2019-06-13 2019-10-08 Oppo广东移动通信有限公司 弹幕生成方法及相关装置
CN110806830A (zh) * 2019-09-06 2020-02-18 华为技术有限公司 一种用户交互方法及电子设备
CN110795015A (zh) * 2019-09-25 2020-02-14 广州视源电子科技股份有限公司 操作提示方法、装置、设备及存储介质
CN111182151A (zh) * 2019-12-31 2020-05-19 上海摩软通讯技术有限公司 一种侧屏控制方法、电子设备及存储介质
CN111273808B (zh) * 2020-01-08 2021-07-27 深圳市鸿合创新信息技术有限责任公司 一种透明双面触控显示方法及显示系统
CN112965648A (zh) * 2021-02-03 2021-06-15 惠州Tcl移动通信有限公司 一种移动终端的控制方法、装置、存储介质及移动终端

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9767681B2 (en) * 2007-12-12 2017-09-19 Apple Inc. Handheld electronic devices with remote control functionality and gesture recognition
US20120216152A1 (en) * 2011-02-23 2012-08-23 Google Inc. Touch gestures for remote control operations
KR20140046327A (ko) * 2012-10-10 2014-04-18 삼성전자주식회사 멀티 디스플레이 장치, 입력 펜, 멀티 디스플레이 장치의 제어 방법 및 멀티 디스플레이 시스템
KR102015347B1 (ko) * 2013-01-07 2019-08-28 삼성전자 주식회사 터치 디바이스를 이용한 마우스 기능 제공 방법 및 장치
US10297002B2 (en) * 2015-03-10 2019-05-21 Intel Corporation Virtual touch pad method and apparatus for controlling an external display
CN104951235B (zh) * 2015-06-29 2019-01-08 深圳中电数码显示有限公司 一种多屏触摸的方法及装置
CN105867746A (zh) * 2016-06-24 2016-08-17 努比亚技术有限公司 一种触控操作方法及移动终端
CN106201183B (zh) * 2016-06-28 2019-10-29 努比亚技术有限公司 分屏显示装置、移动终端及方法

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190056857A1 (en) * 2017-08-18 2019-02-21 Microsoft Technology Licensing, Llc Resizing an active region of a user interface
US11237699B2 (en) 2017-08-18 2022-02-01 Microsoft Technology Licensing, Llc Proximal menu generation
US11301124B2 (en) 2017-08-18 2022-04-12 Microsoft Technology Licensing, Llc User interface modification using preview panel
CN111818372A (zh) * 2020-06-12 2020-10-23 深圳市战音科技有限公司 图像显示方法、系统、显示设备及存储介质
CN112328163A (zh) * 2020-11-10 2021-02-05 四川长虹电器股份有限公司 一种双屏显示设备的触摸控制方法

Also Published As

Publication number Publication date
CN108319422A (zh) 2018-07-24
WO2018133357A1 (zh) 2018-07-26
EP3447625A4 (en) 2019-06-12
EP3447625A1 (en) 2019-02-27

Similar Documents

Publication Publication Date Title
US20190339854A1 (en) Multi-screen interaction touch display method, apparatus, storage medium and terminal
US9996176B2 (en) Multi-touch uses, gestures, and implementation
US10318149B2 (en) Method and apparatus for performing touch operation in a mobile device
US8686966B2 (en) Information processing apparatus, information processing method and program
RU2609070C2 (ru) Средство запуска для контекстных меню
US8176435B1 (en) Pinch to adjust
US20170300227A1 (en) Method for adjusting input virtual keyboard and input apparatus
US20110199386A1 (en) Overlay feature to provide user assistance in a multi-touch interactive display environment
US11003328B2 (en) Touch input method through edge screen, and electronic device
KR102199356B1 (ko) 멀티-터치 디스플레이 패널 및 이를 제어하는 방법
US20160124532A1 (en) Multi-Region Touchpad
US10706811B2 (en) Method and device for controlling display of a flexible display screen
US11693544B2 (en) Mobile terminal display picture control method, apparatus, and device and storage medium
US20100048251A1 (en) Electronic device and operation method of the electronic device by using a virtual button
WO2019119799A1 (zh) 一种显示应用图标的方法及终端设备
US10146424B2 (en) Display of objects on a touch screen and their selection
US20150033161A1 (en) Detecting a first and a second touch to associate a data file with a graphical data object
JP7109448B2 (ja) 動的スペースバー
US20220263929A1 (en) Mobile terminal and control method therefor
US20140189570A1 (en) Managing Tab Buttons
CN111638828A (zh) 界面显示方法及装置
US10678336B2 (en) Orient a user interface to a side
US20180024728A1 (en) Terminal and Terminal Wallpaper Control Method
CN115867883A (zh) 用于接收用户输入的方法和装置
US20140085340A1 (en) Method and electronic device for manipulating scale or rotation of graphic on display

Legal Events

Date Code Title Description
AS Assignment

Owner name: ZTE CORPORATION, CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WEI, ZHANTING;REEL/FRAME:047396/0120

Effective date: 20180629

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION