WO2019228233A1 - 基于分屏模式下应用交互的方法、设备和存储介质 - Google Patents

基于分屏模式下应用交互的方法、设备和存储介质 Download PDF

Info

Publication number
WO2019228233A1
WO2019228233A1 PCT/CN2019/087815 CN2019087815W WO2019228233A1 WO 2019228233 A1 WO2019228233 A1 WO 2019228233A1 CN 2019087815 W CN2019087815 W CN 2019087815W WO 2019228233 A1 WO2019228233 A1 WO 2019228233A1
Authority
WO
WIPO (PCT)
Prior art keywords
input
screen interface
event
application
input channel
Prior art date
Application number
PCT/CN2019/087815
Other languages
English (en)
French (fr)
Inventor
孙长青
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2019228233A1 publication Critical patent/WO2019228233A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present disclosure relates to, but is not limited to, the technical field of terminal split screen processing, and in particular, to a method, device, and storage medium based on application interaction in a split screen mode.
  • the screen size of smart terminals is getting larger and larger. More and more users need smart terminals to support split-screen mode, and even some devices support multi-screen.
  • the current split-screen mode only ensures that multiple independent tasks of the user run independently, and there is no interaction between applications on different screens. Therefore, even if the device supports the split-screen mode, it is only equivalent to a simple superposition of two display devices, and it cannot bring a new experience in interactive use for users.
  • the main purpose of the embodiments of the present disclosure is to provide a method, a device, and a storage medium based on application interaction in a split screen mode.
  • an embodiment of the present disclosure provides a method for application interaction based on a split screen mode.
  • the method includes the following steps: starting a control application on a first screen interface of a same mobile terminal, and a second screen interface A response application is started on the server, and a first input channel of the control application and a second input channel of the response application are stored; a user input event is received on the control application, and the input event is performed according to a preset rule. Mapping conversion to map the input event from the first input channel to the second input channel; and responding to the action corresponding to the input event on the response application.
  • an embodiment of the present disclosure further provides a device based on application interaction in a split screen mode, where the device includes a memory, a processor, and a program stored on the memory and executable on the processor. And a data bus for implementing connection and communication between the processor and the memory, the steps of the foregoing method are implemented when the program is executed by the processor.
  • the present disclosure provides a storage medium for computer-readable storage, where the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors. To achieve the steps of the aforementioned method.
  • FIG. 1 is a flowchart of a method for application interaction in a split screen mode according to an embodiment of the present disclosure.
  • FIG. 2 is a structural block diagram of a mobile terminal according to an embodiment of the present disclosure.
  • FIG. 3 is a flowchart of step S120 of the method for application interaction in the split screen mode shown in FIG. 1.
  • FIG. 4 is a schematic diagram of a mobile terminal provided by an embodiment of the present disclosure, where a second virtual control key group does not exist on the second screen.
  • FIG. 5 is a schematic diagram of a mobile terminal according to an embodiment of the present disclosure, where a second virtual control key group exists on a second screen.
  • FIG. 6 is a structural block diagram of a device for application interaction in a split screen mode according to an embodiment of the present disclosure.
  • this embodiment provides a method for application interaction based on a split screen mode.
  • the method includes the following steps:
  • Step S110 start a control application on a first screen interface of the same mobile terminal, start a response application on a second screen interface, and store a first input channel of the control application and a second input channel of the response application.
  • the method for application interaction based on the split screen mode proposed in the embodiments of the present disclosure can control the running of another task by one task on the split screen device.
  • the mobile terminal 100 includes: an input mapping module 110, a callback service module 120, and channel switching Module 130, key-value mapping module 140, and event injection module 150.
  • the input mapping module 110 is located at the system hardware abstraction layer (HAL layer, which is an interface layer between the operating system kernel and hardware circuits, the purpose of which is to abstract the hardware).
  • HAL layer which is an interface layer between the operating system kernel and hardware circuits, the purpose of which is to abstract the hardware.
  • the user's The input event performs coordinate mapping conversion according to the specified displacement amount, and completes the conversion of physical input and logical input. The purpose of this mapping is to ensure the operating efficiency of the logic inputs.
  • the callback service module 120 cooperates with the input mapping module 110 to re-call the mapped input event to the physical input terminal for subsequent interactive display of the user operation interface (UI).
  • UI user operation interface
  • the key-value mapping module 140 is mainly configured to convert an input event of a specific range or operation into a designated key value again according to a request of the controller.
  • the controlling end or controlled end only needs to process the corresponding key value event.
  • the event injection module 150 is configured to re-inject the key-value events converted by the key-value mapping module 140 into the input end of the system.
  • the system can process the input key value according to the native logic.
  • the role of the channel switching module 130 is to control the switching of the input channels to ensure that the input events can be correctly distributed to the application tasks of the two screens.
  • the mobile terminal can immediately execute the method "start the control application on the first screen interface of the same mobile terminal, and start the response application on the second screen interface, and Steps of storing the first input channel of the control application and the second input channel of the response application.
  • start the control application on the first screen interface of the same mobile terminal
  • start the response application on the second screen interface
  • Steps of storing the first input channel of the control application and the second input channel of the response application For the split screen mode where the mobile terminal is provided with two screens through the split screen mode, before the mobile terminal performs the above method steps, it is also necessary to execute "Enable the split screen mode of the mobile terminal so that the screen interface of the mobile terminal is divided. For the first screen interface and the second screen interface.
  • Step S120 Receive a user input event on the control application, and map and convert the input event according to a preset rule to map the input event from the first input channel to the second input channel.
  • the mobile terminal 100 shown in FIG. 2 finishes “starting a control application on the first screen interface of the same mobile terminal, starting a response application on the second screen interface, and storing the first input channel of the control application and the After the step of “responding to the second input channel of the application”, “receive a user input event on the control application and perform mapping conversion according to a preset rule to map the input event from the first input channel to the first input channel Two-input channel.
  • the input event specifically includes a click input event at a preset position and a slide input event at a preset range, that is, the user can perform a tap input at a preset position on the first screen, or perform a swipe input within a preset range of the first screen.
  • the response application launched by the second screen is a game application.
  • the control application includes a standard button set, which is similar to a game console handle.
  • the game application is controlled by clicking the up, down, left, right, A, B, Y, and X keys.
  • the control application includes a non-standard key group, which is more commonly used in mobile terminal mobile games.
  • the game application is controlled by sliding in the corresponding direction or touching the corresponding function button.
  • the method further includes step S121: receiving a user input event on the control application, and detecting whether there is a first virtual control key group on the second screen interface and a first virtual control key group on the first screen interface. The corresponding second virtual control key group.
  • a user input event is received on the control application, and at the same time, it is detected whether a second virtual control key group corresponding to the first virtual control key group on the first screen interface exists on the second screen interface. That is, it is determined whether the control application is the first case described above or the second case.
  • the first case as shown in FIG. 4, only the first virtual control key group exists on the first screen interface, and the corresponding second virtual control key group does not exist on the second screen interface.
  • the second case as shown in FIG. 5, not only a first virtual control key group exists on the first screen interface, but a corresponding second virtual control key group also exists on the second screen interface.
  • the first virtual control key group includes a plurality of first virtual control keys
  • the second virtual control key group includes a plurality of second virtual control keys corresponding to the functions of the first virtual control keys on a one-to-one basis. That is, the virtual control keys on the display screen in the existing game application (that is, the second virtual control key group) are projected from the second screen interface to the operation control keys on the first screen interface (that is, the first virtual control key group). Control group).
  • the method further includes step S122: if the second virtual key group does not exist on the second screen interface, mapping conversion is performed according to a first preset rule to map the input event from the first input channel to the first Two input channels.
  • mapping conversion is required according to a first preset rule to input the input event from the first input channel. Map to this second input channel. Specifically, the input event is converted into a corresponding key value event by the key value mapping module 140. Then, the key value events converted by the key value mapping module 140 are re-injected into the system input terminal through the event injection module 150. Finally, the key-value event re-injected to the system input terminal is delivered to the second input channel through the channel switching module 130, so that the input event is mapped from the first input channel to the second input channel.
  • a first virtual control key group is displayed on the first screen interface.
  • the first virtual control key group is a standard key group, similar to a handle of a game machine, and includes up, down, left, right, A, B, Y, X and other keys. Each key is displayed at a corresponding preset position on the first screen interface.
  • the input event can be converted into a corresponding key event through the key value mapping module 140.
  • the key value event converted by the key value mapping module 140 is re-injected into the input end of the system through the event injection module 150.
  • the key value event injected into the system input terminal is delivered to the second input channel through the channel switching module 130 to ensure that the input event can be correctly distributed to the application tasks of the two screen interfaces.
  • the post-control application or response application only needs to process the corresponding key-value event.
  • the method further includes step S123: if the second virtual control key group exists on the second screen interface, mapping conversion is performed according to a second preset rule to map the input event from the first input channel to the second Input channel.
  • mapping conversion needs to be performed according to a first preset rule to map the input event from the first input channel to The second input channel.
  • coordinate conversion is performed on the input event through the input mapping module 110 to directly map the input event to a corresponding position on the second screen interface, thereby realizing mapping the input event from the first input channel to the first input channel.
  • Two input channels That is, after the mobile terminal 100 opens the response application on the second screen interface, a second virtual control key group (that is, an application-native virtual control key group) is displayed on the second screen interface.
  • a first virtual control key group is displayed on the first screen interface (which is completely consistent with the function layout of the second virtual control key group).
  • the first virtual control key group is a non-standard key group, and may include a full range of sliding control keys and various function control keys. Each key is displayed at a corresponding preset position on the first screen interface.
  • the input mapping module 110 performs coordinate conversion on the input event, and the input event can be directly mapped to the second screen interface.
  • Corresponding position that is, the touch area of the second screen interface. It is equivalent to the user directly operating on the second virtual control key group on the second screen interface. In this way, the input event can be mapped from the first input channel to the second input channel.
  • the input event is also recalled to the first screen interface through the callback service module 120 to complete the interactive display on the operation interface on the first screen interface, so that the user can use the first screen interface.
  • Each virtual control key that controls the first virtual control key group can obtain corresponding operation feedback on the first screen interface.
  • the method further includes step S130: responding to the action corresponding to the input event on the response application.
  • the responding application may respond to the input event on the second screen interface as long as it processes the corresponding key value event. Corresponding action.
  • the response application can directly process the operation corresponding to the input event and can respond to the action corresponding to the input event on the second screen interface .
  • the first control situation is shown in Figure 4.
  • the second screen interface starts the game application, and the first screen interface starts the game controller at the same time.
  • the game input channel of the second screen interface is stored as a backup channel.
  • the user only needs to perform operations on the first screen interface.
  • the button area in the game controller of the first screen interface is clicked, the first screen interface screen responds to the click event to complete the UI interaction, and simultaneously re-injects key events such as Dpad_A ⁇ Dpad_B ⁇ Dpad_Y ⁇ Dpad_X into the system input.
  • key events such as Dpad_A ⁇ Dpad_B ⁇ Dpad_Y ⁇ Dpad_X into the system input.
  • the input channel is switched to the game input channel of the second screen interface.
  • the game application on the second screen interface will receive a key event to complete the corresponding game action.
  • the second control situation is shown in Figure 5.
  • the second screen interface launches the game application.
  • the first screen interface activates the game controller.
  • the game controller input channel of the first screen interface is stored as a backup channel.
  • the input mapping module directly maps the click or slide event to the touch area of the second screen interface through coordinate conversion, and the second screen interface Game applications can run normally and interactively.
  • the callback service module registered in the native system will return the click or swipe event on the second screen interface to the first screen interface.
  • the input channel is switched to the game controller on the first screen interface.
  • a corresponding click or slide response is made on the game controller of the first screen interface, thereby completing the interactive operation on the operation interface.
  • an embodiment of the present disclosure provides a device 20 based on application interaction in a split screen mode.
  • the device 20 includes a memory 21, a processor 22, a program stored on the memory and executable on the processor, and a data bus 23 for implementing connection and communication between the processor 21 and the memory 22.
  • the program is executed by the processor, the following method shown in FIG. 1 is implemented:
  • Step S110 start a control application on a first screen interface of the same mobile terminal, start a response application on a second screen interface, and store a first input channel of the control application and a second input channel of the response application.
  • the method for application interaction based on the split screen mode proposed in the embodiments of the present disclosure can control the running of another task by one task on the split screen device.
  • the mobile terminal 100 includes: an input mapping module 110, a callback service module 120, and channel switching Module 130, key-value mapping module 140, and event injection module 150.
  • the input mapping module 110 is located at the system hardware abstraction layer (HAL layer, which is an interface layer between the operating system kernel and hardware circuits, the purpose of which is to abstract the hardware).
  • HAL layer which is an interface layer between the operating system kernel and hardware circuits, the purpose of which is to abstract the hardware.
  • the user's The input event performs coordinate mapping conversion according to the specified displacement amount, and completes the conversion of physical input and logical input. The purpose of this mapping is to ensure the operating efficiency of the logic inputs.
  • the callback service module 120 cooperates with the input mapping module 110 to re-call the mapped input event to the physical input terminal for subsequent interactive display of the user operation interface (UI).
  • UI user operation interface
  • the key-value mapping module 140 is mainly configured to convert an input event of a specific range or operation into a designated key value again according to a request of the controller.
  • the controlling end or controlled end only needs to process the corresponding key value event.
  • the event injection module 150 is configured to re-inject the key-value events converted by the key-value mapping module 140 into the input end of the system.
  • the system can process the input key value according to the native logic.
  • the role of the channel switching module 130 is to control the switching of the input channels to ensure that the input events can be correctly distributed to the application tasks of the two screens.
  • the mobile terminal can immediately execute the method "start the control application on the first screen interface of the same mobile terminal, and start the response application on the second screen interface, and Steps of storing the first input channel of the control application and the second input channel of the response application.
  • start the control application on the first screen interface of the same mobile terminal
  • start the response application on the second screen interface
  • Steps of storing the first input channel of the control application and the second input channel of the response application For the split screen mode where the mobile terminal is provided with two screens through the split screen mode, before the mobile terminal performs the above method steps, it is also necessary to execute "Enable the split screen mode of the mobile terminal so that the screen interface of the mobile terminal is divided. For the first screen interface and the second screen interface.
  • the program also implements step S120: receiving a user's input event on the control application, and mapping the input event according to a preset rule to map the input event from the first input channel to the second input channel.
  • the mobile terminal 100 shown in FIG. 2 finishes “starting a control application on the first screen interface of the same mobile terminal, starting a response application on the second screen interface, and storing the first input channel of the control application and the After the step of “responding to the second input channel of the application”, “receive a user input event on the control application and perform mapping conversion according to a preset rule to map the input event from the first input channel to the first input channel Two-input channel.
  • the input event specifically includes a click input event at a preset position and a slide input event at a preset range, that is, the user can perform a tap input at a preset position on the first screen, or perform a swipe input within a preset range of the first screen.
  • the response application launched by the second screen is a game application.
  • the control application includes a standard key set, similar to the handle of a game machine, which controls the game application by clicking the up, down, left, right, A, B, Y, X keys.
  • the control application includes a non-standard key group, which is more commonly used in mobile terminal mobile games. The game application is controlled by sliding in the corresponding direction or touching the corresponding function button.
  • the program further implements step S121: receiving a user input event on the control application, and detecting whether there is a first virtual control key group on the second screen interface and a first virtual control key group on the first screen interface The corresponding second virtual control key group.
  • a user input event is received on the control application, and at the same time, it is detected whether a second virtual control key group corresponding to the first virtual control key group on the first screen interface exists on the second screen interface. That is, it is determined whether the control application is the first case described above or the second case.
  • the first case as shown in FIG. 4, only the first virtual control key group exists on the first screen interface, and the corresponding second virtual control key group does not exist on the second screen interface.
  • the second case as shown in FIG. 5, not only a first virtual control key group exists on the first screen interface, but a corresponding second virtual control key group also exists on the second screen interface.
  • the first virtual control key group includes a plurality of first virtual control keys
  • the second virtual control key group includes a plurality of second virtual control keys corresponding to the functions of the first virtual control keys on a one-to-one basis. That is, the virtual control keys on the display screen in the existing game application (that is, the second virtual control key group) are projected from the second screen interface to the operation control keys on the first screen interface (that is, the first virtual control key group). Control group).
  • step S122 if the second virtual control key group does not exist on the second screen interface, mapping conversion is performed according to a first preset rule to map the input event from the first input channel to the first Two input channels.
  • mapping conversion is required according to a first preset rule to input the input event from the first input channel. Map to this second input channel. Specifically, the input event is converted into a corresponding key value event by the key value mapping module 140. Then, the key value events converted by the key value mapping module 140 are re-injected into the system input terminal through the event injection module 150. Finally, the key-value event re-injected to the system input terminal is delivered to the second input channel through the channel switching module 130, so that the input event is mapped from the first input channel to the second input channel.
  • a first virtual control key group is displayed on the first screen interface.
  • the first virtual control key group is a standard key group, similar to a handle of a game machine, and includes up, down, left, right, A, B, Y, X and other keys. Each key is displayed at a corresponding preset position on the first screen interface.
  • the input event can be converted into a corresponding key event through the key value mapping module 140.
  • the key value event converted by the key value mapping module 140 is injected into the input end of the system through the event injection module 150.
  • the key value event re-injected into the system input terminal is delivered to the second input channel through the channel switching module 130 to ensure that the input event can be correctly distributed to the application tasks of the two screen interfaces.
  • the post-control application or response application only needs to process the corresponding key-value event.
  • step S123 if the second virtual control key group exists on the second screen interface, mapping conversion is performed according to a second preset rule to map the input event from the first input channel to the second Input channel.
  • mapping conversion needs to be performed according to a first preset rule to map the input event from the first input channel to The second input channel.
  • coordinate conversion is performed on the input event through the input mapping module 110 to directly map the input event to a corresponding position on the second screen interface, thereby realizing mapping the input event from the first input channel to the first input channel.
  • Two input channels That is, after the mobile terminal 100 opens the response application on the second screen interface, a second virtual control key group (that is, an application-native virtual control key group) is displayed on the second screen interface.
  • a first virtual control key group is displayed on the first screen interface (which is completely consistent with the function layout of the second virtual control key group).
  • the first virtual control key group is a non-standard key group, and may include a full range of sliding control keys and various function control keys. Each key is displayed at a corresponding preset position on the first screen interface.
  • the input mapping module 110 performs coordinate conversion on the input event, and the input event can be directly mapped to the second screen interface.
  • Corresponding position that is, the touch area of the second screen interface. It is equivalent to the user directly operating on the second virtual control key group on the second screen interface. In this way, the input event can be mapped from the first input channel to the second input channel.
  • the input event is also recalled to the first screen interface through the callback service module 120 to complete the interactive display on the operation interface on the first screen interface, so that the user can use the first screen interface.
  • Each virtual control key that controls the first virtual control key group can obtain corresponding operation feedback on the first screen interface.
  • the program also implements step S130: responding to the action corresponding to the input event on the responding application.
  • the responding application may respond to the input event on the second screen interface as long as it processes the corresponding key value event. Corresponding action.
  • the response application can directly process the operation corresponding to the input event and can respond to the action corresponding to the input event on the second screen interface.
  • the first control situation is shown in Figure 4.
  • the second screen interface starts the game application, and the first screen interface starts the game controller at the same time.
  • the game input channel of the second screen interface is stored as a backup channel.
  • the user only needs to operate on the first screen interface.
  • the button area in the game controller of the first screen interface is clicked, the first screen interface screen responds to the click event to complete the UI interaction, and at the same time, Dpad_A ⁇ Dpad_B ⁇ Dpad_Y ⁇ Dpad_X etc. Key events are reinjected into the system inputs.
  • the input channel is switched to the game input channel of the second screen interface.
  • the game application on the second screen interface will receive a key event to complete the corresponding game action.
  • the second control situation is shown in Figure 5.
  • the second screen interface launches the game application.
  • the first screen interface activates the game controller.
  • the game controller input channel of the first screen interface is stored as a backup channel.
  • the input mapping module directly maps the click or slide event to the touch area of the second screen interface through coordinate conversion, and the second screen interface Game applications can run normally and interactively.
  • the callback service module registered in the native system will return the click or swipe event on the second screen interface to the first screen interface.
  • the input channel is switched to the game controller on the first screen interface.
  • a corresponding click or slide response is made on the game controller of the first screen interface, thereby completing the interactive operation on the operation interface.
  • An embodiment of the present disclosure provides a computer-readable storage medium.
  • the computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the following figure.
  • Step S110 start a control application on a first screen interface of the same mobile terminal, start a response application on a second screen interface, and store a first input channel of the control application and a second input channel of the response application;
  • Step S120 receiving a user's input event on the control application and mapping the input event according to a preset rule to map the input event from the first input channel to the second input channel;
  • Step S130 respond to the action corresponding to the input event on the responding application.
  • the step of receiving a user input event on the control application and mapping the input event according to a preset rule to map the input event from the first input channel to the second input channel It further includes the following steps:
  • Step S121 receiving a user input event on the control application, and detecting whether a second virtual control key group corresponding to the first virtual control key group on the first screen interface exists on the second screen interface;
  • Step S122 if the second virtual control key group does not exist on the second screen interface, perform mapping conversion according to a first preset rule to map the input event from the first input channel to the second input channel; as well as
  • Step S123 if the second virtual control key group exists on the second screen interface, perform mapping conversion according to a second preset rule to map the input event from the first input channel to the second input channel.
  • a control application is started on a first screen interface of the same mobile terminal, a response application is started on a second screen interface, and the control application is stored The first input channel and the second input channel in response to the application.
  • mapping conversion can be performed according to a preset rule to map the input event from the first input channel to the second input channel.
  • the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical The components execute cooperatively.
  • Some or all physical components can be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit .
  • Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media).
  • Computer storage medium includes both volatile and nonvolatile implementations in any method or technology used to store information such as computer-readable instructions, data structures, program modules or other data.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or may Any other medium used to store desired information and which can be accessed by a computer.
  • a communication medium typically contains computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and may include any information delivery medium .

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开提供了一种基于分屏模式下应用交互的方法、设备和存储介质。该方法包括：在同一移动终端的第一屏幕界面上启动控制应用，第二屏幕界面上启动响应应用，并存储所述控制应用的第一输入通道及所述响应应用的第二输入通道；在所述控制应用上接收用户的输入事件，并按预设规则对所述输入事件进行映射转换，以将所述输入事件由所述第一输入通道映射到所述第二输入通道；以及在所述响应应用上响应所述输入事件所对应的动作。摘图1

Description

基于分屏模式下应用交互的方法、设备和存储介质 技术领域
本公开涉及但不限于终端分屏处理技术领域，尤其涉及一种基于分屏模式下应用交互的方法、设备和存储介质。
背景技术
目前，智能终端的屏幕尺寸越来越大。越来越多的用户需要智能终端支持分屏模式，甚至一些设备支持多屏。但目前的分屏模式只是保证了用户的多个独立任务独立运行，不同屏幕上的应用之间是没有交互的。因此，即使设备支持了分屏模式，也仅仅是相当于两个显示设备的简单叠加，并不能给用户带来更过交互使用上的新的体验。
发明内容
本公开实施例的主要目的在于提出一种基于分屏模式下应用交互的方法、设备和存储介质。
为实现上述目的，本公开的一个实施例提供了一种基于分屏模式下应用交互的方法，所述方法包括以下步骤：在同一移动终端的第一屏幕界面上启动控制应用，第二屏幕界面上启动响应应用，并存储所述控制应用的第一输入通道及所述响应应用的第二输入通道；在所述控制应用上接收用户的输入事件，并按预设规则对所述输入事件进行映射转换，以将所述输入事件由所述第一输入通道映射到所述第二输入通道；以及在所述响应应用上响应所述输入事件所对应的动作。
为实现上述目的，本公开实施例还提出了一种基于分屏模式下应用交互的设备，所述设备包括存储器、处理器、存储在所述存储器上并可在所述处理器上运行的程序以及用于实现所述处理器和所述存储器之间的连接通信的数据总线，所述程序被所述处理器执行时实现前述方法的步骤。
为实现上述目的，本公开提供了一种存储介质，用于计算机可读存储，所述存储介质存储有一个或者多个程序，所述一个或者多个程 序可被一个或者多个处理器执行，以实现前述方法的步骤。
附图说明
图1是本公开的一个实施例提供的基于分屏模式下应用交互的方法的流程图。
图2是本公开的一个实施例提供的移动终端的结构框图。
图3是图1所示基于分屏模式下应用交互的方法步骤S120的流程图。
图4是本公开的一个实施例提供的移动终端的示意图，其中在第二屏幕上不存在第二虚拟控键组。
图5是本公开的一个实施例提供的移动终端的示意图，其中在第二屏幕上存在第二虚拟控键组。
图6是本公开的一个实施例提供的基于分屏模式下应用交互的设备的结构框图。
具体实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本公开，并不用于限定本公开。
在后续的描述中，使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本公开的说明，其本身没有特有的意义。因此，“模块”、“部件”或“单元”可以混合地使用。
如图1所示，本实施例提供了一种基于分屏模式下应用交互的方法，该方法包括以下步骤：
步骤S110：在同一移动终端的第一屏幕界面上启动控制应用，第二屏幕界面上启动响应应用，并存储该控制应用的第一输入通道及该响应应用的第二输入通道。
随着移动终端功能越来越强大，用户在移动终端上的业务也越来越多。为了便于用户进行多任务的操作，大部分的移动终端设备目前都支持分屏的模式。甚至一些移动终端设备直接就设置了两个屏幕， 通过折叠结构将两个屏幕连接在一个移动终端设备上，使用户可同时进行两个任务的并行操作。然而，无论是使移动终端设备进入分屏模式还是移动终端设备本身具备两个屏幕，并行的任务之间是独立的，两个任务之间没有交互。即不同屏幕上的应用之间是没有交互的，仅仅是相当于两个显示设备的简单叠加，并不能给用户带来交互使用的体验。
基于此，本公开的实施例提出的基于分屏模式下应用交互的方法，可通过分屏设备上的一个任务来控制另外一个任务的运行。而为了实现本公开的实施例提出的基于分屏模式下应用交互的方法，如图2所示，根据本公开的实施例的移动终端100包括：输入映射模块110、回调服务模块120、通道切换模块130、键值映射模块140以及事件注入模块150。
在一个示例性实施例中，输入映射模块110处于系统硬件抽象层(HAL层，是位于操作系统内核与硬件电路之间的接口层，其目的在于将硬件抽象化)，根据实际需要将用户的输入事件按照指定的位移量进行坐标映射转换，完成物理输入与逻辑输入的转换。该映射的目的是保证逻辑输入端的运行效率。回调服务模块120配合输入映射模块110，能够将映射后的输入事件重新回调到物理输入端，用于后续用户操作界面(UI)的交互显示。键值映射模块140主要被构造成按照控制器的要求，将特定范围或操作的输入事件再次转换成指定的键值。控制端或被控制端只要去处理对应的键值事件即可。事件注入模块150被构造成将键值映射模块140转换出的键值事件重新注入系统的输入端。系统按照原生的逻辑对输入的键值处理即可。通道切换模块130的作用则是控制输入通道的切换，保证输入事件能够正确的分发到两个屏幕的应用任务中去。
这样一来，针对移动终端本身就具备两个屏幕的分屏情形，移动终端可立即执行本方法“在同一移动终端的第一屏幕界面上启动控制应用，第二屏幕界面上启动响应应用，并存储该控制应用的第一输入通道及该响应应用的第二输入通道”的步骤。而针对通过分屏模式使得本移动终端具备两个屏幕的分屏情形，移动终端在执行上述的方法 步骤之前，还需执行“启动该移动终端的分屏模式，使得该移动终端的屏幕界面划分为第一屏幕界面与第二屏幕界面”的步骤。
步骤S120：在该控制应用上接收用户的输入事件，并按预设规则对该输入事件进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。
具体地，当图2所示的移动终端100在完成“在同一移动终端的第一屏幕界面上启动控制应用，第二屏幕界面上启动响应应用，并存储该控制应用的第一输入通道及该响应应用的第二输入通道”的步骤之后，可以执行“在该控制应用上接收用户的输入事件，并按预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道”的步骤。该输入事件具体包括预设位置的点击输入事件以及预设范围的滑动输入事件，即用户可在第一屏幕的预设位置进行点击输入，或在第一屏幕的预设范围内进行滑动输入，以达到操作该控制应用的目的。
例如，第二屏幕启动的响应应用为游戏应用。一般对游戏进行操控的控制应用可有两种形式。在第一种形式中，控制应用包括标准按键组，类似于游戏机的手柄，通过点击上、下、左、右、A、B、Y、X按键对游戏应用进行操控。在第二种形式中，控制应用包括非标准按键组，在移动终端手游中比较常用，通过相应方向的滑动或者触摸相应的功能按键对游戏应用进行操控。
基于此，如图3所示，本方法还包括步骤S121：在该控制应用上接收用户的输入事件，检测该第二屏幕界面上是否存在与该第一屏幕界面上的第一虚拟控键组相对应的第二虚拟控键组。
具体地，在该控制应用上接收用户的输入事件，同时，检测该第二屏幕界面上是否存在与该第一屏幕界面上的第一虚拟控键组相对应的第二虚拟控键组。即，判断该控制应用是上述的第一种情形，还是第二种情形。对于第一种情形，如图4所示，只在该第一屏幕界面上存在第一虚拟控键组，而在第二屏幕界面上并不存在相应的第二虚拟控键组。而对于第二种情形，如图5所示，不仅在该第一屏幕界面上存在第一虚拟控键组，而在第二屏幕界面上同样存在相应的第二虚拟 控键组。该第一虚拟控键组包括若干第一虚拟控键，该第二虚拟控键组包括若干与若干第一虚拟控键功能一一对应的第二虚拟控键。也就是说，将现有游戏应用中的显示屏幕上的虚拟控键(即第二虚拟控键组)由第二屏幕界面一一投射到了第一屏幕界面中的操作控键(即第一虚拟控键组)。
本方法还包括步骤S122：若该第二屏幕界面上不存在该第二虚拟控键组，则按第一预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。
具体地，如图4所示，针对该第二屏幕界面上不存在该第二虚拟控键组的情形，需按第一预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。具体地，通过键值映射模块140将该输入事件转换成相应的键值事件。然后，通过事件注入模块150将键值映射模块140转换出的键值事件重新注入到系统输入端。最后，通过通道切换模块130将重新注入到系统输入端的键值事件投递到第二输入通道，进而实现将输入事件由第一输入通道映射到第二输入通道。即，当移动终端100在该第一屏幕界面上打开该控制应用后，在该第一屏幕界面上显示有第一虚拟控键组。此时，该第一虚拟控键组为标准按键组，类似于游戏机的手柄，包括上、下、左、右、A、B、Y、X等按键。每一按键显示在该第一屏幕界面相应的预设位置上。用户在该第一屏幕界面上的相应位置进行点击输入后，通过键值映射模块140可将该输入事件转换成相应的键值事件。接着，通过事件注入模块150将键值映射模块140转换出的键值事件重新注入系统的输入端。最后，通过通道切换模块130将注入到系统输入端的键值事件投递到第二输入通道，保证输入事件能够正确地分发到两个屏幕界面的应用任务中。后期控制应用或响应应用只要去处理对应的键值事件即可。
本方法还包括步骤S123：若该第二屏幕界面上存在该第二虚拟控键组，则按第二预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。
具体地，如图5所示，针对该第二屏幕界面存在该第二虚拟控键 组的情形，需按第一预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。具体地，通过输入映射模块110对该输入事件进行坐标换算，以将该输入事件直接映射到该第二屏幕界面的相应位置上，进而实现将该输入事件由该第一输入通道映射到该第二输入通道。即，当移动终端100在该第二屏幕界面上打开该响应应用后，在该第二屏幕界面上显示有第二虚拟控键组(即，应用原生的虚拟控键组)。在该第一屏幕界面上打开该控制应用后，在该第一屏幕界面上显示有第一虚拟控键组(与第二虚拟控键组的功能布局完全一致)。此时，该第一虚拟控键组为非标准按键组，可以包括全方位的滑动控键及各种功能控键。每一按键显示在该第一屏幕界面相应的预设位置上。用户在该第一屏幕界面上的相应位置进行点击输入或进行范围内的滑动输入后，通过输入映射模块110对该输入事件进行坐标换算，可将该输入事件直接映射到该第二屏幕界面的相应位置上(即该第二屏幕界面的触控区域)。相当于用户直接在该第二屏幕界面上的第二虚拟控键组上进行操作。如此，便可实现将该输入事件由该第一输入通道映射到该第二输入通道。
另外，为提高用户操控体验，还通过回调服务模块120将该输入事件回调到第一屏幕界面上，以在该第一屏幕界面上完成操作界面上的交互显示，使得用户在该第一屏幕界面上操控第一虚拟控键组的每一虚拟控键，都可在该第一屏幕界面上获得相应的操作反馈。
本方法还包括步骤S130：在该响应应用上响应该输入事件对应的动作。
具体地，针对图4所示的该第二屏幕界面上不存在该第二虚拟控键组的情形，响应应用只要去处理对应的键值事件便可在该第二屏幕界面上响应该输入事件对应的动作。而针对图5所示的该第二屏幕界面上存在该第二虚拟控键组的情形，响应应用可直接处理输入事件对应的操作便可在该第二屏幕界面上响应该输入事件对应的动作。
下面仍以游戏应用的两种不同控制情形为例具体说明本基于分屏模式下应用交互的方法的实际应用。
第一种控制情形如图4所示。第二屏幕界面启动游戏应用，第一 屏幕界面同时启动游戏控制器。此时，将第二屏幕界面的游戏输入通道存储为备用通道。用户只需要在第一屏幕界面上进行操作。当点击第一屏幕界面的游戏控制器中的按钮区域时，第一屏幕界面屏响应点击事件完成UI交互，同时将Dpad_A\Dpad_B\Dpad_Y\Dpad_X等按键事件重新注入到系统输入端中。在进行按键事件分发时，将输入通道切换到第二屏幕界面的游戏输入通道。此时，第二屏幕界面的游戏应用将会接收到按键事件完成相应的游戏动作。同样，当在第一屏幕界面屏的方向区域滑动操作时，会将Dpad_down\Dpad_up\Dpad_left\Dpad_right的键值发送给第二屏幕界面的游戏应用，最终实现第一屏幕界面的游戏控制器控制第二屏幕界面的游戏应用的功能。
第二种控制情形如图5所示。第二屏幕界面启动游戏应用。第一屏幕界面启动游戏控制器。此时，将第一屏幕界面的游戏控制器输入通道存储为备用通道。当在第一屏幕界面屏上的按钮及方向控制区进行点击或滑动操作时，输入映射模块会将点击或滑动事件通过坐标换算直接映射到第二屏幕界面的触摸区域上，并且第二屏幕界面的游戏应用则可以正常交互运行。注册在原生系统中的回调服务模块，则会将第二屏幕界面上的点击或滑动事件回传给第一屏幕界面。第一屏幕界面收到点击或滑动事件坐标后，将输入通道切换到第一屏幕界面的游戏控制器上。最终，在第一屏幕界面的游戏控制器上作出相应的点击或滑动回应，进而完成操作界面上的交互操作。
如图11所示，本公开的一个实施例提出一种基于分屏模式下应用交互的设备20。该设备20包括存储器21、处理器22、存储在该存储器上并可在该处理器上运行的程序以及用于实现处理器21和存储器22之间的连接通信的数据总线23。该程序被该处理器执行时，以实现以下如图1所示的方法：
步骤S110：在同一移动终端的第一屏幕界面上启动控制应用，第二屏幕界面上启动响应应用，并存储该控制应用的第一输入通道及该响应应用的第二输入通道。
随着移动终端功能越来越强大，用户在移动终端上的业务也越来越多。为了便于用户进行多任务的操作，大部分的移动终端设备目前都支持分屏的模式。甚至一些移动终端设备直接就设置了两个屏幕，通过折叠结构将两个屏幕连接在一个移动终端设备上，使用户可同时进行两个任务的并行操作。然而，无论是使移动终端设备进入分屏模式还是移动终端设备本身具备两个屏幕，并行的任务之间是独立的，两个任务之间没有交互。即不同屏幕上的应用之间是没有交互的，仅仅是相当于两个显示设备的简单叠加，并不能给用户带来交互使用的体验。
基于此，本公开的实施例提出的基于分屏模式下应用交互的方法，可通过分屏设备上的一个任务来控制另外一个任务的运行。而为了实现本公开的实施例提出的基于分屏模式下应用交互的方法，如图2所示，根据本公开的实施例的移动终端100包括：输入映射模块110、回调服务模块120、通道切换模块130、键值映射模块140以及事件注入模块150。
在一个示例性实施例中，输入映射模块110处于系统硬件抽象层(HAL层，是位于操作系统内核与硬件电路之间的接口层，其目的在于将硬件抽象化)，根据实际需要将用户的输入事件按照指定的位移量进行坐标映射转换，完成物理输入与逻辑输入的转换。该映射的目的是保证逻辑输入端的运行效率。回调服务模块120配合输入映射模块110，能够将映射后的输入事件重新回调到物理输入端，用于后续用户操作界面(UI)的交互显示。键值映射模块140主要被构造成按照控制器的要求，将特定范围或操作的输入事件再次转换成指定的键值。控制端或被控制端只要去处理对应的键值事件即可。事件注入模块150被构造成将键值映射模块140转换出的键值事件重新注入系统的输入端。系统按照原生的逻辑对输入的键值处理即可。通道切换模块130的作用则是控制输入通道的切换，保证输入事件能够正确的分发到两个屏幕的应用任务中去。
这样一来，针对移动终端本身就具备两个屏幕的分屏情形，移动终端可立即执行本方法“在同一移动终端的第一屏幕界面上启动控制 应用，第二屏幕界面上启动响应应用，并存储该控制应用的第一输入通道及该响应应用的第二输入通道”的步骤。而针对通过分屏模式使得本移动终端具备两个屏幕的分屏情形，移动终端在执行上述的方法步骤之前，还需执行“启动该移动终端的分屏模式，使得该移动终端的屏幕界面划分为第一屏幕界面与第二屏幕界面”的步骤。
该程序还实现步骤S120：在该控制应用上接收用户的输入事件，并按预设规则对该输入事件进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。
具体地，当图2所示的移动终端100在完成“在同一移动终端的第一屏幕界面上启动控制应用，第二屏幕界面上启动响应应用，并存储该控制应用的第一输入通道及该响应应用的第二输入通道”的步骤之后，可以执行“在该控制应用上接收用户的输入事件，并按预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道”的步骤。该输入事件具体包括预设位置的点击输入事件以及预设范围的滑动输入事件，即用户可在第一屏幕的预设位置进行点击输入，或在第一屏幕的预设范围内进行滑动输入，以达到操作该控制应用的目的。
例如，第二屏幕启动的响应应用为游戏应用。一般对游戏进行操控的控制应用可有两种形式。在第一种形式中，控制应用包括标准按键组，类似于游戏机的手柄，通过点击上、下、左、右、A、B、Y、X按键对游戏应用进行操控。在第二种形式中，控制应用包括非标准按键组，在移动终端手游中比较常用，通过相应方向的滑动或者触摸相应的功能按键对对游戏应用进行操控。
基于此，如图3所示，该程序还实现步骤S121：在该控制应用上接收用户的输入事件，检测该第二屏幕界面上是否存在与该第一屏幕界面上的第一虚拟控键组相对应的第二虚拟控键组。
具体地，在该控制应用上接收用户的输入事件，同时，检测该第二屏幕界面上是否存在与该第一屏幕界面上的第一虚拟控键组相对应的第二虚拟控键组。即，判断该控制应用是上述的第一种情形，还是第二种情形。对于第一种情形，如图4所示，只在该第一屏幕界面上 存在第一虚拟控键组，而在第二屏幕界面上并不存在相应的第二虚拟控键组。而对于第二种情形，如图5所示，不仅在该第一屏幕界面上存在第一虚拟控键组，而在第二屏幕界面上同样存在相应的第二虚拟控键组。该第一虚拟控键组包括若干第一虚拟控键，该第二虚拟控键组包括若干与若干第一虚拟控键功能一一对应的第二虚拟控键。也就是说，将现有游戏应用中的显示屏幕上的虚拟控键(即第二虚拟控键组)由第二屏幕界面一一投射到了第一屏幕界面中的操作控键(即第一虚拟控键组)。
该程序还实现步骤S122：若该第二屏幕界面上不存在该第二虚拟控键组，则按第一预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。
具体地，如图4所示，针对该第二屏幕界面上不存在该第二虚拟控键组的情形，需按第一预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。具体地，通过键值映射模块140将该输入事件转换成相应的键值事件。然后，通过事件注入模块150将键值映射模块140转换出的键值事件重新注入到系统输入端。最后，通过通道切换模块130将重新注入到系统输入端的键值事件投递到第二输入通道，进而实现将输入事件由第一输入通道映射到第二输入通道。即，当移动终端100在该第一屏幕界面上打开该控制应用后，在该第一屏幕界面上显示有第一虚拟控键组。此时，该第一虚拟控键组为标准按键组，类似于游戏机的手柄，包括上、下、左、右、A、B、Y、X等按键。每一按键显示在该第一屏幕界面相应的预设位置上。用户在该第一屏幕界面上的相应位置进行点击输入后，通过键值映射模块140可将该输入事件转换成相应的键值事件。接着，通过事件注入模块150将键值映射模块140转换出的键值事件注入系统的输入端。最后，通过通道切换模块130将重新注入到系统输入端的键值事件投递到第二输入通道，保证输入事件能够正确地分发到两个屏幕界面的应用任务中。后期控制应用或响应应用只要去处理对应的键值事件即可。
该程序还实现步骤S123：若该第二屏幕界面上存在该第二虚拟控 键组，则按第二预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。
具体地，如图5所示，针对该第二屏幕界面存在该第二虚拟控键组的情形，需按第一预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。具体地，通过输入映射模块110对该输入事件进行坐标换算，以将该输入事件直接映射到该第二屏幕界面的相应位置上，进而实现将该输入事件由该第一输入通道映射到该第二输入通道。即，当移动终端100在该第二屏幕界面上打开该响应应用后，在该第二屏幕界面上显示有第二虚拟控键组(即，应用原生的虚拟控键组)。在该第一屏幕界面上打开该控制应用后，在该第一屏幕界面上显示有第一虚拟控键组(与第二虚拟控键组的功能布局完全一致)。此时，该第一虚拟控键组为非标准按键组，可以包括全方位的滑动控键及各种功能控键。每一按键显示在该第一屏幕界面相应的预设位置上。用户在该第一屏幕界面上的相应位置进行点击输入或进行范围内的滑动输入后，通过输入映射模块110对该输入事件进行坐标换算，可将该输入事件直接映射到该第二屏幕界面的相应位置上(即该第二屏幕界面的触控区域)。相当于用户直接在该第二屏幕界面上的第二虚拟控键组上进行操作。如此便可实现将该输入事件由该第一输入通道映射到该第二输入通道。
另外，为提高用户操控体验，还通过回调服务模块120将该输入事件回调到第一屏幕界面上，以在该第一屏幕界面上完成操作界面上的交互显示，使得用户在该第一屏幕界面上操控第一虚拟控键组的每一虚拟控键，都可在该第一屏幕界面上获得相应的操作反馈。
该程序还实现步骤S130：在该响应应用上响应该输入事件对应的动作。
具体地，针对图4所示的该第二屏幕界面上不存在该第二虚拟控键组的情形，响应应用只要去处理对应的键值事件便可在该第二屏幕界面上响应该输入事件对应的动作。而针对图5所示的该第二屏幕界面上存在该第二虚拟控键组的情形，响应应用可直接处理输入事件对应的操作便可在该第二屏幕界面上响应该输入事件对应的动作。
下面仍以游戏应用的两种不同控制情形为例具体说明本基于分屏模式下应用交互的方法的实际应用。
第一种控制情形如图4所示。第二屏幕界面启动游戏应用，第一屏幕界面同时启动游戏控制器。此时，将第二屏幕界面的游戏输入通道存储为备用通道。用户只需要在第一屏幕界面上进行操作，当点击第一屏幕界面的游戏控制器中的按钮区域时，第一屏幕界面屏响应点击事件完成UI交互，同时将Dpad_A\Dpad_B\Dpad_Y\Dpad_X等按键事件重新注入到系统输入端中。在进行按键事件分发时，将输入通道切换到第二屏幕界面的游戏输入通道。此时，第二屏幕界面的游戏应用将会接收到按键事件完成相应的游戏动作。同样，当在第一屏幕界面屏的方向区域滑动操作时，会将Dpad_down\Dpad_up\Dpad_left\Dpad_right的键值发送给第二屏幕界面的游戏应用，最终实现第一屏幕界面的游戏控制器控制第二屏幕界面的游戏应用的功能。
第二种控制情形如图5所示。第二屏幕界面启动游戏应用。第一屏幕界面启动游戏控制器。此时，将第一屏幕界面的游戏控制器输入通道存储为备用通道。当在第一屏幕界面屏上的按钮及方向控制区进行点击或滑动操作时，输入映射模块会将点击或滑动事件通过坐标换算直接映射到第二屏幕界面的触摸区域上，并且第二屏幕界面的游戏应用则可以正常交互运行。注册在原生系统中的回调服务模块，则会将第二屏幕界面上的点击或滑动事件回传给第一屏幕界面。第一屏幕界面收到点击或滑动事件坐标后，将输入通道切换到第一屏幕界面的游戏控制器上。最终，在第一屏幕界面的游戏控制器上作出相应的点击或滑动回应，进而完成操作界面上的交互操作。
本公开的一个实施例提出一种计算机可读存储介质，该计算机可读存储介质存储有一个或者多个程序，该一个或者多个程序可被一个或者多个处理器执行，以实现以下如图1所示的方法：
步骤S110：在同一移动终端的第一屏幕界面上启动控制应用，第二屏幕界面上启动响应应用，并存储该控制应用的第一输入通道及该响应应用的第二输入通道；
步骤S120：在该控制应用上接收用户的输入事件，并按预设规则对该输入事件进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道；以及
步骤S130：在该响应应用上响应该输入事件对应的动作。
如图3所示，在该控制应用上接收用户的输入事件，并按预设规则对该输入事件进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道的步骤进一步包括以下步骤：
步骤S121：在该控制应用上接收用户的输入事件，检测该第二屏幕界面上是否存在与该第一屏幕界面上的第一虚拟控键组相对应的第二虚拟控键组；
步骤S122：若该第二屏幕界面上不存在该第二虚拟控键组，则按第一预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道；以及
步骤S123：若该第二屏幕界面上存在该第二虚拟控键组，则按第二预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。
由于本实施例与基于分屏模式下应用交互的方法的实施例和基于分屏模式下应用交互的设备的实施例类似，因此省略其详细描述。
根据本公开实施例提出的基于分屏模式下应用交互的方法、设备和存储介质，通过在同一移动终端的第一屏幕界面上启动控制应用，第二屏幕界面上启动响应应用，并存储控制应用的第一输入通道及响应应用的第二输入通道。这样一来，便可在该控制应用上接收用户的输入事件，并按预设规则进行映射转换，以将该输入事件由该第一输入通道映射到该第二输入通道。最终，在该响应应用上响应该输入事件所对应的动作。可见，根据本公开实施例，可实现当移动终端处于 分屏模式下，用户可使用其中的一个屏幕作为控制端，操控另一个屏幕上的应用的功能。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统、设备中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。
在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些物理组件或所有物理组件可以被实施为由处理器，如中央处理器、数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
以上参照附图说明了本公开的优选实施例，并非因此局限本公开的权利范围。本领域技术人员不脱离本公开的范围和实质内所作的任何修改、等同替换和改进，均应在本公开的权利范围之内。

Claims (10)

  1. 一种基于分屏模式下应用交互的方法，包括以下步骤：
    在同一移动终端的第一屏幕界面上启动控制应用，第二屏幕界面上启动响应应用，并存储所述控制应用的第一输入通道及所述响应应用的第二输入通道；
    在所述控制应用上接收用户的输入事件，并按预设规则对所述输入事件进行映射转换，以将所述输入事件由所述第一输入通道映射到所述第二输入通道；以及
    在所述响应应用上响应所述输入事件所对应的动作。
  2. 根据权利要求1所述的方法，其中，所述在同一移动终端的第一屏幕界面上启动控制应用，第二屏幕界面上启动响应应用，并存储所述控制应用的第一输入通道及所述响应应用的第二输入通道的步骤之前，所述方法还包括：
    启动所述移动终端的分屏模式，使得所述移动终端的屏幕界面划分为所述第一屏幕界面与所述第二屏幕界面。
  3. 根据权利要求1所述的方法，其中，所述输入事件包括预设位置的点击输入事件以及预设范围的滑动输入事件。
  4. 根据权利要求1所述的方法，其中，所述在所述控制应用上接收用户的输入事件，并按预设规则进行映射转换，以将所述输入事件由所述第一输入通道映射到所述第二输入通道的步骤包括：
    在所述控制应用上接收用户的输入事件，检测所述第二屏幕界面上是否存在与所述第一屏幕界面上的第一虚拟控键组相对应的第二虚拟控键组；
    在所述第二屏幕界面上不存在所述第二虚拟控键组的情况下，则按第一预设规则进行映射转换，以将所述输入事件由所述第一输入通道映射到所述第二输入通道；以及
    在所述第二屏幕界面上存在所述第二虚拟控键组的情况下，则按第二预设规则进行映射转换，以将所述输入事件由所述第一输入通道映射到所述第二输入通道。
  5. 根据权利要求4所述的方法，其中，
    所述第一虚拟控键组包括至少一个第一虚拟控键，所述第二虚拟控键组包括至少一个与所述至少一个第一虚拟控键功能对应的至少一个第二虚拟控键。
  6. 根据权利要求4所述的方法，其中，所述在所述第二屏幕界面上不存在所述第二虚拟控键组的情况下，则按第一预设规则进行映射转换，以将所述输入事件由所述第一输入通道映射到所述第二输入通道的步骤包括：
    [圣1]将所述输入事件转换成相应的键值事件；
    将所述键值映射模块转换出的键值事件注入到系统输入端；以及
    将注入到系统输入端的键值事件投递到所述第二输入通道，使得所述输入事件由所述第一输入通道映射到所述第二输入通道。
  7. 根据权利要求4所述的方法，其中，所述在所述第二屏幕界面上存在所述第二虚拟控键组的情况下，则按第二预设规则进行映射转换，以将所述输入事件由所述第一输入通道映射到所述第二输入通道的步骤包括：
    对所述输入事件进行坐标换算，以将所述输入事件直接映射到所述第二屏幕界面的相应位置上，使得所述输入事件由所述第一输入通道映射到所述第二输入通道。
  8. 根据权利要求7所述的方法，其中，所述在所述第二屏幕界面上存在所述第二虚拟控键组的情况下，则按第一预设规则进行映射转换，以将所述输入事件由所述第一输入通道映射到所述第二输入通道的步骤还包括：
    将所述输入事件回调到所述第一屏幕界面上，以在所述第一屏幕界面上完成操作界面上的交互显示。
  9. 一种基于分屏模式下应用交互的设备，其中，所述设备包括存储器、处理器、存储在所述存储器上并可在所述处理器上运行的程序以及用于实现所述处理器和所述存储器之间的连接通信的数据总线，所述程序被所述处理器执行时实现如权利要求1-8任一项所述的基于分屏模式下应用交互的方法的步骤。
  10. 一种存储介质，用于计算机可读存储，其中，所述存储介质存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现权利要求1至8中任一项所述的基于分屏模式下应用交互的方法的步骤。
PCT/CN2019/087815 2018-05-28 2019-05-21 基于分屏模式下应用交互的方法、设备和存储介质 WO2019228233A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810522981.4 2018-05-28
CN201810522981.4A CN110543264B (zh) 2018-05-28 2018-05-28 基于分屏模式下应用交互的方法、设备和存储介质

Publications (1)

Publication Number Publication Date
WO2019228233A1 true WO2019228233A1 (zh) 2019-12-05

Family

ID=68697411

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/087815 WO2019228233A1 (zh) 2018-05-28 2019-05-21 基于分屏模式下应用交互的方法、设备和存储介质

Country Status (2)

Country Link
CN (1) CN110543264B (zh)
WO (1) WO2019228233A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110989957A (zh) * 2019-12-12 2020-04-10 深圳市深智电科技有限公司 一种多屏显示方法、终端及存储介质
CN114051062A (zh) * 2021-10-29 2022-02-15 珠海读书郎软件科技有限公司 一种双屏电话手表交互控制系统及方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105677228A (zh) * 2013-07-11 2016-06-15 三星电子株式会社 用于显示内容的用户终端设备及其方法
CN106168870A (zh) * 2016-06-30 2016-11-30 深圳市金立通信设备有限公司 一种分屏窗口显示方法及终端
CN107340967A (zh) * 2017-07-10 2017-11-10 广州视源电子科技股份有限公司 一种智能设备及其操作方法和装置及计算机存储介质

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102082875B (zh) * 2011-02-15 2013-08-14 惠州Tcl移动通信有限公司 一种移动终端
CN103218094A (zh) * 2013-05-16 2013-07-24 江西合力泰科技股份有限公司 一种低成本的多点触控电容屏
CN104133629A (zh) * 2014-07-10 2014-11-05 深圳市中兴移动通信有限公司 双屏互动的方法及移动终端
CN105068743B (zh) * 2015-06-12 2018-07-17 西安交通大学 基于多指触控行为特征的移动终端用户身份认证方法
CN106951170A (zh) * 2017-03-13 2017-07-14 北京奇虎科技有限公司 一种移动终端的分屏处理方法和装置、移动终端
CN107193480B (zh) * 2017-06-01 2019-11-19 孙康 一种触控双屏交互系统及其控制方法
CN107728983A (zh) * 2017-10-18 2018-02-23 上海龙旗科技股份有限公司 双屏操作方法及设备

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105677228A (zh) * 2013-07-11 2016-06-15 三星电子株式会社 用于显示内容的用户终端设备及其方法
CN106168870A (zh) * 2016-06-30 2016-11-30 深圳市金立通信设备有限公司 一种分屏窗口显示方法及终端
CN107340967A (zh) * 2017-07-10 2017-11-10 广州视源电子科技股份有限公司 一种智能设备及其操作方法和装置及计算机存储介质

Also Published As

Publication number Publication date
CN110543264B (zh) 2022-05-10
CN110543264A (zh) 2019-12-06

Similar Documents

Publication Publication Date Title
EP3200061B1 (en) Icon management method and apparatus, and terminal
EP2993566B9 (en) Application interface presentation method and apparatus, and electronic device
CN104468741B (zh) 云桌面的处理方法及装置
AU2013389985B2 (en) User interface elements for multiple displays
WO2021093619A1 (zh) 用于Android系统双屏异显的多输入设备交互方法、装置及介质
WO2022057881A1 (zh) 操作方法及装置
WO2015106514A1 (zh) 一种实现悬浮显示的方法及装置
US10223103B2 (en) Rom flashing method and intelligent terminal
US9575649B2 (en) Virtual touchpad with two-mode buttons for remote desktop client
CN110908625A (zh) 多屏显示方法、装置、设备、系统、舱体及存储介质
WO2022001899A1 (zh) 应用程序管理方法、装置和电子设备
US9830181B2 (en) Method and system for gracefully shutdown virtual system
WO2017167126A1 (zh) 一种窗口显示方法、信息交互方法及系统
WO2022166820A1 (zh) 应用界面处理方法、装置、电子设备及可读存储介质
WO2023020149A1 (zh) 对象拖拽方法、设备和存储介质
WO2019228233A1 (zh) 基于分屏模式下应用交互的方法、设备和存储介质
WO2017156983A1 (zh) 一种列表的调用方法及装置
CN107357586A (zh) 应用程序的控制方法、装置及设备
CN107832113A (zh) 一种Android系统应用程序的界面显示方法及装置
JP2018195304A (ja) モバイルクラウドシステム、その動作方法、およびクラウドサーバ
CN115220842B (zh) 车载导航方法、系统、车辆及存储介质
US10606632B2 (en) Preventing interruption during virtual machine reboot
WO2016131181A1 (zh) 一种指纹事件的处理方法、装置及终端
CN111857514A (zh) 设备控制方法、装置、电子设备及存储介质
US20150381766A1 (en) Application transfer system, application transfer method, terminal, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19811674

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 20.04.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19811674

Country of ref document: EP

Kind code of ref document: A1