WO2021093619A1 - 用于Android系统双屏异显的多输入设备交互方法、装置及介质 - Google Patents

用于Android系统双屏异显的多输入设备交互方法、装置及介质 Download PDF

Info

Publication number
WO2021093619A1
WO2021093619A1 PCT/CN2020/125612 CN2020125612W WO2021093619A1 WO 2021093619 A1 WO2021093619 A1 WO 2021093619A1 CN 2020125612 W CN2020125612 W CN 2020125612W WO 2021093619 A1 WO2021093619 A1 WO 2021093619A1
Authority
WO
WIPO (PCT)
Prior art keywords
input device
display
screen
event
information
Prior art date
Application number
PCT/CN2020/125612
Other languages
English (en)
French (fr)
Inventor
沈志成
陈智松
卢荣富
Original Assignee
厦门亿联网络技术股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 厦门亿联网络技术股份有限公司 filed Critical 厦门亿联网络技术股份有限公司
Publication of WO2021093619A1 publication Critical patent/WO2021093619A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/4401Bootstrapping
    • G06F9/4411Configuring for operating with peripheral devices; Loading of device drivers

Definitions

  • the present invention relates to the technical field of embedded devices, in particular to a method, device and medium for multi-input device interaction for dual-screen display of an Android system.
  • multi-screen entertainment and multi-screen office are becoming more and more popular, and there are more and more application scenarios for multi-screen.
  • users can connect multiple display screens in the office or home, such as computer screens, mobile phone screens, TV screens, or projector screens, to achieve mutual wireless connection between multiple display devices through a local area network.
  • Display is also one of the connection methods.
  • One device is connected to two display devices at the same time, so that the two display devices can respectively display different interactive interfaces.
  • the inventor of the present invention found that the native system in the prior art does not fully support the different display scenarios of dual-screen multi-input devices, and lacks a unified standard. ; And the existing dual-screen different display scenes are mainly used for the dual-screen scenes where the main screen is responsible for display and operation, and the secondary screen is responsible for displaying.
  • the secondary screen device is controlled by the mode of the primary screen device, and the secondary screen does not have autonomy, and its content is Part of the screen content displayed by the main screen device cannot be completely controlled and operated independently.
  • the technical problem to be solved by the embodiments of the present invention is that a method, device, and medium for multi-input device interaction for dual-screen display of the Android system can support the display on the secondary screen while the secondary screen is controlled by the primary screen application. Carry out autonomous control.
  • an embodiment of the present invention provides a multi-input device interaction method for dual-screen display of the Android system, which includes at least the following steps:
  • the system After receiving the event reported by the input device of the secondary display and triggering the secondary display to start a new application, the system enters the different display mode, and at the same time updates the current different display mode to the system input layer;
  • the judgment is made according to the status of the same and different display modes stored in the input layer of the system, and the corresponding application is started and displayed on the secondary display screen.
  • the multi-input device interaction method for dual-screen different display of the Android system further includes:
  • the different display mode when the application program displayed on the secondary display is closed, the different display mode is actively exited, the system enters the same display mode, and the state information of the same display mode is synchronized to the system input layer.
  • the multi-input device interaction method for dual-screen different display of the Android system further includes:
  • the events reported by the secondary display screen can be transformed into the coordinate system of the primary display screen in the same display scene.
  • the multi-input device interaction method for dual-screen different display of the Android system further includes:
  • the custom peripheral input device is the third bustype type, which is used to define its additional definition operations.
  • the event reported by the secondary display screen is converted into the coordinate system of the primary display screen in the same display scene, specifically as follows:
  • the device type identifiers corresponding to the two customized bustype types are added to the first function, specifically:
  • the isExternalDeviceLocked function is obtained by combing the original framework process of the system, the bustype type of the input device is judged according to the isExternalDeviceLocked function, and the device type identification corresponding to the input device is added, so that the custom-defined device can be distinguished in the system framework layer. bustpye type.
  • binding identification information of the event added to the event structure is specifically:
  • the main display screen when receiving the event information reported by the input device of the main display screen, after judging and event conversion processing is performed according to the event information, the corresponding application is started and displayed on the main display screen, which further includes :
  • An embodiment of the present invention provides a multi-input device interaction apparatus for dual-screen display of the Android system, which is characterized in that it includes a processor, a memory, and is stored in the memory and configured to be used by the processor.
  • the executed computer program when the processor executes the computer program, the above-mentioned multi-input device interaction method for dual-screen display of the Android system is implemented.
  • An embodiment of the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored computer program, wherein the computer-readable storage medium is controlled when the computer program is running.
  • the device where the medium is located executes the above-mentioned multi-input device interaction method for dual-screen display of the Android system.
  • the embodiment of the present invention provides a method, device, and medium for multi-input device interaction for dual-screen display of the Android system.
  • the method includes: adapting two display screens through a system driver layer, and customizing two bustype types Distinguish between the primary display and the secondary display; after obtaining the input device information through the system input layer, add the device type identifiers corresponding to the two customized bustype types in the first function, and add the event information to the event structure Bind identification information; monitor the new event information of the underlying device, and display a pop-up prompt when it is judged as a peripheral input device, so that the peripheral is configured as the peripheral input device of the display screen, and the peripheral is updated synchronously Configure to the input layer of the system; after receiving an event reported by the input device of the secondary display and triggering the secondary display to start a new application, the system enters the different display mode, and at the same time updates the current different display mode to the system input layer;
  • the input device of the main display screen reports event information, after judgment and event
  • the invention can support two embedded devices that display touch screens to enter and exit the different display mode by operating the secondary screen to start the application, and supports that in the different display mode, the applications of the two display screens can normally respond to the input devices bound to the corresponding display screens.
  • it allows the user to configure the mouse, keyboard and other external devices, bind the primary and secondary screens and the applications displayed on them, which can not only meet the mode that the secondary screen is controlled by the primary screen application, but also support the display on the secondary screen. Operate, enter or exit the dual-screen different display mode more quickly, and improve the autonomy of the operation of the secondary screen.
  • FIG. 1 is a schematic flowchart of a multi-input device interaction method for dual-screen display of Android system according to an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of a system framework diagram for implementing a multi-input device interaction method for dual-screen display of the Android system according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of the work flow of a coordinate system conversion module provided by an embodiment of the present invention.
  • the application scenarios that can be provided by the present invention are introduced, such as multi-input device interaction that realizes dual-screen different displays.
  • the method for multi-input device interaction for dual-screen display of the Android system includes at least the following steps:
  • the driver layer adapts two touch screens, one is the main touch screen, and the other is the auxiliary touch screen.
  • the bustype is customized to distinguish between the main and auxiliary touch screens. Peripherals such as the display screen and custom mouse are the third bustype type, which may require additional definition operations to define them.
  • bustype is the member data of the system describing the input device, which belongs to the basic knowledge of the relevant knowledge system in the industry. Its declaration is mainly executed on the device driver. Take the touch screen gslX680 as an example:
  • BUS_MAINDISPLAY is used to declare the main screen
  • BUS_EXTERNALDISPLAY is used to declare the secondary screen
  • BUS_DUALSCREENMOUSE is used to declare the mouse peripherals in the dual-screen scenario.
  • the gslX680 touch device is the main screen input device.
  • the system input layer EventHub obtains the input device information, adds the defined private bustype to the isExternalDeviceLocked function to determine the primary and secondary devices, and adds the type identification of peripherals such as the mouse; among them, the acquisition of the input device information mainly depends on the framework The original support of the system, the system bottom driver will create the corresponding driver device node on the fixed directory node (/dev/input/) by default, and the system layer will read the node in the specific directory through the ioctl method (provided by the kernel The general way to operate the drive device node) read the corresponding node information to obtain the corresponding bustype:
  • the isExternalDeviceLocked function is obtained by combing the original framework process of the system.
  • the original implementation of this method is mainly to determine whether the corresponding device is an external device by judging the bustype. In this embodiment, it is mainly used to control the input device
  • the bustype judges and adds the identification of the corresponding device type to it, which is used to distinguish these types of custom types at the system framework layer:
  • the event structure of the input module of the system mainly includes the InputEvent structure of the native and Java layers, and the InputDeviceInfo structure of the input layer.
  • the displayId information is added, and the InputTransport event delivery class is modified.
  • the input device that will generate the event in the event transmission process The displayId information is packaged and reported.
  • the displayId information is used to identify whether the event is bound to the main screen display device or the secondary screen display device, and it is bound to the information describing the specific input device in the original system. Its function is to identify that the reported event message belongs to On which specific display device. Its acquisition is mainly based on several aspects:
  • the device reporting the event is of another type, its value is based on user configuration and defaults to the main screen device number.
  • the user configuration is based on the user's operation on the interface (selecting the main screen or the secondary screen), passing a target device number value to the input device information maintained by the system framework.
  • the original system framework does not support the transmission of the display device ID number, that is, displayId.
  • displayId In order to upload the displayId number of the underlying event to the application layer, we need to make changes to the original framework and add a displayId that supports displayId. Pass it so that you can know the source of the event and perform differentiated operations.
  • the key code of the modification is:
  • the motion will eventually be reflected in the MotionEvent event description data on the application side and provided to the application for processing.
  • S103 Monitor the newly added event information of the underlying device, and perform a pop-up prompt when it is judged to be a peripheral input device, so that the peripheral is configured as the peripheral input device of the display screen, and the peripheral configuration is updated to the system synchronously In the input layer.
  • step S103 add the configuration module of the peripheral on the display interface, monitor the new event of the underlying device, and display a pop-up prompt when it is judged to be a peripheral such as a mouse, allowing the user to configure it as a peripheral of the primary or secondary screen Input the device, and update the configuration to the input module synchronously.
  • a peripheral such as a mouse
  • the configuration method is mainly to provide a user selection interface, and according to the user's selection, call the system service interface to transfer the configuration value to the input module of the system to the corresponding input device (ie peripheral).
  • the key code is:
  • InputReader.cpp adds the following methods to provide external program calls, and the interface finally calls the following methods through system services:
  • the new method in InputReader is used to traverse the existing devices in the system and find the id value of the peripheral id to be configured.
  • the system After receiving the event reported by the input device of the secondary display screen and triggering the secondary display screen to start a new application, the system enters the different display mode, and at the same time updates the current different display mode to the system input layer.
  • the default initial state of the system is the same display state, that is, the display contents of the two display screens are kept consistent in real time.
  • the definition of different display mode is that the two display screens show different APP programs.
  • the trigger method for entering the different display mode is that the input device of the secondary screen reports an event and triggers the launch of a new application on the secondary screen (the effect is equivalent to performing a mouse operation on a separate device to execute an application).
  • the input device bound to the secondary screen reports the event, click to start application A.
  • the event is transformed through the input layer and reported with the displayId of the secondary screen.
  • the Launcher APP processes the new application B according to the displayId information and displays it on the secondary screen, and the system enters the different display mode. At the same time, update the current same-different display mode to the system input layer.
  • step S105 after entering the different display mode, the input device of the main screen will report the event, which will also carry the displayId information of the main screen, which will be processed by the Launcher APP. If the operation is to click the application, it will be activated and displayed to the displayId according to the displayId information. In the main screen.
  • Launcher APP mainly refers to the Home interface, that is, the interface that the user sees after turning on the computer, which is equivalent to the desktop of the computer. Its role is to provide users with all the applications installed on the machine to view and operate. The way to start the specific application to the corresponding screen is mainly through the following key codes:
  • step 4 Click on the application, the specific display device information is carried when the event is reported (step 4), and the information will be saved to the new member data mDisplayId of the View class;
  • Launcher APP executes the acquisition of displayId when launching the application.
  • This method is a newly-added View class method, which is used to obtain the judgment when launching the application on the Launcher APP side:
  • the service program of the system receives the information from the Launcher APP, checks the flag flag, and judges FLAG_ACTIVITY_EXTERNAL_DISPLAY to start the corresponding application to the secondary screen to achieve the different display effect:
  • the getContainerFromExtDisplay method mainly relies on the native system's support for different display functions. Its core code is:
  • step S106 in the different display mode, when the input device bound to the secondary screen reports an event, the judgment will be made based on the same different display mode state saved in the input module layer, and the different display mode event does not need to be processed by the event conversion module. , Directly report to the foreground window with the same displayId for APP processing.
  • the multi-input device interaction method for dual-screen different displays of the Android system further includes:
  • the different display mode when the application program displayed on the secondary display is closed, the different display mode is actively exited, the system enters the same display mode, and the state information of the same display mode is synchronized to the system input layer.
  • closing the application displayed on the secondary screen will actively exit the different display mode, enter the same display mode, and synchronize the mode state to the input module layer.
  • the multi-input device interaction method for dual-screen different displays of the Android system further includes:
  • the events reported by the secondary display screen can be transformed into the coordinate system of the primary display screen in the same display scene.
  • the coordinate system conversion module is added to the input layer of the system to convert the events reported by the secondary display screen into the coordinate system of the primary display screen in the same display scene, specifically:
  • a coordinate system conversion module is added to convert events reported by the secondary screen touch or a peripheral device into the coordinate system of the main screen in the same display scenario.
  • the main purpose of the transformation of the coordinate system is to realize that when the contents displayed on the two screens are the same, the operating position reported by the secondary screen can be distributed to the application in the size of the main screen according to the relative position. Because when the two screens display the same content, the application only loads image resources according to the size and configuration information of the main screen, and determines the display interval of each upper-level application control.
  • Figure 3 shows the working steps of the coordinate system conversion module. After the event is reported, it is determined whether it comes from the main screen. If it is, the application will be distributed directly. If not, the display coordinates obtained by the secondary display screen will be converted into the corresponding according to the coordinate system conversion formula. The display coordinates of the main display.
  • the conversion principle is to multiply the current coordinate system by the width ratio and length ratio of the two display screens.
  • the multi-input device interaction method for dual-screen different displays of the Android system further includes:
  • the custom peripheral input device is the third bustype type, which is used to define its additional definition operations.
  • the device type identifiers corresponding to the two customized bustype types are added to the first function, specifically:
  • the isExternalDeviceLocked function is obtained by combing the original framework process of the system, the bustype type of the input device is judged according to the isExternalDeviceLocked function, and the device type identification corresponding to the input device is added, so that the custom-defined device can be distinguished in the system framework layer. bustpye type.
  • the binding identification information of the event is added to the event structure, specifically:
  • the corresponding application is started and displayed on the main display screen In, also includes:
  • This embodiment provides a multi-input device interaction method for dual-screen different displays of the Android system, including: adapting two display screens through the system driver layer, and customizing two bustype types for the main display and the sub-display After obtaining the input device information through the system input layer, add the device type identification corresponding to the two customized bustype types in the first function, and add the binding identification information of the event in the event structure; monitor the underlying device When it is judged to be a peripheral input device, a pop-up prompt will be displayed, so that the peripheral is configured as a peripheral input device of the display screen, and the peripheral configuration is updated to the system input layer simultaneously; After receiving the event reported by the input device of the secondary display and triggering the secondary display to start a new application, the system enters the different display mode, and at the same time updates the current different display mode to the system input layer; when the input of the main display is received When the device reports event information, after making judgments and event conversion processing based on the event information, the corresponding application is started and displayed on the main display screen;
  • the invention can support two embedded devices that display touch screens to enter and exit the different display mode by operating the secondary screen to start the application, and supports that in the different display mode, the applications of the two display screens can normally respond to the input devices bound to the corresponding display screens.
  • it allows the user to configure the mouse, keyboard and other external devices, bind the primary and secondary screens and the applications displayed on them, which can not only meet the mode that the secondary screen is controlled by the primary screen application, but also support the display on the secondary screen. Operate, enter or exit the dual-screen different display mode more quickly, and improve the autonomy of the operation of the secondary screen.
  • An embodiment of the present invention provides a multi-input device interaction apparatus for dual-screen display of the Android system, which is characterized in that it includes a processor, a memory, and is stored in the memory and configured to be used by the processor.
  • the executed computer program when the processor executes the computer program, the above-mentioned multi-input device interaction method for dual-screen display of the Android system is implemented.
  • Another embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium includes a stored computer program, wherein, when the computer program is running, the device where the computer-readable storage medium is located is controlled Perform the above-mentioned multi-input device interaction method for dual-screen different display of Android system
  • the disclosed technical content can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the modules may be a logical function division.
  • multiple modules or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, units or modules, and may be in electrical or other forms.
  • modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple modules. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional modules in the various embodiments of the present invention may be integrated into one processing module, or each module may exist alone physically, or two or more modules may be integrated into one module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or software function modules.
  • the program can be stored in a computer readable storage medium, and the program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments.
  • the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Digital Computer Display Output (AREA)

Abstract

一种用于Android系统双屏异显的多输入设备交互方法、装置及介质,所述方法包括:通过系统驱动层适配两个显示屏,定制bustype类型进行主显示屏和副显示屏的区分;在通过系统输入层获取输入设备信息后,在第一函数中添加两种定制bustype类型对应的设备类型标识,并在事件结构体中添加事件绑定标识信息;监听底层设备的新增事件信息,在判断为外设输入设备时进行弹窗提示,并同步更新该外设配置至系统输入层中;系统进入异显模式后同时更新当前的同异显模式至系统输入层中;当接收到显示屏的输入设备上报事件时进行事件判断,启动对应的应用并显示至对应的显示屏中。本方法能够在副屏受主屏应用控制的同时,支持在副屏显示上进行自主控制。

Description

用于Android系统双屏异显的多输入设备交互方法、装置及介质 技术领域
本发明涉及嵌入式设备技术领域,具体涉及一种用于Android系统双屏异显的多输入设备交互方法、装置及介质。
背景技术
随着科技的不断发展,多屏娱乐和多屏办公越来越普及,多屏的应用场景也越来越多。例如,用户可将办公室或家庭中的多个显示屏幕,例如电脑屏幕、手机屏幕、电视机屏幕或投影仪屏幕等,通过局域网实现多个显示设备之间的相互的无线连接,而双屏异显也是其中一种连接方式,通过一台设备同时接入两个显示设备,使得两个显示设备分别能够显示不同的交互界面。
但是,在对现有技术的研究与实践的过程中,本发明的发明人发现,现有技术中的原生系统并未对双屏多输入设备的异显场景进行完整的支持,缺乏统一的标准;并且现有的双屏异显的场景主要用于在主屏负责显示和操作,副屏负责展示的双屏场景,副屏设备受主屏设备的模式控制,副屏不具备自主性,其内容为主屏设备投屏显示内容的其中一部分,无法做到完全自主控制和操作。
发明内容
本发明实施例所要解决的技术问题在于,一种用于Android系统双屏异显的多输入设备交互方法、装置及介质,,能够在副屏受主屏应用控制的同时,支持在副屏显示上进行自主控制。
为解决上述问题,本发明的一个实施例提供了一种用于Android系统双屏异显的多输入设备交互方法,至少包括如下步骤:
通过系统驱动层适配两个显示屏,并通过定制两种bustype类型进行主显示 屏和副显示屏的区分;
在通过系统输入层获取输入设备信息后,在第一函数中添加所述两种定制bustype类型对应的设备类型标识,并在事件结构体中添加事件的绑定标识信息;
监听底层设备的新增事件信息,在判断为外设输入设备时进行弹窗提示,以使将所述外设配置为显示屏的外设输入设备,并同步更新该外设配置至系统输入层中;
在接收到副显示屏的输入设备上报事件并触发副显示屏启动新应用程序后,系统进入异显模式,同时更新当前的异显模式至系统输入层中;
当接收到所述主显示屏的输入设备上报事件信息时,根据所述事件信息进行判断和事件转换处理后,启动对应的应用并显示至所述主显示屏中;
当接收到所述副显示屏的输入设备上报事件信息时,根据所述系统输入层保存的同异显模式状态进行判断,启动对应的应用并显示至所述副显示屏中。
进一步的,所述用于Android系统双屏异显的多输入设备交互方法,还包括:
在异显模式下,当关闭副显示屏显示的应用程序时,主动退出异显模式,系统进入同显模式,并同步同显模式状态信息至系统输入层。
进一步的,所述用于Android系统双屏异显的多输入设备交互方法,还包括:
通过在系统输入层中添加坐标系转化模块,以使在同显场景下将副显示屏上报的事件转化为主显示屏的坐标系。
进一步的,所述用于Android系统双屏异显的多输入设备交互方法,还包括:
定制外设输入设备为第三种bustype类型,用于定义其额外的定义操作。
进一步的,所述通过在系统输入层中添加坐标系转化模块,以使在同显场景下将副显示屏上报的事件转化为主显示屏的坐标系,具体为:
当获取外设输入设备上报事件信息时,判断是否该事件信息是否来自主显示屏;
若是,则直接派发对应的应用程序至主显示屏,以使启动所述应用程序并显示至主显示屏;
若否,则根据坐标系转化公式将副显示屏获取的显示坐标转化为对应的主 显示屏的显示坐标。
进一步的,所述在通过系统输入层获取输入设备信息后,在第一函数中添加所述两种定制bustype类型对应的设备类型标识,具体为:
通过系统底层驱动在固定的目录节点上创建对应的驱动设备节点,系统层通过读取该特定目录下的节点,并通过ioctl方式读取对应节点信息获取对应的bustype类型;
通过对系统的原有框架流程梳理获取得到isExternalDeviceLocked函数,根据所述isExternalDeviceLocked函数对输入设备的bustype类型进行判断,并添加对输入设备对应的设备类型标识,以使在系统框架层中区分自定义的bustpye类型。
进一步的,所述事件结构体中添加事件的绑定标识信息,具体为:
在native和Java层的InputEvent结构体以及input层的InputDeviceInfo结构体中添加displayId信息,同时修改InputTransport事件传递类信息,并将产生事件的输入设备displayId信息打包上报。
进一步的,所述当接收到所述主显示屏的输入设备上报事件信息时,根据所述事件信息进行判断和事件转换处理后,启动对应的应用并显示至所述主显示屏中,还包括:
在接收到所述主显示屏的输入设备上报事件信息时,提取所述事件信息中输入设备的displayId信息,且将该displayId信息保存至View类的新建成员数据mDisplayId上;
通过Launcher APP启动应用,在获取displayId信息后发送至系统的服务程序;
根据接收所述Launcher APP发送的displayId信息,检查flag标志,判断是否需要启动相关应用至副显示屏。
本发明的一个实施例提供了一种用于Android系统双屏异显的多输入设备交互装置,其特征在于,包括处理器、存储器以及存储在所述存储器中且被配置为由所述处理器执行的计算机程序,所述处理器执行所述计算机程序时实现 如上述的用于Android系统双屏异显的多输入设备交互方法。
本发明的一个实施例还提供了一种计算机可读存储介质,其特征在于,所述计算机可读存储介质包括存储的计算机程序,其中,在所述计算机程序运行时控制所述计算机可读存储介质所在设备执行如上述的用于Android系统双屏异显的多输入设备交互方法。
实施本发明实施例,具有如下有益效果:
本发明实施例提供的一种用于Android系统双屏异显的多输入设备交互方法、装置及介质,所述方法包括:通过系统驱动层适配两个显示屏,并通过定制两种bustype类型进行主显示屏和副显示屏的区分;在通过系统输入层获取输入设备信息后,在第一函数中添加所述两种定制bustype类型对应的设备类型标识,并在事件结构体中添加事件的绑定标识信息;监听底层设备的新增事件信息,在判断为外设输入设备时进行弹窗提示,以使将所述外设配置为显示屏的外设输入设备,并同步更新该外设配置至系统输入层中;在接收到副显示屏的输入设备上报事件并触发副显示屏启动新应用程序后,系统进入异显模式,同时更新当前的异显模式至系统输入层中;当接收到所述主显示屏的输入设备上报事件信息时,根据所述事件信息进行判断和事件转换处理后,启动对应的应用并显示至所述主显示屏中;当接收到所述副显示屏的输入设备上报事件信息时,根据所述系统输入层保存的同异显模式状态进行判断,启动对应的应用并显示至所述副显示屏中。本发明能够支持两个显示触摸屏的嵌入式设备通过操作副屏启动应用进入和退出异显模式,支持在异显模式下,两个显示屏的应用均能正常响应对应显示屏绑定的输入设备的事件信息,同时允许用户对鼠标、键盘等外部设备进行配置、绑定主副屏以及其上显示的应用,既能够满足副屏受主屏应用控制的模式,也同时支持在副屏显示上进行操作,更快速的进入或退出双屏异显模式,提高副屏的操作的自主性。
附图说明
图1为本发明实施例提供的一种用于Android系统双屏异显的多输入设备交互方法的流程示意图;
图2为本发明实施例提供的实施用于Android系统双屏异显的多输入设备交互方法的系统框架图的流程示意图;
图3为本发明实施例提供的坐标系转化模块的工作流程示意图。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
首先介绍本发明可以提供的应用场景,如实现双屏异显的多输入设备交互。
本发明第一实施例:
请参阅图1-2。
如图1所示,本实施例提供的一种用于Android系统双屏异显的多输入设备交互方法,至少包括如下步骤:
S101、通过系统驱动层适配两个显示屏,并通过定制两种bustype类型进行主显示屏和副显示屏的区分。
具体的,如图2所示,对于步骤S101,驱动层适配两个触摸显示屏,适配其一为主触摸显示屏,其二为副触摸显示屏,通过定制bustype来区分主、副触摸显示屏,定制鼠标等外设为第三种bustype类型,用来定义其可能需要做额外的定义操作。
需要说明的是,申明为两个触摸显示屏只是为了方便对多输入设备的场景进行说明,实际情况中本方案并不需要两个触摸显示屏,换成其他显示屏也同样适用。
其中bustype是系统描述输入设备的成员数据,属于行业内具备相关知识体 系的基础知识,其申明主要在设备的驱动程序上执行,以触摸屏gslX680为例:
A.在include/uapi/linux/input.h文件中添加相应的BUS类型:
#define BUS_MAINDISPLAY     0x3A
#define BUS_EXTERNALDISPLAY     0x3B
#define BUS_DUALSCREENMOUSE     0x3C
如上定义BUS_MAINDISPLAY用于申明主屏,BUS_EXTERNALDISPLAY用于申明副屏,BUS_DUALSCREENMOUSE用于申明双屏场景下的鼠标外设。
B.在gslX680的驱动程序中进行申明配置,文件为:drivers/input/touchscreen/rockchip_gslX680.c
input_device->id.bustype=BUS_MAINDISPLAY;
如上定义了gslX680触摸设备为主屏输入设备。
S102、在通过系统输入层获取输入设备信息后,在第一函数中添加所述两种定制bustype类型对应的设备类型标识,并在事件结构体中添加事件的绑定标识信息。
具体的,对于步骤S102,系统输入层EventHub获取输入设备信息,在isExternalDeviceLocked函数中添加定义的私有bustype判断主副设备,同时添加鼠标等外设的类型识别;其中,获取输入设备信息主要依赖于框架的原有支持,系统底层驱动默认会在固定的目录节点(/dev/input/)上创建对应的驱动设备节点,系统层会通过读取该特定目录下的节点,通过ioctl方式(kernel提供的操作驱动设备节点的通用方式)读取对应节点信息获取对应的bustype:
Figure PCTCN2020125612-appb-000001
Figure PCTCN2020125612-appb-000002
isExternalDeviceLocked函数是通过对系统的原有框架流程梳理获取到的,该方法原有的实现方式主要是通过判断bustype来决定对应设备是否为外部设备,在本实施例中主要是用来对输入设备的bustype进行判断,为其添加对应设备类型的标识,用于在系统框架层区分这几类自定义类型:
Figure PCTCN2020125612-appb-000003
而针对系统input模块的事件结构体,主要包括native和Java层的InputEvent结构体、input层的InputDeviceInfo结构体,添加displayId信息,同时修改InputTransport事件传递类,在事件传输流程上将产生事件的输入设备displayId信息打包上报。
其中,displayId信息是用来标识事件绑定的是主屏显示设备或者副屏显示设备,并且其绑定到原有系统中描述具体输入设备的信息上,其作用就是标识了上报的事件消息是归属于哪个具体的显示设备上。其获取主要是依据几个方面:
A.若上报事件的设备为INPUT_DEVICE_TYPE_MAINDISPLAY,则其值为主屏设备号;
B.若上报事件的设备为INPUT_DEVICE_TYPE_EXTERNALDISPLAY,则其值为副屏设备号;
C.若上报事件的设备为其他类型,则其值根据用户配置,默认为主屏设备号。其中用户配置是根据用户在界面上的操作(选择主屏或副屏),传递一个目标设备号数值到系统框架维护的输入设备信息上。
InputTransport事件传递类,原有系统框架并不支持显示设备ID号即displayId的传递,为了能将底层事件所属的displayId号同样上传至应用层,因此我们需要对原有框架做改动,添加支持displayId的传递,以便能够知道事件的来源,并进行区分操作。修改的关键代码为:
InputTransport.cpp中publishMotionEvent方法新增displayId的传递:
status_t InputPublisher::publishMotionEvent(…int32_t displayId,…){
msg.body.motion.displayId=displayId;
}
其中motion最终将体现到应用程序端的MotionEvent事件描述数据当中提供给应用处理。
S103、监听底层设备的新增事件信息,在判断为外设输入设备时进行弹窗提示,以使将所述外设配置为显示屏的外设输入设备,并同步更新该外设配置至系统输入层中。
具体的,对于步骤S103,在显示界面上添加外设的配置模块,监听底层设备新增事件,判断为鼠标等外设时进行弹窗提示,允许用户将其配置为主屏或者副屏的外设输入设备,并同步更新该配置到input模块中。
配置方式主要是通过提供用户选择界面,并根据用户的选择情况,调用系统服务接口传递该配置值到系统的input模块当中给对应的input设备(即外设),关键代码为:
InputReader.cpp新增如下方法提供外部程序调用,界面最终通过系统的服务调用到如下方法:
Figure PCTCN2020125612-appb-000004
Figure PCTCN2020125612-appb-000005
InputReader中新增方法用来遍历系统中已存在的设备,并查找id值为要配置的外设id。
void InputDevice::setDisplayConfig(size_t displayId){
    mTargetDisplayId=displayId;
}
将该配置的目标displayId设置到对应的InputDevice对象数据中。
S104、在接收到副显示屏的输入设备上报事件并触发副显示屏启动新应用程序后,系统进入异显模式,同时更新当前的异显模式至系统输入层中。
具体的,对于步骤S104,系统默认初始状态为同显状态,即,两个显示屏显示内容实时保持一致。异显模式的定义为两个显示屏显示内容分别为不同的APP程序。进入异显模式的触发方式为副屏的输入设备上报事件并触发在副屏启动新应用(其效果等同于在单独设备上进行鼠标操作执行某一应用)。
在同显模式情况下,副屏绑定的输入设备上报事件,点击启动应用A。事件经由输入层的转化,携带副屏的displayId上报,由Launcher APP处理根据displayId信息将新应用B启动并显示到副屏当中,系统进入异显模式。同时,更新当前的同异显模式到系统输入层。
S105、当接收到所述主显示屏的输入设备上报事件信息时,根据所述事件信息进行判断和事件转换处理后,启动对应的应用并显示至所述主显示屏中。
具体的,对于步骤S105,进入异显模式后,主屏的输入设备上报事件,也将携带主屏的displayId信息,由Launcher APP处理,若操作为点击应用,则根据displayId信息,将其启动、显示到主屏当中。
其中,Launcher APP主要指Home界面,即用户开机后看到的界面,等同 于电脑的桌面。其作用是提供本机安装的所有应用给用户查看和操作。其启动具体应用到相应的屏幕中的方式主要通过如下关键代码:
A.点击应用,事件上报时携带了具体的显示设备信息(步骤4),且该信息将保存到View类的新建成员数据mDisplayId上;
B.Launcher APP启动应用时,执行displayId的获取,该方法为新增的View类方法,用来在Launcher APP端启动应用时进行获取判断:
Figure PCTCN2020125612-appb-000006
Launcher.java的startActivitySafely方法:
Figure PCTCN2020125612-appb-000007
startActivity(intent,optsBundle);
C.系统的服务程序通过接收Launcher APP传递来的信息,检查flag标志,判断FLAG_ACTIVITY_EXTERNAL_DISPLAY来启动到相应应用到副屏,达到异显效果:
ActivityStarter.java的startActivityMayWait方法:
Figure PCTCN2020125612-appb-000008
其中getContainerFromExtDisplay方法主要依赖原生系统对异显功能的支持 实现,其核心代码为:
Figure PCTCN2020125612-appb-000009
S106、当接收到所述副显示屏的输入设备上报事件信息时,根据所述系统输入层保存的同异显模式状态进行判断,启动对应的应用并显示至所述副显示屏中。
具体的,对于步骤S106,在异显模式下,副屏绑定的输入设备上报事件时,将依据input模块层保存的同异显模式状态进行判断,异显模式事件不需要经过事件转化模块处理,直接上报到相同displayId的前台窗口上给APP进行处理。
在优选的实施例中,所述用于Android系统双屏异显的多输入设备交互方法,还包括:
在异显模式下,当关闭副显示屏显示的应用程序时,主动退出异显模式,系统进入同显模式,并同步同显模式状态信息至系统输入层。
具体的,在异显模式下,关闭副屏显示的应用,将主动退出异显模式,进入同显模式,并同步模式状态到input模块层。
在优选的实施例中,所述用于Android系统双屏异显的多输入设备交互方法,还包括:
通过在系统输入层中添加坐标系转化模块,以使在同显场景下将副显示屏上报的事件转化为主显示屏的坐标系。
在优选的实施例中,所述通过在系统输入层中添加坐标系转化模块,以使在同显场景下将副显示屏上报的事件转化为主显示屏的坐标系,具体为:
当获取外设输入设备上报事件信息时,判断是否该事件信息是否来自主显示屏;
若是,则直接派发对应的应用程序至主显示屏,以使启动所述应用程序并显示至主显示屏;
若否,则根据坐标系转化公式将副显示屏获取的显示坐标转化为对应的主显示屏的显示坐标。
具体的,在系统的input模块中,添加坐标系转化模块,用于在同显场景下将副屏触摸或外设设备上报的事件转化为主屏的坐标系。
坐标系的转化主要目的是为了实现在两屏显示内容一致时,副屏上报的操作位置能够根据相对位置派发给按主屏大小布局的应用程序。因为两屏显示内容一致时,应用程序只按主屏的大小和配置信息来加载图片资源、决定每个上层应用控件的显示区间。如图3所示的坐标系转化模块的工作步骤,事件上报后判断是否来自主屏,若是则直接派发应用程序,若否,则按照坐标系转化公式将副显示屏获取的显示坐标转化为对应的主显示屏的显示坐标。其转化原理为将当前坐标系乘以两个显示屏的宽度比例以及长度比例,具体公式为:dx=cx*mw/ew,dy=cy*mh/eh;其中,dx为要要转化成对应的主屏的x坐标位置;cx为当前副屏获取到的x坐标位置;mw为主屏的宽;ew为副屏的宽;dy为要要转化成对应的主屏的y坐标位置;cy为当前副屏获取到的y坐标位置;mh为主屏的长;eh为副屏的长。
在优选的实施例中,所述用于Android系统双屏异显的多输入设备交互方法,还包括:
定制外设输入设备为第三种bustype类型,用于定义其额外的定义操作。
在优选的实施例中,所述在通过系统输入层获取输入设备信息后,在第一函数中添加所述两种定制bustype类型对应的设备类型标识,具体为:
通过系统底层驱动在固定的目录节点上创建对应的驱动设备节点,系统层通过读取该特定目录下的节点,并通过ioctl方式读取对应节点信息获取对应的bustype类型;
通过对系统的原有框架流程梳理获取得到isExternalDeviceLocked函数,根据所述isExternalDeviceLocked函数对输入设备的bustype类型进行判断,并添加对输入设备对应的设备类型标识,以使在系统框架层中区分自定义的bustpye类型。
在优选的实施例中,所述事件结构体中添加事件的绑定标识信息,具体为:
在native和Java层的InputEvent结构体以及input层的InputDeviceInfo结构体中添加displayId信息,同时修改InputTransport事件传递类信息,并将产生事件的输入设备displayId信息打包上报。
在优选的实施例中,所述当接收到所述主显示屏的输入设备上报事件信息时,根据所述事件信息进行判断和事件转换处理后,启动对应的应用并显示至所述主显示屏中,还包括:
在接收到所述主显示屏的输入设备上报事件信息时,提取所述事件信息中输入设备的displayId信息,且将该displayId信息保存至View类的新建成员数据mDisplayId上;
通过Launcher APP启动应用,在获取displayId信息后发送至系统的服务程序;
根据接收所述Launcher APP发送的displayId信息,检查flag标志,判断是否需要启动相关应用至副显示屏。
本实施例提供的一种用于Android系统双屏异显的多输入设备交互方法,包括:通过系统驱动层适配两个显示屏,并通过定制两种bustype类型进行主显示屏和副显示屏的区分;在通过系统输入层获取输入设备信息后,在第一函数中添加所述两种定制bustype类型对应的设备类型标识,并在事件结构体中添加事件的绑定标识信息;监听底层设备的新增事件信息,在判断为外设输入设备时进行弹窗提示,以使将所述外设配置为显示屏的外设输入设备,并同步更新该外设配置至系统输入层中;在接收到副显示屏的输入设备上报事件并触发副显示屏启动新应用程序后,系统进入异显模式,同时更新当前的异显模式至系统输入层中;当接收到所述主显示屏的输入设备上报事件信息时,根据所述事件信息进行判断和事件转换处理后,启动对应的应用并显示至所述主显示屏中;当接收到所述副显示屏的输入设备上报事件信息时,根据所述系统输入层保存的同异显模式状态进行判断,启动对应的应用并显示至所述副显示屏中。本发明能够支持两个显示触摸屏的嵌入式设备通过操作副屏启动应用进入和退出异 显模式,支持在异显模式下,两个显示屏的应用均能正常响应对应显示屏绑定的输入设备的事件信息,同时允许用户对鼠标、键盘等外部设备进行配置、绑定主副屏以及其上显示的应用,既能够满足副屏受主屏应用控制的模式,也同时支持在副屏显示上进行操作,更快速的进入或退出双屏异显模式,提高副屏的操作的自主性。
本发明的一个实施例提供了一种用于Android系统双屏异显的多输入设备交互装置,其特征在于,包括处理器、存储器以及存储在所述存储器中且被配置为由所述处理器执行的计算机程序,所述处理器执行所述计算机程序时实现如上述的用于Android系统双屏异显的多输入设备交互方法。
本发明的另一个实施例还提供了一种计算机可读存储介质,所述计算机可读存储介质包括存储的计算机程序,其中,在所述计算机程序运行时控制所述计算机可读存储介质所在设备执行如上述的用于Android系统双屏异显的多输入设备交互方法
在本发明的上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。
在本申请所提供的几个实施例中,应该理解到,所揭露的技术内容,可通过其它的方式实现。其中,以上所描述的装置实施例仅仅是示意性的,例如所述模块的划分,可以为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个模块或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,单元或模块的间接耦合或通信连接,可以是电性或其它的形式。
所述作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理模块,即可以位于一个地方,或者也可以分布到多个模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。
另外,在本发明各个实施例中的各功能模块可以集成在一个处理模块中, 也可以是各个模块单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。
以上所述是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以做出若干改进和变形,这些改进和变形也视为本发明的保护范围。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。

Claims (10)

  1. 一种用于Android系统双屏异显的多输入设备交互方法,其特征在于,至少包括如下步骤:
    通过系统驱动层适配两个显示屏,并通过定制两种bustype类型进行主显示屏和副显示屏的区分;
    在通过系统输入层获取输入设备信息后,在第一函数中添加所述两种定制bustype类型对应的设备类型标识,并在事件结构体中添加事件的绑定标识信息;
    监听底层设备的新增事件信息,在判断为外设输入设备时进行弹窗提示,以使将所述外设配置为显示屏的外设输入设备,并同步更新该外设配置至系统输入层中;
    在接收到副显示屏的输入设备上报事件并触发副显示屏启动新应用程序后,系统进入异显模式,同时更新当前的异显模式至系统输入层中;
    当接收到所述主显示屏的输入设备上报事件信息时,根据所述事件信息进行判断和事件转换处理后,启动对应的应用并显示至所述主显示屏中;
    当接收到所述副显示屏的输入设备上报事件信息时,根据所述系统输入层保存的同异显模式状态进行判断,启动对应的应用并显示至所述副显示屏中。
  2. 根据权利要求1所述的用于Android系统双屏异显的多输入设备交互方法,其特征在于,还包括:
    在异显模式下,当关闭副显示屏显示的应用程序时,主动退出异显模式,系统进入同显模式,并同步同显模式状态信息至系统输入层。
  3. 根据权利要求1所述的用于Android系统双屏异显的多输入设备交互方法,其特征在于,还包括:
    通过在系统输入层中添加坐标系转化模块,以使在同显场景下将副显示屏上报的事件转化为主显示屏的坐标系。
  4. 根据权利要求1所述的用于Android系统双屏异显的多输入设备交互方法,其特征在于,还包括:
    定制外设输入设备为第三种bustype类型,用于定义其额外的定义操作。
  5. 根据权利要求3所述的用于Android系统双屏异显的多输入设备交互方法,其特征在于,所述通过在系统输入层中添加坐标系转化模块,以使在同显场景下将副显示屏上报的事件转化为主显示屏的坐标系,具体为:
    当获取外设输入设备上报事件信息时,判断是否该事件信息是否来自主显示屏;
    若是,则直接派发对应的应用程序至主显示屏,以使启动所述应用程序并显示至主显示屏;
    若否,则根据坐标系转化公式将副显示屏获取的显示坐标转化为对应的主显示屏的显示坐标。
  6. 根据权利要求1所述的用于Android系统双屏异显的多输入设备交互方法,其特征在于,所述在通过系统输入层获取输入设备信息后,在第一函数中添加所述两种定制bustype类型对应的设备类型标识,具体为:
    通过系统底层驱动在固定的目录节点上创建对应的驱动设备节点,系统层通过读取该特定目录下的节点,并通过ioctl方式读取对应节点信息获取对应的bustype类型;
    通过对系统的原有框架流程梳理获取得到isExternalDeviceLocked函数,根据所述isExternalDeviceLocked函数对输入设备的bustype类型进行判断,并添加对输入设备对应的设备类型标识,以使在系统框架层中区分自定义的bustpye类型。
  7. 根据权利要求1所述的用于Android系统双屏异显的多输入设备交互方法,其特征在于,所述事件结构体中添加事件的绑定标识信息,具体为:
    在native和Java层的InputEvent结构体以及input层的InputDeviceInfo结构体中添加displayId信息,同时修改InputTransport事件传递类信息,并将产生事件的输入设备displayId信息打包上报。
  8. 根据权利要求1所述的用于Android系统双屏异显的多输入设备交互方法,其特征在于,所述当接收到所述主显示屏的输入设备上报事件信息时,根据所述事件信息进行判断和事件转换处理后,启动对应的应用并显示至所述主显示屏中,还包括:
    在接收到所述主显示屏的输入设备上报事件信息时,提取所述事件信息中输入设备的displayId信息,且将该displayId信息保存至View类的新建成员数据mDisplayId上;
    通过Launcher APP启动应用,在获取displayId信息后发送至系统的服务程序;
    根据接收所述Launcher APP发送的displayId信息,检查flag标志,判断是否需要启动相关应用至副显示屏。
  9. 一种用于Android系统双屏异显的多输入设备交互装置,其特征在于,包括处理器、存储器以及存储在所述存储器中且被配置为由所述处理器执行的计算机程序,所述处理器执行所述计算机程序时实现如权利要求1至8任一项所述的用于Android系统双屏异显的多输入设备交互方法。
  10. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质包括存储的计算机程序,其中,在所述计算机程序运行时控制所述计算机可读存储介质所在设备执行如权利要求1至8任一项所述的用于Android系统双屏异显的多输入设备交互方法。
PCT/CN2020/125612 2019-11-12 2020-10-31 用于Android系统双屏异显的多输入设备交互方法、装置及介质 WO2021093619A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911103654.6A CN110888615B (zh) 2019-11-12 2019-11-12 用于Android系统双屏异显的多输入设备交互方法、装置及介质
CN201911103654.6 2019-11-12

Publications (1)

Publication Number Publication Date
WO2021093619A1 true WO2021093619A1 (zh) 2021-05-20

Family

ID=69747316

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/125612 WO2021093619A1 (zh) 2019-11-12 2020-10-31 用于Android系统双屏异显的多输入设备交互方法、装置及介质

Country Status (2)

Country Link
CN (1) CN110888615B (zh)
WO (1) WO2021093619A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113589730A (zh) * 2021-07-30 2021-11-02 展讯半导体(成都)有限公司 基于xen的多系统的异显控制系统、方法及相关产品
CN114217763A (zh) * 2022-02-22 2022-03-22 麒麟软件有限公司 在Linux上兼容Android应用的窗口双屏协同显示方法
CN114442981A (zh) * 2022-01-26 2022-05-06 杭州联吉技术有限公司 一种显示管理方法、显示管理装置及管理设备
CN115016702A (zh) * 2021-09-10 2022-09-06 荣耀终端有限公司 扩展屏幕模式下选择应用程序显示屏幕的控制方法及系统

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110888615B (zh) * 2019-11-12 2021-12-21 厦门亿联网络技术股份有限公司 用于Android系统双屏异显的多输入设备交互方法、装置及介质
CN111596856B (zh) * 2020-05-06 2023-08-29 深圳市世纪创新显示电子有限公司 一种基于副屏触摸的一种笔迹书写方法、系统及存储介质
CN112004049B (zh) * 2020-08-18 2022-06-28 北京字节跳动网络技术有限公司 双屏异显方法、装置和电子设备
CN112099751A (zh) * 2020-09-25 2020-12-18 深圳市创维群欣安防科技股份有限公司 双屏异步显示处理方法、装置、双屏显示智能终端
CN112965618A (zh) * 2021-01-15 2021-06-15 聚融医疗科技(杭州)有限公司 一种多屏超声诊断系统多鼠标设备操作方法及系统
CN113760122A (zh) * 2021-07-21 2021-12-07 深圳市智微智能科技股份有限公司 双屏设备副屏触摸控制方法、系统、终端及存储介质
CN114095909A (zh) * 2021-11-15 2022-02-25 珠海读书郎软件科技有限公司 一种双屏电话手表投屏的方法、存储介质及设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105739758A (zh) * 2016-01-21 2016-07-06 广州市莱麦互联网科技有限公司 安卓设备的显示控制方法和装置
CN107368272A (zh) * 2017-06-30 2017-11-21 百富计算机技术(深圳)有限公司 一种双屏异触异显的方法、装置及计算机可读存储介质
CN110109638A (zh) * 2019-05-09 2019-08-09 深圳超多维科技有限公司 用于安卓终端的显示方法、装置和安卓终端
US20190268561A1 (en) * 2015-11-20 2019-08-29 Hattar Tanin LLC Dual-screen electronic devices
CN110888615A (zh) * 2019-11-12 2020-03-17 厦门亿联网络技术股份有限公司 用于Android系统双屏异显的多输入设备交互方法、装置及介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106250083A (zh) * 2016-07-31 2016-12-21 上海普览智能科技有限公司 双屏双控智能终端及实现方法
CN107463325A (zh) * 2017-07-12 2017-12-12 福州瑞芯微电子股份有限公司 一种支持多屏输入的显示方法和装置
CN108205430B (zh) * 2017-11-01 2023-04-18 中兴通讯股份有限公司 双屏移动终端、相应操控方法及存储介质
CN108228061B (zh) * 2017-12-29 2020-11-20 北京珠穆朗玛移动通信有限公司 基于双屏的信息显示方法、移动终端及存储介质
KR102513752B1 (ko) * 2018-04-11 2023-03-24 삼성전자 주식회사 전자 장치 및 전자 장치의 제어 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190268561A1 (en) * 2015-11-20 2019-08-29 Hattar Tanin LLC Dual-screen electronic devices
CN105739758A (zh) * 2016-01-21 2016-07-06 广州市莱麦互联网科技有限公司 安卓设备的显示控制方法和装置
CN107368272A (zh) * 2017-06-30 2017-11-21 百富计算机技术(深圳)有限公司 一种双屏异触异显的方法、装置及计算机可读存储介质
CN110109638A (zh) * 2019-05-09 2019-08-09 深圳超多维科技有限公司 用于安卓终端的显示方法、装置和安卓终端
CN110888615A (zh) * 2019-11-12 2020-03-17 厦门亿联网络技术股份有限公司 用于Android系统双屏异显的多输入设备交互方法、装置及介质

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113589730A (zh) * 2021-07-30 2021-11-02 展讯半导体(成都)有限公司 基于xen的多系统的异显控制系统、方法及相关产品
CN115016702A (zh) * 2021-09-10 2022-09-06 荣耀终端有限公司 扩展屏幕模式下选择应用程序显示屏幕的控制方法及系统
CN115016702B (zh) * 2021-09-10 2023-10-27 荣耀终端有限公司 扩展屏幕模式下选择应用程序显示屏幕的控制方法及系统
CN114442981A (zh) * 2022-01-26 2022-05-06 杭州联吉技术有限公司 一种显示管理方法、显示管理装置及管理设备
CN114442981B (zh) * 2022-01-26 2024-02-13 杭州联吉技术有限公司 一种显示管理方法、显示管理装置及管理设备
CN114217763A (zh) * 2022-02-22 2022-03-22 麒麟软件有限公司 在Linux上兼容Android应用的窗口双屏协同显示方法
CN114217763B (zh) * 2022-02-22 2022-05-20 麒麟软件有限公司 在Linux上兼容Android应用的窗口双屏协同显示方法

Also Published As

Publication number Publication date
CN110888615A (zh) 2020-03-17
CN110888615B (zh) 2021-12-21

Similar Documents

Publication Publication Date Title
WO2021093619A1 (zh) 用于Android系统双屏异显的多输入设备交互方法、装置及介质
CN109101352B (zh) 图像处理算法架构、算法调用方法、装置、存储介质及移动终端
US11644943B2 (en) Method for icon display, terminal, and storage medium
EP3285156B1 (en) Information processing method and terminal, and computer storage medium
US8015504B1 (en) System and method for communicating information over a network
JP6083244B2 (ja) リモートデスクトップセッションにおいて複数のマウス入力を提供する方法
WO2021136133A1 (zh) 一种应用程序切换方法及电子设备
CN111049935B (zh) 远程控制电子设备的系统及其电子设备
CN109308241B (zh) 监听应用程序启动流程方法、装置、终端设备和存储介质
CN110769048B (zh) 本地与远程虚拟桌面的无缝衔接方法及系统
US20240111473A1 (en) Distributed display method and terminal for application interface
TW201419114A (zh) 使用行動裝置之基本輸入輸出系統使用者介面控制
JP7100154B6 (ja) プロセッサコアのスケジューリング方法、装置、端末及び記憶媒体
CN106027631B (zh) 一种数据传输方法及装置
WO2019047183A1 (zh) 按键显示方法、装置及终端
EP3680765A1 (en) Navigation bar control method and device
CN113268212A (zh) 投屏方法、装置、存储介质及电子设备
US20140351833A1 (en) Multi-computing environment operating on a single native operating system
CN113448651B (zh) 一种应用单例功能的实现方法和装置
CN102364434A (zh) 一种整合Wine与Android鼠标输入的方法
US20240077998A1 (en) Application compatibility on a computing device
CN111988382B (zh) 一种跨终端进行应用界面交互的方法和系统
CN110543264B (zh) 基于分屏模式下应用交互的方法、设备和存储介质
CN112199124B (zh) 一种项目开启方法及装置、显示设备
CN111552537B (zh) 主题切换方法、装置、计算机设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20888610

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20888610

Country of ref document: EP

Kind code of ref document: A1