CN116841662A

CN116841662A - Split screen display method, split screen display device, electronic device, storage medium and program product

Info

Publication number: CN116841662A
Application number: CN202210300933.7A
Authority: CN
Inventors: 刘灵皓; 唐明刚; 寻亮
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2022-03-25
Filing date: 2022-03-25
Publication date: 2023-10-03
Also published as: WO2023179085A1

Abstract

The application relates to a split screen display method, a split screen display device, an electronic device, a storage medium and a program product. The method comprises the following steps: acquiring the component layout of a current display interface of a current running application of the electronic equipment; if the target component in the component layout is determined, confirming the current running application as a split-screen application corresponding to the split-screen mode; the target component comprises a component which needs to be displayed in a split screen interface of a split screen mode; and responding to the split screen mode operation, and performing split screen display on a target component of the split screen application in the split screen interface. The application has wide applicability, can be compatible with most of current applications, allows the components of the split-screen application to be freely displayed in the split-screen interface, and has flexible mechanism.

Description

Split screen display method, split screen display device, electronic device, storage medium and program product

Technical Field

The present application relates to the field of electronic devices, and in particular, to a split screen display method, a split screen display device, an electronic device, a storage medium, and a program product.

Background

With the development of technology, screens of various electronic devices are increasingly larger, and folding screen devices, wide screen devices and the like are continuously emerging; taking a folding screen device as an example, the folding screen device refers to an electronic device in which a screen is bendable and foldable. Folding screen devices are divided into an unfolded state and a folded state. In the folded state, the equipment is small in size, and the requirements of holding and carrying convenience of a user with one hand in daily life can be met. In the unfolded state, the device can obtain a larger display area, and can realize multi-task operation. Whereas a wide screen device, such as a tablet device, is similar to a folding screen device in an unfolded state.

Currently, for adapting a screen, an electronic device can provide an application split screen mode; however, the split screen mode of the traditional application has poor applicability, and affects the popularization of the mode.

Disclosure of Invention

In view of the foregoing, it is desirable to provide a split-screen display method, apparatus, electronic device, storage medium, and program product that can improve applicability.

In a first aspect, the present application provides a split-screen display method, applied to an electronic device, where the method includes:

acquiring the component layout of a current display interface of a current running application of the electronic equipment;

determining a target component in the component layout, wherein the target component comprises components required to be displayed in a split screen interface of a split screen mode of the electronic equipment;

in response to determining a target component in the component layout, determining the currently running application as a split-screen application in a split-screen mode;

and responding to the split screen mode operation, and performing split screen display on a target component of the split screen application in the split screen interface.

In one embodiment, the target component comprises a component in the split screen interface that needs to be migrated or copied from the current display interface to the split screen mode;

the step of performing split-screen display on the target component of the split-screen application in the split-screen interface in response to the split-screen mode operation comprises the following steps:

Obtaining layout information aiming at split screen application according to a target component;

and under the condition of operation in the split screen mode, carrying out split screen display on a target component of the split screen application in a split screen interface according to the layout information.

In one embodiment, the step of obtaining a component layout of a current display interface of a currently running application of the electronic device includes:

responding to a first operation acted on the electronic equipment, and acquiring the component layout of a current display interface of a current running application;

the step of determining the target component in the component layout comprises:

displaying a mark in the current display interface according to the layout of the components; marking a display area to which each component in the application running currently belongs;

in response to a second operation acting on the display area, a component corresponding to the display area acted on by the second operation is determined as a target component.

the step of determining the target component in the component layout comprises:

And determining the component with the preset identifier in the component layout as a target component.

In one embodiment, the layout information includes data for rendering the target component for display in the split screen interface;

the step of obtaining layout information for the split screen application based on the target component includes:

acquiring bottom layer data, and acquiring original layout parameters of the split-screen application from the bottom layer data;

and intercepting the original layout parameters according to the target component, and modifying the intercepted original layout parameters to obtain layout information.

In one embodiment, the underlying data includes data sent by a central processing unit CPU of the electronic device to a graphics processor GPU of the electronic device; the layout information includes the display size and display position of the target component in the corresponding split screen interface.

In one embodiment, the component layout includes a tree structure of components on an active Activity page corresponding to the current display interface.

In one embodiment, the split screen interface includes a display interface of another application in the electronic device other than the currently running application.

In one embodiment, the split screen interface includes more than one display interface, the method further comprising:

responding to the operation of a first component in any display interface acting on the split screen interface, and synchronously updating the display content of a second component in the corresponding display interface of the split screen interface; the first component is any component in the split-screen application; the second component is a component associated with the first component within the split-screen application.

In a second aspect, the present application further provides a split-screen display device, applied to an electronic device, where the device includes:

the component layout acquisition module is used for acquiring the component layout of the current display interface of the current running application of the electronic equipment;

the target component determining module is used for determining target components in the component layout, wherein the target components comprise components which need to be displayed in a split screen interface of a split screen mode of the electronic equipment;

the split-screen application determining module is used for responding to the target component in the component layout, and determining the currently running application as a split-screen application in a split-screen mode;

and the split screen display module is used for responding to the split screen mode operation and performing split screen display on a target component of the split screen application in the split screen interface.

In a third aspect, the present application further provides an electronic device, including a memory and a processor, where the memory stores a computer program, and the processor implements the steps of the split screen display method described above when executing the computer program.

In a fourth aspect, the present application also provides a computer readable storage medium having stored thereon a computer program which when executed by a processor implements the steps of the split screen display method described above.

In a fifth aspect, the present application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of the split screen display method described above.

According to the split screen display method, device, electronic equipment, storage medium and program product, the component layout of the current display interface of the current running application is obtained, and then the target component is determined, wherein the target component comprises components which need to be displayed in the split screen interface of the split screen mode, so that when the split screen mode is running, the split screen display of the components in the application is realized by re-layout of the split screen application after rendering the target component. The scheme provided by the embodiment of the application has wide applicability, can be compatible with most of current applications, allows the components of the split-screen application to be freely displayed in the split-screen interface, and has flexible mechanism.

Drawings

FIG. 1 is a schematic diagram of a folding screen mobile phone in different states according to an embodiment;

FIG. 2 is a diagram of a content adaptive dynamic layout in UI layout adjustment;

FIG. 3 is a diagram of a content scaling adaptive dynamic layout in UI layout adjustment;

FIG. 4 is a diagram of a lateral expansion fill layout in UI layout adjustment;

FIG. 5 is a schematic diagram of a split screen effect of a conventional application;

FIG. 6 is a flow chart of a split screen display method according to an embodiment;

FIG. 7 is a schematic diagram of a component layout of a tree architecture in one embodiment;

FIG. 8 is a schematic diagram of a target component being obtained by user selection in one embodiment;

FIG. 9 is a schematic diagram of a split screen display of an application internal component in one embodiment;

FIG. 10 is a schematic diagram illustrating an application of a split screen display method in one embodiment;

FIG. 11 is a block diagram of a split-screen display device in one embodiment;

fig. 12 is an internal structural diagram of an electronic device in one embodiment.

Detailed Description

In order that the application may be readily understood, a more complete description of the application will be rendered by reference to the appended drawings. Embodiments of the application are illustrated in the accompanying drawings. This application may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.

It will be understood that the terms first, second, etc. as used herein may be used to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another element. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," and/or the like, specify the presence of stated features, integers, steps, operations, elements, components, or groups thereof, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or groups thereof. Also, the term "and/or" as used in this specification includes any and all combinations of the associated listed items.

An Application program (App) according to an embodiment of the present application is simply an Application, which is a software program capable of implementing one or more specific functions. Typically, a plurality of applications may be installed in an electronic device. Such as an image capturing class application, an instant messaging class application, a live video class application, etc. The application mentioned below may be an application installed when the electronic device leaves the factory, or may be an application downloaded from a network or acquired by a user from other electronic devices during use of the electronic device.

It should be noted that, the split-screen display method provided by the embodiment of the present application may be applicable to any electronic device having a display screen, such as various personal computers, notebook computers, smart phones, tablet computers, devices of the internet of things (for example, smart speakers, smart televisions, smart air conditioners, smart vehicle devices, etc.), and portable wearable devices (for example, smart watches, smart bracelets, headsets, etc.), and the embodiment of the present application is not limited. The electronic device according to the embodiment of the present application may also be a foldable electronic device, such as a foldable mobile phone, a foldable ipad, etc., which is not limited in this application. The electronic device according to the embodiment of the present application may also be a wide screen device, for example, a tablet device, a scroll screen device, or the like, which may have a large screen, which is not limited in the present application; hereinafter, a folding screen mobile phone will be described as an example.

Referring to fig. 1, a schematic diagram of a folding screen mobile phone according to an embodiment of the present application is shown, where the folding screen mobile phone has a bending portion, so that the folding screen mobile phone is unfolded or folded to form an unfolded state and a folded state. As shown in the left view of fig. 1, the folding screen mobile phone is in a folding state, and the screen area is smaller; as shown in the right view of fig. 1, the folding screen mobile phone is in an unfolded state, and the screen area is large. The screen sizes of the folding screen mobile phone in different states are different, for this purpose, the OS (Operating System) and the APP need to adapt to the different screen sizes in the two states, which puts forward many requirements for mobile phone manufacturers and APP developers.

The currently commonly used adaptation scheme mainly comprises two types of UI (User Interface) layout adjustment and application split screen. UI layout adjustment is to adapt to screen size changes by adjusting interface element sizes, and the main layout strategies are content adaptive dynamic layout (as shown in fig. 2), content scaling adaptive dynamic layout (as shown in fig. 3), laterally extending fill layout (as shown in fig. 4), etc.

For application split screens, as shown in fig. 5, taking an Android (Android operating system) system as an example, at present, the application split screens take Activity as a basic unit, and take left and right window separation display, double window life cycle management, double window display mode and switching logic as cores, so as to realize a system side solution of the application split screens. The method comprises the steps of (1) separating left and right windows for display, expanding a display frame of an android based on the Activity of the android system, and realizing the independent separation display of the activities, so that each Activity of an application can be independently displayed at different positions of a screen. (2) The life cycle management of the Activity double window is to optimize and reform the life cycle of each instruction in the Activity, so that the life cycles of the two display windows are managed simultaneously, and the influence of the content on the other side when one side of the screen is operated is avoided. (3) The dual window display mode and switching logic may also allow for a reasonable spatial layout after the two items of content are completed.

However, the conventional application split screen mode has drawbacks in at least two aspects: (1) poor applicability, requiring APP to adapt; in order to realize the application split screen mode, the mobile phone manufacturer modifies the android frame and provides a corresponding interface for an APP developer, the developer needs to create a configuration file, set split screen rules and finally integrate on a special development IDE (Integrated Development Environment ). Limited to android ecology, only a fraction of APP currently supports this model. Meanwhile, android devices are various, and depending on APP developers to carry out adaptation development on different devices, high requirements are put forward on manpower of the APP developers, and popularization of the mode is greatly affected. (2) insufficient flexibility of use; the multi-window mode requires the developer to set the split screen rule before APP release. In the use process of the user, all interfaces are set, under different scenes, the user can only passively select a mode and can not set different schemes according to own requirements, so that the user encounters a lot of inconvenience in the use process, gradually gives up the use of an application split screen mode in the APP, and limits the full use of large screen equipment such as a folding screen, a flat panel and the like.

Aiming at the larger hardware characteristics of the folding screen device and the screen on the tablet device, the application provides an application program component layout reconstruction scheme which has small development difficulty compared with the traditional scheme, more flexible mode and wider application range. It should be noted that the application can be applied to folding screen equipment, and also can be applied to wide screen equipment such as flat panel equipment, scroll screen equipment and the like, and can fully utilize the hardware advantage of a large screen to obtain better user experience. The present application will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present application more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.

In the following embodiments, an electronic device is described as an example. The scheme of the embodiment of the application can be applied to any electronic equipment with a larger screen, but can also be applied to small-screen electronic equipment, and the application is not limited.

In one embodiment, as shown in fig. 6, a split screen display method is provided, and the method is applied to an electronic device; the method comprises the following steps:

step 602, obtaining a component layout of a current display interface of a current running application of the electronic device.

The currently running application may refer to an APP in an electronic device that is currently in a running state, for example, a user opens a short video live APP in the electronic device, the live APP is in the running state, and the user further operates to make the live APP be in the running state of live short video; taking electronic equipment as a folding screen mobile phone as an example, in some examples, the live broadcast APP can adopt a mode of vertical screen playing in an operating state.

Further, the currently running application currently has a display interface on the screen of the electronic device, i.e., a current display interface. The current display interface displays all components of the currently running application, namely, the components in the application, for example, the functions of chatting and transmitting the barrage are arranged in the short video live broadcast APP, when the APP is running, the barrage can roll on a screen, meanwhile, a user can pop up an input method when typing, and the barrage function and the chatting function belong to the components on the current display interface of the short video live broadcast APP.

It should be noted that, each Activity of the APP (application) of the present application has a custom layout page, and a component (such as a button) on the layout page refers to a component in the present application.

In addition, the currently running application can be run and displayed in a display screen (for example, a display interface before the split screen) of the electronic equipment, and also can be run and displayed in a display screen (for example, a split screen interface after the split screen) of the electronic equipment, so that the multi-APP collaborative operation can be performed across the APP in the multi-screen, namely, one component in a first APP running in a first screen can be moved into (or copied to) a second APP running in a second screen (for example, the currently displayed interface of the second APP); for example, when a component in an APP currently running is moved to another screen, another APP may already or is running in the other screen, i.e., according to the present application, a component in an APP may be moved to another APP. Meanwhile, other functions including a new screen, special effects, a background and the like can be added in the other APP, so that the functions of the screen where the other APP is located can be more abundant.

Specifically, the application can acquire the component layout of the current display interface, wherein the component layout can comprise the architecture relation among the components in the current display interface and can also comprise the preset identification of the components. In some examples, the preset identifier may refer to a component identifier configured in a component layout during a development stage or a configuration stage, so as to indicate that the component can be displayed in a split-screen interface of a split-screen mode, for example, migrated or copied into the split-screen interface (i.e., the component belongs to a target component). In addition, the component layout may further include a rendering mode of the component, for example, a split-screen layout style of the component in the split-screen mode may include a display size, a display position, and the like.

In one embodiment, the component layout may include a tree structure of components on an Activity page corresponding to the current display interface.

The step of obtaining a component layout of a current display interface of a current running application of the electronic device may include:

and determining the component layout by carrying out static code analysis and dynamic tracking on the current display interface.

Specifically, the component layout in the application can refer to the UI layout structure of the APP (i.e. the user interface layout structure), and the application can determine the user interface layout structure by carrying out static code analysis and dynamic tracking on the current display interface. Furthermore, the static code analysis and dynamic tracking in the application can be realized by adopting the following modes:

taking an electronic device as an example, all activities of a current display interface (Activity) can be obtained through an ADB (Android Debug Bridge ) LIST command, and a corresponding hash_code is obtained. Furthermore, the information of a specific Activity can be obtained through the 'DUMP hash_code', and the information is stored in the Viewnode, and the Viewnode already determines the father node and the content of the Viewnode when storing the information. The process may be updated dynamically.

The application provides an APP UI layout redistribution stage, in which, firstly, the component layout of the current display interface of the currently running APP can be analyzed to determine the components in the currently running APP; specifically, in this stage, the electronic device may determine the UI layout structure of the APP through the foregoing static code analysis and dynamic tracking; taking an Android system as an example, the layout of UI components may be in a tree architecture relationship, as shown in fig. 7.

and responding to a first operation acted on the electronic equipment, and acquiring the component layout of the current display interface of the current running application.

Specifically, entering the step of acquiring the component layout of the current display interface of the current running application, wherein a triggering condition exists; the triggering condition may be a trigger switch; furthermore, the trigger condition may also be a first operation acting on the electronic device. In some embodiments, the first operation may be a preset gesture operation; in other embodiments, the first operation may be an operation that triggers a split screen mode. It should be noted that the preset gesture operation may also be used as one of the operation modes for triggering the split screen mode.

Further, the preset gesture operation may be a shortcut gesture (gesture), and the trigger switch may be a redistribution mode switch for indicating that the APP UI layout redistribution phase is entered. The redistributing mode switch can also be used as a split screen mode switch in the application. The redistribution mode switch is used for indicating whether the electronic equipment executes component layout of a current display interface for acquiring a current running application and acquiring a target component; furthermore, the application is not limited to the triggering conditions and the specific form of operation.

Above, the object of the application is the APP which is currently running, and the UI component of the current display interface of the APP is analyzed to obtain the component layout, so that the target component can be determined, and the application has stronger flexibility (for example, the components in the component layout can be used as the target components which need to be displayed in the split screen interface of the split screen mode) and applicability. Based on the application, the APP developer does not need extra development work, and can perform moderate fine adjustment according to the feedback of the actual effect, thereby reducing the development work. Meanwhile, the application can support the current popular APP UI framework and can be compatible with most of current APP.

Step 604, determining a target component in the component layout, wherein the target component comprises a component to be displayed in a split screen interface of a split screen mode;

Specifically, after the component layout of the current display interface of the currently running application is obtained, a target component in the component layout may be determined. The target component may refer to a component that needs to be displayed in a split screen interface in split screen mode, which may be selected by a user or determined by a system default of the electronic device.

In one embodiment, the target component comprises a component in the split-screen interface that needs to be migrated or copied from the current display interface to the split-screen mode.

Specifically, based on the component layout obtained by the method, the target component to be migrated or copied can be automatically determined. I.e. the application allows a free choice of migrating or copying components on the APP.

Further, in one of the embodiments, the step of determining the target component in the component layout may include:

Specifically, after the component layout is obtained, a mark may be displayed in a current display interface of the currently running application of the electronic device, where the mark may be used to identify a display area to which each component in the currently running application belongs. Wherein each component in the application is each component in the component layout. The display area to which each component belongs refers to the display area occupied by the component in the current display interface.

As shown in fig. 8, in the APP UI layout redistribution stage provided by the present application, in this stage, firstly, by analyzing the component layout of the current display interface of the currently running APP, the in-application component of the currently running APP may be determined, and further, the layout reconstruction of the UI component may be entered, and the user may select the required UI component by clicking, dragging, etc. operations, and perform layout reconstruction on the selected UI component between multiple screens. For example, after the component layout of the currently running APP is obtained, the components may be identified by using a frame mark surrounding the component occupation area for selection by a user, so that the components selected by the user and needing to be transplanted (e.g., migrated or copied) in the current display interface are determined to be target components; it should be noted that all components in the component layout may be identified as objects, that is, each component in the component layout has the capability of being displayed in the split-screen interface in the split-screen mode.

Further, according to the display mark in the current display interface, if there is a second operation acting on the component display area, it is determined that the component is a component that needs to be displayed in the split-screen interface in the split-screen mode (e.g., a component that needs to be migrated or copied from the current display interface to the split-screen interface in the split-screen mode), that is, it is determined that the component is a target component.

In one embodiment, the second operation may include at least one of a click operation and a drag operation; the mark may include a color frame surrounding the display area (i.e. the component occupying area), or may also adopt other manners, such as a frame with a preset shape, highlighting, etc., and shake the component occupying area, and meanwhile, the shake amplitude of the component occupying area may be set, such as jump shake, etc., and may be specifically set according to actual needs. It should be noted that other operation forms may be used as the second operation, and other marking forms may be used for marking, which is not limited in the present application. For example, taking a short video live APP as an example, after the user opens the APP, the user can pop up the area by clicking the input method, and determine the corresponding component as the target component.

Further, in the application, whether the component needs to be migrated from the current display interface to the split-screen interface in the split-screen mode or needs to be copied to the split-screen interface in the split-screen mode can be confirmed through a second operation. For example, when a user applies a click operation to a display area occupied by a component in a current display interface, the component may be determined to be in a split screen interface that needs to be migrated from the current display interface to a split screen mode; when a user applies a drag operation to a display area occupied by a component in a current display interface, the component can be determined to be in a split screen interface which needs to be copied from the current display interface to a split screen mode. In addition, the prompt information can be displayed to remind the user; it should be noted that the second operation and the prompt information may be implemented in other forms, and the present application is not limited to the second operation and the prompt information.

In one embodiment, the step of determining the target component in the component layout comprises:

Specifically, the target component in the application can be defaulted by the system of the electronic equipment, namely the system can automatically reconstruct the layout of the UI components of multiple screens. In some examples, taking a UI component layout of an Android system in a tree-like architecture relationship as an example, the UI component layout of the tree-like architecture relationship may mark a target component through a preset identifier. It should be noted that all components in the component layout may be used as the marking objects, that is, each component in the component layout has the capability of being displayed in the split-screen interface in the split-screen mode.

It should be noted that, the process of determining the target component by default of the system of the electronic device may also be performed when the operation of selecting the target component by the user is not acquired within the preset waiting time, so that applicability and flexibility of split-screen execution of the component in the application may be further ensured. If the operation of selecting the target component by the user is not obtained within the preset waiting time, the user can be reminded by displaying the prompt information. In some examples, the content of the hint information may be: separating the components, namely selecting the components; in other examples, the content of the hint information may be: please determine whether to split the component.

It should be noted that the number of the target components may be plural; in some examples, a target component that needs to be displayed in the same split-screen interface in multiple target components may be used as a combined component, so that the combined component is migrated or copied from the current display interface to the same split-screen interface for display in the case of split-screen mode operation. Based on the application, the mobile combination of the UI components among multiple screens can be realized, and the copy combination of the UI components among the multiple screens can be realized, namely, the multiple screens can display the same UI components.

In response to determining the target component in the component layout, the currently running application is identified as a split application in split mode, step 606.

Specifically, after determining the target component, the currently running application may be validated as a split-screen application corresponding to the split-screen mode in response to determining the target component in the component layout. When the electronic equipment operates in the split screen mode, the application can be adopted to perform split screen display of the components in the application for the current operation application confirmed as the split screen application; the split-screen application in the application refers to the current running application which can adopt the mode proposed by the application to carry out split-screen display of the components in the application when the split-screen mode is operated.

The split screen mode in the application can comprise the number of split screens, the positions of the split screen interfaces in the screen of the electronic equipment, the screen dividing mode and the like. Further, the split screen mode is performed in the screen display area of the electronic device, and the split screen mode may be entered after the split screen function is turned on (for example, the above response acts on the first operation of the electronic device, that is, it may be determined that the split screen function is turned on), after that, the screen display area of the electronic device may be divided into a plurality of areas (generally, two areas, such as an upper area and a lower area, or a left area and a right area, etc.), where different areas are respectively used to display different split screen interfaces, such as an interface of the application a and an interface of the application B respectively in the left area and the right area, and may also display the target component of the application in either one of the left area and the right area based on the present application.

If the target component in the component layout is not determined, the current running application corresponding to the component layout is considered, the split-screen mode of the component split-screen display in the application provided by the application is not needed, but the current running application cannot respond to the split-screen mode; in some examples, the currently running application may still be displayed as required in a split screen mode, e.g., as in the conventional multi-window display or conventional application split screen mode described above. Specifically, if the target component in the component layout is not determined, the current running application corresponding to the component layout can be considered to be not supported currently or does not need to split the screen of the internal component, and at the moment, the split screen mode can be responded continuously or can be exited; meanwhile, prompt information can be displayed on a display interface (or a current display interface of a current running application) of the electronic equipment so as to remind a user; in some examples, the content of the hint information may be: split-screen browsing, requesting to select a style layout (or requesting to select an application); in other examples, the content of the hint information may be: the application does not support component split, please confirm whether to exit split mode.

In one embodiment, the method further comprises:

acquiring a split screen layout style based on the component layout; the split-screen layout style comprises the display size and the display position of the target component in the corresponding split-screen interface.

Specifically, after the target component is determined, the system of the electronic device can default the split-screen layout style, namely, the system can automatically reconstruct the layout of the UI components of the multiple screens, so that the applicability and flexibility of the split-screen of the components in the application are further improved. The split-screen layout style may include rendering data such as a display size and a display position of the target component in the corresponding split-screen interface. In some examples, taking a tree-structured UI component layout of an Android system as an example, the tree-structured UI component layout may include a split-screen layout style of a target component. Further, layout information for the split application may be determined from the split layout style.

By acquiring the target component, the method and the device determine whether the currently running application is an application capable of carrying out split screen display of the components in the application, further allow free selection of components to migrate or copy the components on the APP, and have flexible mechanism.

In step 608, in response to the split mode operation, a split display is performed on the target component of the split application in the split interface.

Specifically, after determining that the currently running application is a split-screen application corresponding to the split-screen mode, the split-screen application can be run in response to the split-screen mode, and split-screen display can be performed on a target component of the split-screen application in the split-screen interface. The application can realize the sub-window (namely corresponding sub-screen interface) rendering of different components in the same APP. After determining that the currently running application is a split-screen application corresponding to the split-screen mode, the stage of the split-screen mode running may be referred to as an APP multi-screen running stage.

In one embodiment, in response to the split mode operation, the step of split displaying the target component of the split application in the split interface includes:

Specifically, the layout information aiming at the split-screen application can be obtained according to the target component, so that the split-screen display of the component in the application of the split-screen application is completed; the layout information may include rendering data; as shown in fig. 9, according to the determined target component, a UI of each screen (split screen interface) is rendered and displayed in the corresponding screen.

Specifically, the application may intercept and modify an original layout parameter of a split-screen application, where the original layout parameter may refer to a layout parameter corresponding to a currently running application displayed on a current display interface (e.g., rendering data of the currently displayed interface), or may refer to a layout parameter corresponding to a displayed interface when the currently running application normally responds to a split-screen mode (i.e., when the split-screen display of an in-application component is not adopted). Furthermore, the application can acquire the original layout parameters from the bottom data, and further tamper the original layout parameters into rendering data required by realizing the split screen display of the components in the application. In the above way, the split screen display of the components in the application does not damage the running logic and the running content of the APP.

In one embodiment, the underlying data may include data sent by a central processing unit CPU of the electronic device to a graphics processor GPU of the electronic device; the layout information includes the display size and display position of the target component in the corresponding split screen interface.

Specifically, the underlying data in the present application may refer to data sent to the GPU (Graphics Processing Unit, graphics processor) by the underlying system read CPU (Central Processing Unit ). The layout information includes the display size and the display position of the target component in the corresponding split screen interface.

In one embodiment, the split screen interface includes more than one display interface, and the method further includes:

Specifically, based on the in-application component split-screen display proposed by the application, the user can synchronously update to the associated screen UI components by operating certain UI components on a certain screen. The application can realize the window rendering and synchronization of different components in the same APP; above, the application changes the rendering position of the component, and the content of the component is still controlled by the APP, so that the synchronous update is realized the same as the original APP.

Specifically, the target component needs to be displayed in a split screen interface in a split screen mode, and the split screen interface can refer to a target interface to which the target component is migrated or copied from a current display interface in the split screen mode; the target interface may be any interface in a split screen mode, or may be a display interface of another application in the electronic device other than the currently running application. The other application can be a split screen application defined by the application, or any application currently provided with a display interface in the electronic equipment.

For example, a component within a first APP running in a first screen may be moved into (or copied to) a second APP running in a second screen (e.g., in the second APP's current display interface); specifically, when a component in an APP currently running is moved to another screen, another APP may already or is running in the other screen, that is, according to the present application, a component in an APP may be moved to another APP. Meanwhile, other functions including a new screen, special effects, a background and the like can be added in the other APP, so that the functions of the screen where the other APP is located can be more abundant.

The application carries out the reconstruction rendering of the UI layout of the multiple screens at the system level. Correspondingly, the multi-APP collaborative operation in the multi-screen space can be performed across the APP, so that richer functions are realized.

The application does not need secondary development, and has wide applicability; according to the application, through static code analysis and dynamic tracking processes, UI components of the APP are analyzed, components needing to be migrated or copied are automatically determined, and rendering is performed according to a user or a default re-layout result of the system. The APP developer does not need additional development work, can perform moderate fine adjustment according to feedback of actual effects, and greatly lightens the development work. Meanwhile, the application can support the current popular APP UI framework and can be compatible with most of current APP. In addition, the mechanism of the application is flexible, allows the components on the APP to be freely selected and migrated or copied (system or user), and fully meets the requirements of different users.

To further illustrate the present application, a specific example is described below, as shown in fig. 10, in a short video live scene, a vertical screen playing mode is generally adopted, as shown in a left view in fig. 10; in order to strengthen interaction between a user and a host, the chat and bullet screen sending functions are arranged in the APP, the bullet screen can sometimes influence watching experience when being rolled on a screen, meanwhile, the user needs to pop up an input method when typing, the input method blocks a large playing area, and great trouble is brought to the user.

After the user opens the APP, the user is reminded of the component to be capable of split-screen display by marking the component through the square frame in the current display interface of the APP as shown in the left view of FIG. 10; furthermore, the user can move the input method into another window by clicking the pop-up region of the input method, and can move the barrage into a second window at the same time, as shown in the right view in fig. 10; the number of the barrages serving as the target components can be multiple, and in this case, the barrages can be used as a combination to migrate or copy the combination from the display interface in fig. 10 to the right interface in fig. 10 for display under the condition of running in a split screen mode.

Furthermore, the user can see all live broadcast contents on one side, and can interact with other audiences on the other side to release views and feelings, so that the hardware advantages of the large-screen equipment can be fully exerted. In addition, the user can not only move the barrage to another window to obtain complete watching experience, but also keep the original barrage playing scheme to adapt to watching habits, and the requirements of different users are fully met. The application has the advantages of small development difficulty, more flexible mode and wider application range.

It should be understood that, although the steps in the flowcharts related to the embodiments described above are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.

Based on the same inventive concept, the embodiment of the application also provides a split-screen display device for realizing the split-screen display method. The implementation of the solution provided by the device is similar to the implementation described in the above method, so the specific limitation in the embodiments of the split-screen display device provided below may refer to the limitation of the split-screen display method hereinabove, and will not be repeated herein.

In one embodiment, as shown in fig. 11, there is provided a split screen display device, applied to an electronic apparatus, the device including:

a component layout obtaining module 110, configured to obtain a component layout of a current display interface of a current running application of the electronic device;

a target component determining module 120, configured to determine a target component in a component layout, where the target component includes a component that needs to be displayed in a split screen interface of a split screen mode of the electronic device;

a split-screen application determining module 130 for determining the currently running application as a split-screen application of the split-screen mode in response to determining the target component in the component layout

The split display module 140 is configured to perform split display on a target component of the split application in the split interface in response to the split mode operation.

the split screen display module 140 includes:

the layout information acquisition module is used for acquiring layout information aiming at split screen application according to the target component;

and the layout display module is used for carrying out split-screen display on the target component of the split-screen application in the split-screen interface according to the layout information under the condition of split-screen mode operation.

In one embodiment, the component layout obtaining module 110 is configured to obtain, in response to a first operation acting on the electronic device, a component layout of a current display interface of a currently running application;

a target component determining module 120, configured to display a mark in a current display interface according to a component layout; marking a display area to which each component in the application running currently belongs; in response to a second operation acting on the display area, a component corresponding to the display area acted on by the second operation is determined as a target component.

The target component determining module 120 is configured to determine a component having a preset identifier in the component layout as a target component.

the layout information acquisition module is used for acquiring the bottom layer data and acquiring original layout parameters of the split screen application from the bottom layer data; and intercepting the original layout parameters according to the target component, and modifying the intercepted original layout parameters to obtain layout information.

In one embodiment, the component layout includes a tree structure of components on an active Activity page corresponding to a current display interface;

In one embodiment, the split screen interface includes more than one display interface, the apparatus further comprising:

the synchronous updating module is used for responding to the operation of the first component in any display interface acting on the split screen interface and synchronously updating the display content of the second component in the corresponding display interface of the split screen interface; the first component is any component in the split-screen application; the second component is a component associated with the first component within the split-screen application.

The above-described respective modules in the split-screen display device may be implemented in whole or in part by software, hardware, and a combination thereof. The above modules may be embedded in hardware or independent of a processor in the electronic device, or may be stored in software in a memory in the electronic device, so that the processor may call and execute operations corresponding to the above modules.

In one embodiment, an electronic device is provided, which may be a terminal, and an internal structure diagram thereof may be as shown in fig. 12. The electronic device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the electronic device is configured to provide computing and control capabilities. The memory of the electronic device includes a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The communication interface of the electronic device is used for conducting wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a split screen display method. The display screen of the electronic equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the electronic equipment, and can also be an external keyboard, a touch pad or a mouse and the like.

It will be appreciated by those skilled in the art that the structure shown in fig. 12 is merely a block diagram of a portion of the structure associated with the present inventive arrangements and is not limiting of the electronic device to which the present inventive arrangements are applied, and that a particular electronic device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.

In one embodiment, an electronic device is provided that includes a memory having a computer program stored therein and a processor that implements the split screen display method described above when the computer program is executed.

In one embodiment, the processor may be a central processing unit, CPU; the electronic device may also include a graphics processor GPU. The bottom data in the application can refer to data which is read by a bottom system and sent to a graphic processor GPU by a central processing unit CPU, and further, the layout parameters of the currently running APP can be intercepted and modified based on the bottom data so as to obtain rendering data required by realizing the split screen display of the components in the application.

In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, which when executed by a processor, implements the split screen display method described above.

In one embodiment, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the split screen display method described above.

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, database, or other medium used in embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magnetic random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (Phase Change Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like. The databases referred to in the embodiments provided herein may include at least one of a relational database and a non-relational database. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processor referred to in the embodiments provided in the present application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic unit, a data processing logic unit based on quantum computing, or the like, but is not limited thereto.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The foregoing examples illustrate only a few embodiments of the application and are described in detail herein without thereby limiting the scope of the application. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the application, which are all within the scope of the application. Accordingly, the scope of the application should be assessed as that of the appended claims.

Claims

1. A split screen display method, characterized in that it is applied to an electronic device, the method comprising:

acquiring the component layout of a current display interface of the current running application of the electronic equipment;

determining a target component in the component layout, wherein the target component comprises a component which needs to be displayed in a split screen interface of a split screen mode of the electronic equipment;

responsive to determining a target component in the component layout, identifying the currently running application as a split-screen application of the split-screen mode;

And responding to the split screen mode operation, and performing split screen display on the target component of the split screen application in the split screen interface.

2. The method of claim 1, wherein the target component comprises a component in a split screen interface that needs to be migrated or copied from the current display interface to the split screen mode;

acquiring layout information aiming at the split screen application according to the target component;

and under the condition of the split screen mode operation, carrying out split screen display on the target component of the split screen application in the split screen interface according to the layout information.

3. The method according to claim 1 or 2, wherein the step of obtaining a component layout of a current display interface of a currently running application of the electronic device comprises:

responding to a first operation acted on the electronic equipment, and acquiring the component layout of the current display interface of the current running application;

the step of determining the target component in the component layout comprises:

Displaying a mark in the current display interface according to the component layout; the mark is used for identifying the display area to which each component in the currently running application belongs;

and responding to a second operation acted on the display area, and determining a component corresponding to the display area acted on by the second operation as the target component.

4. The method according to claim 1 or 2, wherein the step of obtaining a component layout of a current display interface of a currently running application of the electronic device comprises:

the step of determining the target component in the component layout comprises:

and determining the component with the preset identifier in the component layout as the target component.

5. The method of claim 2, wherein the layout information includes data for rendering the target component for display in a split screen interface;

the step of obtaining layout information for the split-screen application according to the target component comprises the following steps:

acquiring bottom layer data, and acquiring original layout parameters of the split screen application from the bottom layer data;

Intercepting the original layout parameters according to the target component, and modifying the intercepted original layout parameters to obtain the layout information.

6. The method of claim 5, wherein the underlying data comprises data sent by a central processing unit CPU of the electronic device to a graphics processor GPU of the electronic device; the layout information comprises the display size and the display position of the target component in the corresponding split screen interface.

7. The method according to claim 1 or 2, wherein the component layout comprises a tree structure of components on an active Activity page corresponding to the current display interface.

8. The method of claim 1 or 2, wherein the split screen interface comprises a display interface of another application in the electronic device other than the currently running application.

9. The method of claim 1 or 2, wherein the split screen interface comprises more than one display interface, the method further comprising:

10. A split screen display device, characterized in that it is applied to an electronic apparatus, the device comprising:

a target component determining module, configured to determine a target component in the component layout, where the target component includes a component that needs to be displayed in a split screen interface of a split screen mode of the electronic device;

a split-screen application determining module, configured to determine the currently running application as a split-screen application of the split-screen mode in response to determining a target component in the component layout;

and the split screen display module is used for responding to the split screen mode operation and carrying out split screen display on the target component of the split screen application in the split screen interface.

11. An electronic device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any one of claims 1 to 9 when the computer program is executed.

12. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 9.

13. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any one of claims 1 to 9.