CN113589927B - Split screen display method, head-mounted display device and computer readable medium - Google Patents
Split screen display method, head-mounted display device and computer readable medium Download PDFInfo
- Publication number
- CN113589927B CN113589927B CN202110838495.5A CN202110838495A CN113589927B CN 113589927 B CN113589927 B CN 113589927B CN 202110838495 A CN202110838495 A CN 202110838495A CN 113589927 B CN113589927 B CN 113589927B
- Authority
- CN
- China
- Prior art keywords
- display
- displayed
- mode
- layer
- application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000004044 response Effects 0.000 claims abstract description 41
- 238000004590 computer program Methods 0.000 claims description 10
- 238000004891 communication Methods 0.000 claims description 6
- 230000000694 effects Effects 0.000 abstract description 14
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 3
- 230000000644 propagated effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Abstract
Embodiments of the present disclosure disclose a split screen display method, a head mounted display device, and a computer readable medium. One embodiment of the method comprises the following steps: in response to detecting any application in the target device to launch, determining whether any application is a two-dimensional display application; in response to determining that either application is a two-dimensional display application, adjusting the resolution of the two display screens to a target resolution; creating a first to-be-displayed layer with the resolution being the target resolution according to the current display interface of any application program; copying the first to-be-displayed sub-layer to obtain a copied first to-be-displayed sub-layer, and taking the first to-be-displayed sub-layer and the copied first to-be-displayed sub-layer as the first to-be-displayed sub-layer in the first to-be-displayed sub-layer group; and displaying the first to-be-displayed sub-layer in the first to-be-displayed sub-layer group in the two display screens respectively. According to the embodiment, the split screen display effect and the user experience can be improved.
Description
Technical Field
Embodiments of the present disclosure relate to the field of computer technology, and in particular, to a split screen display method, a head-mounted display device, and a computer readable medium.
Background
Split screen display is one method of displaying an application interface in a target device (e.g., a mobile terminal) on two display screens of the head-mounted display device after the head-mounted display device is connected to the target device. But the resolution of the head-mounted display device differs greatly from that of the target device, and the two display screens of the head-mounted display device often have characteristics of different display from left to right. Therefore, when the head-mounted display device displays the common two-dimensional display application program interface, the original two-dimensional display application program interface is divided into two parts which are respectively and independently displayed in the two display screens, so that the display effect and the user experience are greatly reduced. Currently, in order to solve the above problems, the following methods are generally adopted in split screen display: setting a layout which is adapted to the head-mounted display equipment for each two-dimensional display application program, and switching the display mode of the head-mounted display equipment into a left-right simultaneous display mode when the head-mounted display equipment displays the interfaces of the two-dimensional display application programs, namely displaying the interfaces of the two-dimensional display application programs which are completely identical in two display screens of the head-mounted display equipment; when the head-mounted display device displays the interface of the three-dimensional display application program, the display mode of the head-mounted display device is switched to a left-right different display mode, namely, contents in two different display areas in the interface of the three-dimensional display application program are respectively displayed in two display screens of the head-mounted display device.
However, when the split screen display is adopted as described above, there are often the following technical problems:
when the head-mounted display device is switched between the left and right simultaneous display modes and the left and right different display modes, hardware in the head-mounted display device needs a certain time (for example, 3 to 5 seconds) to reset the hardware, and when the hardware is reset, the head-mounted display is in a black screen state, so that the split screen display effect and the user experience of the head-mounted display device are greatly reduced.
Disclosure of Invention
The disclosure is in part intended to introduce concepts in a simplified form that are further described below in the detailed description. The disclosure is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
Some embodiments of the present disclosure propose a split screen display method, a head-mounted display device, and a computer readable medium to solve the technical problems mentioned in the background section above.
In a first aspect, some embodiments of the present disclosure provide a split screen display method, including: in response to detecting that any application program in target equipment is started, determining whether any application program is a two-dimensional display application program, wherein the target equipment is in communication connection with the head-mounted display equipment, the head-mounted display equipment comprises two display screens, and a display mode of the head-mounted display equipment is in a left-right different display mode; in response to determining that either application is a two-dimensional display application, adjusting the resolution of the two display screens to a target resolution, wherein the target resolution is one-half of an initial resolution, and the initial resolution is a maximum resolution of the display screens in the head-mounted display device; creating a first to-be-displayed layer with the resolution being the target resolution according to the current display interface of any application program; copying the first to-be-displayed sub-layer to obtain a copied first to-be-displayed sub-layer, and taking the first to-be-displayed sub-layer and the copied first to-be-displayed sub-layer as the first to-be-displayed sub-layer in the first to-be-displayed sub-layer group; and respectively displaying the first to-be-displayed image layer in the first to-be-displayed image layer group in the two display screens.
In a second aspect, some embodiments of the present disclosure provide a head mounted display device comprising: one or more processors; a storage device having one or more programs stored thereon, which when executed by one or more processors causes the one or more processors to implement the method described in any of the implementations of the first aspect above.
In a third aspect, some embodiments of the present disclosure provide a computer readable medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the method described in any of the implementations of the first aspect above.
The above embodiments of the present disclosure have the following advantageous effects: according to the split-screen display method of some embodiments of the present disclosure, there is no need to set a layout adapted to the resolution of the head-mounted display device for each two-dimensional display application, and there is also no need to switch between a left-right co-display mode and a left-right co-display mode, so that the occurrence of a black screen state during hardware reset is avoided, and no-perception switching between an interface of the two-dimensional display application and an interface of the three-dimensional display application in a display screen of the head-mounted display device is realized. Specifically, the reason why the display effect and the user experience are poor in the interface switching process of the two-dimensional display application program and the three-dimensional display application program is that: when the head-mounted display device is switched between the left and right simultaneous display modes and the left and right simultaneous display modes, hardware in the head-mounted display device needs a certain time (for example, 3 to 5 seconds) to reset the hardware, and the head-mounted display is in a black screen state when the hardware is reset. Based on this, the split screen display method of some embodiments of the present disclosure displays the interface of the two-dimensional display application and the interface of the three-dimensional display application in the left-right highlighting mode while maintaining the display mode of the head-mounted display device in the left-right highlighting mode. Therefore, the occurrence of the black screen phenomenon caused by hardware reset when the left and right different display modes and the left and right same display modes are switched can be avoided. And adaptively adjusting the resolution of the head mounted display device when displaying the interface of the two-dimensional display application. Thus, it is possible to avoid setting a layout adapted to the head-mounted display device for each two-dimensional display application in advance. Furthermore, the effect and the user experience of split-screen display are improved.
Drawings
The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.
FIG. 1 is an architecture diagram of an exemplary system in which some embodiments of the present disclosure may be applied;
FIG. 2 is a schematic diagram of one application scenario of a split screen display method of some embodiments of the present disclosure;
FIG. 3 is a flow chart of some embodiments of a split screen display method according to the present disclosure;
FIG. 4 is a flow chart of other embodiments of split screen display methods according to the present disclosure;
fig. 5 is a schematic structural diagram of an electronic device suitable for use in implementing some embodiments of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.
It should be noted that, for convenience of description, only the portions related to the present invention are shown in the drawings. Embodiments of the present disclosure and features of embodiments may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.
It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.
The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Fig. 1 illustrates an exemplary system architecture 100 that may be applied to embodiments of the split screen display methods of the present disclosure.
As shown in fig. 1, an exemplary system architecture 100 may include a head mounted display device 11 and a target device 12.
The head mounted display device 11 may include one or two display screens 111. The two display screens 111 are used for displaying the layers to be displayed. In some optional implementations of some embodiments, when the head-mounted display device has two lenses, the two display screens may be respectively located in the two lenses. Alternatively, when the head-mounted display device has only one lens, the two display screens may be simultaneously located in the one lens. In addition, the head mounted display device 11 also includes a frame 112. In some embodiments, the sensors, processing unit, memory, and battery of the head mounted display device 11 can be placed inside the frame 112. In some alternative implementations of some embodiments, one or more of the sensor, processing unit, memory, and battery may also be integrated into another separate accessory (not shown) connected to the frame 112 via a data line. In some alternative implementations of some embodiments, the head mounted display device 11 may have only display functionality and some sensors, while data processing, data storage, power supply capabilities, etc. are provided by the target device 12.
The target device 12 may include a touch sensitive display screen 121, and in some embodiments, the head mounted display device 11 and the target device 12 may communicate via a wireless connection. In some alternative implementations of some embodiments, the head mounted display device 11 and the target device 12 may also be connected by a data line (not shown).
It should be understood that the number of head mounted display devices and target devices in fig. 1 is merely illustrative. There may be any suitable number of head mounted display devices and target devices, as desired for implementation.
Fig. 2 is a schematic diagram of an application scenario of a split screen display method according to some embodiments of the present disclosure.
In the application scenario of fig. 2, first, the computing device 201 may determine whether any application 203 in the target device 202 is a two-dimensional display application in response to detecting that any application 203 is launched. Wherein the target device 202 is communicatively coupled to the head mounted display device 204. The head mounted display device 204 described above includes two display screens 2041. The display mode of the head-mounted display device 204 is in the left-right different display mode. Next, the computing device 201 may adjust the resolution of the two display screens 2041 to the target resolution 205 in response to determining that either application 203 is a two-dimensional display application. Wherein the target resolution 205 is one half of the initial resolution. The initial resolution is the maximum resolution of the display screen in the head mounted display device 204. The computing device 201 may then create a first layer to be displayed 206 having a resolution of the target resolution 205 based on the current display interface of any of the applications 203. Then, the computing device 201 may copy the first to-be-displayed layer 206 to obtain a copied first to-be-displayed layer 207, and use the first to-be-displayed layer 206 and the copied first to-be-displayed layer 207 as the first to-be-displayed layer in the first to-be-displayed layer group 208. Finally, the computing device 201 may display the first layer to be displayed in the first layer to be displayed group 208 in the two display screens 2041, respectively.
The computing device 201 may be hardware or software. When the computing device is hardware, the computing device may be implemented as a distributed cluster formed by a plurality of servers or terminal devices, or may be implemented as a single server or a single terminal device. When the computing device is embodied as software, it may be installed in the above-listed hardware devices, or in the above-mentioned target device or head-mounted display device. It may be implemented as a plurality of software or software modules, for example, for providing distributed services, or as a single software or software module. The present invention is not particularly limited herein.
It should be understood that the number of computing devices in fig. 2 is merely illustrative. There may be any number of computing devices, as desired for an implementation.
With continued reference to fig. 3, a flow 300 of some embodiments of a split screen display method according to the present disclosure is shown. The process 300 of the split screen display method includes the following steps:
in response to detecting any application launch in the target device, a determination is made as to whether any application is a two-dimensional display application, step 301.
In some embodiments, the execution subject of the split-screen display method (e.g., computing device 201 shown in fig. 2) may determine, in response to detecting any application launch in the target device, whether any application is a two-dimensional display application from information generated at the time of any application launch. Wherein the target device is communicatively coupled to the head mounted display device. The head-mounted display device includes two display screens. The display mode of the head-mounted display device is in a left-right different display mode. The left and right different display modes are display modes in which two display screens of the head-mounted display device are respectively used for displaying two layers to be displayed. The two layers to be displayed are in one-to-one correspondence with the two display screens.
Whether any application program is a two-dimensional display application program or not, the display mode of the head-mounted display device is in a left-right different display mode. The display mode of the head-mounted display device is not different because any of the applications is a two-dimensional display application or a three-dimensional display application. Therefore, the display mode of the head-mounted display device is not required to be switched between a left-right different display mode and a left-right same display mode, and the occurrence of a black screen state is avoided.
In some optional implementations of some embodiments, before the executing entity determines whether any application is a two-dimensional display application in response to detecting that any application in the target device is launched, the executing entity may further execute the following steps:
first, in response to detecting that the target device is communicatively connected to the head-mounted display device, determining whether the head-mounted display device supports a left-right heterodisplay mode. The device information of the head-mounted display device may be acquired first, and then it may be determined whether the head-mounted display device supports the left-right iso-display mode according to the display mode identifier included in the device information. If the display mode identifier included in the device information is the target identifier, it may be determined that the head-mounted display device supports the left-right different display mode. The target identifier may be a preset identifier that characterizes that the head-mounted display device supports a left-right different display mode.
And a second step of setting the display mode of the head-mounted display device to the left-right display mode in response to determining that the head-mounted display device supports the left-right display mode.
Thus, when the target device is communicatively connected to the head-mounted display device, the display mode of the head-mounted display device supporting the left-right different display mode is maintained in the left-right different display mode. The switching of the display modes of the follow-up head-mounted display device between the left and right different display modes and the left and right same display modes is limited, and the occurrence of a black screen state is avoided.
In response to determining that either application is a two-dimensional display application, the resolution of the two display screens is adjusted to the target resolution, step 302.
In some embodiments, the executing entity may adjust the resolutions of the two display screens to the target resolution in response to determining that either application is a two-dimensional display application. Wherein the target resolution is one half of the initial resolution. The initial resolution is a maximum resolution of a single display screen in the head-mounted display device.
As an example, the above initial resolution may be 1280dpi (Dots Per Inch) ×720dpi. The target resolution may be 640dpi x 360dpi.
Therefore, when any application program is a two-dimensional display application program, the resolution of the two display screens can be adaptively adjusted, so that the interface of the two-dimensional display application program can be ensured to be normally displayed in the two display screens. A layout adapted to the head-mounted display device described above does not need to be set in advance for each two-dimensional display application. The two-dimensional display application development steps are simplified.
In some optional implementations of some embodiments, the executing body may further execute the following steps:
and in the first step, in response to determining that any application program is a three-dimensional display application program, respectively creating a second layer to be displayed, which corresponds to each different display area in the current display interface of any application program and has the resolution of the initial resolution, so as to obtain a second layer group to be displayed. The current display interface of any application program comprises two different display areas. The two different display areas are different in content. And the second image layer to be displayed in the second image layer group corresponds to the two different display areas one by one. The content of the second layer to be displayed in the second layer group to be displayed is the same as the content displayed in the two different display areas. In some embodiments, the second layer to be displayed may be created using a Surface Flinger service.
And a second step of displaying the second layer to be displayed in the second layer group to be displayed in the two display screens respectively. The second layer to be displayed in the second layer group to be displayed may be transferred to the HWC (hardware composer, hardware writer) through a frame buffer, so that the second layer to be displayed in the second layer group to be displayed is displayed in the two display screens respectively.
Step 303, creating a first to-be-displayed layer with a resolution being a target resolution according to the current display interface of any application program.
In some embodiments, the executing entity may create the first layer to be displayed with the resolution being the target resolution according to the current display interface of any application program. The first layer to be displayed described above may be created using a Surface Flinger service. The content of the first to-be-displayed layer is the same as the content in the current display interface of any application program.
Step 304, copy the first to-be-displayed sub-layer to obtain a copied first to-be-displayed sub-layer, and use the first to-be-displayed sub-layer and the copied first to-be-displayed sub-layer as the first to-be-displayed sub-layer in the first to-be-displayed sub-layer group.
In some embodiments, the execution body may copy the first to-be-displayed layer to obtain a copied first to-be-displayed layer, and use the first to-be-displayed layer and the copied first to-be-displayed layer as the first to-be-displayed layer in the first to-be-displayed layer group. In practice, the first layer to be displayed may be copied by using OpenGL (Open Graphics Library ).
Because the two display screens in the head-mounted display device in the left-right different display mode respectively display the contents in the two layers to be displayed, the first layer to be displayed, which is created for the current display interface, needs to be copied to obtain the two first layers to be displayed. So as to be displayed in two display screens in the left and right different display modes of the head-mounted display device, respectively.
In step 305, the first to-be-displayed sub-layers in the first to-be-displayed sub-layer group are respectively displayed in the two display screens.
In some embodiments, the execution body may display a first layer to be displayed in the first layer group to be displayed in the two display screens, respectively. In practice, the first layer to be displayed in the first layer group to be displayed may be transferred to the HWC through a frame buffer, so that the first layer to be displayed in the first layer group to be displayed is displayed in the two display screens respectively.
The above embodiments of the present disclosure have the following advantageous effects: according to the split-screen display method of some embodiments of the present disclosure, there is no need to set a layout adapted to the resolution of the head-mounted display device for each two-dimensional display application, and there is also no need to switch between a left-right co-display mode and a left-right co-display mode, so that the occurrence of a black screen state during hardware reset is avoided, and no-perception switching between an interface of the two-dimensional display application and an interface of the three-dimensional display application in a display screen of the head-mounted display device is realized. Specifically, the reason why the display effect and the user experience are poor in the interface switching process of the two-dimensional display application program and the three-dimensional display application program is that: when the head-mounted display device is switched between the left and right simultaneous display modes and the left and right simultaneous display modes, hardware in the head-mounted display device needs a certain time (for example, 3 to 5 seconds) to reset the hardware, and the head-mounted display is in a black screen state when the hardware is reset. Based on this, the split screen display method of some embodiments of the present disclosure displays the interface of the two-dimensional display application and the interface of the three-dimensional display application in the left-right highlighting mode while maintaining the display mode of the head-mounted display device in the left-right highlighting mode. Therefore, the occurrence of the black screen phenomenon caused by hardware reset when the left and right different display modes and the left and right same display modes are switched can be avoided. And adaptively adjusting the resolution of the head mounted display device when displaying the interface of the two-dimensional display application. Thus, it is possible to avoid setting a layout adapted to the head-mounted display device for each two-dimensional display application in advance. Furthermore, the effect and the user experience of split-screen display are improved.
With further reference to FIG. 4, a flow 400 of further embodiments of a split screen display method is shown. The process 400 of the split screen display method includes the following steps:
in response to detecting any application launch in the target device, a determination is made as to whether any application is a two-dimensional display application, step 401.
In some embodiments, the target device is communicatively connected to the head-mounted display device, the head-mounted display device includes two display screens, and a display mode of the head-mounted display device is in a left-right different display mode. The left and right different display modes are display modes in which two display screens of the head-mounted display device are respectively used for displaying two layers to be displayed. The two layers to be displayed are in one-to-one correspondence with the two display screens.
In response to detecting that any application in the target device is launched, the execution subject of the split-screen display method (e.g., computing device 201 shown in fig. 2) determines whether any application is a two-dimensional display application, and may include the steps of:
in step 4011, application information of any application is acquired.
The execution body may acquire application information of any application program through a wired connection mode or a wireless connection mode.
In step 4012, in response to determining that the application information includes a mode identification that characterizes a display mode of any application as a three-dimensional mode, it is determined that any application is a three-dimensional display application.
The mode identifier may be written into the application information when any application is developed. As an example, the above-described mode identification that characterizes the display mode of any application as a three-dimensional mode may be "3D".
In some optional implementations of some embodiments, the executing entity may further determine that the any application is a two-dimensional display application in response to determining that a mode identifier that characterizes a display mode of the any application as a two-dimensional mode is included in the application information. As an example, the above-described mode identification that characterizes the display mode of any application as a two-dimensional mode may be "2D".
In response to determining that either application is a two-dimensional display application, the resolution of the two display screens is adjusted to the target resolution, step 402.
Step 403, creating a first to-be-displayed layer with a resolution being the target resolution according to the current display interface of any application program.
In step 404, the first to-be-displayed sub-layer is copied to obtain a copied first to-be-displayed sub-layer, and the first to-be-displayed sub-layer and the copied first to-be-displayed sub-layer are used as the first to-be-displayed sub-layer in the first to-be-displayed sub-layer group.
Step 405, displaying the first to-be-displayed sub-layers in the first to-be-displayed sub-layer group in the two display screens respectively.
In some embodiments, the specific implementation manner and the technical effects of steps 402 to 405 may refer to steps 302 to 305 in those embodiments corresponding to fig. 3, which are not described herein.
In step 406, in response to determining that the application information does not include the mode identifier, active component information of an active component currently corresponding to any application is obtained.
In some embodiments, the executing entity may obtain the active component information of the active component currently corresponding to the any application in response to determining that the mode identifier is not included in the application information. The active component may be a carrier of the current display interface of any application program. For example, activity. The active component information may include information written when the active component is developed.
In step 407, in response to determining that the active component information includes a mode identifier that characterizes a display mode of the active component as a three-dimensional mode, a third layer to be displayed corresponding to each different display area in the current display interface of the active component and having a resolution of an initial resolution is created, so as to obtain a third layer group to be displayed.
In some embodiments, the executing body may, in response to determining that the active component information includes a mode identifier that characterizes a display mode of the active component as a three-dimensional mode, respectively create a third layer to be displayed corresponding to each different display area in a current display interface of the active component and having a resolution that is the initial resolution, and obtain a third layer group to be displayed. The current display interface of the movable component comprises two different display areas. The two different display areas are different in content. And the third layer to be displayed in the third layer group to be displayed corresponds to the two different display areas one by one. The contents of the two third to-be-displayed layers in the third to-be-displayed layer group are respectively the same as the two different display areas. In practice, a Surface Flinger service may be used to create the third layer to be displayed.
As an example, the mode identifier that characterizes the display mode of the active component as a three-dimensional mode may be "3D".
In some optional implementations of some embodiments, the executing body may further execute the following steps:
in the first step, in response to determining that the active component information includes a mode identifier that characterizes a display mode of the active component as a two-dimensional mode, the resolutions of the two display screens are adjusted to the target resolution.
As an example, the mode identifier that characterizes the display mode of the active component as a two-dimensional mode may be "2D".
And secondly, creating a fourth layer to be displayed with the resolution being the target resolution according to the current display interface of the movable component. In practice, the fourth layer to be displayed described above may be created using the Surface Flinger service. The content of the fourth layer to be displayed is the same as the content in the current display interface of the movable component.
And thirdly, copying the fourth layer to be displayed to obtain a copied fourth layer to be displayed, and taking the fourth layer to be displayed and the copied fourth layer to be displayed as a fourth layer to be displayed in a fourth layer group to be displayed. In practice, openGL may be used to copy the fourth layer to be displayed.
And a fourth step of displaying the fourth layer to be displayed in the fourth layer group to be displayed in the two display screens respectively. In practice, the fourth layer to be displayed in the fourth layer group to be displayed may be transferred to the HWC through a frame buffer, so that the fourth layer to be displayed in the fourth layer group to be displayed is displayed in the two display screens respectively.
In step 408, the third layer to be displayed in the third layer group to be displayed is displayed in the two display screens respectively.
In some embodiments, the execution body may display a third layer to be displayed in the third layer group to be displayed in the two display screens respectively. In practice, the third layer to be displayed in the third layer group to be displayed may be transferred to the HWC through a frame buffer, so that the third layer to be displayed in the third layer group to be displayed is displayed in the two display screens respectively.
In some alternative implementations of some embodiments, the active component is an active component that includes a mode switch control. The mode switching control is a control for switching between the two-dimensional display mode and the three-dimensional display mode.
The executing body may switch the display mode of the current display interface of the active component in the head-mounted display device to the three-dimensional display mode in response to detecting the mode switching operation for the mode switching control, and before detecting the mode switching operation for the mode switching control, the display mode of the current display interface of the active component in the head-mounted display device is the two-dimensional display mode. The two-dimensional display mode may be a display mode in which the resolutions of the two display screens of the head-mounted display device are both the target resolutions and the contents in the layers displayed on the two display screens are the same. The three-dimensional display mode may be a display mode in which resolutions of two display screens of the head-mounted display device are both the initial resolutions, and contents in layers displayed in the two display screens are different. In some embodiments, the specific implementation manner of switching the three-dimensional display mode and the technical effects thereof may refer to the content of displaying the third layer to be displayed in the third layer group to be displayed in the two display screens in steps 407-408 in those embodiments corresponding to fig. 4, which are not described herein.
As an example, the mode switch control described above may be a mode switch button.
Optionally, the executing body may further switch the display mode of the current display interface of the active component in the head-mounted display device to the two-dimensional display mode in response to detecting the mode switching operation for the mode switching control, and before detecting the mode switching operation for the mode switching control, the display mode of the current display interface of the active component in the head-mounted display device is a three-dimensional display mode. In some embodiments, the specific implementation manner of switching the two-dimensional display mode and the technical effects thereof may refer to step 407 in those embodiments corresponding to fig. 4, in which the fourth layer to be displayed in the fourth layer group to be displayed is displayed in the two display screens respectively, which is not described herein again.
As can be seen from fig. 4, compared with the description of some embodiments corresponding to fig. 3, the flow 400 of the split-screen display method in some embodiments corresponding to fig. 4 represents a manner of performing split-screen display according to the active component information of the active component currently corresponding to the application when the application information does not include the mode identifier. And the user actively switches the split screen display mode between the two-dimensional display mode and the three-dimensional display mode through a mode switching control in the movable component. Thus, the schemes described in these embodiments can be adapted to more application scenarios. Therefore, the effect and the user experience of split-screen display are further improved.
Referring now to fig. 5, a hardware architecture diagram of a head mounted display device (e.g., the head mounted display device of fig. 1) 500 suitable for use in implementing some embodiments of the present disclosure is shown. The head mounted display device shown in fig. 5 is only one example and should not impose any limitation on the functionality and scope of use of the embodiments of the present disclosure.
As shown in fig. 5, the head mounted display device 500 may include a processing means (e.g., a central processor, a graphics processor, etc.) 501, a memory 502, an input unit 503, an output unit 504. Wherein the processing means 501, the memory 502, the input unit 503 and the output unit 504 are connected to each other by a bus 505. Here, a method according to an embodiment of the present disclosure may be implemented as a computer program and stored in the memory 502. For example, some embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. The processing means 501 in the head mounted display device embody the split screen display function defined in the method of the present disclosure by calling the above-described computer program stored in the memory 502. In some implementations, the input unit 503 may include a touch device (e.g., a touch-sensitive display screen of a target device). Thus, whether or not a start operation of the user for any application program in the target device is detected may be sensed by the touch device in the input unit 503, and in response to the determination that it is, the processing apparatus 501 may call the above-described computer program to execute the split screen display function. The output unit 504 may include a display screen for displaying the layers to be displayed.
It should be noted that, the computer readable medium described in some embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In some embodiments of the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, however, the computer-readable signal medium may comprise a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: in response to detecting that any application program in target equipment is started, determining whether any application program is a two-dimensional display application program, wherein the target equipment is in communication connection with the head-mounted display equipment, the head-mounted display equipment comprises two display screens, and a display mode of the head-mounted display equipment is in a left-right different display mode; in response to determining that either application is a two-dimensional display application, adjusting the resolution of the two display screens to a target resolution, wherein the target resolution is one-half of an initial resolution, and the initial resolution is a maximum resolution of the display screens in the head-mounted display device; creating a first to-be-displayed layer with the resolution being the target resolution according to the current display interface of any application program; copying the first to-be-displayed sub-layer to obtain a copied first to-be-displayed sub-layer, and taking the first to-be-displayed sub-layer and the copied first to-be-displayed sub-layer as the first to-be-displayed sub-layer in the first to-be-displayed sub-layer group; and respectively displaying the first to-be-displayed image layer in the first to-be-displayed image layer group in the two display screens.
Computer program code for carrying out operations for some embodiments of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
Claims (8)
1. A split screen display method comprises the following steps:
in response to detecting that any application program in target equipment is started, determining whether the any application program is a two-dimensional display application program, wherein the target equipment is in communication connection with head-mounted display equipment, the head-mounted display equipment comprises two display screens, and a display mode of the head-mounted display equipment is in a left-right different display mode;
in response to determining that the either application is a two-dimensional display application, adjusting the resolutions of the two display screens to a target resolution, wherein the target resolution is one-half of an initial resolution, the initial resolution being a maximum resolution of display screens in the head-mounted display device;
creating a first to-be-displayed layer with the resolution being the target resolution according to the current display interface of any application program;
Copying the first to-be-displayed sub-layer to obtain a copied first to-be-displayed sub-layer, and taking the first to-be-displayed sub-layer and the copied first to-be-displayed sub-layer as the first to-be-displayed sub-layer in the first to-be-displayed sub-layer group;
displaying a first layer to be displayed in the first layer group to be displayed in the two display screens respectively;
responding to the fact that any application program is determined to be a three-dimensional display application program, respectively creating a second layer to be displayed, which corresponds to each different display area in a current display interface of the any application program and has the resolution of the initial resolution, and obtaining a second layer group to be displayed, wherein the current display interface of any application program comprises two different display areas;
respectively displaying a second layer to be displayed in the second layer group to be displayed in the two display screens;
wherein the determining whether any application program is a two-dimensional display application program comprises:
acquiring application program information of any application program;
in response to determining that the application information includes a mode identifier that characterizes a display mode of the any application as a three-dimensional mode, determining that the any application is a three-dimensional display application, wherein the mode identifier is written into the application information when the any application is developed;
In response to determining that the application information includes a mode identification that characterizes a display mode of the any application as a two-dimensional mode, determining that the any application is a two-dimensional display application.
2. The method of claim 1, wherein prior to the determining whether any application is a two-dimensional display application in response to detecting any application launch in a target device, the method further comprises:
in response to detecting that the target device is communicatively connected with the head-mounted display device, determining whether the head-mounted display device supports a left-right highlighting mode;
in response to determining that the head-mounted display device supports a left-right highlighting mode, a display mode of the head-mounted display device is set to a left-right highlighting mode.
3. The method of claim 1, wherein the method further comprises:
acquiring the information of the active component currently corresponding to any application program in response to determining that the application program information does not comprise the mode identifier;
in response to determining that the movable component information comprises a mode identifier representing that a display mode of the movable component is a three-dimensional mode, respectively creating a third layer to be displayed, which corresponds to each different display area in a current display interface of the movable component and has the resolution of the initial resolution, to obtain a third layer group to be displayed, wherein the current display interface of the movable component comprises two different display areas;
And respectively displaying the third to-be-displayed layers in the third to-be-displayed layer group in the two display screens.
4. A method according to claim 3, wherein the method further comprises:
in response to determining that the active component information includes a mode identification that characterizes a display mode of the active component as a two-dimensional mode, adjusting a resolution of the two display screens to the target resolution;
creating a fourth layer to be displayed with the resolution being the target resolution according to the current display interface of the movable component;
copying the fourth layer to be displayed to obtain a copied fourth layer to be displayed, and taking the fourth layer to be displayed and the copied fourth layer to be displayed as a fourth layer to be displayed in a fourth layer group to be displayed;
and respectively displaying the fourth to-be-displayed layers in the fourth to-be-displayed layer group in the two display screens.
5. The method of claim 3, wherein the active component is an active component comprising a mode switch control, the mode switch control being a control for switching between a two-dimensional display mode and a three-dimensional display mode; and
The method further comprises the steps of:
in response to detecting a mode switching operation for the mode switching control, and before the mode switching operation for the mode switching control is detected, a display mode of a current display interface of the active component in the head-mounted display device is a two-dimensional display mode, and the display mode of the current display interface of the active component in the head-mounted display device is switched to a three-dimensional display mode.
6. The method of claim 5, wherein the method further comprises:
in response to detecting a mode switching operation for the mode switching control, and before the mode switching operation for the mode switching control is detected, a display mode of a current display interface of the active component in the head-mounted display device is a three-dimensional display mode, and the display mode of the current display interface of the active component in the head-mounted display device is switched to a two-dimensional display mode.
7. A head mounted display device comprising:
one or more processors;
a display screen for displaying the graphic layer;
a storage device having one or more programs stored thereon,
When executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-6.
8. A computer readable medium having stored thereon a computer program, wherein the program when executed by a processor implements the method of any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110838495.5A CN113589927B (en) | 2021-07-23 | 2021-07-23 | Split screen display method, head-mounted display device and computer readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110838495.5A CN113589927B (en) | 2021-07-23 | 2021-07-23 | Split screen display method, head-mounted display device and computer readable medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113589927A CN113589927A (en) | 2021-11-02 |
| CN113589927B true CN113589927B (en) | 2023-07-28 |
Family
ID=78249271
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110838495.5A Active CN113589927B (en) | 2021-07-23 | 2021-07-23 | Split screen display method, head-mounted display device and computer readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113589927B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104125452A (en) * | 2014-08-08 | 2014-10-29 | 北京行云时空科技有限公司 | Two-dimensional and three-dimensional image display and operation control system for stereoscopic glasses |
| CN104898280A (en) * | 2015-05-04 | 2015-09-09 | 青岛歌尔声学科技有限公司 | Display method of head-mounted display, and head-mounted display |
| CN105447898A (en) * | 2015-12-31 | 2016-03-30 | 北京小鸟看看科技有限公司 | Method and device for displaying 2D application interface in virtual real device |
| CN105847789A (en) * | 2016-03-31 | 2016-08-10 | 深圳多哚新技术有限责任公司 | Display screen driving method and device based on VR images |
| WO2018086295A1 (en) * | 2016-11-08 | 2018-05-17 | 华为技术有限公司 | Application interface display method and apparatus |
| CN112540709A (en) * | 2020-12-21 | 2021-03-23 | 维沃移动通信有限公司 | Split screen display method and device, electronic equipment and readable storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150138065A1 (en) * | 2013-11-21 | 2015-05-21 | Nvidia Corporation | Head-mounted integrated interface |
| US20150193102A1 (en) * | 2014-01-08 | 2015-07-09 | Microsoft Corporation | Multi-mode display system |
| JP6407824B2 (en) * | 2015-09-01 | 2018-10-17 | 株式会社東芝 | Glasses-type wearable terminal and method using the terminal |
| KR102599383B1 (en) * | 2018-10-26 | 2023-11-08 | 삼성전자 주식회사 | Electronic device for displaying an executable application on a split screen and method for the same |
-
2021
- 2021-07-23 CN CN202110838495.5A patent/CN113589927B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104125452A (en) * | 2014-08-08 | 2014-10-29 | 北京行云时空科技有限公司 | Two-dimensional and three-dimensional image display and operation control system for stereoscopic glasses |
| CN104898280A (en) * | 2015-05-04 | 2015-09-09 | 青岛歌尔声学科技有限公司 | Display method of head-mounted display, and head-mounted display |
| CN105447898A (en) * | 2015-12-31 | 2016-03-30 | 北京小鸟看看科技有限公司 | Method and device for displaying 2D application interface in virtual real device |
| CN105847789A (en) * | 2016-03-31 | 2016-08-10 | 深圳多哚新技术有限责任公司 | Display screen driving method and device based on VR images |
| WO2018086295A1 (en) * | 2016-11-08 | 2018-05-17 | 华为技术有限公司 | Application interface display method and apparatus |
| CN112540709A (en) * | 2020-12-21 | 2021-03-23 | 维沃移动通信有限公司 | Split screen display method and device, electronic equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113589927A (en) | 2021-11-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111459364B (en) | Icon updating method and device and electronic equipment | |
| TW201508695A (en) | Image processing method and device | |
| CN115600629B (en) | Vehicle information two-dimensional code generation method, electronic device and computer readable medium | |
| CN113521728A (en) | Cloud application implementation method and device, electronic equipment and storage medium | |
| CN114489896B (en) | Content display method and device, storage medium and electronic equipment | |
| CN113589926B (en) | Virtual interface operation method, head-mounted display device and computer readable medium | |
| CN113589927B (en) | Split screen display method, head-mounted display device and computer readable medium | |
| CN114125485B (en) | Image processing method, device, equipment and medium | |
| CN111199569A (en) | Data processing method and device, electronic equipment and computer readable medium | |
| CN115576470A (en) | Image processing method and apparatus, augmented reality system, and medium | |
| CN115082368A (en) | Image processing method, device, equipment and storage medium | |
| CN111915532B (en) | Image tracking method and device, electronic equipment and computer readable medium | |
| CN111290692B (en) | Picture display method and device, electronic equipment and computer readable medium | |
| CN114187169A (en) | Method, device and equipment for generating video special effect package and storage medium | |
| CN111367592B (en) | Information processing method and device | |
| CN110991312A (en) | Method, apparatus, electronic device, and medium for generating detection information | |
| CN110825480A (en) | Picture display method and device, electronic equipment and computer readable storage medium | |
| CN114327316B (en) | Method, apparatus and computer program product for obtaining visual content | |
| US20240104703A1 (en) | Method and apparatus for adjusting image brightness, electronic device, and medium | |
| CN115619918A (en) | Image rendering method, device and equipment and storage medium | |
| CN117061684A (en) | Special effect video generation method and device, electronic equipment and storage medium | |
| CN115578299A (en) | Image generation method, device, equipment and storage medium | |
| CN116459508A (en) | Special effect prop generation method, picture processing method and device and electronic equipment | |
| CN117311882A (en) | Picture rendering method, device, equipment and medium | |
| CN113342220A (en) | Window rendering method, head-mounted display kit, and computer-readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Split screen display method, headworn display device, and computer readable medium Effective date of registration: 20231108 Granted publication date: 20230728 Pledgee: Guotou Taikang Trust Co.,Ltd. Pledgor: Hangzhou companion Technology Co.,Ltd. Registration number: Y2023980064432 |