CN113867603A

CN113867603A - Control method and device

Info

Publication number: CN113867603A
Application number: CN202111134791.3A
Authority: CN
Inventors: 王煜坤
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2021-09-27
Filing date: 2021-09-27
Publication date: 2021-12-31

Abstract

In the application of using the first display screen and the second display screen for content display, due to the change of the viewing angle of the target object, a shielded area which is shielded by the second display screen may exist in the first display screen in the target sight direction, and the viewing of the display content of the shielded area by the target object in the target sight direction is influenced.

Description

Control method and device

Technical Field

The present disclosure relates to electronic technologies, and in particular, to a control method and apparatus.

Background

At present, in the use process of an electronic device such as a notebook computer, a desktop computer, a tablet computer, etc., because the size of a display area of a display screen of the electronic device is limited, another display device may need to be connected, and the display screen of the display device is utilized to realize display expansion of the electronic device, or another display screen of the electronic device is started to increase the display area of the electronic device.

However, in the process of displaying two display screens, one display screen often shields the other display screen, and this requires the user to continuously move and adjust the viewing angle to be able to see the required display content, which is very troublesome and affects the reading efficiency.

Disclosure of Invention

In view of the above, the present application proposes a control method, including:

if the first display screen is determined to have an occluded area occluded by the second display screen in the target sight line direction, obtaining first display content of the first display screen in the occluded area;

displaying the first display content of the occluded area in a first area of the second display screen, wherein the first area and the occluded area have a specific position relationship.

Optionally, wherein:

determining that the occluded region exists if it is determined that the second display screen is between a target object and the first display screen and that a first gaze region of the target object on the first display screen has a first relationship to a second gaze region thereof on the second display screen.

Optionally, the obtaining the display content of the first display screen in the occluded area includes:

determining an occluded area on the first display screen, and acquiring first display content of the occluded area;

wherein the determining of the occluded area on the first display screen comprises:

obtaining a first positional relationship between the first display screen and the second display screen, and determining the occluded area based on at least the first positional relationship; or the like, or, alternatively,

obtaining a first position relation between the first display screen and the second display screen and a second position relation between a target object and the second display screen, and determining the shielded area at least based on the second position relation and the first position relation; or the like, or, alternatively,

obtaining a second positional relationship between a target object and the second display screen and a third positional relationship between the target object and the first display screen, and determining the shielded area at least based on the second positional relationship and the third positional relationship; or the like, or, alternatively,

obtaining an occlusion region on the second display screen that occludes a target gaze direction of a target object, and determining the occluded region based at least on the occlusion region and the gaze direction.

Optionally, the method further includes:

determining an association relationship between first display content of the occluded area in the first display screen and second display content of a second area, wherein the second area is at least a partial area of the first display screen except for the occluded area;

and displaying the first display content in the first area of the second display screen based on the association relation, and/or controlling at least the display output of the second area.

Optionally, the displaying the first display content in the first area of the second display screen based on the association relationship includes:

if the first display content and the second display content belong to the same content source, displaying the first display content in a first area of the second display screen, wherein the first area and the shielded area have a projection relation in the target sight line direction; and/or the presence of a gas in the atmosphere,

and if the first display content and the second display content do not belong to the same content source, displaying the first display content in a first area of the second display screen, wherein the first area is at least part of the display area of the second display screen.

Optionally, the controlling at least the display output of the second area includes:

controlling the display parameters of the second display content in the second area; or the like, or, alternatively,

controlling display parameters of the first display content and the second display content in the second area; or the like, or, alternatively,

controlling the display parameters of the first display content in a first area and the display parameters of the second display content in a second area; or the like, or, alternatively,

and controlling display parameters of third display content in the second area, wherein the third display content has no correlation with the first display content and/or the second display content.

Optionally, the determining the occluded area based on at least the second positional relationship and the first positional relationship includes:

determining an occlusion region on the second display screen for occluding a target sight direction of a target object based on the second positional relationship and the first positional relationship;

obtaining a projection area of the shielding area projected on the first display screen in the target sight line direction;

determining the occluded region based on the projected region.

Optionally, the determining, based on the second positional relationship and the first positional relationship, an occlusion region that occludes a target line of sight direction of the target object on the second display screen includes:

obtaining a first vertex position of the first display screen, a second vertex position of the second display screen and a target object position based on the second positional relationship and the first positional relationship;

obtaining a first intersection point position of the second display screen and a vertebral body formed by the target object and the first vertex of the first display screen based on the first vertex position, the second vertex position and the target object position;

determining an occlusion region on the second display screen for occluding a target sight direction of a target object based on the first intersection position and a target second vertex position; the target second vertex position refers to a position of a second vertex on the second display screen, which blocks the target sight line direction of the target object.

Optionally, the obtaining a first positional relationship between the first display screen and the second display screen and a second positional relationship between the target object and the second display screen includes:

acquiring first detection data obtained by a first detector of equipment where a second display screen is located and second detection data obtained by a second detector; the first detector is positioned on the surface of the second display screen; the second detector is located on an opposite side of the second display screen;

obtaining a second position relation between the target object and the second display screen based on the first detection data;

and obtaining a first position relation between the first display screen and the second display screen based on the second detection data.

The present application further proposes a control device, the device comprising:

the display content acquisition module is used for acquiring the display content of the first display screen in an occluded area if the first display screen is determined to have the occluded area occluded by the second display screen in the target sight line direction;

and the display processing module is used for displaying the display content of the shielded area in a first area of the second display screen, and the first area and the shielded area have a specific position relation.

The present application further proposes an electronic device, which includes:

at least one display screen

At least one memory for storing a program implementing the control method as described above;

at least one processor for loading and executing the program stored in the memory to implement the control method described above.

The present application also proposes a computer-readable storage medium, on which a computer program can be stored, which can be loaded and executed by a processor to implement the above-mentioned control method.

It can be seen that the present application provides a control method, apparatus, electronic device and computer readable storage medium, in an application for content display using a first display screen and a second display screen, due to a change in the viewing angle of a target object, may cause the first display screen to have an occluded area in the target viewing direction, which is occluded by the second display screen, to affect the viewing of the display content of the occluded area by the target object in the target viewing direction, in contrast, the first display content of the shielded area is obtained and is mapped to the first area of the second display screen for display, the target object does not need to move to change the viewing angle, the complete display content of the second display screen can be viewed by the target object in the target sight direction, the user experience is improved, and the reading efficiency of the display content of the second display screen is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.

Fig. 1 is a schematic diagram of a hardware structure of an alternative example of an electronic device suitable for use in the control method proposed in the present application;

fig. 2 is a schematic diagram of a hardware structure of still another alternative example of an electronic device suitable for use in the control method proposed by the present application;

FIG. 3 is a schematic flow chart diagram of some examples of the control method presented herein;

FIG. 4 is a schematic flow chart diagram of further examples of the control method set forth herein;

fig. 5 is a schematic view of an optional application scenario of an electronic device suitable for the control method proposed in the present application;

fig. 6a is a schematic view of another alternative application scenario of an electronic device suitable for use in the control method proposed in the present application;

fig. 6b is a schematic view of another alternative application scenario of an electronic device suitable for the control method proposed in the present application;

fig. 6c is a schematic view of another alternative application scenario of an electronic device suitable for the control method proposed in the present application;

FIG. 7 is a schematic flow chart diagram of further examples of the control method set forth herein;

FIG. 8 is a schematic flow chart diagram of further examples of the control method set forth herein;

FIG. 9 is a schematic flow chart diagram of further examples of the control method set forth herein;

FIG. 10 is a schematic flow chart diagram of further examples of the control method set forth herein;

FIG. 11 is a schematic flow chart diagram illustrating further examples of the control method set forth herein;

fig. 12 is a schematic diagram of a calculation method for obtaining a blocked area on a first display screen in the control method provided by the present application;

fig. 13 is a schematic structural diagram of an alternative example of the control device proposed by the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Referring to fig. 1, a schematic diagram of a hardware structure of an alternative example of an electronic device suitable for the control method proposed in the present application, which may include, but is not limited to, a smart phone, a tablet computer, a notebook computer, a desktop computer, and the like, as shown in fig. 1, the electronic device may include: at least one display screen 11 (fig. 1 only illustrates that the electronic device includes one display screen as an example), at least one memory 12, and at least one processor 13, where the display screen 11, the memory 12, and the processor 13 may be connected to a communication bus to implement data transmission therebetween through the communication bus, and the connection manner of these parts is not limited in this application.

The display screen 11 may be a touch display screen or a non-touch display screen, and the application does not limit the screen type, and it can be understood that the display screen 11 may display the content received by the electronic device and sent by other electronic devices, and may also display the content generated by the electronic device itself, and the application does not detail the display operation principle of the display screen 11.

In some embodiments, in order to extend the display area of the electronic device, the electronic device may be configured with a plurality of display screens 11, for example, a dual-screen electronic device, and one display screen 11 may be configured on both the a-side and the B-side of the electronic device, so that users located in different directions of the electronic device may view required display contents through different display screens 11, for example, by performing position tracking detection on the user, mapping target display contents onto a display screen within the current sight range of the user for display, and the like.

It should be noted that, in the case where the electronic device is configured with a plurality of display screens 11, including but not limited to configuring the display screens 11 on the a-side and the B-side of the electronic device, and for an electronic device including at least two body components, such as a notebook computer, a display screen may also be configured on the C-side of the electronic device, such as configuring the display screens 11 on the B-side and the C-side, so as to implement content display on the same content source or different content sources, in this case, there is usually no obstruction in the line of sight direction of the user for the two display screens, and the present application may describe a display control process of two display screens located in the same electronic device and possibly having a line of sight obstruction, that is, a display control process of two display screens located on the a-side and the B-side of the same electronic device is described.

In the embodiment of the application, for example, two display screens (i.e., display screens on the a-side and the B-side) of the electronic device are simultaneously in a display working state, a user is located in any direction of the electronic device to view display content, and often only can see the display content of a certain display screen, for example, the display content of the a-side display screen is shielded by the display screen on the B-side when the user is located in front of the B-side, and under the condition that the user does not move the position, the display content of the a-side display screen is mapped to the first area of the B-side display screen for display. The first area may be at least a part of the display area of the B-side display screen, and a specific positional relationship when content mapping is performed between the two display screens may be configured in advance, so that the display content on one display screen is mapped to the other display screen for display according to the specific positional relationship.

In still other embodiments, as for the method for implementing display expansion of an electronic device, another electronic device (i.e., a terminal having a display screen, which may be referred to as a display device for convenience of description) may be directly connected to the electronic device externally, and especially in the case that the electronic device has one display screen, the display expansion of the electronic device may be implemented by using such a method of connecting the display device externally, and details of the implementation of the display expansion are not described in this application.

In the other embodiments, if the electronic device and the display device connected thereto are placed on a shelf of the same desk or the like, the electronic device and the display device may be placed in a staggered manner due to limited space of the shelf, so that when a user views display content in a certain direction of the electronic device, the display screen of the electronic device may block a part of the display area of the display screen of the display device in the target line of sight direction, so that the user cannot completely view the display content on the display screen of the display device. In contrast, according to the present application, the display content of the blocked area on the display device is mapped to the non-blocked display area, for example, the display screen of the electronic device or the non-blocked display area of the display device is displayed, so that the requirement of the user for viewing the display content of the blocked area on the display device is met, the implementation process may refer to the following description of the corresponding part of the method embodiment, which is not repeated in this embodiment.

The memory 12 may be used to store a program implementing the control method proposed in the present application; the processor 13 may load and execute the program stored in the memory 12 to implement the steps of the control method proposed in the present application.

In the present embodiment, the memory 12 may include a high speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device or other volatile solid state storage device. The processor 13 may be a Central Processing Unit (CPU), an application-specific integrated circuit (ASIC), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA), or other programmable logic devices.

It should be understood that the structure of the electronic device shown in fig. 1 does not constitute a limitation to the electronic device in the embodiment of the present application, and in practical applications, the electronic device may include more components than those shown in fig. 1, or may combine some components, such as the position sensor (e.g., laser sensor, radar sensor, etc.), the communication interface (e.g., display expansion interface, USB interface, serial/parallel port, multimedia communication interface, etc.), the camera, the microphone, the sound pick-up, the power manager, the antenna, etc., as shown in fig. 2, which may be determined according to the product type of the electronic device and the functional requirements thereof, and this application is not listed here.

Referring to fig. 3, a flowchart of an alternative example of the control method proposed by the present application, which may be executed by an electronic device, and the structure of the electronic device and the display application scenario of the electronic device described in the foregoing embodiments are described, as shown in fig. 3, the control method proposed by the present embodiment may include, but is not limited to, the following steps:

step S11, if it is determined that the first display screen has an occluded area occluded by the second display screen in the target sight line direction, obtaining first display content of the first display screen in the occluded area;

in this embodiment, in combination with the above description of the display application scenario of the electronic device, the second display screen is a display screen on the electronic device, and the first display screen may be a display screen on the electronic device or a display screen of another electronic device connected to the display expansion interface of the electronic device, which is not limited in this application.

In the case that the first display screen and the second display screen are located on different planes, when a user (i.e., a target object) views display content of the display screens, the second display screen may block at least a part of a display area of the first display screen in a target line-of-sight direction of the user and mark as a blocked area, so that the user cannot see the display content of the blocked area at the viewing angle.

In step S12, the first display content of the occluded area is displayed in the first area of the second display screen, and the first area and the occluded area have a specific positional relationship.

In the case that the first display screen has a blocked area blocked by the second display screen in the target sight line direction, it can be known that the second display screen is closer to the target object (such as the user mentioned above) relative to the first display screen in the target sight line direction, and the target object can see the complete display content of the second display screen.

Moreover, the first area and the blocked area may have a specific position relationship, for example, the first area may block the blocked area in the target sight line direction; of course, the first area may also be any display area on the second display screen, in this case, the blocking relationship between the first area and the blocked area in the target sight line direction is not restricted, the specific positional relationship may be configured in advance according to an actual situation, and the content of the specific positional relationship is not limited by the present application.

In summary, in the embodiment of the present application, in an application that uses a first display screen and a second display screen to perform content display, due to a change in a viewing angle of a target object, a blocked area that is blocked by the second display screen may exist in the first display screen in a target viewing direction, which may affect a viewing of the display content of the blocked area by the target object in the target viewing direction.

Referring to fig. 4, a flow chart of another optional example of the control method proposed by the present application is schematically illustrated, and the embodiment of the present application may be implemented by an optional detailed implementation method of the control method described above, but is not limited to the detailed implementation method described in the present embodiment. As shown in fig. 4, the method may include:

step S21, if it is determined that the second display screen is located between the target object and the first display screen, and the first watching area of the target object on the first display screen has a first relation with the second watching area of the target object on the second display screen, determining an occluded area of the first display screen in the target sight line direction, which is occluded by the second display screen;

in practical application, it is assumed that the first display screen and the second display screen are located on different electronic devices, if the two electronic devices are in the position relationship as shown in fig. 5, the device where the second display screen is located between the target object and the device where the first display screen is located, and when the target object looks at the first display screen and the second display screen, the target object can see the first watching region of the first display screen in the target sight line direction, and can see the second watching region of the second display screen in the target sight line direction at the same time.

It is understood that in the application scenario as shown in fig. 5, the first gaze area may be at least a partial display area of the first display screen, and in general, the first gaze area may be a global display area of the first display screen; the second gazing area may be at least a partial display area of the second display screen, and is usually a global display area of the first display screen if the second display screen has an area in the target sight line direction, which is blocked by the first display screen. But the display content of the second gaze area may be occluded in the target gaze direction.

It can be seen that, the first relation between the first gazing area and the second gazing area may include, but is not limited to, a projection relation, an occlusion relation, an overlapping relation, etc., that is, the second gazing area may occlude at least a part of the first gazing area in the target viewing direction, or at least a part of the projection of the second gazing area in the target viewing direction may fall within the first gazing area; or at least different overlapping areas of the first and second gaze areas in the target gaze direction. In practical application, the first relation between the first gazing area and the second gazing area is determined through a corresponding detection mode, and the blocked area on the first display screen can be determined.

In still other embodiments of the present disclosure, if the first display screen and the second display screen are located on different planes of the same electronic device, as shown in the scene diagrams of different display forms of the electronic device shown in fig. 6a, 6b, and 6c, in the case that the relative position between the target object and the electronic device is different, that is, the target object is located at different orientations of the electronic device, and the multi-screen electronic device is located in different display forms, the first display screen and the second display screen may be located on different planes of the electronic device.

For example, as shown in fig. 6a, the a side of the electronic device configures a first display screen, the B side configures a second display screen, and the B side and the C side of the electronic device form a first angle (e.g., 90 degrees, etc.), and in a case where a user views display content toward the B side, the first display screen is completely blocked by the second display screen, so that, in an application scenario as shown in fig. 6a, a global display area of the first display screen is a blocked area blocked by the second display screen in a target sight line direction.

Similarly, in the application scenario shown in fig. 6B, the user moves to the a-plane position of the electronic device, and the line of sight is oriented in the a-plane direction, in which case, the display screen on the a-plane of the electronic device may be the second display screen, and the display screen on the B-plane or C-plane may be the first display screen. And under the target sight direction in the current state, the global display area of the first display screen is shielded by the second display screen, and the shielded area is the global display area of the first display screen.

In the application scenario shown in fig. 6C, the B-plane and the C-plane of the electronic device form a second angle (which is an acute angle greater than 90 degrees), the display screen of the user facing the C-plane is the second display screen, and the display screen on the B-plane is the first display screen. In this display form of the electronic device, the occluded area of the first display screen that is occluded by the first display screen in the target view direction is a global display area of the first display screen.

In relation to the application scenarios of the multi-screen electronic device shown in fig. 6a, 6b, and 6c under different display forms, a first relationship between a first gaze region of a target object on a first display screen and a second gaze region on a second display screen may be combined with the description of the corresponding portion of the extended display embodiment in connection with the external display of the electronic device, which is not repeated in this embodiment. It can be understood that, in the application of the multi-screen electronic device, the occlusion relationship, the projection relationship, or the overlapping relationship between the first gazing area and the second gazing area may be determined by combining an angle between a plurality of bodies of the electronic device, that is, a display form of the electronic device, and specific contents of the first relationship are not described in detail in this application.

Step S22, determining an occluded area on the first display screen, and acquiring first display content of the occluded area;

as can be seen from the above description of the embodiments, the first display screen and the second display screen may be located on the same electronic device or on different electronic devices, and in different cases, the position of the occluded area on the first display screen is different, which may be a global display area of the first display screen or a local display area of a certain position in the display area of the first display screen, as the case may be.

Therefore, when the position of the blocked area on the first display screen is determined, the relationship between the device where the first display screen is located and the device where the second display screen is located can be determined, then, the position of the blocked area is further determined by combining the position relationship between the two display screens, and/or the position relationship between the display screens and the target object, and the like, and then, the first display content of the blocked area is acquired. It should be noted that, the method for acquiring the blocked area on the first display screen is not limited in the present application.

Optionally, for the position relationship between the different display screens and the position relationship between the target object and the display screen, a position sensor (e.g., a radar sensor) and an image collector (e.g., a camera) configured on a corresponding plane of the electronic device may be started to perform data acquisition, and the corresponding position relationship is obtained through analysis according to the acquired position information and/or image information.

Step S23, determining the incidence relation between the first display content of the blocked area and the second display content of the second area in the first display screen;

in step S24, the first display content is displayed in the first area of the second display screen based on the association relationship.

In this embodiment of the application, the second region may be at least a partial region of the first display screen except for the occluded region, that is, the global display region of the first display screen at least includes the occluded region and the second region, and the display content of the second region is recorded as the second display content.

In general, the first display content and the second display content are from the same content source and are spliced to form complete display content, in this case, the target object often needs to see the first display content and the second display content at the same time, and therefore, when the association relationship between the first display content and the second display content is determined to represent that the first display content and the second display content are from the same content source, the first display content can be mapped to the first area of the second display screen for display, and thus, the target object can view the display content of the content source through the first area and the second area of the first display content.

It should be noted that, when the association relationship between the first display content and the second display content indicates other meanings, the first display content is not limited to be displayed in the first area of the second display screen, and the second area of the first display screen may also be controlled to output the first display content, and the implementation process of this embodiment is not described in detail. In addition, regarding the implementation process of displaying the first display content in the first area of the second display screen, reference may be made to the description of the corresponding part in the above embodiment, which is not repeated in this embodiment.

In addition, the association relationship between the first display content and the second display content may include a control relationship, a master-slave content relationship, an overall-division architecture relationship, and the like, in addition to a relationship of whether the first display content and the second display content are from the same content source, and the present application may configure a display control manner for the first display content in advance for different association relationships, for example, whether a display area of the first display content can occupy a display area of the second display content, and if so, how the first display content and the second display content are distributed and displayed in the second area; if not, a specific position relationship between the first area of the first display content on the second display screen and the shielded area can be configured, so that the display control of the first display content is realized.

For example, in the application scenario shown in fig. 5, the first display screen has a partial display area (i.e. an occluded area) occluded by the second display screen in the target viewing direction, and the first display content of the partial display area can be mapped to a first area of the second display screen, such as an occluded area that occludes the occluded area in the target viewing direction, and the first display content is displayed by the first area, so that the complete display content of the first display screen is viewed from the current viewing angle of the target object.

In the application scenario shown in fig. 6a, 6b, or 6c, the global display area of the first display screen is blocked by the second display screen, so that the first display content of the blocked area is the global display content of the first display screen, and the second area does not exist, at this time, if the target object does not want to move to adjust the viewing angle, the display content of the first display screen can be switched to the second display screen for displaying, at this time, the global display area of the second display screen can display the first display content, or the local display area of the second display screen can display the first display content according to a preset specific position relationship, and the other display areas display the original display content of the second display screen, which is denoted as the third display content, and the application does not limit the method for implementing the display of the first display content by the second display screen in the scenario, as the case may be.

In further embodiments provided by the present application, after obtaining the first display content of the blocked area, the present application may also directly map the first display content to the first area of the second display screen for display according to the implementation manner shown in fig. 3 above, and the implementation process is not described in detail in this embodiment.

In summary, in the case that the first display screen has an occluded area occluded by the second display screen in the target visual line direction, in order to enable the target object to see the first display content of the occluded area in the target sight line direction, after the occluded area on the first display screen is determined, first display content of the occluded area can be acquired, and then, mapping the first display content to an unoccluded display area for displaying can be determined according to the incidence relation between the first display content and second display content of a second area on the first display screen, if the first display content is displayed in the first area of the second display screen, the target object does not need to move to adjust the viewing angle, the first display content and the second display content can be watched through different display screens, and the complete watching requirement of the display content of the first display screen is met.

Referring to fig. 7, which is a flowchart illustrating a further optional example of the control method proposed by the present application, the present application may implement the above-described further optional detailed implementation method of the control method, such as a further implementation manner of switching display of the first display content of the occluded region of the first display screen, which may be applied to, but is not limited to, the electronic device application scenarios shown in fig. 5 and fig. 6a, fig. 6b, fig. 6c, and so on. As shown in fig. 7, the method may include:

step S31, determining an occluded area which is present in the first display screen in the target sight line direction and is occluded by the second display screen, and acquiring first display content of the occluded area;

step S32, determining the incidence relation between the first display content of the blocked area and the second display content of the second area in the first display screen;

regarding the implementation process of step S31 and step S32, reference may be made to the description of the corresponding parts in the above embodiments, which is not repeated in this embodiment.

Step S33, if the association relationship indicates that the first display content and the second display content belong to the same content source, displaying the first display content in the first area of the second display screen; the first area and the shielded area have a projection relation in the target sight line direction;

step S34, if the association relationship indicates that the first display content and the second display content do not belong to the same content source, displaying the first display content in a first area of the second display screen, where the first area is at least a partial display area of the second display screen.

In the embodiment of the application, under the condition that the association relationship indicates whether the two display contents belong to the same content source, the identification information of the respective content sources of the first display content and the second display content can be obtained, and if the two identification information are the same through comparison, the two display contents can be considered to be from the same content source; conversely, the two display contents may be from different content sources, but are not limited to the identification information detection implementation method.

Following the analysis of the above corresponding parts, in the case that it is determined that the first display content and the second display content belong to the same content source, the target object often needs to view the first display content and the second display content at the same time, and the first display content may be mapped to a first region of the second display screen for display, where the first region and the occluded region have a projection relationship in the target line of sight direction, for example, the first region may be projected to the occluded region in the target line of sight direction, so the first region may be used as a display content compensation region of the occluded region, so that the first region has a compensation relationship with the occluded region in terms of visual effect, and in the case that the first region displays the first display content, from the perspective of visual effect, the complete display content of the first display screen is relatively viewed.

In some embodiments, the first display content and the second display content on the first display screen may also come from different content sources, and in this case, the first display content may still be displayed in the first area having a projection relationship with the occluded area on the second display screen according to the display switching processing method described above, as the content is described in step S33; in yet another possible implementation manner, as described in step S34, for the display contents of different content sources, the present application may also map the first display content to at least a portion of the display area of the second display screen, so as to facilitate the simultaneous viewing requirement of the two display contents of the target object.

In still other embodiments provided by the application, whether the first display content and the second display content are from the same content source or not, the first display content may be directly mapped to at least a part of the display area of the second display screen for display, and is not limited to a part of the display area of the second display screen having a projection relationship with the shielded area in the target viewing direction, so that flexibility of switching display control of the shielded display content in the target viewing direction is improved, and reading reliability is improved.

Referring to fig. 8, which is a schematic flow chart of a further optional example of the control method proposed by the present application, an embodiment of the present application may implement the further optional detailed implementation method of the control method described above, different from the implementation method of displaying the first display content by the first area of the second display screen described in the above embodiment, the present embodiment proposes to control at least the display output of the second area of the first display screen after obtaining the first display content of the occluded area, such as displaying the first display content by the second area, but is not limited to this switching display control method. As shown in fig. 8, the method may include:

step S41, determining an occluded area which is present in the first display screen in the target sight line direction and is occluded by the second display screen, and acquiring first display content of the occluded area;

step S42, determining the incidence relation between the first display content of the blocked area and the second display content of the second area in the first display screen;

regarding the implementation processes of step S41 and step S42, reference may be made to the description of the corresponding parts in the above embodiments, which is not repeated in this embodiment.

In step S43, based on the association, the display parameters of the first display content and the second display content in the second area are controlled.

In the embodiment of the present application, by analyzing the relevance between the first display content and the second display content, if the first display content and the second display content belong to the same content source, and if a control relationship, a master-slave content relationship, a total-branch architecture relationship, and the like exist, it may be determined, according to an analysis result, whether the first display content is to be mapped to the second display screen for display, or mapped to the second area of the first display screen for display, and this embodiment describes a control method for mapping to the second area for display.

Based on the analysis, it is determined that the first display content and the second display content can be displayed in the second area in the scene where the first display content is mapped to the second area of the first display screen for display, and in this case, the application does not limit the display mode of the first display content and the second display content on the second area. The display manner may be determined based on the position relationship of the first display content and the second display content determined by the position in the display area of the second area, such as picture-in-picture display (for example, the first display content is displayed at any position in the second display content as an illustration of the second display content), tiling (for example, the display areas of the two display contents are horizontally or vertically tiled), splicing (for example, the first display content is merged into the second display content, the display content arrangement is readjusted), and floating (for example, the display area of the first display content is positioned above the display area of the second display content and the floating display area is closed after the user views the first display content), but is not limited to the display manners listed in this embodiment.

It should be noted that, for the display parameters of the controlled second area, in addition to the display manner, the respective explicit states of the first display content and/or the second display content may also be included, for example, by updating the content display size, the color, and the like of the first display content and/or the second display content, or displaying the background color, and the like, so as to sequentially implement the highlighting of the target display content (e.g., at least a part of the first display content and/or the second display content). The present application does not limit the content of the display parameters and the control implementation method thereof.

In summary, under the condition that the first display screen has the shielded area shielded by the second display screen in the target sight line direction, the method and the device can map the first display content of the shielded area to the second area of the first display screen, control the second area to display the first display content and the second display content originally displayed in the second area, meet the watching requirement of the target object on the first display content, do not need to map the first display content to the first area of the second display screen, and avoid the interference on the operation work of the second display screen.

Based on the control methods described in the foregoing embodiments, in still other embodiments, for the first display content in the occluded region, the application may map the first display content to the first region of the second display screen for display, and at the same time, control at least the display output of the second region of the first display screen, such as control the display parameters of the second display content in the second region. In combination with the above description of the display parameters, the present application can control the display position of the second display content in the second area, whether to highlight (the implementation method thereof may refer to the description of the corresponding part of the above embodiment, and the description is not repeated in this embodiment), and the like, so as to meet the display requirement of the second display content.

In yet another possible implementation manner, in the case that the first display content is mapped to the first area of the second display screen as described above, the application may further control the display parameter of the first display content in the first area and the display parameter of the second display content in the second area, so as to determine the display position, the display state, the display manner, and the like of the first display content in the first area and the display position, the display state, and the like of the second display content in the second area. Regarding the implementation process of controlling the display parameters, reference may be made to the description of the corresponding parts of the above embodiments.

In still other embodiments, whether the first display content is mapped to the first area for display or mapped to the second area for display, in addition to the control of the display parameter of the corresponding area according to the above-described method, the display parameter of the third display content in the second area may be controlled, where the third display content may refer to a display content that has no association relationship with the first display content and/or the second display content, and the content of the controlled display parameter of the third display content in the second area may be determined according to the display control requirement of the electronic device, which is not displayed in this application, and may include, but is not limited to, the above-described display position, display state, and/or display manner, and the like.

Referring to fig. 9, which is a flowchart illustrating a further optional example of the control method proposed by the present application, an embodiment of the present application may implement the further optional detailed implementation method of the control method described above, such as, but not limited to, the implementation method of determining the occluded area on the first display screen described in the above embodiment, which is detailed. As shown in fig. 9, the method may include:

step S51, determining that a shielded area shielded by the second display screen exists in the first display screen in the target sight line direction, and obtaining a first position relation between the first display screen and the second display screen;

referring to the application scenario diagram of the electronic device shown in fig. 6a, the electronic device may determine a first positional relationship between a first display screen and a second display screen by detecting its own configuration parameters, for example, the first display screen is located on an a-plane of the electronic device, and the second display screen is located on a B-plane of the electronic device, but is not limited to this detection implementation method.

Step S52, determining an occluded area on the first display screen at least based on the first position relation;

step S53, acquiring first display content of the blocked area;

in step S54, the first display content is displayed in the first area of the second display screen.

Based on the above analysis, it is determined that the first display screen and the second display screen are located on the same electronic device and are respectively located on the a-side and the B-side of the electronic device based on the first position relationship between the first display screen and the second display screen, as shown in the application scenario shown in fig. 6a, the occluded area on the first display screen can be directly determined as the whole display area thereof, and under the condition that the target object does not move, the display content of the first display screen can be directly mapped to at least a part of the display area of the second display screen for display.

In still other embodiments, in order to improve the accuracy of determining the blocked area, especially in a scene where the first display screen is determined to be located on the a side of the electronic device and the second display screen is determined to be located on the C side of the electronic device, the method and the device may further perform eye tracking detection on the target object to obtain a gaze direction or a gaze area of the target object, so as to determine the blocked area of the first display screen according to the latest detected gaze direction or gaze area, and further determine the first area, which is not described in detail in the present application.

In still other embodiments provided by the present application, in combination with the application scenario shown in fig. 5, in a case that the first display screen and the second display screen are located on different electronic devices, in order to determine the occluded area of the first display screen, the present application may be implemented in combination with a relative position relationship between the first display screen, the second display screen, and the target object, with reference to a flowchart shown in fig. 10, the method includes:

step S61, determining that a shielded area shielded by a second display screen exists in the first display screen in the target sight line direction, and obtaining a first position relation between the first display screen and the second display screen and a second position relation between a target object and the second display screen;

in practical application, position sensors such as laser radar can be configured on the surface A and the surface B of the electronic equipment, three-dimensional scanning and modeling of a front object are achieved by using detection signals sensed by the position sensors, and therefore a first position relation such as a relative position and a distance between the two pieces of electronic equipment is determined. The present application does not limit the method for obtaining the first positional relationship and the second positional relationship in this embodiment.

For example, a laser radar may be configured in the middle of the a-plane of the second electronic device where the second display screen is located, or two laser radars may be configured on two sides of the a-plane, respectively, and the first electronic device where the first display screen is located may be scanned and modeled three-dimensionally by using the functions of the laser radars that can achieve high-precision ranging and detection at millimeter level, which will not be described in detail in the present application. Similarly, similar to the acquisition of the second position relationship between the second electronic device and the target object, the laser radar may be configured at the middle position or at the two side positions of the B-plane of the second electronic device, so as to implement three-dimensional scanning and modeling of the target object.

In still other embodiments, the present application may further use an image collector configured on the a-plane, such as a camera, to collect an image of an object in a shooting range in front of the a-plane, that is, to collect an image of the first electronic device, and determine, by analyzing the collected image content (which may include the display content of the first display screen), that the device shielded by the second electronic device is the first electronic device connected to the second electronic device, which is not described in detail in this embodiment of the implementation process.

Step S62, determining an occluded area on the first display screen based on at least the second positional relationship and the first positional relationship;

in this embodiment of the application, based on the first positional relationship and the second positional relationship, the position coordinates of the first display screen, the second display screen, and the target object in the same coordinate system may be determined, and then, the position of the blocked region on the first display screen may be obtained through calculation in combination with the projection coordinate operation relationship, and the position of the blocked region on the second display screen that blocks the blocked region in the target sight line direction may also be obtained, and the calculation process may refer to the description of the corresponding portion of the following embodiment, which is not described in detail in this embodiment.

In still other embodiments, in the case of obtaining the second positional relationship between the target object and the second display screen, the application may also obtain a third positional relationship between the target object and the first display screen, perform eye tracking detection on the target object, determine a focal position of the gaze direction of the target object on the second display screen, obtain a gaze area of the target object on the second display screen according to the preset visual range and the second positional relationship, and similarly obtain the gaze area of the target object on the first display screen. Then, the occluded area on the first display screen, that is, the occluded area in the gazing area, may be determined according to a first gazing area of the target object on the first display screen and a second gazing area on the second display screen, respectively, and the application may not pay attention to the occluded area of the non-gazing area on the first display screen.

In still other embodiments presented herein, to determine the occluded area on the first display screen, the present application may obtain an occluded area on the second display screen that occludes the target gaze direction of the target object, and then determine the occluded area on the first display screen based on at least the occluded area and the gaze direction. In combination with the above description, the present application may determine the position of the occlusion region according to the eyeball tracking detection result and the first position relationship between the first display screen and the second display screen, and then calculate the projection region of the occlusion region on the first display screen in the target sight direction, that is, the occluded region of the first display screen, by using a projection operation method, which is not described in detail in the present application.

Step S63, acquiring first display content of the blocked area;

in step S64, the first display content is displayed in the first area of the second display screen or the second area of the first display screen.

In the application scenario shown in fig. 5, for the first display content in the blocked area on the first display screen, the first display content may be mapped to the first area of the second display screen or the second area of the first display screen for display according to the description method of the corresponding part in the above embodiment, which is not repeated in this embodiment of the implementation process.

In still other embodiments provided by the present application, the camera on the B-plane may be further utilized to perform eye tracking detection on the target object to determine the gaze direction of the target object and/or the gaze area on each display screen, so as to determine the target display screen where the gaze focus of the target object is located according to the gaze direction, and if the target display screen is the third area of the second display screen (i.e., the display area excluding the overlapping area with the first display screen in the gaze direction), or the target display screen is the second area of the first display screen, the display content switching control described in the above embodiments may not be executed; if the target display screen is an overlapping area of the first display screen and the second display screen, a historical watching area before the sight line direction of the target object moves to the overlapping area can be obtained, the first display screen or the second display screen where the historical watching area is located is determined as a new target display screen, and then display control is achieved according to the method described above.

Referring to fig. 11, which is a flowchart illustrating some further examples of the control method proposed by the present application, this embodiment may be an optional detailed implementation method described above for determining an occluded area on the first display screen, an implementation method how to determine an occluded area on the first display screen based on at least the second positional relationship and the first positional relationship, but is not limited to this detailed implementation method, and as shown in fig. 11, the method may include:

step S71, acquiring first detection data acquired by a first detector of the device located on the second display screen and second detection data acquired by a second detector;

step S72, based on the first detection data, obtaining a second position relation between the target object and a second display screen; obtaining a first position relation between a first display screen and a second display screen based on second detection data;

in conjunction with the description of the corresponding parts of the above embodiments, the first detector and the second detector may include, but are not limited to, a position sensor such as a lidar, and may further include an image collector as needed. Regarding the implementation method for obtaining the first positional relationship between the first display screen and the second display screen, and the second positional relationship between the target object and the second display screen, the implementation method includes, but is not limited to, the implementation methods described in the above steps S71 and S72.

Step S73, based on the second position relation and the first position relation, obtaining a first vertex position of the first display screen, a second vertex position of the second display screen and a target object position;

still taking the application scenario of the electronic device shown in fig. 5 as an example for explanation, in order to determine the position of the occluded area on the first display screen, the method may adopt a projection coordinate operation manner in the same coordinate system to obtain, assuming that the first display screen is a plane ABCD, the second display screen is a plane FGKJ, the target object (e.g., the head or the eyes of the user) is E, and the plane where the first display screen is located is an xOy coordinate system plane, and a vertical line passing through the center of the first electronic device where the first display screen is located is a z-axis, so as to construct a spatial rectangular coordinate system.

After the first positional relationship and the second positional relationship are obtained, the first positional relationship and the second positional relationship are mapped to the constructed coordinate system, and the first vertex position of the first display screen, the second vertex position of the second display screen, and the target object position can be determined by combining the configuration parameters of the first display screen and the second display screen, for example, the width of the first display screen is 2a, and the height of the first display screen is 2B, that is, each first vertex coordinate of the first display screen can be a (a, B,0), B (-a, B,0), C (-a, -B,0), D (a, -B,0), and the target object E (x) (x, y_E,y_E,z_E) Each second vertex coordinate of the second display screen may be F (x)_F,y_F,z_F)、G(x_G,y_G,z_G)、K(x_K,y_K,z_K)、J(x_J,y_J,z_J) These position coordinates are known quantities in the constructed coordinate system.

Step S74, obtaining a cone formed by the target object and the first vertex of the first display screen and a first intersection point position of the cone and the second display screen based on the first vertex position, the second vertex position and the target object position;

as shown in fig. 12, connecting the target object E with each first vertex of the first display screen may form a rectangular pyramid E-ABCD, which intersects the second display screen FGKJ to obtain an intersection region FLIH, which may be an occlusion region FLIH of the second display screen in the target line of sight direction, and which is a projection region projected onto the first display screen in the target line of sight direction, that is, an occluded region PNCO of the first display screen. In order to determine the position of the occlusion region FLIH, the positions of the vertices F and H of the occlusion region FLIH need to be obtained, and the positions of the vertices F and H are known.

For example, the present application uses a two-point linear equation to represent each line, and uses a three-point planar equation to represent each plane, but the present application is not limited to this equation representation. Thus, the equation for the straight line FJ can be expressed as:

the equation for the plane BEC formed by the connection of the target object E with the first vertices B and C may be expressed as:

the coordinates of the first vertices B and C, i.e., B (-a, B,0), C (-a, -B,0), are substituted into the equation of the plane BEC, which can be transformed into

Through the reduction operation, the following results can be obtained: -2bz (x)_E+a)+2bz_E(x + a) ═ 0. Then, the equation of the deformed plane BEC and the equation of the straight line FJ can be solved to obtain an intersection point L (x) of the plane BEC and the straight line FJ_L,y_L,z_L)。

Similarly, the equation of the straight line EC and the equation of the plane FGKJ are substituted into the coordinates of the known vertex positions and then the equation is solved, namely the equation is solved

The first intersection point I (x) of the surface FGKJ and the straight line EC can be obtained by solving_I,y_I,z_I)。

Similarly, the equation of the screen ECD formed by the object E connected with the first vertices C and D can be expressed as

Substituting the coordinates of the first vertex C and D to obtain the coordinate

Equation of plane ECD after deformation processing and equation of straight line FG

Solving to obtain the intersection point H (x) of the surface ECD and the straight line FG_H,y_H,z_H)。

Step S75, determining an occlusion area on the second display screen for occluding the target sight line direction of the target object based on the first intersection point position and the target second vertex position;

in the embodiment of the present application, the target second vertex position refers to a position of a second vertex on the second display screen, which blocks the target sight line direction of the target object, that is, F (x)_F,y_F,z_F). Thus, the first intersection position, i.e. I (x), calculated in combination with the above_I,y_I,z_I)、L(x_L,y_L,z_L) And H (x)_H,y_H,z_H) The position of the occlusion region FLIH on the second display screen in the coordinate system can be determined.

Step S76, obtaining a projection area of the shielding area projected on the first display screen in the target sight line direction;

in step S77, an occluded area is determined based on the projected area.

Referring to fig. 12, in the case of obtaining the position of the occlusion region FLIH in the coordinate system and the position of the target object E, a projection region of the occlusion region on the second display screen projected onto the first display screen in the target visual line direction, that is, an occluded region on the first display screen may be determined using the first intersection position of different first intersections and the target second vertex position.

For example, the intersection point position on the first display screen and the extended line of the vertex connecting the target object E and the occlusion region FLIH is obtained by the intersection point calculation method described above, and the z-axis coordinate of the vertex of the first display screen ABCD is 0, so the equation z of the plane ABCD is 0.

Equation of straight line EF

Equation of the straight line EL

Equation of straight line EH is

Solving the equation of the straight line EF and the plane ABCD can obtain the coordinate data P (x) of the intersection point P of the straight line EF and the plane ABCD_P,y_P,z_P) To solve the equation

Can obtain

z_P＝0。

Similarly, the equation of the line EL and the equation of the plane ABCD can be solved as described above to obtain the intersection point N (x)_N,y_N,z_N) I.e. by

z_N0; solving the equation of the straight line EH and the face ABCD to obtain an intersection point O (x)_O,y_O,z_O) Of (i) a

z_OThe calculation process for solving the above equation of the straight line and the plane is not described in detail in this application.

Based on the calculation, the position of the sheltered area PNCO on the first display screen can be calculated. It is noted that the implementation of how to determine the occluded area based on the second positional relationship and the first positional relationship includes, but is not limited to, the above listed implementation.

Based on the above-described control method, after the blocked region of the first display screen is determined, the first display content of the blocked region may be obtained, for example, the pixel position and the pixel value of any pixel point located in the blocked region are obtained according to the first positional relationship, then, when the first display content is mapped to the first region of the second display screen or the second region of the first display screen for display, the target pixel position of the projection pixel point of the corresponding pixel point on the first region or the second region may be obtained according to the target opposite direction line of sight of the target object by using the pixel position and the first positional relationship, and the first region or the second region is controlled to display the first display content according to the mapping relationship between the target pixel position and the pixel value.

For example, assuming that the electronic device maps the first display content of the occluded area on the first display screen to the corresponding occluded area on the second display screen, as shown in fig. 12, the first display content of the occluded area PNCO is projected to the occluding area FLIH along the target object E, and any pixel point Q (x) on the occluded area PNCO is determined by combining the intersection calculation manner described above_Q,y_Q,z_Q) And projected to the position of the pixel point Q' on the shielded region FLIH.

Based on this, the equation for the straight line QE can be

Equation with plane FLIH

And (4) solving an equation to obtain the coordinates of the intersection point Q' of the straight line QE and the plane FLIH, wherein the calculation process is not detailed in the application.

According to the calculation mode described above, each pixel point on the shielded area PNCO can be obtained, the pixel point is controlled to output a corresponding pixel value according to the pixel point position projected to the shielded area FLIH in the opposite direction of the target sight, and the shielded area displays the first display content.

Referring to fig. 13, a schematic structural diagram of an alternative example of the control device proposed by the present application may include:

the display content acquiring module 21 is configured to, if it is determined that a blocked area blocked by a second display screen exists in the first display screen in the target sight line direction, acquire display content of the first display screen in the blocked area;

and the display processing module 22 is configured to display the display content of the occluded area in a first area of the second display screen, where the first area and the occluded area have a specific positional relationship.

In some embodiments, the display content obtaining module 21 may include:

a first determination unit, configured to determine that the occluded area exists when it is determined that the second display screen is located between a target object and the first display screen, and a first gaze area of the target object on the first display screen has a first relationship with a second gaze area thereof on the second display screen.

A second determination unit for determining an occluded area on the first display screen;

and the display content acquisition unit is used for acquiring the first display content of the shielded area.

Optionally, the second determining unit may include:

a first obtaining unit configured to obtain a first positional relationship between the first display screen and the second display screen;

a third determining unit, configured to determine the occluded area based on at least the first positional relationship;

optionally, the second determining unit may also include:

a second obtaining unit, configured to obtain a first positional relationship between the first display screen and the second display screen, and a second positional relationship between a target object and the second display screen;

a fourth determination unit for determining the occluded area based on at least the second positional relationship and the first positional relationship

Optionally, the second determining unit may also include:

a third obtaining unit configured to obtain a second positional relationship between a target object and the second display screen and a third positional relationship between the target object and the first display screen;

a fifth determination unit for determining the occluded area based on at least the second positional relationship and the third positional relationship

Optionally, the second determining unit may also include:

a fourth obtaining unit, configured to obtain a blocking area in a target view direction on the second display screen, where the target object is blocked;

a sixth determination unit for determining the occluded area based on at least the occluded area and the gaze direction.

In still other embodiments, the apparatus may further include:

an association relation determining module, configured to determine an association relation between first display content of the occluded area in the first display screen and second display content of a second area, where the second area is at least a partial area of the first display screen except for the occluded area;

accordingly, the display processing module 22 may include:

a first display processing unit configured to display the first display content in a first area of the second display screen based on the association relationship;

a display control unit for controlling at least display output of the second region;

or, the second display processing unit is configured to display the first display content in the first area of the second display screen based on the association relationship.

Optionally, the apparatus may include:

and the display control module is used for controlling the display output of at least the second area.

Optionally, the display processing unit for displaying the first display content in the first area of the second display screen may include:

a first display processing subunit, configured to display the first display content in a first area of the second display screen when the first display content and the second display content belong to a same content source, where the first area and the blocked area have a projection relationship in the target sight line direction; and/or the presence of a gas in the atmosphere,

and a second display processing subunit, configured to display the first display content in a first area of the second display screen when the first display content and the second display content do not belong to the same content source, where the first area is at least a partial display area of the second display screen.

Optionally, the display control unit or the display control module for controlling at least the display output of the second area may include any one of the following control units:

the first control unit is used for controlling the display parameters of the second display content in the second area;

a second control unit, configured to control display parameters of the first display content and the second display content in the second area;

a third control unit, configured to control a display parameter of the first display content in the first area and a display parameter of the second display content in the second area;

and the fourth control unit is used for controlling the display parameters of third display content in the second area, wherein the third display content has no relation with the first display content and/or the second display content.

In still other embodiments, the second obtaining unit may include:

the detection data acquisition unit is used for acquiring first detection data acquired by a first detector of equipment where the second display screen is located and second detection data acquired by a second detector; the first detector is positioned on the surface of the second display screen; the second detector is located on an opposite side of the second display screen;

and the first position relation obtaining unit is used for obtaining the first position relation between the first display screen and the second display screen based on the second detection data.

A second positional relationship obtaining unit configured to obtain a second positional relationship between the target object and the second display screen based on the first detection data.

In still other embodiments, the fourth determining unit may include:

an occlusion region determining subunit, configured to determine, based on the second positional relationship and the first positional relationship, an occlusion region that occludes a target sight line direction of the target object on the second display screen;

a projection area obtaining subunit, configured to obtain a projection area, in which the occlusion area is projected on the first display screen in the target sight line direction;

an occluded region determining subunit configured to determine the occluded region based on the projection region.

Optionally, the occlusion region determining subunit may include:

a position data obtaining subunit, configured to obtain, based on the second positional relationship and the first positional relationship, a first vertex position of the first display screen, a second vertex position of the second display screen, and a target object position;

an intersection position obtaining subunit, configured to obtain, based on the first vertex position, the second vertex position, and the target object position, a vertebral body formed by the target object and the first vertex of the first display screen, and a first intersection position between the vertebral body and the second display screen;

an occlusion region obtaining subunit, configured to determine, based on the first intersection position and the target second vertex position, an occlusion region that occludes a target sight line direction of the target object on the second display screen; the target second vertex position refers to a position of a second vertex on the second display screen, which blocks the target sight line direction of the target object.

It should be noted that, various modules, units, and the like in the embodiments of the foregoing apparatuses may be stored in the memory as program modules, and the processor executes the program modules stored in the memory to implement corresponding functions, and for the functions implemented by the program modules and their combinations and the achieved technical effects, reference may be made to the description of corresponding parts in the embodiments of the foregoing methods, which is not described in detail in this embodiment.

The present application further provides a computer-readable storage medium, on which a computer program may be stored, where the computer program may be called and loaded by a processor to implement the control method described in the foregoing embodiments, and details of the implementation process are not described in this embodiment.

Finally, it should be noted that, with respect to the above embodiments, unless the context clearly dictates otherwise, the words "a", "an" and/or "the" do not denote a singular number, but may include a plurality. In general, the terms "comprises" and "comprising" merely indicate that steps and elements are included which are explicitly identified, that the steps and elements do not form an exclusive list, and that a method or apparatus may include other steps or elements. An element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality" means two or more than two.

Reference herein to terms such as "first," "second," or the like, is used for descriptive purposes only and to distinguish one operation, element, or module from another operation, element, or module without necessarily requiring or implying any actual such relationship or order between such elements, operations, or modules. And are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated, whereby a feature defined as "first" or "second" may explicitly or implicitly include one or more of such features.

In addition, in the present specification, the embodiments are described in a progressive or parallel manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. The device and the electronic equipment disclosed by the embodiment correspond to the method disclosed by the embodiment, so that the description is relatively simple, and the relevant points can be referred to the method part for description.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method of controlling, the method comprising:

2. The method of claim 1, wherein,

3. The method of claim 1, the obtaining display content of the first display screen in the occluded region, comprising:

4. The method of any of claims 1 to 3, further comprising:

5. The method of claim 4, the displaying the first display content in the first area of the second display screen based on the association, comprising:

6. The method of claim 4, the controlling display output of at least the second region comprising:

7. The method of claim 3, the determining the occluded area based at least on the second positional relationship and the first positional relationship, comprising:

determining the occluded region based on the projected region.

8. The method of claim 7, the determining an occlusion region on the second display screen that occludes a target gaze direction of a target object based on the second positional relationship and the first positional relationship, comprising:

9. The method of claim 3, the obtaining a first positional relationship of the first display screen to the second display screen and a second positional relationship of a target object to the second display screen, comprising:

10. A control device, the device comprising: