CN112312042A

CN112312042A - Display control method, display control device, electronic equipment and storage medium

Info

Publication number: CN112312042A
Application number: CN202011193692.8A
Authority: CN
Inventors: 梁洪霞
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2020-10-30
Filing date: 2020-10-30
Publication date: 2021-02-02

Abstract

The application discloses a display control method and device, electronic equipment and a storage medium, and belongs to the technical field of electronic equipment. The method comprises the following steps: adjusting the bending angle of the flexible display control device; acquiring N frames of sub-video images collected by N cameras under the condition that the bending angle of the flexible display control device is larger than or equal to a preset angle threshold; then displaying a target video image, wherein the target video image comprises M video objects and is obtained based on N frames of sub video images; n, M are each integers greater than 1. Like this, in this application embodiment, when a plurality of video objects participated in the video conference through flexible display controlling means, through the adjustment to flexible display controlling means angle of buckling for flexible display controlling means can shoot all a plurality of video objects that need shoot in the video conference, can avoid appearing leaking the mirror, leak the condition of shooing, make the image that finally shows more comprehensive, complete, optimized the shooting effect.

Description

Display control method, display control device, electronic equipment and storage medium

Technical Field

The invention belongs to the technical field of electronic equipment, and particularly relates to a display control method and device, electronic equipment and a storage medium.

Background

In the intelligent era, electronic devices have been widely used in the work and life of users. Teleconferencing is a very important function of electronic devices. In the prior art, when a plurality of people utilize the same electronic equipment to participate in a remote video conference, the shooting range of the camera is limited, so that the conditions of lens leakage and shooting leakage are easy to occur, the finally displayed video image is incomplete and comprehensive, and the shooting effect is poor.

Disclosure of Invention

The embodiment of the application aims to provide a display control method, a display control device, electronic equipment and a storage medium, and can solve the technical problems that in the prior art, a camera is limited in shooting range, and lens leakage and shooting leakage are easy to occur.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a display control method, which is applied to a flexible display control device, and the method includes:

adjusting the bending angle of the flexible display control device;

acquiring N frames of sub-video images collected by N cameras under the condition that the bending angle of the flexible display control device is larger than or equal to a preset angle threshold;

displaying a target video image, wherein the target video image comprises M video objects, and the target video image is obtained based on the N frames of sub-video images; wherein N, M are each integers greater than 1.

In a second aspect, an embodiment of the present application provides a display control apparatus, including:

the adjusting module is used for adjusting the bending angle of the flexible display control device;

the acquisition module is used for acquiring N frames of sub-video images acquired by N cameras under the condition that the bending angle of the flexible display control device is greater than or equal to a preset angle threshold;

a display module, configured to display a target video image, where the target video image includes M video objects, and the target video image is obtained based on the N frame sub-video images; wherein N, M are each integers greater than 1.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or an instruction stored on the memory and executable on the processor, and when the program or the instruction is executed by the processor, the steps of the display control method according to the first aspect are implemented.

In a fourth aspect, the present application provides a readable storage medium, on which a program or instructions are stored, and when the program or instructions are executed by a processor, the program or instructions implement the steps of the display control method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the display control method according to the first aspect.

In the embodiment of the application, the bending angle of the flexible display control device is adjusted; acquiring N frames of sub-video images collected by N cameras under the condition that the bending angle of the flexible display control device is larger than or equal to a preset angle threshold; then displaying a target video image, wherein the target video image comprises M video objects and is obtained based on N frames of sub video images; wherein N, M are each integers greater than 1. Like this, in this application embodiment, through the adjustment to flexible display controlling means angle of buckling, when a plurality of video objects participated in the video conference through flexible display controlling means for flexible display controlling means can shoot all a plurality of video objects that need shoot in the video conference, can avoid appearing leaking the mirror, leak the condition of shooing, make the image that finally shows more comprehensive, complete, optimized the shooting effect.

Drawings

FIG. 1 is a flow chart illustrating the steps of a display control method according to an embodiment of the present application;

fig. 2 is a schematic diagram illustrating an initial state of a flexible display control apparatus according to an embodiment of the present application;

FIG. 3 is a schematic diagram illustrating bending of a flexible display control device according to an embodiment of the present application;

FIG. 4 is a schematic view showing bending of another flexible display control device in an embodiment of the present application;

FIG. 5 is a schematic view illustrating bending of another flexible display control device in an embodiment of the present application;

FIG. 6 is a schematic diagram illustrating an automatic bending angle adjustment according to an embodiment of the present application;

FIG. 7 is a schematic view of another embodiment of the present application showing automatic adjustment of the bend angle;

FIG. 8 is a diagram illustrating an embodiment of the present application prompting a user whether to zoom in;

fig. 9 is a schematic diagram illustrating a display of a current speaking object according to an embodiment of the present application;

fig. 10 is a schematic diagram illustrating an enlarged display of a current speaking object according to an embodiment of the present application;

fig. 11 is a schematic diagram illustrating a display of another current speaking object according to an embodiment of the present application;

fig. 12 is a schematic diagram illustrating an enlarged display of another current speaking object according to an embodiment of the present application;

fig. 13 is a flow chart of a panoramic video conference according to an embodiment of the present application;

fig. 14 is a schematic diagram illustrating confirmation of a panoramic conference shooting mode according to an embodiment of the present application;

fig. 15 is a block diagram showing a configuration of a display control apparatus according to an embodiment of the present application;

fig. 16 is a block diagram showing a structure of an electronic device according to an embodiment of the present application;

fig. 17 is a schematic diagram illustrating a hardware structure of an electronic device implementing various embodiments of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

A display control method, a display control apparatus, an electronic device, and a storage medium according to embodiments of the present application are described in detail below with reference to the accompanying drawings.

Referring to fig. 1, a flowchart illustrating steps of a display control method according to an embodiment of the present application, the method being applied to a flexible display control apparatus, the method including:

step 101, adjusting the bending angle of the flexible display control device.

In this embodiment, the flexible display control device may refer to an electronic device equipped with a flexible screen. The flexible screen may refer to a flexible screen, i.e., a screen using flexible organic light Emitting diodes (OLED flexible display, wherein the OLED is organic light-Emitting Diode). This flexible screen pliability is stronger, can buckle. The electronic device may be a smart phone, a notebook, a tablet computer, a vehicle-mounted computer, and the like, which is not limited in the embodiment of the present application. The bending angle can be used to characterize the degree of bending of the flexible display control device.

In this step, when the flexible display control device is bent, the shooting ranges of the M cameras are also changed. The bending angles are different, and the shooting range of the flexible display control device is also different. Specifically, during adjustment, the flexible display control device may be bent manually by a user, or may be bent automatically by the flexible display control device, which is not limited in the embodiment of the present application.

And 102, acquiring N frames of sub-video images acquired by N cameras under the condition that the bending angle of the flexible display control device is greater than or equal to a preset angle threshold value.

In this embodiment of the application, the preset angle threshold may refer to an angle at which the flexible display control device can shoot all video objects in a bending process. The preset angle threshold may be set by a user based on actual adjustment experience, or may be a default angle of the system, which is not limited in the embodiment of the present application. The N-frame sub video images may refer to video images respectively captured by the N cameras. The N cameras may refer to cameras disposed on a flexible screen in the flexible display control device. Wherein, N is for being greater than 1 integer, can be provided with two at least cameras on flexible display controlling means's the flexible screen promptly, and these two at least cameras can be arranged uniformly on flexible screen, constitute and take a photograph the array more, can guarantee like this that the scope that electronic equipment shot can change along with the change of angle of buckling. Of course, a plurality of cameras, for example, 3, 4, 5 or more cameras, may also be arranged on the flexible display control device, and may be specifically arranged according to actual shooting requirements, which is not limited in this embodiment of the present application.

It should be noted that in the embodiment of the present application, specifically, when the cameras are called to perform a video conference, the N cameras may be simultaneously turned on by default to ensure the integrity of video image shooting; the flexible display control device can be set to default to turn on one or two cameras according to the actual requirements of the user to reduce the power consumption of the electronic device, and more cameras can be turned on based on the shooting requirements of the user video conference subsequently.

In the step, in the process of bending the flexible display control device, the shooting range corresponding to each camera can move, and the shooting field range of the whole multi-camera array consisting of the N cameras is gradually enlarged. The flexible display control device acquires N frames of sub-video images acquired by the N cameras, and then the complete video images can be synthesized based on the sub-video images shot by the N cameras, so that the display range of the video images is expanded.

103, displaying a target video image, wherein the target video image comprises M video objects, and the target video image is obtained based on the N frames of sub video images; wherein N, M are each integers greater than 1.

In the embodiment of the application, the target video image may be a video image which is finally transmitted to other electronic devices in the process of the video conference. The video object may refer to a participant who participates in a video conference through the flexible display control device. The number of the video objects may be at least two, specifically, 6, 10 or more, and the number of the video objects is not limited in the embodiment of the present application.

In this step, when the bending angle of the flexible display control device is greater than or equal to the preset angle threshold, the flexible display control device can shoot all video objects in the video conference. At this time, N frames of sub-video images acquired by N cameras are acquired, and then a target video image is acquired through image synthesis and other modes based on the N frames of sub-video images. Therefore, the target video image is obtained through N frames of sub-video images shot by N cameras of the bent flexible display control device, the shooting range can be expanded, and the completeness and the comprehensiveness of the video image in the video conference are ensured.

In summary, in the display control method provided in the embodiment of the present application, the bending angle of the flexible display control device is adjusted; acquiring N frames of sub-video images collected by N cameras under the condition that the bending angle of the flexible display control device is larger than or equal to a preset angle threshold; then displaying a target video image, wherein the target video image comprises M video objects and is obtained based on N frames of sub video images; wherein N, M are each integers greater than 1. Like this, in this application embodiment, through the adjustment to flexible display controlling means angle of buckling, when a plurality of video objects participated in the video conference through flexible display controlling means for flexible display controlling means can shoot all a plurality of video objects that need shoot in the video conference, can avoid appearing leaking the mirror, leak the condition of shooing, make the image that finally shows more comprehensive, complete, optimized the shooting effect.

Optionally, in this embodiment of the application, before step 103, the display control method may further include the following steps (1) to (2):

and (1) extracting overlapped area images and non-overlapped area images among the N frames of sub video images.

In this embodiment of the present application, the overlapped area image may refer to an area image with the same image content in the N frames of sub video images. The non-overlapped region image may refer to a region image in which image contents are different in the N-frame sub video images.

Specifically, in the process of bending the flexible display control device, there may be an overlapping region between the shooting field ranges of the cameras, so that the N cameras may shoot images with partially the same content, and the image part with the same content is an overlapping region image in the N frames of sub-video images. In this step, the flexible display control device may perform image detection and recognition on the N frames of sub-video images, and may specifically determine, through image feature extraction, feature comparison, and the like, an overlapped area image with the same image content and a non-overlapped area image with different image content. For the overlapped region image in the N-frame sub-video images, the flexible display control device may arbitrarily extract one of the images, or may extract the overlapped region image with the highest image quality, which is not limited in the embodiment of the present application. For the non-overlapped area images in the N frames of sub video images, the flexible display control device can extract all the images so as to ensure the comprehensiveness and integrity of the finally synthesized target video image.

And (2) carrying out image synthesis on the overlapped area image and the non-overlapped area image to obtain the target video image.

In the embodiment of the application, after acquiring the overlapped region image and the non-overlapped region image in the N frames of sub-video images, the flexible display control device may fuse the overlapped region image and the non-overlapped region image into the target video image in an image synthesis manner. Specifically, when image synthesis is performed, the flexible display control device may align the image of the overlapping region and the image of the non-overlapping region, then splice and fuse the aligned region images, and perform smoothing processing on the spliced edge to obtain the target video image.

Of course, in the embodiment of the present application, other manners may also be used to obtain the target video image based on the N-frame sub-video image, which is not limited in the embodiment of the present application.

In the embodiment of the application, after acquiring N frames of sub-video images acquired by N cameras, the flexible display control device extracts images of overlapping regions and images of non-overlapping regions between the N frames of sub-video images, and then performs image synthesis on the images of the overlapping regions and the images of the non-overlapping regions to obtain a target video image. Therefore, the flexible display control device synthesizes the N frames of sub-video images collected by the N bent cameras into the target video image, so that the content contained in the target video image is more complete and comprehensive, and the bent flexible display control device can shoot all participants.

Optionally, in this embodiment of the application, after the step 103, the display control method may further include the following step (3):

and (3) transmitting the target video image to at least one electronic device in a video conference in which the flexible display control device participates.

In this embodiment of the application, after acquiring the N frames of sub-video images and synthesizing the target video image, the flexible display control device may transmit the target video image to at least one electronic device used by other participants in the video conference. It should be noted that, in the process of the video conference, the target video image is updated in real time, so that the flexible display control device can send continuous target video image frames during transmission to form a real-time conference video, which facilitates instant communication and discussion among the participants.

In the embodiment of the application, the flexible display control device transmits the target video image to at least one electronic device in a video conference in which the flexible display control device participates. Therefore, the method can ensure that other users can receive complete and comprehensive video images in real time, and ensures real-time and accurate information acquisition and interactive communication of the participants in the video conference.

Optionally, in this embodiment of the present application, the operation of adjusting the bending angle of the flexible display control device may be triggered manually by a user, and specifically, before step 101, the display control method may further include the following step (4):

and (4) receiving a first input of a user, wherein the first input is used for indicating to bend the flexible display control device.

In this embodiment of the application, the first input may be an operation input of a user bending the flexible display control device, and the operation may specifically be a bending operation performed directly and manually on the flexible screen by the user.

Accordingly, step 101 can be specifically realized by the following substeps (5) to (6):

and (5) bending the flexible display control device in response to the first input.

In the embodiment of the application, the flexible display control device bends the flexible screen based on the first input, and the specific bending angle can be determined according to the first input of the user. Specifically, the flexible display control device may directly bend the flexible screen to a bending angle corresponding to an acting force applied by the user based on a manual bending operation of the user.

And (6) in the process of bending the flexible display control device, displaying prompt information under the condition that M video objects are included in the shooting view field range of the N cameras, wherein the prompt information is used for prompting to stop executing the first input.

In this embodiment of the application, the prompt message may be used to prompt the user to stop the current first input, and the prompt message may be an information prompt box or the like popped up on the flexible screen by the flexible display control device. Specifically, when a user manually bends the flexible display control device, the situation that the shooting view field range is not appropriate due to too large or too small force may occur, the flexible display control device can detect the number of video objects included in the shooting view field ranges of the N cameras in real time in the process that the user manually bends, and when the number reaches the number M of the video objects currently performing a video conference through the flexible display control device, the flexible display control device outputs prompt information to prompt the user to stop bending operation, so that the current bending angle of the flexible screen is maintained, and zero-leakage mirror shooting of the video objects is realized.

In the embodiment of the application, the flexible display control device receives a first input of a user, wherein the first input is used for indicating to bend the flexible display control device; bending the flexible display control device in response to the first input; in the process of bending the flexible display control device, when M video objects are included in the shooting view field range of the N cameras, prompt information is displayed, and the prompt information is used for prompting to stop executing the first input. Like this, through the manual flexible display controlling means that buckles of user, realize the adjustment to N camera shooting field of view scope, realized that the user independently revises the angle of buckling of flexible screen, can accord with user's actual shooting needs to through showing prompt message, can remind in real time to the user, improved the accuracy of the angle adjustment of buckling, guaranteed that image shooting is complete, comprehensive.

Exemplarily, fig. 2 shows an initial state diagram of a flexible display control device according to an embodiment of the present application. As shown in fig. 2, the video objects are 8 participants, numbered a1, a2, A3, …, A8 in that order. The flexible display control device is characterized in that 4

cameras

201, 202, 203 and 204 at the top end of a flexible screen form a multi-camera array. Theta is a bending angle, and the bending angle can be a fan-shaped central angle formed at the top end of a flexible screen of the flexible display control device when the flexible screen is bent; the value range of the bending angle is 180-0 degrees, the larger the bending angle is, the smaller the bending degree of the flexible display control device is, for example, when the bending angle is 180 degrees, the flexible screen is in a flat state, and the top end of the screen of the flexible screen is a straight line; when the bending angle is 0 degree, the flexible screen is bent into a cylindrical shape, and the top end of the screen of the flexible screen forms a circle. Specifically, in fig. 2, θ is 180 °, at this time, the flexible screen is not bent, the shooting field range of the camera is small, and the target video image displayed in the flexible display control device only includes two participants a4 and a5, that is, the flexible display control device can only shoot two participants a4 and a5 opposite to the camera, and the situations of lens leakage and missed shooting occur.

Fig. 3 shows a schematic view of bending of a flexible display control device in an embodiment of the present application. As shown in fig. 3, the bending angle of the flexible display control device is 120 °, and as the flexible screen is bent, the shooting field range of the multi-camera array formed by the N cameras of the flexible display control device is gradually widened, the shooting range is increased, and more participants can be shot. The target video image displayed in the flexible display control device in fig. 3 includes four participants A3, a4, a5 and a6, i.e., the flexible display control device can shoot the participants A3, a4, a5 and a 6.

Fig. 4 shows a schematic view of another flexible display control device bending in the embodiment of the present application. As shown in fig. 4, the bending angle of the flexible display control device is 60 °, and with further bending of the flexible display control device, the flexible screen is gradually bent into a semi-cylindrical shape, the shooting field range of the multi-camera array formed by the N cameras is wider, the shooting range is further increased, and after N frames of sub-video images collected by the N cameras are synthesized into a target video image, more video objects can be displayed in the target video image. In the target video image displayed in the flexible display control apparatus in fig. 4, six video objects a2, A3, a4, a5, A6 and a7 are included, that is, the flexible display control apparatus after bending can shoot video objects a2, A3, a4, a5, A6 and a 7.

Fig. 5 shows a schematic view of bending of a further flexible display control device in an embodiment of the present application. As shown in fig. 5, the bending angle θ of the flexible display control device is 0 °, the flexible screen is bent into a cylindrical shape, and the multi-camera array of N cameras of the flexible display control device can capture images within a 360 ° capture range centered on the flexible display control device, so that the video objects a1 to A8 in fig. 5 can all enter the lens. After the flexible display control device obtains the target video image by synthesizing the N frames of sub-video images acquired by the N cameras, all the participants can be included in the target video image. In the target video image displayed by the flexible display control device in fig. 5, all the video objects a1, a2, A3, a4, a5, A6, a7 and A8 are included, that is, the flexible display control device after being bent can shoot the video objects a1, a2, A3, a4, a5, A6, a7 and A8, so that zero-leakage mirror shooting of the video objects is realized.

Optionally, in this embodiment of the present application, step 101 may be implemented by the following sub-steps (7) to (11):

and a substep (7) of adjusting the bending angle of the flexible display control device to an initial bending angle.

In the embodiment of the present application, the initial bending angle may be a bending angle of the flexible display control device in an initial state, and may be, for example, 180 °, 60 °, 0 °, and the like. The initial bending angle may be set by a user based on actual shooting requirements, or may be set by a default of the flexible display control device system, which is not limited in the embodiment of the present application.

Specifically, in this step, the flexible display control device can automatically adjust the bending angle of the flexible screen to realize shooting of the M video objects, and after receiving the triggering operation of the user, the flexible display control device can start the function of the flexible screen adaptive adjustment of the bending angle, so that the flexible screen is firstly bent to the initial bending angle, and the bending angle can be adjusted subsequently based on the shooting effect.

And a substep (8) of detecting the total number of video objects in the shooting field range of the N cameras.

In this embodiment of the application, the shooting field range may refer to a maximum range that can be shot by the N cameras. After the flexible display control device is bent, the shooting range of each camera is changed, the overall shooting view field range of the multi-camera array formed by the N cameras is wider, and more video objects can be shot. In this step, the flexible display control device may detect the number of video objects included in the shooting field range of the N cameras based on face recognition, image feature extraction, and the like, and may subsequently use this as a basis for adjustment of the bending angle.

And a substep (9) of detecting the proportion of the background picture in the target video image.

In the embodiment of the present application, the background picture may refer to a background portion of the target video image that does not include the video object. In this step, in the process of adjusting the bending angle, the larger the bending degree of the flexible display control device is, the larger the shooting range of the N cameras is, but when the bending degree is too large, too many background pictures are easily taken into the target video image, so that too many picture margins or an irrelevant and unattractive picture occupies too large proportion of the whole preview image, and the image display effect is not beautiful enough. The flexible display control device can adjust the bending angle based on the proportion of the background picture in the target video image, thereby not only ensuring the integrity of image shooting, but also optimizing the display effect of the image.

Exemplarily, fig. 6 shows a schematic diagram of automatically adjusting the bending angle according to an embodiment of the present application. As shown in fig. 6, there are 4 video objects participating in the video conference, labeled B1, B2, B3, B4, respectively. The bending angle theta of the flexible display control device is 0 DEG, at the moment, the shooting range of the flexible display control device is large, 4 video objects can be shot into the target video image, namely b1, b2, b3 and b4 in the target video image, but the blank background part accounts for a large proportion in the target video image, the proportion of the human part is small, and the display effect of the image is not ideal.

And (10) when the total number of the video objects is less than the number M of the video objects or the proportion does not meet a preset condition, continuously adjusting the initial bending angle until the total number of the video objects is not less than M and the proportion meets the preset condition.

In this embodiment of the application, the preset condition may refer to whether a ratio of the background picture in the target video image is smaller than or equal to a preset threshold. The preset threshold may be preset by a user based on actual needs, or may be a default of the flexible display control device system, for example, specifically, the preset threshold may be 5%, 10%, and the like, which is not limited in this embodiment of the application.

Specifically, in this step, after the flexible display control device adjusts the flexible screen to the initial bending angle, by detecting the total number of video objects in the shooting field range of the N cameras and the proportion of the background portion in the target video image, if one of the total number of video objects and the proportion of the background portion does not meet the requirement, the flexible display control device continues to adjust the bending angle until a bending angle is determined that the total number of video objects is not less than M and the proportion of the background image is not greater than a preset threshold. After the bending angle meeting the two conditions is determined, the flexible display control device can display prompt information in the flexible screen to prompt a user that the adjustment of the bending angle is completed, and follow-up shooting operation can be executed.

In the embodiment of the application, the flexible display control device adjusts the bending angle of the flexible screen to be the initial bending angle; detecting the total number of video objects in the shooting field range of the N cameras; detecting the proportion of a background picture in a target video image; and under the condition that the total number of the video objects is less than the number M of the video objects or the proportion does not meet the preset condition, continuously adjusting the initial bending angle until the total number of the video objects is not less than M and the proportion meets the preset condition. Like this, flexible display controlling means can adjust the angle of buckling automatically based on video object total number and image shooting effect, finally determines a flexible screen angle of buckling that satisfies the condition, can avoid leaking the mirror, the condition of neglecting to shoot, also can optimize the display effect of image, has improved meeting experience of meeting personnel in the video conference.

Exemplarily, fig. 7 shows another schematic diagram of automatically adjusting the bending angle according to the embodiment of the present application. Fig. 7 corresponds to fig. 6, and shows a state in which the flexible display control device adjusts the bending angle based on fig. 6. As shown in fig. 7, the bending angle θ of the flexible screen of the flexible display control device is adjusted from 0 ° to 120 °, and all video objects, i.e., b1, b2, b3, b4 in the target video image can be included in the target video image; moreover, the proportion of the background picture in the target video image is smaller than a preset threshold, the image blank part is smaller, the proportion of the person part is more balanced, and the overall display effect of the target video image is better. Thus, based on the bending angle of 0 ° in fig. 6 and the ratio of the background picture in the target video image, the flexible display control device automatically adjusts the bending angle to determine the bending angle satisfying the condition. Of course, in this embodiment of the present application, the flexible display control device may also directly use a preset threshold as an optimal proportion of the background picture in the target video image, and when the total number of the video objects reaches M and the proportion of the background picture reaches the preset threshold, the bending angle at this time may be determined as the optimal bending angle of the flexible display control device. Thus, the image display effect can be optimized while realizing zero leakage mirror.

Optionally, in this embodiment of the application, after the step 103, the display control method may further include the following steps (11) to (12):

and (11) determining the position information of the current speaking object. In this embodiment of the present application, the current speaking object may refer to a participant who is speaking currently in the video conference. The location information may refer to a real-time location of the current speaking object. The preset positioning algorithm may be used to determine a person who is speaking currently among the participants, and specifically may be a sound source positioning algorithm or the like.

In this step, when a video conference is performed and a plurality of video objects participate in the video conference, the flexible display control device displays images of all the video objects on the flexible screen, and it is difficult for other users to directly determine which video object is speaking. At this time, the flexible display control device may determine the current speaking object that is speaking based on a preset positioning algorithm, where the preset positioning algorithm may specifically be a sound source positioning algorithm or the like. After the current speaking object is determined, the flexible display control device can capture and track the current speaking object through the camera corresponding to the current speaking object in the N cameras, so that other users can conveniently and timely know the expression object of the current video conference content.

It should be noted that, in this embodiment of the application, the flexible display control device may perform the step of determining the position information of the current speaking object once every preset time period, where the preset time period may be set based on an actual conference rhythm of the user video conference, for example, when the conference rhythm is fast, there are many speaking people, and the preset time period may be short, for example, 30 seconds or 1 minute; when the conference rhythm is slow, the number of speakers is small, and the preset time period may be appropriately extended, for example, 3 minutes or 5 minutes, which is not limited in the embodiment of the present application.

Step (12), displaying a preset identifier in the target video image according to the position information; the preset mark is used for indicating the area of the current speaking object in the target video image.

In this embodiment of the application, the preset identifier may be used to identify an area of a current speaking object in the video conference in the target video image, and specifically may be a frame, a circle, or the like.

Specifically, in this step, after the flexible display control device determines the current speech object based on the preset positioning algorithm, it may detect edge information of the current speech object in the target video image, and add preset marks such as a frame to the current speech object to highlight the current speech object, so that other participants in the video conference can know the current speech object in time.

It should be noted that, within a preset time period, there may be more than one current speaking object, and the flexible display control device may add a preset identifier to at least one current speaking object according to the speaking time, so as to clarify the real-time position of each current speaking person and ensure that other participants can know in time.

In the embodiment of the application, the flexible display control device determines the position information of the current speaking object; displaying a preset identifier in the target video image according to the position information; the preset mark is used for indicating the area of the current speaking object in the target video image. Therefore, the flexible display control device can determine and highlight the current speaking object in real time, other users can be guaranteed to know the presentation object of the conference in time, and the effect of the video conference is improved.

Optionally, in this embodiment of the application, after step 103, the display control method may further include the following steps (13) to (15):

and (13) detecting the number of people of the current speaking object.

In the embodiment of the application, the flexible display control device can detect the current speaking object in real time and can determine the number of people of the current speaking object in a preset time period. And (14) acquiring a face image of the current speaking object and amplifying and displaying the personal image when the number of people of the current speaking object is 1. .

In the embodiment of the application, the enlarged display may refer to that the flexible display control device enlarges and displays a face image of a current speaking object in a preset area of the flexible screen; the enlarged display may be to transmit the face image of the current speaking object to the target display device for display, for example, to transmit the face image to a projector, to enlarge and display the face image by the projector, or the like.

Specifically, in this step, when the number of people who speak the current object is one, the flexible display control device may detect the position of the current object through a preset positioning algorithm, then call the camera corresponding to the position of the current object for real-time tracking, and simultaneously amplify and display the face image of the current object for convenient viewing by other users.

It should be noted that, in this embodiment of the application, before starting the video conference, the flexible display control device may further display a prompt message to prompt the user whether to select to perform an enlarged display, so as to improve the interaction effect of the video conference.

Illustratively, fig. 8 shows a schematic diagram for prompting a user whether to perform an enlarged projection display according to an embodiment of the present application. As shown in fig. 8, the flexible display control device displays an information prompt box in the flexible screen, in which "need projection? Text prompt information of ' and selection options of ' yes ' and ' no '. The user can select whether to enlarge the display or not based on the actual needs of the user.

Illustratively, fig. 9 shows a schematic display diagram of a current speaking object according to an embodiment of the present application. As shown in fig. 9, the video object includes 8 participants, labeled a1, a2, …, A8 in that order. In a preset time period, the flexible display control device determines that the current speaking object is a video object A3 through a preset positioning algorithm such as sound source positioning detection, and the flexible display control device positions an area corresponding to the video object A3, namely A3 in the target video image, in the target video image of the flexible screen, and adds a preset identifier 901 to highlight the current speaking object. And the flexible display control device can capture and track the current speaking object A3 through the camera corresponding to the position of A3 in the N cameras based on the position of the video object A3, and sends the face image of the speaking object A3 to the projector and projects the face image to the projection curtain, so that the display effect is optimized, and the interactive communication among the participants is facilitated. The display state of the flexible display control means after the flexible display control means displays the current utterance object a3 in an enlarged manner can be referred to fig. 10.

Illustratively, fig. 10 shows a schematic diagram of an enlarged display of a current speaking object according to an embodiment of the present application. As shown in fig. 10, the enlarged displayed face image 1001 of the current utterance object video object a3 is projected in the projection curtain corresponding to the projector, so that the display effect on the current utterance object can be optimized, other users can know the object of the conference utterance in time, and the effect of the video conference is improved.

And (15) acquiring the face image of each current speaking object under the condition that the number of people of the current speaking object is more than 1, and amplifying and displaying each face image in different display areas. .

In this application embodiment, the display area may refer to a display area of a flexible screen of the flexible display control device or a display area on the projection screen, and may be flexibly set according to different display modes.

Specifically, in this step, when the number of the current speaking objects is greater than 1 within the preset time period, the flexible display control device may enlarge and display the at least two current speaking objects, specifically, display the at least two current speaking objects in different display areas of the flexible screen or in different display areas of the projection screen. That is, the flexible display control device performs split-screen display on at least two current speaking objects, and compared with a mode of sequentially amplifying and displaying according to the speaking sequence, the split-screen display can avoid the problem of switching delay in sequential amplification and display under the condition that seamless connection conversation of speakers appears in a short time, so that the display effect of the video conference is optimized.

Illustratively, fig. 11 shows a schematic display diagram of another current speaking object according to an embodiment of the present application. As shown in fig. 11, the flexible display control device detects 3 current speaking objects, which are video objects A3, a5, a6 in sequence, within a preset time period. The flexible display control device respectively adds preset marks 1101, 1102 and 1103 to A3, a5 and a6 in sequence according to the speaking time in the target video image displayed on the flexible screen so as to highlight the current speaking object, thereby facilitating other users to know in time. And, the flexible display control means may transmit the respective face images of the current spoken subjects, i.e., A3, a5, a6, to the projector and project into the projection curtain to improve the display effect. The display state of the flexible display control device after at least two current speakers are displayed in an enlarged manner can be referred to fig. 12.

For example, fig. 12 is a schematic diagram illustrating an enlarged display of another current speaking object according to an embodiment of the present application. As shown in fig. 12, the projection curtain is divided into 3 display areas, and 3 current speaking objects, namely, face

images

1201, 1202, 1203 corresponding to A3, a5, a6, respectively, are projected. Through the split-screen amplification display, the problem that the switching delay exists when a plurality of speakers have frequent conversations in a video conference and the flexible display control device tracks, positions and performs amplification projection display can be avoided.

In the embodiment of the application, the flexible display control device detects the number of people who speak the current object; under the condition that the number of people of the current speaking object is 1, acquiring a face image of the current speaking object, and amplifying and displaying the face image; and under the condition that the number of people of the current speaking object is more than 1, acquiring the face image of each current speaking object, and amplifying and displaying each face image in different display areas. . Therefore, the flexible display control device can detect the current speaking object in real time and perform amplification display, can optimize the display effect on the current speaking object, is convenient for other users to know the speaking object of the conference in real time, and improves the accuracy of information acquisition of the participants.

The following takes a panoramic video conference as an example, and a practical example of the specific implementation of the above steps is explained. Fig. 13 shows a flowchart of a panoramic video conference according to an embodiment of the present application. Referring to fig. 13, the panoramic video conference specifically includes the following steps:

and step 1301, entering a video call interface.

In this step, the user can use any application program to enter the video call interface and start the video conference.

Step 1302, determining whether to enter a panoramic conference shooting mode.

In this step, the panoramic conference display control mode may be a video conference mode in which the flexible screen photographs the subject at a certain bending angle. Under the display control mode of the panoramic conference, a plurality of video objects participating in the conference through the flexible display control device can be ensured to enter the target video image.

By way of example, fig. 14 shows a schematic diagram of confirmation of a panoramic conference shooting mode according to an embodiment of the present application. As shown in fig. 14, after the user enters the video conference, the flexible display control apparatus displays an information prompt box 1401 in the flexible screen, in which text prompt information of "whether to enter the panorama shooting mode" and selection options of "on" and "ignore" are displayed, and the user can select the information prompt box based on actual needs.

And step 1303, adjusting the bending angle to make the bending angle of the flexible display control device be greater than or equal to a preset angle threshold.

In this step, the bending angle may be adjusted manually by a user, or may be adjusted automatically by the flexible display control device, which specifically refers to the foregoing step 102 and steps (4) to (10), and this embodiment of the present application is not described herein again.

And step 1304, confirming whether the amplification display is needed or not.

In this step, the electronic device may prompt the user to determine whether to perform the enlarged display, and the specific prompting manner may refer to fig. 8, which is not described herein again in this embodiment of the application.

And step 1305, detecting the position of the current speaking object in real time, and amplifying and displaying the human face image.

And 1306, continuously detecting the position of the current speaking object and amplifying and displaying the position under the current panoramic conference mode.

The specific implementation process in this step may refer to the contents of the foregoing step (11) to step (15), and details of this embodiment are not described herein again.

And step 1307, ending the video conference, and exiting the video conference and panoramic conference modes.

In the embodiment of the application, the video conference is carried out based on the display control method, the target video image is obtained through N frames of sub-video images shot by N cameras of the flexible display control device after bending, the panoramic video conference can be realized, a plurality of video objects participating in the conference do not need to be crowded together, a user can participate in the video conference in multiple directions, the conditions of lens leakage and shooting leakage are avoided, the conditions of unclear conference object, error recording and the like are also avoided, and the comprehensive and complete information acquisition of participants is ensured; meanwhile, the flexible display control device determines the position information of the current speaking object in real time and displays the current speaking object in an amplification mode, so that the current conference speaker can be highlighted, other users can conveniently and timely know the conference presentation object, and the accuracy of participant information acquisition is improved.

It should be noted that the above display control method of the embodiment of the present application is not only used in the video conference scene. In one implementation, when a user shoots a panoramic image by using an electronic device, the user often needs to hold the electronic device by hand, move the camera so that more scenes enter the camera, and then splice a plurality of images controlled by all displays into one panoramic image. In the display control process, a user needs to move the electronic equipment to change the display control angle and change the display control range to complete panoramic image acquisition, so that the panoramic image is easy to deform and dislocate when a plurality of images are spliced due to shaking caused by the user holding the panoramic image, and the image display effect is poor.

Based on the display control method in the embodiment of the application, when a user shoots a panoramic image, the bending angle of the flexible display control device can be adjusted, and the shooting view field range of the N cameras is enlarged, so that the display control of the panoramic image can be completed at one time, the user does not need to hold the electronic equipment for movement, the operation of the user can be facilitated, meanwhile, the influence of shaking on the image effect when the user holds the electronic equipment for movement can be reduced, and the quality of the shot panoramic image is improved.

It should be noted that, in the display control method provided in the embodiment of the present application, the execution main body may be a display control device, or a control module in the display control device for executing the loaded display control method. In the embodiment of the present application, a display control method executed by a display control apparatus is taken as an example, and the display control apparatus provided in the embodiment of the present application is described.

Referring to fig. 15, a block diagram of a display control apparatus according to an embodiment of the present application is shown, where the apparatus 150 includes:

and an adjusting module 1501, configured to adjust a bending angle of the flexible display control apparatus.

An obtaining module 1502 is configured to obtain N frames of sub-video images acquired by the N cameras when a bending angle of the flexible display control apparatus is greater than or equal to a preset angle threshold.

A display module 1503, configured to display a target video image, where the target video image includes M video objects, and the target video image is obtained based on the N frames of sub-video images; wherein N, M are each integers greater than 1.

Optionally, the apparatus 150 further comprises:

the extraction module is used for extracting an overlapped area image and a non-overlapped area image between the N frames of sub-video images; and the synthesis module is used for carrying out image synthesis on the overlapped area image and the non-overlapped area image to obtain the target video image.

Optionally, the apparatus 150 further comprises:

and the transmission module is used for transmitting the target video image to at least one electronic device in a video conference in which the flexible display control device participates.

Optionally, the adjusting module 1501 is specifically configured to:

adjusting the bending angle of the flexible display control device to an initial bending angle; detecting the total number of video objects in the shooting field range of the N cameras; detecting the proportion of a background picture in the target video image; and under the condition that the total number of the video objects is less than the number M of the video objects or the proportion does not meet a preset condition, continuously adjusting the initial bending angle until the total number of the video objects is not less than M and the proportion meets the preset condition.

Optionally, the apparatus 150 further comprises:

the receiving module is used for receiving a first input of a user, and the first input is used for indicating the bending of the flexible display control device; the adjusting module 1501 is specifically configured to: bending the flexible display control device in response to the first input; and in the process of bending the flexible display control device, displaying prompt information under the condition that M video objects are included in the shooting view field range of the N cameras, wherein the prompt information is used for prompting to stop executing the first input.

Optionally, the apparatus 150 is further configured to:

determining the position information of the current speaking object; displaying a preset identifier in the target video image according to the position information; the preset mark is used for indicating the area of the current speaking object in the target video image.

Optionally, the apparatus 150 is further configured to:

detecting the number of people who speak the current object; under the condition that the number of people of the current speaking object is 1, acquiring a face image of the current speaking object, and amplifying and displaying the personal image; and under the condition that the number of people of the current speaking object is more than 1, acquiring the face image of each current speaking object, and amplifying and displaying each face image in different display areas.

In summary, the display control device provided in the embodiment of the present application adjusts the bending angle of the flexible display control device; acquiring N frames of sub-video images collected by N cameras under the condition that the bending angle of the flexible display control device is larger than or equal to a preset angle threshold; then displaying a target video image, wherein the target video image comprises M video objects and is obtained based on N frames of sub video images; n, M are each integers greater than 1. Like this, in this application embodiment, when a plurality of video objects participated in the video conference through flexible display controlling means, through the adjustment to flexible display controlling means angle of buckling for flexible display controlling means can shoot all a plurality of video objects that need shoot in the video conference, can avoid appearing leaking the mirror, leak the condition of shooing, make the image that finally shows more comprehensive, complete, optimized the shooting effect.

The display control device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The display control device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The display control device provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to 14, and is not described here again to avoid repetition.

Optionally, as shown in fig. 16, an electronic device 160 is further provided in an embodiment of the present application, and includes a processor 1601, a memory 1602, and a program or an instruction stored in the memory 1602 and executable on the processor 1601, where the program or the instruction is executed by the processor 1601 to implement the processes of the foregoing display control method embodiment, and achieve the same technical effects, and no further description is provided here to avoid repetition.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and the non-mobile electronic devices described above.

Referring to fig. 17, a hardware structure diagram of an electronic device implementing various embodiments of the present application is shown.

The electronic device 170 includes, but is not limited to: radio frequency unit 1701, network module 1702, audio output unit 1703, input unit 1704, sensor 1705, display unit 1706, user input unit 1707, interface unit 1708, memory 1709, and processor 1710.

Those skilled in the art will appreciate that the electronic device 170 may further include a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 1710 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. The electronic device structure shown in fig. 17 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description thereof is omitted.

The processor 1710 is configured to adjust a bending angle of the flexible display control device.

An input unit 1704, configured to obtain N frames of sub-video images acquired by the N cameras when the bending angle of the flexible display control apparatus is greater than or equal to a preset angle threshold.

A display unit 1706, configured to display a target video image, where the target video image includes M video objects, and the target video image is obtained based on the N frames of sub-video images; wherein N, M are each integers greater than 1.

In the embodiment of the application, the electronic equipment can adjust the bending angle of the flexible display control device; acquiring N frames of sub-video images collected by N cameras under the condition that the bending angle of the flexible display control device is larger than or equal to a preset angle threshold; then displaying a target video image, wherein the target video image comprises M video objects and is obtained based on N frames of sub video images; n, M are each integers greater than 1. Like this, in this application embodiment, when a plurality of video objects participated in the video conference through flexible display controlling means, through the adjustment to flexible display controlling means angle of buckling for flexible display controlling means can shoot all a plurality of video objects that need shoot in the video conference, can avoid appearing leaking the mirror, leak the condition of shooing, make the image that finally shows more comprehensive, complete, optimized the shooting effect.

It should be understood that in the embodiment of the present application, the input Unit 1704 may include a Graphics Processing Unit (GPU) 17041 and a microphone 17042, and the Graphics Processing Unit 17041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1706 may include a display panel 17061, and the display panel 17061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. User input unit 1707 includes a touch panel 17071 and other input devices 17072. A touch panel 17071, also referred to as a touch screen. The touch panel 17071 may include two parts, a touch detection device and a touch controller. Other input devices 17072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1709 may be used to store software programs as well as various data, including but not limited to application programs and an operating system. The processor 1710 can integrate an application processor, which primarily handles operating systems, user interfaces, application programs, and the like, and a modem processor, which primarily handles wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 1710.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above display control method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above display control method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A display control method is applied to a flexible display control device and is characterized by comprising the following steps:

adjusting the bending angle of the flexible display control device;

displaying a target video image, wherein the target video image comprises M video objects, and the target video image is obtained based on the N frames of sub-video images;

wherein N, M are each integers greater than 1.

2. The method of claim 1, wherein prior to displaying the target video image, the method further comprises:

extracting overlapped area images and non-overlapped area images among the N frames of sub video images;

and carrying out image synthesis on the overlapped area image and the non-overlapped area image to obtain the target video image.

3. The method of claim 1, wherein after displaying the target video image, the method further comprises:

and transmitting the target video image to at least one electronic device in a video conference in which the flexible display control device participates.

4. The method of claim 1, wherein the adjusting the bend angle of the flexible display control device comprises:

adjusting the bending angle of the flexible display control device to an initial bending angle;

detecting the total number of video objects in the shooting field range of the N cameras;

detecting the proportion of a background picture in the target video image;

and under the condition that the total number of the video objects is less than the number M of the video objects or the proportion does not meet a preset condition, continuously adjusting the initial bending angle until the total number of the video objects is not less than M and the proportion meets the preset condition.

5. The method according to claim 1, wherein before adjusting the bending angle of the flexible display control device, the method further comprises:

receiving a first input of a user, wherein the first input is used for indicating to bend the flexible display control device;

the adjustment the angle of buckling of flexible display controlling means includes:

bending the flexible display control device in response to the first input;

and in the process of bending the flexible display control device, displaying prompt information under the condition that M video objects are included in the shooting view field range of the N cameras, wherein the prompt information is used for prompting to stop executing the first input.

6. The method of any of claims 1-5, wherein after displaying the target video image, the method further comprises:

determining the position information of the current speaking object;

displaying a preset identifier in the target video image according to the position information;

the preset mark is used for indicating the area of the current speaking object in the target video image.

7. The method of any of claims 1-5, wherein after said displaying a target video image, the method further comprises:

detecting the number of people who speak the current object;

under the condition that the number of people of the current speaking object is 1, acquiring a face image of the current speaking object, and amplifying and displaying the personal image;

and under the condition that the number of people of the current speaking object is more than 1, acquiring the face image of each current speaking object, and amplifying and displaying each face image in different display areas.

8. A display control apparatus, characterized by comprising:

a display module, configured to display a target video image, where the target video image includes M video objects, and the target video image is obtained based on the N frame sub-video images;

wherein N, M are each integers greater than 1.

9. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the display control method according to any one of claims 1 to 7.

10. A readable storage medium, on which a program or instructions are stored, which when executed by a processor, implement the steps of the display control method according to any one of claims 1 to 7.