CN110489047B

CN110489047B - Display control method and flexible terminal

Info

Publication number: CN110489047B
Application number: CN201910678327.7A
Authority: CN
Inventors: 崔青虎; 钟燕和
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2019-07-25
Filing date: 2019-07-25
Publication date: 2021-03-02
Anticipated expiration: 2039-07-25
Also published as: CN110489047A

Abstract

The invention provides a display control method, a flexible terminal, a mobile terminal and a computer readable storage medium, wherein the display control method comprises the following steps: the method comprises the steps of obtaining a target image collected by a target camera, determining target data based on the target image, and updating display of a target screen area based on the target data under the condition that a flexible terminal is in a preset target bending state. In the method, the flexible terminal updates the display of the target screen area according to the target data acquired by the target camera, so that the screen display of the flexible terminal can be matched with a user wearing, accessory or a designated object, the diversity of the screen display is increased, and the decoration effect of the flexible terminal is realized.

Description

Display control method and flexible terminal

Technical Field

The embodiment of the invention relates to the technical field of communication, in particular to a display control method, a flexible terminal, a mobile terminal and a computer readable storage medium.

Background

The flexible terminal adopts a flexible screen and can be used as a traditional telephone terminal in a flat state; in the bent state, the flexible terminal becomes smaller in size and can be worn as a wearable device, for example, a user can select to bend the flexible terminal to a wearing mode to hang the flexible terminal in a coat pocket or wear the flexible terminal on a wrist.

The inventor finds in the process of research on the prior art that the existing flexible terminal is generally designed to automatically turn off the screen into a standby state when in a wearing mode, and the standby display is generally inherent display content, such as a black screen. For fashion-pursuing users, the standby display mode of the flexible terminal is very monotonous.

Disclosure of Invention

The embodiment of the invention provides a display control method, a flexible terminal, a mobile terminal and a computer readable storage medium, which aim to solve the problem that the existing flexible terminal has a fixed display mode and cannot meet the requirements of different display effects of a user.

In a first aspect, an embodiment of the present invention provides a display control method, which is applied to a flexible terminal, and the method includes:

acquiring a target image acquired by a target camera;

determining target data based on the target image;

updating the display of a target screen area based on the target data under the condition that the flexible terminal is in a preset target bending state;

wherein, in the target bending state, the display screen of the flexible terminal is positioned on the surface of the flexible terminal in the opposite direction of the bending direction.

Optionally, before updating the display of the target screen region based on the target data, the method further includes:

acquiring the position of a bent part of the flexible terminal;

determining a first screen area and a second screen area based on the position of the bent part, wherein the terminal side where the first screen area is located comprises the target camera;

determining a target screen region in the first screen region and the second screen region.

Optionally, the determining a target screen region in the first screen region and the second screen region includes:

determining the second screen area as a target screen area under the condition that the target camera is shielded;

and under the condition that the target camera is not shielded, determining the first screen area as a target screen area.

Optionally, the determining target data based on the target image includes:

identifying first face information in the target image;

and under the condition that the first face information is the face information of the first user, identifying target data of a clothes area in the target image.

Optionally, the target data comprises at least one of color information of the garment, pattern information on the garment.

Optionally, the updating the display of the target screen region based on the target data includes at least one of:

in the event that the target data includes a first color of a first user's clothing, setting a color of a target screen region to a second color associated with the first color;

in a case where the target data includes a first pattern of a first user's clothing, the first pattern is displayed on a target screen area.

Optionally, the target data is the target image, and the target image is an image of a target object; updating the display of the target screen region based on the target data, comprising:

acquiring the image depth of the target image;

and displaying each frame of preview image data of the target object acquired by the target camera in real time in the target screen area under the condition that the image depth is less than or equal to a preset depth threshold.

In a second aspect, an embodiment of the present invention provides a flexible terminal, including:

the target image acquisition module is used for acquiring a target image acquired by a target camera;

a target data determination module for determining target data based on the target image;

the updating module is used for updating the display of a target screen area based on the target data under the condition that the flexible terminal is in a preset target bending state;

Optionally, the flexible terminal further comprises:

the position acquisition module is used for acquiring the position of the bending part of the flexible terminal;

the screen area determining module is used for determining a first screen area and a second screen area based on the position of the bent part, wherein the terminal side where the first screen area is located comprises the target camera;

and the target screen area determining module is used for determining a target screen area in the first screen area and the second screen area.

Optionally, the target screen area determining module includes:

the first determining submodule is used for determining the second screen area as a target screen area under the condition that the target camera is blocked;

and the second determining submodule is used for determining the first screen area as a target screen area under the condition that the target camera is not shielded.

Optionally, the target data determining module includes:

the face recognition submodule is used for recognizing first face information in the target image;

and the data identification submodule is used for identifying target data of a clothes area in the target image under the condition that the first face information is the face information of the first user.

Optionally, the update module comprises at least one of:

a color setting sub-module for setting a color of a target screen region to a second color associated with a first color of a first user's clothing if the target data includes the first color;

a pattern display sub-module to display a first pattern of a first user's clothing on a target screen area if the target data includes the first pattern.

Optionally, the target data is the target image, and the target image is an image of a target object; the update module includes:

the depth acquisition submodule is used for acquiring the image depth of the target image;

and the real-time display sub-module is used for displaying each frame of preview image data of the target object acquired by the target camera in real time in the target screen area under the condition that the image depth is less than or equal to a preset depth threshold.

In a third aspect, an embodiment of the present invention provides a mobile terminal, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program, when executed by the processor, implements the steps of the display control method according to the first aspect.

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the display control method according to the first aspect are implemented.

In the embodiment of the invention, the flexible terminal acquires a target image acquired by the target camera, determines target data based on the target image, and updates the display of the target screen area based on the target data under the condition that the flexible terminal is in a preset target bending state. In the method, the flexible terminal updates the display of the target screen area according to the target data acquired by the target camera, so that the screen display of the flexible terminal can be matched with a user wearing, accessory or a designated object, the diversity of the screen display is increased, and the decoration effect of the flexible terminal is realized.

Drawings

Fig. 1 is one of flowcharts of a display control method provided in an embodiment of the present invention;

fig. 2 is one of schematic diagrams of bending a flexible terminal to a predetermined target bending state according to an embodiment of the present invention;

fig. 3 is a second schematic view illustrating bending of the flexible terminal to a predetermined target bending state according to an embodiment of the present invention;

fig. 4 is a schematic view of a flexible terminal provided in an embodiment of the present invention in a wearing mode;

FIG. 5 is one of the schematic diagrams of determining a target screen area provided in an embodiment of the present invention;

FIG. 6 is a second schematic diagram illustrating the determination of a target screen area according to an embodiment of the present invention;

FIG. 7 is a second flowchart of a display control method according to an embodiment of the present invention;

FIG. 8 is a schematic view of a target camera facing a native user's clothing provided in an embodiment of the invention;

FIG. 9 is a schematic view of a target camera provided in an embodiment of the invention facing the clothing of another person;

fig. 10 is one of structural block diagrams of a flexible terminal provided in an embodiment of the present invention;

fig. 11 is a second block diagram of the structure of the flexible terminal provided in the embodiment of the present invention;

fig. 12 is a schematic hardware structure diagram of a mobile terminal provided in an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Referring to fig. 1, which shows one of flowcharts of a display control method provided in an embodiment of the present invention, applied to a flexible terminal, the terminal described in the embodiment of the present invention may include a mobile terminal such as a mobile phone, a tablet computer, a notebook computer, a palm computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a smart band, a pedometer, and a fixed terminal such as a Digital TV, a desktop computer, and the like, but it should be noted that the terminal described above should be understood as a flexible terminal all provided with a flexible screen, and the flexible screen may be bent or folded based on a current terminal housing.

The display control method may specifically include the steps of:

step 101, acquiring a target image acquired by a target camera.

In the embodiment of the invention, the flexible terminal can acquire the target image data acquired by the target camera in the preview mode. The cameras of the flexible terminal may generally include a front view at the flexible screen portion of the terminal and a rear view at the housing portion of the terminal, and the target camera herein may be one determined based on the current shape state of the flexible terminal, for example, the front view at the display screen portion of the flexible terminal. In addition, the user may adjust the orientation of the target camera in order to obtain the desired target image. For example, in capturing an image of the user's clothing, the target camera may be oriented in the direction of the user's clothing.

The action of the target camera acquiring the target image may be performed after the terminal detects an opening instruction for the camera, where the opening instruction may be an instruction to operate on a housing portion of the flexible terminal, for example, the opening instruction may be a pressing operation of a user on a preset portion of the housing of the flexible terminal, or a user bending a display screen of the flexible terminal to a target bending state.

Step 102, determining target data based on the target image.

In the embodiment of the invention, target data can be acquired from the target image. Specifically, if the target camera faces the clothing worn by the user, the target image is an image of the user's clothing, and the target data may be a color or pattern of the user's clothing; if the target camera faces clothes worn by other people, the target image is an image of clothes of other people, and the target data can be colors or patterns of clothes of other people; if the camera is facing the accessory worn by the user, the target image is the accessory and the target data is the color or pattern of the accessory.

103, updating the display of a target screen area based on the target data under the condition that the flexible terminal is in a preset target bending state; wherein, in the target bending state, the display screen of the flexible terminal is positioned on the surface of the flexible terminal in the opposite direction of the bending direction.

In this embodiment of the present invention, the preset target bending state may be a state in which the display screen of the flexible terminal is bent to a wearing mode, at this time, the display screen of the flexible terminal is located on a surface of the flexible terminal in a direction opposite to a bending direction of the flexible terminal, and the target screen area is located on the display screen of the flexible terminal and may be used for displaying target data, and the target screen area may be all display areas or a part of display areas of the display screen of the flexible terminal. The target camera is a camera positioned on the display screen of the flexible terminal.

Referring to fig. 2, one of the schematic diagrams for bending the flexible terminal to a preset target bending state according to the embodiment of the present invention is shown. In fig. 2, S1 shows a target camera of the flexible terminal, and on the left side of fig. 2, the flexible terminal is in an unbent state, and on the right side of fig. 2, the flexible terminal is bent in the direction of S2 and is bent to a preset target bending state, and after bending, the target camera faces in the direction of the arrow shown in S3, that is, the camera S1 faces the outside of the flexible terminal, and on the right side of fig. 2, when the bending direction of the flexible terminal is downward as viewed from above, the display screen is located on the surface of the flexible terminal in the upward direction, that is, the surfaces shown in S7 and S8.

Referring to fig. 3, a second schematic view of bending the flexible terminal to a predetermined target bending state according to the embodiment of the present invention is shown. In fig. 3, S1 shows a target camera of the flexible terminal, and on the left side of fig. 3, the flexible terminal is in an unbent state, and on the right side of fig. 3, the flexible terminal is bent in the direction of S4 and is bent to a preset target bending state, and after bending, the direction of the camera is the arrow direction shown in S5, that is, the camera S1 faces the outside of the flexible terminal, and on the right side of fig. 3, when the bending direction of the flexible terminal is still downward as viewed from above, the display screen is located on the surface of the flexible terminal in the upward direction.

In the target curved state, the display of the target screen region may be updated based on the target data, for example, the target data may be displayed on the target screen region. Specifically, if the target data is the color or the pattern of the clothes of the user, the color or the pattern is displayed in the target screen area, and when the user hangs the flexible terminal in a coat pocket or wears the flexible terminal on the wrist, the color or the pattern of the screen of the flexible terminal corresponds to the color or the pattern of the clothes of the user, so that the matching feeling of the flexible terminal and the clothes of the user is improved, and the flexible terminal has the decoration effect of a wearing article.

Referring to fig. 4, a schematic diagram of a flexible terminal in a wearing mode according to an embodiment of the present invention is shown. In fig. 4, the flexible terminal is bent to a target bent state to be worn in a user's jacket pocket, and the flexible terminal displays a clothes color in a target screen area D1 based on the clothes color of the user.

Optionally, before updating the display of the target screen area based on the target data, the target screen area of the flexible terminal may be further determined through the following steps a 1-A3.

Step A1, obtaining the position of the bending part of the flexible terminal.

In the embodiment of the invention, a user applies forces towards the center direction of the flexible terminal to the two ends of the flexible terminal to bend the flexible terminal, the flexible terminal can detect the stress of the terminal through a built-in sensor, and the position of the bent part of the flexible terminal is obtained through stress analysis.

Step A2, determining a first screen area and a second screen area based on the position of the bending part, wherein the terminal side of the first screen area comprises the target camera.

Specifically, according to the position of the bending portion, the display screen of the flexible terminal can be divided into two screen areas, namely a first screen area and a second screen area, wherein the screen area where the target camera is located is used as the first screen area.

For example, in fig. 2, S6 shows a curved portion, and P1 and P2 are two screen regions divided by S6, respectively, where the screen region P1 where the target camera S1 is located is the first screen region.

Step a3, determining a target screen area in the first screen area and the second screen area.

The target screen area may be a screen area that can be displayed outside when the flexible terminal is in a wearing mode. Therefore, the decoration effect of the flexible terminal can be realized by displaying the target data in the target screen area.

Specifically, step a3 may include:

and step A31, determining the second screen area as the target screen area under the condition that the target camera is blocked.

In the embodiment of the present invention, the target camera determines whether it is blocked according to the preview image, and if it is blocked, it indicates that the first screen area where the target camera is located is in close contact with the user, for example, the first screen area is in contact with the clothes of the user, or the first screen area is in contact with the skin of the wrist of the user, and in short, the first screen area cannot be displayed in the external environment. At this time, a second screen region that can be displayed in the external environment is determined as a target screen region.

Referring to fig. 5, one of the schematic diagrams for determining a target screen area provided by the embodiment of the present invention is shown. In fig. 5, the flexible terminal is put on the jacket pocket of the user a, and the screen region P3 and the screen region P4 are determined based on the position of the bent portion, wherein the screen region P3 is taken as the first screen region and the screen region P4 is taken as the second screen region because the terminal side where the screen region P3 is located includes the target camera S1. The direction in which the target camera S1 is facing is the direction indicated by the arrow T1, i.e., the target camera S1 is facing the jacket pocket of user a. In this case, the target camera S1 is blocked by the jacket pocket of the user a, and then the second screen region P4 is determined as the target screen region.

Step A32, under the condition that the target camera is not blocked, determining the first screen area as a target screen area.

And if the target camera judges that the target camera is not blocked according to the preview image, taking a first screen area where the target camera is located as a target screen area, and displaying target data in the first screen area.

Referring to fig. 6, a second schematic diagram of determining a target screen area according to the embodiment of the present invention is shown. In fig. 6, the flexible terminal is put on the jacket pocket of the user a, and the screen region P5 and the screen region P6 are determined based on the position of the bent portion, wherein the screen region P6 is taken as the first screen region and the screen region P5 is taken as the second screen region because the terminal side where the screen region P6 is located includes the target camera S1. The direction in which the target camera S1 is facing is the direction indicated by the arrow T1, i.e., the target camera S1 is facing the outside of the flexible terminal. In this case, the target camera S1 is not obstructed by anything, and then the first screen region P6 is determined as the target screen region.

By the method for determining the target screen area, the target data can be displayed in the screen area of the flexible terminal which is not shielded, so that the target data can be clearly displayed outside, and the matching feeling of the flexible terminal and wearing and accessories of a user is enhanced.

In summary, in the embodiment of the present invention, the flexible terminal obtains the target image collected by the target camera, determines the target data based on the target image, and updates the display of the target screen area based on the target data when the flexible terminal is in the preset target bending state. In the method, the flexible terminal updates the display of the target screen area according to the target data acquired by the target camera, so that the screen display of the flexible terminal can be matched with a user wearing, accessory or a designated object, the diversity of the screen display is increased, and the decoration effect of the flexible terminal is realized.

Referring to fig. 7, a second flowchart of the display control method provided in the embodiment of the present invention is shown, and is applied to a flexible terminal, where the display control method specifically includes the following steps:

step 201, acquiring a target image acquired by a target camera.

In the embodiment of the present invention, step 201 may refer to step 101, which is not described herein again.

Step 202, identifying first face information in the target image.

In the embodiment of the invention, the first face information can be preset as the face information of the user of the camera, or can not be set, so that the target camera can acquire the face information of other people when facing the other people.

Referring to fig. 8, a schematic diagram of a target camera facing clothes of a local user according to an embodiment of the present invention is shown. In fig. 8, the target camera S1 is located on the outer side of the flexible terminal, and the direction in which the target camera S1 faces is the direction indicated by the arrow T2, i.e., facing the user' S clothing. In this case, the target image acquired by the target camera is the color or pattern of the user and his clothes, and the flexible terminal extracts the face information of the user from the target image. And, based on the bending position of the flexible terminal, the display screen of the flexible terminal is divided into a screen region P7 and a screen region P8, and the target camera S1 is located in the screen region P8, so that the screen region P8 is taken as a first screen region, the screen region P7 is taken as a second screen region, the target camera S1 faces the clothes of the user, the target camera S1 is shielded by the clothes of the user, and the second screen region P7 is taken as a target screen region.

Referring to fig. 9, a schematic diagram of the target camera facing the clothes of others according to the embodiment of the present invention is shown. In fig. 9, the user a holds the flexible terminal, and the direction in which the target camera S1 is directed is the direction indicated by the arrow T1, i.e., the camera S1 faces the clothing of the person B. In this case, the target image acquired by the camera is the color or pattern of the person B and the clothes thereof, and the flexible terminal extracts the face information of the person B therefrom. And, since the target camera S1 is directed to the outside of the flexible terminal as shown in T1, the first screen region P9 in which the target camera S1 is located is determined as the target screen region.

Step 203, identifying target data of a clothing area in the target image when the first face information is the face information of the first user.

In the embodiment of the present invention, the first user may be set as the local user, or may be set as anyone, and then, in the case where the first face information is the face information of the local user, the first user may recognize from the face area downward, may recognize the clothing area of the local user, and extracts the target data from the image of the clothing area; when the first face information is face information of another person, the first face information is recognized from the face region downward, the clothing region of the other person can be recognized, and the target data can be extracted from the image of the clothing region.

The first face information in the target image is recognized, the target data of the clothes area in the target image is recognized, the target data can be data in clothes worn by a person, the recognized target data is prevented from being clothes data but not clothes worn by the person, such as clothes of a clothing store or clothes hung on a clothes hanger, and therefore the target area of the clothes area is recognized after the face information is recognized, the clothes not worn by the person can be prevented from being recognized by the flexible terminal, the recognition effect is improved, and meaningless recognition is reduced.

In the embodiment of the invention, in order to match the display of the target screen area of the flexible terminal with the clothes of the user or with the clothes of other people, the target data extracted from the target image can be color information and pattern information of the clothes, so that the color and the pattern are displayed on the target screen area. Specifically, for the case in fig. 8, the target screen area of the flexible terminal will display the color or pattern of the user's own clothing; for the case in fig. 9, the target screen area of the flexible terminal will display the clothing pattern or color of character B.

The target screen area of the flexible terminal displays the clothes color or pattern of the user, a mode of adaptively adjusting the standby display of the flexible terminal according to the clothes color is provided, on one hand, the trouble of manually changing the standby display of the flexible terminal by the user can be avoided, on the other hand, when the user puts the flexible terminal as a wearing article in a jacket pocket or wears the flexible terminal on the wrist, the standby display of the flexible terminal corresponds to the clothes pattern or color, the feeling of integrating a mobile phone and the clothes into a whole is provided, and the playability and the interestingness are enhanced.

The target screen area of the flexible terminal displays the clothes color or pattern of other people, so that the trouble of manually changing standby display by a user is avoided, some psychological activities of the user can be indirectly transmitted, such as good feeling, love admiration, hope of paying attention and the like, and the expressive property, the playability and the interestingness of the flexible terminal are enhanced.

In practical applications, there may be no person or clothes in the shooting direction of the target camera, but if there is other large-area color or pattern information in the shooting direction, the color or pattern information may be displayed in the target screen area; if no color or pattern information exists in the shooting direction at this time, default information or no information is displayed in the target screen area.

After step 203, step 204, or step 205, or step 206-step 207 may be performed.

In the event that the target data includes a first color of the first user's clothing, setting the color of the target screen area to a second color associated with the first color, step 204.

In the embodiment of the invention, the color of the target screen area is matched with the clothes of the user, so that not only can the primary color, namely the first color, of the clothes of the user be displayed in the target screen area, but also the second color related to the first color can be displayed, and thus, a better matching effect can be obtained. For example, if the first color of the clothes of the user is black, the color of the target screen area can be set to be red which is more matched with black, so that the sense of heaviness of the black clothes can be broken, the feeling of vitality can be brought, and a better matching effect can be obtained.

In step 205, in the case that the target data includes a first pattern of a first user's clothing, the first pattern is displayed on a target screen area.

In an embodiment of the present invention, if the first user's clothing includes a first pattern, the first pattern is also displayed in the target screen area. For example, if the first pattern is a flower or grid pattern, the flower or grid pattern is also displayed in the target screen area.

The first pattern is displayed on the target screen area, so that the type of target data displayed on the target screen area can be expanded, and the matching effect of the flexible terminal and the clothes of a user is further improved.

Step 206, obtaining the image depth of the target image.

In the embodiment of the present invention, the image depth refers to a distance from an image collector to each object in a scene, where the depth means a distance. For a flexible terminal adopting two cameras for imaging, the image depth of a target image can be obtained by adopting a binocular depth estimation method, because a certain distance exists between the two cameras, the images of the same scene formed by the two lenses have a certain difference, namely parallax, because of the existence of parallax information, the general depth information of the scene can be estimated; for a flexible terminal adopting a single camera for imaging, a depth estimation method based on image content understanding can be adopted, wherein the depth estimation method for image content understanding is mainly used for classifying each scene block in an image and then estimating the depth information of each class of scenes by using a respectively applicable method; a depth estimation method based on focusing can also be adopted, wherein the focusing depth estimation is to enable the camera to be at a heat accumulation position relative to the measured point, and then the distance between the measured point and the camera can be obtained according to a lens imaging formula.

And step 207, displaying each frame of preview image data of the target object acquired by the target camera in real time in the target screen area under the condition that the image depth is less than or equal to a preset depth threshold.

In the embodiment of the invention, a depth threshold value can be preset, and if the image depth of each object in the image is smaller than or equal to the preset depth threshold value, the distance between the objects in the image is very small, so that the camera of the flexible terminal is placed in a narrow space. In order to make the user know the internal situation of the narrow space, the flexible terminal can not extract colors or patterns from the target image at this time, but dynamically display each frame of preview image data captured in the narrow space directly in the target screen area.

Specifically, if a user needs to know the condition inside the narrow space, an opening instruction for a camera can be sent firstly, then one side, provided with the camera, of the flexible terminal is plugged into the narrow space to obtain a target image, then the camera performs image analysis on the target image to obtain the image depth, and when the image depth is detected to be smaller than or equal to a preset depth threshold value, each frame image in the narrow space, namely video information in the narrow space, is displayed on a target screen area in real time, so that the visual range of human eyes is expanded. The condition in the narrow space of shooting also can be utilized to present flexible terminal, nevertheless need flexible terminal to record a video or finish shooing in narrow space, just can take out flexible terminal, plays the video again or look over the album and see the effect, can not be according to the scene adjustment position of seeing in real time, and this scheme just can accomplish to show in real time on the screen area, and is more convenient, swift.

In summary, the display control method provided in the embodiment of the present invention has the beneficial effects of the display control method in fig. 1, and also identifies the target data of the clothing region in the target image by identifying the first face information in the target image, so as to prevent the flexible terminal from identifying clothing that is not worn by a person, improve the identification effect, and reduce meaningless identification; in addition, under the condition that the target data comprise a first color of clothes of a first user, the color of the target screen area is set to be a second color associated with the first color, so that a better matching effect can be obtained; in addition, each frame of image of the target data can be dynamically displayed in the target screen area through the depth analysis of the target image, the visual range of human eyes is expanded, and the operation is more convenient and faster.

Referring to fig. 10, which is a block diagram of a structure of a flexible terminal according to an embodiment of the present invention, the flexible terminal 300 may specifically include:

a target image obtaining module 301, configured to obtain a target image collected by a target camera;

a target data determination module 302 for determining target data based on the target image;

an updating module 303, configured to update display of a target screen area based on the target data when the flexible terminal is in a preset target bent state;

Optionally, the terminal 300 further includes:

Optionally, the target screen area determining module includes:

The flexible terminal provided by the embodiment of the present invention can implement each process implemented in the method embodiment of fig. 1, and is not described herein again to avoid repetition.

The flexible terminal provided by the embodiment of the invention acquires a target image acquired by the target camera, determines target data based on the target image, and updates the display of the target screen area based on the target data under the condition that the flexible terminal is in a preset target bending state. In the method, the flexible terminal updates the display of the target screen area according to the target data acquired by the target camera, so that the screen display of the flexible terminal can be matched with a user wearing, accessory or a designated object, the diversity of the screen display is increased, and the decoration effect of the flexible terminal is realized.

Referring to fig. 11, on the basis of fig. 10, a second block diagram of the flexible terminal according to the embodiment of the present invention is shown, where the target data determining module 302 includes:

a face recognition sub-module 3021, configured to recognize first face information in the target image;

a data identification submodule 3022, configured to identify target data of a clothing region in the target image if the first face information is face information of the first user.

The update module 303 comprises at least one of:

a color setting sub-module 3031 for setting a color of a target screen region to a second color associated with a first color of a first user's clothing, if the target data comprises the first color;

a pattern display sub-module 3032 is configured to display a first pattern of a first user's clothing on a target screen area if the target data includes the first pattern.

Optionally, the target data is the target image, and the target image is an image of a target object; the update module 303 includes:

a depth acquisition submodule 3033, configured to acquire an image depth of the target image;

the real-time display submodule 3034 is configured to display, in the target screen region, each frame of preview image data of the target object acquired by the target camera in real time when the image depth is less than or equal to a preset depth threshold.

The flexible terminal provided in the embodiment of the present invention can implement each process implemented in the method embodiment of fig. 7, and is not described here again to avoid repetition.

The flexible terminal provided by the embodiment of the invention has the beneficial effects of the flexible terminal in fig. 10, and also identifies the target data of the clothes area in the target image by identifying the first face information in the target image, so that the flexible terminal can be prevented from identifying clothes not worn by people, the identification effect is improved, and the meaningless identification is reduced; in addition, under the condition that the target data comprise a first color of clothes of a first user, the color of the target screen area is set to be a second color associated with the first color, so that a better matching effect can be obtained; in addition, each frame of image of the target data can be dynamically displayed in the target screen area through the depth analysis of the target image, the visual range of human eyes is expanded, and the operation is more convenient and faster.

Figure 12 is a schematic diagram of the hardware architecture of a mobile terminal implementing various embodiments of the present invention,

the mobile terminal 400 includes, but is not limited to: radio frequency unit 401, network module 402, sound output unit 403, input unit 404, sensor 405, display unit 406, user input unit 407, interface unit 408, memory 409, processor 410, and power supply 411. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 12 is not intended to be limiting of mobile terminals, and that a mobile terminal may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

Wherein, the processor 410 is configured to:

acquiring a target image acquired by a target camera;

determining target data based on the target image;

It should be understood that, in the embodiment of the present invention, the radio frequency unit 401 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 410; in addition, the uplink data is transmitted to the base station. Typically, radio unit 401 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Further, the radio unit 401 can also communicate with a network and other devices through a wireless communication system.

The mobile terminal provides the user with wireless broadband internet access through the network module 402, such as helping the user send and receive e-mails, browse web pages, and access streaming media.

The sound output unit 403 may convert sound data received by the radio frequency unit 401 or the network module 402 or stored in the memory 409 into a sound signal and output as sound. Also, the sound output unit 403 may also provide sound output related to a specific function performed by the mobile terminal 400 (e.g., a call signal reception sound, a message reception sound, etc.). The sound output unit 403 includes a speaker, a buzzer, a receiver, and the like.

The input unit 404 is used to receive a sound or video signal. The input Unit 404 may include a Graphics Processing Unit (GPU) 4041 and a microphone 4042, and the Graphics processor 4041 processes image data of a still picture or video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 406. The image frames processed by the graphic processor 4041 may be stored in the memory 409 (or other storage medium) or transmitted via the radio frequency unit 401 or the network module 402. The microphone 4042 may receive sound, and can process such sound into sound data. The processed voice data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 401 in case of the phone call mode.

The mobile terminal 400 also includes at least one sensor 405, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that adjusts the brightness of the display panel 4061 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 4061 or backlight when the mobile terminal 400 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 405 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be described in detail herein.

The display unit 406 is used to display information input by the user or information provided to the user. The Display unit 406 may include a Display panel 4061, and the Display panel 4061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 407 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 407 includes a touch panel 4071 and other input devices 4072. Touch panel 4071, also referred to as a touch screen, may collect touch operations by a user on or near it (e.g., operations by a user on or near touch panel 4071 using a finger, a stylus, or any suitable object or attachment). The touch panel 4071 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 410, receives a command from the processor 410, and executes the command. In addition, the touch panel 4071 can be implemented by using various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 4071, the user input unit 407 may include other input devices 4072. Specifically, the other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a track ball, a mouse, and a joystick, which are not described herein again.

Further, the touch panel 4071 can be overlaid on the display panel 4061, and when the touch panel 4071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 410 to determine the type of the touch event, and then the processor 410 provides a corresponding visual output on the display panel 4061 according to the type of the touch event. Although in fig. 12, the touch panel 4071 and the display panel 4061 are two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 4071 and the display panel 4061 may be integrated to implement the input and output functions of the mobile terminal, which is not limited herein.

The interface unit 408 is an interface through which an external device is connected to the mobile terminal 400. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, a sound input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 408 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 400 or may be used to transmit data between the mobile terminal 400 and external devices.

The memory 409 may be used to store software programs as well as various data. The memory 409 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as voice data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 409 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 410 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs or modules stored in the memory 409 and calling data stored in the memory 409, thereby integrally monitoring the mobile terminal. Processor 410 may include one or more processing units; preferably, the processor 410 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The mobile terminal 400 may further include a power supply 411 (e.g., a battery) for supplying power to various components, and preferably, the power supply 411 may be logically connected to the processor 410 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.

In addition, the mobile terminal 400 includes some functional modules that are not shown, and thus, are not described in detail herein.

Preferably, an embodiment of the present invention further provides a mobile terminal, which includes a processor 410, a memory 409, and a computer program that is stored in the memory 409 and can be run on the processor 410, and when being executed by the processor 410, the computer program implements each process of the display method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.

Based on the hardware structure of the mobile terminal, the following detailed description will be made of embodiments of the present invention.

The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the display method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A display control method is applied to a flexible terminal, and is characterized by comprising the following steps:

acquiring a target image acquired by a target camera;

determining target data based on the target image;

wherein, in the target bending state, the display screen of the flexible terminal is positioned on the surface of the flexible terminal in the opposite direction of the bending direction;

the target data is the target image, and the target image is an image of a target object; updating the display of the target screen region based on the target data, comprising:

acquiring the image depth of the target image, wherein the image depth refers to the distance from an image collector to each object in a scene;

2. The method of claim 1, wherein prior to updating the display of the target screen region based on the target data, further comprising:

acquiring the position of a bent part of the flexible terminal;

3. The method of claim 2, wherein determining the target screen region of the first and second screen regions comprises:

4. The method of claim 1, wherein determining target data based on the target image comprises:

identifying first face information in the target image;

5. The method according to claim 4, wherein the target data includes at least one of color information of the garment, pattern information on the garment.

6. The method of claim 5, wherein updating the display of the target screen area based on the target data comprises at least one of:

7. A flexible terminal, comprising:

the target data is the target image, and the target image is an image of a target object; the update module is to:

8. A mobile terminal, characterized in that it comprises a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the display control method according to any one of claims 1 to 6.

9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the display control method according to any one of claims 1 to 6.