CN114466132A - Photographing display method, electronic equipment and storage medium - Google Patents

Photographing display method, electronic equipment and storage medium Download PDF

Info

Publication number
CN114466132A
CN114466132A CN202110657359.6A CN202110657359A CN114466132A CN 114466132 A CN114466132 A CN 114466132A CN 202110657359 A CN202110657359 A CN 202110657359A CN 114466132 A CN114466132 A CN 114466132A
Authority
CN
China
Prior art keywords
multimedia content
display screen
image
electronic device
preview
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110657359.6A
Other languages
Chinese (zh)
Other versions
CN114466132B (en
Inventor
倪静
吴霞
刘伟杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202110657359.6A priority Critical patent/CN114466132B/en
Publication of CN114466132A publication Critical patent/CN114466132A/en
Application granted granted Critical
Publication of CN114466132B publication Critical patent/CN114466132B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A shooting display method and a device relate to the technical field of electronics, and can show a multimedia content to a shot person for reference in the shooting process, so that the process that a user repeatedly checks a referable image and shoots again is avoided, the user operation is simplified, and the shooting experience of the user is improved. The specific scheme comprises the following steps: the method comprises the steps that a first camera collects a preview image, and the preview image is displayed in a first preview interface of a first display screen; displaying a first to-be-selected multimedia content, wherein the first to-be-selected multimedia content is displayed on a first display screen or a second display screen, and both an object feature of the first to-be-selected multimedia content and an object feature of a preview image comprise a first object feature, wherein the first object feature is used for representing the content of the preview image, and a first operation of a user on the first to-be-selected multimedia content is detected; and responding to the first operation, and displaying the first to-be-selected multimedia content on the first preview interface.

Description

Photographing display method, electronic equipment and storage medium
Technical Field
The present application relates to the field of electronic technologies, and in particular, to a photographing display method, an electronic device, and a storage medium.
Background
At present, in order to shoot better images, users usually look at some images meeting their needs before shooting. After the user has viewed the images, the user takes the images with the electronic device with reference to the images.
The user only has to finish shooting the images by himself or herself during shooting. Images taken in this way may not meet the user's requirements and need to be reviewed and then taken. Therefore, the user needs to repeatedly operate to shoot the image meeting the self requirement, so that the shooting experience of the user is poor.
Disclosure of Invention
The embodiment of the application provides a photographing display method, an electronic device and a storage medium, which can display multimedia content capable of being referred to in real time by using a display screen of the electronic device in the photographing process of the electronic device, so that a photographed person can photograph based on the multimedia content, images with good effect can be photographed, and the photographing experience of the photographed person is improved.
In order to achieve the technical purpose, the embodiment of the application adopts the following technical scheme:
in a first aspect, an embodiment of the present application provides a photographing display method, which is applied to an electronic device including a first display screen, a second display screen, and a first camera, where the first display screen and the first camera are oriented in the same direction, and the first display screen and the second display screen are arranged in a back-to-back manner, and the method includes: the method comprises the steps that a first camera collects a preview image, and the preview image is displayed in a first preview interface of a first display screen; then, displaying the first multimedia content to be selected; then detecting a first operation of the user on the first to-be-selected multimedia content; and responding to the first operation, and displaying the first to-be-selected multimedia content on the first preview interface.
The object features of the first to-be-selected multimedia content and the object features of the preview image both comprise first object features. The first object features are used for characterizing the content of the preview image, and the object features comprise at least one of the following: character features and scene features.
It can be understood that, during the shooting of the shot person by the first camera, the electronic equipment displays the first to-be-selected multimedia content on the first display screen towards the shot person. The object features of the first to-be-selected multimedia content comprise first object features, and the first object features represent the content of the preview image. That is, the first candidate multimedia content includes content similar to the preview image. And because the preview image comprises the current shooting scene, the first to-be-selected multimedia content comprises the content similar to the preview image, which means that the first to-be-selected multimedia content comprises the content similar to the current shooting scene, and the first to-be-selected multimedia content has a certain reference value for the shot person. Furthermore, the shot person can refer to the first to-be-selected multimedia content while shooting to adjust the shot person to the best state and then shoot. Therefore, the process that the photographer repeatedly checks the first to-be-selected multimedia content and shoots the first to-be-selected multimedia content is avoided, the user operation is simplified, and the shooting experience of the user is improved.
In a possible design manner of the first aspect, before the displaying the first to-be-selected multimedia content, the method further includes: extracting object features of the preview image; acquiring a plurality of reference multimedia contents, and determining the object characteristics of each reference multimedia content in the plurality of reference multimedia contents; determining similarity between the object features of each reference multimedia content and the object features of the preview image; and determining that the at least one to-be-selected multimedia content comprises a reference multimedia content with the similarity larger than a preset similarity threshold, wherein the at least one to-be-selected multimedia content comprises a first to-be-selected multimedia content. The reference multimedia contents are locally stored multimedia contents for reference of photographing or multimedia contents acquired from a server for reference of photographing.
It can be understood that the electronic device determines that the reference multimedia content with the similarity greater than the preset similarity threshold is at least one candidate multimedia content from the plurality of reference multimedia contents. The similarity is a similarity between an object feature of one reference multimedia content and an object feature of the preview image, and the object feature may include a character feature and a scene feature. Then, the similarity is greater than a preset similarity threshold, which indicates that there is a similar character feature or scene feature between the reference multimedia content and the preview image. And because the preview image reflects the current framing content, the reference multimedia content is similar to the character feature or the scene feature in the current framing content, and has a higher reference value for the shot receiver. Furthermore, at least one to-be-selected multimedia content with the similarity larger than the preset similarity threshold determined by the electronic device has a larger reference value. The electronic equipment provides at least one piece of multimedia content to be selected for the user to select, and the first multimedia content to be selected, which is selected by the user from the at least one piece of multimedia content to be selected, also has a relatively high reference value.
In another possible design manner of the first aspect, the method further includes: under the condition that a second operation on the local multimedia content input by the user on the first display screen is detected, controlling the first display screen to jump from the first preview interface to the local multimedia interface; the local multimedia interface includes at least one local multimedia content different from the plurality of reference multimedia contents; detecting a third operation input by a user on the first display screen and aiming at least one local multimedia content; and responding to the third operation, determining that the at least one to-be-selected multimedia content further comprises the local multimedia content selected by the third operation, and controlling the first display screen to jump from the local multimedia interface to the first preview interface.
It is understood that, in addition to determining the first to-be-selected multimedia content according to the object features of the preview image, the electronic device may detect a third operation on the local multimedia content input by the user on the first display screen. The electronic equipment adds the local multimedia content selected by the third operation into at least one to-be-selected multimedia content, and any local multimedia content in the at least one to-be-selected multimedia content can be used as the first to-be-selected multimedia content and displayed on the first shooting interface. Therefore, the user can manually add local multimedia contents which need to be referred to and carry out reference in the shooting process.
In another possible design manner of the first aspect, the method further includes: and displaying at least one to-be-selected multimedia content on the first preview interface. The detecting of the first operation of the user on the first to-be-selected multimedia content includes: a first operation input by a user on the first display screen is detected.
It is understood that this design describes one embodiment of an electronic device receiving a first operation.
In another possible design manner of the first aspect, the displaying at least one candidate multimedia content on the first preview interface includes: and displaying at least one to-be-selected multimedia content in the first preview interface according to the similarity between the first preview interface and the object features of the preview image.
It can be understood that, according to the above analysis, it is known that "at least one candidate multimedia content having a similarity greater than a preset similarity threshold determined by the electronic device has a greater reference value", and the greater the similarity, the greater the reference value provided by the candidate multimedia content to the shot multimedia content is. Therefore, the electronic device may display the at least one candidate multimedia content in the order of the similarity, for example, display the at least one candidate multimedia content in the order of the similarity from large to small, and then allow the user to preferentially select the one candidate multimedia content with a higher reference value as the first candidate multimedia content.
In another possible design manner of the first aspect, before the displaying the first to-be-selected multimedia content, the method further includes: extracting object features of the preview image; and if the object characteristics of the preview image meet the preset video reference requirement, determining at least one to-be-selected multimedia content as at least one reference video, wherein the at least one to-be-selected multimedia content comprises a first to-be-selected multimedia content. At least one reference video is a video which is locally stored and used for reference of photographing or a video which is acquired from a storage server and used for reference of photographing; the preset video reference requirement includes that the object feature of the preview image includes age information, and the age information belongs to target age information.
It is understood that, in order to be able to attract the attention of the photographer towards the first camera for taking the image, the plurality of reference multimedia contents may include a reference video that is able to attract the attention of the photographer. Furthermore, the first multimedia content to be selected can be any reference video, and the reference video is displayed on the first display screen, so that the attention of the photographed person can be attracted, and the photographed person can face the first display screen. And the first camera is faced to the first display screen, so that the image comprising the front face of the shot person can be shot by the first camera.
For example, by the fact that the subject who needs to attract attention may be a child, the target age information in the preset video reference requirement may be a child. The electronic device may provide at least one reference video capable of attracting attention of a child when the object features of the preview image include the child, and allow the user to select one of the reference videos to be displayed on the first preview interface. The reference video can attract the attention of the child, so that the child faces the first camera. At this time, the first camera can shoot images including the front face of the child.
In another possible design manner of the first aspect, after the first to-be-selected multimedia content is displayed on the first preview interface, the method further includes: under the condition that the first to-be-selected multimedia content is a first image, extracting an image outline of the first image, and displaying the image outline by adopting a preset first display effect on a first preview interface; under the condition that a fourth operation of the user on the image contour is detected, the image contour is adjusted, and the adjusted image contour is displayed on a first preview interface; a fourth operation for triggering an adjustment of at least one of a size and a position of the image contour; and under the condition that the fifth operation of the user on the first display effect is detected, updating the first display effect, and displaying the image contour by adopting the updated first display effect on the first preview interface.
It is understood that, in order to provide a better reference effect, the electronic device may extract an image contour of the first multimedia content to be selected and display the image contour. The image outline can provide reference for the shot person, and can reduce the shielding of the preview image displayed on the first preview interface. In this way, the photographer can see the framing effect through the first display screen and can refer to the image outline. Therefore, the shot person can adjust the self to the best state to shoot by combining the framing effect and the image contour. The shot image can better meet the requirements of the shot person, and the satisfaction degree of the shot person is improved.
In another possible design of the first aspect, the first image includes a person. The extracting an image contour of the first image and displaying the image contour on the first preview interface by using a preset first display effect includes: and extracting the figure outline of the first image, and displaying the figure outline by adopting a preset first display effect on a first preview interface.
It is to be appreciated that if the first image includes a person, the electronic device can extract and display a person outline for the first candidate multimedia content. The figure outline can provide reference for the shot person, and can reduce the obstruction of the preview image displayed on the first preview interface.
In another possible design manner of the first aspect, the method further includes: the first camera collects a preview image, and displays the preview image in a second preview interface of a second display screen; under the condition that a second operation on the local multimedia content input by the user on the second display screen is detected, controlling the second display screen to jump from the second preview interface to the local multimedia interface; the local multimedia interface includes at least one local multimedia content different from the plurality of reference multimedia contents; detecting a third operation input by the user on the second display screen aiming at the at least one local multimedia content; and responding to the third operation, determining that the at least one to-be-selected multimedia content further comprises the local multimedia content selected by the third operation, and controlling the second display screen to jump from the local multimedia interface to the second preview interface.
It can be understood that this design describes that, in addition to detecting the multimedia content to be selected manually added by the user through the first display screen, the electronic device can also detect the multimedia content to be selected manually added by the user through the first display screen.
In another possible design manner of the first aspect, the method further includes: and displaying at least one to-be-selected multimedia content on the second preview interface. The detecting of the first operation of the user on the first to-be-selected multimedia content includes: a first operation input by a user on the second display screen is detected.
It is understood that this design describes another embodiment where the electronic device receives the first operation.
In another possible design of the first aspect, the character characteristic includes at least one of: number of persons, gender of persons, and age information of persons. The scene characteristics include at least one of: location information, time information, and environment type.
In a second aspect, an embodiment of the present application provides an electronic device, which includes a first display screen, a second display screen, a first camera, a memory, and a processor. The first display screen and the first camera are in the same orientation, and the first display screen and the second display screen are arranged in a back-to-back mode. The first display screen, the second display screen, the first camera and the memory are coupled with the processor. The first camera is used for collecting a preview image, and the first display screen is used for displaying the preview image and first to-be-selected multimedia content; the memory has stored therein computer program code comprising computer instructions which, when executed by the processor, cause the electronic device to perform the method as set forth in the first aspect and any of its possible designs.
In a third aspect, an embodiment of the present application further provides an electronic device, where the electronic device includes a first display screen, a second display screen, a first camera, a memory, and a processor. The first display screen and the first camera are in the same orientation, and the first display screen and the second display screen are arranged in a back-to-back mode. The first display screen, the second display screen, the first camera and the memory are coupled with the processor. The first camera is used for collecting a preview image, and the first display screen is used for displaying the preview image and first to-be-selected multimedia content; the memory has stored therein computer program code comprising computer instructions.
The computer instructions, when executed by the processor, cause the electronic device to perform the steps of: the method comprises the steps that a first camera collects a preview image, and the preview image is displayed in a first preview interface of a first display screen; displaying the first multimedia content to be selected; detecting a first operation of a user on a first to-be-selected multimedia content; and responding to the first operation, and displaying the first to-be-selected multimedia content on the first preview interface.
The object features of the first to-be-selected multimedia content and the object features of the preview image both comprise first object features. The first object features are used for characterizing the content of the preview image, and the object features comprise at least one of the following: character features and scene features.
In a possible design of the third aspect, the computer instructions, when executed by the processor, cause the electronic device to specifically perform the following steps: before the first to-be-selected multimedia content is displayed, extracting object features of a preview image; acquiring a plurality of reference multimedia contents, and determining the object characteristics of each reference multimedia content in the plurality of reference multimedia contents; determining similarity between the object features of each reference multimedia content and the object features of the preview image; and determining that the at least one to-be-selected multimedia content comprises a reference multimedia content with the similarity larger than a preset similarity threshold, wherein the at least one to-be-selected multimedia content comprises a first to-be-selected multimedia content. The plurality of reference multimedia contents are multimedia contents for photographing reference stored locally or multimedia contents for photographing reference acquired from a server.
In another possible design of the third aspect, the computer instructions, when executed by the processor, cause the electronic device to further perform the following steps: under the condition that second operation on local multimedia content input by a user on the first display screen is detected, controlling the first display screen to jump from the first preview interface to the local multimedia interface; the local multimedia interface includes at least one local multimedia content different from the plurality of reference multimedia contents; detecting a third operation input by a user on the first display screen and aiming at least one local multimedia content; and responding to the third operation, determining that the at least one to-be-selected multimedia content further comprises the local multimedia content selected by the third operation, and controlling the first display screen to jump from the local multimedia interface to the first preview interface.
In another possible design of the third aspect, the computer instructions, when executed by the processor, cause the electronic device to further perform the following steps: and displaying at least one to-be-selected multimedia content on the first preview interface. The detecting of the first operation of the user on the first to-be-selected multimedia content includes: a first operation input by a user on a first display screen is detected.
In another possible design of the third aspect, when the computer instructions are executed by the processor, the electronic device specifically performs the following steps: and displaying at least one to-be-selected multimedia content in the first preview interface according to the similarity between the first preview interface and the object features of the preview image.
In another possible design of the third aspect, when the computer instructions are executed by the processor, the electronic device specifically performs the following steps: before the first to-be-selected multimedia content is displayed, extracting object features of a preview image; and if the object characteristics of the preview image meet the preset video reference requirement, determining at least one to-be-selected multimedia content as at least one reference video, wherein the at least one to-be-selected multimedia content comprises a first to-be-selected multimedia content. At least one reference video is a video which is locally stored and used for reference of photographing or a video which is acquired from a storage server and used for reference of photographing; the preset video reference requirement includes that the object feature of the preview image includes age information, and the age information belongs to target age information.
In another possible design of the third aspect, the computer instructions, when executed by the processor, cause the electronic device to further perform the following steps: after the first to-be-selected multimedia content is displayed on the first preview interface, under the condition that the first to-be-selected multimedia content is a first image, extracting an image contour of the first image, and displaying the image contour on the first preview interface by adopting a preset first display effect; under the condition that a fourth operation of the user on the image contour is detected, the image contour is adjusted, and the adjusted image contour is displayed on a first preview interface; a fourth operation for triggering an adjustment of at least one of a size and a position of the image contour; and under the condition that the fifth operation of the user on the first display effect is detected, updating the first display effect, and displaying the image contour by adopting the updated first display effect on the first preview interface.
In another possible design of the third aspect, the first image includes a person. The computer instructions, when executed by the processor, cause the electronic device to further perform the steps of: and extracting the figure outline of the first image, and displaying the figure outline by adopting a preset first display effect on a first preview interface.
In another possible design of the third aspect, the computer instructions, when executed by the processor, cause the electronic device to further perform the following steps: the first camera collects a preview image, and displays the preview image in a second preview interface of a second display screen; under the condition that a second operation on the local multimedia content input by the user on the second display screen is detected, controlling the second display screen to jump from the second preview interface to the local multimedia interface; the local multimedia interface includes at least one local multimedia content different from the plurality of reference multimedia contents; detecting a third operation input by the user on the second display screen aiming at the at least one local multimedia content; and responding to the third operation, determining that the at least one to-be-selected multimedia content further comprises the local multimedia content selected by the third operation, controlling the second display screen to jump from the local multimedia interface to the second preview interface, and displaying a preview image on the second preview interface.
In another possible design of the third aspect, the computer instructions, when executed by the processor, cause the electronic device to further perform the following steps: and displaying at least one to-be-selected multimedia content on the second preview interface. The detecting of the first operation of the user on the first to-be-selected multimedia content includes: a first operation input by a user on the second display screen is detected.
In another possible design of the third aspect, the character features include at least one of: number of persons, gender of persons, and age information of persons. The scene characteristics include at least one of: location information, time information, and environment type.
In a fourth aspect, embodiments of the present application further provide a computer-readable storage medium, where computer instructions are stored on the computer-readable storage medium, and when the computer instructions are executed on an electronic device, the electronic device is caused to perform the photo display method according to the first aspect and any possible implementation manner thereof.
In a fifth aspect, embodiments of the present application further provide a computer program product, which includes computer instructions, where the computer instructions are executable on an electronic device, so that the electronic device executes the photo display method according to the first aspect and any possible implementation manner thereof.
It is to be understood that the advantageous effects achieved by the electronic device according to the second aspect, the third aspect, and any possible design manner thereof, the computer-readable storage medium according to the fourth aspect, and the computer program product according to the fifth aspect may refer to the advantageous effects of the first aspect and any possible design manner thereof, and are not described herein again.
Drawings
Fig. 1A is a schematic product form view of an electronic device with a foldable screen folded outwards according to an embodiment of the present application;
fig. 1B is a schematic product form view of an electronic device with a foldable screen folded inwards according to an embodiment of the present application;
fig. 2 is a schematic product form of an electronic device including at least two non-foldable display screens according to an embodiment of the present application;
FIG. 3 is a schematic interface diagram of a photographing display method in the prior art;
fig. 4 is a schematic structural diagram of a photographing display system according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 6 is a first flowchart of a photo display method according to an embodiment of the present disclosure;
fig. 7 is a first schematic diagram of a photographing display interface in a self-photographing scene according to an embodiment of the present application;
fig. 8 is a schematic diagram of a photographing display interface in a scene of taking a photo by the user according to an embodiment of the present application;
fig. 9 is a schematic view of a photographing display interface for children according to an embodiment of the present disclosure;
fig. 10 is a flowchart of a photo display method according to an embodiment of the present application;
FIG. 11 is a schematic interface diagram of a display effect regarding an image contour according to an embodiment of the present disclosure;
fig. 12 is a flowchart of a photographing display method in a self-photographing scene according to an embodiment of the present application;
fig. 13 is a second schematic diagram of a photographing display interface in a self-photographing scene according to an embodiment of the present application;
fig. 14 is a flowchart of a photographing display method in an other photographing scene according to an embodiment of the present application;
fig. 15 is a schematic structural diagram of a chip system according to an embodiment of the present application.
Detailed Description
In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present application, "a plurality" means two or more unless otherwise specified.
The embodiment of the application provides a photographing display method which can be applied to electronic equipment comprising a first display screen and a first camera. Wherein, the orientation of first display screen and first camera is the same. The first camera may refer to a camera used for shooting a subject in the electronic device. Then, the first display screen, which is oriented in the same direction as the first camera, is also oriented toward the subject.
The photographing display method provided by the embodiment of the application can be applied to a self-photographing scene (namely, a photographed person and a photographer are the same object) and a photographing scene (namely, the photographed person and the photographer are different objects).
In a self-timer scenario, the electronic device may include a display screen (e.g., the first display screen mentioned in this embodiment of the application). Of course, in practical applications, the electronic device may further include other display screens, such as a second display screen opposite to the first display screen, and a third display screen connected to the folding edge of the first display screen (in this case, the electronic device is an electronic device including a foldable display screen).
In his shooting scenario, the electronic device may include at least two display screens. The at least two display screens may include a first display screen and a second display screen opposite the first display screen; the electronic device may be a foldable screen or a non-foldable screen, such as a curved screen. Of course, in practical applications, the electronic device may further include other display screens, such as a third display screen connected to the folded edge of the first display screen.
Among them, the at least two display screens in the electronic device may be at least two display screens (which may be simply referred to as folding screens) that are foldable (e.g., a screen and B screen shown in (B) of fig. 1A, a1 screen and a2 screen shown in (c) of fig. 1B), or at least two display screens that are not foldable (e.g., a screen and B screen shown in fig. 2). The foldable screen may be folded to form at least two display screens, for example, the foldable screen may be folded along a folding edge or a folding axis to form a first display screen and a second display screen that are opposite to each other. The at least two non-foldable display screens may include a first display screen and a second display screen that are always opposite each other in the electronic device.
The folding screens in the embodiments of the present application can be classified into two types. The foldable screens folded outwards (called as outwards folded screens for short) and the foldable screens folded inwards (called as inwards folded screens for short) are adopted as one type of the foldable screens. For example, the foldable screen may be folded to form the first display screen and the second display screen. The first display screen and the second display screen are back to back after the folding screen is folded. After the inward folding screen is completely unfolded, the first display screen and the second display screen are opposite to each other.
For example, please refer to fig. 1A, which shows a product configuration diagram of an electronic device 100 with a folding screen according to an embodiment of the present application. Fig. 1A is a schematic view of the folded-out screen in a fully unfolded state. The folded-out screen may be folded along the folded edges in the directions 102a and 102B as shown in fig. 1A (a), to form a and B screens as shown in fig. 1A (B). The folded-out screen can be folded along the folding edges in the directions 103a and 103b shown in fig. 1A (b), and can be folded into the folded-out screen shown in fig. 1A (c). As shown in fig. 1A (c), when the foldable screen of the electronic device 100 is completely folded, the a screen and the B screen are opposite to each other and visible to the user.
The orientation of the screen a is the same as that of the camera 101a, and the orientation of the screen B is the same as that of the camera 101B.
It is understood that for an electronic device having a fold-out folding screen, the interface may be displayed on screen a, on screen B, or on both screen a and screen B when the folding screen is in the folded state. When the folding screen is in the unfolding state, interfaces can be displayed on the A screen and the B screen. For the description of the unfolding state and the folding state of the folding screen, reference may be made to the description in the following embodiments, which are not repeated herein.
It should be noted that, an electronic device having at least two non-foldable display screens provided in the embodiments of the present application may refer to the electronic device 100 shown in fig. 1A (c). Unlike the electronic apparatus 100, the electronic apparatus having at least two display screens that are not foldable does not have a folding edge, which includes a screen a and a screen B facing each other.
For another example, please refer to fig. 1B, which shows a product form diagram of an electronic device 100 with a foldable screen folded inwards according to an embodiment of the present application. Fig. 1B (a) is a schematic view of the fully unfolded folded-in screen. When the fold-in folding screen is fully unfolded, an a-screen of the electronic device 100 may be formed. As shown in fig. 1B (B), a B screen may be provided on the back of the a screen.
The orientation of the screen A is the same as that of the camera 201a, and the orientation of the screen B is the same as that of the camera 201B.
The fold-in screen may be folded along the folded edges in the directions 202a and 202B shown in fig. 1B (a), to form the fold-in screen shown in fig. 1B (c). The flap-in screen can be folded along the folding edge in the directions 203a and 203B as shown in fig. 1B (c), and can be folded into the folded state as shown in fig. 1B (d). As shown in fig. 1B (d), when the folded-in folding screen is completely folded, the two folded parts of the a-screen are opposite to each other, and the black line 204 is a line on the contact surface of the two folded parts of the a-screen. After the folding screen is completely folded, the screen A is invisible to the user, and the screen B is visible to the user.
If the A screen consists of two display screens, namely an A1 screen and an A2 screen, the A1 screen and the A2 screen shown in (c) of FIG. 1B can be formed after the folded-in folding screen is folded. As shown in fig. 1B (d), when the fold-in screen is completely folded, the a1 screen and the a2 screen are opposite to each other, and the black line 204 is a line on the contact surfaces of the a1 screen and the a2 screen.
It is understood that for an electronic device having such a folding screen folded inwards, when the folding screen is in a folded state, an interface can be displayed on the B screen; when the folding screen is in the unfolding state, interfaces can be displayed on the A screen and the B screen.
Generally, the folding angle α of the folding screen (including the inward folding screen and the outward folding screen) is in the range of [0 °, 180 ° ]. And the folding included angle of the folded screen is the included angle between the screen A and the screen B. The folding angle of the folded-in folding screen is the angle between the A1 screen and the A2 screen. In the embodiment of the application, if α [0 °, P ], the electronic device may determine that the foldable screen is in the folded state; if α (P, 180 ° ], the electronic device may determine that the folding screen is in the unfolded state, or, if α [0 °, P), the electronic device may determine that the folding screen is in the folded state; if α [ P, 180 ° ], the electronic device can determine that the folding screen is in the unfolded state. Where P is a preset angle threshold. P can be determined according to the use habits of a large number of users using the folding screen; alternatively, P may be set in the electronic device by the user.
In some embodiments, according to the usage habit of most users, when the folding angle α is larger than 90 °, the possibility that the user wants to use the display screen located at both sides of the folding edge as a whole (i.e. as a complete display screen) is high. Therefore, the preset angle threshold P in the embodiment of the present application may be greater than 90 °. The value range of the preset angle threshold P may be (90 °, 180 °). For example, the preset angle threshold P may be 100 °, 120 °, 135 °, 140 °, 145 °, 150 °, or the like.
It should be noted that, at least two screens formed by folding the folding screens (including the inward folding screen and the outward folding screen) in the embodiment of the present application may be a plurality of screens (for example, the a screen and the B screen shown in (c) in fig. 1A) that are independent from each other, or may be one complete screen (for example, the a screen shown in (a) in fig. 1B) that is an integral structure, and only is folded to form at least two parts.
For example, the folded screen may be a flexible folded screen. The flexible folding screen comprises a folding edge made of flexible materials. Part or all of the flexible folding screen is made of flexible materials. At least two screens formed by folding the flexible folding screen are a whole screen of an integral structure, and only the flexible folding screen is folded to form at least two parts.
For another example, the folding screen may be a multi-screen folding screen. The multi-screen folding screen may include a plurality (two or more) of screens. The plurality of screens are a plurality of individual display screens. The plurality of screens may be connected in turn by a folding shaft. Each screen can rotate around a folding shaft connected with the screen, and folding of the multi-screen folding screen is achieved.
In fig. 1A and 1B, the foldable screen in the embodiment of the present application is described by taking the foldable screen as an example. In addition, in the following embodiments of the present application, the method provided in the embodiments of the present application is also described by taking the foldable screen as a flexible foldable screen as an example.
For example, please refer to fig. 2, which illustrates an electronic device with at least two non-foldable display screens provided in an embodiment of the present application. Fig. 2 (a) is an a-screen of the electronic device 100, and the a-screen includes a camera 210 a. Fig. 2 (B) is a B screen of the electronic apparatus 100, which includes the camera 210B. Fig. 2 (c) is a side view of the electronic apparatus 100, and a B screen is opposite to the a screen. As can be seen from (c) of fig. 2, there is no folding edge between the a screen and the B screen of the electronic apparatus 100, and the electronic apparatus 100 does not have a folding function.
It should be noted that the a screen in the electronic device 100 may be a first display screen, and the B screen is a second display screen. Alternatively, if the B screen in the electronic device 100 is the first display screen, the a screen is the second display screen. The camera in the first display screen may be referred to as a first camera and the camera in the second display screen may be referred to as a second camera.
Currently, when a photographer takes a picture of a person to be photographed by using a first camera in an electronic device, after controlling the first camera to start, and before the first camera starts to photograph, a preview image (which may also be referred to as a viewfinder image) collected by the first camera may be displayed on a first display screen in real time. The first display screen faces the shot person, and the shot person can view the preview image including the shot person through the first display screen. Further, a more satisfactory image is taken from the viewed preview image.
The preview image refers to an image acquired before shooting after the first camera starts working.
For example, taking the electronic device 100 shown in fig. 1B as an example, the B screen in the electronic device 100 may be a first display screen, and the a screen may be a second display screen. The camera 201B included in the B screen is the first camera. The second display screen is a complete screen of unitary construction. When the photographer uses the first camera 201b to perform his shooting, the preview image captured by the first camera 201b is displayed in real time on the second display screen after the first camera 201b is started. As shown in fig. 3 (a), the electronic apparatus 100 also displays a switch option 301 on the second display screen. The switch option 301 is used to trigger the electronic device 100 to synchronously display the preview image in the first display screen. When the switch option 301 is in the ON state (ON), the electronic apparatus displays a preview image captured by the first camera 201b ON the first display screen in real time, as shown in (b) of fig. 3.
Although the preview image captured by the first camera is displayed in real time on the first display screen facing the photographed person, in the case of photographing after some images which can be referred to need to be viewed, the preview image captured in real time is displayed to the photographed person only through the first display screen, and the photographed person still needs to finish photographing by virtue of the impression of the photographed person on the images. The images thus taken may still be significantly different from the effects of these referenceable images. The photographed person needs to review these images for reference and then photograph the images. In this way, the user needs to repeat the operation to capture a satisfactory image, resulting in a poor photographing experience of the subject.
In order to solve the problem of poor photographing experience caused by the fact that a user needs to repeatedly check a reference image and shoot the reference image, the embodiment of the application provides a photographing display method. Therefore, the shot person can refer to the first to-be-selected multimedia content while shooting so as to adjust the shot person to the best state and then shoot. Therefore, the first multimedia content to be selected is displayed for reference to the shot person in the shooting process, so that the process that the user repeatedly checks the image which can be referred to and shoots the image is avoided, the user operation is simplified, and the shooting experience of the user is improved.
The photographing display method provided by the embodiment of the application is suitable for a photographing display system. The photo display system can comprise an electronic device and a server. In conjunction with the electronic device 100 shown in FIG. 1B, FIG. 4 illustrates a picture-taking display system. As shown in fig. 4, the photo display system may include the electronic device 100 and may further include a server 401. In the case where the photo display system includes the server 401, the electronic apparatus 100 is connected to the server 401 through a wired network or a wireless network.
Some of the candidate multimedia contents provided by the electronic device 100 for the photographer may include a plurality of reference multimedia contents. The plurality of reference multimedia contents are multimedia contents for photographing reference stored locally or multimedia contents for photographing reference acquired from a server. The candidate multimedia contents may further include local multimedia contents selected by the user from at least one local multimedia content stored by the electronic device 100, for example, at least one local multimedia content stored in the gallery by the electronic device 100. The candidate multimedia contents may further include network multimedia contents that the user triggers the electronic device 100 to request the server 401 for retrieval.
The server 401 may provide services such as data storage and data processing for any user account recorded by the server 401. In a case where the electronic device 100 logs in any user account, the electronic device 100 may perform data interaction with the server 401 based on the user account. For example, the electronic device 100 receives network multimedia content (e.g., network images, network videos) from the server 401. The electronic device 100 may then determine that the candidate multimedia content includes the received network multimedia content.
The electronic device in the embodiment of the present application may be, for example, a mobile phone, a tablet computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, or the like. The server in the embodiment of the present application may be a cloud server or a server cluster. The embodiment of the present application does not set any limit to the specific forms of the electronic device and the server.
In the embodiment of the present application, an example in which the electronic device is a mobile phone is described, and a hardware structure of the electronic device is introduced. As shown in fig. 5, the electronic device 100 may include: the mobile phone includes a processor 510, an external memory interface 520, an internal memory 521, a Universal Serial Bus (USB) interface 530, a charging management module 540, a power management module 541, a battery 542, an antenna 1, an antenna 2, a mobile communication module 550, a wireless communication module 560, an audio module 570, a speaker 570A, a receiver 570B, a microphone 570C, an earphone interface 570D, a sensor module 580, a button 590, a motor 591, an indicator 592, a camera 593 (which may include cameras 1-N), a display 594 (such as a touch screen), and a Subscriber Identity Module (SIM) card interface 595 (which may include SIM card interfaces 1-N), and the like.
The sensor module 580 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
The display screen 594 may include a first display screen and may also include a second display screen. The camera 593 may include a first camera oriented the same as the first display screen and may also include a second camera oriented the same as the second display screen. The whole area where the first display screen is located can be provided with a touch sensor, and the touch sensor is used for sensing touch operation. The entire area where the second display screen is located may also be provided with touch sensors.
It is to be understood that the illustrated structure of the present embodiment does not constitute a specific limitation to the electronic apparatus 100. In other embodiments, electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Processor 510 may include one or more processing units, such as: processor 510 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), among others. The different processing units may be separate devices or may be integrated into one or more processors.
The controller may be a neural center and a command center of the electronic device 100. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.
A memory may also be provided in processor 510 for storing instructions and data. The instructions are used for being executed by the processor 501 to implement the photographing display method provided by the embodiment of the application. In some embodiments, the memory in processor 510 is a cache memory. The memory may hold instructions or data that have just been used or recycled by processor 510. If processor 510 needs to reuse the instruction or data, it may be called directly from memory. Avoiding repeated accesses reduces the latency of the processor 510, thereby increasing the efficiency of the system.
It should be understood that the interface connection relationship between the modules illustrated in the present embodiment is only an exemplary illustration, and does not limit the structure of the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.
The charging management module 540 is configured to receive charging input from a charger. The charging management module 540 may also provide power to the electronic device through the power management module 541 while charging the battery 542. In other embodiments, the power management module 541 and the charging management module 540 may be disposed in the same device.
The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 550, the wireless communication module 560, the modem processor, the baseband processor, and the like. The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 550 and antenna 2 is coupled to wireless communication module 560 such that electronic device 100 may communicate with networks and other devices via wireless communication techniques.
The wireless communication technology may include Global Navigation Satellite System (GNSS), Wireless Local Area Network (WLAN) (e.g., Wi-Fi network) technology, and the like. GNSS may include Global Positioning System (GPS), global navigation satellite system (GLONASS), beidou satellite navigation system (BDS), quasi-zenith satellite system (QZSS), and/or Satellite Based Augmentation System (SBAS), among others. For example, the electronic device 100 may obtain the real-time location information of the electronic device 100 through a positioning technology such as GPS, BDS, or SBAS.
The mobile communication module 550 may provide a solution including 2G/3G/4G/5G wireless communication, etc. applied to the electronic device 100. For example, the electronic device 100 may communicate with a server through the mobile communication module 550 to receive network multimedia content (e.g., network images, network videos) from the server.
The wireless Communication module 360 may provide a solution for wireless Communication applied to the electronic device 100, including WLAN (e.g., Wi-Fi network), Bluetooth (BT), GNSS, Near Field Communication (NFC), Infrared (IR), Frequency Modulation (FM), and the like. For example, the electronic device 100 may obtain real-time location information of the electronic device 100 through GNSS positioning technology.
The electronic device 100 implements display functionality via the GPU, the display screen 594 (e.g., the first display screen, the second display screen), and the application processor. The GPU is an image processing microprocessor connected to a display screen 594 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 510 may include one or more GPUs that execute program instructions to generate or alter display information.
The electronic device 100 may implement a capture function via the ISP, the camera 593, the video codec, the GPU, the display screen 594, the application processor, and the like. The external memory interface 520 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 100. The external memory card communicates with the processor 510 through the external memory interface 520 to implement a data storage function. Multimedia content such as images, videos, etc. is stored in an external memory card.
The internal memory 521 may be used to store computer-executable program code, which includes instructions. The internal memory 521 may also be used to store local multimedia content. The processor 510 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 521.
The electronic device 100 may implement an audio function through the audio module 570, the speaker 570A, the receiver 570B, the microphone 570C, the headphone interface 570D, and the application processor.
The gyro sensor may be used to determine the motion pose of the electronic device 100. The acceleration sensor may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. The method can also be used for recognizing the posture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.
The keys 590 include a power-on key, a volume key, and the like. The keys 590 may be mechanical keys. Or may be touch keys. The electronic apparatus 100 may receive a key input, and generate a key signal input related to user setting and function control of the electronic apparatus 100. The motor 591 may generate a vibration indication. The motor 591 can be used for incoming call vibration prompt and also can be used for touch vibration feedback. Indicator 592 can be an indicator light that can be used to indicate a charge status, a charge change, a message, a missed call, a notification, etc. The SIM card interface 595 is used to connect a SIM card. The SIM card interface 595 may support a Nano SIM card, a Micro SIM card, a SIM card, etc.
The methods in the following embodiments may be implemented in the electronic device 100 having the above-described hardware structure.
Please refer to fig. 6, which is a flowchart illustrating a photo display method according to an embodiment of the present disclosure. As shown in fig. 6, the photographing display method may include S601-S603.
S601, a first camera collects a preview image, and the electronic equipment displays a first preview interface on a first display screen; the first preview interface comprises a preview image acquired by the first camera.
The electronic equipment can detect the starting operation of the camera by the user. The electronic equipment responds to the starting operation, can trigger the first camera to work, the first camera collects the preview images, and controls the first display screen to display a first preview interface comprising the preview images (namely, the preview images are displayed in the first preview interface of the first display screen). The first preview interface may also be referred to as a first viewing interface. The first preview interface refers to an interface displayed by the electronic device while the camera is working, and is used for displaying images collected by the camera in the electronic device, control options of the camera, and the like.
Or, the electronic device may further include a second camera, and the electronic device may trigger the second camera to operate in response to the start operation. Then, the electronic device may detect a switching operation of the camera by the user. And responding to the conversion operation, the electronic equipment closes the second camera, triggers the first camera to work, and controls the first display screen to display the first preview interface. Wherein, first display screen and second display screen set up dorsad.
The first preview interface may include a conversion option, where the conversion option is used to trigger the electronic device to change the operating states of the first camera and the second camera. The conversion operation may be a click operation on the conversion option.
In the embodiment of the application, under the condition that a photographer uses the first camera to perform self-shooting, the electronic device can detect the starting operation of the camera and the conversion operation of the camera, which are input by a user on the first display screen.
For example, taking the electronic apparatus 100 shown in (a) of fig. 1B as an example, if the photographer performs self-shooting with the camera 201a in the electronic apparatus 100, the a screen facing the same direction as the camera 201a is the first display screen facing the photographer, and the camera 201a is the first camera. The first display screen is a complete screen of a unitary structure. As shown in fig. 7 (a), in the operating state of the first camera 201a, a first preview interface 710 is displayed on the first display screen. The first preview interface 710 includes a preview image captured by the first camera 201 a.
The first preview interface 710 may further include a conversion option 711 and a shooting option 712. The transition option 711 is used to trigger the electronic device to change the operating states of the first camera and the second camera. The shooting option 712 is used to trigger the electronic device to control the camera in the working state to shoot.
In the embodiment of the application, under the condition that a photographer uses the first camera to perform other photographing and the electronic device comprises the second display screen, the electronic device can detect the starting operation of the camera and the conversion operation of the camera, which are input by a user on the second display screen. When the first camera is in an operating state, the electronic device displays a second preview interface (which may also be referred to as a second view interface) on the second display screen in addition to the first preview interface on the first display screen.
Wherein, first display screen and second display screen set up dorsad. The second preview interface and the first preview interface may be the same or different. The second preview interface also comprises a preview image acquired by the first camera, namely the electronic equipment displays the preview image in the second preview interface of the second display screen. The second preview interface may further include: and the shooting option is used for triggering the shooting of the first camera.
For example, taking the electronic device 100 shown in (a) of fig. 1B as an example, if the photographer takes his/her photograph with the camera 201B in the electronic device 100, the B screen facing the same direction as the camera 201B is a first display screen facing the photographer, the camera 201B is a first camera, the a screen is a second display screen, and the camera 201a is a second camera. As shown in (a) of fig. 8, in the operating state of the first camera 201b, the electronic apparatus 100 displays a first preview interface 810 on the first display screen. As shown in fig. 8 (b), the electronic device may also display a second preview interface 820 on the second display screen.
The first preview interface 810 and the second preview interface 820 both include preview images acquired by the first camera 201 b. The second preview interface 820 may also include a conversion option 821, and a capture option 822.
S602, the electronic equipment displays a first to-be-selected multimedia content; the first to-be-selected multimedia content is displayed on the first display screen or the second display screen, the object features of the first to-be-selected multimedia content and the object features of the preview image both comprise first object features, and the first object features are used for representing the content of the preview image.
Wherein the first object feature comprises at least one of: character features and scene features. The character features are used to characterize features associated with the character. The scene features are used to characterize features associated with the image acquisition scene.
In the embodiment of the present application, the object feature of the first candidate multimedia content may include other object features different from the first object feature, in addition to the first object feature. Likewise, the object feature of the preview image may include other object features different from the first object feature in addition to the first object feature. The other object features may be different from the first object features, may indicate that the character features included in the other object features are different from the character features included in the first object features, and may also indicate that the scene features included in the other object features are different from the scene features included in the first object features.
In the embodiment of the present application, the character features may include at least one of the following: number of persons (e.g., 1 person, 2 persons, 3 persons or more, etc.), gender of persons (e.g., male, female), age information of persons (e.g., child, teenager, middle age, old age). The scene characteristics may include at least one of: location information (e.g., landmarks), time information (e.g., day, night, etc.), environment type (e.g., indoor, outdoor, etc.), weather (e.g., sunny, cloudy, rainy, snowy, etc.). The object features may also be labels recognized by AI (e.g., landscape, sea, green, etc.), gestures of people in the image, items held by people in the image, etc.
In this embodiment, before S602, the electronic device may extract an object feature of the preview image. Then, the electronic device acquires a plurality of reference multimedia contents and determines an object characteristic of each of the plurality of reference multimedia contents. The electronic device then determines a similarity between the object features of each of the reference multimedia content and the object features of the preview image. Finally, the electronic equipment determines that the at least one to-be-selected multimedia content comprises a reference multimedia content with the similarity larger than a preset similarity threshold; the at least one candidate multimedia content includes a first candidate multimedia content.
In some embodiments, in the case that a photographer performs self-timer shooting using a first camera, after the electronic device displays a first preview interface on a first display screen, a first request operation input by a user on the first display screen may be detected. The electronic equipment responds to the first request operation and extracts the object characteristics of the preview image.
The first request operation is used for triggering the electronic equipment to acquire the multimedia content to be selected. The first request operation may be a preset slide operation. Alternatively, the first preview interface may include the first option, and the first request operation may be a click operation on the first option in the first preview interface. The first option is used for triggering the electronic equipment to acquire the multimedia content to be selected.
Further, the electronic device, in response to the first request operation, may pop up a preset multimedia window on the first preview interface in addition to extracting an object feature of a frame of preview image acquired at the current time. The preset multimedia window is used for displaying multimedia contents.
Illustratively, for the first preview interface 710 shown in fig. 7 (a), the first preview interface 710 may further include a first option 713. The first option 713 is for triggering the electronic device 100 to retrieve multimedia content. The electronic apparatus 100 detects a click operation of the first option 713 input by the user on the first display screen. The user's click operation on the first option 713 is a first request operation. As shown in (b) of fig. 7, in response to the first request operation, the electronic device 100 extracts an object feature of one frame of the preview image and pops up a preset multimedia window 714 on the first preview interface 710.
As can be seen from (a) in fig. 7, the object features of the preview image extracted by the electronic device 100 may include: female, Beijing Oracle, one person.
In some embodiments, in a case where the photographer performs his/her photographing with the first camera and the electronic device includes the second display screen, the electronic device displays the first preview interface on the first display screen and may detect the first request operation input by the user on the first display screen or the second display screen after the second preview interface is displayed on the second display screen.
For example, when the electronic device detects a first request operation input by the user on the second display screen, the second preview interface may include the first option, and the first request operation may be a click operation on the first option in the second preview interface. Further, the electronic device, in response to the first request operation, may pop up a preset multimedia window on the second preview interface in addition to extracting the object feature of the one frame of preview image acquired at the current time.
Illustratively, for the second preview interface 820 shown in fig. 8 (a), the second preview interface 820 does not include the first option 713. As shown in (b) of fig. 8, the electronic apparatus 100 detects a preset slide operation input by the user on the second display screen. The preset slide operation is a first request operation. The electronic apparatus 100 extracts an object feature of one frame of the preview image in response to the first request operation, and pops up a preset multimedia window 823 on the second preview interface 820, as shown in (c) of fig. 8.
As can be seen from (a) and (b) in fig. 8, the object features of the preview image extracted by the electronic device 100 may include: female, Beijing Oracle, one person.
In the embodiment of the application, after the electronic device extracts the object features of the preview image, a plurality of locally stored reference multimedia contents may be acquired, or a plurality of reference multimedia contents may be acquired from a server. The plurality of reference multimedia contents acquired by the electronic equipment can be marked with object characteristics. Or, if the plurality of reference multimedia contents acquired by the electronic device do not have the object feature, the electronic device extracts the object feature from the plurality of reference multimedia contents respectively.
The electronic device may then determine that the at least one candidate multimedia content includes reference multimedia content having object features similar to the object features of the preview image.
Or, the electronic device may further acquire real-time location information of the electronic device through positioning technologies such as GPS, BDS, or SBAS. The electronic device takes the real-time location information as location information in the object feature of the preview image. The electronic device then determines that the at least one candidate multimedia content includes a reference multimedia content having object features similar to the object features of the preview image.
In some embodiments, the similarity of the object feature of the reference multimedia content and the object feature of the preview image may mean that the first object feature is the same between the object feature of the reference multimedia content and the object feature of the preview image, for example, the number of persons in the object feature of the reference multimedia content is the same as the number of persons in the object feature of the preview image.
In some embodiments, the electronic device may determine a similarity between the object feature of each reference multimedia content and the object feature of the preview image (i.e., a similarity corresponding to each reference multimedia content), and further determine a plurality of similarities corresponding to the plurality of reference multimedia contents. Then, the electronic device determines that the at least one candidate multimedia content includes a reference multimedia content with a corresponding similarity greater than a preset similarity threshold.
The similarity corresponding to any one of the reference multimedia contents may be equal to the number of the same features between the object feature of the preview image and the object feature of the reference multimedia content. The preset similarity threshold may be a positive integer greater than 0.
Illustratively, the object features of the preview image include: the number of persons is 1 person, the sex of the person is female, the location information is building a, the time information is day time, and the environment type is outdoor. The object characteristics of any one of the reference multimedia contents are: the number of persons is 1 person, the sex of the person is a woman, the location information is building a, and the time information is night. The similarity between the object features of the preview image and the object features of the reference multimedia content is 3.
In some embodiments, the plurality of reference multimedia content may include at least one of a plurality of reference images and a plurality of reference videos. Accordingly, the at least one candidate multimedia content may also include at least one of at least one candidate image and at least one candidate video. The object features of the reference image and the reference video may be different or the same.
S603, the electronic equipment detects the trigger operation of the user on the first to-be-selected multimedia content, responds to the trigger operation, and displays the first to-be-selected multimedia content on the first preview interface.
Wherein the first candidate multimedia content may be one of the at least one candidate multimedia content. The shot person adjusts itself by referring to the first to-be-selected multimedia content on the first preview interface so as to make itself in a better state. Then, an image is captured by the first camera. The shot image can better meet the requirements of the shot person.
In the embodiment of the application, after the electronic device determines at least one multimedia content to be selected, the electronic device can display the at least one multimedia content to be selected on the first display screen under the condition that a photographer uses the first camera to perform self-shooting. Then, the electronic device can detect a triggering operation of a first to-be-selected multimedia content in the at least one to-be-selected multimedia content input by a user on the first display screen, and display the first to-be-selected multimedia content in the first preview interface.
Or, in the case that the photographer performs his photographing with the first camera and the electronic device includes the second display screen, the at least one multimedia content to be selected may be displayed on the first display screen or the second display screen. Then, the electronic device may detect a triggering operation of the first to-be-selected multimedia content input by the user on the first display screen or the second display screen, and display the first to-be-selected multimedia content in the first preview interface. The electronic device may also display or not display the first to-be-selected multimedia content on the second preview interface.
The triggering operation on the first to-be-selected multimedia content may be a clicking operation, a sliding operation or a dragging operation on the first to-be-selected multimedia content.
The electronic equipment can display at least one to-be-selected multimedia content on the first display screen or the second display screen according to the size sequence of the similarity between the electronic equipment and the object features of the preview image. That is to say, the at least one to-be-selected multimedia content displayed on the first display screen or the second display screen is the at least one to-be-selected multimedia content sorted according to the size sequence of the similarity.
In some embodiments, in the case that the electronic device pops up a preset multimedia window on the first preview interface or the second preview interface, the electronic device may display at least one candidate multimedia content in the preset multimedia window.
Illustratively, taking the at least one candidate multimedia content as the at least one candidate image as an example, for the first preview interface 710 shown in (b) of fig. 7, the first preview interface 710 includes a preset multimedia window 714, and the preset multimedia window 714 includes at least one ordered candidate image. The electronic device 100 detects a dragging operation of a certain image 715 to be selected in the preset multimedia window 714, which is input by a user on the first display screen. Wherein, the dragging operation on the candidate image 715 is a triggering operation on the first candidate multimedia content. The candidate image 715 is the first image. As shown in fig. 7 (c), in response to a trigger operation, the electronic device 100 displays a first image 715 on the first preview interface 710 and hides a preset multimedia window 714.
As can be seen from (c) in fig. 7, since the electronic device 100 extracts the object feature of the preview image, it includes: female, Beijing Oracle, one person. Thus, the object features of first image 715 may also include: female, Beijing Oracle, one person.
Illustratively, taking the at least one candidate multimedia content as the at least one candidate image as an example, for the second preview interface 820 shown in fig. 8 (c), the second preview interface 820 includes a preset multimedia window 823, and the preset multimedia window 823 includes at least one candidate image after sorting. The electronic device 100 detects a click operation on a certain image 824 to be selected in the preset multimedia window 823, which is input by the user on the second display screen. Wherein, the click operation on the image to be selected 824 is a trigger operation on the first multimedia content to be selected. The candidate image 824 is the first image. As shown in (d) of fig. 8, the electronic device 100 displays a first image 824 on the first preview interface 810 in response to a trigger operation. Meanwhile, as shown in (e) of fig. 8, the electronic apparatus 100 may further display a first image 824 on the second preview interface 820 and hide the preset multimedia window 823.
As can be seen from (d) in fig. 8, since the electronic device 100 extracts the object feature of the preview image, it includes: female, Beijing Oracle, one person. In this regard, the object features of the first image 824 may also include: female, Beijing Oracle, one person.
It can be understood that, during the shooting of the shot person by the first camera, the electronic equipment displays the first to-be-selected multimedia content on the first display screen towards the shot person. The object features of the first to-be-selected multimedia content comprise first object features, and the first object features represent the content of the preview image. That is, the first candidate multimedia content includes content similar to the preview image. And because the preview image comprises the current shooting scene, the first to-be-selected multimedia content comprises the content similar to the preview image, which means that the first to-be-selected multimedia content comprises the content similar to the current shooting scene, and the first to-be-selected multimedia content has a certain reference value for the shot person. Furthermore, the shot person can refer to the first to-be-selected multimedia content while shooting so as to adjust the shot person to the best state and then shoot. Therefore, the process that the photographer repeatedly checks the first to-be-selected multimedia content and shoots the first to-be-selected multimedia content is avoided, the user operation is simplified, and the shooting experience of the user is improved.
In the embodiment of the present application, in order to be able to attract the attention of the photographer to face the first camera for photographing the image, the plurality of reference multimedia contents may include a reference video that is able to attract the attention of the photographer. Furthermore, the first multimedia content to be selected can be any reference video, and the reference video is displayed on the first display screen, so that the attention of the photographed person can be attracted.
Wherein the plurality of reference multimedia contents may include at least one reference video set for any type of the photographed persons who need to attract attention. The object features marked by the at least one reference video may include object features possessed by this type of photographer. For example, any type of subject who needs to attract attention may be a child, and the age information in the object feature marked by the at least one reference video is a child.
Specifically, after extracting the object features of the preview image, the electronic device determines that at least one to-be-selected multimedia content is at least one reference video if the object features of the preview image meet a preset video reference requirement; the at least one candidate multimedia content includes a first candidate multimedia content. At least one reference video is a video which is locally stored and used for reference of photographing or a video which is acquired from a storage server and used for reference of photographing; the preset video reference requirement includes that the object feature of the preview image includes age information, and the age information belongs to target age information.
Illustratively, taking the example that the subject who needs to attract attention is a child, the electronic device may acquire a plurality of reference multimedia contents in advance. The plurality of reference multimedia contents may include a plurality of reference images and a plurality of reference videos marked with children. The electronic device extracts object features for each reference image in the plurality of reference multimedia contents and marks the reference image with the extracted object features. The electronic device then stores a plurality of reference images tagged with the object features and a plurality of reference videos tagged with the child.
Further, if the object features of the preview image include a child, the electronic device may determine at least one candidate video from the plurality of reference videos marked with the child, for example, the at least one candidate video may be the plurality of reference videos marked with the child. The electronic device may then display the at least one video to be selected on the first preview interface or the second preview interface. At this time, the at least one candidate multimedia content is at least one candidate video.
If the object features of the preview image do not include the child, the electronic device may determine that at least one image to be selected includes a reference image with a similarity greater than a preset similarity threshold from the plurality of reference images marked with the object features. Then, the electronic equipment displays at least one image to be selected on the first preview interface or the second preview interface. At this time, the at least one candidate multimedia content is at least one candidate image.
For example, taking the electronic device 100 shown in (a) of fig. 1B as an example, if the photographer takes his/her photograph with the camera 201B in the electronic device 100, the B screen facing the same direction as the camera 201B is a first display screen facing the photographer, the camera 201B is a first camera, the a screen is a second display screen, and the camera 201a is a second camera. As shown in (a) of fig. 9, in the operating state of the first camera 201b, the electronic apparatus 100 displays a first preview interface 910 on the first display screen. As shown in (b) of fig. 9, the electronic apparatus 100 may further display a second preview interface 920 on the second display screen. The first preview interface 910 and the second preview interface 920 each include a preview image captured by the first camera 201 b. The second preview interface 920 may also include a conversion option 921, and a capture option 922.
Then, the electronic device 100 extracts the object features of one frame of preview image, and pops up a preset multimedia window 923 on the second preview interface 920. If the object features of the preview image include a child, the electronic device 100 determines that the plurality of reference videos marked with the child in the plurality of reference multimedia contents are at least one video to be selected according to the child in the object features of the preview image, and displays the at least one video to be selected in a preset multimedia window 923 in the second preview interface 920, as shown in (c) of fig. 9.
The electronic device 100 detects a click operation of a certain video 924 to be selected in the preset multimedia window 923, which is input by the user on the second display screen. Wherein, the click operation on the video to be selected 924 is a trigger operation on the first multimedia content to be selected. The candidate video 924 is the first video. As shown in (d) of fig. 9, the electronic device 100 displays a first video 924 on the first preview interface 910 in response to the trigger operation.
In the embodiment of the application, in order to provide a better reference effect, the electronic device may extract an image contour of the first multimedia content to be selected, and may further display the image contour with a more prominent display effect. Therefore, the shot person can see the image contour in the first multimedia content to be selected more clearly to shoot by referring to the image contour.
Specifically, as shown in fig. 10, the photographing display method provided in the embodiment of the present application may further include S1001 after S603. The method may further include S1002 or S1003 after S1001.
S1001, the electronic equipment extracts an image contour of the first to-be-selected multimedia content and displays the image contour on the first preview interface by adopting a preset first display effect.
Wherein the first display effect may include color, line thickness, and the like.
It should be noted that the electronic device may not display the first to-be-selected multimedia content on the first preview interface, and display the image contour by using a preset first display effect.
In the embodiment of the application, under the condition that the first to-be-selected multimedia content is the first image, the electronic equipment extracts the image contour of the first image to obtain an image contour. Under the condition that the first to-be-selected multimedia content is a first video, the electronic equipment extracts image outlines from a plurality of frame images included in the first video to obtain a plurality of image outlines corresponding to the plurality of frame images.
The electronic device may extract an image contour from the first image or one frame of image in the first video by using an image edge extraction method based on depth learning or an image contour extraction method based on depth learning. The image edge extraction method based on deep learning can comprise the following steps: integral-Nested Edge Detection (HED), depth-class-Aware Semantic Edge Detection (CASENT). The image contour extraction method based on the deep learning can comprise the following steps: a multi-scale bifurcation deep network deep, Full convolutional encoder-decoder (CEDN) suitable for top-down contour detection.
Further, the first image includes a person. The electronic equipment can extract the figure outline from the first image and display the figure outline by adopting a preset first display effect on the first preview interface.
It should be noted that the first image may include other objects such as a car and an animal in addition to the person, and the electronic device may further extract outlines of the other objects from the first image and display the outlines.
In the embodiment of the application, after the electronic device obtains the image contour, the electronic device can perform character positioning on a frame of preview image acquired at the current moment, and determine character position information in the frame of preview image. Then, the electronic equipment displays the image outline on the first preview interface according to the person position information.
The electronic equipment can determine a first size and a first position of the image outline in the first preview interface according to the person position information. Then, the electronic device may display the image contour on the first preview interface according to the first size and the first position, so that the image contour in the first preview interface and the region where the person is located in the preview image in the first preview interface are overlapped.
In the embodiment of the application, under the condition that a photographer takes a picture of the person by using the first camera and the electronic device comprises the second display screen, after the electronic device determines the position information of the person in a frame of preview image acquired at the current moment, the outline of the image can be displayed on the second preview interface according to the position information of the person.
The electronic device can determine a second size and a second position of the image outline in the second preview interface according to the person position information. Then, the electronic device may display the image contour on the second preview interface according to the second size and the second position, so that the image contour in the second preview interface and the region where the person is located in the preview image in the second preview interface coincide.
Further, the electronic device may further display the image outline at a second preview interface by using a preset second display effect. The second display effect and the first display effect may be the same or different.
As can be appreciated, the photographer mainly views the framing effect through the preview image in the second preview interface; therefore, compared with the first display effect, the image contour displayed by the second display effect is not prominent, and the interference of the image contour on the preview image displayed on the second preview interface is reduced. For example, the line thickness in the second display effect is thin and the color is light. The photographed person needs to refer to the image contour in the first preview interface, so the first display effect can make the image contour more prominent so that the photographed person can clearly see the image contour. For example, the line thickness in the first display effect is thick and the color is a dark color.
Illustratively, continuing with the example of electronic device 100 shown in fig. 8, after first preview interface 810 and second preview interface 820 display first image 824, electronic device 100 may extract an image outline for the first image and display a prompt on second preview interface 820 that the outline is being extracted. The electronic device 100 further performs character positioning on a frame of preview image acquired at the current time, and determines character position information in the frame of preview image.
Then, the electronic device 100 may determine a first size and a first position of the image outline in the first preview interface and a second size and a second position of the image outline in the second preview interface according to the person position information. As shown in fig. 11 (a), the electronic device 100 may display an image outline 1101 at the first preview interface 810 with a first display effect in a first size and a first position. As shown in fig. 11 (b), the electronic apparatus 100 further displays the image outline 1102 in the second preview interface 820 with the second display effect in the second size and the second position.
As can be seen from (a) and (b) in fig. 11, the image outline 1101 in the first preview interface coincides with the region where the person is located in the preview image in the first preview interface, and the image outline 1102 in the second preview interface coincides with the region where the person is located in the preview image in the second preview interface. The image outline 1101 is more prominent than the image outline 1102.
S1002, the electronic equipment detects the adjustment operation of the user on the image contour, adjusts the image contour, and displays the adjusted image contour on a first preview interface.
The adjusting operation (corresponding to the fourth operation mentioned in the embodiments of the present application) may be a resizing operation, a position adjusting operation, or a size and position adjusting operation. The position adjustment operation may be a drag operation or a slide operation on the image contour. The resizing operation may be an enlarging operation or a reducing operation on the image contour. The resizing operation may be an operation of resizing both the position and the size of the image outline.
In the embodiment of the application, under the condition that a photographer uses the first camera to perform self-shooting, the electronic equipment can detect the adjustment operation of the image outline input by the user on the second display screen. In the case where the photographer performs his or her photographing with the first camera and the electronic apparatus includes the second display screen, the electronic apparatus may detect an adjustment operation of the image contour input by the user on the second display screen.
S1003, the electronic equipment detects a first setting operation of the user on the first display effect, updates the first display effect, and displays the image outline by adopting the updated first display effect on the first preview interface.
The electronic device updates the first display effect in response to the first setting operation (corresponding to the fifth operation mentioned in the embodiment of the present application), and may also save the updated first display effect.
In the embodiment of the application, under the condition that a photographer utilizes the first camera to carry out self-shooting, the electronic equipment can detect a first setting operation of a preset first display effect input by a user on the first display screen. The electronic equipment can detect a first setting operation of a preset first display effect input by a user on the second display screen under the condition that a photographer takes a photo by using the first camera and the electronic equipment comprises the second display screen.
In this embodiment, for example, the electronic device may detect a first setting operation on a preset first display effect, which is input by a user on the first display screen, and the first preview interface may include a first setting option. The electronic equipment can detect the click operation of the first setting option input by the user on the first display screen, and in response to the click operation of the first setting option, pop up an effect setting popup window in the first preview interface. The effect setting popup may include a plurality of setting options corresponding to the first display effect. The electronic equipment receives and responds to a first setting operation of a user on a plurality of setting options corresponding to the first display effect, and updates the first display effect.
Alternatively, the electronic device may receive and respond to a first display trigger operation of the user, and pop up the effect setting popup in the first preview interface. Then, the electronic equipment receives and responds to the first setting operation of the user on the plurality of setting options corresponding to the first display effect, and the first display effect is updated.
The plurality of setting options may include a color option and a line thickness option, among others. The first display trigger operation is used for triggering the electronic equipment to display a plurality of setting options corresponding to the first display effect, for example, the first display trigger operation may be a long-press operation on an image outline in the first preview interface. The long-press operation refers to holding the click operation on the image contour for a preset time (e.g., 3 seconds) or more.
It should be noted that the effect setting popup window may further include a plurality of setting options corresponding to the second display effect. For a specific process of the electronic device updating the second display effect, reference may be made to the detailed description of the electronic device updating the first display effect, which is not described herein again in this embodiment of the present application.
Illustratively, referring to (a) and (b) in fig. 11, the electronic device 100 displays an image outline 1101 on the first preview interface, and after displaying an image outline 1102 on the second preview interface, detects a long press operation on the image outline 1102 in the second preview interface, which is input by the user on the second display screen. As shown in (c) of fig. 11, the electronic apparatus 100 pops up the effect setting popup 1103 in the second preview interface 820 in response to the long press operation. The effect setting popup 1103 may include a plurality of setting options corresponding to the first display effect and a plurality of setting options corresponding to the second display effect. The electronic device 100 receives and responds to a first setting operation of the user on a plurality of setting options corresponding to the first display effect, and updates the first display effect.
The plurality of setting options may include a color option, a line thickness option, and a dotted line option, and the first setting operation of the user on the plurality of setting options corresponding to the first display effect may be a selection operation on any color of the color options, a dragging operation on a thickness control of the line thickness option, or a selection operation on any dotted line of the dotted line options.
In the embodiment of the present application, in addition to determining the first multimedia content to be selected according to the object feature of the preview image, the electronic device may further detect a first selection operation (corresponding to the third operation mentioned in the embodiment of the present application) on the local multimedia content or a second selection operation on the network multimedia content, which is input by the user on the first display screen or the second display screen; and determining the first to-be-selected multimedia content by combining the selected local multimedia content or the network multimedia content.
Illustratively, taking the example that the photographer takes a self-timer by using the first camera, the process that the electronic equipment determines the first to-be-selected multimedia content according to the object characteristics of the preview image and the local multimedia content selected by the user is explained. As shown in fig. 12, the photographing display method provided in the embodiment of the present application is applied to an electronic device including a first display screen. The method may not include S602-S603, including S1201-S1208, after S601.
S1201, the electronic equipment extracts the object features of the preview image.
S1202, the electronic equipment acquires a plurality of reference multimedia contents and determines the object characteristics of each reference multimedia content in the plurality of reference multimedia contents.
It should be noted that, in S1202, the specific process of the electronic device obtaining the multiple reference multimedia contents and determining the object feature of each of the multiple reference multimedia contents may refer to a detailed description of the electronic device obtaining the multiple reference multimedia contents and determining the object feature of each of the multiple reference multimedia contents in S602, which is not repeated herein in this embodiment of the present application.
S1203, the electronic equipment determines similarity between the object features of each reference multimedia content and the object features of the preview image, and determines that at least one to-be-selected multimedia content comprises the reference multimedia content of which the similarity is greater than a preset similarity threshold.
It should be noted that, in S1203, the specific process of determining, by the electronic device, the similarity between the object feature of each reference multimedia content and the object feature of the preview image, and determining that the at least one to-be-selected multimedia content includes the reference multimedia content whose similarity is greater than the preset similarity threshold may refer to a detailed description, in S602, of determining, by the electronic device, the similarity between the object feature of each reference multimedia content and the object feature of the preview image, and determining that the at least one to-be-selected multimedia content includes the reference multimedia content whose similarity is greater than the preset similarity threshold, which is not described herein again in this embodiment of the present application.
S1204, the electronic device displays at least one multimedia content to be selected on the first preview interface according to the sequence of the similarity from large to small.
Exemplarily, as shown in (b) of fig. 7, the electronic apparatus 100 displays a first preview interface 710 on a first display screen. The first preview interface 710 includes a preset multimedia window 714. The electronic device may sort the at least one candidate multimedia content in an order of similarity from large to small. Then, the sorted at least one image to be selected is displayed in the preset multimedia window 714. The preset multimedia window 714 also includes an add option 716. The second option may be an add option 716.
It should be noted that, if the similarity between the object features of the plurality of reference multimedia contents and the object features of the preview image is all equal to zero, the electronic device may obtain the historical number of times that each reference multimedia content is selected as the first multimedia content to be selected; then, it is determined that the at least one candidate multimedia content includes a reference multimedia content with a history number greater than zero. And the electronic equipment displays at least one to-be-selected multimedia content on the first preview interface according to the sequence of the historical times from large to small. Or, if the similarity between the object features of the plurality of reference multimedia contents and the object features of the preview image is equal to zero, the electronic device may arbitrarily select several reference multimedia contents from the plurality of reference multimedia contents as at least one candidate multimedia content, and display the selected reference multimedia contents on the first preview interface.
S1205, under the condition that the electronic equipment detects that the user inputs a request operation for the local multimedia content on the first display screen, the first display screen is controlled to jump from the first preview interface to the local multimedia interface; the local multimedia interface includes at least one local multimedia content that is different from the plurality of reference multimedia contents.
The request operation of the user for the local multimedia content may be referred to as a second request operation (corresponding to the second operation mentioned in the embodiments of the present application). The second request operation is used for triggering the electronic equipment to acquire the local multimedia content.
In an embodiment of the present application, the first preview interface may include a second option; the second option is for triggering the electronic device to retrieve local multimedia content. The second request operation may be a click operation on the second option.
Illustratively, continuing with the example of the electronic device 100 shown in fig. 7, the electronic device 100 detects a click operation of the add option 716 input by the user on the first display screen. As shown in (a) of fig. 13, in response to the click operation of the add option 716 by the electronic apparatus 100, the electronic apparatus 100 pops up an add list 1310 on the first preview interface 710. The add list 1310 includes a local image option 1311 and a network image option 1312. As shown in (b) of fig. 13, the electronic apparatus 100 detects a click operation of the option 1311 by the user, and controls the first display screen to jump from the first preview interface 710 to the local image interface 1320 in response to the click operation of the option 1311.
The local image interface 1320 includes a plurality of local images and options corresponding to the plurality of local images. The second request operation includes: click on add option 716, click on option 1311.
S1206, the electronic device detects a first selection operation aiming at least one local multimedia content input by a user on the first display screen.
For example, the electronic device 100 may detect a click operation of a user on an option corresponding to any number of local images in the local image interface 1320, which is input by the user on the first display screen. The clicking operation of the user on the options corresponding to any number of local images is a first selection operation.
S1207, the electronic device responds to the first selection operation, determines that the at least one to-be-selected multimedia content further comprises local multimedia content selected by the first selection operation, controls the first display screen to jump from the local multimedia interface to the first preview interface, and displays the at least one to-be-selected multimedia content in the first preview interface.
The electronic device may add the local multimedia content selected by the first selection operation to at least one candidate multimedia content or the sequenced at least one candidate multimedia content to obtain the updated at least one candidate multimedia content. And then, the electronic equipment controls the first display screen to jump from the local multimedia interface to the first preview interface, and at least one updated multimedia content to be selected is displayed in the first preview interface.
For example, the electronic device may add the local multimedia content selected by the first selection operation to a start position in the ordered at least one candidate multimedia content, so as to obtain the updated at least one candidate multimedia content.
Or, the electronic device may extract object features from the local multimedia content selected by the first selection operation; and then calculating the similarity between the object features of the preview image and the object features of the local multimedia content selected by the first selection operation. Then, the electronic device may sort the local multimedia contents selected by the first selection operation according to the order of the similarity degrees corresponding to the local multimedia contents selected by the first selection operation from large to small, so as to obtain the sorted local multimedia contents. And the electronic equipment adds the sequenced local multimedia content to the beginning position of the sequenced at least one to-be-selected multimedia content to obtain the updated at least one to-be-selected multimedia content.
Or, the electronic device may add the local multimedia content selected by the first selection operation to the at least one candidate multimedia content to obtain the updated at least one candidate multimedia content. And the electronic equipment extracts object features of the local multimedia content selected by the first selection operation and calculates the similarity between the object features of the preview image and the object features of the local multimedia content selected by the first selection operation. And then, the electronic equipment displays the updated at least one multimedia content to be selected in the first preview interface according to the sequence of the similarity from large to small.
Illustratively, in response to the first selection operation, the electronic device 100 adds the local image 1330 selected by the first selection operation to the beginning position of the sorted at least one candidate multimedia content, resulting in an updated at least one candidate multimedia content. As shown in (c) of fig. 13, the electronic device 100 controls the first display screen to jump from the local multimedia interface 1320 to the first preview interface 710, and the updated at least one candidate multimedia content is displayed in the first preview interface 710. The updated at least one candidate multimedia content includes the local image 1330.
S1208, the electronic equipment detects the triggering operation of the user on the first to-be-selected multimedia content in the at least one to-be-selected multimedia content input by the first display screen, and displays the first to-be-selected multimedia content in the first preview interface.
It should be noted that, in S1208, the specific process of the electronic device receiving the trigger operation and displaying the first to-be-selected multimedia content in the first preview interface may refer to the detailed description of the electronic device receiving the trigger operation and displaying the first to-be-selected multimedia content in the first preview interface in S603, which is not described herein again in this embodiment of the present application.
It should be noted that the at least one candidate multimedia content may not include the plurality of reference multimedia contents, including the local multimedia content, and the electronic device may not perform the steps related to the reference multimedia content (e.g., S1201-S1204), and perform the steps related to the local multimedia content (e.g., S1205-S1207). In this case, the at least one candidate multimedia content is the local multimedia content selected by the first selection operation.
It should be noted that, after S1204, the electronic device may not execute S1205-S1207, but directly execute S1208.
It should be noted that, in the case that the photographer performs self-shooting by using the first camera, the electronic device determines the specific process of the first to-be-selected multimedia content according to the object feature of the preview image and the network multimedia content selected by the user, refer to the detailed description about determining the first to-be-selected multimedia content by the electronic device according to the object feature of the preview image and the local multimedia content selected by the user in fig. 12, which is not described herein again in this embodiment of the present application.
It should be noted that, when the photographer takes a photograph with the first camera and the electronic device includes the second display screen, the first to-be-selected multimedia content may be selected by the photographer himself or herself in addition to the first to-be-selected multimedia content. If the first to-be-selected multimedia content is selected by the photographer himself, the electronic device may also perform the above S1201-S1208 in a case where the photographer performs his shooting with the first camera and the electronic device includes the second display screen.
Illustratively, taking an example that the photographer takes his photograph with the first camera and selects the first multimedia content to be selected by the photographer, the process of the electronic device determining the first multimedia content to be selected according to the object feature of the preview image and the local multimedia content selected by the user is described. As shown in fig. 14, the photographing display method provided in the embodiment of the present application is applied to an electronic device including a first display screen and a second display screen. The method may include S1401-S1409.
S1401, a first camera collects preview images, the electronic equipment displays a first preview interface on a first display screen, and displays a second preview interface on a second display screen; the first preview interface and the second preview interface both comprise preview images acquired by the first camera.
When the first camera collects the preview image, the electronic device can simultaneously display the preview image in a first preview interface of the first display screen and a second preview interface of the second display screen.
The electronic device extracts object features of the preview image.
S1402, the electronic device extracts the object features of the preview image.
S1403, the electronic device obtains a plurality of reference multimedia contents and determines an object characteristic of each of the plurality of reference multimedia contents.
It should be noted that, in S1403, the specific process of the electronic device obtaining the multiple reference multimedia contents and determining the object feature of each of the multiple reference multimedia contents may refer to a detailed description of the electronic device obtaining the multiple reference multimedia contents and determining the object feature of each of the multiple reference multimedia contents in S602, which is not repeated herein in this embodiment of the present application.
S1404, the electronic equipment determines the similarity between the object features of each reference multimedia content and the object features of the preview image, and determines that at least one to-be-selected multimedia content comprises the reference multimedia content of which the similarity is greater than a preset similarity threshold.
It should be noted that, in S1404, the electronic device determines the similarity between the object feature of each reference multimedia content and the object feature of the preview image, and determines that at least one candidate multimedia content includes the reference multimedia content whose similarity is greater than the preset similarity threshold, which may refer to the detailed description in S602, regarding that the electronic device determines the similarity between the object feature of each reference multimedia content and the object feature of the preview image, and determines that at least one candidate multimedia content includes the reference multimedia content whose similarity is greater than the preset similarity threshold, which is not described herein again in this embodiment of the present application.
S1405, the electronic equipment displays at least one to-be-selected multimedia content on the second preview interface according to the sequence of the similarity from large to small.
Illustratively, continuing with the example of the second preview interface shown in fig. 8 (c), the second preview interface 820 includes a preset multimedia window 823. The electronic device may sort the at least one candidate multimedia content in an order of similarity from large to small. Then, the sorted at least one image to be selected is displayed in the preset multimedia window 823. The preset multimedia window 823 also includes an add option 825. The second option may be an add option 825.
It should be noted that, if the similarities between the object features of the multiple reference multimedia contents and the object features of the preview image are all equal to zero, the electronic device may determine and display the at least one piece of multimedia content to be selected in other manners, and the specific process may refer to the detailed description that the electronic device determines and displays the at least one piece of multimedia content to be selected when the similarities between the object features of the multiple reference multimedia contents and the object features of the preview image are all equal to zero in S1204, which is not described herein again in this embodiment of the present application.
S1406, under the condition that the electronic equipment detects a second request operation input by the user on the second display screen, controlling the second display screen to jump from the second preview interface to the local multimedia interface; the local multimedia interface includes at least one local multimedia content that is different from the plurality of reference multimedia contents.
And the second request operation is used for triggering the electronic equipment to acquire the local multimedia content.
In this embodiment of the application, the second preview interface may include a second option; the second option is for triggering the electronic device to retrieve local multimedia content. The second request operation may be a click operation on the second option.
S1407, the electronic device detects a first selection operation for at least one local multimedia content input by the user on the second display screen.
Illustratively, the electronic equipment can detect clicking operation input by the user on the second display screen on options corresponding to any several local images in the local image interface. The clicking operation of the user on the options corresponding to any number of local images is a first selection operation.
S1408, the electronic equipment responds to the first selection operation, determines that the at least one to-be-selected multimedia content further includes the local multimedia content selected by the first selection operation, controls the second display screen to jump from the local multimedia interface to the second preview interface, and displays the at least one to-be-selected multimedia content in the second preview interface.
It should be noted that, for the specific process of S1408, reference may be made to the detailed description of S1207, which is not described herein again in this embodiment of the present application.
S1409, the electronic device detects the trigger operation of the user on the first to-be-selected multimedia content in the at least one to-be-selected multimedia content input on the second display screen, and displays the first to-be-selected multimedia content in the first preview interface.
It should be noted that, in S1409, the specific process of the electronic device receiving the trigger operation and displaying the first to-be-selected multimedia content in the first preview interface may refer to the detailed description of the electronic device receiving the trigger operation and displaying the first to-be-selected multimedia content in the first preview interface in S603, which is not described herein again in this embodiment of the application.
It should be noted that the at least one candidate multimedia content may not include the plurality of reference multimedia contents, and may include the local multimedia content, and the electronic device may not perform the steps related to the reference multimedia content (e.g., S1402-S1405) and perform the steps related to the local multimedia content (e.g., S1406-S1408). In this case, the at least one candidate multimedia content is the local multimedia content selected by the first selection operation.
Note that, after S1405, the electronic apparatus may directly execute S1409 without executing S1406 to S1408.
It should be noted that, when the photographer uses the first camera to perform his shooting and the electronic device includes the second display screen, the electronic device determines a specific process of the first to-be-selected multimedia content according to the object feature of the preview image and the network multimedia content selected by the user, see the detailed description about determining the first to-be-selected multimedia content by the electronic device according to the object feature of the preview image and the local multimedia content selected by the user in fig. 14, which is not described herein again in this embodiment of the application.
The embodiment of the application further provides electronic equipment which can comprise a first display screen, a second display screen, a first camera, a processor and a memory. The first display screen and the first camera are in the same orientation, and the first display screen and the second display screen are arranged in a back-to-back mode. The first display screen, the second display screen, the first camera and the memory are coupled with the processor. The first camera is used for collecting preview images. The first display screen is used for displaying the preview image and the first multimedia content to be selected. The memory is for storing computer program code, the computer program code including computer instructions. The processor is configured to execute the computer instructions, so that the electronic device performs each function or step performed by the electronic device 100 in the above method embodiments.
The hardware structure of the electronic device may refer to the structure of the electronic device 100 shown in fig. 5, which is not described herein again in this embodiment of the present application.
The embodiment of the present application further provides a chip system, as shown in fig. 15, where the chip system 1500 includes at least one processor 1501 and at least one interface circuit 1502.
The processor 1501 and the interface circuit 1502 may be interconnected by wires. For example, the interface circuit 1502 may be used to receive signals from other devices (e.g., a memory of an electronic device). Also for example, the interface circuit 1502 may be used to send signals to other devices (e.g., the processor 1501, the first display screen). Illustratively, the interface circuit 1502 may read instructions stored in the memory and send the instructions to the processor 1501. The instructions, when executed by the processor 1501, may cause the electronic device to perform the various steps performed by the electronic device 100 in the embodiments described above. Of course, the chip system may further include other discrete devices, which is not specifically limited in this embodiment of the present application.
Embodiments of the present application further provide a computer-readable storage medium, where computer instructions are stored on the computer-readable storage medium, and when the computer instructions are executed on an electronic device, the electronic device is caused to perform various functions or steps performed by the electronic device 100 in the foregoing method embodiments. For example, the computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a Compact Disc Read-Only Memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, and the like.
Embodiments of the present application also provide a computer program product, which includes computer instructions that can be executed on an electronic device, so that the electronic device performs each function or step performed by the electronic device 100 in the above method embodiments.
Through the description of the above embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, a module or a unit may be divided into only one logic function, and may be implemented in other ways, for example, a plurality of units or components may be combined or integrated into another apparatus, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed to a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application, or portions of the technical solutions that substantially contribute to the prior art, or all or portions of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (14)

1. The photographing display method is characterized by being applied to electronic equipment comprising a first display screen, a second display screen and a first camera, wherein the first display screen and the first camera are in the same orientation, and the first display screen and the second display screen are arranged in a back-to-back mode, and the method comprises the following steps:
the first camera collects a preview image, and the preview image is displayed in a first preview interface of the first display screen;
displaying a first multimedia content to be selected, wherein the first multimedia content to be selected is displayed on the first display screen or the second display screen, the object feature of the first multimedia content to be selected and the object feature of the preview image both include a first object feature, wherein the first object feature is used for characterizing the content of the preview image, and the first object feature includes at least one of the following: character features and scene features;
detecting a first operation of a user on the first to-be-selected multimedia content;
and responding to the first operation, and displaying the first to-be-selected multimedia content on the first preview interface.
2. The method of claim 1, wherein prior to said displaying the first candidate multimedia content, the method further comprises:
extracting object features of the preview image;
acquiring a plurality of reference multimedia contents and determining the object characteristics of each reference multimedia content in the plurality of reference multimedia contents; the reference multimedia contents are locally stored multimedia contents for reference of photographing or multimedia contents for reference of photographing acquired from a server;
determining a similarity between the object feature of each reference multimedia content and the object feature of the preview image;
determining that at least one to-be-selected multimedia content comprises a reference multimedia content with the similarity greater than the preset similarity threshold; the at least one candidate multimedia content comprises the first candidate multimedia content.
3. The method of claim 2, further comprising:
under the condition that second operation on local multimedia content input by the user on the first display screen is detected, controlling the first display screen to jump from the first preview interface to the local multimedia interface; the local multimedia interface comprises at least one local multimedia content different from the plurality of reference multimedia contents;
detecting a third operation input by the user on the first display screen and aiming at the at least one local multimedia content;
and responding to the third operation, determining that the at least one to-be-selected multimedia content further comprises the local multimedia content selected by the third operation, and controlling the first display screen to jump from the local multimedia interface to the first preview interface.
4. The method according to claim 2 or 3, wherein said displaying the first to-be-selected multimedia content comprises:
displaying the at least one multimedia content to be selected on the first preview interface;
the detecting a first operation of the user on the first to-be-selected multimedia content includes:
the first operation input by the user on the first display screen is detected.
5. The method of claim 4, wherein the displaying the at least one candidate multimedia content on the first preview interface comprises:
and displaying the at least one to-be-selected multimedia content on the first preview interface according to the similarity between the at least one to-be-selected multimedia content and the object features of the preview image.
6. The method of claim 1, wherein prior to said displaying the first to-be-selected multimedia content, the method further comprises:
extracting object features of the preview image;
if the object features of the preview image meet the preset video reference requirement, determining at least one to-be-selected multimedia content as at least one reference video, wherein the at least one to-be-selected multimedia content comprises the first to-be-selected multimedia content; the at least one reference video is a video which is locally stored and used for reference of photographing or a video which is acquired from a storage server and used for reference of photographing; the preset video reference requirement includes that the object feature of the preview image includes age information, and the age information belongs to target age information.
7. The method according to any one of claims 1-5, wherein after the first preview interface displays the first to-be-selected multimedia content, the method further comprises:
under the condition that the first to-be-selected multimedia content is a first image, extracting an image outline of the first image, and displaying the image outline on the first preview interface by adopting a preset first display effect;
under the condition that a fourth operation of the user on the image contour is detected, the image contour is adjusted, and the adjusted image contour is displayed on the first preview interface; the fourth operation is to trigger an adjustment of at least one of a size and a position of the image contour;
and under the condition that the fifth operation of the user on the first display effect is detected, updating the first display effect, and displaying the image outline by adopting the updated first display effect on the first preview interface.
8. The method of claim 7, wherein the first image comprises a person; the extracting an image contour of the first image and displaying the image contour on the first preview interface by adopting a preset first display effect includes:
and extracting a figure outline from the first image, and displaying the figure outline on the first preview interface by adopting a preset first display effect.
9. The method of claim 2, further comprising:
the first camera collects a preview image, and the preview image is displayed in a second preview interface of the second display screen;
under the condition that second operation on local multimedia content input by the user on the second display screen is detected, controlling the second display screen to jump from the second preview interface to the local multimedia interface; the local multimedia interface comprises at least one local multimedia content different from the plurality of reference multimedia contents;
detecting a third operation input by the user on the second display screen aiming at the at least one local multimedia content;
and responding to the third operation, determining that the at least one to-be-selected multimedia content further comprises the local multimedia content selected by the third operation, controlling the second display screen to jump from the local multimedia interface to the second preview interface, and displaying the preview image on the second preview interface.
10. The method of claim 9, further comprising:
displaying the at least one multimedia content to be selected on the second preview interface;
the detecting a first operation of the user on the first to-be-selected multimedia content includes:
the first operation input by the user on the second display screen is detected.
11. The method of any of claims 1-10, wherein the character features include at least one of: number of people, gender of people, and age of people; the scene characteristics include at least one of: location information, time information, and environment type.
12. An electronic device, comprising a first display screen, a second display screen, a first camera, a memory and a processor; the first display screen and the first camera are in the same direction, and the first display screen and the second display screen are arranged in a back-to-back mode; the first display screen, the second display screen, the first camera, the memory and the processor are coupled; the first camera is used for collecting a preview image, and the first display screen is used for displaying the preview image and first to-be-selected multimedia content; the memory has stored therein computer program code comprising computer instructions which, when executed by the processor, cause the electronic device to perform the method of any of claims 1-11.
13. A computer-readable storage medium having stored thereon computer instructions which, when run on an electronic device, cause the electronic device to perform the method of any one of claims 1-11.
14. A computer program product, characterized in that the computer program product comprises computer instructions which, when run on an electronic device, cause the electronic device to perform the method according to any of claims 1-11.
CN202110657359.6A 2021-06-11 2021-06-11 Photographing display method, electronic equipment and storage medium Active CN114466132B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110657359.6A CN114466132B (en) 2021-06-11 2021-06-11 Photographing display method, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110657359.6A CN114466132B (en) 2021-06-11 2021-06-11 Photographing display method, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN114466132A true CN114466132A (en) 2022-05-10
CN114466132B CN114466132B (en) 2024-06-14

Family

ID=81405308

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110657359.6A Active CN114466132B (en) 2021-06-11 2021-06-11 Photographing display method, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114466132B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104184934A (en) * 2013-05-23 2014-12-03 北京千橡网景科技发展有限公司 Method and apparatus for providing auxiliary reference for shooting
CN104935810A (en) * 2015-05-29 2015-09-23 努比亚技术有限公司 Photographing guiding method and device
CN107024990A (en) * 2017-03-31 2017-08-08 维沃移动通信有限公司 A kind of method for attracting children to autodyne and mobile terminal
CN107257439A (en) * 2017-07-26 2017-10-17 维沃移动通信有限公司 A kind of image pickup method and mobile terminal
CN107835365A (en) * 2017-11-03 2018-03-23 上海爱优威软件开发有限公司 Auxiliary shooting method and system
CN109547694A (en) * 2018-11-29 2019-03-29 维沃移动通信有限公司 A kind of image display method and terminal device
CN109922271A (en) * 2019-04-18 2019-06-21 珠海格力电器股份有限公司 A kind of mobile terminal and its photographic method based on Folding screen
CN112351185A (en) * 2019-08-07 2021-02-09 华为技术有限公司 Photographing method and mobile terminal

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104184934A (en) * 2013-05-23 2014-12-03 北京千橡网景科技发展有限公司 Method and apparatus for providing auxiliary reference for shooting
CN104935810A (en) * 2015-05-29 2015-09-23 努比亚技术有限公司 Photographing guiding method and device
CN107024990A (en) * 2017-03-31 2017-08-08 维沃移动通信有限公司 A kind of method for attracting children to autodyne and mobile terminal
CN107257439A (en) * 2017-07-26 2017-10-17 维沃移动通信有限公司 A kind of image pickup method and mobile terminal
CN107835365A (en) * 2017-11-03 2018-03-23 上海爱优威软件开发有限公司 Auxiliary shooting method and system
CN109547694A (en) * 2018-11-29 2019-03-29 维沃移动通信有限公司 A kind of image display method and terminal device
CN109922271A (en) * 2019-04-18 2019-06-21 珠海格力电器股份有限公司 A kind of mobile terminal and its photographic method based on Folding screen
CN112351185A (en) * 2019-08-07 2021-02-09 华为技术有限公司 Photographing method and mobile terminal

Also Published As

Publication number Publication date
CN114466132B (en) 2024-06-14

Similar Documents

Publication Publication Date Title
CN110445978B (en) Shooting method and equipment
CN111263005B (en) Display method and related device of folding screen
CN113727012B (en) Shooting method and terminal
CN110807361B (en) Human body identification method, device, computer equipment and storage medium
CN110865754B (en) Information display method and device and terminal
CN110222789B (en) Image recognition method and storage medium
CN118042262A (en) Control method, electronic equipment, computer readable storage medium and chip
CN113542581A (en) View finding method of multi-channel video, graphical user interface and electronic equipment
WO2020029306A1 (en) Image capture method and electronic device
US20210168279A1 (en) Document image correction method and apparatus
EP4060603A1 (en) Image processing method and related apparatus
KR20150007403A (en) Apparatus and method for operating information searching data of persons and person recognizes method using the same
WO2022228274A1 (en) Preview image display method in zoom photographing scenario, and electronic device
CN113949803B (en) Photographing method and electronic equipment
CN113497890B (en) Shooting method and equipment
CN115115679A (en) Image registration method and related equipment
CN117425065A (en) Shooting method and related equipment
WO2021185374A1 (en) Image capturing method and electronic device
CN112184722A (en) Image processing method, terminal and computer storage medium
CN114466132B (en) Photographing display method, electronic equipment and storage medium
CN114302063B (en) Shooting method and equipment
WO2022257645A1 (en) Photographic display method, electronic device, and storage medium
CN114827445B (en) Image processing method and related device
WO2021197014A1 (en) Picture transmission method and apparatus
CN116027886A (en) Display method of folding screen and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant