CN111327795A - Terminal, shooting method, storage medium and electronic device - Google Patents
Terminal, shooting method, storage medium and electronic device Download PDFInfo
- Publication number
- CN111327795A CN111327795A CN201811543971.5A CN201811543971A CN111327795A CN 111327795 A CN111327795 A CN 111327795A CN 201811543971 A CN201811543971 A CN 201811543971A CN 111327795 A CN111327795 A CN 111327795A
- Authority
- CN
- China
- Prior art keywords
- camera
- image
- gap
- terminal
- edge
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0266—Details of the structure or mounting of specific components for a display module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The invention provides a terminal, a shooting method, a storage medium and an electronic device. In the invention, the camera is arranged behind the gap formed by the display panel and the shell of the terminal, so that the screen occupation ratio of the terminal is improved.
Description
Technical Field
The invention relates to the field of image processing, in particular to a terminal, a shooting method, a storage medium and an electronic device.
Background
With the development of panel technology and the rapid increase of user demands, the area of the display area of the terminal device in the terminal device is larger and larger, that is, the screen occupation ratio of the display area (i.e., screen) in the terminal device is gradually increased. At present, one of bottlenecks that further increase screen occupation ratio in the terminal device is setting of a front camera in the terminal device, and since common applications in the current terminal, such as video communication, self-shooting, and the like, need to be realized by relying on the front camera, the front camera cannot be omitted.
In order to ensure the display effect of the camera, the camera in the related art often needs to be placed in parallel with a screen in the terminal device, that is, the camera and the screen are integrated in parallel at the front end of the terminal device. Under the layout mode of the cameras, the terminal equipment can improve the screen occupation ratio only by increasing the area of the screen in the area where the non-camera is located, and cannot perform screen layout on the area where the camera is located, so that the screen occupation ratio of the terminal equipment in the related art cannot be further improved.
Aiming at the problem that the screen occupation ratio cannot be improved because the terminal equipment is influenced by the layout of the front camera in the related technology, an effective solution is not provided in the related technology.
Disclosure of Invention
The embodiment of the invention provides a terminal, a shooting method based on the terminal, a storage medium and an electronic device, and aims to at least solve the problem that in the related art, the screen occupation ratio cannot be improved because terminal equipment is influenced by the layout of a front camera.
According to an embodiment of the present invention, there is provided a terminal including: the device comprises a shell, a display panel and a camera; the camera is arranged in the terminal and is positioned behind a gap formed between the display panel and the shell.
According to another embodiment of the present invention, there is also provided a photographing method applied to a terminal, the terminal including: the device comprises a shell, a display panel, a camera and a displacement assembly; the camera is arranged in the terminal and is positioned behind a gap formed by the display panel and the shell, and the displacement assembly is connected with the camera and used for driving the camera to move along the vertical direction of the gap; the method comprises the following steps:
driving the camera to move to a first edge of the gap along the vertical direction of the gap, and framing a first shooting area through the gap;
driving the camera to move to a second edge of the gap opposite to the first edge along the vertical direction of the gap, and framing a second shooting area through the gap;
and splicing the view image of the first shooting area and the view image of the second shooting area to form a shooting view image.
According to a further embodiment of the present invention, there is also provided a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
According to yet another embodiment of the present invention, there is also provided an electronic device, including a memory in which a computer program is stored and a processor configured to execute the computer program to perform the steps in any of the above method embodiments.
In the above embodiments of the present invention, the camera is disposed behind the gap formed between the display panel and the housing of the terminal, so that the screen occupation ratio of the terminal is improved. Therefore, the invention can solve the problem that the screen occupation ratio cannot be improved because the terminal equipment is influenced by the layout of the front camera in the related art.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a schematic structural diagram of a terminal provided according to an embodiment of the present invention;
FIG. 2 is a schematic diagram (one) of a motion position of a camera provided according to an embodiment of the present invention;
fig. 3 is a schematic diagram (two) of a motion position of a camera provided according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a shooting position of a camera provided according to an embodiment of the invention;
fig. 5 is a flowchart of a photographing method provided according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a first photographing region provided according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a second photographing region provided according to an embodiment of the present invention;
FIG. 8 is a schematic illustration of a centerline position provided in accordance with an embodiment of the present invention;
fig. 9 is a schematic diagram of a front camera structure of a mobile phone according to an embodiment of the present invention;
FIG. 10 is a schematic diagram of a front-facing camera working coordinate system provided in accordance with an embodiment of the present invention;
FIG. 11 is a schematic diagram of a focus position in a front camera working coordinate system according to an embodiment of the present invention;
FIG. 12 is a schematic diagram of the front camera according to the position of the upper edge of the slit;
FIG. 13 is a schematic view of the front camera according to the lower edge of the slit;
fig. 14 is a schematic diagram of a front-facing camera image acquisition flow within a frame rate period according to an embodiment of the present invention;
FIG. 15 is a schematic illustration of an upper-half image provided in accordance with an embodiment of the present invention;
FIG. 16 is a diagram of a bottom half image provided in accordance with an embodiment of the present invention;
FIG. 17 is a schematic illustration of a complete image provided in accordance with an embodiment of the present invention;
FIG. 18 is a schematic illustration of image processing provided in accordance with an embodiment of the present invention;
fig. 19 is a block diagram of a configuration of a photographing apparatus provided according to an embodiment of the present invention.
Detailed Description
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
Example 1
In the present embodiment, a terminal is provided, and fig. 1 is a schematic structural diagram of a terminal provided according to an embodiment of the present invention; as shown in fig. 1, the terminal includes: a housing 102, a display panel 104, and a camera 106; the camera 106 is disposed inside the terminal and behind a gap 108 formed between the display panel 104 and the housing 102.
In the embodiment, the camera is arranged behind the gap formed by the display panel and the shell of the terminal, so that the screen occupation ratio of the terminal is improved. Therefore, the terminal in the embodiment can solve the problem that the screen occupation ratio cannot be improved because the terminal equipment is influenced by the layout of the front camera in the related art.
It should be further noted that, the terminal in this embodiment includes, but is not limited to, a mobile phone, a tablet computer, a PC, a wearable device, and the like, and any terminal having a front camera function and including a housing and a display panel can be used as the terminal in this embodiment; the present invention is not limited to the specific type of terminal.
In the terminal, the housing is a housing for forming a coating on the terminal, and generally, the housing includes an upper end surface, a lower end surface, a side end surface, a front end surface and a rear end surface, and the front end surface of the housing is provided with an opening for installing a display panel for installing the display panel; when the display panel is mounted in the opening, the display panel and the shell form a terminal whole. The housing may be an integrally formed component, or may be formed by connecting a plurality of components (e.g., a back cover and a side cover of a mobile phone).
In the process of assembling the display panel and the housing, a certain gap is inevitably formed between the display panel and the housing due to the same component, and the gap is the gap in the above embodiment. The gap may be a gap naturally formed between the display panel and the housing in the assembling process, or may be a gap artificially formed as needed on the basis of the gap formed by the assembling. It should be noted that, taking a mobile phone as an example, a glass panel or a capacitive touch component is usually disposed outside the display panel, and the gap in this embodiment may be disposed below the glass panel, or a groove may be formed in a region of the glass panel corresponding to the gap.
The camera is used for indicating a front camera positioned at the front end of the terminal in the terminal, the camera is arranged in the terminal and positioned behind a gap formed by the display panel and the shell, and the front camera is specifically indicated to be arranged in the terminal, namely between the shell and the display panel; because the gap in the above embodiment is formed between the housing and the display panel, when the camera is located inside the terminal, the camera and the gap are respectively distributed on the front end surface and inside of the terminal, thereby forming a staggered distribution structure; in order to enable the camera to react as timely as possible in the working process, the camera and the gap should be located at height positions opposite to each other (taking a mode that the terminal is vertically placed in a use state as a reference), or the height positions of the camera and the gap are located within a reasonable difference. In addition to the camera in this embodiment, the region between the housing and the display panel is provided with components such as a control component, a storage component, a power supply component, a heat dissipation component, and the like.
Since the camera is disposed inside the terminal in the terminal of this embodiment, only the gap formed between the display panel and the housing remains in the front end surface of the terminal, i.e., the end surface where the display panel of the terminal is located. Compared with the scheme that the camera is directly arranged at the front end of the terminal in the related art (namely the camera is parallel to the display panel), the width of the gap in the embodiment is obviously smaller than the physical width of the camera in the direction, so that a space equal to the corresponding area of the camera does not need to be reserved on the end face of the terminal, and the screen occupation ratio of the front end of the terminal is further improved.
In an optional embodiment, the terminal further includes:
and the displacement assembly 110 is arranged inside the terminal, is connected with the camera and is used for driving the camera to move along the vertical direction of the gap.
It should be further noted that the displacement assembly is used for controlling the camera to move along the vertical direction of the slit, so that the camera can shoot at different angles relative to the edge of the slit at different positions of the slit; according to the optical principle, images acquired by the camera in the shooting process at different angles relative to the edge of the gap are different, namely, the displacement assembly controls the camera to move along the vertical direction of the gap so that the camera can acquire the images at different angles, and the images are subjected to related processing to acquire complete images for user operation. Therefore, the terminal in the embodiment can ensure a good shooting effect while improving the screen occupation ratio of the terminal.
For moving the camera module, the displacement module at least includes a connecting portion for connecting the camera head and a driving portion for driving the connecting portion and the camera module to move, for example, the displacement module may include a connecting portion formed by a screw rod and a driving portion formed by a micro motor, or a connecting portion formed by a slide rail and a driving portion formed by a driving wheel, or an electric push rod integrated with the connecting portion and the driving portion, etc.; the present invention is not limited to the specific structure of the displacement assembly, and any displacement assembly that can achieve the above functions is within the scope of the present invention.
The driving part also comprises a control part for controlling the driving part to drive the connecting part to move so as to control the movement of the camera; the control unit may be a control unit separately integrated with the driving unit, such as a memory storing control instructions, a controller for sending control instructions, or the like, or the control unit may be combined with a control module of the terminal itself, that is, the control instructions for the displacement assembly and the camera are integrated in a CPU of the relevant terminal device. In any of the above manners, the control portion and the driving portion are directly or indirectly electrically connected, that is, the driving portion, the connecting portion and the camera can generate corresponding movement under the control command generated by the control portion; the specific connection mode between the control part and the driving part may adopt physical connection or wireless communication connection, and the present invention is not limited thereto.
In an alternative embodiment, the displacement assembly 110 includes:
a slide rail 1102 provided in the vertical direction of the slit 108;
and a driving component 1104 connected with the camera head 106 and used for driving the camera head 106 to move along the sliding rail 1102.
It should be further noted that the slide rail may be used as the connecting portion in the above embodiment, and the driving member may be used as the driving portion in the above embodiment. Fig. 2 is a schematic diagram (one) of a movement position of a camera provided according to an embodiment of the present invention, and fig. 3 is a schematic diagram (two) of a movement position of a camera provided according to an embodiment of the present invention, and as shown in fig. 2 and fig. 3, the camera moves along a slide rail to a position corresponding to an upper edge and a position corresponding to a lower edge of a slot respectively to perform a shooting process under the control of a driving part in a displacement assembly, so as to complete the movement along the vertical direction of the slot.
Example 2
In this embodiment, a shooting method is provided, which is applied to the terminal in the foregoing embodiment, and fig. 4 is a schematic diagram of a shooting position of a camera provided according to an embodiment of the present invention, as shown in fig. 4, the terminal includes: a housing 102, a display panel 104, a camera 106, and a displacement assembly 110; the camera 106 is arranged inside the terminal and behind a gap 108 formed between the display panel 104 and the housing 102, and the displacement assembly 110 is connected with the camera 106 and used for driving the camera 106 to move along the vertical direction of the gap 108; in addition, the position where the camera performs shooting in this embodiment includes the first edge 1082 and the second edge 1084 of the slit 108. Fig. 5 is a flowchart of a photographing method according to an embodiment of the present invention, and as shown in fig. 5, the method in the embodiment includes:
s202, driving the camera to move to the first edge of the gap along the vertical direction of the gap, and framing the first shooting area through the gap;
s204, driving the camera to move to a second edge of the gap opposite to the first edge along the vertical direction of the gap, and framing the second shooting area through the gap;
and S206, splicing the view image of the first shooting area and the view image of the second shooting area to form a shooting view image.
In the above embodiment, the terminal has the camera disposed behind the gap formed between the display panel of the terminal and the housing, the shooting method obtains the framing images of different shooting areas by driving the camera to move in the vertical direction of the gap and perform framing shooting for different shooting areas, and forms the shooting framing images by splicing the framing images of the different shooting areas, so that the screen ratio of the terminal is improved, and the shooting effect of the front camera is ensured. Therefore, the shooting method in the embodiment can solve the problem that the screen occupation ratio cannot be improved due to the influence of the layout of the front camera on the terminal equipment in the related art.
In an alternative embodiment, the execution sequence of step S202 and step S204 may be interchanged, that is, step S204 may be executed first, and then step S202 may be executed.
In an alternative embodiment, the execution subjects of steps S202 to S206 are all control components, and the control components may be integrated in a control module of the terminal, that is, the moving and shooting of the camera in steps S202 and S204 and the stitching process of the images in step S206 are realized by a CPU of the terminal device. The control component may also control the movement and shooting of the camera in steps S202 and S204 by an independent first control component, and implement the stitching process on the images in step S206 by an independent second control component, and the specific configuration of the control component is not limited in the present invention.
As shown in fig. 4, the first edge of the slot in step S202 indicates a corresponding edge position of the slot relative to one side of the housing, and the first edge is an upper edge of the slot when the terminal is in a vertical manner in a normal use state. The first photographing region is used to indicate a corresponding photographed image when the camera is located at the first edge position of the slit, fig. 6 is a schematic diagram of the first photographing region provided according to an embodiment of the present invention, and as shown in fig. 6, when the camera is located at the first edge position of the slit, according to an optical principle, a photographing range of the camera corresponds to a lower half region with respect to the slit, that is, the first photographing region in this embodiment is the lower half region. It should be further noted that the camera is moved to the first edge of the slot to indicate that the camera is moved to a position flush with the height of the first edge of the slot, rather than contacting the camera with the first edge. The second edge of the slit in the step S204 indicates a corresponding edge position of the slit relative to the display panel, and when the terminal is in a vertical manner in a normal use state, the first edge is the lower edge of the slit. Fig. 7 is a schematic diagram of the second shooting area provided in the embodiment of the present invention, and as shown in fig. 7, when the camera is located at a position corresponding to the second edge of the slit, according to an optical principle, a shooting range of the camera corresponds to an upper half area relative to the slit, that is, the second shooting area in this embodiment is the upper half area. It should be further noted that the camera is moved to the second edge of the slot to indicate that the camera is moved to a position flush with the height of the second edge of the slot, rather than bringing the camera into contact with the second edge.
Taking the example of the portrait as an example, when the user needs to view the portrait, the camera is positioned at the first edge of the gap to shoot the lower body of the portrait, the camera is positioned at the second edge of the gap to shoot the upper body of the portrait, and the upper body image and the lower body image are spliced or combined to synthesize the complete portrait image.
In an alternative embodiment, before the driving the camera to move to the first edge of the slit along the vertical direction of the slit in step S202, the method further includes:
when the camera is initialized, acquiring the position information of a first edge and a second edge of a gap;
and establishing a coordinate axis according to the acquired position information, wherein the extending direction of the gap is an X axis, the vertical direction of the gap is a Y axis, and the viewing direction is a Z axis.
It should be further explained that the moment of initializing the camera is used to indicate the moment when the terminal starts to operate, which is usually two cases when the terminal enters the power-on state from the power-off state or enters the operating state from the sleep state; in the initialization of the camera, the control component can instruct the camera to acquire the first edge position and the second edge position of the slit, and specifically, an image including the first edge and the second edge of the slit can be acquired by the camera, and the corresponding positions of the first edge and the second edge of the slit can be acquired according to the processing or the recognition of the image.
Further, on the premise that the camera acquires the first edge and the second edge of the gap, the extending direction of the first edge or the second edge can be used as the extending direction of the gap, namely the X axis, the relative direction of the first edge and the second edge is used as the vertical direction of the gap, namely the Y axis, and the shooting and viewing direction of the camera is used as the Z axis.
In an optional embodiment, after the coordinate axis is established according to the collected position information, the method further includes:
calculating the position of a central line between the first edge and the second edge according to the established coordinate axis;
and driving the camera to move to the middle line position along the Y axis, and focusing the camera.
It should be further noted that the center line position between the first edge and the second edge is specifically used to indicate the central position of the gap, fig. 8 is a schematic diagram of the center line position provided according to the embodiment of the present invention, as shown in fig. 8, the central positions of the first edge 1082 and the second edge 1084 are the center line 1086. The midline position can be used for focusing of the camera, and when the camera finishes focusing, the initialization of the camera is finished. In addition, the centerline position may also be used for resetting after the camera completes the shooting method in steps S202 to S206.
In an alternative embodiment, in step S206, stitching the through image of the first shooting area and the through image of the second shooting area to form a shooting through image includes:
respectively extracting feature points in the framing image of the first shooting area and the framing image of the second shooting area;
splicing the view image of the first shooting area and the view image of the second shooting area into a shooting view image according to the extracted characteristic points;
and carrying out proportion selection on the shot view-finding image according to a preset display proportion.
It should be further explained that the feature points in the viewfinder image of the first shooting area and the viewfinder image of the second shooting area are generally used for indicating the basic pixel points forming the viewfinder image, and the complete shot viewfinder image can be obtained by splicing the basic pixel points; in the splicing process, the characteristic points in the viewfinder image of the first shooting area and the characteristic points in the viewfinder image of the second shooting area can be used as reference points, wherein the characteristic points are overlapped with each other in the viewfinder image of the first shooting area and the viewfinder image of the second shooting area.
Since the through image of the first photographing region or the through image of the second photographing region is not 1: 2, after the framing image of the first shooting area is spliced with the framing image of the second shooting area, a certain proportion of reduction is needed to obtain a shooting framing image which can be normally displayed in the terminal; it should be noted that the above ratio is related to the width of the slit in the vertical direction in the present embodiment, and the specific setting of the ratio is not limited in the present invention.
In an alternative embodiment, in step S206, after the through image of the first photographing region and the through image of the second photographing region are stitched to form the photographed through image, the photographed through image is stored as the photographed image.
It should be further noted that, storing the shot view image is to store the shot view image in a storage module of the terminal, and to present the shot view image to the user through an application such as "album". In addition to the above-described storage operation, the shooting method of the present embodiment may also display the above-described shot through image in real time on a display panel of the terminal.
In an optional embodiment, a set of the first shooting area framing operation, the second shooting area framing operation and the splicing operation of the framing images is completed at least within one refresh period of the camera.
It should be further noted that the above one refresh period refers to a refresh period of each frame of image in the display panel, that is, in this embodiment, the camera completes the operations of shifting between the first edge and the second edge of the gap, shooting the viewfinder image at the corresponding position, and stitching the viewfinder image in one refresh period; according to the technical scheme, the display panel does not generate time delay due to the shooting method in the embodiment when displaying the image. When the shooting method in the embodiment is used for continuous shooting or video call, multiple groups of operations can be completed in one refreshing period, and the image with the best definition in the multiple groups of operations is selected for storage.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
To further explain the structure and operation of the camera terminal in this embodiment, the following detailed description is made by way of specific embodiments:
detailed description of the preferred embodiment 1
The specific embodiment is specifically described by using a mobile phone terminal, and the mobile phone in the specific embodiment adopts a scheme that a front-facing camera and a screen are arranged in a front-back overlapping manner, rather than a scheme that the screen and the front-facing camera are arranged in parallel in the related art; specifically, in this embodiment, the front-facing camera is disposed inside the mobile phone, and the view of the front-facing camera is implemented by using a gap between the display panel and the mobile phone casing. Fig. 9 is a schematic structural diagram of a front camera of a mobile phone according to an embodiment of the present invention, as shown in fig. 9, a gap 306 is formed between a housing 302 and a display screen 304 of the mobile phone, the front camera 308 is disposed inside the mobile phone housing 302 and opposite to the gap 306, the front camera 308 is further connected to a sliding device, such as a sliding rail, inside the housing, and the front camera 308 can specifically slide along the sliding rail in a width direction of the gap (i.e., a height direction of the mobile phone when the mobile phone is vertically placed). The exterior of the display screen 304 is also covered with a glass panel 310.
The width of the gap 306 is significantly smaller than the conventional width of the front camera 308, so that the mobile phone in this embodiment can achieve a significant increase in screen ratio at the front end.
The steps of the front camera in this embodiment when operating are as follows:
and S1, when the front camera 308 is started, acquiring the edge of the gap. The start of the front-facing camera 308 is used to instruct the front-facing camera 308 to perform initialization processing, and the start operation may be set after the mobile phone is powered on each time or after the mobile phone finishes hibernation each time. The acquisition of the slit edge by the front camera 308 can be realized by establishing a coordinate system, and fig. 10 is a schematic diagram of a working coordinate system of the front camera according to an embodiment of the present invention, as shown in fig. 10, the establishment of the coordinate system refers to the following steps:
s1.1, establishing a coordinate system, wherein the length direction of the gap 306 is taken as an X axis; the width direction of the gap 306 or the movement direction of the front camera 308 is taken as the Y axis; the view finding direction of the front camera 308 is the Z axis, wherein the X axis and the Y axis are mutually vertical;
s1.2, after the mobile phone is started, namely when the front camera 308 is powered on, the front camera 308 keeps still and scans upper and lower edge information corresponding to the upper and lower edges of the gap 306, wherein the upper and lower edge information is specifically the height positions of the upper edge and the lower edge;
and S1.3, according to the collected upper and lower edge information, marking coordinates corresponding to the upper and lower edge information on the coordinate system established in the step S1.1.
S2, calculating the coordinate corresponding to the central line of the gap 306 according to the coordinate corresponding to the information of the upper and lower edges of the gap 306 in the coordinate system; specifically, the intersection position of the upper edge gap and the Y axis can be defined as Y1, the intersection position of the lower edge gap and the Y axis is defined as Y2, the midpoint of the line segment Y1-Y2 is defined as (0, 0) point of the X and Y coordinate planes, and the X coordinate axis is established, and is the gap center line 312; fig. 11 is a schematic diagram of the focusing position in the working coordinate system of the front camera according to the embodiment of the present invention, and as shown in fig. 11, the coordinate axis is established by using the (0, 0) position illustrated in fig. 11 as the focusing focus position.
After the above setting is completed, the front-facing camera 308 performs displacement adjustment in the Y-axis direction, and moves to the (0, 0) point, at which time the camera focuses on the center of the slit.
When the mobile phone starts the front camera each time, the front camera 308 is set to automatically execute the process, namely the front camera 308 is set to focus on (0, 0) of the coordinate; in addition, (0, 0) is also used as the return reset position of the front camera 308 after the front camera 308 completes the work each time.
S3, when the front camera 308 needs to work, the front camera 308 is controlled to move to the corresponding coordinates of the upper edge information in real time, and when the front camera 308 is at the corresponding position of the upper edge of the gap, more scenes in the lower half area can be collected, so that after focusing is completed, the front camera 308 needs to move to the coordinate position of the upper edge information of the gap to view the lower half area; fig. 12 is a schematic diagram illustrating the operation of the front camera according to the position of the upper edge of the slit, where the front camera completes the view of the lower half area at the position corresponding to the upper edge of the slit, as shown in fig. 12.
S4, similarly, when the front-facing camera 308 is at the corresponding position on the lower edge of the slit, more scenery of the upper half area can be collected, so that after the front-facing camera 308 completes the framing processing of the upper half area, it needs to move to the information coordinate position on the lower edge of the slit to frame the upper half area; fig. 13 is a schematic diagram illustrating the operation of the front camera according to the lower edge position of the slit, where as shown in fig. 13, the front camera 308 completes the framing of the upper half area at the lower edge position of the slit;
fig. 14 is a schematic diagram of an image obtaining flow of the front camera in the frame rate period according to the embodiment of the present invention, as shown in fig. 14, an upward arrow in fig. 14 indicates that the front camera moves upward to obtain a lower half area image, and a downward arrow indicates that the front camera moves downward to obtain an upper half area image.
S5, because the lower half area image and the upper half area image obtained in S3 and S4 are both local scene, the lower half area image and the upper half area image need to be spliced in real time to obtain a complete scene image; the specific image stitching process is as follows:
s5.1, an image processing chip in the mobile phone, such as a CPU or a DSP, extracts and analyzes feature points of a group of real-time upper and lower half-area images;
s5.2, splicing the pictures in an increased size according to the characteristic points of the two pictures;
and S5.3, performing proportion selection on the spliced images according to the size proportion displayed by the current mobile phone, wherein the selection principle is to display the image scene information with the maximum current display proportion.
S5.4, completing the splicing of a plurality of groups of images if the images are within a refresh frame rate period, and selecting clearer images from the plurality of groups of images as images to be displayed; fig. 15 is a schematic diagram of an upper half area image provided according to an embodiment of the present invention, fig. 16 is a schematic diagram of a lower half area image provided according to an embodiment of the present invention, and fig. 17 is a schematic diagram of a complete image provided according to an embodiment of the present invention, it should be noted that, in this embodiment, in order to more clearly show the acquisition of the image, fig. 15 and fig. 16 are both images taken by the mobile phone in a horizontal state, so that the front camera respectively acquires images located at left and right angles of an actual orientation of the gap during the shooting process; the images shown in fig. 15 and 16 are spliced to obtain the image shown in fig. 17.
And S5.5, displaying the processed image in the mobile phone.
The above-mentioned S1 to S5 are all completed within one frame rate refresh period; at the moment, the picture displayed by the terminal equipment is a clear picture which is spliced and has obvious characteristics.
In summary, the processing of image real-time stitching performed by the front-facing camera in the shooting process in the present embodiment includes three parts of image acquisition, image analysis, and image stitching, and fig. 18 is a schematic diagram of image processing provided according to an embodiment of the present invention.
In addition, if the handset is in a continuous preview mode, such as video communication, etc., the above-mentioned S1 to S5 are completed once per refresh frame period, and are repeated.
And if the mobile phone is in a photographing mode, storing the finally processed image as a photographing picture in the current refreshing frame period.
Example 3
The embodiment also provides a camera device, and the camera device in the embodiment is applied to the terminal in embodiment 1, and the device is used for implementing the above embodiments and preferred embodiments, and the description of the device is omitted. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 19 is a block diagram of a configuration of an image pickup apparatus according to an embodiment of the present invention, as shown in fig. 19, the apparatus including:
the first view finding module 302 is configured to drive the camera to move to a first edge of the gap along a vertical direction of the gap, and view a first shooting area through the gap;
the second view finding module 304 is used for driving the camera to move to a second edge of the gap opposite to the first edge along the vertical direction of the gap, and finding a view of the second shooting area through the gap;
and a splicing module 306, configured to splice the view image of the first shooting area and the view image of the second shooting area to form a shooting view image.
In the above embodiment, the camera is disposed behind a gap formed between the display panel of the terminal and the housing, the camera is driven by the camera to move in the vertical direction of the gap and perform framing shooting for different shooting areas to obtain framing images of different shooting areas, and the framing images of the different shooting areas are spliced to form a shooting framing image, so that the screen occupation ratio of the terminal is improved, and the shooting effect of the front camera is ensured. Therefore, the shooting device in the embodiment can solve the problem that the screen occupation ratio cannot be improved due to the influence of the layout of the front camera on the terminal equipment in the related art.
In an alternative embodiment, before driving the camera to move along the vertical direction of the slit to the first edge of the slit, the first viewfinder module 302 further includes:
when the camera is initialized, acquiring the position information of a first edge and a second edge of a gap;
and establishing a coordinate axis according to the acquired position information, wherein the extending direction of the gap is an X axis, the vertical direction of the gap is a Y axis, and the viewing direction is a Z axis.
In an optional embodiment, after the coordinate axis is established according to the collected position information, the method further includes:
calculating the position of a central line between the first edge and the second edge according to the established coordinate axis;
and driving the camera to move to the middle line position along the Y axis, and focusing the camera.
In an optional embodiment, the stitching module 306 stitching the through image of the first shooting area and the through image of the second shooting area to form a shot through image includes:
respectively extracting feature points in the framing image of the first shooting area and the framing image of the second shooting area;
splicing the view image of the first shooting area and the view image of the second shooting area into a shooting view image according to the extracted characteristic points;
and carrying out proportion selection on the shot view-finding image according to a preset display proportion.
In an optional embodiment, after the splicing module 306 splices the through image of the first shooting area and the through image of the second shooting area to form a shot through image, the method further includes:
the captured through-image is stored as a captured image.
In an optional embodiment, the shooting device completes at least one group of the first shooting area framing operation, the second shooting area framing operation and the framing image splicing operation within one refreshing period of the camera.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.
Example 4
Embodiments of the present invention also provide a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
Alternatively, in the present embodiment, the storage medium may be configured to store a computer program for executing the steps of:
s1, driving the camera to move to the first edge of the gap along the vertical direction of the gap, and framing the first shooting area through the gap;
s2, driving the camera to move to a second edge of the gap opposite to the first edge along the vertical direction of the gap, and framing the second shooting area through the gap;
and S3, splicing the view image of the first shooting area and the view image of the second shooting area to form a shooting view image.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing computer programs, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Example 5
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, driving the camera to move to the first edge of the gap along the vertical direction of the gap, and framing the first shooting area through the gap;
s2, driving the camera to move to a second edge of the gap opposite to the first edge along the vertical direction of the gap, and framing the second shooting area through the gap;
and S3, splicing the view image of the first shooting area and the view image of the second shooting area to form a shooting view image.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (11)
1. A terminal, comprising: a shell, a display panel and a camera, which is characterized in that,
the camera is arranged in the terminal and is positioned behind a gap formed between the display panel and the shell.
2. The terminal of claim 1, further comprising:
and the displacement assembly is arranged in the terminal, is connected with the camera and is used for driving the camera to move along the vertical direction of the gap.
3. A terminal according to claim 2, wherein the displacement assembly comprises:
the sliding rail is arranged along the vertical direction of the gap;
and the driving part is connected with the camera and used for driving the camera to move along the sliding rail.
4. A shooting method is applied to a terminal, and is characterized in that the terminal comprises: the device comprises a shell, a display panel, a camera and a displacement assembly; the camera is arranged in the terminal and is positioned behind a gap formed by the display panel and the shell, and the displacement assembly is connected with the camera and used for driving the camera to move along the vertical direction of the gap; the method comprises the following steps:
driving the camera to move to a first edge of the gap along the vertical direction of the gap, and framing a first shooting area through the gap;
driving the camera to move to a second edge of the gap opposite to the first edge along the vertical direction of the gap, and framing a second shooting area through the gap;
and splicing the view image of the first shooting area and the view image of the second shooting area to form a shooting view image.
5. The method of claim 4, further comprising, prior to driving the camera to move in a vertical direction of the slit to the first edge of the slit:
when the camera is initialized, acquiring the position information of the first edge and the second edge of the gap;
and establishing a coordinate axis according to the acquired position information, wherein the extending direction of the gap is an X axis, the vertical direction of the gap is a Y axis, and the viewing direction is a Z axis.
6. The method of claim 5, wherein after establishing the coordinate axis based on the collected location information, further comprising:
calculating the position of a center line between the first edge and the second edge according to the established coordinate axis;
and driving the camera to move to the midline position along the Y axis, and focusing the camera.
7. The method according to claim 4, wherein stitching the through image of the first photographing region and the through image of the second photographing region to form a photographed through image comprises:
respectively extracting feature points in the framing image of the first shooting area and the framing image of the second shooting area;
splicing the framing image of the first shooting area and the framing image of the second shooting area into the shooting framing image according to the extracted characteristic points;
and carrying out proportion selection on the shot view-finding image according to a preset display proportion.
8. The method according to claim 4, wherein after the step of stitching the through image of the first photographing region and the through image of the second photographing region to form the photographed through image, further comprising:
the shot through image is stored as a shot image.
9. The method according to claim 4, wherein a set of the first photographing region framing operation, the second photographing region framing operation, and the splicing operation of the framing images is completed at a minimum within one refresh period of the camera.
10. A storage medium, in which a computer program is stored, wherein the computer program is arranged to perform the method of any of claims 4 to 9 when executed.
11. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and wherein the processor is arranged to execute the computer program to perform the method of any of claims 4 to 9.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811543971.5A CN111327795B (en) | 2018-12-17 | 2018-12-17 | Terminal, shooting method, storage medium and electronic device |
| PCT/CN2019/112892 WO2020125196A1 (en) | 2018-12-17 | 2019-10-24 | Terminal and photographing method, storage medium, and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811543971.5A CN111327795B (en) | 2018-12-17 | 2018-12-17 | Terminal, shooting method, storage medium and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111327795A true CN111327795A (en) | 2020-06-23 |
| CN111327795B CN111327795B (en) | 2022-04-29 |
Family
ID=71102048
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811543971.5A Active CN111327795B (en) | 2018-12-17 | 2018-12-17 | Terminal, shooting method, storage medium and electronic device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111327795B (en) |
| WO (1) | WO2020125196A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111929765A (en) * | 2020-08-18 | 2020-11-13 | 昆山工研院新型平板显示技术中心有限公司 | Display panel and light guide structure thereof |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105120179A (en) * | 2015-09-22 | 2015-12-02 | 三星电子（中国）研发中心 | Shooting method and device |
| CN107613057A (en) * | 2017-10-31 | 2018-01-19 | 北京小米移动软件有限公司 | Electronic equipment |
| CN207369131U (en) * | 2017-09-30 | 2018-05-15 | 上海爱优威软件开发有限公司 | A kind of mobile terminal case and mobile terminal for supporting 360 degree of pan-shots |
| CN207926673U (en) * | 2018-04-03 | 2018-09-28 | 信利光电股份有限公司 | A kind of comprehensive screen mobile phone |
| CN207968590U (en) * | 2018-03-29 | 2018-10-12 | 绿灯实验室(深圳)科技有限公司 | Camera module and shield mobile terminal comprehensively |
| CN108762397A (en) * | 2018-06-08 | 2018-11-06 | Oppo广东移动通信有限公司 | Control method, control assembly, electronic equipment and the storage medium of slide assemblies |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103731605B (en) * | 2013-12-16 | 2017-04-19 | 宇龙计算机通信科技(深圳)有限公司 | Photographing method and terminal |
| JP2015133647A (en) * | 2014-01-15 | 2015-07-23 | 株式会社発明屋 | Camera hiding device |
-
2018
- 2018-12-17 CN CN201811543971.5A patent/CN111327795B/en active Active
-
2019
- 2019-10-24 WO PCT/CN2019/112892 patent/WO2020125196A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105120179A (en) * | 2015-09-22 | 2015-12-02 | 三星电子（中国）研发中心 | Shooting method and device |
| CN207369131U (en) * | 2017-09-30 | 2018-05-15 | 上海爱优威软件开发有限公司 | A kind of mobile terminal case and mobile terminal for supporting 360 degree of pan-shots |
| CN107613057A (en) * | 2017-10-31 | 2018-01-19 | 北京小米移动软件有限公司 | Electronic equipment |
| CN207968590U (en) * | 2018-03-29 | 2018-10-12 | 绿灯实验室(深圳)科技有限公司 | Camera module and shield mobile terminal comprehensively |
| CN207926673U (en) * | 2018-04-03 | 2018-09-28 | 信利光电股份有限公司 | A kind of comprehensive screen mobile phone |
| CN108762397A (en) * | 2018-06-08 | 2018-11-06 | Oppo广东移动通信有限公司 | Control method, control assembly, electronic equipment and the storage medium of slide assemblies |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111929765A (en) * | 2020-08-18 | 2020-11-13 | 昆山工研院新型平板显示技术中心有限公司 | Display panel and light guide structure thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111327795B (en) | 2022-04-29 |
| WO2020125196A1 (en) | 2020-06-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2779628B1 (en) | Image processing method and device | |
| KR101487516B1 (en) | Apparatus and method for multi-focus image capture using continuous auto focus | |
| US8704929B2 (en) | System and method for user guidance of photographic composition in image acquisition systems | |
| CN110012209A (en) | Panorama image generation method, device, storage medium and electronic equipment | |
| CN111862620B (en) | Image fusion processing method and device | |
| WO2018188609A1 (en) | Photographing device, method and equipment | |
| CN110177200B (en) | Camera module, electronic equipment and image shooting method | |
| CN110099220B (en) | Panoramic stitching method and device | |
| CN112637500B (en) | Image processing method and device | |
| WO2011014421A2 (en) | Methods, systems, and computer-readable storage media for generating stereoscopic content via depth map creation | |
| CN106331497A (en) | Image processing method and terminal | |
| CN113329172B (en) | Shooting method and device and electronic equipment | |
| CN112954212B (en) | Video generation method, device and equipment | |
| CN113596294A (en) | Shooting method and device and electronic equipment | |
| CN103905735A (en) | Mobile terminal with dynamic tracing shooting function and dynamic tracing shooting method thereof | |
| CN107111371A (en) | A kind of method, device and terminal for showing panoramic vision content | |
| EP2613520B1 (en) | Apparatus and method of displaying camera view area in portable terminal | |
| WO2021139764A1 (en) | Method and device for image processing, electronic device, and storage medium | |
| CN111327795B (en) | Terminal, shooting method, storage medium and electronic device | |
| KR20210101009A (en) | Method for Recording Video using a plurality of Cameras and Device thereof | |
| JP7404563B2 (en) | Image acquisition methods, equipment and electronics | |
| JP2010034652A (en) | Multi-azimuth camera mounted mobile terminal apparatus | |
| CN110876018B (en) | Mobile terminal, control method of mobile terminal, and computer storage medium | |
| CN115004685A (en) | Electronic device and method for displaying image at electronic device | |
| CN104869283A (en) | Shooting method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |