WO2020125196A1

WO2020125196A1 - Terminal and photographing method, storage medium, and electronic device

Info

Publication number: WO2020125196A1
Application number: PCT/CN2019/112892
Authority: WO
Inventors: 刘凤鹏; 刘冬梅
Original assignee: 中兴通讯股份有限公司
Priority date: 2018-12-17
Filing date: 2019-10-24
Publication date: 2020-06-25
Also published as: CN111327795A; CN111327795B

Abstract

The present invention provides a terminal and a photographing method, a storage medium, and an electronic device. The terminal comprises a housing, a display panel, and a camera, wherein the camera is disposed inside the terminal, and is located behind the gap formed by the display panel and the housing.

Description

Terminal, shooting method, storage medium, electronic device

Cross-reference of related applications

This application is based on a Chinese patent application with an application number of 201811543971.5 and an application date of December 17, 2018, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated by reference.

Technical field

The present invention relates to the field of image processing, and in particular, to a terminal, a shooting method, a storage medium, and an electronic device.

Background technique

With the development of panel technology and the surge in user demand, the area of the display area of the terminal device in the terminal device is becoming larger and larger, that is, the screen area of the display area (ie, screen) in the terminal device is gradually increasing. At present, one of the bottlenecks restricting the further increase of the screen ratio in the terminal device is the setting of the front camera in the terminal device. Due to the common applications in the current terminal, such as video communication, self-timer, etc., all need to rely on the front camera to be able to Realization, so the front camera cannot be omitted.

In order to ensure the display effect of the camera, the camera in the related art often needs to be placed side by side with the screen in the terminal device, that is, the camera and the screen are integrated in the front end of the terminal device. In the above camera layout method, the terminal device can only increase the screen ratio by increasing the area of the screen in the area where the camera is not located, and cannot perform screen layout for the area where the camera is located. Therefore, the screen ratio of the terminal device in the related art cannot Further improve.

In view of the above related art, the terminal device is affected by the layout of the front camera and cannot increase the screen ratio, and no effective solution has been proposed in the related art.

Summary of the invention

Embodiments of the present invention provide a terminal, a shooting method, a storage medium, and an electronic device based on the terminal, to at least solve the problem that the terminal device in the related art is affected by the layout of the front camera and cannot increase the screen ratio.

According to an embodiment of the present invention, a terminal is provided, including: a housing, a display panel, and a camera; the camera is disposed inside the terminal, and is located in a gap formed by the display panel and the housing The rear.

According to another embodiment of the present invention, there is also provided a shooting method, which is applied to a terminal, and the terminal includes: a housing, a display panel, a camera, and a displacement component; the camera is disposed inside the terminal and is located Behind the gap formed by the display panel and the housing, the displacement component is connected to the camera for driving the camera to move in the vertical direction of the gap; the method includes:

Driving the camera to move to the first edge of the slit in the vertical direction of the slit, and framing the first shooting area through the slit;

Driving the camera to move in the vertical direction of the slit to the second edge of the slit opposite to the first edge, and framing the second shooting area through the slit;

Stitching the framing image of the first shooting area and the framing image of the second shooting area to form a shooting framing image.

According to yet another embodiment of the present invention, there is also provided a storage medium in which a computer program is stored, wherein the computer program is configured to execute the steps in any one of the above method embodiments during runtime.

According to yet another embodiment of the present invention, there is also provided an electronic device, including a memory and a processor, the memory stores a computer program, the processor is configured to run the computer program to perform any of the above The steps in the method embodiment.

BRIEF DESCRIPTION

The drawings described herein are used to provide a further understanding of the present invention and form a part of the present application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an undue limitation on the present invention. In the drawings:

FIG. 1 is a schematic structural diagram of a terminal according to an embodiment of the present invention;

FIG. 2 is a schematic diagram (1) of the movement position of a camera according to an embodiment of the present invention;

FIG. 3 is a schematic diagram (2) of camera movement positions provided according to an embodiment of the present invention;

4 is a schematic diagram of a shooting position of a camera according to an embodiment of the present invention;

5 is a flowchart of a shooting method according to an embodiment of the present invention;

6 is a schematic diagram of a first shooting area according to an embodiment of the present invention;

7 is a schematic diagram of a second shooting area according to an embodiment of the present invention;

8 is a schematic diagram of the position of the center line provided according to an embodiment of the present invention;

9 is a schematic structural diagram of a front camera of a mobile phone according to a specific embodiment of the present invention;

10 is a schematic diagram of a working coordinate system for a front camera provided according to a specific embodiment of the present invention;

11 is a schematic diagram of a focus position in a working coordinate system of a front camera according to a specific embodiment of the present invention;

FIG. 12 is a working schematic diagram of the position of the upper edge of the slit corresponding to the front camera according to a specific embodiment of the present invention;

13 is a working schematic diagram of the position of the lower edge of the slit corresponding to the front camera according to a specific embodiment of the present invention;

14 is a schematic diagram of a process of acquiring a front camera image in a frame rate period according to an embodiment of the present invention;

15 is a schematic diagram of an image of an upper half region provided according to a specific embodiment of the present invention;

16 is a schematic diagram of an image of a lower half area provided according to a specific embodiment of the present invention;

17 is a schematic diagram of a complete image provided according to a specific embodiment of the present invention;

18 is a schematic diagram of image processing according to a specific embodiment of the present invention;

19 is a structural block diagram of a photographing device according to an embodiment of the present invention.

detailed description

Hereinafter, the present invention will be described in detail with reference to the drawings and in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other if there is no conflict.

It should be noted that the terms “first” and “second” in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and do not have to be used to describe a specific order or sequence.

Example 1

A terminal is provided in this embodiment. FIG. 1 is a schematic structural diagram of a terminal provided according to an embodiment of the present invention. As shown in FIG. 1, the terminal includes: a housing 102, a display panel 104, and a camera 106; Inside the terminal, it is located behind the gap 108 formed by the display panel 104 and the housing 102.

In the above embodiment, the terminal is provided with a camera behind the gap formed by the display panel and the case of the terminal, thereby increasing the screen ratio of the terminal. Therefore, the terminal in this embodiment can solve the problem that the terminal device in the related art is affected by the layout of the front camera and cannot increase the screen ratio.

It should be further noted that the terminals in this embodiment include but are not limited to mobile phones, tablet computers, PCs, wearable devices, etc. Any terminal with a front camera function and including a case and a display panel can be used as the terminal The terminal in the embodiment; the present invention does not limit the specific type of terminal.

In the above terminal, the housing is a shell forming a cover for the terminal. Generally, the housing includes an upper end surface, a lower end surface, a side end surface, a front end surface, and a rear end surface. The front end surface of the housing is provided with an opening for installing a display panel , Used to install the display panel; when the display panel is installed in the above opening, the display panel and the housing constitute the terminal as a whole. It should be noted that the above-mentioned housing may be an integrally formed component, or may be a combination of multiple components (such as a back cover and a side wall of a mobile phone). The present invention does not limit the structure of the housing.

During the assembly process between the display panel and the housing, because there is the same component between the display panel and the housing, there must be a certain gap, and the gap constitutes the gap described in the above embodiment. The above-mentioned gap may be a gap naturally formed between the display panel and the housing during the assembly process, or may be a gap further artificially provided according to needs based on the gap formed by the above-mentioned assembly. It should be noted that, taking a mobile phone as an example, a glass panel or a capacitive touch component is usually provided outside the display panel. The slit in this embodiment may be provided under the glass panel, or in the area corresponding to the slit of the glass panel Slotted.

The above-mentioned camera is used to instruct the front-facing camera located at the front end of the terminal in the terminal. The camera is located inside the terminal and behind the gap formed by the display panel and the case. Between the display panel and the display panel; because the gap in the above embodiment is formed between the housing and the display panel, when the camera is inside the terminal, the camera and the gap are distributed on the front end surface and inside of the terminal, respectively, thereby forming a stagger Distributed structure; In order to make the camera react as quickly as possible during the work, the camera and the gap should be located at a height relative to each other (the terminal is placed vertically in use as a reference), or the camera and the gap are located The height position is within a reasonable difference. In addition to the camera in this embodiment, the area between the housing and the display panel is also provided with components such as control components, storage components, power components, heat dissipation components, etc. The type and layout method are not limited.

Since the camera in the terminal of this embodiment is provided inside the terminal, only the gap formed between the display panel and the case remains in the front end surface of the terminal, that is, the end surface where the display panel of the terminal is located. Compared with the solution in the related art in which the camera is directly placed at the front end of the terminal (that is, the camera is in parallel with the display panel), the width of the slit in this embodiment is significantly smaller than the physical width of the camera in this direction. Therefore, the end face of the terminal It is no longer necessary to reserve a space equal to the corresponding area of the camera, thereby further increasing the screen ratio of the front end of the terminal.

In an alternative embodiment, the terminal further includes:

The displacement component 110 is provided inside the terminal and connected to the camera, and is used to drive the camera to move in the vertical direction of the slit.

It should be further noted that the above displacement component is used to control the camera to move in the vertical direction of the slit, so that the camera can shoot at different angles relative to the edge of the slit at different positions of the slit; according to the optical principle, the camera is different from the edge of the slit The images obtained during the shooting at different angles are also different, that is, the displacement component controls the camera to move in the vertical direction of the slit, so that the camera can obtain images at different angles, and the relevant images can be processed to obtain the complete image. For user operation. Therefore, the terminal in this embodiment improves the screen ratio of the terminal while also ensuring a good shooting effect.

In order to achieve the movement of the camera assembly, the above displacement assembly includes at least one connecting portion for connecting the camera, and a driving portion for driving the connecting portion and the camera assembly to move, for example, the above displacement assembly may include a connection formed by a screw The drive part composed of the motor and the micro motor, or the connection part composed of the slide rail and the drive part composed of the drive wheel, or the electric push rod integrated with the above-mentioned connection part and the drive part, etc.; The composition is not limited, and any displacement component that can achieve the above-mentioned functions belongs to the protection scope of the present invention.

The above-mentioned driving part should also include a control part for controlling the driving part to drive the connecting part to move, thereby controlling the movement of the camera; the control part can adopt a control unit independently integrated with the driving part, such as a memory storing control instructions , And a controller for sending control commands, etc., may also combine the control part with the terminal's own control module, that is, integrate the control commands for the displacement component and the camera in the CPU of the relevant terminal device. In any of the above methods, a direct or indirect electrical connection is formed between the control unit and the drive unit, that is, the drive unit, the connection unit, and the camera can move correspondingly under the control command generated by the control unit; The specific connection mode between the driving parts may be a physical connection or a wireless communication connection, which is not limited in the present invention.

In an alternative embodiment, the displacement component 110 includes:

The slide rail 1102 is arranged along the vertical direction of the gap 108;

The driving component 1104 is connected to the camera 106 and is used to drive the camera 106 to move along the slide rail 1102.

It should be further noted that the above-mentioned slide rail can be used as the connecting portion in the above-mentioned embodiment, and the driving member can be used as the driving portion in the above-mentioned embodiment. 2 is a schematic diagram (1) of the camera movement position provided according to an embodiment of the present invention, and FIG. 3 is a schematic diagram (2) of the camera movement position provided according to an embodiment of the present invention. As shown in FIGS. 2 and 3, the camera is moving Under the control of the driving component in the assembly, the slide rail is moved to the corresponding position of the upper edge and the lower edge of the slit respectively to perform shooting processing to complete the movement in the vertical direction of the slit.

Example 2

In this embodiment, a shooting method is provided, which is applied to the terminal in the above embodiment. FIG. 4 is a schematic diagram of a camera shooting position according to an embodiment of the present invention. As shown in FIG. 4, the terminal includes: a housing 102, The display panel 104, the camera 106, and the displacement component 110; the camera 106 is disposed inside the terminal and is located behind the gap 108 formed by the display panel 104 and the housing 102, and the displacement component 110 is connected to the camera 106 for driving the camera 106 along The slit 108 moves in the vertical direction; in addition, in this embodiment, the position where the camera shoots includes the first edge 1082 and the second edge 1084 of the slit 108. FIG. 5 is a flowchart of a shooting method according to an embodiment of the present invention. As shown in FIG. 5, the method in this embodiment includes:

S202, driving the camera to move to the first edge of the slit in the vertical direction of the slit, and framing the first shooting area through the slit;

S204, driving the camera to move in the vertical direction of the slit to the second edge of the slit opposite to the first edge, and framing the second shooting area through the slit;

S206, stitching the framing image of the first shooting area and the framing image of the second shooting area to form a shooting framing image.

In the above embodiment, the terminal sets the camera behind the gap formed by the display panel and the housing of the terminal, and the above-mentioned shooting method moves the camera in the vertical direction of the gap by driving the camera to different shooting areas Perform framing shooting to obtain framing images of different shooting areas, and form framing images by stitching the framing images of the above different shooting areas, thereby improving the screen ratio of the terminal and ensuring the shooting effect of the front camera . Therefore, the shooting method in this embodiment can solve the problem that the terminal device in the related art is affected by the layout of the front camera and cannot increase the screen ratio.

In an alternative embodiment, the execution order of step S202 and step S204 can be interchanged, that is, step S204 can be executed first, and then S202 can be executed.

In an alternative embodiment, the execution subjects of steps S202 to S206 are all control components. The control components can be integrated into the control module of the terminal, that is, the movement of the camera in step S202 and step S204 is realized by the CPU of the terminal device, Shooting and stitching processing for images in step S206. The control component may also be controlled by an independent first control component to move and shoot the camera in steps S202 and S204. The independent second control component implements the image splicing process in step S206. Be limited.

As shown in FIG. 4, the first edge of the slit in step S202 indicates the corresponding edge position of the slit relative to the side of the case. When the terminal is placed vertically in the normal use state, the first edge is The upper edge of the gap. The above first shooting area is used to indicate the corresponding shooting image when the camera is located at the first edge of the slit. FIG. 6 is a schematic diagram of the first shooting area according to an embodiment of the present invention. As shown in FIG. 6, when the camera is located at the slit When the first edge corresponds to the position, according to the optical principle, the shooting range of the camera corresponds to the lower half area relative to the slit, that is, the first shooting area in this embodiment is the above lower half area. It should be further noted that the camera moves to the first edge of the slit, which is used to instruct the camera to move to a position flush with the first edge of the slit, instead of making the camera contact the first edge. The second edge of the slit in step S204 indicates the corresponding edge position of the slit relative to the side of the display panel. When the terminal is placed vertically in the normal use state, the first edge is the lower edge of the slit. The above second shooting area is used to indicate the corresponding shooting image when the camera is located at the second edge position of the slit. FIG. 7 is a schematic diagram of the second shooting area according to an embodiment of the present invention. As shown in FIG. 7, when the camera is located at the slit When the second edge corresponds to the position, according to the optical principle, the shooting range of the camera corresponds to the upper half area relative to the slit, that is, the second shooting area in this embodiment is the upper half area. It should be further noted that the camera moves to the second edge of the slit, which is used to instruct the camera to move to a position flush with the second edge of the slit, rather than contacting the camera with the second edge.

Taking the portrait shooting as an example, when the user needs to frame his own portrait, the camera can locate the lower body of the portrait when the camera is located at the first edge of the gap, and can shoot the upper body of the portrait when the camera is located at the second edge of the gap , By stitching or combining the above upper body image and the lower body image, a complete portrait image can be synthesized.

In an optional embodiment, in the above step S202, before driving the camera to move to the first edge of the slit in the vertical direction of the slit, the method further includes:

When the camera is initialized, the position information of the first and second edges of the gap is collected;

The coordinate axis is established according to the collected position information, wherein the extending direction of the slit is the X axis, the vertical direction of the slit is the Y axis, and the viewing direction is the Z axis.

It should be further noted that the time when the camera is initialized is used to indicate the time when the terminal starts to work. Usually, the terminal enters the power-on state from the shutdown state or enters the working state from the sleep state; in the camera initialization, the The control component instructs the camera to obtain the first edge position and the second edge position of the slit, specifically the image including the first edge and the second edge of the slit can be acquired through the camera, and the first of the camera slit can be obtained according to the processing or recognition of the image The corresponding position of the edge and the second edge.

Further, on the premise that the camera acquires the first edge and the second edge of the slit, the extension direction of the first edge or the second edge can be used as the slit extension direction, that is, the X axis, and the first edge and the second edge The relative direction of is the vertical direction of the slit, which is the Y axis, and the shooting direction of the camera is the Z axis.

In an optional embodiment, after the coordinate axis is established according to the collected position information, the method further includes:

Calculate the midline position between the first edge and the second edge according to the established coordinate axis;

Drive the camera to move to the centerline position along the Y axis, and focus the camera.

It should be further noted that the position of the center line between the first edge and the second edge is specifically used to indicate the center position of the gap. FIG. 8 is a schematic diagram of the position of the center line according to an embodiment of the present invention. As shown in FIG. 8, The central position of one edge 1082 and the second edge 1084 is the above-mentioned middle line 1086. The above-mentioned centerline position can be used for the camera's focusing process. After the camera completes the focusing process, the camera's initialization is completed. In addition, the above-mentioned midline position can also be used for the camera to reset after completing the shooting methods of steps S202 to S206.

In an optional embodiment, in the above step S206, stitching the framing image of the first shooting area and the framing image of the second shooting area to form a shooting framing image includes:

Extract feature points in the framing image of the first shooting area and the framing image of the second shooting area, respectively;

Stitching the framing image of the first shooting area and the framing image of the second shooting area into a shooting framing image according to the extracted feature points;

Proportionally select the captured view image according to the preset display scale.

It should be further noted that the feature points in the framing image of the first shooting area and the framing image of the second shooting area are usually used to indicate the basic pixels constituting the framing image, and the completeness can be obtained by stitching the basic pixels Shooting framing image; the feature points in the framing image of the first shooting area and the framing image of the second shooting area can be overlapped with each other in the stitching process of the framing image of the first shooting area and the framing image of the second shooting area As the reference point.

Since the framing image in the first shooting area or the framing image in the second shooting area is not a ratio of 1:2 compared to the framing image, after stitching the framing image in the first shooting area and the framing image in the second shooting area, you need to A certain ratio can be reduced to obtain a shooting view image that can be displayed normally in the terminal; it should be noted that the above ratio is related to the width of the slit in the vertical direction in this embodiment, and the present invention does not make a specific setting for the ratio limited.

In an alternative embodiment, in the above step S206, after the framing image of the first shooting area and the framing image of the second shooting area are stitched to form a photographing framing image, the photographing framing image is stored as the photographing image.

It should be further noted that the above-mentioned storing of the captured framing image is to store the captured framing image in the storage module of the terminal, and display it to the user through an application such as “album”. In addition to the above-mentioned storage operation, the shooting method of this embodiment can also display the above-mentioned captured framing image in real time on the display panel of the terminal.

In an alternative embodiment, at least one set of framing operations for the first shooting area, framing operations for the second shooting area, and stitching operations for the framing images are completed at least within one refresh period of the camera.

It should be further noted that the above one refresh cycle refers to the refresh cycle of each frame of image in the display panel, that is, in this embodiment, the displacement of the camera between the first edge and the second edge of the slit is completed in one refresh cycle , The shooting of the framing image at the corresponding position and the stitching operation of the framing image; the above technical solution can make the display panel display the image without delay due to the shooting method in this embodiment. When the shooting method in this embodiment is used for continuous shooting or video calling, multiple sets of operations can also be completed within one refresh cycle, and images with the best resolution among the multiple sets of operations can be selected and saved.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware, but in many cases the former is Better implementation. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence or part that contributes to the existing technology, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, The CD-ROM includes several instructions to enable a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of various embodiments of the present invention.

To further explain the structure and working mode of the photographing terminal in this embodiment, the following detailed description will be made by way of specific embodiments:

Specific Example 1

This specific embodiment is specifically described with a mobile phone terminal. The mobile phone in this specific embodiment adopts a scheme in which the front camera and the front and back of the screen are overlapped instead of the scheme in which the screen and the front camera are arranged in parallel in the related art; In a specific embodiment, the front camera is arranged inside the mobile phone, and the gap between the display panel and the mobile phone housing is used to realize the framing of the front camera. 9 is a schematic structural diagram of a front camera of a mobile phone according to a specific embodiment of the present invention. As shown in FIG. 9, a gap 306 is formed between the housing 302 of the mobile phone and the display screen 304, and the front camera 308 is disposed on the housing 302 of the mobile phone Inside, and opposite to the above-mentioned gap 306, the front camera 308 is also connected with a sliding device inside the housing, such as a slide rail, the front camera 308 can be specifically along the slide rail in the width direction of the gap (that is, the phone is placed vertically In the height direction). The outside of the display screen 304 is also covered with a glass panel 310.

The width of the above-mentioned slit 306 is significantly smaller than the conventional width of the front camera 308. Therefore, the mobile phone in this specific embodiment can achieve a significant increase in the screen ratio at the front end.

The steps of the front camera in this specific embodiment when working are as follows:

S1, when the front camera 308 is started, the edge of the gap is collected. The start of the front camera 308 is used to instruct the front camera 308 to perform an initialization process. The start work can be set after the mobile phone is turned on each time, or can be set after the mobile phone ends sleep every time. The acquisition of the edge of the gap by the front camera 308 can be achieved by establishing a coordinate system. FIG. 10 is a schematic diagram of the working coordinate system of the front camera according to a specific embodiment of the present invention. As shown in FIG. 10, the reference for establishing the coordinate system is as follows step:

S1.1, establishing a coordinate system, taking the length direction of the slit 306 as the X axis; taking the width direction of the slit 306 or the movement direction of the front camera 308 as the Y axis; taking the front camera 308 viewing direction as the Z axis, where the X axis is Y The axes are perpendicular to each other;

S1.2, after the mobile phone is turned on, that is, when the front camera 308 is powered on, the front camera 308 remains stationary and scans the upper and lower edge information corresponding to the upper and lower edges of the gap 306, and the upper and lower edge information is specifically the height position of the upper edge and the lower edge ;

S1.3. According to the collected upper and lower edge information, the coordinates corresponding to the upper and lower edge information are marked on the coordinate system established in step S1.1.

S2, according to the coordinates corresponding to the upper and lower edge information of the gap 306 in the coordinate system, calculate the coordinates corresponding to the center line of the gap 306; specifically, the position where the upper edge gap intersects the Y axis can be defined as Y1, and the lower edge gap intersects the Y axis The position is Y2, the midpoint of the line segment Y1-Y2 is defined as the (0,0) point of the X and Y coordinate planes, and the X coordinate axis is established, and this coordinate axis is the gap center line 312; FIG. 11 is a specific embodiment according to the present invention The schematic diagram of the focus position in the working coordinate system of the front camera is provided. As shown in FIG. 11, the coordinate axis uses the (0, 0) position shown in FIG. 11 as the focus position to establish the X axis.

After completing the above settings, the front camera 308 adjusts the displacement in the Y-axis direction and moves to the point (0, 0), at which time the camera focuses on the center of the gap.

When the mobile phone activates the front camera each time, the front camera 308 is set to automatically perform the above process, that is, the focus coordinates of the front camera 308 are (0, 0); in addition, each time the front camera 308 completes its work will also ( 0,0) as the return position of the front camera 308.

S3, when the current camera 308 needs to work, first control the front camera 308 to move to the coordinates corresponding to the upper edge information in real time. When the front camera 308 is at the corresponding position of the upper edge of the gap, more scenes in the lower half can be collected. Therefore, After the front camera 308 has finished focusing, it needs to move to the coordinate position of the upper edge of the slit for framing the lower half of the area; FIG. 12 is a schematic diagram of the work of the front camera corresponding to the position of the upper edge of the slit according to a specific embodiment of the present invention, as shown in the figure As shown in 12, the front camera completes the framing of the lower half of the area at the corresponding position on the upper edge of the gap.

S4. Similarly, when the front camera 308 is at the corresponding position on the lower edge of the gap, more scenes in the upper half can be collected. Therefore, the front camera 308 needs to move to the lower edge of the gap after completing the framing process in the upper half. The information coordinate position is used for framing the upper half of the region; FIG. 13 is a schematic diagram of the work of the front camera corresponding to the position of the lower edge of the slit according to a specific embodiment of the present invention. As shown in FIG. 13, the front camera 308 is completed at the position corresponding to the lower edge of the slit For the framing of the upper half;

FIG. 14 is a schematic diagram of an image acquisition process of a front camera in a frame rate period according to an embodiment of the present invention. As shown in FIG. 14, the upward arrow in FIG. 14 indicates that the front camera moves upward to acquire the image of the lower half, and the downward arrow This means that the front camera moves downward to obtain the upper half of the image.

S5, because the lower half image and the upper half image obtained in the above S3 and S4 are partial scenes, it is necessary to stitch the lower half image and the upper half image in real time to obtain a complete scene image; specific The image stitching process is as follows:

S5.1, the image processing chip in the mobile phone, such as CPU or DSP, performs feature point extraction and analysis on a set of two images in the upper and lower half of the real-time group;

S5.2, according to the feature points of the two pictures to increase the size of the stitching;

S5.3, according to the size ratio of the current mobile phone display, the above-mentioned stitched image is selected proportionally, and the selection principle is to display the image scene information with the largest current display ratio.

S5.4, if multiple groups of image stitching are completed within one refresh frame rate period, and a clearer image is selected from the multiple groups of images as the image to be displayed; FIG. 15 is the upper half provided according to an embodiment of the present invention A schematic diagram of the area image, FIG. 16 is a schematic diagram of the lower half image provided according to an embodiment of the present invention, and FIG. 17 is a schematic diagram of the complete image provided according to an embodiment of the present invention. It should be noted that this specific embodiment is more clear Show the acquisition of images. Both Figure 15 and Figure 16 are the images taken when the mobile phone is in a horizontal state, so the front camera acquires the images at the left and right angles of the actual orientation of the slit during the shooting process; By stitching the images in FIG. 15 and FIG. 16, the image shown in FIG. 17 can be obtained.

S5.5, display the processed image on the mobile phone.

All of the above S1 to S5 need to be completed within one frame rate refresh cycle; at this time, the picture displayed by the terminal device is a clear picture with stitching and obvious features.

In summary, the process of real-time image stitching performed by the front camera in the shooting process in this specific embodiment includes three parts: image acquisition, analysis, and stitching. FIG. 18 is an image process according to a specific embodiment of the present invention. Schematic.

In addition, if the mobile phone is in the continuous preview mode, such as video communication, etc., then each refresh frame period completes the above S1 to S5 and repeats continuously.

If the mobile phone is in the photographing mode, the final processed image is stored as a photographed picture within a current refresh frame period.

Example 3

In this embodiment, an imaging device is also provided. The imaging device in this embodiment is applied to the terminal of Embodiment 1, and the device is used to implement the above embodiments and preferred implementations, and descriptions that have already been described will not be repeated. As used below, the term "module" may implement a combination of software and/or hardware that performs predetermined functions. Although the devices described in the following embodiments are preferably implemented in software, implementation of hardware or a combination of software and hardware is also possible and conceived.

FIG. 19 is a structural block diagram of an imaging device according to an embodiment of the present invention. As shown in FIG. 19, the device includes:

The first framing module 302 is used to drive the camera to move to the first edge of the slit in the vertical direction of the slit, and view the first shooting area through the slit;

The second framing module 304 is used to drive the camera to move in the vertical direction of the slit to the second edge of the slit opposite to the first edge, and view the second shooting area through the slit;

The stitching module 306 is used to stitch the framing image of the first shooting area and the framing image of the second shooting area to form a shot framing image.

In the above embodiment, the terminal sets the camera behind the gap formed by the display panel and the case of the terminal, and the shooting device drives the camera to move in the vertical direction of the gap and performs framing shooting for different shooting areas. To obtain the framing images of different shooting areas, the framing images of the above different shooting areas are spliced to form a shooting framing image, so as to increase the screen ratio of the terminal and ensure the shooting effect of the front camera. Therefore, the photographing device in this embodiment can solve the problem that the terminal device in the related art is affected by the layout of the front camera and cannot increase the screen ratio.

In an optional embodiment, in the first framing module 302, before driving the camera to move to the first edge of the slit in the vertical direction of the slit, the method further includes:

In an optional embodiment, in the above-mentioned stitching module 306, stitching the framing image of the first shooting area and the framing image of the second shooting area to form a shot framing image includes:

In an optional embodiment, in the above-mentioned stitching module 306, after stitching the framing image of the first shooting area and the framing image of the second shooting area to form a shot framing image, the method further includes:

Store the captured framing image as the captured image.

In an alternative embodiment, the above-mentioned shooting device completes at least one set of framing operations for the first shooting area, framing operations for the second shooting area, and stitching operations of the framing images in one refresh period of the camera.

It should be noted that the above modules can be implemented by software or hardware, and the latter can be implemented by the following methods, but not limited to this: the above modules are all located in the same processor; or, the above modules can be combined in any combination The forms are located in different processors.

Example 4

An embodiment of the present invention further provides a storage medium in which a computer program is stored, wherein the computer program is set to execute any of the steps in the above method embodiments during runtime.

Optionally, in this embodiment, the above storage medium may be set to store a computer program for performing the following steps:

S1, driving the camera to move to the first edge of the slit in the vertical direction of the slit, and framing the first shooting area through the slit;

S2, driving the camera to move in the vertical direction of the slit to the second edge of the slit opposite to the first edge, and framing the second shooting area through the slit;

S3, stitching the framing image in the first shooting area and the framing image in the second shooting area to form a shooting framing image.

Optionally, for specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiments and optional implementation manners, and details are not repeated in this embodiment.

Optionally, in this embodiment, the above storage medium may include, but is not limited to: a USB flash drive, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), Various media that can store computer programs, such as removable hard disks, magnetic disks, or optical disks.

Example 5

An embodiment of the present invention also provides an electronic device, including a memory and a processor, where the computer program is stored in the memory, and the processor is configured to run the computer program to perform the steps in any one of the foregoing method embodiments.

Optionally, the electronic device may further include a transmission device and an input-output device, wherein the transmission device is connected to the processor, and the input-output device is connected to the processor.

Optionally, in this embodiment, the above processor may be configured to perform the following steps through a computer program:

In the above embodiments of the present invention, the camera is arranged behind the gap formed by the display panel and the casing of the terminal, thereby increasing the screen ratio of the terminal. Therefore, the present invention can solve the problem that the terminal device in the related art is not affected by the layout of the front camera and cannot increase the screen ratio.

Obviously, those skilled in the art should understand that the above-mentioned modules or steps of the present invention can be implemented by a general-purpose computing device, they can be concentrated on a single computing device, or distributed in a network composed of multiple computing devices Above, optionally, they can be implemented with program code executable by the computing device, so that they can be stored in the storage device to be executed by the computing device, and in some cases, can be in a different order than here The steps shown or described are performed, or they are made into individual integrated circuit modules respectively, or multiple modules or steps among them are made into a single integrated circuit module to achieve. In this way, the present invention is not limited to any specific combination of hardware and software.

The above are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modification, equivalent replacement, and improvement made within the principles of the present invention should be included in the protection scope of the present invention.

Claims

A terminal includes: a housing, a display panel and a camera, wherein,

The camera is disposed inside the terminal, and is located behind the gap formed by the display panel and the housing.
The terminal according to claim 1, wherein the terminal further comprises:

A displacement component is provided inside the terminal, and is connected to the camera to drive the camera to move in the vertical direction of the gap.
The terminal according to claim 2, wherein the displacement component comprises:

The slide rail is set along the vertical direction of the gap;

The driving component is connected to the camera and used to drive the camera to move along the slide rail.
A shooting method applied to a terminal, wherein the terminal includes: a housing, a display panel, a camera, and a displacement component; the camera is disposed inside the terminal, and is located between the display panel and the housing Behind the formed gap, the displacement component is connected to the camera for driving the camera to move in the vertical direction of the gap; the method includes:

Driving the camera to move to the first edge of the slit in the vertical direction of the slit, and framing the first shooting area through the slit;

Driving the camera to move in the vertical direction of the slit to the second edge of the slit opposite to the first edge, and framing the second shooting area through the slit;

Stitching the framing image of the first shooting area and the framing image of the second shooting area to form a shooting framing image.
The method according to claim 4, wherein before driving the camera to move to the first edge of the slit in the vertical direction of the slit, further comprising:

When the camera is initialized, the position information of the first edge and the second edge of the gap is collected;

A coordinate axis is established according to the collected position information, wherein the extending direction of the slit is the X axis, the vertical direction of the slit is the Y axis, and the viewing direction is the Z axis.
The method according to claim 5, wherein after establishing the coordinate axis according to the collected position information, further comprising:

Calculating the position of the midline between the first edge and the second edge according to the established coordinate axis;

Driving the camera to move to the centerline position along the Y axis, and focusing the camera.
The method according to claim 4, wherein stitching the framing image of the first photographing area and the framing image of the second photographing area to form a photographing framing image includes:

Extracting feature points in the framing image of the first shooting area and the framing image of the second shooting area, respectively;

Stitching the framing image of the first shooting area and the framing image of the second shooting area into the captured framing image according to the extracted feature points;

Proportional selection of the captured viewfinder image according to a preset display ratio.
The method according to claim 4, wherein after stitching the framing image of the first photographing area and the framing image of the second photographing area to form a photographed framing image, further comprising:

The captured viewfinder image is stored as a captured image.
The method according to claim 4, wherein at least a group of the first shooting area framing operation, the second shooting area framing operation, and the framing image stitching operation are completed at least within one refresh period of the camera.
A storage medium, wherein a computer program is stored in the storage medium, wherein the computer program is configured to execute the method described in any one of claims 4 to 9 when it is run.
An electronic device includes a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute any one of claims 4 to 9. method.