CN112383700B - Display device and control method thereof - Google Patents
Display device and control method thereof Download PDFInfo
- Publication number
- CN112383700B CN112383700B CN202011088554.3A CN202011088554A CN112383700B CN 112383700 B CN112383700 B CN 112383700B CN 202011088554 A CN202011088554 A CN 202011088554A CN 112383700 B CN112383700 B CN 112383700B
- Authority
- CN
- China
- Prior art keywords
- screen area
- display
- camera
- auxiliary screen
- auxiliary
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1431—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0266—Details of the structure or mounting of specific components for a display module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention provides a display device and a control method thereof. The display device comprises a display panel and a camera module. The display panel comprises a main screen area, a first auxiliary screen area and a second auxiliary screen area; the camera module is arranged below the display panel and corresponds to the first secondary screen area and the second secondary screen area in position; in the process of collecting images by using the camera module, controlling the first secondary screen area and the second secondary screen area to alternately be in a non-display state at a preset time interval; after the first auxiliary screen area is in a non-display state, controlling the camera module to acquire an image through the first auxiliary screen area, and controlling the main screen area and the second auxiliary screen area to normally display the image acquired by the camera module; and after the second auxiliary screen area is in a non-display state, the camera module is controlled to collect images through the second auxiliary screen area, and the main screen area and the first auxiliary screen area are controlled to normally display the images collected by the camera module. The invention can ensure that the full screen can still synchronously and normally display images when the camera device under the screen is used for collecting the images, and can ensure that the algorithm time of the camera device is sufficient.
Description
Technical Field
The present invention relates to the field of display technologies, and in particular, to a display device and a control method thereof.
Background
In the field of electronic device terminals with display devices, currently, a display panel is required to have a screen ratio as large as possible to enhance user experience. For a smart phone with a comprehensive screen concept, various optical sensing elements such as front-facing camera shooting, face recognition, fingerprint recognition and the like are expected to be integrated into a screen, so that the effect of a 'full screen' that the screen occupies the front panel of the whole phone is achieved.
One implementation method in the prior art is to dispose the optical sensing element (such as a front camera) below a display screen, and open a slot or a hole at a position on the display screen corresponding to the optical sensing device, but these slotted or holed areas cannot normally display a picture, resulting in poor user experience.
In the prior art, a transparent display area is arranged in a display screen area corresponding to an optical sensing element, and the optical sensing element is arranged below the transparent display area, so that the optical sensing element such as a front camera is integrated into the display area of the screen on the premise that the screen appearance is complete and the display picture is not incomplete, thereby improving the screen occupation ratio and realizing a real full screen.
However, the above full-screen scheme in the prior art cannot utilize the off-screen camera to photograph or shoot video without being affected by the screen in the normal preview display state, that is, cannot synchronously perform full-screen display when the off-screen camera is used to photograph or shoot video. Especially in the video acquisition state, the conventional sampling frequency needs 30Hz (namely 30 frames per second), a pause phenomenon exists when the frequency is too low, and the algorithm time is insufficient when the frequency is too high. Therefore, under the condition of ensuring the video sampling frequency, the technology problem of reserving enough algorithm time is also solved.
Disclosure of Invention
In view of the above, the present invention provides a display device and a control method thereof, so that the full-screen can still synchronously and normally display images when the camera under the screen is used for capturing images.
The invention provides a display device which comprises a display panel, a camera module and a control module. The display panel comprises a main screen area, a first auxiliary screen area and a second auxiliary screen area; the camera module is arranged below the display panel and corresponds to the first auxiliary screen area and the second auxiliary screen area in position; the control module is used for controlling the display panel and the camera module, and the display panel is used for displaying the image acquired by the camera module; in the process of collecting images by using the camera module, the control module controls the first secondary screen area and the second secondary screen area to alternately be in a non-display state at a preset time interval; after the first auxiliary screen area is in a non-display state, the control module controls the camera module to acquire images through the first auxiliary screen area, and the control module controls the main screen area and the second auxiliary screen area to normally display the images acquired by the camera module; after the second auxiliary screen area is in a non-display state, the control module controls the camera module to collect images through the second auxiliary screen area, and the control module controls the main screen area and the first auxiliary screen area to normally display the images collected by the camera module.
The first auxiliary screen area and the second auxiliary screen area are respectively connected with the main screen area or in seamless connection with the main screen area; preferably, the first auxiliary screen area and the second auxiliary screen area are integrally formed with the main screen area. The first secondary screen area and the second secondary screen area are transparent display areas, and display states or non-display states are presented according to instructions of the control module. When the first secondary screen area and/or the second secondary screen area are in a non-display state, the camera module can capture incident light penetrating through the display surface of the display panel without being influenced by the display luminous pixels.
Preferably, the camera module includes a single camera, the position of the single camera corresponds to the first secondary screen area and the second secondary screen area at the same time, and the single camera collects images modulated by the first secondary screen area and the second secondary screen area at a preset time interval.
Furthermore, after the first auxiliary screen area is in a non-display state, the control module controls the single camera to acquire a first image through the first auxiliary screen area; after the second auxiliary screen area is in a non-display state, the control module controls the single camera to acquire a second image through the second auxiliary screen area; the image synthesized by the first image and the second image corresponds to the image collected by the camera module.
Preferably, the camera module includes a first camera whose position corresponds to the first secondary screen area and a second camera whose position corresponds to the second secondary screen area, and the first camera and the second camera alternately capture images at preset time intervals.
Furthermore, after the first auxiliary screen area is in a non-display state, the control module controls the first camera to collect images through the first auxiliary screen area, and the control module controls the main screen area and the second auxiliary screen area to normally display the images collected by the first camera; after the second auxiliary screen area is in a non-display state, the control module controls the second camera to penetrate through the second auxiliary screen area to collect images, and the control module controls the main screen area and the first auxiliary screen area to normally display the images collected by the second camera.
Preferably, the light transmittance of the main screen area in the display panel is less than the light transmittance of the first auxiliary screen area and/or the second auxiliary screen area. The main screen area of the display panel is an AMOLED display screen, and the first auxiliary screen area and/or the second auxiliary screen area is/are a PMOLED display screen.
Preferably, the predetermined time interval is negatively related to the refresh frequency of the display panel.
The invention also provides a control method of the display device, the display device comprises a display panel and a camera module, the display panel comprises a main screen area, a first auxiliary screen area and a second auxiliary screen area, the first auxiliary screen area and the second auxiliary screen area are respectively connected with the main screen area, the camera module is arranged below the display panel and corresponds to the first auxiliary screen area and the second auxiliary screen area in position, and the display panel is used for displaying images acquired by the camera module. The control method comprises the following steps: in the process of collecting images by using the camera module, controlling the first secondary screen area and the second secondary screen area to alternately be in a non-display state at a preset time interval; after the first auxiliary screen area is in a non-display state, controlling the camera module to acquire an image through the first auxiliary screen area, and controlling the main screen area and the second auxiliary screen area to normally display the image acquired by the camera module; and after the second auxiliary screen area is in a non-display state, controlling the camera module to collect images through the second auxiliary screen area, and controlling the main screen area and the first auxiliary screen area to normally display the images collected by the camera module.
Preferably, the camera module comprises a single camera, and the position of the single camera corresponds to the first secondary screen area and the second secondary screen area simultaneously; the control method further comprises the following steps: after the first auxiliary screen area is in a non-display state, controlling the single camera to acquire a first image through the first auxiliary screen area, and controlling the main screen area and the second auxiliary screen area to normally display the first image acquired by the single camera; after the second auxiliary screen area is in a non-display state, controlling the single camera to acquire a second image through the second auxiliary screen area, and controlling the main screen area and the first auxiliary screen area to normally display the second image acquired by the single camera; the image synthesized by the first image and the second image corresponds to the complete image collected by the camera module.
Preferably, the camera module comprises a first camera with a position corresponding to the first secondary screen area and a second camera with a position corresponding to the second secondary screen area; the control method further comprises the following steps: after the first auxiliary screen area is in a non-display state, controlling the first camera to acquire an image through the first auxiliary screen area, and controlling the main screen area and the second auxiliary screen area to normally display the image acquired by the first camera; and after the second auxiliary screen area is in a non-display state, controlling the second camera to collect images through the second auxiliary screen area, and controlling the main screen area and the first auxiliary screen area to normally display the images collected by the second camera.
Compared with the prior art, the display device and the control method thereof have the advantages that the camera module is arranged below the display panel and corresponds to the first auxiliary screen area and the second auxiliary screen area in the non-display state, so that the complete appearance and normal display of the screen are ensured, and the normal shooting of the camera module can be met; moreover, the camera module can ensure sufficient algorithm time of the camera device on the premise of meeting the display refreshing frequency and the video sampling frequency by using a mode of modulating or alternatively collecting images.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic view of a display device according to an embodiment of the invention.
Fig. 2 is a schematic view of a display device according to another embodiment of the invention.
Fig. 3 is a schematic diagram of a display device according to another embodiment of the present invention.
Fig. 4 is a schematic view of a display device according to another embodiment of the invention.
Fig. 5 is a schematic diagram of a display device according to another embodiment of the present invention.
Fig. 6 is a flowchart illustrating a control method of a display device according to an embodiment of the invention.
Fig. 7 is a flowchart illustrating a control method of a display device according to another embodiment of the invention.
Fig. 8 is a flowchart illustrating a control method of a display device according to another embodiment of the invention.
Detailed Description
In order to further understand the objects, structures, features and functions of the present invention, the following embodiments are described in detail.
The display device can be various electronic equipment such as a smart phone, a tablet personal computer, a television, a display screen module and the like.
Referring to fig. 1, fig. 1 is a schematic view of a display device 100 according to an embodiment of the invention. A display device 100 includes a display panel 1, a camera module 2, and a control module 3.
The display panel 1 includes a main screen area 10, a first sub screen area 11 and a second sub screen area 12, and the first sub screen area 11 and the second sub screen area 12 are respectively connected with the main screen area 10. Preferably, the main screen area 10, the first sub-screen area 11 and the second sub-screen area 12 may be different display areas adjacently disposed on the same display screen; alternatively, the main screen area 10, the first sub-screen area 11, and the second sub-screen area 12 may be a plurality of display screens arranged adjacently, and the display panel 1 is formed by splicing the display screens according to the prior art.
The camera module 2 is disposed below the display panel 1 and corresponds to the first sub-screen area 11 and the second sub-screen area 12. Preferably, the first secondary screen area 11 and the second secondary screen area 12 are located in the primary screen area 10, and the effective display areas of the first secondary screen area 11 and the second secondary screen area 12 are equal and smaller than the effective display area of the primary screen area 10. Conventionally, the first sub-screen region 11 and the second sub-screen region 12 are disposed at a top middle portion or an edge portion of the main screen region 10, but the invention is not limited thereto.
The control module 3 is used for controlling the display panel 1 and the camera module 2, and the display panel 1 is used for displaying the image collected by the camera module 2. Preferably, the display panel 1 may be provided with a touch function, i.e. the display panel 1 is integrated with or covered with a touch panel on which the camera module 2 can be turned on or off by an operation. The control module 3 may correspond to an integrated or discrete plurality of drive control circuits or chip sets.
In the process of acquiring images by using the camera module 2, the control module 3 controls the first secondary screen area 11 and the second secondary screen area 12 to alternately be in a non-display state at preset time intervals. The camera module 2 can shoot the external scenery in front of the display panel 1 through the first secondary screen area 11 or the second secondary screen area 12 in the non-display state, and it should be noted that the non-display state is not limited to 100% transparency, as long as the image acquisition of the camera module 2 is not affected.
After the first secondary screen area 11 is in a non-display state, the control module 3 controls the camera module 2 to collect images through the first secondary screen area 11, and the control module 3 controls the main screen area 10 and the second secondary screen area 12 to normally display the images collected by the camera module 2. It should be noted that, when the display area of the second sub-screen region 12 is much smaller than the display area of the main screen region 10, the main screen region 10 and the second sub-screen region 12 can be considered to mainly display the image by the main screen region 10, and the second sub-screen region 12 can be considered to display the image by assistance, such as only providing a backlight or a monochrome image.
After the second secondary screen area 12 is in a non-display state, the control module 3 controls the camera module 2 to capture an image through the second secondary screen area 12, and the control module 3 controls the main screen area 10 and the first secondary screen area 11 to normally display the image captured by the camera module 2. It should be noted that, when the display area of the first sub-screen area 11 is much smaller than the display area of the main screen area 10, the main screen area 10 and the first sub-screen area 11 can be considered as mainly displaying the image by the main screen area 10, and the first sub-screen area 11 can be used for auxiliary display, such as only providing a backlight or a monochrome image.
Preferably, the main screen area 10 is a first display screen, the first sub-screen area 11 and the second sub-screen area 12 are second display screens, and the transparency of the second display screens is not lower than that of the first display screens. In practical applications, the first display screen may be an AMOLED (active matrix organic light emitting diode) display screen, and the second display screen is a PMOLED (passive matrix organic light emitting diode) display screen or a high-transparency AMOLED display screen, so as to ensure a display effect and reduce an influence on the under-screen image capturing device. The prior art related to the transparent display screen can be referred to chinese patents CN207781599U, CN110767099A, etc., and all the technical means mentioned in these prior arts can be used in the present invention, and therefore, are not described herein again.
Preferably, the preset time interval is related to the refresh frequency of the display panel 1. For example, the refresh frequency of the display panel 1 is 60Hz, and the preset time interval may be set to 1/60 seconds (i.e. 16.7 milliseconds), i.e. the preset time interval is equal to the inverse of the refresh frequency of the display panel 1 (or the interval of one frame). Of course, the preset time interval may also be set shorter, such as 1/75, 1/120 seconds, and preferably corresponds to the inverse of the refresh frequency of the display panel 1 (i.e., the time interval of each frame of the picture). In addition, since the sampling frequency of the camera module 2 is normally 30Hz (i.e. 30 frames per second), the frames are sufficiently consecutive, and when the display panel 1 can be set to a higher refresh frequency (e.g. 90Hz, 120 Hz), the preset time interval can also correspond to the time interval of multiple frames, as long as smooth image display and image acquisition can be ensured.
Taking the display panel 1 as an example with a refresh frequency of 60Hz, when the camera module 2 is used to capture an image, the control module 3 controls the camera module 2 to start, first, the first secondary screen area 11 is turned off to display (i.e. to be in a non-display state), at this time, the camera module 2 captures an image through the first secondary screen area 11, and simultaneously, the main screen area 10 and the second secondary screen area 12 normally display the image captured by the camera module 2 to form a first frame of image of the display panel 1, after the preset time interval (e.g. 1/60 seconds), the second secondary screen area 12 is turned off to display (i.e. to be in a non-display state), at this time, the camera module 2 captures an image through the second secondary screen area 12, and simultaneously, the main screen area 10 and the first secondary screen area 11 normally display the image captured by the camera module 2 to form a second frame of image of the display panel 1, and after the preset time interval (e.g. 1/60 seconds), and continuously and repeatedly executing the steps to form images of a third frame, a fourth frame and the like, and repeating the steps until the image does not need to be acquired by the camera module 2 any more. Although theoretically, the more the number of frames per second, the smoother the picture is, as long as the sampling frequency of the camera module 2 is well matched with the refreshing frequency of the display panel 1, the picture seen by the user through the display panel 1 will be a complete and smooth shooting preview picture corresponding to the camera module 2, so that the full-screen display of the preview picture can be synchronously performed when the camera module under the screen is used for shooting or shooting videos.
Referring to fig. 2, fig. 2 is a schematic view of a display device 200 according to another embodiment of the invention. Elements corresponding to the above embodiments are denoted by the same reference numerals in the present embodiment, in the display device 200 of the present embodiment, the camera module 2 includes a single camera 20, the position of the single camera 20 corresponds to both the first secondary screen area 11 and the second secondary screen area 12, and the single camera 20 is modulated by the first secondary screen area 11 and the second secondary screen area 12 to capture images at the preset time interval.
Referring to fig. 3, fig. 3 is a schematic diagram of a display device 200 according to another embodiment of the invention. After the first secondary screen area 11 is in the non-display state (at this time, the second secondary screen area 12 can be used for normal display, so that the second secondary screen area is generally in the non-display state), the control module 3 controls the single camera 20 to acquire a first image through the first secondary screen area 11; after the second sub-screen area 12 is in the non-display state (at this time, the first sub-screen area 11 can be used for normal display, and therefore is generally in the non-display state), the control module 3 controls the single camera 20 to acquire a second image through the second sub-screen area 12; the image synthesized by the first image and the second image corresponds to the complete image collected by the camera module 2. Due to the effect of persistence of vision of human eyes, when the user views the picture displayed on the display panel 1, the user still sees a complete image composed of the first image and the second image, and the transient non-display state of the first sub-screen region 11 or the second sub-screen region 12 is hardly observed, i.e., the integrity of the preview picture is not destroyed. The complete image may be directly synthesized by the first image and the second image, or may be synthesized by a known image processing technique, which is not limited by the invention.
In this embodiment, preferably, the first secondary screen area 11 and the second secondary screen area 12 are two adjacent display areas on the same display screen, the first secondary screen area 11 is a half of the display area (the right half area shown in fig. 3) on the same display screen, and the second secondary screen area 12 is the other half of the display area (the left half area shown in fig. 3) on the same display screen. After the first secondary screen area 11 is in the non-display state, the single camera 20 acquires a first image (such as the right half image shown in fig. 3) through the first secondary screen area 11, and at this time, the left half of the single camera 20 is shielded by the second secondary screen area 12 in the non-display state; after the second sub-screen area 12 is in the non-display state, the single camera 20 acquires a second image (e.g., the left half image shown in fig. 3) through the second sub-screen area 12, and at this time, the right half part of the single camera 20 is shielded by the first sub-screen area 11 in the non-display state; since the predetermined time interval corresponds to the refresh rate of the display panel 1, the image composed of the first image and the second image may present a complete image that the single camera 20 should capture.
Referring to fig. 4, fig. 4 is a schematic view of a display device 300 according to another embodiment of the invention. Elements corresponding to the above-mentioned embodiments are denoted by the same reference numerals in the present embodiment, in the display device 300 according to the present embodiment, the camera module 2 includes a first camera 21 corresponding to the first sub-screen area 11 and a second camera 22 corresponding to the second sub-screen area 12, and the first camera 21 and the second camera 22 alternately capture images at the preset time interval.
Referring to fig. 5, fig. 5 is a schematic diagram of a display device 300 according to another embodiment of the present invention. After the first secondary screen area 11 is in a non-display state (at this time, the second secondary screen area 12 can be used for normal display, and therefore is generally in a non-display state), the control module 3 controls the first camera 21 to acquire an image through the first secondary screen area 11, and the control module 3 controls the main screen area 10 and the second secondary screen area 12 to normally display the image acquired by the first camera 21; after the second secondary screen area 12 is in the non-display state (at this time, the first secondary screen area 11 can be used for normal display, so it is generally in the non-display state), the control module 3 controls the second camera 22 to collect images through the second secondary screen area 12, and the control module 3 controls the main screen area 10 and the first secondary screen area 11 to normally display images collected by the second camera 22. Due to the effect of persistence of vision of human eyes, when a user observes a picture displayed on the display panel 1, the transient non-display state of the first sub-screen region 11 or the second sub-screen region 12 is hardly observed, i.e., the integrity of the preview picture is not destroyed.
Preferably, the first camera 21 and the second camera 22 have the same specification and are located close to each other. In the process of acquiring images by using the camera module 2, the first camera 21 and the second camera 22 can both shoot each complete frame of image, and the distance between the two is short, so each frame of image can be directly used for generating a shot image or previewing display, if the difference between the two shot angles is large, the frames of image can be synthesized into a shot image or a picture for previewing display by using the known image processing technology, and the invention is not limited thereto.
In the above another embodiment, the two cameras (or more cameras) are equivalent to time-changing in space, and image acquisition is alternately completed on the premise of ensuring full-screen display, so as to realize off-screen image capture. Taking the display refresh frequency of 60Hz as an example, image acquisition is respectively realized on two cameras, and each camera only needs a sampling frequency of 30 frames per second, so that sufficient processing time of a camera program algorithm is ensured.
Referring to fig. 6, fig. 6 is a flowchart illustrating a control method of a display device according to an embodiment of the invention. The display device comprises a display panel and a camera module, the display panel comprises a main screen area, a first auxiliary screen area and a second auxiliary screen area, the first auxiliary screen area and the second auxiliary screen area are respectively connected with the main screen area, the camera module is arranged below the display panel and at a position corresponding to the first auxiliary screen area and the second auxiliary screen area, and the display panel is used for displaying images collected by the camera module. The control method of the display device of the invention comprises the following steps:
and S1, controlling the first secondary screen area and the second secondary screen area to alternately be in a non-display state at a preset time interval in the process of acquiring the image by using the camera module.
And S2, after the first auxiliary screen area is in a non-display state, controlling the camera module to collect images through the first auxiliary screen area, and controlling the main screen area and the second auxiliary screen area to normally display the images collected by the camera module.
And S3, after the second secondary screen area is in a non-display state, controlling the camera module to penetrate through the second secondary screen area to collect images, and controlling the main screen area and the first secondary screen area to normally display the images collected by the camera module.
Referring to fig. 7 in combination, fig. 7 is a flowchart illustrating a control method of a display device according to another embodiment of the invention. In this embodiment, the camera module includes a single camera, and the position of the single camera corresponds to both the first secondary screen area and the second secondary screen area. The control method may include the steps of:
and S1, controlling the first secondary screen area and the second secondary screen area to alternately be in a non-display state at a preset time interval in the process of acquiring the image by using the camera module.
And S12, after the first secondary screen area is in a non-display state, controlling the single camera to collect a first image through the first secondary screen area, and controlling the main screen area and the second secondary screen area to normally display the first image collected by the single camera.
S13, controlling the single camera to collect a second image through the second auxiliary screen area after the second auxiliary screen area is in a non-display state, and controlling the main screen area and the first auxiliary screen area to normally display the second image collected by the single camera; wherein an image synthesized by the first image and the second image corresponds to a complete image acquired by the camera module.
Referring to fig. 8, fig. 8 is a flowchart illustrating a control method of a display device according to another embodiment of the invention. In this embodiment, the camera module includes a first camera corresponding to the first secondary screen area and a second camera corresponding to the second secondary screen area. The control method may include the steps of:
and S1, controlling the first secondary screen area and the second secondary screen area to alternately be in a non-display state at a preset time interval in the process of acquiring the image by using the camera module.
And S22, after the first auxiliary screen area is in a non-display state, controlling the first camera to penetrate through the first auxiliary screen area to collect images, and controlling the main screen area and the second auxiliary screen area to normally display the images collected by the first camera.
And S23, after the second secondary screen area is in a non-display state, controlling the second camera to penetrate through the second secondary screen area to collect images, and controlling the main screen area and the first secondary screen area to normally display the images collected by the second camera.
Based on the same or similar operation principle, the descriptions in the embodiments of the display device are also applicable to the embodiments of the control method of the display device, and therefore are not described herein again. The above control method may be implemented by an integrated or discrete control module.
According to the display device and the control method thereof, the camera module is arranged below the display panel and corresponds to the first secondary screen area and the second secondary screen area in the non-display state, so that the complete and normal display of the screen is ensured, and the normal shooting of the camera module can be met; moreover, the camera module can ensure sufficient algorithm time of the camera device on the premise of meeting the display refreshing frequency and the video sampling frequency by using a mode of modulating or alternatively collecting images.
The present invention has been described in relation to the above embodiments, which are only exemplary of the implementation of the present invention. Furthermore, the technical features mentioned in the different embodiments of the present invention described above may be combined with each other as long as they do not conflict with each other. It should be noted that the disclosed embodiments do not limit the scope of the invention. Rather, it is intended that all such modifications and variations be included within the spirit and scope of this invention.
Claims (10)
1. A display device comprises a display panel, a camera module and a control module,
the display panel comprises a main screen area, a first auxiliary screen area and a second auxiliary screen area;
the camera module is arranged on the back of the display surface of the display panel, corresponds to the first auxiliary screen area and the second auxiliary screen area in position, and is used for capturing incident light penetrating through the display surface of the first auxiliary screen area and/or the second auxiliary screen area;
the control module is used for controlling the display panel and the camera module, and the display panel is used for displaying the image acquired by the camera module;
in the process of acquiring images by using the camera module, the control module controls the first secondary screen area and the second secondary screen area to alternately present a display state or a non-display state at a preset time interval;
after the first auxiliary screen area is in a non-display state, the control module controls the camera module to acquire images through the first auxiliary screen area, and the control module controls the main screen area and the second auxiliary screen area to normally display the images acquired by the camera module;
after the second auxiliary screen area is in a non-display state, the control module controls the camera module to penetrate through the second auxiliary screen area to collect images, and the control module controls the main screen area and the first auxiliary screen area to normally display the images collected by the camera module.
2. The display device according to claim 1, wherein the camera module comprises a single camera, the single camera is positioned to cover the first and second sub-screen areas, and the single camera captures images modulated by the first and second sub-screen areas at the predetermined time interval.
3. The display device according to claim 2, wherein the control module controls the single camera to capture a first image through the first secondary screen area after the first secondary screen area is in a non-display state; after the second secondary screen area is in a non-display state, the control module controls the single camera to acquire a second image through the second secondary screen area; wherein an image synthesized by the first image and the second image corresponds to an image acquired by the camera module.
4. The display device according to claim 1, wherein the camera module comprises a first camera positioned corresponding to the first sub-screen area and a second camera positioned corresponding to the second sub-screen area, and the first camera and the second camera alternately capture images at the preset time interval.
5. The display device according to claim 4, wherein the control module controls the first camera to capture an image through the first secondary screen area after the first secondary screen area is in a non-display state, and the control module controls the main screen area and the second secondary screen area to normally display the image captured by the first camera; after the second auxiliary screen area is in a non-display state, the control module controls the second camera to penetrate through the second auxiliary screen area to collect images, and the control module controls the main screen area and the first auxiliary screen area to normally display the images collected by the second camera.
6. The display device according to claim 1, wherein the light transmittance of the main panel region in the display panel is smaller than the light transmittance of the first sub-panel region and/or the second sub-panel region.
7. The display device of claim 1, wherein the main screen area of the display panel is an AMOLED display screen, and the first and/or second sub-screen areas are PMOLED display screens.
8. The display device of claim 1, wherein the preset time interval is inversely related to a refresh frequency of the display panel.
9. A control method of a display device comprises the display panel and a camera module, and is characterized in that the display panel comprises a main screen area, a first auxiliary screen area and a second auxiliary screen area, the camera module is arranged on the back of the display surface of the display panel and corresponds to the first auxiliary screen area and the second auxiliary screen area in position, and the display panel is used for displaying images acquired by the camera module; the control method comprises the following steps:
in the process of collecting images by using the camera module, controlling the first secondary screen area and the second secondary screen area to alternately be in a non-display state at a preset time interval;
after the first auxiliary screen area is in a non-display state, controlling the camera module to acquire an image through the first auxiliary screen area, and controlling the main screen area and the second auxiliary screen area to normally display the image acquired by the camera module;
and after the second auxiliary screen area is in a non-display state, controlling the camera module to penetrate through the second auxiliary screen area to collect images, and controlling the main screen area and the first auxiliary screen area to normally display the images collected by the camera module.
10. The control method according to claim 9,
the camera module comprises a single camera, and the position of the single camera covers the first auxiliary screen area and the second auxiliary screen area; the control method further comprises the following steps: after the first auxiliary screen area is in a non-display state, controlling the single camera to collect a first image through the first auxiliary screen area, and controlling the main screen area and the second auxiliary screen area to normally display the first image collected by the single camera; after the second auxiliary screen area is in a non-display state, controlling the single camera to acquire a second image through the second auxiliary screen area, and controlling the main screen area and the first auxiliary screen area to normally display the second image acquired by the single camera; wherein an image synthesized by the first image and the second image corresponds to a complete image acquired by the camera module; or
The camera module comprises a first camera with a position corresponding to the first auxiliary screen area and a second camera with a position corresponding to the second auxiliary screen area; the control method further comprises the following steps: after the first auxiliary screen area is in a non-display state, controlling the first camera to collect images through the first auxiliary screen area, and controlling the main screen area and the second auxiliary screen area to normally display the images collected by the first camera; and after the second auxiliary screen area is in a non-display state, controlling the second camera to penetrate through the second auxiliary screen area to collect images, and controlling the main screen area and the first auxiliary screen area to normally display the images collected by the second camera.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011088554.3A CN112383700B (en) | 2020-10-13 | 2020-10-13 | Display device and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011088554.3A CN112383700B (en) | 2020-10-13 | 2020-10-13 | Display device and control method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112383700A CN112383700A (en) | 2021-02-19 |
| CN112383700B true CN112383700B (en) | 2021-10-22 |
Family
ID=74581387
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011088554.3A Active CN112383700B (en) | 2020-10-13 | 2020-10-13 | Display device and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112383700B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113077757A (en) * | 2021-03-09 | 2021-07-06 | 武汉华星光电半导体显示技术有限公司 | Camera control method and device for electronic equipment, electronic equipment and storage medium |
| CN115278027B (en) * | 2022-07-28 | 2024-04-23 | 联想(北京)有限公司 | Display control method and device |
| CN116030716A (en) * | 2022-10-31 | 2023-04-28 | 武汉天马微电子有限公司 | Display device |
| JP7474304B1 (en) | 2022-11-25 | 2024-04-24 | レノボ・シンガポール・プライベート・リミテッド | Display system, electronic device, and calibration method |
| JP7474305B1 (en) | 2022-11-25 | 2024-04-24 | レノボ・シンガポール・プライベート・リミテッド | Display system, electronic device, and control method |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108600472A (en) * | 2018-07-18 | 2018-09-28 | 苏州天为幕烟花科技有限公司 | A kind of mobile phone of the complementary realization of dot matrix shields technology comprehensively |
| CN109348011A (en) * | 2018-11-16 | 2019-02-15 | Oppo广东移动通信有限公司 | Electronic device and its control method and control device |
| CN110275342A (en) * | 2019-07-04 | 2019-09-24 | 惠州市华星光电技术有限公司 | Display panel and electronic equipment |
| CN111261680A (en) * | 2020-01-20 | 2020-06-09 | 京东方科技集团股份有限公司 | Display panel and display device |
| CN111292617A (en) * | 2020-02-27 | 2020-06-16 | 昆山国显光电有限公司 | Display panel and display device |
| CN111385465A (en) * | 2018-12-29 | 2020-07-07 | 北京小米移动软件有限公司 | Auxiliary screen display control method and device, electronic equipment and machine readable storage medium |
| WO2020186375A1 (en) * | 2019-03-15 | 2020-09-24 | 深圳柔宇显示技术有限公司 | Display device, terminal and photographing method |
| WO2020192336A1 (en) * | 2019-03-28 | 2020-10-01 | 宁波舜宇光电信息有限公司 | Under-display camera assembly and corresponding terminal device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2552090B (en) * | 2017-06-29 | 2021-06-16 | Inodyn Newmedia Gmbh | Front-facing camera and maximized display screen of a mobile device |
-
2020
- 2020-10-13 CN CN202011088554.3A patent/CN112383700B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108600472A (en) * | 2018-07-18 | 2018-09-28 | 苏州天为幕烟花科技有限公司 | A kind of mobile phone of the complementary realization of dot matrix shields technology comprehensively |
| CN109348011A (en) * | 2018-11-16 | 2019-02-15 | Oppo广东移动通信有限公司 | Electronic device and its control method and control device |
| CN111385465A (en) * | 2018-12-29 | 2020-07-07 | 北京小米移动软件有限公司 | Auxiliary screen display control method and device, electronic equipment and machine readable storage medium |
| WO2020186375A1 (en) * | 2019-03-15 | 2020-09-24 | 深圳柔宇显示技术有限公司 | Display device, terminal and photographing method |
| WO2020192336A1 (en) * | 2019-03-28 | 2020-10-01 | 宁波舜宇光电信息有限公司 | Under-display camera assembly and corresponding terminal device |
| CN110275342A (en) * | 2019-07-04 | 2019-09-24 | 惠州市华星光电技术有限公司 | Display panel and electronic equipment |
| CN111261680A (en) * | 2020-01-20 | 2020-06-09 | 京东方科技集团股份有限公司 | Display panel and display device |
| CN111292617A (en) * | 2020-02-27 | 2020-06-16 | 昆山国显光电有限公司 | Display panel and display device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112383700A (en) | 2021-02-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112383700B (en) | Display device and control method thereof | |
| US11650633B2 (en) | Display panel and display apparatus | |
| US11120726B2 (en) | Method and device for driving display panel, and display apparatus | |
| CN105992987B (en) | Camera included in display | |
| DE102018005130A1 (en) | Mobile device with front camera and method for maximizing the usable screen area | |
| EP3076653B1 (en) | Display device and shooting display method therefor | |
| KR20140054959A (en) | Method for controlling camera of terminal and terminal thereof | |
| CN110047386A (en) | Display device and electronic equipment | |
| CN108597469B (en) | A kind of method, display device and detection device for eliminating black surround | |
| EP4175280A1 (en) | Image photographing method and electronic device | |
| US10235586B2 (en) | Image processing system capable of executing operation by recognizing information encoding pattern and image displayed alternately and related method | |
| KR20240004839A (en) | Filming methods, devices and electronics | |
| CN101569241A (en) | System, method, computer-readable medium, and user interface for displaying light radiation | |
| WO2016033925A1 (en) | Display method and display device | |
| CN114581583A (en) | Image processing method, device and storage medium | |
| CN105549205A (en) | Display device and display control method | |
| US20140218402A1 (en) | Apparatus and Method to Display Images Protected From Capture | |
| CN111885286B (en) | Display screen and display device | |
| CN111327795B (en) | Terminal, shooting method, storage medium and electronic device | |
| CN113965687A (en) | Shooting method and device and electronic equipment | |
| CN113077757A (en) | Camera control method and device for electronic equipment, electronic equipment and storage medium | |
| CN112738306A (en) | Electronic device and control method of electronic device | |
| CN217405431U (en) | Transparent display screen and display device | |
| CN111800530A (en) | Display device and electronic device | |
| JP2000152205A (en) | Image pickup and display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |