CN115542639A - Under-screen camera shooting display device and control method thereof, controller and terminal equipment - Google Patents

Under-screen camera shooting display device and control method thereof, controller and terminal equipment Download PDF

Info

Publication number
CN115542639A
CN115542639A CN202110656845.6A CN202110656845A CN115542639A CN 115542639 A CN115542639 A CN 115542639A CN 202110656845 A CN202110656845 A CN 202110656845A CN 115542639 A CN115542639 A CN 115542639A
Authority
CN
China
Prior art keywords
display
module
display module
camera
screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110656845.6A
Other languages
Chinese (zh)
Inventor
王彦彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN202110656845.6A priority Critical patent/CN115542639A/en
Priority to PCT/CN2022/088861 priority patent/WO2022257622A1/en
Publication of CN115542639A publication Critical patent/CN115542639A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/02Bodies
    • G03B17/17Bodies with reflectors arranged in beam forming the photographic image, e.g. for reducing dimensions of camera
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B30/00Camera modules comprising integrated lens units and imaging units, specially adapted for being embedded in other devices, e.g. mobile phones or vehicles
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1407General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)

Abstract

The embodiment of the invention discloses an off-screen camera display device and a control method thereof, a controller and terminal equipment, wherein the off-screen camera display device comprises: the first display module comprises a light transmitting layer and a display layer, wherein the light transmitting layer is positioned on one side of the display layer, the display layer is provided with a notch, and the light transmitting layer is provided with a transmission display area corresponding to the notch; the second display module is positioned on the other side of the display layer and staggered with the notch; the camera module is positioned on the other side of the display layer; the optical component is located between the camera module and the first display module, the second display module faces the optical component, the optical component is used for reflecting the display information of the second display module to the transmission display area, and the optical component is also used for transmitting the light penetrating through the transmission display area to the camera module. Through the device, the shooting effect and the screen display effect of the camera terminal equipment under the screen can be improved, so that the screen occupation ratio of the comprehensive screen terminal is improved, and the use experience of a user is optimized.

Description

Under-screen camera display device and control method thereof, controller and terminal equipment
Technical Field
The embodiment of the invention relates to the technical field of terminals, in particular to an off-screen camera display device, terminal equipment, a control method of the off-screen camera display device, a controller and a computer readable storage medium.
Background
With the wider application scene of the front-end camera and the more and more popular use of the full-screen terminal, how to set the front-end camera module to enable the screen of the full-screen terminal to have a higher occupation ratio becomes an important subject of the technical development of the terminal. Some terminals that have now set the screen to the water droplet screen comprehensively, punch the screen etc. in order to place the module of making a video recording, some terminals utilize mechanical structure to hide the module of making a video recording inside the cell-phone and slide out again in needs, but the screen of water droplet screen and the screen that punches accounts for than still having the space that rises, and the mechanical mechanism of transferring many times then makes equipment fragile. In addition, some terminals will make a video recording the module and place the below region of comprehensive screen, but because the shooting of the module of making a video recording has higher printing opacity requirement, this kind of mode not only makes on the full screen correspond regional screen display module's pixel with the module of making a video recording and reduces by a wide margin, influences this regional screen display effect, and it is lower still to make the module of making a video recording correspond regional luminousness, influences the shooting effect of the module of making a video recording to greatly influence user's use and experience.
Disclosure of Invention
The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.
The invention provides an off-screen camera display device, a terminal device, a control method of the off-screen camera display device, a controller and a computer readable storage medium, which can improve the shooting effect and the screen display effect of the off-screen camera terminal device, thereby improving the screen occupation ratio of a comprehensive screen terminal and optimizing the use experience of a user.
In a first aspect, an embodiment of the present invention provides an off-screen camera display device, including: the first display module comprises a light-transmitting layer and a display layer, wherein the light-transmitting layer is positioned on one side of the display layer, the display layer is provided with a notch, and the light-transmitting layer is provided with a transmission display area corresponding to the notch; the second display module is positioned on the other side of the display layer and staggered with the notch; the camera module is positioned on the other side of the display layer; the optical component is positioned between the camera module and the first display module, the second display module faces the optical component, the optical component is used for reflecting the display information of the second display module to the transmission display area, and the optical component is also used for transmitting the light penetrating through the transmission display area to the camera module.
In a second aspect, an embodiment of the present invention further provides a terminal device, where the terminal device includes the under-screen image capture and display apparatus according to the embodiment of the first aspect.
In a third aspect, an embodiment of the present invention further provides a control method for an off-screen camera display device, which is applied to a controller of the off-screen camera display device, where the off-screen camera display device further includes a first display module, a second display module, a camera module, and an optical component, where the first display module includes a light-transmitting layer and a display layer, the light-transmitting layer is located on one side of the display layer, the display layer is provided with a notch, the light-transmitting layer is provided with a transmissive display area corresponding to the notch, the second display module is located on the other side of the display layer and is staggered from the notch, the camera module is located on the other side of the display layer, the optical component is located between the camera module and the first display module, and the second display module faces the optical component;
the control method comprises the following steps:
acquiring the working state of the camera module;
and under the condition that the working state is the closed state, when a driving instruction of the first display module and the second display module is obtained, the first display module is controlled to work, and the second display module is controlled to work, so that the optical component reflects the display information of the second display module to the transmission display area.
In a fourth aspect, an embodiment of the present invention further provides a controller, where the controller includes: a memory, a processor and a computer program stored on the memory and executable on the processor, the processor executing the computer program to perform the method of controlling an off-screen image display device according to the third aspect.
In a fifth aspect, the present invention further provides a computer-readable storage medium storing computer-executable instructions for causing a computer to execute the method for controlling an underscreen imaging display apparatus according to the third aspect.
The embodiment of the invention comprises the following steps: the under-screen camera shooting display device comprises a first display module, a second display module, a camera shooting module and an optical component, wherein the first display module comprises a light transmitting layer and a display layer, the light transmitting layer is positioned on one side of the display layer, the display layer is provided with a notch, and the light transmitting layer is provided with a transmission display area corresponding to the notch; the second display module is positioned on the other side of the display layer and staggered with the notch; the camera module is positioned on the other side of the display layer; optical component is located between the module of making a video recording and the first display module assembly, and the second display module assembly is towards optical component, and optical component is used for reflecting the display information of second display module assembly to the transmission display area, and optical component still is used for the light transmission that will see through the transmission display area to the module of making a video recording. In the embodiment of the invention, when the camera shooting module is in an open state, the optical component transmits the light rays penetrating through the transmission display area to the camera shooting module; when the camera module is in a closed state, the first display module and the second display module are in a working state, and the optical component reflects the display information of the second display module to the transmission display area. According to the technical scheme of the embodiment of the invention, when the under-screen camera shooting technology is applied, the shooting effect of the camera shooting module and the display effect of the screen display module can be improved without reducing the display pixels or the light transmittance of the screen display module, so that the feasibility of the under-screen camera shooting scheme is higher, the screen occupation ratio of a comprehensive screen terminal is improved, and the use experience of a user is optimized.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the present invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and do not constitute a limitation thereof.
Fig. 1 is a schematic structural diagram of an off-screen camera display device according to an embodiment of the present invention;
fig. 2 is a schematic view of a part of the structure of an under-screen camera display device according to another embodiment of the present invention;
FIG. 3 is a schematic diagram of the structure of an optical component of one embodiment of the present invention;
FIG. 4 is a schematic view of another perspective of an optical component according to another embodiment of the present invention;
FIG. 5 is a schematic diagram of the reflection of an under-screen camera display device according to another embodiment of the present invention;
FIG. 6 is a schematic diagram of the reflection of an under-screen camera display device according to another embodiment of the present invention;
fig. 7 is a schematic diagram of a system architecture platform of a control method for an off-screen camera display device according to an embodiment of the present invention;
FIG. 8 is a flowchart illustrating the steps of a method for controlling an off-screen camera display device according to an embodiment of the present invention;
fig. 9 is a flowchart illustrating steps of a method for controlling an off-screen image display apparatus according to another embodiment of the present invention;
fig. 10 is a flowchart illustrating steps of a method for controlling an off-screen image capture and display device according to another embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and do not limit the invention.
It should be noted that although functional blocks are partitioned in a schematic diagram of an apparatus and a logical order is shown in a flowchart, in some cases, the steps shown or described may be performed in a different order than the partitioning of blocks in the apparatus or the order in the flowchart. The terms "first," "second," and the like in the description, in the claims, or in the foregoing drawings, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
With the popularization of 5G mobile phones as fashionable fast-selling electronic products in the market and the popularity of applications such as short videos and WeChat videos, more and more scenes are shot by the aid of front cameras. At present, for the sake of aesthetic appearance, how to set a front camera module to make the screen ratio of the full screen terminal higher becomes an important issue for the development of terminal technology. However, in reality, the layout of the front camera is required to be considered in high screen occupation ratio, the existing terminals set the comprehensive screen into a water drop screen, a perforated screen and the like so as to place the camera module, and the terminals store the camera module in the mobile phone by using a mechanical structure and slide out when needed, but the screen occupation ratio of the water drop screen and the perforated screen still has a rising space, and the mechanical mechanism is moved for many times so that the equipment is easy to damage. In addition, some terminals adopt the technology of making a video recording under the screen, will make a video recording the module and place the below region of comprehensive screen to solve the screen and account for the problem of comparing with the overall arrangement of making a video recording. However, because the screen area corresponding to the camera module has a higher light transmission requirement, the pixels of the screen display module are greatly reduced, and the screen display in the area is greatly influenced. Simultaneously, because the regional luminousness of the screen that the module of making a video recording corresponds is lower for the shooting effect of the module of making a video recording also receives certain influence. In summary, the technical scheme for improving the screen occupation ratio in the related art still has disadvantages, wherein the problem of poor shooting effect and poor display effect exists in the screen lower shooting scheme, which affects the use experience of the user on the comprehensive screen.
Based on the above situation, embodiments of the present invention provide an off-screen camera display device, a terminal device, a control method for an off-screen camera device, a controller, and a computer-readable storage medium, which can improve a shooting effect and a screen display effect of an off-screen camera terminal device, thereby improving a screen occupation ratio of a comprehensive screen terminal and optimizing a user experience.
The embodiments of the present invention will be further explained with reference to the drawings.
In a first aspect, an embodiment of the present invention provides an off-screen camera display device.
Referring to fig. 1 and 2, an embodiment of the present invention provides an off-screen camera display device including: the display module comprises a first display module 100, a second display module 200, a camera module 300 and an optical component 400, wherein the first display module 100 comprises a light-transmitting layer 110 and a display layer 120, the light-transmitting layer 110 is positioned on one side of the display layer 120, the display layer 120 is provided with a notch 121, and the light-transmitting layer 110 is provided with a transmission display area 111 corresponding to the notch 121; the second display module 200 is located at the other side of the display layer 120 and staggered with the notch 121; the camera module 300 is located at the other side of the display layer 120; optical component 400 is located make a video recording between module 300 and the first display module assembly 100, and second display module assembly 200 is towards optical component 400, and optical component 400 is used for reflecting the display information of second display module assembly 200 to transmission display area 111, and optical component 400 still is used for will seeing through the light transmission of transmission display area 111 to module 300 of making a video recording.
When the off-screen camera display device is used, when the camera module 300 is in an open state, the optical component 400 transmits the light rays penetrating through the transmission display area 111 to the camera module 300; when the camera module 300 is in the closed state and the first display module 100 and the second display module 200 are in the working state, the optical component 400 reflects the display information of the second display module 200 to the transmissive display region 111.
Exemplarily, as shown in fig. 5, fig. 5 is a reflection schematic diagram of an under-screen image capture display device according to another embodiment of the present invention. When the perspective display area above the camera module 300 needs to display four circular patterns, the 2 circular patterns displayed by the first reflective display module 210 on the left side are reflected by the first reflective surface 410 on the left side of the optical component 400. Similarly, the second reflective module on the right displays another 2 circular patterns reflected by the second reflective surface 420 on the right of the optical member 400. At this time, four complete circular patterns are displayed right above the camera module 300 when viewed from the front.
It can be understood that according to the technical scheme of the embodiment of the present invention, when the under-screen camera shooting technology is applied, the shooting effect of the camera shooting module 300 and the display effect of the screen display module can be improved without reducing the display pixels or the light transmittance of the screen display module, so that the feasibility of the under-screen camera shooting scheme is higher, the screen occupation ratio of the full-screen terminal is improved, and the use experience of the user is optimized.
It is to be noted that the embodiment of the present invention greatly improves the shooting effect of the off-screen camera module 300, and meanwhile, the screen display module does not need to use the gaps between the crystals for light transmission, and the display effect is also ensured, so that the embodiment of the present invention has good shooting effect and full image display effect at the same time. In addition, the production process of the embodiment of the invention has low difficulty and strong reliability, and the manufacturing cost is low, so the technical added value is very high.
It should be noted that the transmissive display area 111 of the light-transmissive layer 110 corresponds to the notch 121 of the display layer 120, and the second display module 200 is staggered from the notch 121, so that a light path can be formed among the second display module 200, the optical component 400 and the transmissive display area 111, and the display information of the second display module 200 can be reflected to the transmissive display area 111 through the optical component 400. Illustratively, two second display modules 200 are respectively disposed at two sides of the gap 121, and the optical component 400 is disposed between the two second display modules 200. It should be noted that the position of the second display module 200 is only required to enable an optical path to be formed between the second display module 200, the optical component 400 and the transmissive display area 111 so as to reflect the display information of the second display module 200 to the transmissive display area 111, and this embodiment is not limited thereto.
The light-transmitting layer 110 is a glass cover plate, and it can be understood that glass has good transmission effect and display effect, and can resist certain external impact, thereby protecting the device.
Referring to fig. 3, exemplarily, the optical component 400 is a mirror, the mirror is provided with a first reflecting surface 410 and a second reflecting surface 420, the second display module 200 includes a first reflective display module 210 and a second reflective display module 220, the first reflective display module 210 and the second reflective display module 220 are respectively located at two sides of the mirror, the transmissive display area 111 includes a first sub transmissive display area 1111 and a second sub transmissive display area 1112, the first reflecting surface 410 is configured to reflect the display information of the first reflective display module 210 to the first sub transmissive display area 1111, and the second reflecting surface 420 is configured to reflect the display information of the second reflective display module 220 to the second sub transmissive display area 1112.
Specifically, when the camera module 300 is in the closed state and the first display module 100 and the second display module 200 are in the working state, the mirror reflects the display information of the first reflective display module 210 to the first sub transmissive display area 1111 through the first reflective surface 410, and further reflects the display information of the second reflective display module 220 to the second sub transmissive display area 1112 through the second reflective surface 420.
It should be noted that the first reflective display module 210 and the second reflective display module 220 may be an integrated structure, or may be a plurality of display modules spliced into a corresponding shape, and this embodiment does not limit the present invention.
Illustratively, the optical component 400 is a double-reflector, and the first display module 100 and the second display module 200 are respectively located at two sides of the double-reflector and symmetrically arranged along a central axis of the double-reflector.
Referring to fig. 3 and 5, for example, an included angle between the first reflective surface 410 and the first reflective display module 210 is 45 degrees, and an included angle between the second reflective surface 420 and the second reflective display module 220 is 45 degrees.
Specifically, a first reflection surface 410 and a second reflection surface 420 are respectively disposed on two sides of the reflector, the first display module 100 and the second display module 200 are respectively disposed on two sides of the reflector, the first display module 100 faces the first reflection surface 410, and the second display module 200 faces the second reflection surface 420. When the camera module 300 is in the closed state, and the first display module 100 and the second display module 200 are in the working state, the light emitted by the display information of the first display module 100 faces the first reflecting surface 410 and is reflected from the first reflecting surface 410 to the transmissive display area 111 of the display layer 120 to form the reflective light path of the first display module 100, and similarly, the light emitted by the display information of the second display module 200 faces the second reflecting surface 420 and is reflected from the second reflecting surface 420 to the transmissive display area 111 of the display layer 120 to form the reflective light path of the second display module 200.
Referring to fig. 4, the optical member 400 is exemplarily provided with a groove 430, and the groove 430 is used for placing the camera module 300.
Specifically, when the camera module 300 is in the open state, the external light passes through the transmissive display region 111 of the transparent layer 110 and then is transmitted to the camera module 300 through the optical component 400. Therefore, set up recess 430 and be used for placing module 300 of making a video recording, can conveniently see through external light to module 300 of making a video recording from optical component 400 for the structure is inseparabler, also reduces the loss of light in the transmission process, thereby promotes module 300 of making a video recording's shooting effect.
Illustratively, one side of the optical member 400 is closely attached to the display layer 120, and the other corresponding side is provided with a groove 430 for placing the camera module 300. It should be noted that the groove 430 may be disposed at the center of the other side of the optical component 400, which is not limited in this embodiment, and in addition, the groove 430 may be circular, which is not limited in this embodiment.
Referring to fig. 1 and 2, the under-screen camera display device further includes a positioning assembly 500, and the positioning assembly 500 is used for positioning the second display module 200 and the optical component 400.
Specifically, locating component 500 fixes the back with second display module assembly 200, places optical component 400 to the corresponding position of second display module assembly 200 again, then will make a video recording module assembly 300 and be used for acquireing one side of external light and optical component 400 and closely laminate and place, later with the opposite side and the PCB board of module 300 of making a video recording or corresponding support fixed connection.
Illustratively, the positioning assembly 500 is a positioning bezel, and as shown in fig. 2, the positioning bezel is a semi-enclosed structure.
Referring to fig. 1 and 2, the video camera display device further includes a flat cable assembly 600, the positioning assembly 500 is provided with a through hole (not shown), the flat cable assembly 600 is disposed through the through hole, and the flat cable assembly 600 is electrically connected to the second display module 200.
Specifically, the flat cable assembly 600 is disposed through the through hole of the positioning assembly 500 and electrically connected to the second display module 200, so that the second display module 200 displays corresponding display information.
Based on the off-screen image display device of the above-described embodiment, various embodiments of the terminal device of the second aspect of the present invention are set forth below.
An embodiment of the present invention provides a terminal device, including the under-screen camera display apparatus according to each embodiment of the first aspect.
Specifically, the terminal device of the embodiment of the invention can be an intelligent terminal device with a display screen, such as a mobile phone, a tablet computer, a communication payment terminal with a face recognition function, a management terminal, a computer and the like.
It can be understood that, because the terminal device according to the second aspect of the present invention and the off-screen image display apparatus according to any of the embodiments of the first aspect belong to the same inventive concept, specific implementations and technical effects of the terminal device according to the second aspect of the present invention may refer to the specific implementations and technical effects of the off-screen image display apparatus according to any of the embodiments of the first aspect, and are not described herein again.
Further, based on the off-screen image pickup display apparatus of the embodiment of the first aspect described above, various embodiments of a control method of an off-screen image pickup display apparatus of a third aspect of the present invention are set forth below.
As shown in fig. 7, fig. 7 is a schematic diagram of a system architecture platform 100 for executing a control method of an off-screen camera display device according to an embodiment of the present invention.
In the example of fig. 7, the system architecture platform is provided with a processor 800 and a memory 700, wherein the processor 800 and the memory 700 may be connected by a bus or other means, and fig. 7 exemplifies the connection by a bus.
The memory 700, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs as well as non-transitory computer executable programs. Further, the memory 700 may include a high speed random access memory 700, and may also include a non-transitory memory 700, such as at least one piece of disk memory 700, flash memory device, or other piece of non-transitory solid state memory 700. In some embodiments, memory 700 optionally includes memory 700 located remotely from processor 800, and such remote memory 700 may be connected to the system architecture platform via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
It can be understood by those skilled in the art that the system architecture platform may be applied to a 5G communication network system, a mobile communication network system evolved in the following process, and the like, and this embodiment is not limited in particular.
Those skilled in the art will appreciate that the system architecture platform illustrated in FIG. 7 does not constitute a limitation on embodiments of the invention, and may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components.
In the system architecture platform shown in fig. 7, the processor 800 may call a control program stored in the memory 700, thereby executing a control method of the off-screen image display device.
Based on the above system architecture platform, the following provides various embodiments of the control method of the off-screen camera display device according to the present invention.
Referring to fig. 1 and 2, in an exemplary embodiment, the method for controlling an under-screen camera display device is applied to a controller of an under-screen camera display device, and the under-screen camera display device further includes a first display module 100, a second display module 200, a camera module 300 and an optical component 400, where the first display module 100 includes a light-transmitting layer 110 and a display layer 120, the light-transmitting layer 110 is located on one side of the display layer 120, the display layer 120 is provided with a notch 121, the light-transmitting layer 110 is provided with a transmissive display area 111 corresponding to the notch 121, the second display module 200 is located on the other side of the display layer 120 and staggered from the notch 121, the camera module 300 is located on the other side of the display layer 120, the optical component 400 is located between the camera module 300 and the first display module 100, and the second display module 200 faces the optical component 400.
As shown in fig. 8, the control method of the off-screen image capture and display apparatus specifically includes, but is not limited to, the following steps S100 and S200.
Step S100: acquiring the working state of the camera module 300;
the operating state of the camera module 300 includes an on state and an off state.
And S200, under the condition that the working state is the closed state, when the driving instructions of the first display module 100 and the second display module 200 are obtained, controlling the first display module 100 to work, and controlling the second display module 200 to work so that the optical component 400 reflects the display information of the second display module 200 to the transmission display area 111.
It should be noted that, when the camera module 300 is in the closed state and the first display module 100 and the second display module 200 are in the open state, the first display module 100 and the second display module 200 are controlled to respectively display the corresponding display information, and the display information of the second display module 200 is reflected to the transmissive display area 111 of the transmissive layer 110 under the action of the optical component 400, so that the display information of the first display module 100 and the second display module 200 can be spliced into complete display information on the transmissive layer 110.
Specifically, through steps S100 and S200, when the camera module 300 is in the off state and the first display module 100 and the second display module 200 are in the working state, the optical component 400 reflects the display information of the second display module 200 to the transmissive display area 111. According to the technical scheme of the embodiment of the invention, when the under-screen camera shooting technology is applied, the display effect of the screen display module can be improved without reducing the display pixels or the light transmittance of the screen display module, so that the feasibility of the under-screen camera shooting scheme is higher, the screen occupation ratio of the comprehensive screen terminal is improved, and the use experience of a user is optimized.
Referring to fig. 9, the method for controlling the off-screen image capture and display device specifically includes, but is not limited to, the following step S300.
Step S300: when the working state is the on state, the second display module 200 is turned off, so that the optical component 400 transmits the light rays passing through the transmissive display region 111 to the camera module 300.
Specifically, when the camera module 300 is in the open state, the optical member 400 transmits the light passing through the transmissive display region 111 to the camera module 300. It can be understood that, through step S100 to step S300, when applying the screen down camera shooting technique, the display pixel or the luminousness of the screen display module need not to be reduced, the shooting effect of the camera module 300 and the display effect of the screen display module can be improved, thereby improving the screen occupation ratio of the comprehensive screen terminal.
Referring to fig. 10, for example, the optical component 400 is a mirror, the mirror is provided with a first reflecting surface 410 and a second reflecting surface 420, the second display module 200 includes a first reflective display module 210 and a second reflective display module 220, the first reflective display module 210 and the second reflective display module 220 are respectively located at two sides of the mirror, and the transmissive display area 111 includes a first sub transmissive display area 1111 and a second sub transmissive display area 1112. The step S200 includes, but is not limited to, the following steps S210 and S220.
Step S210: controlling the first reflective display module 210 to operate such that the first reflective surface 410 reflects the display information of the first reflective display module 210 to the first sub-transmissive display region 1111;
step S220: the second reflective display module 220 is controlled to operate such that the second reflective surface 420 reflects the display information of the second reflective display module 220 to the second sub-transmissive display region 1112.
Specifically, when the operating state of the camera module 300 is the closed state, when the driving instructions of the first display module 100 and the second display module 200 are obtained, the first display module 100 is controlled to display the corresponding display information, the first reflective display module 210 is controlled to operate so that the first reflective surface 410 reflects the display information of the first reflective display module 210 to the first sub transmissive display area 1111, and the second reflective display module 220 is controlled to operate so that the second reflective surface 420 reflects the display information of the second reflective display module 220 to the second sub transmissive display area 1112, so that the transparent layer 110 displays the complete display information.
For example, the step S200 may specifically include, but is not limited to, the following step S410 and step S420.
Step S410: acquiring information to be displayed, and executing preset operation on the information to be displayed;
step S420: the information to be displayed after the predetermined operation is performed is displayed on the first reflective display module 210 and the second reflective display module 220.
It should be noted that the information to be displayed may include patterns, characters, and the like, and this embodiment does not limit this.
It should be noted that the preset operation includes: the information to be displayed is converted into an assigned pixel dot matrix, and the pixel dot matrix is divided into a first dot matrix area, a second dot matrix area and a third dot matrix area in an averaging mode, wherein the first dot matrix area and the third dot matrix area are symmetrical about a central axis of the second dot matrix area, and the second dot matrix area corresponds to the display information of the transmission display area 111.
For example, the step S420 may specifically include, but is not limited to, the following step S421 and step S422.
Step S421: displaying a first pixel information group of the first dot matrix area and a second pixel information group of the third dot matrix area on the first display module 100;
step S422: the second pixel information group on the second dot matrix area is subjected to mirror image inversion, and the inverted second pixel information group is displayed on the second display module 200.
Specifically, as shown in fig. 6, when the operating state of the image capturing module 300 is the off state, the driving instructions of the first display module 100 and the second display module 200 are acquired. The controller divides the information to be displayed into three parts, taking a row of pixels as an example, wherein n > m, which can be specifically divided into: (a 1, ak), (ak, a (k + m/2)), (a (k + m/2), am), (am, an), wherein (ak, a (k + m/2)) is assigned to the first reflective display module 210 and mirrored (a (k + m/2), ak), and similarly, (a (k + m/2), am) is assigned to the second reflective display module 220 and mirrored (am, a (k + m/2)), such that the pixel rows of the display information at the transparent layer 110 after specular reflection remain: (a 1, ak), (ak, a (k + m/2)), (a (k + m/2), am), (am, an) i.e.: (a 1, an) complete row information. When the camera module 300 is in the open state, the controller turns off the second display module 200, so that the optical member 400 transmits the light transmitted through the transmissive display region 111 to the camera module 300.
It can be understood that, since the control method of the off-screen image display device according to the third aspect of the present invention and the off-screen image display device according to any one of the above-mentioned embodiments of the first aspect belong to the same inventive concept, specific implementations and technical effects of the control method of the off-screen image display device according to the third aspect of the present invention may refer to the specific implementations and technical effects of the off-screen image display device according to any one of the above-mentioned embodiments of the first aspect, and are not described herein again.
Based on the control method of the off-screen photographic display device of the above-described embodiments, respective embodiments of the controller of the fourth aspect and the computer-readable storage medium of the fifth aspect of the present invention are set forth below.
One embodiment of the present invention provides a controller, including: memory 700, processor 800, and a computer program stored on memory 700 and executable on processor 800.
The processor 800 and memory 700 may be connected by a bus or other means.
It should be noted that the controller in this embodiment may be configured to include the memory 700 and the processor 800 in the embodiment shown in fig. 7, and can form a part of the system architecture platform in the embodiment shown in fig. 7, and both are within the same inventive concept, so that both have the same implementation principle and beneficial effects, and will not be described in detail herein.
Non-transitory software programs and instructions necessary to implement the information processing method of the above-described embodiment are stored in the memory 700, and when executed by the processor 800, perform the control method of the off-screen image capture display device of the above-described embodiment, for example, the method steps S100 to S200 in fig. 8, the method step S300 in fig. 9, and the method steps S210 to S220 in fig. 10 described above.
It can be understood that, since the controller according to the fourth aspect of the present invention executes the control method of the off-screen image capture and display device according to any one of the above third aspects, specific implementation manners and technical effects of the controller according to the fourth aspect of the present invention may refer to the specific implementation manners and technical effects of the control method of the off-screen image capture and display device according to any one of the above third aspects, and are not described herein again.
The above described embodiments of the apparatus are merely illustrative, wherein the units illustrated as separate components may or may not be physically separate, may be located in one place, or may be distributed over a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
Furthermore, an embodiment of the present invention provides a computer-readable storage medium storing computer-executable instructions for performing the above-described control method of the off-screen photographic display apparatus, for example, performing the above-described method steps S100 to S200 in fig. 8, the method step S300 in fig. 9, and the method steps S210 to S220 in fig. 10.
It will be understood by those of ordinary skill in the art that all or some of the steps, systems, and methods disclosed above may be implemented as software, firmware, hardware, or suitable combinations thereof. Some or all of the physical components may be implemented as software executed by a processor 800, such as the central processing unit 800, the digital signal processor 800 or the microprocessor 800, or as hardware, or as integrated circuits, such as application specific integrated circuits. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory 700 technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as is well known to those skilled in the art.
While the preferred embodiments of the present invention have been described in detail, it will be understood by those skilled in the art that the foregoing and various other changes, omissions and deviations in the form and detail thereof may be made without departing from the scope of this invention.

Claims (12)

1. An off-screen camera display device comprising:
the first display module comprises a light-transmitting layer and a display layer, wherein the light-transmitting layer is positioned on one side of the display layer, the display layer is provided with a notch, and the light-transmitting layer is provided with a transmission display area corresponding to the notch;
the second display module is positioned on the other side of the display layer and staggered with the notch;
the camera module is positioned on the other side of the display layer;
the optical component is positioned between the camera module and the first display module, the second display module faces the optical component, the optical component is used for reflecting the display information of the second display module to the transmission display area, and the optical component is also used for transmitting the light penetrating through the transmission display area to the camera module.
2. The device of claim 1, wherein: the optical component is a reflector, the reflector is provided with a first reflecting surface and a second reflecting surface, the second display module comprises a first reflecting display module and a second reflecting display module, the first reflecting display module and the second reflecting display module are respectively located on two sides of the reflector, the transmitting display area comprises a first sub transmitting display area and a second sub transmitting display area, the first reflecting surface is used for reflecting display information of the first reflecting display module to the first sub transmitting display area, and the second reflecting surface is used for reflecting display information of the second reflecting display module to the second sub transmitting display area.
3. The device of claim 2, further comprising: the first reflecting surface and the included angle of the first reflection display module are 45 degrees, and the second reflecting surface and the included angle of the second reflection display module are 45 degrees.
4. The off-screen camera display device according to claim 1, wherein: the optical component is provided with a groove, and the groove is used for placing the camera module.
5. The device according to any one of claims 1 to 4, characterized in that: still include locating component, locating component is used for fixing a position the second display module assembly with optical component.
6. The device of claim 5, wherein: the display module further comprises a flat cable assembly, the positioning assembly is provided with a through hole, the flat cable assembly penetrates through the through hole, and the flat cable assembly is electrically connected with the second display module.
7. A terminal device characterized by: comprising an underscreen camera display device according to any one of claims 1 to 6.
8. A control method of an under-screen camera display device is applied to a controller of the under-screen camera display device, and the under-screen camera display device further comprises a first display module, a second display module, a camera module and an optical component, wherein the first display module comprises a light transmitting layer and a display layer, the light transmitting layer is located on one side of the display layer, the display layer is provided with a notch, the light transmitting layer is provided with a transmission display area corresponding to the notch, the second display module is located on the other side of the display layer and staggered with the notch, the camera module is located on the other side of the display layer, the optical component is located between the camera module and the first display module, and the second display module faces the optical component;
the control method comprises the following steps:
acquiring the working state of the camera module;
and under the condition that the working state is a closed state, when a driving instruction of the first display module and the second display module is obtained, the first display module is controlled to work, and the second display module is controlled to work so that the optical component reflects the display information of the second display module to the transmission display area.
9. The method of controlling an off-screen camera display device according to claim 8, further comprising:
and under the condition that the working state is the opening state, closing the second display module so that the optical component transmits the light rays penetrating through the transmission display area to the camera module.
10. The control method of the off-screen camera display device according to claim 8, wherein the optical component is a reflector, the reflector is provided with a first reflecting surface and a second reflecting surface, the second display module comprises a first reflective display module and a second reflective display module, the first reflective display module and the second reflective display module are respectively located on two sides of the reflector, and the transmissive display area comprises a first sub transmissive display area and a second sub transmissive display area;
the controlling the second display module to work so that the optical component reflects the display information of the second display module to the transmissive display area comprises:
controlling the first reflective display module to work so that the first reflective surface reflects the display information of the first reflective display module to the first sub-transmissive display area;
and controlling the second reflection display module to work so that the second reflection surface reflects the display information of the second reflection display module to the second sub-transmission display area.
11. A controller, comprising: a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing a method of controlling an off-screen image display device according to any one of claims 8 to 10 when executing the computer program.
12. A computer-readable storage medium, characterized in that: there are stored computer-executable instructions for performing the method of controlling an underscreen camera display device of any one of claims 8 to 10.
CN202110656845.6A 2021-06-11 2021-06-11 Under-screen camera shooting display device and control method thereof, controller and terminal equipment Pending CN115542639A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110656845.6A CN115542639A (en) 2021-06-11 2021-06-11 Under-screen camera shooting display device and control method thereof, controller and terminal equipment
PCT/CN2022/088861 WO2022257622A1 (en) 2021-06-11 2022-04-24 Under-screen photographing display apparatus and control method therefor, controller, and terminal device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110656845.6A CN115542639A (en) 2021-06-11 2021-06-11 Under-screen camera shooting display device and control method thereof, controller and terminal equipment

Publications (1)

Publication Number Publication Date
CN115542639A true CN115542639A (en) 2022-12-30

Family

ID=84425461

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110656845.6A Pending CN115542639A (en) 2021-06-11 2021-06-11 Under-screen camera shooting display device and control method thereof, controller and terminal equipment

Country Status (2)

Country Link
CN (1) CN115542639A (en)
WO (1) WO2022257622A1 (en)

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2893599B2 (en) * 1989-10-05 1999-05-24 セイコーエプソン株式会社 Polarized light source and projection display
CN111314521A (en) * 2017-03-07 2020-06-19 Oppo广东移动通信有限公司 Terminal device
CN109584741A (en) * 2018-12-04 2019-04-05 深圳绿米联创科技有限公司 Optics module and electronic equipment under a kind of concealed screen
CN110658582A (en) * 2019-05-10 2020-01-07 武汉华星光电技术有限公司 Display device
CN110211500A (en) * 2019-06-27 2019-09-06 Oppo广东移动通信有限公司 Image display module, method, terminal device and storage medium
CN209930366U (en) * 2019-07-03 2020-01-10 北京小米移动软件有限公司 Camera mounting structure and terminal equipment
CN113539059A (en) * 2020-04-20 2021-10-22 华为技术有限公司 Display screen and electronic equipment
CN112929470B (en) * 2021-01-20 2023-07-21 武汉科技大学 Smart phone, front camera shooting and display compensation system and packaging method
CN112947877A (en) * 2021-02-25 2021-06-11 维沃移动通信有限公司 Electronic device, control method and control device thereof

Also Published As

Publication number Publication date
WO2022257622A1 (en) 2022-12-15

Similar Documents

Publication Publication Date Title
CN109891432B (en) Under-screen fingerprint identification system, liquid crystal display screen fingerprint identification device and electronic equipment
CN110213408B (en) Electronic apparatus, rotating assembly control method, and storage medium
US9998642B2 (en) Apparatus and method to maximize the display area of a mobile device
US20210090353A1 (en) Image Compensation for an Occluding Direct-View Augmented Reality System
CN105824147B (en) Display device
EP3993079A1 (en) Display apparatus and electronic device
CN101854472B (en) Image photoraphing apparatus, method of controliing image photoraphing apparatus
WO2022001453A1 (en) Electronic device and display apparatus
US20150084994A1 (en) Touch-enabled field-sequential color (fsc) display using a light guide with light turning features
US9454265B2 (en) Integration of a light collection light-guide with a field sequential color display
CN210007736U (en) Electronic device
CN103327167B (en) Information processing terminal device
CN110211500A (en) Image display module, method, terminal device and storage medium
US20230108468A1 (en) Display screen assembly, electronic device, and image acquisition method
CN110764300A (en) Display module and electronic device
EP4167561A1 (en) Camera control method and device, and in-screen camera structure
EP4036641B1 (en) Electronic device and control method therefor, and computer-readable storage medium
WO2021052190A1 (en) Electronic apparatus
CN108984139A (en) The control method of display module, terminal and terminal
CN113031346B (en) Backlight module and display method of display equipment
CN115542639A (en) Under-screen camera shooting display device and control method thereof, controller and terminal equipment
CN110618559B (en) Display device and screen light supplementing method thereof
US20190306291A1 (en) Electronic device
EP3009887B1 (en) Optical imaging processing system
CN210155484U (en) Hide LCD display module assembly and electronic equipment of camera under screen

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination