CN114245090A

CN114245090A - Image projection method, laser projection apparatus, and computer-readable storage medium

Info

Publication number: CN114245090A
Application number: CN202111625798.5A
Authority: CN
Inventors: 吴凯; 肖纪臣; 梁倩
Original assignee: Qingdao Hisense Laser Display Co Ltd
Current assignee: Qingdao Hisense Laser Display Co Ltd
Priority date: 2021-12-28
Filing date: 2021-12-28
Publication date: 2022-03-25

Abstract

The embodiment of the application discloses an image projection method, laser projection equipment and a computer readable storage medium, and belongs to the field of laser projection. In the embodiment of the application, the high-resolution image is framed into the low-resolution sub-images, and then the plurality of sub-images are sequentially subjected to staggered imaging in one image display period by controlling the turnover of different micro-mirror arrays in the DMD, so that the high-resolution image is projected. In this way, a high-resolution image can be projected using a low-resolution DMD without losing image information. In addition, the laser projection equipment of the scheme can realize the projection of the high-resolution image without adopting a vibrating mirror, thereby reducing the cost.

Description

Image projection method, laser projection apparatus, and computer-readable storage medium

Technical Field

The embodiment of the application relates to the field of laser projection, in particular to an image projection method, laser projection equipment and a computer readable storage medium.

Background

The resolution of an image represents the amount of information stored in the image, which is typically expressed in terms of the number of pixels in the image. The higher the resolution of the image, the more pixels the image contains and the greater the amount of information. For example, an image having a resolution of 1920 × 1080 includes an information amount of 2M pixels. An image with a resolution of 3840 × 2160 contains an information amount of 8M pixels.

The resolution of a laser projection device is an important indicator of the performance of a laser projection device. The higher the resolution of the laser projection device, the higher the precision of the image that can be projected onto the screen, the more information is displayed, and the sharper the picture is. However, as a hardware device, the resolution of the laser projection device is limited by the hardware processing technology, and therefore, compared with the speed of increasing the image resolution, the resolution of the laser projection device is often increased more slowly. Taking a laser projection apparatus using a DMD (Digital micro mirror Device) as a key component as an example, the resolution of the laser projection apparatus is mainly determined by the resolution of the DMD.

The resolutions of the present DMD mainly include 800 × 600, 1024 × 768, 1280 × 720, 1920 × 1080, 2716 × 1528, and the like. Many images currently have higher resolution than DMDs, such as the common 3840 × 2160 image. How to project high-resolution images using low-resolution DMDs without losing image information is a hot spot of research in the industry.

Disclosure of Invention

Embodiments of the present application provide an image projection method, a laser projection apparatus, and a computer-readable storage medium, which can project an image with high resolution using a DMD with low resolution without losing image information, and do not need to use a galvanometer. The technical scheme is as follows:

in one aspect, an image projection method is provided, the method comprising:

framing a target image to be displayed to obtain multiple frames of subgraphs, wherein the target image has a first resolution, the multiple frames of subgraphs have a second resolution, and the first resolution is greater than the second resolution;

generating a plurality of control signals corresponding to the multi-frame subgraphs one by one based on the multi-frame subgraphs;

respectively controlling a plurality of micro mirror arrays in the DMD to turn over through the plurality of control signals, so that the plurality of frames of sub-images are sequentially imaged in one image display period to project the target image, wherein the DMD has a third resolution, and the third resolution is smaller than the first resolution and larger than the second resolution;

wherein one control signal is used for controlling one micromirror array to image a corresponding frame of sub-image, different micromirror arrays are partially overlapped, and imaging areas of different sub-images are partially overlapped.

Optionally, the number of pixels of the first resolution in the row direction is N times the number of pixels of the second resolution in the row direction, and the number of pixels of the first resolution in the column direction is M times the number of pixels of the second resolution in the column direction;

the multi-frame subgraph comprises an N x M frame subgraph, the multiple micro mirror arrays comprise N x M micro mirror arrays, different pixels included in any pixel block in the target image are divided into different subgraphs, the target image comprises multiple non-overlapping pixel blocks, each pixel block comprises N x M pixels, and N and M are positive integers.

Optionally, N and M are both 2, the multi-frame sub-image includes a 4-frame sub-image, the plurality of micromirror arrays includes 4 micromirror arrays, an angle of turning of adjacent 4 micromirrors in each micromirror array is controlled by a corresponding control signal to be consistent, so as to display a pixel in the corresponding sub-image, and the adjacent 4 micromirrors include two micromirrors in both the row direction and the column direction;

during imaging, a second frame sub-picture of the 4-frame sub-pictures is shifted up by 0.5 pixels with respect to the first frame sub-picture, a third frame sub-picture is shifted right by 0.5 pixels with respect to the second frame sub-picture, and a fourth frame sub-picture is shifted down by 0.5 pixels with respect to the third frame sub-picture;

the second micromirror array of the 4 micromirror arrays is offset one row of micromirrors upward with respect to the first micromirror array, the third micromirror array is offset one column of micromirrors rightward with respect to the second micromirror array, and the fourth micromirror array is offset one row of micromirrors downward with respect to the third micromirror array.

Optionally, the second resolution is L × K, each micromirror array comprises (L +1) rows and (K +1) columns of micromirrors, and L and K are positive integers.

In another aspect, there is provided a laser projection apparatus including: an image processing device and a DMD;

the image processing device is used for framing a target image to be displayed to obtain a plurality of frames of subgraphs, generating a plurality of control signals corresponding to the plurality of frames of subgraphs one to one based on the plurality of frames of subgraphs, and sequentially outputting the plurality of control signals to the DMD, wherein the target image has a first resolution, the plurality of frames of subgraphs have a second resolution, and the first resolution is greater than the second resolution;

the DMD is configured to respectively control, based on the plurality of control signals received in sequence, a plurality of micromirror arrays in the DMD to flip, so that the plurality of frames of sub-images are sequentially imaged in one image display period to project the target image, where the DMD has a third resolution, and the third resolution is smaller than the first resolution and larger than the second resolution;

Optionally, the DMD includes a POM (point of micro mirrors, micromirror cell), and at least one of the plurality of micromirror arrays includes a micromirror in the POM.

In another aspect, there is provided an image projection apparatus, the apparatus comprising:

the device comprises a framing module, a display module and a display module, wherein the framing module is used for framing a target image to be displayed to obtain a plurality of frames of subgraphs, the target image has a first resolution, the plurality of frames of subgraphs have a second resolution, and the first resolution is greater than the second resolution;

the generating module is used for generating a plurality of control signals which correspond to the multi-frame subgraphs one by one on the basis of the multi-frame subgraphs;

the control module is used for respectively controlling a plurality of micromirror arrays in the digital micromirror device DMD to turn over through the plurality of control signals, so that the plurality of frames of sub-images are sequentially imaged in one image display period to project the target image, wherein the DMD has a third resolution ratio, and the third resolution ratio is smaller than the first resolution ratio and is larger than the second resolution ratio;

In another aspect, a computer-readable storage medium is provided, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the image projection method described above.

In another aspect, a computer program product is provided comprising instructions which, when run on a computer, cause the computer to perform the steps of the image projection method described above.

The technical scheme provided by the embodiment of the application can at least bring the following beneficial effects:

in the embodiment of the application, the high-resolution image is framed into the low-resolution sub-images, and then the plurality of sub-images are sequentially subjected to staggered imaging in one image display period by controlling the turnover of different micro-mirror arrays in the DMD, so that the high-resolution image is projected. In this way, a high-resolution image can be projected using a low-resolution DMD without losing image information. In addition, the laser projection equipment of the scheme can realize the projection of the high-resolution image without adopting a vibrating mirror, thereby reducing the cost.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a laser projection apparatus in the related art provided by an embodiment of the present application;

fig. 2 is a schematic diagram of a laser projection apparatus in the present solution provided by an embodiment of the present application;

fig. 3 is a schematic view of an operation scenario between a laser projection apparatus and a control device according to an embodiment of the present disclosure;

fig. 4 is a block diagram of a hardware configuration of a laser projection apparatus according to an embodiment of the present disclosure;

FIG. 5 is a flowchart of an image projection method provided in an embodiment of the present application;

FIG. 6 is a schematic diagram illustrating an image framing method according to an embodiment of the present disclosure;

FIG. 7 is a flow chart of another image projection method provided by an embodiment of the present application;

fig. 8 is a schematic diagram of a micromirror of a DMD according to an embodiment of the present application;

FIG. 9 is a schematic diagram of a display pixel assembled by a micromirror according to an embodiment of the present application;

FIG. 10 is a schematic diagram of sub-imaging a first frame by a micro mirror array according to an embodiment of the present application;

FIG. 11 is a diagram of sub-imaging a second frame by another micro mirror array according to an embodiment of the present application;

FIG. 12 is a diagram of sub-imaging a third frame by another micro mirror array according to an embodiment of the present application;

FIG. 13 is a diagram of sub-imaging a fourth frame by yet another micro mirror array according to an embodiment of the present application;

fig. 14 is a schematic structural diagram of an image projection apparatus according to an embodiment of the present application;

fig. 15 is a schematic structural diagram of a terminal according to an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the embodiments of the present application more clear, the embodiments of the present application will be further described in detail with reference to the accompanying drawings.

All other embodiments, which can be obtained by a person skilled in the art without making creative efforts based on the exemplary embodiments shown in the embodiments of the present application, belong to the protection scope of the embodiments of the present application. In addition, while the disclosure in the embodiments of the present application has been presented in terms of exemplary embodiment or embodiments, it should be appreciated that aspects of the disclosure may stand alone in a complete solution.

It is to be understood that reference herein to "at least one" means one or more and "a plurality" means two or more. In the description of the embodiments of the present application, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in order to facilitate clear description of technical solutions of the embodiments of the present application, in the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same items or similar items having substantially the same functions and actions. Those skilled in the art will appreciate that the terms "first," "second," etc. do not denote any order or quantity, nor do the terms "first," "second," etc. denote any order or importance. That is, "first," "second," etc. are used to distinguish between similar objects and not necessarily to describe a particular order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module" as used in the embodiments of the present application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

Before explaining the embodiments of the present application in detail, an application scenario and an apparatus structure of the embodiments of the present application are introduced. It should be noted that the device structure and the service scenario described in the embodiment of the present application are for more clearly illustrating the technical solution of the embodiment of the present application, and do not constitute a limitation to the technical solution provided in the embodiment of the present application, and it is known by a person skilled in the art that along with the evolution of technology and the appearance of a new service scenario, the technical solution provided in the embodiment of the present application is also applicable to similar technical problems.

At present, the laser projection technology (i.e. laser display technology) is developed at a high speed, and the laser projection technology is applied to more and more fields of families, businesses, video conferences, enterprise production monitoring and the like. As the demand for screen size in these fields increases, higher image quality is required to meet the display demand of the screen. At present, most of related products of laser projection equipment have image quality degrees of 1080P and 4K, and in order to meet the requirements of image quality in various fields, the improvement of image resolution is undoubted.

The image projection method provided by the embodiment of the application can be applied to laser projection equipment, and the laser projection equipment comprises a laser television, a laser projector and the like. The higher the resolution of the laser projection device, the sharper the image that can be projected onto the screen. The laser projection device in the embodiment of the present application includes a DMD, that is, the DMD is used as a key element of the laser projection device, and the resolution of the laser projection device is mainly determined by the resolution of the DMD. Under the condition that the resolution of the DMD is lower than that of an image to be displayed, and on the premise that a micro mirror used in the DMD is fixed in the related art, a method of adding a vibrating mirror in laser projection equipment is adopted to project the image with high resolution, namely, a scheme of matching the DMD with the vibrating mirror is adopted to realize the display of the image with high resolution. Specifically, the multi-dimensional motion of the galvanometer is adopted to perform frame division and time division on the image to be displayed, so that the image with high resolution is projected.

As shown in fig. 1, the laser projection apparatus includes an image processing device (not shown), a DMD, a TIR (Total Internal Reflection) prism, a galvanometer, a lens, and the like. The image processing device is used for framing a high-resolution image to be displayed, obtaining a plurality of frames of low-resolution subgraphs, generating a control signal (namely an image display signal) of each frame of subgraph, and sequentially outputting the control signal of each frame of subgraph to the DMD. The DMD is used for driving one micro mirror array in the DMD to turn over based on the control signal of each frame subgraph so as to output the optical signal of each frame subgraph in sequence. And the optical signals of each frame of subgraph are sequentially output to the vibrating mirror after passing through the TIR prism. When the optical signals of each frame of subgraph respectively reach the vibrating mirror, the vibrating mirror vibrates to different angles, so that the effect of displaying the vision of human eyes by the multiple frames of subgraphs is that high-resolution images are displayed in a superposition mode.

The image projection method provided by the embodiment of the application projects the high-resolution image by using the DMD with low resolution without using a vibrating mirror, and image information is not lost. That is, as shown in fig. 2, the laser projection apparatus in the embodiment of the present application does not include a galvanometer, but includes an image processing device, a DMD, a lens, and the like. The image processing device is used for controlling the turnover of the micro mirror in the DMD according to the image projection method provided by the embodiment of the application, so that the projection of a high-resolution image is realized. In an embodiment of the present application, the laser projection apparatus further includes a light source, and the light source is configured to provide a light source, i.e., an optical signal, for the DMD. Optionally, the laser projection device further comprises a TIR prism. Optionally, the laser projection device further comprises a display screen for presenting the projected image. The display screen is a display of a laser television, or a projection screen of a laser projector, and the like, and the embodiment of the present application is not limited thereto.

Fig. 3 is a schematic diagram illustrating an operation scenario between a laser projection device and a control apparatus. As shown in fig. 3, a user may operate the laser projection apparatus 200 through the mobile terminal 300 and the control device 100. It is noted that the laser projection device 200 includes a projector for laser projection and a display screen for presenting a projected image, the projector not being shown in fig. 3.

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the laser projection apparatus 200 includes infrared protocol communication or bluetooth protocol communication, other short-distance communication methods, and the like, and the laser projection apparatus 200 is controlled by wireless or other wired methods. The user may input user commands via keys on a remote control, voice input, control panel input, etc. to control the laser projection device 200. Such as: the user may input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, an on/off key, etc. on the remote controller, to implement the function of controlling the laser projection apparatus 200.

In some embodiments, smart phones, tablets, laptops, and other mobile terminals may also be used to control the laser-projection device 200. For example, the laser projection device 200 is controlled using an application program running on a mobile terminal. The application may be configured on a screen associated with the mobile terminal to provide the user with various controls in an intuitive user interface.

In some embodiments, the mobile terminal 300 may install a software application with the laser projection device 200 to enable connection communication via a network communication protocol for the purpose of one-to-one control operations and data communication. Such as: the mobile terminal 300 and the laser projection device 200 can establish a control instruction protocol, synchronize a remote control keyboard to the mobile terminal 300, and control the laser projection device 200 by controlling a user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the laser projection device 200, so as to realize the synchronous display function.

As also shown in fig. 3, the laser projection device 200 is also in data communication with the server 400 through a variety of communication means. The laser projection device 200 may be allowed to make communication connections via a LAN (Local Area Network), a WLAN (Wireless Local Area Network), and other networks. The server 400 may provide various content and interactions to the laser projection device 200. Illustratively, the laser projection device 200 receives software Program updates, or accesses a remotely stored digital media library by sending and receiving information, and EPG (Electronic Program Guide) interaction. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers. Other web service contents such as video on demand and advertisement services are provided through the server 400.

The particular display device type, size, resolution, etc. of the laser projection device 200 are not limited, and those skilled in the art will appreciate that the laser projection device 200 may be modified in performance and configuration as desired.

The laser projection apparatus 200 may additionally provide an intelligent network television function of a computer support function, including but not limited to a network television, an intelligent television, an internet protocol television, etc., in addition to the broadcast receiving television function.

Fig. 4 is a block diagram of a hardware configuration of a laser projection apparatus 200 according to an embodiment of the present disclosure.

In some embodiments, at least one of controller 250, tuning demodulator 210, communicator 220, detector 230, first interface 255, display 275, audio output interface 285, memory 260, power supply 290, user interface 265, external device interface 240 are included in laser projection apparatus 200.

In some embodiments, a display screen 275 receives image signals from the processor output and displays video content and images as well as components of the menu manipulation interface.

In some embodiments, the display 275, includes a display component for presenting a picture, and a driving component for driving the display of an image.

In some embodiments, the video content is displayed from broadcast television content, or alternatively, from various broadcast signals that may be received via wired or wireless communication protocols. Alternatively, various image contents received from the network communication protocol and sent from the network server side can be displayed.

In some embodiments, the display screen 275 is used to present a user-manipulated UI interface generated in the laser projection device 200 and used to control the laser projection device 200.

In some embodiments, a drive assembly for driving the display is also included, depending on the type of display screen 275.

In some embodiments, the display screen 275 is a projection display screen and may also include a projection device and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example: the communicator 220 may include at least one of a WIFI (Wireless Fidelity) module 221, a bluetooth module 222, a wired ethernet module 223, and other network communication modules or near field communication modules, and an infrared receiver.

In some embodiments, the laser projection device 200 may establish transmission and reception of control signals and data signals with the external control apparatus 100 or the content providing device through the communicator 220.

In some embodiments, the user interface 265 may be configured to receive infrared control signals from a control device 100 (e.g., an infrared remote control, etc.).

In some embodiments, detector 230 is a laser projection device 200 for acquiring signals of the external environment or interacting with the outside.

In some embodiments, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light, adaptive display of parameter changes by collecting ambient light, and the like.

In some embodiments, the detector 230 may further include an image collector 232, such as a camera, a video camera, etc., which may be configured to collect external environment scenes, collect attributes of the user or gestures interacted with the user, adaptively change display parameters, and recognize user gestures, so as to implement a function of interaction with the user.

In some embodiments, the detector 230 may also include a temperature sensor or the like for sensing ambient temperature.

In some embodiments, the laser projection device 200 may adaptively adjust the display color temperature of the image. For example, the laser projection device 200 may be adjusted to display a cool tone of the color temperature of the image when the temperature is higher, or the laser projection device 200 may be adjusted to display a warm tone of the image when the temperature is lower.

In some embodiments, the detector 230 may further include a sound collector 231 or the like, such as a microphone, which may be used to receive the user's voice. For example, a voice signal may be used to receive a control command from a user to control the laser projection device 200, or an ambient sound may be collected to identify an ambient scene type, so that the laser projection device 200 may adapt to ambient noise.

In some embodiments, as shown in fig. 4, the first interface 255 is configured to allow data transmission between the controller 250 and an external other device or other controller 250. Such as receiving video signal data and audio signal data of an external device, or command instruction data, etc.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: any one or more of an HDMI (High Definition Multimedia Interface) 241, a CVBS (Composite Video Broadcast Signal) Interface 242, an analog or data High-Definition component input Interface 243, a USB (Universal Serial Bus) input Interface 244, and an RGB (Red Green Blue) port. The plurality of interfaces may form a composite input/output interface.

In some embodiments, as shown in fig. 4, the tuning demodulator 210 is configured to receive a broadcast television signal through a wired or wireless receiving manner, perform modulation and demodulation processing such as amplification, mixing, resonance, and the like, and demodulate an audio and video signal from a plurality of wireless or wired broadcast television signals, where the audio and video signal may include a television audio and video signal carried in a television channel frequency selected by a user and an EPG data signal.

In some embodiments, the frequency points demodulated by the tuner demodulator 210 are controlled by the controller 250, and the controller 250 can send out control signals according to user selection, so that the modem responds to the television signal frequency selected by the user and modulates and demodulates the television signal carried by the frequency.

In some embodiments, the broadcast television signal may be classified into a terrestrial broadcast signal, a cable broadcast signal, a satellite broadcast signal, an internet broadcast signal, or the like according to the broadcasting system of the television signal. Or may be classified into a digital modulation signal, an analog modulation signal, and the like according to a modulation type. Or the signals are classified into digital signals, analog signals and the like according to the types of the signals.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. Thus, the set-top box outputs the television audio/video signals modulated and demodulated by the received broadcast television signals to the main device, and the main device receives the audio/video signals through the first interface 255.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 may control the overall operation of the laser projection device 200. For example: in response to receiving a user command for selecting a UI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the laser projection apparatus 200 or a voice command corresponding to a voice spoken by the user.

As shown in fig. 4, the controller 250 includes at least one of a RAM (Random Access Memory) 251, a ROM (Read-Only Memory) 252, another processor (e.g., a GPU (Graphics Processing Unit) 253, a CPU (Central Processing Unit) 254, an SOC (System on Chip), an FPGA (Field Programmable Gate Array, also called a Programmable device) Chip, a communication interface, and a communication bus 256, wherein the communication bus 256 connects the respective components.

In some embodiments, RAM 251 is used to store temporary data for the operating system or other programs that are running.

In some embodiments, ROM 252 is used to store instructions for various system boots.

In some embodiments, the ROM 252 is used to store a Basic Input Output System (BIOS). The system is used for completing power-on self-test of the system, initialization of each functional module in the system, a driver of basic input/output of the system and booting an operating system.

In some embodiments, when the power-on signal is received, the laser projection apparatus 200 starts to power up, the CPU executes the system boot instruction in the ROM 252, and copies the temporary data of the operating system stored in the memory into the RAM 251 so as to boot or run the operating system. After the start of the operating system is completed, the CPU copies the temporary data of the various application programs in the memory to the RAM 251, and then, the various application programs are started or run.

In some embodiments, CPU processor 254 is used to execute operating system and application program instructions stored in memory. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include a main processor and one or more sub-processors. A main processor for performing some operations of the laser projection apparatus 200 in a pre-power-up mode and/or operations for displaying a picture in a normal mode. One or more sub-processors for performing an operation in a standby mode or the like.

In some embodiments, the graphics processor 253 is used to generate various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And the system comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display screen.

In some embodiments, the laser projection device 200 further includes a video processor 270, and the video processor 270 is configured to receive an external video signal, perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, and obtain a signal that is directly displayed or played on the laser projection device 200.

In some embodiments, video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And an image synthesis module, such as an image synthesizer, configured to superimpose and mix a graphics generator with the scaled video image according to a GUI (Graphical User Interface) signal input by a User or generated by the User, so as to generate an image signal for display.

The frame rate conversion module is configured to convert an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and the normal format is implemented in, for example, an interpolation frame mode.

The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.

In some embodiments, the graphics processor 253 and the video processor 270 may be integrated or separately configured, and when the graphics processor and the video processor are integrated, the graphics processor may perform processing of a graphics signal output to a display screen, and when the graphics processor and the video processor are separately configured, the graphics processor and the video processor may perform different functions, for example, a Frame Rate Conversion (GPU + FRC) architecture.

In some embodiments, the laser projection device 200 further comprises an audio processor 280, wherein the audio processor 280 is configured to receive an external audio signal, decompress and decode the audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processes to obtain an audio signal that can be played in a speaker.

In some embodiments, video processor 270 may include one or more chips. Audio processor 280 may also include one or more chips.

In some embodiments, video processor 270 and audio processor 280 may be separate chips or may be integrated with the controller in one or more chips.

In some embodiments, audio output interface 285, under the control of controller 250, receives audio signals output by audio processor 280, such as: a speaker 286, and an external sound output terminal 287 which can be output to a generating device of an external device, in addition to a speaker carried by the laser projection device 200 itself, such as: external sound interface or earphone interface, etc., and may also include a near field communication module in the communication interface, for example: and the Bluetooth module is used for outputting sound of the Bluetooth loudspeaker.

The power supply 290 provides power supply support for the laser projection apparatus 200 with power input from an external power source under the control of the controller 250. The power supply 290 may include a built-in power supply circuit installed inside the laser projection apparatus 200, or may be an external power supply installed in the laser projection apparatus 200, and provides a power interface for an external power supply in the laser projection apparatus 200.

A user interface 265 for receiving an input signal of a user and then transmitting the received user input signal to the controller 250. The user input signal may be a remote controller signal received through an infrared receiver, and may be various user control signals received through a network communication module.

In some embodiments, a user inputs a user command via the control device 100, and the laser projection apparatus 200 responds to the user input via the controller 250.

In some embodiments, the user may enter user commands at a GUI displayed on the display screen 275, and the user input interface receives the user input commands through the GUI. Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A common presentation form of a user interface is GUI, which refers to a user interface related to computer operations displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

Memory 260, including memory storing various software modules for driving laser projection device 200. Such as: various software modules stored in memory, including: at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

The base module is a bottom layer software module that is used for signal communication between the various hardware in the laser projection device 200 and for sending processing and control signals to the upper layer modules. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.

For example, the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is used for controlling the display screen to display the image content, and can be used for playing the multimedia image content, UI interface and other information. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing a module for data communication between browsing servers. And the service module is used for providing various services and modules including various application programs. Meanwhile, the memory 260 may store a visual effect map for receiving external data and user data, images of various items in various user interfaces, and a focus object, etc.

Next, the image projection method provided in the embodiments of the present application will be explained in detail.

Fig. 5 is a flowchart of an image projection method according to an embodiment of the present application. The method can be applied to laser projection equipment. Referring to fig. 5, the method includes the following steps.

Step 501: the method comprises the steps of framing a target image to be displayed to obtain a plurality of frames of subgraphs, wherein the target image has a first resolution, the plurality of frames of subgraphs have a second resolution, and the first resolution is larger than the second resolution.

In the embodiment of the present application, an image to be displayed is referred to as a target image, and the target image has a first resolution. The laser projection device comprises a DMD, wherein the DMD is provided with a third resolution, and the third resolution is smaller than the first resolution. In order to project a high-resolution target image by using a low-resolution DMD, the laser projection device needs to frame the target image to obtain a plurality of frame subgraphs, and the plurality of frame subgraphs have a second resolution which is smaller than the first resolution and the third resolution. In brief, the laser projection apparatus frames a high-resolution target image into a plurality of low-resolution subgraphs, and the framing process may be understood as a down-sampling process.

Alternatively, assuming that the number of pixels of the first resolution in the row direction is N times the number of pixels of the second resolution in the row direction, and the number of pixels of the first resolution in the column direction is M times the number of pixels of the second resolution in the column direction, in one implementation of framing, different pixels included in any pixel block in the target image are divided into different sub-images. The target image comprises a plurality of non-overlapping pixel blocks, each pixel block comprises N multiplied by M pixels, and N and M are positive integers. Accordingly, the multi-frame subpicture includes an N × M frame subpicture.

As shown in fig. 6, assuming that the target image has the first resolution of 3840 × 2160, i.e. the target image is a 4K image, and the DMD has the third resolution smaller than 3840 × 2160 and larger than 1920 × 1080, the target image may be framed to obtain a sub-image with a resolution of 1920 × 1080. That is, N and M are both 2, the multi-frame sub-picture includes 4-frame sub-pictures, and the target image may include 1920 × 1080 pixel blocks, each pixel block including 2 × 2 pixels. The pixel at the lower left corner in each pixel block is divided into a first frame sub-picture, the pixel at the upper left corner is divided into a second frame sub-picture, the pixel at the upper right corner is divided into a third frame sub-picture, and the pixel at the lower right corner is divided into a fourth frame sub-picture. Or the pixel at the upper left corner in each pixel block is divided into the first frame sub-picture, the pixel at the upper right corner is divided into the second frame sub-picture, the pixel at the lower right corner is divided into the third frame sub-picture, and the pixel at the lower left corner is divided into the fourth frame sub-picture. Or divided in other ways. It should be noted that pixels at the same position in different pixel blocks are divided into the same sub-picture. Thus, the multi-frame subgraph is actually obtained by carrying out pixel dislocation division on the target image.

As another example, assuming that N is 2 and M is 3 in one implementation, the multi-frame sub-picture includes 6 frames of sub-pictures, and each pixel block in the target image includes 2 × 3 pixels. Different pixels in each pixel block are partitioned into different sub-pictures and pixels at the same position in different pixel blocks are partitioned into the same sub-picture.

In other embodiments, the target image may be framed in other ways. For example, taking N and M as 2 as an example, starting from the pixel in the first row and the first column in the target image, 2 × 2 pixels adjacent to each other in the target image are taken as a pixel block, and each pixel block is synthesized into one pixel, thereby obtaining a frame of subgraph. Starting from the pixels in the first row and the second column in the target image, dividing 2 × 2 pixels adjacent to each other in the target image into a pixel block, and synthesizing each pixel block into one pixel, thereby obtaining another frame of sub-image. Starting from the pixel positioned in the second row and the first column in the target image, dividing 2 × 2 pixels adjacent to each other in the target image into a pixel block, and synthesizing each pixel block into one pixel, thereby obtaining another frame subgraph. Starting from the pixel located in the second row and the second column in the target image, 2 × 2 pixels adjacent to each other in the target image are divided into one pixel block, and each pixel block is synthesized into one pixel, thereby obtaining another frame sub-picture.

Optionally, in this embodiment of the present application, the laser projection apparatus further includes an image processing device, and step 501 is performed by the image processing device, and optionally, the image processing device is an FPGA. Optionally, the image processing apparatus comprises an image processing module, and step 501 is performed by the image processing module.

Optionally, in an embodiment of the present application, the laser projection apparatus further includes a signal receiver and an SOC, and the image processing device includes an image processing module and an image display control module. Referring to fig. 7, the signal receiver receives an image signal or a video signal to be displayed, which is transmitted from the front-end signal source, and outputs the image signal or the video signal to the SOC. Since formats of image signals or video signals received by the front-end signal source may be various, the SOC encodes and decodes the input image signals or video signals into images to be displayed, thereby obtaining image information with a uniform format. The SOC outputs image information to an image processing module, and the image processing module performs processing such as framing on an image to be displayed based on the input image information to obtain a multi-frame subgraph. The image processing module outputs the multi-frame subgraphs to the image display control module.

Step 502: and generating a plurality of control signals corresponding to the multi-frame subgraphs one by one based on the multi-frame subgraphs.

In the embodiment of the present application, after framing a target image to obtain multiple frames of subgraphs, a laser projection device generates multiple control signals corresponding to the multiple frames of subgraphs one to one based on the multiple frames of subgraphs, that is, the multiple control signals are used for imaging the multiple frames of subgraphs respectively. Illustratively, the multi-frame subgraph comprises 4 frame subgraphs, then 4 control signals are generated, the 4 control signals correspond to the 4 frame subgraphs one-to-one, and one control signal is used for imaging one frame subgraph.

It should be noted that the plurality of control signals are used to control different micromirror arrays in the DMD. In the embodiment of the present application, the resolution of the DMD is determined based on the maximum array formed by the micromirrors included in the DMD, and the resolution of the DMD is higher than that of the sub-image, i.e., the maximum array formed by the micromirrors in the DMD is greater than that of the sub-image. In this way, a plurality of control signals for controlling different micromirror arrays in the DMD can be generated, thereby achieving the staggered imaging of multiple frames of subgraphs to project the target image through step 503 described below.

In one implementation, as shown in fig. 8, the DMD includes a basic micromirror array including micromirrors in a dotted line and a POM region, which is a micromirror pool composed of micromirrors surrounding the basic micromirror array, and in fig. 8, the POM region includes one circle of micromirrors as an example, in a specific implementation, the POM region may include multiple circles of micromirrors. In one embodiment, the plurality of micromirror arrays controlled by the plurality of control signals are implemented by a basic micromirror array and a POM region. That is, the DMD includes a POM, and at least one of the plurality of micromirror arrays controlled by the plurality of control signals includes a micromirror in the POM. Briefly, in step 502, a plurality of control signals generated based on the multi-frame subgraph are used to control the flipping of the plurality of micromirror arrays in the DMD respectively. In some implementations, the plurality of micromirror arrays are implemented by the basic micromirror array and the POM in the DMD.

As can be seen from the foregoing, the laser projection apparatus includes an image processing device, and step 502 is executed by the image processing device. Optionally, referring to fig. 7, the image processing apparatus includes an image processing module and an image display control module, and the image display control module generates the plurality of control signals after receiving the plurality of frames of subgraphs sent by the image processing module. The image display control module sends the plurality of control signals to the DMD in sequence, for example, to the driver module in the DOM.

Step 503: respectively controlling a plurality of micromirror arrays in the DMD to turn over through the plurality of control signals, so that the plurality of frames of subgraphs are sequentially imaged in one image display period to project a target image; the DMD has a third resolution, the third resolution is smaller than the first resolution and larger than the second resolution, and a control signal is used for controlling one micro mirror array to image a corresponding frame of sub-image, wherein different micro mirror arrays are partially overlapped, and imaging areas of different sub-images are partially overlapped.

In the embodiment of the application, when the laser projection device generates a plurality of control signals, the laser projection device respectively controls the plurality of micromirror arrays in the DMD to flip through the plurality of control signals, so that the plurality of frames of subgraphs are sequentially imaged in one image display period to project a target image. For example, the image processing device in the laser projection apparatus sequentially sends the plurality of control signals to the DMD, for example, to a driving module in the DMD, and the driving module drives the corresponding micromirror to turn over according to the control signal every time the driving module receives one control signal, so that the corresponding sub-image is imaged.

Optionally, the plurality of micromirror arrays includes N × M micromirror arrays, the multi-frame subgraph includes N × M frame subgraphs, the plurality of control signals includes N × M, the plurality of micromirror arrays correspond to the multi-frame subgraphs one to one, and the plurality of micromirror arrays correspond to the plurality of control signals one to one.

As can be seen from the foregoing, in some embodiments, the DMD includes a base micromirror array and a POM, and the plurality of micromirror arrays controlled by the plurality of control signals are implemented by the base micromirror array and the POM region. For example, there are a plurality of rows and columns of micromirrors forming the POM region around the basic micromirror array, then, in the case that the basic micromirror array in the DMD has a resolution equivalent to that of the subgraph, the micromirror array controlled by one of the plurality of control signals may comprise the basic micromirror array, and the micromirror array controlled by the other control signals may be composed of some micromirrors in the basic micromirror array and some micromirrors in the POM region.

It should be noted that, in the case that the resolution of the basic micromirror array of the DMD is greater than the second resolution, it is also possible to realize a plurality of micromirror arrays corresponding to the plurality of control signals one to one by the micromirrors included in the basic micromirror array. For example, the basic micromirror array of the DMD includes 1920 × 1080 micromirrors, and the sub-image has a second resolution of 1280 × 960, and assuming that there are 4 control signals in total, then 4 micromirror arrays corresponding to the 4 control signals one by one can be obtained by the micromirrors included in the basic micromirror array.

It should be further noted that, in the related art, in the process of projecting a high-resolution image by using a DMD and a galvanometer, the micromirror array in the DMD is fixed, that is, the micromirror array for imaging each frame sub-image is the same.

Alternatively, assuming that N and M are both 2, the multi-frame sub-image comprises a 4-frame sub-image, the plurality of micromirror arrays comprises 4 micromirror arrays, and the angles of turning of adjacent 4 micromirrors in each micromirror array are controlled by respective control signals to be consistent to display one pixel in the corresponding sub-image. Wherein each adjacent 4 micromirrors comprise two micromirrors in both row and column directions. In addition, the second micromirror array of the 4 micromirror arrays is offset by one row of micromirrors upward with respect to the first micromirror array, the third micromirror array is offset by one column of micromirrors rightward with respect to the second micromirror array, and the fourth micromirror array is offset by one row of micromirrors downward with respect to the third micromirror array. Accordingly, at the time of imaging, the second frame sub-picture of the 4-frame sub-pictures is shifted up by 0.5 pixels with respect to the first frame sub-picture, the third frame sub-picture is shifted right by 0.5 pixels with respect to the second frame sub-picture, and the fourth frame sub-picture is shifted down by 0.5 pixels with respect to the third frame sub-picture.

That is, in an implementation manner of the embodiment of the present application, the flip angles of every adjacent 4 micromirrors in the DMD are controlled to be consistent to display one pixel of the sub-image, each row of micromirrors corresponds to 0.5 pixel, and each column of micromirrors also corresponds to 0.5 pixel. That is, as shown in fig. 9, every adjacent 4 micromirrors in the DMD are used to display one pixel in the sub-image, then every 3 × 3 micromirrors can be used to display 2 × 2 pixels in the sub-image, and 4 × 4 micromirrors can be used to display 3 × 3 pixels in the sub-image. By analogy, (L +1) × (K +1) micromirrors can be used to display L × K pixels in the sub-image. It can be seen that in this implementation, if the sub-image has a second resolution of L × K, each micromirror array comprises (L +1) rows and (K +1) columns of micromirrors. Wherein L and K are both positive integers. For example, the resolution of the sub-image is 1920 × 1080, 1921 × 1081 micromirrors can be used to display the entire sub-image, and then one micromirror array controlled by one control signal includes 1921 × 1081 micromirrors.

It should be noted that, in fig. 9, in the process of displaying 3 × 3 pixels by 4 × 4 micromirrors, every adjacent 4 micromirrors can be sequentially turned to sequentially display the 1 st to 9 th pixels. It is also possible to display a part of pixels at the same time and then another part of pixels at the same time by controlling the micromirrors to turn in batches until all of the 9 pixels are displayed. Similarly, in the process of displaying L × K pixels by (L +1) × (K +1) micromirrors, each pixel may be displayed sequentially, or a portion of pixels may be displayed simultaneously and then another portion of pixels may be displayed simultaneously by controlling the micromirrors to turn in batches until all the L × K pixels are displayed.

Taking N and M as an example, both of N and M are 2, respectively controlling 4 micromirror arrays to flip through 4 control signals, so that 4 frame sub-images are sequentially imaged in one image display period. Referring to fig. 10 to 13, when a first frame sub-image is imaged, the micromirror array controlled by the control signal corresponding to the sub-image includes 1 st to 1081 st rows and 1 st to 1921 st columns of micromirrors. When the second frame sub-image is imaged, the micromirror array controlled by the control signal corresponding to the sub-image includes 0 to 1080 rows and 1 to 1921 columns of micromirrors, so that the second frame sub-image is shifted up by 0.5 pixels in imaging compared to the first frame sub-image. When a third frame sub-image is imaged, the micromirror array controlled by the control signal corresponding to the sub-image includes 0 to 1080 rows and 2 to 1922 columns of micromirrors, so that the third frame sub-image is shifted to the right by 0.5 pixels when imaged compared to the second frame sub-image. When the fourth frame sub-image is imaged, the micromirror array controlled by the control signal corresponding to the sub-image includes rows 1 to 1081 and columns 2 to 1922 micromirrors, so that the fourth frame sub-image is shifted down by 0.5 pixels in imaging compared to the third frame sub-image.

It should be noted that, when the 4-frame sub-images are sequentially imaged as shown in fig. 10 to 13, the pixel of the first-frame sub-image is the pixel at the lower left corner in each pixel block of the target image, the pixel of the second-frame sub-image is the pixel at the upper left corner in each pixel block of the target image, the pixel of the third-frame sub-image is the pixel at the upper right corner in each pixel block of the target image, and the pixel of the fourth-frame sub-image is the pixel at the lower right corner in each pixel block of the target image. In one image display period, 4 sub-images with 1920 × 1080 resolution are imaged, and a 4K image, namely a target image with 3840 × 2160 resolution is presented by using the human eye persistence effect.

That is, in the scheme, multiple sub-images are sequentially displayed in one image display period, and a high-resolution target image formed by overlapping the multiple sub-images in a staggered manner is presented to human eyes by using the visual persistence effect of the human eyes. Alternatively, taking a 4-frame subgraph as an example, assuming that the image display frequency corresponding to the image display period is 60Hz, the imaging frequency corresponding to the subgraph is 240 Hz.

In summary, in the embodiment of the present application, the high-resolution image is framed into the low-resolution sub-images, and then the inversion of different micromirror arrays in the DMD is controlled, so that the sub-images are sequentially formed in a staggered manner in one image display period, thereby projecting the high-resolution image. In this way, a high-resolution image can be projected using a low-resolution DMD without losing image information. In addition, the laser projection equipment of the scheme can realize the projection of the high-resolution image without adopting a vibrating mirror, thereby reducing the cost.

All the above optional technical solutions can be combined arbitrarily to form an optional embodiment of the present application, and the present application embodiment is not described in detail again.

Fig. 14 is a schematic structural diagram of an image projection apparatus 1400 provided in an embodiment of the present application, where the image projection apparatus 1400 may be implemented as part or all of a laser projection device by software, hardware, or a combination of both. Referring to fig. 14, the apparatus 1400 includes: a framing module 1401, a generating module 1402 and a control module 1403.

A framing module 1401, configured to frame a target image to be displayed to obtain multiple frames of subgraphs, where the target image has a first resolution, the multiple frames of subgraphs have a second resolution, and the first resolution is greater than the second resolution;

a generating module 1402, configured to generate, based on the multiple frames of subgraphs, multiple control signals corresponding to the multiple frames of subgraphs one to one;

a control module 1403, configured to respectively control, by the multiple control signals, the multiple micromirror arrays in the DMD to flip, so that the multiple frames of sub-images are sequentially imaged in one image display period to project a target image, where the DMD has a third resolution, and the third resolution is smaller than the first resolution and greater than the second resolution;

the multi-frame subgraph comprises an N multiplied by M frame subgraph, the multiple micro mirror arrays comprise N multiplied by M micro mirror arrays, different pixels included in any pixel block in a target image are divided into different subgraphs, the target image comprises multiple non-overlapping pixel blocks, each pixel block comprises N multiplied by M pixels, and N and M are positive integers.

during imaging, the second frame sub-picture of the 4-frame sub-pictures is shifted up by 0.5 pixels with respect to the first frame sub-picture, the third frame sub-picture is shifted to the right by 0.5 pixels with respect to the second frame sub-picture, and the fourth frame sub-picture is shifted down by 0.5 pixels with respect to the third frame sub-picture;

It should be noted that: in the image projection apparatus provided in the above embodiment, when projecting an image, only the division of the above functional modules is taken as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the apparatus is divided into different functional modules to complete all or part of the above described functions. In addition, the image projection apparatus and the image projection method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.

Fig. 15 shows a block diagram of a terminal 1500 according to an exemplary embodiment of the present application. The laser projection device in the above embodiment can be implemented by the terminal 1500. The terminal 1500 may be: laser projection apparatuses such as laser televisions and laser projectors.

In general, terminal 1500 includes: a processor 1501 and memory 1502.

Processor 1501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 1501 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). Processor 1501 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also referred to as a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 1501 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content that the display screen needs to display. In some embodiments, processor 1501 may also include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.

The memory 1502 may include one or more computer-readable storage media, which may be non-transitory. The memory 1502 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 1502 is used to store at least one instruction for execution by processor 1501 to implement the image projection methods provided by method embodiments herein.

In some embodiments, the terminal 1500 may further include: a peripheral interface 1503 and at least one peripheral. The processor 1501, memory 1502, and peripheral interface 1503 may be connected by buses or signal lines. Various peripheral devices may be connected to peripheral interface 1503 via buses, signal lines, or circuit boards. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1504, a display 1505, a camera assembly 1506, an audio circuit 1507, a positioning assembly 1508, and a power supply 1509.

The peripheral interface 1503 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 1501 and the memory 1502. In some embodiments, the processor 1501, memory 1502, and peripheral interface 1503 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1501, the memory 1502, and the peripheral interface 1503 may be implemented on separate chips or circuit boards, which is not limited in this embodiment.

The Radio Frequency circuit 1504 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuitry 1504 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 1504 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1504 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuit 1504 can communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 1504 may also include NFC (Near Field Communication) related circuits, which are not limited in this application.

The display screen 1505 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 1505 is a touch display screen, the display screen 1505 also has the ability to capture touch signals on or over the surface of the display screen 1505. The touch signal may be input to the processor 1501 as a control signal for processing. In this case, the display screen 1505 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, display 1505 may be one, provided on the front panel of terminal 1500; in other embodiments, display 1505 may be at least two, each disposed on a different surface of terminal 1500 or in a folded design; in other embodiments, display 1505 may be a flexible display disposed on a curved surface or a folded surface of terminal 1500. Even further, the display 1505 may be configured in a non-rectangular irregular pattern, i.e., a shaped screen. The Display 1505 can be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and other materials.

The camera assembly 1506 is used to capture images or video. Optionally, the camera assembly 1506 includes a front camera and a rear camera. Generally, a front camera is disposed at a front panel of the terminal, and a rear camera is disposed at a rear surface of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 1506 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

The audio circuitry 1507 may include a microphone and speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 1501 for processing or inputting the electric signals to the radio frequency circuit 1504 to realize voice communication. For stereo capture or noise reduction purposes, multiple microphones may be provided, each at a different location of the terminal 1500. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 1501 or the radio frequency circuit 1504 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, the audio circuitry 1507 may also include a headphone jack.

The positioning component 1508 is used to locate the current geographic position of the terminal 1500 for navigation or LBS (Location Based Service). The Positioning component 1508 may be a Positioning component based on the united states GPS (Global Positioning System), the chinese beidou System, the russian graves System, or the european union's galileo System.

Power supply 1509 is used to power the various components in terminal 1500. The power supply 1509 may be alternating current, direct current, disposable or rechargeable. When the power supply 1509 includes a rechargeable battery, the rechargeable battery may support wired charging or wireless charging. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, terminal 1500 also includes one or more sensors. Such as pressure sensors, fingerprint sensors, optical sensors, proximity sensors, and the like.

Those skilled in the art will appreciate that the configuration shown in fig. 15 does not constitute a limitation of terminal 1500, and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components may be employed.

In some embodiments, a computer-readable storage medium is also provided, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the image projection method in the above-mentioned embodiments. For example, the computer readable storage medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

It is noted that the computer-readable storage medium referred to in the embodiments of the present application may be a non-volatile storage medium, in other words, a non-transitory storage medium.

It should be understood that all or part of the steps for implementing the above embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions may be stored in the computer-readable storage medium described above.

That is, in some embodiments, there is also provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the steps of the image projection method described above.

The above-mentioned embodiments are provided not to limit the present application, and any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. A method of image projection, the method comprising:

respectively controlling a plurality of micromirror arrays in a Digital Micromirror Device (DMD) to turn over through the plurality of control signals, so that the plurality of frames of subgraphs sequentially image in one image display period to project the target image, wherein the DMD has a third resolution, and the third resolution is smaller than the first resolution and larger than the second resolution;

2. The method of claim 1, wherein the number of pixels of the first resolution in the row direction is N times the number of pixels of the second resolution in the row direction, and the number of pixels of the first resolution in the column direction is M times the number of pixels of the second resolution in the column direction;

3. The method of claim 2, wherein N and M are both 2, the multi-frame sub-image comprises a 4-frame sub-image, the plurality of micromirror arrays comprises 4 micromirror arrays, adjacent 4 micromirrors in each micromirror array controlled by respective control signals to flip at a uniform angle to display a pixel in the corresponding sub-image, the adjacent 4 micromirrors comprise two micromirrors in both row and column directions;

4. The method of claim 3, wherein the second resolution is L x K, each micromirror array comprises (L +1) rows and (K +1) columns of micromirrors, and both L and K are positive integers.

5. A laser projection device, characterized in that the laser projection device comprises: an image processing device and a Digital Micromirror Device (DMD);

6. A laser projection device as claimed in claim 5, wherein the DMD comprises a micromirror cell (POM), at least one micromirror array of the plurality of micromirror arrays comprising micromirrors of the POM.

7. The laser projection apparatus of claim 5 or 6, wherein the number of pixels of the first resolution in the row direction is N times the number of pixels of the second resolution in the row direction, and the number of pixels of the first resolution in the column direction is M times the number of pixels of the second resolution in the column direction;

8. The laser projection device of claim 7, wherein N and M are both 2, the multi-frame sub-image comprises 4-frame sub-images, the plurality of micromirror arrays comprises 4 micromirror arrays, adjacent 4 micromirrors in each micromirror array are controlled by respective control signals to have the same turning angle to display one pixel in the corresponding sub-image, the adjacent 4 micromirrors comprise two micromirrors in both row and column directions;

9. The laser projection device of claim 8, wherein the second resolution is lxk, each micromirror array comprises (L +1) rows and (K +1) columns of micromirrors, and L and K are positive integers.

10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 4.