CN113709433A - Method, device and equipment for detecting brightness of projection picture and computer storage medium - Google Patents
Method, device and equipment for detecting brightness of projection picture and computer storage medium Download PDFInfo
- Publication number
- CN113709433A CN113709433A CN202110992027.3A CN202110992027A CN113709433A CN 113709433 A CN113709433 A CN 113709433A CN 202110992027 A CN202110992027 A CN 202110992027A CN 113709433 A CN113709433 A CN 113709433A
- Authority
- CN
- China
- Prior art keywords
- projection
- image
- brightness
- picture
- brightness detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000003860 storage Methods 0.000 title claims abstract description 13
- 238000001514 detection method Methods 0.000 claims abstract description 147
- 239000003086 colorant Substances 0.000 claims description 17
- 238000005516 engineering process Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 12
- 238000012545 processing Methods 0.000 description 11
- 238000010191 image analysis Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 238000004364 calculation method Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 6
- 235000019557 luminance Nutrition 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000010276 construction Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 238000000926 separation method Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3191—Testing thereof
Abstract
The invention discloses a method, a device and equipment for detecting the brightness of a projection picture and a computer storage medium, wherein the method comprises the following steps: generating a checkerboard image with a boundary according to a preset image projection logic, wherein the image projection logic is constructed on the basis of basic lines of which the number is greater than or equal to one; carrying out projection display on the checkerboard image and acquiring a corresponding projection picture; and analyzing the projection picture to detect the brightness according to the boundary of the checkerboard image in the projection picture. The invention avoids the problem that brightness detection cannot be carried out due to the fact that the boundary of the black area in the projection cannot be distinguished, and effectively improves the accuracy of the brightness detection.
Description
Technical Field
The invention relates to the technical field of micro display, in particular to a method, a device and equipment for detecting the brightness of a projection picture and a computer storage medium.
Background
In recent times, compared with the traditional display technologies such as LCD and OLED, the Micro LED (also called micrometer LED) display technology has advantages in brightness, resolution, contrast, energy consumption, service life, response speed, thermal stability, etc., and has been widely applied in the field of display technologies, wherein the Micro LED projection is currently applied to the production and development of smart glasses products as one type of Micro LED display.
In the process of producing intelligent glasses products based on Micro LED projection, brightness detection for images projected by the Micro LED is a necessary and critical process. At present, the mode of brightness detection for the image projected by Micro LED is mainly: the Micro LED Micro display supports independent red, green or blue modes, a red, green or blue projection picture displayed by the Micro LED through single-channel projection is collected by a color camera, and then brightness detection is carried out on the basis of the projection picture. However, when the color camera collects the projection image, the projection image is collected together with a part of background color, and since the glasses are transparent, the black part projected by the Micro LED Micro display always coincides with the color of the background, i.e. the boundary of the black area in the projection image cannot be distinguished, so that the brightness detection cannot be accurately performed on the projection image.
In summary, when the brightness of the projection image projected and displayed by the Micro LED is detected, the accuracy of the brightness detection is poor because the boundary of the black area in the projection image cannot be distinguished.
Disclosure of Invention
The invention mainly aims to provide a method, a device and equipment for detecting the brightness of a projection picture and a computer storage medium, and aims to solve the technical problem that the brightness detection cannot be carried out due to the fact that the boundary of a black area in the projection picture cannot be distinguished when the brightness of the projection picture projected and displayed by a Micro LED is detected in the prior art.
In addition, in order to achieve the above object, the present invention further provides a method for detecting brightness of a projection screen, including:
generating a checkerboard image with a boundary according to a preset image projection logic, wherein the image projection logic is constructed on the basis of basic lines of which the number is greater than or equal to one;
carrying out projection display on the checkerboard image and acquiring a corresponding projection picture;
and analyzing the projection picture to detect the brightness according to the boundary of the checkerboard image in the projection picture.
Optionally, the base line comprises a plurality of block segments, and the method further comprises:
the method comprises the steps of constructing an image projection logic based on a basic line comprising a plurality of block segments, wherein the colors of pixel points of two adjacent block segments in the block segments are black and white respectively, and the number of the basic line is larger than or equal to one.
Optionally, the step of constructing an image projection logic based on a base line including a plurality of block segments includes:
copying the basic line to obtain a copied line of the basic line;
and in the block sections of the copied lines, carrying out preset color adjustment on block sections with black and white colors of two adjacent pixel points respectively to construct and obtain the image projection logic.
Optionally, the step of analyzing the projection picture to perform brightness detection according to the boundary of the checkerboard image in the projection picture includes:
analyzing the projection picture to determine the corner position of the checkerboard image boundary in the projection picture;
and calculating the brightness of the projection picture according to the corner position to detect the brightness.
Optionally, the step of analyzing the projection picture to determine the corner positions of the checkerboard image boundaries in the projection picture includes:
determining a preset self-defined image frame, wherein the self-defined image frame comprises corners of a checkerboard image boundary;
and analyzing the projection picture in the self-defined image frame to determine the corner position of the corner positioned at the boundary of the checkerboard image.
Optionally, the step of performing projection display on the checkerboard image and acquiring a corresponding projection picture includes:
determining characteristic points according to a preset brightness detection requirement;
carrying out projection display on the checkerboard image, and carrying out enhanced display on the feature points in a corresponding projection picture;
and acquiring a projection picture containing the feature points subjected to the enhanced display.
Optionally, after the step of performing projection display on the checkerboard image and acquiring a corresponding projection picture, the method further includes:
determining a to-be-detected area for performing brightness detection on the projection picture according to a preset brightness detection requirement;
and calculating the brightness of the position of the preset feature point in the region to be detected so as to detect the brightness.
In order to achieve the above object, the present invention also provides a brightness detection device for a projection screen, comprising:
the system comprises an image generation module, a detection module and a display module, wherein the image generation module is used for generating a checkerboard image with boundaries according to preset image projection logic, and the image projection logic is constructed on the basis of basic lines of which the number is greater than or equal to one;
the projection acquisition module is used for carrying out projection display on the checkerboard image and acquiring a corresponding projection picture;
and the brightness detection module is used for analyzing the projection picture to detect the brightness according to the boundary of the checkerboard image in the projection picture.
Further, to achieve the above object, the present invention also provides a luminance detection apparatus for a projection screen, comprising: the system comprises a memory, a processor and a brightness detection program of a projection picture, wherein the brightness detection program of the projection picture is stored on the memory and can run on the processor, and when being executed by the processor, the brightness detection program of the projection picture realizes the steps of the brightness detection method of the projection picture.
In order to achieve the above object, the present invention further provides a computer storage medium having a brightness detection program of a projection screen stored thereon, wherein the brightness detection program of the projection screen realizes the steps of the brightness detection method of the projection screen when executed by a processor.
In addition, to achieve the above object, the present invention also provides a computer program product including a computer program, which when executed by a processor, implements the steps of the brightness detection method for a projection screen as described above.
The brightness detection method of the projection picture is applied to brightness detection of pictures projected by Micro LEDs, firstly, an obtained image projection logic is constructed in advance based on basic lines of which the number is more than or equal to one, and a checkerboard image with a boundary is generated; then, carrying out projection display on the generated checkerboard image, and acquiring a projection picture corresponding to the checkerboard image; and finally, analyzing the projection picture to accurately detect the brightness according to the boundary of the checkerboard image in the projection picture.
Compared with the traditional brightness detection mode of the projection picture, the Micro LED projects the checkerboard image with the boundary, so that the accurate brightness detection is carried out on the projection picture corresponding to the checkerboard image according to the boundary of the checkerboard image in the projection picture based on image analysis. The problem that brightness detection cannot be carried out due to the fact that the boundary of the black area in the projection cannot be distinguished is solved, and the accuracy of the brightness detection is effectively improved.
Drawings
Fig. 1 is a schematic hardware structure diagram of an embodiment of a brightness detection apparatus for a projection image according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for detecting brightness of a projected image according to a first embodiment of the present invention;
FIG. 3 is a schematic view of an application scenario of the brightness detection method for a projected image according to the present invention involving a conventional brightness detection method;
FIG. 4 is a schematic diagram of a checkerboard image with boundaries in an embodiment of a method for detecting brightness of a projection image according to the present invention;
FIG. 5 is a projection image corresponding to a checkerboard image with boundaries in an embodiment of a method for detecting brightness of a projection image according to the present invention;
FIG. 6 is a diagram of an application scenario involved in an embodiment of the brightness detection method for a projection image according to the present invention;
FIG. 7 is a diagram of another application scenario involved in an embodiment of the brightness detection method for a projected image according to the present invention;
FIG. 8 is a diagram of another application scenario related to an embodiment of a method for detecting brightness of a projected image according to the present invention;
FIG. 9 is a diagram of another application scenario related to an embodiment of the brightness detection method for a projected image according to the present invention;
FIG. 10 is a diagram of another application scenario related to an embodiment of the brightness detection method for a projected image according to the present invention;
FIG. 11 is a diagram illustrating a luminance detection method for a projection image according to an embodiment of the present invention, which relates to pixel values of a corresponding area of the projection image;
fig. 12 is a functional block diagram of a brightness detection apparatus for projecting a picture according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.
The brightness detection device (also called terminal, device or terminal device) for projecting the picture in the embodiment of the invention can be a detection device specially developed for detecting the brightness of the projected image projected and displayed by the Micro LED, and can also be a device with a program compiling function, such as a personal computer.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU (Central Processing Unit), a communication bus 1002, and a memory 1003. Wherein a communication bus 1002 is used to enable connective communication between these components. The memory 1003 may be a high-speed RAM memory or a non-volatile memory (e.g., a disk memory). The memory 1003 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a brightness detection program of the projection screen may be included in the memory 1003 as a kind of computer storage medium.
In the terminal shown in fig. 1, the processor 1001 may be configured to call a brightness detection program of the projection screen stored in the memory 1003, and perform the following operations:
generating a checkerboard image with a boundary according to a preset image projection logic, wherein the image projection logic is constructed on the basis of basic lines of which the number is greater than or equal to one;
carrying out projection display on the checkerboard image and acquiring a corresponding projection picture;
and analyzing the projection picture to detect the brightness according to the boundary of the checkerboard image in the projection picture.
Further, the basic line includes a plurality of block segments, and the processor 1001 may be configured to call a brightness detection program of the projection screen stored in the memory 1003, and further perform the following operations:
the method comprises the steps of constructing an image projection logic based on a basic line comprising a plurality of block segments, wherein the colors of pixel points of two adjacent block segments in the block segments are black and white respectively, and the number of the basic line is larger than or equal to one.
Further, the processor 1001 may be configured to call a brightness detection program of the projection screen stored in the memory 1003, and further perform the following operations:
copying the basic line to obtain a copied line of the basic line;
and in the block sections of the copied lines, carrying out preset color adjustment on block sections of which the colors of two adjacent pixel points are black and white respectively.
Further, the processor 1001 may be configured to call a brightness detection program of the projection screen stored in the memory 1003, and further perform the following operations:
analyzing the projection picture to determine the corner position of the checkerboard image boundary in the projection picture;
and calculating the brightness of the projection picture according to the corner position to detect the brightness.
Further, the processor 1001 may be configured to call a brightness detection program of the projection screen stored in the memory 1003, and further perform the following operations:
determining a preset self-defined image frame, wherein the self-defined image frame comprises corners of a checkerboard image boundary;
and analyzing the projection picture in the self-defined image frame to determine the corner position of the corner positioned at the boundary of the checkerboard image.
Further, the processor 1001 may be configured to call a brightness detection program of the projection screen stored in the memory 1003, and further perform the following operations:
determining characteristic points according to a preset brightness detection requirement;
carrying out projection display on the checkerboard image, and carrying out enhanced display on the feature points in a corresponding projection picture;
and acquiring a projection picture containing the feature points subjected to the enhanced display.
Further, the processor 1001 may be configured to invoke a brightness detection program of the projection screen stored in the memory 1003, and after executing the step of performing projection display on the checkerboard image and acquiring the corresponding projection screen, further execute the following operations:
determining a to-be-detected area for performing brightness detection on the projection picture according to a preset brightness detection requirement;
and calculating the brightness of the position of the preset feature point in the region to be detected so as to detect the brightness.
Based on the hardware structure of the device, the embodiment of the brightness detection method of the projection picture is provided.
It should be noted that, at present, the method for detecting the brightness of the image projected by the Micro LED mainly includes: the Micro LED Micro display supports independent red, green or blue modes, a red, green or blue projection picture displayed by the Micro LED through single-channel projection is collected by a color camera, and then brightness detection is carried out on the basis of the projection picture. However, as shown in fig. 3, since the color camera collects the projection image together with a part of the background color, and since the glasses are transparent, the black part projected by the Micro LED Micro display always coincides with the background color, i.e. the boundary of the black area in the projection image cannot be distinguished, so that the brightness detection cannot be accurately performed on the projection image.
In summary, when the brightness of the projection image projected and displayed by the Micro LED is detected, the accuracy of the brightness detection is poor because the boundary of the black area in the projection image cannot be distinguished.
In view of the above problems, the present invention provides a method for detecting brightness of a projection image.
It should be noted that the brightness detection method for a projection screen according to the present invention is applicable to the detection device which is developed specifically for brightness detection of a projection image projected and displayed by a Micro LED, or a device such as a personal computer and having a program compiling function, and for convenience of understanding and explanation, in each embodiment of the brightness detection method for a projection screen according to the present invention, a terminal device is used instead of the detection device or the device having the program compiling function as an execution main body of the brightness detection method for a projection screen according to the present invention.
Referring to fig. 2, in a first embodiment of the method for detecting brightness of a projected picture according to the present invention, the method for detecting brightness of a projected picture includes:
step S10, generating a checkerboard image with a boundary according to a preset image projection logic, wherein the image projection logic is constructed on the basis of basic lines of which the number is greater than or equal to one;
when the terminal equipment detects the brightness of a projection picture projected and displayed by the Micro LED, firstly, a checkerboard image with a boundary to be projected is generated according to an image projection logic which is constructed in advance based on basic lines of which the number is more than or equal to one.
Specifically, for example, a worker who performs brightness detection on a projection picture projected and displayed by the Micro LED constructs an image projection logic capable of enabling the Micro LED to project and display a checkerboard image with boundaries based on one or more basic lines through a custom operation. Then, the terminal device transmits the image projection logic generated based on the user-defined operation of the worker to the Micro LED through the data interface between the terminal device and the Micro LED which needs to perform the brightness detection of the projection picture at present, so that the Micro LED loads the image projection logic to generate a checkerboard image with a boundary which needs to be subjected to projection display as shown in fig. 4.
Step S20, carrying out projection display on the checkerboard image and acquiring a corresponding projection picture;
after generating the checkerboard image with the boundary to be projected, the terminal device performs projection display on the checkerboard image with the boundary, and acquires a projection picture for performing projection display on the checkerboard image with the boundary through a preset industrial camera.
It should be noted that, in the present embodiment, the preset industrial camera may specifically be a color camera.
Specifically, for example, the terminal device is connected in advance in communication with a color camera provided in a kit for performing brightness detection on a projection screen projected and displayed by the Micro LED. After transmitting the image projection logic generated based on the user-defined operation of the operator to the Micro LED, so that the Micro LED loads the image projection logic to generate a checkerboard image with a boundary, which needs to be subjected to projection display as shown in fig. 4, the terminal device controls the Micro LED to perform projection display on the checkerboard image with the boundary, and then further controls a connected color camera to collect a projection picture when the Micro LED projects and displays the checkerboard image with the boundary (the collected projection picture is shown in fig. 5, it can be seen from fig. 5 that the checkerboard image projected by the Micro LED has an obvious boundary).
Step S30, analyzing the projection picture to perform brightness detection according to the boundary of the checkerboard image in the projection picture.
After acquiring a projection picture for projection display of a checkerboard image with a boundary, the terminal device analyzes the projection picture, so that a black area in projection is accurately distinguished according to the boundary of the checkerboard image displayed in the projection picture, and then brightness detection of the projection picture is accurately performed.
It should be noted that, in this embodiment, the terminal device may specifically adopt any mature image analysis or image processing technology to perform an analysis operation on the acquired projection picture. It should be understood that, based on different design requirements of practical applications, in different possible embodiments, the terminal device may use different image analysis or image processing technologies to analyze the projection picture, and the brightness detection method for the projection picture according to the present invention is not specifically limited to what kind of image analysis or image processing technology is used by the terminal device, and how to analyze the projection picture.
In addition, in this embodiment, the terminal device may specifically adopt any mature brightness detection standard to perform brightness detection on the projection picture. The brightness detection method of the projection picture of the invention also does not specifically limit the brightness detection standard adopted by the terminal equipment and the brightness detection process of the projection picture.
Specifically, for example, referring to the application scenario shown in fig. 6, after the terminal device acquires, through a connected color camera, a projection picture when the Micro LED is controlled to perform projection display on a checkerboard image with boundaries as shown in fig. 4, the terminal device further performs binarization processing on the projection picture shown in fig. 5 by using any mature image processing technology, and performs threshold separation on a single black block or a single white block in a black-and-white block image obtained through the binarization processing, so as to extract a position point of the whole black-and-white block image key for statistics and calculation of luminance information, thereby obtaining an accurate luminance detection result of the projection picture.
In the present embodiment, in the black-and-white block image obtained by the application scene terminal device performing binarization processing on the projection screen as shown in fig. 6, since the upper left corner position is darkened and the white block region cannot be generated, the luminance information of the white region cannot be counted. In this regard, the terminal device performs threshold separation for a single block, and performs brightness detection in a manner of taking out all key position points of the black-and-white block image to perform statistics and calculation of brightness information, thereby ensuring the accuracy of brightness detection for the projection picture.
In the embodiment, when the brightness of a projection picture projected and displayed by a Micro LED is detected through a terminal device, firstly, a checkerboard image with a boundary to be projected is generated according to an image projection logic which is constructed in advance based on basic lines of which the number is greater than or equal to one; after generating a checkerboard image with a boundary to be projected, the terminal device performs projection display on the checkerboard image with the boundary, and acquires a projection picture for performing projection display on the checkerboard image with the boundary through a preset industrial camera; after acquiring a projection picture for projection display of a checkerboard image with a boundary, the terminal device analyzes the projection picture, so that a black area in projection is accurately distinguished according to the boundary of the checkerboard image displayed in the projection picture, and then brightness detection of the projection picture is accurately performed.
Compared with the traditional brightness detection mode of the projection picture, the Micro LED projects the checkerboard image with the boundary, so that the accurate brightness detection is carried out on the projection picture corresponding to the checkerboard image according to the boundary of the checkerboard image in the projection picture based on image analysis. The problem that brightness detection cannot be carried out due to the fact that the boundary of the black area in the projection cannot be distinguished is solved, and the accuracy of the brightness detection is effectively improved.
Further, on the basis of the first embodiment of the brightness detection method for a projection screen according to the present invention, a second embodiment of the brightness detection method for a projection screen according to the present invention is proposed. The main difference between the second embodiment of the brightness detection method for a projected picture of the present invention and the first embodiment of the brightness detection method for a projected picture of the present invention is that, in this embodiment, the brightness detection method for a projected picture of the present invention may further include:
step S40, constructing an image projection logic based on a basic line comprising a plurality of block segments, wherein the colors of pixel points of two adjacent block segments in the plurality of block segments are black and white respectively, and the number of the basic line is more than or equal to one.
It should be noted that, in this embodiment, each of the one or more basic lines used for constructing the image projection logic includes a plurality of block segments, and the number of the block segments is determined based on the checkerboard image with boundaries that needs to be generated. In addition, in a plurality of blocks of the one or more basic lines, the colors of pixel points of any two adjacent block segments are black and white respectively, so that the method can be used for constructing an image projection logic capable of generating a checkerboard image with boundaries and including a black block area and a white block area.
The terminal device constructs an image projection logic for generating a checkerboard image with boundaries and including a black block area and a white block area through one or more pre-generated basic lines which include a plurality of block sections, and the colors of pixel points of any two adjacent block sections in the plurality of block sections are black and white respectively.
It should be noted that, in this embodiment, a worker performing brightness detection on a projection picture projected and displayed by a Micro LED defines and generates one or more basic lines that include a plurality of blocks and have black and white pixel colors of any two adjacent blocks in the plurality of blocks, through a custom operation, so that a terminal device performs construction of an image projection logic based on the basic lines.
Further, in a possible embodiment, the step S40 may include:
step S401, copying the basic line to obtain a copied line of the basic line;
the method comprises the steps that the terminal equipment obtains a pre-generated basic line which comprises a plurality of block sections, wherein the colors of pixel points of any two adjacent block sections in the plurality of block sections are black and white respectively, and then the terminal equipment copies the basic line to obtain a plurality of copied lines similar to the basic line.
Step S402, in the plurality of block segments of the copy line, performing preset color adjustment on block segments in which two adjacent pixel points are respectively black and white to construct the image projection logic.
After copying one or more basic lines to obtain a plurality of copied lines similar to the basic lines, namely in an image composed of the basic lines and the copied lines, the terminal device performs preset color adjustment on block sections, of which the colors of two adjacent pixel points in the plurality of block sections of the copied lines are black and white, respectively, so that the terminal device determines the processes of copying the basic lines and performing color adjustment on the block sections of the copied lines as image projection logic for generating a checkerboard image with boundaries and including black block areas and white block areas.
It should be noted that the preset color adjustment is to perform black and white adjustment on the color of the pixel point of the block segment in the copy line.
Specifically, for example, referring to the schematic application scenario shown in fig. 7, assuming that a worker performing brightness detection on a projection image projected and displayed by the Micro LED performs a custom operation, a defined and generated basic line includes four block segments, and the colors of respective pixel points of the four block segments from left to right are white, black, white, and black, respectively. Therefore, after obtaining the basic line, the terminal device performs the copy operation on the basic line to obtain an image which consists of a black block area and a white block area and consists of three copy lines, and then, the terminal device performs the original pixel point color distribution of four block segments of the first copy line and the fourth copy line in the vertical direction on the image, wherein the four block segments are as follows: and adjusting the white, black, white and black into black, white, black and white, so that the terminal equipment can determine the original processes of adjusting the black and white colors of the copied basic line and the original pixel point color distribution of the four blocks of the copied basic line as image projection logic for generating the checkerboard image comprising the black block area and the white block area.
In this embodiment, the terminal device constructs an image projection logic for generating a checkerboard image with a boundary and including a black block area and a white block area by one or more pre-generated basic lines which include a plurality of block sections, and the colors of pixel points of any two adjacent block sections in the plurality of block sections are black and white, respectively. Therefore, a worker who performs brightness detection on a projection picture projected and displayed by the Micro LED does not need to perform a large number of complicated operations to generate an image needing projection, and only needs to define one or a plurality of basic lines, the terminal equipment can automatically construct an image projection logic based on the basic lines, so that the Micro LED can generate a checkerboard image which is provided with a boundary and comprises a black block area and a white block area according to the image projection logic for projection and display, the operation is simplified to the greatest extent, and the detection efficiency of the brightness detection on the projection picture projected and displayed by the Micro LED is improved.
Further, on the basis of the first embodiment of the brightness detection method for a projection screen according to the present invention, a third embodiment of the brightness detection method for a projection screen according to the present invention is proposed. The main difference between the third embodiment of the brightness detection method for a projection screen according to the present invention and the first embodiment of the brightness detection method for a projection screen according to the present invention is that, in this embodiment, the step S30 in the first embodiment of the present invention, which analyzes the projection screen to perform brightness detection according to the boundary of the checkerboard image in the projection screen, may include:
step S301, analyzing the projection picture to determine the corner position of the checkerboard image boundary in the projection picture;
after the terminal device acquires a projection picture of the Micro LED for projection display of the checkerboard image with the boundary through an industrial camera, the terminal device analyzes and determines the positions of all corner points of the boundary of the checkerboard image displayed by the projection picture through any mature image analysis technology or image processing technology.
Step S302, calculating the brightness of the projection picture according to the corner position to detect the brightness.
The terminal equipment performs statistics and calculation of brightness information through determining each corner position of the boundary of the checkerboard image displayed by the projection picture, so that an accurate brightness detection result of the projection picture is obtained.
Further, in a possible embodiment, the step S301 may include:
step S3011, determining a preset custom image frame, wherein the custom image frame comprises corners of a checkerboard image boundary;
step S3012, analyze the projection frame in the custom image frame to determine the corner position of the corner located at the checkerboard image boundary.
It should be noted that, in this embodiment, through a user-defined operation, in a projection picture obtained by the industrial camera when the Micro LED performs projection display on a checkerboard image with a boundary, positions, lengths, widths, and coordinate positions of a plurality of image frames including corners of the checkerboard image boundary are roughly defined by a worker performing brightness detection on the projection picture projected and displayed by the Micro LED, so as to mainly analyze corner positions at the corners of the inner boundary of each image frame.
After the terminal device acquires a projection picture of the Micro LED in the projection display process aiming at the checkerboard image with the boundary through an industrial camera, a worker for performing brightness detection on the projection picture projected and displayed by the Micro LED can define a plurality of user-defined image frames in the projection picture through user-defined operation.
Specifically, for example, referring to the application scenario shown in fig. 8, a worker of a terminal device performing brightness detection on a projection screen projected and displayed by a Micro LED may roughly define the positions, lengths, widths, and coordinate positions of 4 image frames including corners of a checkerboard image boundary in the projection screen projected and displayed by the Micro LED with respect to the checkerboard image with the boundary, and perform a segmentation threshold and focus calculation operation by using any mature image processing technique to calculate left positions of four corner points of the checkerboard image as a leavtop (X0, Y0), a rigtop (X1, Y1), a leavbottom (X2, Y2), and a righttotom (X3, Y3), respectively.
In this embodiment, after the terminal device acquires, by an industrial camera, a projection picture obtained when the Micro LED performs projection display on a checkerboard image with a boundary, each corner position of the boundary of the checkerboard image displayed on the projection picture is analyzed and determined by any mature image analysis technology or image processing technology. The terminal equipment performs statistics and calculation of brightness information through determining each corner position of the boundary of the checkerboard image displayed by the projection picture, so that an accurate brightness detection result of the projection picture is obtained.
Compared with the traditional brightness detection mode of the projection picture, the brightness detection method of the projection picture provided by the invention considers the situation that the brightness distribution of the left and right areas of the projection picture of the Micro LED is uneven, and adopts the threshold separation aiming at a single block to take out all key position points of a black and white block image in a checkerboard image displayed in the projection picture to carry out the statistics and calculation of the brightness information so as to carry out the brightness detection, thereby further ensuring the accuracy of the brightness detection aiming at the projection picture.
Further, on the basis of the first embodiment of the brightness detection method for a projection screen according to the present invention, a fourth embodiment of the brightness detection method for a projection screen according to the present invention is proposed. The main difference between the fourth embodiment of the brightness detection method for a projection picture according to the present invention and the first embodiment of the brightness detection method for a projection picture according to the present invention is that, in this embodiment, step S20 in the first embodiment may include:
step S201, determining feature points according to a preset brightness detection requirement;
it should be noted that, in this embodiment, the preset brightness detection requirement may be specifically determined by the terminal device according to the adopted standard for performing brightness detection.
When the terminal equipment detects the brightness of a projection picture projected and displayed by the Micro LED, the preset brightness detection requirement is determined by analyzing any mature brightness detection standard, then, brightness detection staff for the projection picture projected and displayed by the Micro LED are received, and the characteristic points defined by self-defined operation are carried out based on the brightness detection requirement.
Step S202, projection display is carried out on the checkerboard image, and enhancement display is carried out on the characteristic points in a corresponding projection picture;
the terminal equipment performs brightness detection on a projection picture projected and displayed by the Micro LED, immediately performs projection display on a generated checkerboard image with boundaries after determining a feature point defined by self-defining operation based on brightness detection requirements, and performs enhanced display on the feature point by adopting a laser irradiation mode at the position of the feature point in the projection picture when the checkerboard image is projected and displayed in the process of displaying the checkerboard image.
In this embodiment, when a worker performs a brightness detection operation on a projection screen projected and displayed by the Micro LED to define a feature point based on a brightness detection requirement, the worker defines information such as a coordinate position of the feature point. In this way, the terminal device can project laser light to the coordinate position of each determined feature point in a projection picture formed when the Micro LED projects and displays the checkerboard image with the boundary through the additional laser projection device according to the coordinate position information, so as to realize enhanced display of each feature point in the checkerboard image.
And step S203, acquiring a projection picture containing the feature points subjected to enhanced display.
After the characteristic points are subjected to enhanced display in a laser irradiation mode at the positions of the characteristic points in the projection picture when the checkerboard image is projected and displayed by the terminal equipment, the projection picture currently containing the characteristic points subjected to enhanced display is acquired by controlling a pre-connected industrial camera.
Specifically, for example, referring to the application scenario shown in fig. 9, the projection picture acquired by the terminal device by controlling the color camera to perform enhanced display on the feature points includes 1-5 feature points, and the 5 feature points are all located at the boundary position of the checkerboard image with the boundary and at the position where the black block area and the white block area meet each other.
It should be noted that, in this embodiment, based on different design requirements of practical applications, in any other feasible implementation scenarios, the terminal device may also perform enhancement display on feature points greater than 5 or less than 5 in a projection picture for performing enhancement display, and control the color camera to capture the feature points. The brightness detection method of the projection picture of the invention is not limited by the specific number of the characteristic points.
Further, in a possible embodiment, after performing projection display on the checkerboard image and acquiring a corresponding projection picture in step S20, the method further includes:
step S50, determining a to-be-detected area for brightness detection of the projection picture according to a preset brightness detection requirement;
and step S60, calculating the brightness of the position of the preset feature point in the region to be detected so as to detect the brightness.
In this embodiment, the preset feature point is a point located at a junction position between a black block area and a white block area on a checkerboard image including the black block area and the white block area displayed on the projection screen.
Specifically, for example, referring to the application scenario shown in fig. 10, a brightness detection worker is performed on a projection picture projected and displayed by a Micro LED, and performs a custom operation based on a brightness detection requirement to roughly define a to-be-detected region in which brightness detection is required in the acquired projection picture, and then, a terminal device mainly analyzes a feature point located at a junction position between a black block region and a white block region in the to-be-detected region through an arbitrarily mature image analysis technology, so as to calculate respective brightness of the black block region and the white block region at the junction position according to a position where the feature point is acquired.
It should be noted that, in this embodiment, when the terminal device calculates the respective luminances of the black block area and the white block area in the application scene shown in fig. 10, firstly, the terminal device performs sorting adjustment on the positions of the collected feature points to obtain the coordinate positions of the respective feature points of the black block area and the white block area through summary statistics, and then obtains the pixel values of the black and white areas corresponding to the 16 areas shown in fig. 11, and further calculates the ratio of black to white in the projection picture displayed by current projection.
In this embodiment, the terminal device determines feature points defined by a brightness detection worker for a projection screen projected and displayed by the Micro LED and performing a custom operation based on a brightness detection requirement, immediately performs projection display for a generated checkerboard image with a boundary, and performs enhanced display for the feature points by using a laser irradiation method at positions of the feature points in the projection screen when the checkerboard image is projected and displayed in a display process for the checkerboard image. And acquiring a projection picture currently containing the feature points subjected to enhanced display by controlling a pre-connected industrial camera. And determining a region to be detected for brightness detection of the projection picture according to the brightness detection requirement, and calculating the brightness of the position of the preset feature point in the region to be detected to detect the brightness.
Compared with the traditional brightness detection mode of the projection picture, the Micro LED projects the checkerboard image with the boundary, so that the accurate brightness detection is carried out on the projection picture corresponding to the checkerboard image according to the boundary of the checkerboard image in the projection picture based on image analysis. The problem that brightness detection cannot be carried out due to the fact that the boundary of the black area in the projection cannot be distinguished is solved, and the accuracy of the brightness detection is effectively improved.
In addition, referring to fig. 12, an embodiment of the present invention further provides a brightness detection apparatus for a projection screen, including:
the image generation module 10 is configured to generate a checkerboard image with a boundary according to a preset image projection logic, where the image projection logic is constructed based on basic lines of which the number is greater than or equal to one;
the projection acquisition module 20 is configured to perform projection display on the checkerboard image and acquire a corresponding projection picture;
and a brightness detection module 30, configured to analyze the projection picture to perform brightness detection according to a boundary of the checkerboard image in the projection picture.
Optionally, the brightness detection apparatus for a projection screen according to the present invention includes:
the image logic construction module is used for constructing image projection logic based on a basic line comprising a plurality of block segments, wherein the colors of pixel points of two adjacent block segments in the block segments are black and white respectively, and the number of the basic line is more than or equal to one.
Optionally, the image logic construction module includes:
the line copying unit is used for copying the basic line to obtain a copied line of the basic line;
and the color adjusting unit is used for performing preset color adjustment on block sections with black and white colors of two adjacent pixel points in the plurality of block sections of the copied line to construct and obtain the image projection logic.
Optionally, the brightness detection module 30 includes:
the image analysis unit is used for analyzing the projection picture to determine the corner position of the checkerboard image boundary in the projection picture;
and the brightness detection unit is used for calculating the brightness of the projection picture according to the corner position so as to detect the brightness.
Optionally, the image parsing unit is further configured to determine a preset custom image frame, where the custom image frame includes a corner of a checkerboard image boundary; and analyzing the projection picture in the self-defined image frame to determine the corner position of the corner positioned at the checkerboard image boundary.
Optionally, the projection acquisition module 20 comprises:
the point location determining unit is used for determining a characteristic point according to a preset brightness detection requirement;
the projection display unit is used for carrying out projection display on the checkerboard image and carrying out enhanced display on the characteristic points in a corresponding projection picture;
and the acquisition unit is used for acquiring the projection picture containing the feature points subjected to enhanced display.
Optionally, the brightness detection module 30 of the brightness detection apparatus for a projection image according to the present invention is further configured to determine, according to a preset brightness detection requirement, a to-be-detected region for performing brightness detection on the projection image; and calculating the brightness of the position where the preset feature point is located in the region to be detected so as to detect the brightness.
The functional steps executed by the functional modules of the brightness detection apparatus for a projected picture according to the present invention can refer to the embodiments of the brightness detection method for a projected picture according to the present invention, and are not described herein again.
Furthermore, an embodiment of the present invention further provides a computer storage medium, where a brightness detection program of a projection screen is stored on the computer storage medium, and when the brightness detection program of the projection screen is executed by a processor, the operation described in the above embodiments of the brightness detection method of a projection screen of the present invention is implemented.
Furthermore, an embodiment of the present invention further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the computer program implements the operations described in the embodiments of the brightness detection method for a projection screen according to the present invention.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity/action/object from another entity/action/object without necessarily requiring or implying any actual such relationship or order between such entities/actions/objects; the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
For the apparatus embodiment, since it is substantially similar to the method embodiment, it is described relatively simply, and reference may be made to some descriptions of the method embodiment for relevant points. The above-described apparatus embodiments are merely illustrative, in that elements described as separate components may or may not be physically separate. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the invention. One of ordinary skill in the art can understand and implement it without inventive effort.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be substantially or partially embodied in the form of a software product, where the computer software product is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above, and includes several instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the brightness detection method for a projection screen according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A method for detecting the brightness of a projection picture is characterized by comprising the following steps:
generating a checkerboard image with a boundary according to a preset image projection logic, wherein the image projection logic is constructed on the basis of basic lines of which the number is greater than or equal to one;
carrying out projection display on the checkerboard image and acquiring a corresponding projection picture;
and analyzing the projection picture to detect the brightness according to the boundary of the checkerboard image in the projection picture.
2. The method for detecting brightness of a projection screen according to claim 1, wherein the base line includes a plurality of block segments, the method further comprising:
the method comprises the steps of constructing an image projection logic based on a basic line comprising a plurality of block segments, wherein the colors of pixel points of two adjacent block segments in the block segments are black and white respectively, and the number of the basic line is larger than or equal to one.
3. The method for detecting brightness of a projection screen according to claim 2, wherein the step of constructing an image projection logic based on a base line including a plurality of block segments comprises:
copying the basic line to obtain a copied line of the basic line;
and in the block sections of the copied lines, carrying out preset color adjustment on block sections with black and white colors of two adjacent pixel points respectively to construct and obtain the image projection logic.
4. The method for detecting brightness of a projected picture according to claim 1, wherein said step of parsing said projected picture for brightness detection based on the boundaries of checkerboard images in said projected picture comprises:
analyzing the projection picture to determine the corner position of the checkerboard image boundary in the projection picture;
and calculating the brightness of the projection picture according to the corner position to detect the brightness.
5. The method as claimed in claim 4, wherein the step of analyzing the projection picture to determine the corner positions of the checkerboard image boundaries in the projection picture comprises:
determining a preset self-defined image frame, wherein the self-defined image frame comprises corners of a checkerboard image boundary;
and analyzing the projection picture in the self-defined image frame to determine the corner position of the corner positioned at the boundary of the checkerboard image.
6. The method for detecting brightness of a projection screen according to claim 1, wherein the step of performing projection display on the checkerboard image and acquiring a corresponding projection screen comprises:
determining characteristic points according to a preset brightness detection requirement;
carrying out projection display on the checkerboard image, and carrying out enhanced display on the feature points in a corresponding projection picture;
and acquiring a projection picture containing the feature points subjected to the enhanced display.
7. The method for detecting brightness of a projection screen according to claim 1, wherein after the step of performing projection display on the checkerboard image and acquiring the corresponding projection screen, the method further comprises:
determining a to-be-detected area for performing brightness detection on the projection picture according to a preset brightness detection requirement;
and calculating the brightness of the position of the preset feature point in the region to be detected so as to detect the brightness.
8. A luminance detection device for a projection screen, comprising:
the system comprises an image generation module, a detection module and a display module, wherein the image generation module is used for generating a checkerboard image with boundaries according to preset image projection logic, and the image projection logic is constructed on the basis of basic lines of which the number is greater than or equal to one;
the projection acquisition module is used for carrying out projection display on the checkerboard image and acquiring a corresponding projection picture;
and the brightness detection module is used for analyzing the projection picture to detect the brightness according to the boundary of the checkerboard image in the projection picture.
9. A brightness detection apparatus for projecting a picture, characterized by comprising: a memory, a processor and a brightness detection program of a projection picture stored on the memory and operable on the processor, the brightness detection program of the projection picture implementing the steps of the brightness detection method of the projection picture according to any one of claims 1 to 7 when executed by the processor.
10. A computer storage medium, characterized in that the computer storage medium stores thereon a brightness detection program of a projection screen, the brightness detection program of the projection screen realizing the steps of the brightness detection method of the projection screen according to any one of claims 1 to 7 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110992027.3A CN113709433A (en) | 2021-08-26 | 2021-08-26 | Method, device and equipment for detecting brightness of projection picture and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110992027.3A CN113709433A (en) | 2021-08-26 | 2021-08-26 | Method, device and equipment for detecting brightness of projection picture and computer storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113709433A true CN113709433A (en) | 2021-11-26 |
Family
ID=78655595
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110992027.3A Pending CN113709433A (en) | 2021-08-26 | 2021-08-26 | Method, device and equipment for detecting brightness of projection picture and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113709433A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115643384A (en) * | 2022-10-14 | 2023-01-24 | 邹位 | Data and detection system based on video acquisition |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH03160426A (en) * | 1989-11-20 | 1991-07-10 | Fujitsu General Ltd | Projector device |
| JP2002365718A (en) * | 2001-06-04 | 2002-12-18 | Hitachi Ltd | Multidisplay device and regulating method for the same |
| US20080084510A1 (en) * | 2006-10-06 | 2008-04-10 | Seiko Epson Corporation | Projection display apparatus and projection display method |
| JP2014060549A (en) * | 2012-09-14 | 2014-04-03 | Ricoh Co Ltd | Illuminance output device, luminance output device and image projection device |
| CN107371004A (en) * | 2017-08-23 | 2017-11-21 | 无锡北斗星通信息科技有限公司 | A kind of method of colour image projection |
| CN110769232A (en) * | 2019-08-12 | 2020-02-07 | 成都极米科技股份有限公司 | Brightness detection method, device and system of ultra-short focus projector |
| CN110769229A (en) * | 2019-07-10 | 2020-02-07 | 成都极米科技股份有限公司 | Method, device and system for detecting color brightness of projection picture |
-
2021
- 2021-08-26 CN CN202110992027.3A patent/CN113709433A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH03160426A (en) * | 1989-11-20 | 1991-07-10 | Fujitsu General Ltd | Projector device |
| JP2002365718A (en) * | 2001-06-04 | 2002-12-18 | Hitachi Ltd | Multidisplay device and regulating method for the same |
| US20080084510A1 (en) * | 2006-10-06 | 2008-04-10 | Seiko Epson Corporation | Projection display apparatus and projection display method |
| JP2014060549A (en) * | 2012-09-14 | 2014-04-03 | Ricoh Co Ltd | Illuminance output device, luminance output device and image projection device |
| CN107371004A (en) * | 2017-08-23 | 2017-11-21 | 无锡北斗星通信息科技有限公司 | A kind of method of colour image projection |
| CN110769229A (en) * | 2019-07-10 | 2020-02-07 | 成都极米科技股份有限公司 | Method, device and system for detecting color brightness of projection picture |
| CN110769232A (en) * | 2019-08-12 | 2020-02-07 | 成都极米科技股份有限公司 | Brightness detection method, device and system of ultra-short focus projector |
Non-Patent Citations (3)
| Title |
|---|
| V MOHANA MANIGANDA BABU ET AL.: "Efficient brightness adaptive deep-sea image stitching using biorthogonal multi-wavelet transform and harris algorithm", 《2017 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL (I2C2)》, 22 March 2018 (2018-03-22) * |
| 刘直芳等: "基于视觉模型的车型动态定位", 《计算机工程与应用》, no. 8, 11 March 2003 (2003-03-11) * |
| 孙进康: "多媒体教室投影机亮度在线自动检测方法", 《中国教育技术装备》, no. 16, 4 November 2015 (2015-11-04) * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115643384A (en) * | 2022-10-14 | 2023-01-24 | 邹位 | Data and detection system based on video acquisition |
| CN115643384B (en) * | 2022-10-14 | 2023-06-30 | 上海正项信息科技有限公司 | Data and detection system based on video acquisition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102193651B (en) | Equipment, method and system for identifying laser point | |
| KR102595704B1 (en) | Image detection method, device, electronic device, storage medium, and program | |
| KR101353110B1 (en) | Projection image area detecting device, projection image area detecting system, and projection image area detecting method | |
| US9560327B2 (en) | Projection system and projection method | |
| US8953048B2 (en) | Information processing apparatus and control method thereof | |
| CN112272292B (en) | Projection correction method, apparatus and storage medium | |
| US9432645B2 (en) | Information processing method and electronic device | |
| CN111896232B (en) | Optical machine module testing method, equipment, system and computer readable storage medium | |
| JP2008015706A (en) | Image processor | |
| US8752967B2 (en) | Projection system and image processing method thereof | |
| US20200389632A1 (en) | Projection calibration system and projection calibration method thereof | |
| WO2016031190A1 (en) | Information processing device and recognition support method | |
| CN109359644A (en) | Character image uniformity comparison method, apparatus, storage medium and electronic equipment | |
| US20230074060A1 (en) | Artificial-intelligence-based image processing method and apparatus, electronic device, computer-readable storage medium, and computer program product | |
| CN113709433A (en) | Method, device and equipment for detecting brightness of projection picture and computer storage medium | |
| TW201512676A (en) | Image analyzing system and method | |
| JP2018182593A (en) | Image processing apparatus and image processing method | |
| JP2019148940A (en) | Learning processing method, server device, and reflection detection system | |
| CN113407461A (en) | Interface test method and device, electronic equipment and storage medium | |
| TWI737049B (en) | Projection calibration system and projection calibration method thereof | |
| WO2022262848A1 (en) | Image processing method and apparatus, and electronic device | |
| TW201820295A (en) | Method and system for modular display frame | |
| WO2022105277A1 (en) | Projection control method and apparatus, projection optical machine, and readable storage medium | |
| JP6696800B2 (en) | Image evaluation method, image evaluation program, and image evaluation device | |
| KR102191529B1 (en) | System and Method of Multi-Projection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |