CN111935470B - Projector and optical machine control method thereof - Google Patents
Projector and optical machine control method thereof Download PDFInfo
- Publication number
- CN111935470B CN111935470B CN202011031249.0A CN202011031249A CN111935470B CN 111935470 B CN111935470 B CN 111935470B CN 202011031249 A CN202011031249 A CN 202011031249A CN 111935470 B CN111935470 B CN 111935470B
- Authority
- CN
- China
- Prior art keywords
- shape
- preset
- projector
- parameter
- projection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/315—Modulator illumination systems
- H04N9/3155—Modulator illumination systems for controlling the light source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3191—Testing thereof
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Electric Information Into Light Information (AREA)
- Projection Apparatus (AREA)
Abstract
The invention discloses a projector optical machine control method and a projector, wherein the projector comprises an optical machine, and the projector optical machine control method comprises the following steps: acquiring the projection shape of a projection area of optical machine imaging when a projector works; acquiring shape parameters of the projection shape; and if the shape parameter is determined to be out of the preset shape parameter range, the light source of the optical machine is turned off. The technical scheme of the invention is beneficial to improving the use safety of the projector.
Description
Technical Field
The invention relates to the technical field of projectors, in particular to a projector and a projector optical-machine control method.
Background
Along with the improvement of living standard of people, people also use more and more projectors. Most projector optical machines are instruments using strong light sources, the illumination of the light sources is high, the temperature is high during use, and particularly, some optical machines with high power and high brightness are used. When the fire is shielded by dark inflammable, the temperature in the irradiated area of the inflammable is easy to exceed the ignition point, and a fire is caused.
Disclosure of Invention
The invention mainly aims to provide a projector light machine control method, aiming at improving the use safety of a projector.
In order to achieve the above object, the present invention provides a method for controlling an optical engine of a projector, wherein the projector comprises a camera device and an optical engine, and the method for controlling the optical engine of the projector comprises the following steps:
acquiring the projection shape of a projection area of optical machine imaging when a projector works;
acquiring shape parameters of the projection shape;
and if the shape parameter is determined to be out of the preset shape parameter range, the light source of the optical machine is turned off.
Optionally, before the step of turning off the light source of the light engine, the method further includes:
obtaining the maintaining time length of the shape parameter outside the preset shape parameter range;
and when the maintaining time length is determined to be greater than or equal to the preset time length, the light source of the optical machine is turned off.
Optionally, before the step of turning off the light source of the optical machine, determining that the duration of the maintenance is greater than or equal to a preset duration, the step of turning off the light source of the optical machine further includes:
obtaining a comparison difference value between the shape parameter and the maximum value or the minimum value of a preset shape parameter range;
and acquiring the preset time length according to the comparison difference, wherein the absolute value of the comparison difference is inversely related to the length of the preset time length.
Optionally, the step of obtaining the preset duration according to the comparison difference includes:
acquiring a mapping table between the comparison difference and a preset time length;
and acquiring corresponding preset time length from the mapping table according to the comparison difference.
Optionally, the step of obtaining the preset duration according to the comparison difference includes:
acquiring a functional relation between the comparison difference and a preset time length;
and calculating the preset time length according to the comparison difference and the functional relation.
Optionally, the step of obtaining the projection shape of the projection area imaged by the optical engine when the projector is in operation includes:
the image acquisition device is arranged close to the optical machine, the position of an image acquisition area of the image acquisition device is adjusted, so that the image acquisition area covers the projection area of the optical machine, and the projection shape of the projection area is obtained through the image acquisition device.
Optionally, the step of obtaining the shape parameters of the projection shape comprises:
acquiring a parameter type corresponding to the projection shape according to the projection shape;
and respectively acquiring specific parameter values of each parameter type.
Optionally, the step of determining that the shape parameter is outside the preset shape parameter range includes:
acquiring specific parameter values of various parameter types;
and comparing the specific parameter value of each parameter type with the preset shape parameter range of the corresponding parameter type, and determining that each specific parameter value is out of the corresponding preset shape parameter range.
The invention also provides a projector optical machine control method, and the projector optical machine control method comprises the following steps:
acquiring the projection shape of a projection area of optical machine imaging when a projector works;
acquiring a preset shape of a projection area imaged by an optical machine;
and if the similarity between the projection shape and the preset shape is lower than the preset similarity value, closing the light source of the optical machine.
Optionally, before the step of turning off the light source of the light engine, the method further includes:
obtaining the maintaining time length of which the similarity between the projection shape and the preset shape is lower than a preset similarity value;
and determining that the maintaining time length is greater than or equal to the preset time length, and turning off a light source of the optical machine.
Optionally, before the step of determining that the duration is greater than or equal to the preset duration, the method further comprises:
obtaining a comparison difference value between the similarity of the projection shape and the preset shape and a preset similarity value;
and acquiring the preset time length according to the comparison difference, wherein the size of the comparison difference is inversely related to the length of the preset time length.
Optionally, the step of obtaining the preset duration according to the comparison difference includes:
acquiring a mapping table between the comparison difference and a preset time length;
and acquiring corresponding preset time length from the mapping table according to the comparison difference.
Optionally, the step of obtaining the preset duration according to the comparison difference includes:
acquiring a functional relation between the comparison difference and a preset time length;
and calculating the preset time length according to the comparison difference and the functional relation.
The present invention also provides a projector, including: the projector light control method comprises the steps of a memory, a processor and an overtemperature protection program of a switch projection light source, wherein the overtemperature protection program of the switch projection light source is stored on the memory and can be operated on the processor; the projector optical machine control method comprises the following steps:
acquiring the projection shape of a projection area of optical machine imaging when a projector works;
acquiring shape parameters of the projection shape;
and if the shape parameter is determined to be out of the preset shape parameter range, the light source of the optical machine is turned off.
The present invention also provides a projector, including: the projector light control method comprises the steps of a memory, a processor and an overtemperature protection program of a switch projection light source, wherein the overtemperature protection program of the switch projection light source is stored on the memory and can be operated on the processor; the projector optical machine control method comprises the following steps:
acquiring the projection shape of a projection area of optical machine imaging when a projector works;
acquiring a preset shape of a projection area imaged by an optical machine;
and if the similarity between the projection shape and the preset shape is lower than the preset similarity value, closing the light source of the optical machine.
In the technical scheme of the invention, the projection shape of the projection area of the optical machine imaging when the projector works is firstly obtained; then obtaining shape parameters of the projection shape according to the projection shape; and then, determining that the shape parameter is outside the preset shape parameter range, turning off the light source of the optical machine, thus, comparing the currently acquired shape parameter of the projection shape with the preset shape parameter range to judge whether a shielding object exists in the current state of the optical machine, and turning off the light source of the optical machine in time when the shielding object is possibly ignited by high temperature to avoid the shielding object from being ignited, thus the use of the projector becomes safe and reliable, and the projector is beneficial to the use of a user.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the structures shown in the drawings without creative efforts.
FIG. 1 is a schematic flow chart diagram illustrating an embodiment of a method for controlling a projector;
FIG. 2 is a schematic flow chart illustrating a method for controlling a projector according to another embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a projector according to an embodiment of the invention;
FIG. 4 is a schematic view of the working principle of the projector of the present invention without any obstacle in front of the carriage;
FIG. 5 is a schematic diagram of an operating principle of the projector according to an embodiment of the present invention when an obstacle is in front of the optical engine;
FIG. 6 is a schematic diagram of an operating principle of another embodiment of the projector according to the present invention when an obstacle is in front of the optical engine;
fig. 7 is a schematic circuit diagram of a projector according to an embodiment of the invention.
The reference numbers illustrate:
10 projector, 20 obstacle;
100 master control circuits and 200 optical machines;
300 camera, 510 speaker;
520 indicator light, 600 memory;
700 temperature sensor, 800 timer;
900 distance sensor.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that all the directional indicators (such as up, down, left, right, front, and rear … …) in the embodiment of the present invention are only used to explain the relative position relationship between the components, the movement situation, etc. in a specific posture (as shown in the drawing), and if the specific posture is changed, the directional indicator is changed accordingly.
In addition, the descriptions related to "first", "second", etc. in the present invention are for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, "and/or" in the whole text includes three schemes, taking a and/or B as an example, including a technical scheme, and a technical scheme that a and B meet simultaneously; in addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.
The invention mainly provides a projector optical machine control method which is mainly applied to a projector 10 to improve the use safety of the projector 10.
The details of the projector light control method will be mainly described below.
Referring to fig. 1 to 7, in an embodiment of the present invention, the projector 10 includes an optical engine 200, and the projector optical engine control method includes the following steps:
s10, acquiring the projection shape of the projection area imaged by the optical engine 200 when the projector 10 is in operation;
s20, obtaining shape parameters of the projection shape;
s30, if the shape parameter is determined to be outside the preset shape parameter range, the light source of the optical machine 200 is turned off.
Specifically, in the present embodiment, when the projector 10 is in operation, a projection area for imaging by the optical engine 200 will be formed on a wall or a curtain, and the content to be played by the projector 10 will be displayed in the projection area. The shape of the projection area can be various, such as rectangle, square, and circle. There are many ways to obtain the shape of the projection area, for example, by an image acquisition device, the image acquisition device is disposed near the optical engine 200, and the position of the image acquisition area of the image acquisition device is adjusted so that the image acquisition area covers the projection area of the optical engine 200, and the projection shape of the projection area is obtained by the image acquisition device. Therefore, the projection shape of the projection area can be completely acquired by the image acquisition device, and the accuracy of acquiring the projection shape is improved. The image acquisition device can comprise a camera device 300, the camera device 300 shoots, analyzes the shot image and confirms the shape of the projection area. Of course, in some embodiments, the detection may be performed by a light sensor, a plurality of light sensors may be disposed to cover the projection area, and the shape of the projection area may be determined according to the light intensity sensed by each light sensor.
The manner in which the projection shape is obtained by image processing is explained below with reference to another embodiment.
And the camera captures the image of the projection area for identification. The flow of identifying rectangles is as follows: firstly, a gray image is captured from a camera, and then Gaussian filtering is carried out on the gray image. And processing the gray level image after Gaussian filtering to obtain a gray level histogram, extracting a threshold value, and then performing binarization processing. And finally, extracting the contour of the binarized image.
After the projection shape of the projection area is determined, the shape parameters corresponding to the shape are obtained according to the projection shape. The determined projection shape is analyzed in many ways, for example, the determined projection shape is compared with a pre-stored graph, the graph with the highest similarity is used as an analysis result, and all lines in the graph can be analyzed, including the shape, the position and the like, so that the shape parameters of the projection shape are determined according to the analysis result. Shape parameters include parameters that determine the projected shape, such as a rectangle, including long and short sides, and a ratio of long to short sides, such as 16:9, 4:3, etc. Of course, the proportion obtained in the actual detection process is not necessarily the standard, and may be blocked by a bond occlusion object, etc., and may be 16:7, 15:8, etc. When the projection shape is a circle or an ellipse, the shape parameter can be determined by an equation of the circle or an equation of the ellipse.
The preset shape parameter range is the shape parameter of the projection shape in the case where there is no obstruction in front of the projector 10. Since the projection shape is a preset shape of the projector 10, preset shape parameters corresponding to the projection shape are prestored in the projector 10. The preset shape parameter range is allowed to appear on the basis of the preset shape parameters by considering factors such as errors, actual working conditions and the like, normal watching is not influenced, and the range of potential safety hazards is not brought. Taking a rectangle as an example, the aspect ratio of the rectangle is 16:9 (the preset shape parameter), and when the aspect ratio (the shape parameter) of the obtained projection shape is 16.01:9.01, it is considered as an allowable condition within the preset shape parameter range, and the optical engine 200 and the projector 10 continue to operate. However, when the aspect ratio (shape parameter) of the acquired projection shape is 16:8, it is considered that the allowable range is exceeded in the range without the preset shape parameter, at this time, a shelter exists in front of the optical engine 200, at this time, the light source of the optical engine 200 is turned off, and the optical engine 200 stops operating.
Referring to fig. 5 and 6, the area a and the area B in fig. 5 and 6 jointly form a projection area of the optical engine 200, where the area a is an effective area of the projection area, that is, a projection shape of the optical engine 200, and the area B is an area blocked by the obstacle 20. In fig. 5, the area covered by the obstacle 20 is large, one end of the projection area is covered, and the rest shape is still rectangular; in fig. 6, the area blocked by the obstacle 20 is small, and the remainder is non-rectangular.
In this embodiment, the projection shape of the projection area imaged by the optical engine 200 when the projector 10 works is first obtained; then obtaining shape parameters of the projection shape according to the projection shape; then, determining that the shape parameter is outside the preset shape parameter range, the light source of the optical machine 200 is turned off, thus, by comparing the currently acquired shape parameter of the projection shape with the preset shape parameter range, whether a shielding object exists in the optical machine 200 in the current state can be judged, when the shielding object is possibly ignited by high temperature, the light source of the optical machine 200 is turned off in time, the shielding object is prevented from being ignited, thus the use of the projector 10 becomes safe and reliable, and the use of the projector 10 by a user is facilitated.
In some embodiments, in order to minimize the influence on the user, and improve the accuracy and the practicability of the determination, before the step of turning off the light source of the optical machine 200, the method further includes: obtaining the maintaining time length of the shape parameter outside the preset shape parameter range; and when the maintaining time length is determined to be greater than or equal to the preset time length, the light source of the optical machine 200 is turned off. In this embodiment, if the time for the shielding object to shield the optical machine 200 is short, it is considered that the light source of the optical machine 200 is not enough to make the shielding object reach the ignition point in the short time. That is, instead of immediately turning off the light source of the optical engine 200 when a blocking object is detected, the timer 800 or other methods are used to calculate the time duration for the blocking object to maintain the current position, that is, the time duration for the shape parameter to be maintained outside the preset shape parameter range. When the maintaining time of the shielding object at the current position is longer than or equal to the preset time, the shielding object is considered to have the risk of reaching the ignition point. At this time, the light source of the optical machine 200 should be turned off to avoid safety accidents. The duration of the acquired shape parameter outside the preset shape parameter range may be timed by the timer 800, or may be calculated by an external timing device.
In some embodiments, before the step of turning off the light source of the light engine 200 when the maintaining time period is determined to be greater than or equal to the preset time period, the method further includes:
obtaining a comparison difference value between the shape parameter and the maximum value or the minimum value of a preset shape parameter range; and acquiring the preset time length according to the comparison difference, wherein the absolute value of the comparison difference is inversely related to the length of the preset time length.
Specifically, in this embodiment, the preset time length is not a fixed value, but a corresponding preset time length is selected according to a difference between the currently detected shape parameter and the preset shape parameter. When the difference between the currently calculated shape parameter and the preset shape parameter is large, it indicates that the part of the current optical machine 200 which is shielded is large, and at this time, the preset time that can be given is short (more shielding is provided, and the shielded object is easy to burn); when the difference between the currently obtained shape parameter and the preset shape parameter is smaller, it indicates that the part of the current optical machine 200 that is shielded is smaller, and at this time, it can be given that the preset duration can be slightly longer (the shielding is less, and the shielding object is not easy to burn).
Specifically, the difference between the shape parameter and the maximum or minimum of the preset shape parameter range is first compared. Since it has been previously determined that the current shape parameter is outside the preset shape parameter range, comparing the difference means that the current shape parameter is greater than the magnitude of the maximum value of the preset shape parameter range, or the current shape parameter is less than the magnitude of the minimum value of the preset shape parameter range. The larger the amplitude larger than the maximum value or the larger the amplitude smaller than the minimum value is, the larger the shielding object shields the optical machine 200 at the moment is, the combustion is easy, and the obtained preset time is shorter; the smaller the amplitude larger than the maximum value is or the smaller the amplitude smaller than the minimum value is, it indicates that the shielding object shields the optical machine 200 to be smaller and not easy to burn, and the acquired preset time is longer. Taking the preset ratio of the rectangle as 16:9 as an example, when the detected actual shape parameters are 16:8 and 16:7 respectively, 16:8 is slightly deformed compared with 16:7, which means that the occlusion is less, and then 16:8 is slightly longer than the preset duration obtained by 16: 7. When the detected actual shape parameters are 17:9 and 20:9, respectively, 17:9 is slightly deformed compared to 20:9, indicating less occlusion, and thus 17:9 is slightly longer than the preset time period obtained by 20: 9.
There are many ways how to obtain the preset time length according to the absolute value of the comparison difference, and several embodiments are described below.
Through the form of a mapping table, the step of obtaining the preset time length according to the comparison difference value comprises the following steps: acquiring a mapping table between the comparison difference and a preset time length; and acquiring corresponding preset time length from the mapping table according to the comparison difference. In this embodiment, a mapping table of the comparison difference and the preset time length is stored in the storage device of the projector 10, different comparison differences correspond to different preset time lengths, the larger the comparison difference is, the shorter the preset time length is, and the smaller the comparison difference is, the longer the preset time length is. And acquiring the corresponding preset time length from the mapping table through the currently calculated comparison difference value. The method is convenient to obtain, has small calculation amount and can effectively improve the reaction speed.
Calculating according to a preset functional relation, wherein the step of obtaining the preset duration according to the comparison difference comprises the following steps: acquiring a functional relation between the comparison difference and a preset time length; and calculating the preset time length according to the comparison difference and the functional relation. In this embodiment, the functional relationship may be a binary primary function, such as a downward-sloping straight line equation, or a quadratic function, such as a part of a parabola, or the like. The specific function can be determined according to the specific actual situation.
In some embodiments, in order to obtain more accurate shape parameters of the acquired projection shape, the step of acquiring the shape parameters of the projection shape includes: acquiring a parameter type corresponding to the projection shape according to the projection shape; and respectively acquiring specific parameter values of each parameter type. Specifically, in this embodiment, first, the corresponding parameter categories are obtained according to the projection shapes, where the parameter categories include types and numbers, that is, some projection shapes may only need one parameter category to be limited, and some projection shapes may need multiple parameter categories. Taking a rectangle as an example, the rectangle includes long sides and short sides, and the parameter classes affecting the rectangle include the perpendicularity of the long sides and the short sides in addition to the aspect ratio mentioned in the above embodiment. When the verticality of the long side and the short side changes, the fact that the corners of the preset rectangle are blocked is indicated. Specifically, how to judge whether the contour is a rectangle or not may consider the following parameter categories, whether the contour is a convex shape or not, whether the number of corners is four or not, and whether the angles of the four corners are all 90 °. And after the parameter types needing to be referred are obtained, specific parameter values of the parameter types are respectively obtained. After each parameter value is obtained, the parameter values are compared with the corresponding preset parameter range. Therefore, the change of the shape parameters can be considered as much as possible, so that the difference between the projection shape and the preset shape is quantized, the preset duration can be better acquired, and the judgment accuracy can be improved. Specifically, the step of determining that the shape parameter is outside the preset shape parameter range includes: acquiring specific parameter values of various parameter types; and comparing the specific parameter value of each parameter type with the preset shape parameter range of the corresponding parameter type, and determining that each specific parameter value is out of the corresponding preset shape parameter range. In this embodiment, on the basis of obtaining a plurality of parameter categories, all the obtained parameter categories are compared with the corresponding preset shape parameter ranges. When there are multiple parameter types, it is only necessary that one of the parameter values is outside the corresponding preset shape parameter range, which indicates that there is a shielding object in front of the optical machine 200, and certainly, if there are multiple parameter values outside the corresponding preset shape parameter range, it can be more indicative that there is a shielding object in front of the light source of the optical machine 200.
It should be noted that, in some embodiments, in order to obtain a more accurate preset time length, the weights occupied by the parameter categories may be the same or different, and when calculating the influence of each parameter category, a corresponding weight coefficient is set in front of the parameter category. And acquiring the preset time length according to the specific numerical value of each parameter category and the weight occupied by the specific numerical value, so that the acquisition precision of the preset time length is further improved.
The invention also provides a projector optical machine control method, the projector 10 comprises an optical machine 200, and the projector optical machine control method comprises the following steps:
s100, acquiring the projection shape of the projection area imaged by the optical machine 200 when the projector 10 works;
s200, acquiring a preset shape of a projection area imaged by the optical machine 200;
s300, determining that the similarity between the projected shape and the preset shape is lower than the preset similarity value, turning off the light source of the optical machine 200.
Specifically, in the present embodiment, when the projector 10 is in operation, a projection area for imaging by the optical engine 200 will be formed on a wall or a curtain, and the content to be played by the projector 10 will be displayed in the projection area. The shape of the projection area can be various, such as rectangle, square, and circle. There are many ways to obtain the shape of the projection area, for example, by an image acquisition device, the image acquisition device is disposed near the optical engine 200, and the position of the image acquisition area of the image acquisition device is adjusted so that the image acquisition area covers the projection area of the optical engine 200, and the projection shape of the projection area is obtained by the image acquisition device. Therefore, the projection shape of the projection area can be completely acquired by the image acquisition device, and the accuracy of acquiring the projection shape is improved. The image acquisition device can comprise a camera device 300, the camera device 300 shoots, analyzes the shot image and confirms the shape of the projection area. Of course, in some embodiments, the detection may be performed by a light sensor, a plurality of light sensors may be disposed to cover the projection area, and the shape of the projection area may be determined according to the light intensity sensed by each light sensor.
The preset shape of the projection area imaged by the optical engine 200 is obtained, and the preset shape is preset by the projector 10 according to the user requirement, and may be a circle, a square, a rectangle, an ellipse, or the like. The preset shape is a shape of a projection shape in a case where there is no blocking object in front of the projector 10. And after the projection shape and the preset shape of the projection area are determined, comparing the acquired projection shape with the preset shape. When the similarity between the projection shape and the preset shape is high, it indicates that there is no blocking object in front of the optical machine 200 or the area blocked by the blocking object is small, and at this time, it can be considered as safe without turning off the light source when the optical machine is turned off. When the similarity between the projection shape and the preset shape is low, it indicates that there is no blocking object in front of the optical machine 200 or the area blocked by the blocking object is large, and at this time, it may be considered unsafe and the light source that needs to be turned off. Wherein, the similarity between the projection shape and the preset shape is the similarity between the projection shape and the preset shape. It should be noted that, the similarity determination not only compares the shapes, but also considers the proportions of the features in the shape graph, that is, whether the projection shape and the preset shape can be changed into the same shape by scaling up or down. For example, a rectangle of 16:9 is a preset figure, and when the collected figure is a rectangle of 16:8, since the rectangle of 16:8 cannot be enlarged or reduced by an equal ratio to obtain a rectangle of 16:9, the preset shape and the projection shape are different, and the similarity between the preset shape and the projection shape is not high.
In this embodiment, the projection shape of the projection area imaged by the optical engine 200 when the projector 10 works is first obtained; then acquiring the preset shape of the projection area imaged by the optical machine 200; and then determining that the similarity between the projection shape and the preset shape is lower than a preset similarity value, turning off the light source of the optical machine 200, thus, by comparing the currently acquired projection shape with the similarity between the preset shape and the projection shape, judging whether a shielding object exists in the optical machine 200 in the current state, and turning off the light source of the optical machine 200 in time when the shielding object is possibly ignited by high temperature, so as to avoid the shielding object from being ignited, thus the use of the projector 10 becomes safe and reliable, and the use of the projector 10 by a user is facilitated.
In some embodiments, in order to minimize the influence on the user, and improve the accuracy and the practicability of the determination, before the step of turning off the light source of the optical machine 200, the method further includes: obtaining the maintaining time length of which the similarity between the projection shape and the preset shape is lower than a preset similarity value; and determining that the maintaining time length is greater than or equal to the preset time length, and turning off the light source of the optical machine 200. In this embodiment, if the time for the shielding object to shield the optical machine 200 is short, it is considered that the light source of the optical machine 200 is not enough to make the shielding object reach the ignition point in the short time. That is, instead of immediately turning off the light source of the optical engine 200 when the presence of the blocking object is detected, the timer 800 or other methods are used to calculate the time duration for maintaining the current position of the blocking object, that is, the time duration for maintaining the similarity of the blocking object below the preset similarity value. When the maintaining time of the shielding object at the current position is longer than or equal to the preset time, the shielding object is considered to have the risk of reaching the ignition point. At this time, the light source of the optical machine 200 should be turned off to avoid safety accidents. The duration of the acquisition that the similarity between the projection shape and the preset shape is lower than the preset similarity value may be timed by the timer 800, or may be calculated by an external timing device.
In some embodiments, before the step of turning off the light source of the light engine 200 when the maintaining time period is determined to be greater than or equal to the preset time period, the method further includes: obtaining a comparison difference value between the similarity of the projection shape and the preset shape and a preset similarity value; and acquiring the preset time length according to the comparison difference, wherein the size of the comparison difference is inversely related to the length of the preset time length.
Specifically, in this embodiment, the preset time length is not a fixed value, but a corresponding preset time length is selected according to the similarity between the currently detected projection shape and the preset shape. When the difference between the currently acquired projection shape and the preset shape is large, it indicates that the part of the current optical machine 200 which is shielded is large, and at this time, the preset time which can be given is short (more shielding is provided, and the shielding object is easy to burn); when the difference between the currently acquired projection shape and the preset shape is small, it indicates that the part of the current optical machine 200 which is shielded is small, and at this time, the preset time can be given to be slightly longer (the shielding is small, and the shielding object is not easy to burn).
Specifically, since the similarity between the projected shape and the preset shape is smaller than the preset similarity value, comparing the difference means that the similarity between the current projected shape and the preset shape is smaller than the magnitude of the preset similarity value. The larger the amplitude smaller than the preset similarity value is, the more the shielding object shields the optical machine 200 at the moment is, the combustion is easy, and the obtained preset time is shorter; the smaller the amplitude smaller than the preset similarity value is, the smaller the blocking object blocks the optical machine 200 at this time, the burning is not easy, and the obtained preset time is longer. Taking the preset shape as a rectangle with a preset ratio of 16:9 as an example, when the detected projection shapes are a rectangle and a square with a preset ratio of 16:10, respectively, the rectangle with a ratio of 16:10 is slightly deformed compared with the square, which means that the occlusion is less, and thus the preset time length obtained by the rectangle with a ratio of 16:10 is slightly longer than that obtained by the square.
There are many ways how to obtain the preset time length according to the absolute value of the comparison difference, and several embodiments are described below.
Through the form of a mapping table, the step of obtaining the preset time length according to the comparison difference value comprises the following steps: acquiring a mapping table between the comparison difference and a preset time length; and acquiring corresponding preset time length from the mapping table according to the comparison difference. In this embodiment, a mapping table of the comparison difference and the preset time length is stored in the storage device of the projector 10, where different comparison differences correspond to different preset time lengths, and the larger the comparison difference is (the more the similarity is smaller than the preset similarity value), the shorter the preset time length is, the smaller the comparison difference is (the less the similarity is smaller than the preset similarity value), the longer the preset time length is. And acquiring the corresponding preset time length from the mapping table through the currently calculated comparison difference value. The method is convenient to obtain, has small calculation amount and can effectively improve the reaction speed.
Calculating according to a preset functional relation, wherein the step of obtaining the preset duration according to the comparison difference comprises the following steps: acquiring a functional relation between the comparison difference and a preset time length; and calculating the preset time length according to the comparison difference and the functional relation. In this embodiment, the functional relationship may be a binary primary function, such as a downward-sloping straight line equation, or a quadratic function, such as a part of a parabola, or the like. The specific function can be determined according to the specific actual situation.
In some embodiments, to further improve the accuracy of the detection and judgment, before the step of turning off the light source of the optical machine 200, the method further includes:
acquiring the current temperature of the obstacle 20;
determining that the current temperature of the obstacle 20 is higher than the preset safe temperature, the light source of the light machine 200 is turned off.
Specifically, in this embodiment, in order not to affect the use of the projector 10, the temperature of the obstacle 20 in front of the projector 10 is detected, and if the current temperature of the obstacle 20 is less than or equal to the preset safe temperature, it indicates that the temperature of the obstacle is not high, and the obstacle will not burn, and is still in a safe state, and the optical engine 200 does not need to be turned off. When the current temperature of the obstacle 20 is higher than the preset safe temperature, it indicates that the temperature of the obstacle is higher, and there is a safety hazard of burning, and the light source of the optical engine 200 should be turned off. The preset safe temperature can be 90-110 ℃, for example 100 ℃. There are many ways to obtain the temperature, such as by temperature sensor 700. The temperature sensor 700 can be an infrared temperature measurement sensor module, and the highest temperature measurement range can meet the requirement at 110 ℃.
In some embodiments, in order to prompt the user in time, after the step of determining that the shape parameter is outside the preset shape parameter range, the method further includes: and sending out prompt information.
The prompting message can be in many forms, such as short message, light message, sound message, vibration message, etc., and the voice prompt is taken as an example. Of course, in some embodiments, in order to prompt the user more effectively, a combination of the above prompting manners may be used, such as voice broadcasting and indicator light flashing prompting. The voice prompt may be performed through the speaker 510, and the played content is stored in the memory 600.
In some embodiments, in order to quickly put the projector 10 into use after the shutter is removed, the step of turning off the light source of the light machine 200 further includes:
when the shape parameter is determined to be within the preset shape parameter range, the light source of the optical machine 200 is turned on again.
The shape parameter is compared with the preset shape parameter range, and when the actual shape parameter is within the preset shape parameter range, the shielding object is considered to be removed, so that the projector 10 can work normally and safely. At this time, the projector 10 is turned back on.
The invention further provides a projector 10, where the projector 10 includes a memory 600, the memory 600 stores a program for implementing a method for controlling a projector light, and the projector 10 can execute the program in the memory 600 to implement the method, and the specific scheme of the method for controlling the projector light refers to the above embodiments.
The invention further proposes a projector 10, the projector 10 comprising:
a light engine 200, the light engine 200 comprising a light source;
the camera device 300 is arranged close to the optical machine 200, and a shooting area of the camera device 300 covers a projection area imaged by the optical machine 200; the image pickup device 300 picks up the projection shape of the projection area;
the main control circuit 100 is electrically connected to the optical engine 200 and the camera device 300, and turns on or off a light source of the optical engine according to the projection shape parameter of the projection area photographed by the camera device 300.
Specifically, in this embodiment, the image capturing device 300 and the temperature sensor 700 are arranged along the circumference of the optical machine 200 and are both disposed close to the optical machine 200. The temperature sensor 700 and the camera device 300 are both disposed on the housing of the projector 10, so that the temperature of the object in front of the optical engine 200 can be directly detected, and the projection shape of the projection area of the optical engine 200 can be collected. The temperature sensor 700 converts the detected data into a current or a voltage of different intensity. The camera device obtains the projection shape parameters of the projection area through shooting, and the parameters are input to the main control circuit in the form of current or voltage. The main control circuit 100 receives the parameters sent by the camera 300 and the temperature sensor 700, that is, receives the currents or voltages with different intensities. When the current or voltage sent by the camera device 300 triggers the main control circuit 100, the comparison circuit of the main control circuit 100 compares the received current and voltage with a preset current or voltage range, and when the current and voltage exceed the preset current or voltage range, triggers the switch circuit of the optical machine and turns off the power supply of the optical machine; when the current and the voltage are within the preset current or voltage range, the switch circuit of the optical machine is triggered, and the power supply of the optical machine is started.
In some embodiments, for more accurate control, when the current and the voltage received by the comparison circuit exceed the preset current or voltage range, the switching circuit of the optical machine is not directly triggered, but the temperature sensor is triggered to work. The temperature sensor may be directly electrically connected to the switch circuit of the optical machine, or may be electrically connected to the switch circuit of the optical machine through the main control circuit 10. The main control circuit 100 receives the detection parameter sent by the temperature sensor 700, and when the current or voltage intensity reaches a preset intensity, the main control circuit 100 is triggered to control the optical machine 200 to turn on or turn off the light source. Specifically, how to control may refer to the above embodiments, and details are not repeated.
It is noted that in some embodiments, the number of cameras may be set as desired in order to improve the accuracy of the acquisition of the projection shapes. For example, two image capturing devices are provided, specifically, the image capturing devices include two image capturing devices, one of the two image capturing devices is provided on the upper side or the lower side of the optical machine, and the other image capturing device is provided on the left side or the right side of the optical machine. In the two camera devices, the focal length of one of the two camera devices is larger than that of the other camera device, so that the projection pattern with higher quality can be obtained. In some embodiments, one of the two cameras is a color camera and the other is a black-and-white camera, which can be selected and invoked according to different working conditions.
In some embodiments, in order to improve the accuracy of turning on and off the light source of the optical engine 200, the projector 10 further includes a timer 800, the timer 800 is electrically connected to the main control circuit 100, and the timer 800 is used for calculating the time period for which the projected shape of the projected area of the optical engine 200 maintains the current shape.
In some embodiments, in order to timely remind the user of paying attention to the working state of the projector 10, the projector 10 further includes a speaker 510 and a memory 600, the speaker 510 and the memory 600 are connected to the main control circuit 100, the speaker 510 is used for voice broadcast, and the memory 600 is used for storing data of the voice broadcast. In order to facilitate the user to hear the voice content broadcasted by the speaker 510, the projector 10 includes a housing, and the speaker 510 is disposed on the housing.
In some embodiments, in order to timely remind the user of the working state of the projector 10, the projector 10 further includes an indicator lamp 520, and the indicator lamp 520 is electrically connected to the main control circuit 100. In order to facilitate the user to notice the projector 10 in time, the projector 10 includes a housing, and the indicator light 520 is disposed on a surface of the housing, which is adjacent to or opposite to a surface of the light engine 200 emitting light. In this manner, the indicator light 520 is advantageously visible to the user.
In some embodiments, in order to timely remind the user of paying attention to the working state of the projector 10, the projector 10 further includes an information sending device and a memory 600, the information sending device and the memory 600 are connected to the main control circuit 100, the information sending device is configured to send out information, and the memory 600 is configured to store data of the information. The information sending device can send information to a specified mobile terminal, such as a mobile phone, and can also send the information to terminal equipment, such as a display screen.
In some embodiments, the projector further includes a temperature sensor, the temperature sensor is electrically connected to the main control circuit, and the camera device and the temperature sensor are arranged along the circumferential direction of the optical machine. The camera device is arranged in the edge area of the upper side or the edge area of the lower side of the optical machine, and the center of the camera device and the center of the optical machine are on the same vertical line. Or the camera device is arranged at the edge area of the left side or the right side of the optical machine, and the center of the camera device and the center of the optical machine are on the same horizontal straight line.
Since the projection area of the projector is equivalent to an upward inclined projection area in the horizontal direction, the camera device 300 is arranged on the upper side of the light machine, and then the camera device 300 can be arranged to detect the front of the light machine. Then, when the parameters of the projection shape acquired by the camera 300 are not within the preset graphic parameter range, it can be considered that the optical machine is shielded by a blocking object, so that the camera 300 can be used for simply measuring the distance of the obstacle right in front of the optical machine at one time. When the projection area is arranged right below the optical machine, the projection area of the optical machine can be covered by the shooting area of the camera device only by slightly adjusting the deflection angle upwards. It is worth mentioning that, when the center of the camera device and the center of the optical machine are on the same horizontal straight line or the same vertical straight line, under the condition that the image collecting direction of the camera device is consistent with the projecting direction of the optical machine, the distance between the camera device and the projecting surface of the optical machine is equivalent to the distance between the optical machine and the projecting surface, thereby being beneficial to better collecting the image of the projecting area of the optical machine by the camera device.
In some embodiments, for better focusing of the image pickup device, the projector further comprises a distance detection device electrically connected with the main control circuit; the center of the distance sensor 900 is on the same vertical or horizontal straight line as the center of the camera. Through distance sensor 900's setting, can be swift acquire distance between distance sensor 900 and the camera shooting region, because distance sensor 900 is located same vertical plane with camera device for the distance is equivalent between the two distance and the parallel camera shooting region (projection area) of vertical plane, is favorable to the quick preliminary location of camera device. Of course, in some embodiments, in order to obtain a more accurate distance between the image capturing device and the image capturing area, the distance between the image capturing device and the image capturing area may be calculated by obtaining a deflection angle of the distance sensor 900, and taking the distance between the distance sensor 900 and the image capturing area as a hypotenuse, where the distance between the image capturing device and the image capturing area is a square edge corresponding to the deflection angle of the distance sensor 900, that is, the length of the square edge is a product of the length of the bevel and a sine value of the deflection angle.
In some embodiments, the temperature sensor 700 is disposed in an upper edge region of the optical machine 200, and a center of the temperature sensor 700 and a center of the optical machine 200 are on the same horizontal vertical line, under normal circumstances, a light ray at the center of the optical machine is stronger, and then, a temperature at the center is higher than that at a side, so that the temperature sensor 700 can detect a temperature right in front of the optical machine, which can reduce a detection range of the temperature sensor 700, and can obtain a maximum temperature of an obstacle to a certain extent, so as to facilitate timely processing.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and all modifications and equivalents of the present invention, which are made by the contents of the present specification and the accompanying drawings, or directly/indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (6)
1. A projector optical machine control method, the projector includes the optical machine, characterized by that, the projector optical machine control method includes the following steps:
acquiring the projection shape of a projection area of optical machine imaging when a projector works;
acquiring shape parameters of the projection shape;
if the shape parameter is determined to be out of the preset shape parameter range, the light source of the optical machine is turned off;
the step of obtaining shape parameters of the projected shape comprises:
acquiring a parameter type corresponding to the projection shape according to the projection shape; the projection shape comprises a rectangle, and the parameter categories of the rectangle comprise an aspect ratio, perpendicularity between a long side and a short side, whether the outline is a convex side, whether the number of vertex angles is four, and whether the angles of the four vertex angles are all 90 degrees;
respectively acquiring specific parameter values of each parameter type, setting a corresponding weight coefficient in front of each parameter type when calculating the influence of each parameter type, and acquiring preset time length according to the specific numerical value of each parameter type and the weight occupied by the parameter type;
before the step of turning off the light source of the optical machine, the method further comprises the following steps:
obtaining the maintaining time length of the shape parameter outside the preset shape parameter range;
determining that the maintaining time length is greater than or equal to a preset time length, and turning off a light source of the optical machine;
the step of determining that the maintaining duration is greater than or equal to the preset duration and turning off the light source of the optical machine further comprises the following steps:
obtaining a comparison difference value between the shape parameter and the maximum value or the minimum value of a preset shape parameter range;
and acquiring the preset time length according to the comparison difference, wherein the absolute value of the comparison difference is inversely related to the length of the preset time length.
2. The projector light control method as claimed in claim 1, wherein the step of obtaining the preset duration according to the comparison difference comprises:
acquiring a mapping table between the comparison difference and a preset time length;
and acquiring corresponding preset time length from the mapping table according to the comparison difference.
3. The projector light control method as claimed in claim 1, wherein the step of obtaining the preset duration according to the comparison difference comprises:
acquiring a functional relation between the comparison difference and a preset time length;
and calculating the preset time length according to the comparison difference and the functional relation.
4. The method of claim 1, wherein the step of obtaining the projection shape of the projection area imaged by the optical engine during operation of the projector comprises:
the image acquisition device is arranged close to the optical machine, the position of an image acquisition area of the image acquisition device is adjusted, so that the image acquisition area covers the projection area of the optical machine, and the projection shape of the projection area is obtained through the image acquisition device.
5. The projector light control method of claim 1 wherein said step of determining that the shape parameter is outside of a preset shape parameter range comprises:
acquiring specific parameter values of various parameter types;
and comparing the specific parameter values of each parameter type with the preset shape parameter ranges of the corresponding parameter types, and determining that any one of the specific parameter values is out of the corresponding preset shape parameter range.
6. A projector, characterized in that the projector comprises: a memory, a processor and an over-temperature protection program for switching a projection light source stored on the memory and operable on the processor, the over-temperature protection program for switching a projection light source implementing the steps of the projector light control method according to any of claims 1 to 5 when executed by the processor.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110220210.1A CN112995626B (en) | 2020-09-27 | 2020-09-27 | Projector optical machine control method and projector |
| CN202011031249.0A CN111935470B (en) | 2020-09-27 | 2020-09-27 | Projector and optical machine control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011031249.0A CN111935470B (en) | 2020-09-27 | 2020-09-27 | Projector and optical machine control method thereof |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110220210.1A Division CN112995626B (en) | 2020-09-27 | 2020-09-27 | Projector optical machine control method and projector |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111935470A CN111935470A (en) | 2020-11-13 |
| CN111935470B true CN111935470B (en) | 2021-03-26 |
Family
ID=73334277
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011031249.0A Active CN111935470B (en) | 2020-09-27 | 2020-09-27 | Projector and optical machine control method thereof |
| CN202110220210.1A Active CN112995626B (en) | 2020-09-27 | 2020-09-27 | Projector optical machine control method and projector |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110220210.1A Active CN112995626B (en) | 2020-09-27 | 2020-09-27 | Projector optical machine control method and projector |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN111935470B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112203069B (en) * | 2020-11-27 | 2021-04-23 | 深圳市当智科技有限公司 | Wide-screen projection method and system based on camera and readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103106648A (en) * | 2011-11-11 | 2013-05-15 | 株式会社理光 | Method and device for determining projection areas in images |
| CN104598034A (en) * | 2015-02-09 | 2015-05-06 | 联想(北京)有限公司 | Information processing method and information processing equipment |
| CN105959659A (en) * | 2016-04-28 | 2016-09-21 | 乐视控股（北京）有限公司 | Method for realizing projector adaptive adjustment and projector |
| CN107295320A (en) * | 2017-08-07 | 2017-10-24 | 上海青橙实业有限公司 | The control method and device of projection terminal |
| CN108140356A (en) * | 2015-09-17 | 2018-06-08 | 富士胶片株式会社 | Projection display device and method for controlling projection |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105915872B (en) * | 2016-06-06 | 2017-12-29 | 苏州佳世达光电有限公司 | The output intent and projection arrangement of image |
| JP2020079895A (en) * | 2018-11-14 | 2020-05-28 | キヤノン株式会社 | Projector, projection system, control method of projector, projection method, and program |
-
2020
- 2020-09-27 CN CN202011031249.0A patent/CN111935470B/en active Active
- 2020-09-27 CN CN202110220210.1A patent/CN112995626B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103106648A (en) * | 2011-11-11 | 2013-05-15 | 株式会社理光 | Method and device for determining projection areas in images |
| CN104598034A (en) * | 2015-02-09 | 2015-05-06 | 联想(北京)有限公司 | Information processing method and information processing equipment |
| CN108140356A (en) * | 2015-09-17 | 2018-06-08 | 富士胶片株式会社 | Projection display device and method for controlling projection |
| CN105959659A (en) * | 2016-04-28 | 2016-09-21 | 乐视控股（北京）有限公司 | Method for realizing projector adaptive adjustment and projector |
| CN107295320A (en) * | 2017-08-07 | 2017-10-24 | 上海青橙实业有限公司 | The control method and device of projection terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112995626A (en) | 2021-06-18 |
| CN111935470A (en) | 2020-11-13 |
| CN112995626B (en) | 2023-05-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2012104096A (en) | Projector | |
| KR101998639B1 (en) | Intelligent system for ignition point surveillance using composite image of thermal camera and color camera | |
| CN108846819B (en) | Laser cutting parameter acquisition method and device, electronic equipment and storage medium | |
| JP2015127668A (en) | Measurement device, system and program | |
| CN111935470B (en) | Projector and optical machine control method thereof | |
| CN111935469B (en) | Projector safe working method and projector | |
| CN107861170B (en) | Laser safety control device and method | |
| EP3401899B1 (en) | Method for controlling a display parameter of a mobile device and computer program product | |
| CN213342495U (en) | Safety projection terminal | |
| US20150241680A1 (en) | Image Measurement Device | |
| CN1132554C (en) | Electronic equipment having viewpoint detection apparatus | |
| CN111948891B (en) | Over-temperature protection method for switching projection light source and projector | |
| JP2008183933A (en) | Noctovision equipment | |
| CN212660271U (en) | Projector with a light source | |
| CN112861676A (en) | Smoke and fire identification marking method, system, terminal and storage medium | |
| CN112307825B (en) | Visual inspection method and device for automatic driving, electronic equipment and storage medium | |
| JP3115786B2 (en) | Flame detection device and flame detection method | |
| CN111402325A (en) | Automatic calibration method for interactive projection game | |
| JP3888528B2 (en) | Liquid level recognition processing apparatus and liquid level monitoring system | |
| JP2013106238A (en) | Marker detection and tracking device | |
| JP6833584B2 (en) | Lens meter | |
| CN111856866A (en) | Projection device and operation method thereof | |
| JPH0862155A (en) | Object 0bserving apparatus | |
| CN112070046A (en) | Cooking utensil fire identification method and system and readable storage medium | |
| JPH08159712A (en) | Pattern recognition method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |