CN113949853B - Projection system with environment adaptive adjustment capability - Google Patents

Projection system with environment adaptive adjustment capability Download PDF

Info

Publication number
CN113949853B
CN113949853B CN202111192709.2A CN202111192709A CN113949853B CN 113949853 B CN113949853 B CN 113949853B CN 202111192709 A CN202111192709 A CN 202111192709A CN 113949853 B CN113949853 B CN 113949853B
Authority
CN
China
Prior art keywords
projection
environment
change
foreign
foreign matters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111192709.2A
Other languages
Chinese (zh)
Other versions
CN113949853A (en
Inventor
昌学斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jinan Jingxiong Video Technology Co ltd
Original Assignee
Jinan Jingxiong Video Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jinan Jingxiong Video Technology Co ltd filed Critical Jinan Jingxiong Video Technology Co ltd
Priority to CN202111192709.2A priority Critical patent/CN113949853B/en
Publication of CN113949853A publication Critical patent/CN113949853A/en
Application granted granted Critical
Publication of CN113949853B publication Critical patent/CN113949853B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof
    • H04N9/315Modulator illumination systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

The invention relates to the technical field of projection, in particular to a projection system with environment adaptive adjustment capability and a method thereof, wherein the system comprises: an environment change detection unit configured to detect whether a surrounding environment is changed and to judge whether a foreign object enters the surrounding environment; and the environment change identification unit is configured for identifying the type of the change of the environment when the surrounding environment changes or foreign matters enter the surrounding environment, generating an environment change identification result, carrying out image identification on the foreign matters and carrying out track tracking on the foreign matters, and generating a foreign matter analysis result based on the image identification result of the foreign matters and the track tracking result of the foreign matters. The projection image processing method and the projection image processing device have the advantages that the projection parameters are adjusted or the image is repaired through detecting the environmental parameters of the projected surrounding environment and detecting and tracking foreign matters appearing in the projection image, so that the effect that the projection effect is changed along with the change of the environment is realized, and the projection quality is improved.

Description

Projection system with environment adaptive adjustment capability
Technical Field
The invention belongs to the technical field of projection, and particularly relates to a projection system and method with environment adaptive adjustment capability.
Background
The projection system is an optical system which illuminates an object and then images the object on a projection screen, is based on a motion tracking technology, and is suitable for any projector, liquid crystal display screen, LED large screen, plasma, digital video wall and the like. The projection system converts the interactive participant's actions into graphical image interactive feedback. The system has 24 sets of practical interactive effects and customizable high-resolution contents, and can realize an unequally projected area in the same industry so as to meet the interactive requirements of different users. In short, interactive projection systems allow users to experience unprecedented smooth interactive experiences by creating immersive interactive experiences.
Patent No. CN2006800549258A discloses a stereoscopic projection system for displaying stereopair images on a mirror sphere or parabolic screen and viewing stereoscopic effects together without using stereoscopic glasses. The invention can continuously and dynamically superpose the projection of the left and right pictures of the stereopair on the left and right eyes of the user respectively. This setting is independently implemented for each viewer at the same time. The stereoscopic projection system includes: a stereo projector individually assigned to each user and connected in series, a monitoring system for continuously and accurately determining the position of the eyes of the viewer, a self-correction device for mechanically self-correcting the stereo projector and the system optics, a video correction device, an automatic drive, a unit for forming a stereopair projection image in the stereo projector and coupled with the video correction device for video correcting the optimal parameters of the screen image.
The stereoscopic projection system improves the image quality through image correction and image, but only aims at the existing scene, and if the image in the existing scene is changed, the quality of the projection effect is reduced.
Therefore, it would be very significant to develop a method and system capable of improving the projection effect and quality according to the change of environment.
Disclosure of Invention
In view of the above, the main objective of the present invention is to provide a projection system and method with an environment adaptive adjustment capability, which adjust a projection parameter or repair a projection screen by detecting an environmental parameter of a projected ambient environment and detecting and tracking a foreign object appearing in the projection screen, so as to achieve an effect that a projection effect changes with a change in the environment, and improve the projection quality.
In order to achieve the purpose, the technical scheme of the invention is realized as follows:
a projection system with adaptive adjustment capability, the system comprising:
an environment change detection unit configured to detect whether a surrounding environment changes and to judge whether a foreign object enters the surrounding environment;
the environment change identification unit is configured for identifying the type of the change of the environment when the surrounding environment changes or foreign matters enter the surrounding environment, generating an environment change identification result, carrying out image identification on the foreign matters and carrying out track tracking on the foreign matters, and generating a foreign matter analysis result based on the image identification result of the foreign matters and the track tracking result of the foreign matters;
the projection correction unit is configured to correct the projection based on the environment change recognition result and the foreign object analysis result, and specifically includes: generating a projection correction parameter based on the environment change recognition result to correct the projection; and (4) image repairing is carried out on the projection based on the foreign matter analysis result so as to remove the interference of the foreign matter on the projection.
Further, the environment change detection unit includes: a physical environment change detection unit and a foreign object detection unit; the physical environment change detection unit includes: a detection part consisting of a judgment part and a plurality of sensors; the detection part is configured to sense environmental parameters in real time; the judging part is configured to judge whether an environmental change occurs based on the sensed environmental parameter; the foreign matter detection unit is configured to collect a projection picture in real time and perform light direction analysis on the projection picture so as to judge whether foreign matters enter the projection picture.
Further, the detection section includes: a temperature sensor, an illumination sensor and a humidity sensor; the judgment part judges whether the environment changes or not by using a preset judgment model after acquiring the environment parameters sensed by the sensors; the judgment model is expressed by the following formula:
Figure GDA0003703206360000031
wherein, A is the temperature parameter detected by the temperature sensor; b is an illumination parameter detected by an illumination sensor; c is a humidity parameter detected by a humidity sensor; x is a discrimination coefficient, and the value range is as follows: 5 to 10; p is the discrimination probability, the value of which changes along with the projection time, and the change rule of which satisfies the following formula: p =0.5T-2; wherein T is projection time; and when the value of the discrimination value calculated by the judgment model exceeds a set value, judging that the environment is changed.
Further, the method for the foreign object detection unit to determine whether a foreign object enters the projection picture comprises the following steps: collecting a projection picture in real time, analyzing the light direction of the projection picture to judge whether the light direction in the projection picture is abnormal or not, and judging that foreign matters appear in the projection picture when the light direction is abnormal; and if the light direction is not abnormal, judging that no foreign matter is present in the projection picture.
Further, the method for judging the abnormal light direction executes the following steps: analyzing the gradient change of the pixel values in the projection picture acquired in real time to judge whether the gradient change direction of the pixel values in the projection picture is abnormal or not; during judgment, defining the change of the pixel value from high to low as the positive direction of the gradient change, and defining the change of the pixel value from low to high as the negative direction of the gradient change, so as to generate a plurality of gradient change directions; and then performing direction difference and identity change analysis on all gradient change directions, which specifically comprises the following steps: aiming at a certain gradient change direction, judging whether included angles between one or more adjacent gradient change directions and the gradient change direction are within a set threshold value range or not; if yes, judging that no abnormity occurs; if not, judging that the abnormal condition occurs, and judging that the foreign matter occurs in the projection picture.
Further, the environment change recognition unit includes: an environment recognition unit and a foreign object recognition unit; the environment recognition unit is configured to compare the obtained discrimination value S with one or more set threshold value ranges to judge the type of the environment change; the types of the environmental changes at least include: temperature, illumination and humidity variations; the foreign matter identification unit is configured to collect projection pictures in real time, identify and lock foreign matters in the projection pictures, determine the motion track of the foreign matters according to the linked multi-frame projection pictures, and realize track tracking of the foreign matters.
Further, the method for identifying and locking the foreign object in the projection picture by the foreign object identification unit comprises the following steps: carrying out feature extraction on the projection picture to generate a feature map; the characteristic graph comprises characteristic information with different scales; performing region candidate identification on the feature map to obtain candidate region information of the projection picture; and comparing and identifying the candidate region information and the feature map with the trained foreign matter features to generate a foreign matter identification result, and locking the foreign matter part in the projection picture.
Further, the foreign object identification unit performs trajectory tracking based on the locked foreign object portion in each frame of the projection screen, and generates a result of the trajectory tracking.
Further, the projection correction unit performs image inpainting on the projection based on the foreign matter analysis result, so that the method for removing the interference of the foreign matter on the projection performs the following steps: converting pixels of the foreign object portion in the projection image by using a pixel conversion model, and converting the converted new pixels corresponding to the foreign object portionThe pixels are replaced to realize the repair of foreign body parts; the pixel conversion model is represented using the following formula:
Figure GDA0003703206360000051
Figure GDA0003703206360000052
wherein R is 101 、R 102 、R 103 、R 104 、 R 105 、R 108 、R 109 、R 110 、R 111 And R 112 The pixel values of six pixels are obtained by screening the peripheral symmetrical part by the corresponding pixel of the foreign body part to be replaced; PX is a pixel value of a corresponding pixel of the foreign substance portion to be replaced.
A projection method with environment adaptive adjustment capability.
Compared with the traditional method, the projection system and the method with the environment adaptive adjustment capability adjust the projection parameters or repair the picture by detecting the environmental parameters of the projected surrounding environment and detecting and tracking foreign matters appearing in the projected picture, thereby realizing the effect that the projection effect changes along with the change of the environment and improving the projection quality. The method is mainly realized by the following steps: 1. detection of the projection environment: the invention judges whether the projection environment is changed and the type of the change through the detection of the projection environment, the detection of the temperature, the humidity and the illumination intensity, so as to adjust the parameters of the projection and improve the quality of the projection; 2. detection of foreign matter: the invention judges whether the foreign matters enter the projection picture or not by detecting the foreign matters, and repairs each foreign matter in the projection picture according to the identification and tracking of the foreign matters so as to improve the projection quality.
Drawings
Fig. 1 is a schematic system diagram of a projection system with adaptive environment adjustment capability according to an embodiment of the present invention;
FIG. 2 is a schematic diagram illustrating the light direction of a projection system with adaptive environment adjustment capability and a method thereof according to an embodiment of the present invention;
FIG. 3 is a schematic diagram illustrating the principle of a foreign object entering a projection screen in the projection system and method with environment adaptive adjustment capability according to an embodiment of the present invention;
fig. 4 is a schematic diagram illustrating a principle of pixel conversion of a foreign object in the projection system and method with adaptive adjustment capability according to an embodiment of the present invention.
Detailed Description
The method of the present invention will be described in further detail below with reference to the accompanying drawings and embodiments of the invention.
Example 1
As shown in fig. 1, a projection system with adaptive environment adjustment capability, the system comprising:
an environment change detection unit configured to detect whether a surrounding environment changes and to judge whether a foreign object enters the surrounding environment;
the environment change identification unit is configured for identifying the type of the environment change when the surrounding environment changes or foreign matters enter the surrounding environment, generating an environment change identification result, carrying out image identification on the foreign matters and carrying out track tracking on the foreign matters, and generating a foreign matter analysis result based on the image identification result of the foreign matters and the track tracking result of the foreign matters;
the projection correction unit is configured to correct the projection based on the environment change recognition result and the foreign object analysis result, and specifically includes: generating a projection correction parameter based on the environment change recognition result to correct the projection; and image repairing is carried out on the projection based on the foreign matter analysis result so as to remove the interference of the foreign matter on the projection.
Referring to fig. 2, a change of light of a projection screen with the entry of foreign matter is shown in fig. 2. When a foreign object enters the projection screen, if the projection screen is adjusted, the projection quality is degraded. When the foreign matter enters the projection picture, the light of the projection picture can change, whether the foreign matter enters the projection picture or not is judged through the change of the direction of the light, the judging efficiency can be improved, the picture does not need to be identified in real time, and therefore the system efficiency is improved.
Referring to fig. 3, fig. 3 shows a scene in which a foreign object enters the projection screen. The position of the foreign matter in the projection picture can be changed, so that the position of the foreign matter in the projection picture needs to be recorded in real time, the change of the projection picture caused by the foreign matter is repaired in real time, and the projection quality is improved.
Referring to fig. 4, fig. 4 shows that when the projection screen is repaired, for pixel repairing, a plurality of pixels are randomly and symmetrically selected around a pixel to be repaired to perform pixel repairing, so that the quality of repairing can be improved.
Example 2
On the basis of the above embodiment, the environment change detection unit includes: a physical environment change detection unit and a foreign object detection unit; the physical environment change detection unit includes: a detection part consisting of a judgment part and a plurality of sensors; the detection part is configured to sense environmental parameters in real time; the judging part is configured to judge whether an environmental change occurs based on the sensed environmental parameter; the foreign matter detection unit is configured to collect a projection picture in real time and analyze the light direction of the projection picture so as to judge whether foreign matters enter the projection picture.
Specifically, the pixels are composed of small squares of the image, the small squares have a definite position and assigned color value, and the color and the position of the small squares determine the appearance of the image.
A pixel can be considered to be an indivisible unit or element in the entire image. Indivisible means that it cannot be cut into smaller units or elements, which exist in a single color cell. Each dot matrix image contains a certain number of pixels that determine the size of the image to be presented on the screen.
Example 3
On the basis of the above embodiment, the detection section includes: a temperature sensor, a light sensor and a humidity sensor; the judging part acquires the rings sensed by the sensorsAfter the environmental parameters are obtained, judging whether environmental changes occur or not by using a preset judgment model; the judgment model is expressed by the following formula:
Figure GDA0003703206360000081
wherein S is a discrimination value, and A is a temperature parameter detected by a temperature sensor; b is an illumination parameter detected by an illumination sensor;
c is a humidity parameter detected by a humidity sensor; x is a discrimination coefficient, and the value range is as follows: 5 to 10; p is the discrimination probability, the value of which changes along with the projection time, and the change rule of which satisfies the following formula: p =0.5T-2; wherein T is projection time; and when the value of the discrimination value calculated by the judgment model exceeds a set value, judging that the environment is changed.
Specifically, factors affecting the projection effect may cause the projection effect to be deteriorated due to environmental changes, in addition to the factors of the projection itself. Therefore, besides improving the projector or the projection device, the projector or the projection device also needs to monitor the environmental temperature, the illumination intensity and the humidity during projection, and adjust the projection effect according to the change of the environment, so as to improve the projection quality.
Specifically, a temperature sensor (temperature transducer) refers to a sensor that senses temperature and converts the sensed temperature into a usable output signal. The temperature sensor is the core part of the temperature measuring instrument and has a plurality of varieties. The measurement method can be divided into a contact type and a non-contact type, and the measurement method can be divided into a thermal resistor and a thermocouple according to the characteristics of sensor materials and electronic elements. The illumination sensor is a sensor used for detecting illumination intensity, namely illumination intensity for short, and the working principle is to convert the illumination intensity value into a voltage value, and is mainly used for cultivation of agricultural and forestry greenhouses and the like. A temperature sensor (temperature transducer) refers to a sensor that senses temperature and converts it into a usable output signal. The temperature sensor is the core part of the temperature measuring instrument and has a plurality of varieties. The measurement method can be divided into two types, namely contact type and non-contact type, and the measurement method can be divided into two types, namely thermal resistance and thermocouple, according to the characteristics of sensor materials and electronic elements. Human survival and social activities are closely related to humidity. With the development of modernization, it is difficult to find a domain independent of humidity. Due to the different application fields, the technical requirements for humidity sensors are also different. From the manufacturing point of view, the humidity sensor has different materials, structures and processes, and the performance and technical indexes (such as precision) of the humidity sensor are greatly different, so that the price is far from each other. For a user, when selecting a humidity sensor, the user needs to know what sensor is needed; under the condition that the financial resources of the user allow, the user can choose the products of which grades, balance the relation between the 'requirement and the possibility' well, and do not act blindly. From our perspective of the user, we find the following problems to be significant.
Example 4
On the basis of the above embodiment, the method for determining whether a foreign object enters the projection screen by the foreign object detection unit includes the following steps: collecting a projection picture in real time, analyzing the light direction of the projection picture to judge whether the light direction in the projection picture is abnormal or not, and judging that foreign matters appear in the projection picture when the light direction is abnormal; and if the light direction is not abnormal, judging that no foreign matter is present in the projection picture.
Specifically, if a foreign object appears in the projection screen, the projection effect is obviously reduced, and if the projection effect is not adjusted for the foreign object entering the projection screen, the projection quality is reduced.
Example 5
On the basis of the previous embodiment, the method for judging the abnormal light direction comprises the following steps: analyzing the gradient change of the pixel values in the projection picture acquired in real time to judge whether the gradient change direction of the pixel values in the projection picture is abnormal or not; during judgment, defining the change of the pixel value from high to low as the positive direction of the gradient change, and defining the change of the pixel value from low to high as the negative direction of the gradient change, so as to generate a plurality of gradient change directions; and then analyzing the direction difference and identity change of all gradient change directions, which specifically comprises the following steps: aiming at a certain gradient change direction, judging whether included angles between one or more adjacent gradient change directions and the gradient change direction are within a set threshold value range or not; if yes, judging that no abnormity occurs; if not, judging that the abnormal condition occurs, and judging that the foreign matter occurs in the projection picture.
Specifically, the gradient is intended to be a vector (vector) indicating that the directional derivative of a certain function at that point takes a maximum value along that direction, i.e., the function changes the fastest and the rate of change is the greatest (modulo of the gradient) along that direction (the direction of this gradient) at that point.
Example 6
On the basis of the above embodiment, the environment change identifying unit includes: an environment recognition unit and a foreign object recognition unit; the environment recognition unit is configured to compare the obtained discrimination value S with one or more set threshold value ranges to judge the type of the environment change; the types of the environment change at least comprise: temperature, illumination and humidity variations; the foreign matter identification unit is configured to collect projection pictures in real time, identify and lock foreign matters in the projection pictures, determine the motion track of the foreign matters according to the linked multi-frame projection pictures, and realize track tracking of the foreign matters.
Example 7
On the basis of the previous embodiment, the method for identifying and locking the foreign object in the projection picture by the foreign object identification unit comprises the following steps: carrying out feature extraction on the projection picture to generate a feature map; the characteristic graph comprises characteristic information with different scales; performing region candidate identification on the feature map to obtain candidate region information of the projection picture; and comparing and identifying the candidate region information and the feature map with the trained foreign matter features to generate a foreign matter identification result, and locking the foreign matter part in the projection picture.
Example 8
On the basis of the above embodiment, the foreign object recognition unit performs trajectory tracking based on the locked foreign object portion in each frame of the projection screen, and generates a result of trajectory tracking.
Specifically, when the repair is performed,
example 9
On the basis of the above embodiment, the method for image inpainting the projection by the projection correction unit based on the foreign object analysis result to remove the interference of the foreign object on the projection performs the following steps: converting pixels of a foreign matter part in a projected image by using a pixel conversion model, and replacing the pixels corresponding to the foreign matter part by using a new pixel obtained by conversion so as to repair the foreign matter part; the pixel conversion model is represented using the following formula:
Figure GDA0003703206360000111
Figure GDA0003703206360000112
wherein R is 101 、R 102 、R 103 、R 104 、 R 105 、R 108 、R 109 、R 110 、R 111 And R 112 The pixel values of six pixels are obtained by screening the peripheral symmetrical part by the corresponding pixel of the foreign body part to be replaced; PX is a pixel value of a corresponding pixel of the foreign substance portion to be replaced.
Specifically, when the foreign object enters the picture, the foreign object is greatly different from the projection picture, so that the pixels in the foreign object need to be repaired from outside to inside, and after the outermost layer of the pixels in the foreign object is repaired, the pixels are arranged inside layer by layer, so that the difference between each pixel and the pixels in the projection picture is reduced, and the projection quality is improved.
Example 10
A projection method with environment adaptive adjustment capability.
It can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes and related descriptions of the storage device and the processing device described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
Those of skill in the art would appreciate that the various illustrative elements, method steps, described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that programs corresponding to the elements, method steps may be located in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. To clearly illustrate this interchangeability of electronic hardware and software, various illustrative components and steps have been described above generally in terms of their functionality. Whether these functions are performed in electronic hardware or software depends on the particular application and property constraints of the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The terms "first," "second," and the like are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
The terms "comprises," "comprising," or any other similar term are intended to cover a non-exclusive inclusion, such that a process, method, article, or unit/apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or unit/apparatus.
So far, the technical solutions of the present invention have been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of the present invention is obviously not limited to these specific embodiments. Equivalent modifications or substitutions of the related art marks may be made by those skilled in the art without departing from the principle of the present invention, and the technical solutions after such modifications or substitutions will fall within the protective scope of the present invention.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.

Claims (6)

1. A projection system with adaptive adjustment capability, the system comprising:
an environment change detection unit configured to detect whether a surrounding environment changes and to judge whether a foreign object enters the surrounding environment;
the environment change identification unit is configured for identifying the type of the environment change when the surrounding environment changes or foreign matters enter the surrounding environment, generating an environment change identification result, carrying out image identification on the foreign matters and carrying out track tracking on the foreign matters, and generating a foreign matter analysis result based on the image identification result of the foreign matters and the track tracking result of the foreign matters;
the projection correction unit is configured to correct the projection based on the environment change recognition result and the foreign object analysis result, and specifically includes: generating a projection correction parameter based on the environment change identification result to correct the projection; based on the foreign matter analysis result, image repairing is carried out on the projection so as to remove the interference of the foreign matter on the projection; the environment change detection unit includes: a physical environment change detection unit and a foreign object detection unit; the physical environment change detection unit includes: a detection part consisting of a judgment part and a plurality of sensors; the detection part is configured to sense environmental parameters in real time; the judging part is configured to judge whether the environment change occurs based on the sensed environmental parameter; the foreign matter detection unit is configured to collect a projection picture in real time and analyze the light direction of the projection picture so as to judge whether foreign matters enter the projection picture;
the detection section includes: a temperature sensor, an illumination sensor and a humidity sensor; the judgment part judges whether the environment changes or not by using a preset judgment model after acquiring the environment parameters sensed by the sensors; the judgment model is expressed by the following formula:
Figure FDA0003767123420000011
wherein S is a discrimination value, and A is a temperature parameter detected by a temperature sensor; b is an illumination parameter detected by an illumination sensor; c is a humidity parameter detected by a humidity sensor; x is a discrimination coefficient, and the value range is as follows: 5 to 10; p is judgmentThe other probability, the value of which changes with the projection time, and the change rule of which satisfies the following formula: p =0.5T-2; wherein T is projection time; and when the value of the discrimination value calculated by the judgment model exceeds a set value, judging that the environment is changed.
2. The system of claim 1, wherein the method for the foreign object detection unit to determine whether a foreign object enters the projection screen comprises the steps of: collecting a projection picture in real time, analyzing the light direction of the projection picture to judge whether the light direction in the projection picture is abnormal or not, and judging that foreign matters appear in the projection picture when the light direction is abnormal; if the light direction is not abnormal, judging that no foreign matter is present in the projection picture.
3. The system of claim 2, wherein the method for determining the abnormal direction of the light beam comprises the steps of: analyzing gradient change of pixel values in the projection picture acquired in real time to judge whether the gradient change direction of the pixel values in the projection picture is abnormal or not; during judgment, defining the change of the pixel value from high to low as the positive direction of the gradient change, and defining the change of the pixel value from low to high as the negative direction of the gradient change, so as to generate a plurality of gradient change directions; and then performing direction difference and identity change analysis on all gradient change directions, which specifically comprises the following steps: aiming at a certain gradient change direction, judging whether included angles between one or more adjacent gradient change directions and the gradient change direction are within a set threshold value range or not; if yes, judging that no abnormity occurs; if not, judging that the abnormal condition occurs, and judging that the foreign matter occurs in the projection picture.
4. The system of claim 3, wherein the environment change identification unit comprises: an environment recognition unit and a foreign object recognition unit; the environment recognition unit is configured to compare the obtained discrimination value S with one or more set threshold value ranges to judge the type of the environment change; the types of the environment change at least comprise: temperature, illumination and humidity modification; the foreign matter identification unit is configured to collect projection pictures in real time, identify and lock foreign matters in the projection pictures, determine the motion track of the foreign matters according to the linked multi-frame projection pictures, and realize track tracking of the foreign matters.
5. The system as claimed in claim 4, wherein the method for identifying and locking the alien material in the projection screen by the alien material identification unit performs the following steps: performing feature extraction on the projection picture to generate a feature map; the characteristic graph comprises characteristic information with different scales; performing region candidate identification on the feature map to obtain candidate region information of the projection picture; and comparing and identifying the candidate region information and the feature map with the trained foreign matter features to generate a foreign matter identification result, and locking the foreign matter part in the projection picture.
6. The system of claim 5, wherein the alien material identification unit performs trajectory tracking based on the locked alien material portions in each frame of the projection screen to generate a result of trajectory tracking.
CN202111192709.2A 2021-10-13 2021-10-13 Projection system with environment adaptive adjustment capability Active CN113949853B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111192709.2A CN113949853B (en) 2021-10-13 2021-10-13 Projection system with environment adaptive adjustment capability

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111192709.2A CN113949853B (en) 2021-10-13 2021-10-13 Projection system with environment adaptive adjustment capability

Publications (2)

Publication Number Publication Date
CN113949853A CN113949853A (en) 2022-01-18
CN113949853B true CN113949853B (en) 2022-10-25

Family

ID=79330298

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111192709.2A Active CN113949853B (en) 2021-10-13 2021-10-13 Projection system with environment adaptive adjustment capability

Country Status (1)

Country Link
CN (1) CN113949853B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001157980A (en) * 1999-11-30 2001-06-12 Sony Corp Robot device, and control method thereof
KR101891328B1 (en) * 2017-02-27 2018-08-24 (주)에코메이텍 Eco-friendly smart lighting control system according to the biorhythm and environment change

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010075157A (en) * 1998-09-17 2001-08-09 오노 시게오 Method of adjusting optical projection system
JP2005283527A (en) * 2004-03-31 2005-10-13 Hitachi High-Technologies Corp Apparatus for detecting foreign substance
JP6236764B2 (en) * 2012-11-01 2017-11-29 株式会社リコー Image projection apparatus evaluation method, image projection apparatus, image projection apparatus manufacturing method, and image projection apparatus evaluation system
JP6414067B2 (en) * 2013-09-04 2018-10-31 日本電気株式会社 Projection device, projection device control method, projection device control device, and computer program therefor
CN104202547B (en) * 2014-08-27 2017-10-10 广东威创视讯科技股份有限公司 Method, projection interactive approach and its system of target object are extracted in projected picture
WO2019187455A1 (en) * 2018-03-27 2019-10-03 キヤノン株式会社 Image processing device, image display system, image processing method, and program

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001157980A (en) * 1999-11-30 2001-06-12 Sony Corp Robot device, and control method thereof
KR101891328B1 (en) * 2017-02-27 2018-08-24 (주)에코메이텍 Eco-friendly smart lighting control system according to the biorhythm and environment change

Also Published As

Publication number Publication date
CN113949853A (en) 2022-01-18

Similar Documents

Publication Publication Date Title
JP4997252B2 (en) How to identify the illumination area in an image
JP5764238B2 (en) Steel pipe internal corrosion analysis apparatus and steel pipe internal corrosion analysis method
CN111047568B (en) Method and system for detecting and identifying steam leakage defect
US20080266430A1 (en) Method and system for optimizing an image for improved analysis of material and illumination image features
US5033015A (en) Automated system for testing an imaging sensor
JP5168215B2 (en) Appearance inspection device
WO2007074770A1 (en) Defect inspection device for inspecting defect by image analysis
JP2010220197A (en) Device and method for detecting shadow in image
CN104135926A (en) Image processing device, image processing system, image processing method, and program
Christlein et al. A study on features for the detection of copy-move forgeries
JP7481956B2 (en) Inference device, method, program and learning device
US20130170756A1 (en) Edge detection apparatus, program and method for edge detection
CN113758932A (en) Lithium battery diaphragm defect vision system based on deep learning
CN110766683B (en) Pearl finish grade detection method and system
CN109375068A (en) A kind of target identification method and device based on ultraviolet imagery corona detection
JP2020129439A (en) Information processing system and information processing method
RU2363018C1 (en) Method of selecting objects on remote background
US20190273845A1 (en) Vibration monitoring of an object using a video camera
CN109767414A (en) A kind of multi-focus image fusing method based on gray scale median reference
CN113949853B (en) Projection system with environment adaptive adjustment capability
de León et al. High stress concentration analysis using RGB intensity changes in dynamic photoelasticity videos
CN116630327A (en) Boiler state abnormity monitoring system based on thermodynamic diagram
JP2022528575A (en) Methods and Devices for Measuring Local Refractive Power and / or Refractive Power Distribution of a Replacement Eyeglass Lens
WO2020165581A1 (en) Night vision device testing
CN111857623A (en) Calibration apparatus, calibration system, and display apparatus calibration method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant