CN113949853A - Projection system with environment adaptive adjustment capability and method - Google Patents
Projection system with environment adaptive adjustment capability and method Download PDFInfo
- Publication number
- CN113949853A CN113949853A CN202111192709.2A CN202111192709A CN113949853A CN 113949853 A CN113949853 A CN 113949853A CN 202111192709 A CN202111192709 A CN 202111192709A CN 113949853 A CN113949853 A CN 113949853A
- Authority
- CN
- China
- Prior art keywords
- projection
- environment
- change
- foreign
- foreign matter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/315—Modulator illumination systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Electric Information Into Light Information (AREA)
Abstract
The invention relates to the technical field of projection, in particular to a projection system with environment adaptive adjustment capability and a method thereof, wherein the system comprises: an environment change detection unit configured to detect whether a surrounding environment changes and to judge whether a foreign object enters the surrounding environment; and the environment change identification unit is configured for identifying the type of the environment change when the surrounding environment changes or foreign matters enter the surrounding environment, generating an environment change identification result, carrying out image identification on the foreign matters and carrying out track tracking on the foreign matters, and generating a foreign matter analysis result based on the image identification result of the foreign matters and the track tracking result of the foreign matters. The projection image processing method and the projection image processing device have the advantages that the projection parameters are adjusted or the image is repaired through detecting the environmental parameters of the projected surrounding environment and detecting and tracking foreign matters appearing in the projection image, so that the effect that the projection effect is changed along with the change of the environment is realized, and the projection quality is improved.
Description
Technical Field
The invention belongs to the technical field of projection, and particularly relates to a projection system and a projection method with environment adaptive adjustment capability.
Background
The projection system is an optical system which illuminates an object and then images the object on a projection screen, is based on a motion tracking technology, and is suitable for any projector, liquid crystal display screen, LED large screen, plasma, digital video wall and the like. The projection system converts the interactive participant's actions into graphical image interactive feedback. The system has 24 sets of practical interactive effects and customizable high-resolution contents, and can realize an unequally projected area in the same industry so as to meet the interactive requirements of different users. In short, interactive projection systems allow users to experience unprecedented smooth interactive experiences by creating immersive interactive experiences.
Patent No. CN2006800549258A discloses a stereoscopic projection system for displaying stereopair images on a mirror sphere or parabolic screen and viewing the stereoscopic effect together without the use of stereoscopic glasses. The invention can continuously and dynamically superpose the projection of the left and right pictures of the stereopair on the left and right eyes of the user respectively. This setting is independently implemented for each viewer at the same time. The stereoscopic projection system includes: a stereo projector individually assigned to each user and connected in series, a monitoring system for continuously and accurately determining the position of the eyes of the viewer, a self-correction device for mechanically self-correcting the stereo projector and the system optics, a video correction device, an automatic drive, a unit for forming a stereopair projection image in the stereo projector and coupled with the video correction device for video correcting the optimal parameters of the screen image.
The stereoscopic projection system improves the image quality through image correction and image, but only aims at the existing scene, and if the image in the existing scene is changed, the quality of the projection effect is reduced.
Therefore, it would be very significant to develop a method and system capable of improving the projection effect and quality according to the change of environment.
Disclosure of Invention
In view of the above, the main objective of the present invention is to provide a projection system and method with an environment adaptive adjustment capability, which adjust a projection parameter or repair a projection screen by detecting an environmental parameter of a projected ambient environment and detecting and tracking a foreign object appearing in the projection screen, so as to achieve an effect that a projection effect changes with a change in the environment, and improve the projection quality.
In order to achieve the purpose, the technical scheme of the invention is realized as follows:
a projection system with adaptive adjustment capability, the system comprising:
an environment change detection unit configured to detect whether a surrounding environment changes and to judge whether a foreign object enters the surrounding environment;
the environment change identification unit is configured for identifying the type of the environment change when the surrounding environment changes or foreign matters enter the surrounding environment, generating an environment change identification result, carrying out image identification on the foreign matters and carrying out track tracking on the foreign matters, and generating a foreign matter analysis result based on the image identification result of the foreign matters and the track tracking result of the foreign matters;
the projection correction unit is configured to correct the projection based on the environment change recognition result and the foreign object analysis result, and specifically includes: generating a projection correction parameter based on the environment change recognition result to correct the projection; and image repairing is carried out on the projection based on the foreign matter analysis result so as to remove the interference of the foreign matter on the projection.
Further, the environment change detection unit includes: a physical environment change detection unit and a foreign object detection unit; the physical environment change detection unit includes: a detection part consisting of a judgment part and a plurality of sensors; the detection part is configured to sense environmental parameters in real time; the judging part is configured to judge whether an environmental change occurs based on the sensed environmental parameter; the foreign matter detection unit is configured to collect a projection picture in real time and perform light direction analysis on the projection picture so as to judge whether foreign matters enter the projection picture.
Further, the detection section includes: a temperature sensor, an illumination sensor and a humidity sensor; the judgment part judges whether the environment changes or not by using a preset judgment model after acquiring the environment parameters sensed by the sensors; the judgment model is expressed by the following formula:
wherein S is a discrimination value, and A is a temperature parameter detected by a temperature sensor; b is an illumination parameter detected by an illumination sensor; c is a temperature parameter detected by the temperature sensor; x is a discrimination coefficient, and the value range is as follows: 5-10; p is the discrimination probability, the value of which varies with projection time,the change rule of the material satisfies the following formula: p is 0.5T-2; wherein T is projection time; and when the value of the discrimination value calculated by the judgment model exceeds a set value, judging that the environment is changed.
Further, the method for judging whether foreign objects enter the projection picture by the foreign object detection unit comprises the following steps: collecting a projection picture in real time, analyzing the light direction of the projection picture to judge whether the light direction in the projection picture is abnormal or not, and judging that foreign matters appear in the projection picture when the light direction is abnormal; and if the light direction is not abnormal, judging that no foreign matter is present in the projection picture.
Further, the method for judging the abnormal light direction executes the following steps: analyzing the gradient change of the pixel values in the projection picture acquired in real time to judge whether the gradient change direction of the pixel values in the projection picture is abnormal or not; during judgment, defining the change of the pixel value from high to low as the positive direction of the gradient change, and defining the change of the pixel value from low to high as the negative direction of the gradient change, so as to generate a plurality of gradient change directions; and then analyzing the direction difference and identity change of all gradient change directions, which specifically comprises the following steps: aiming at a certain gradient change direction, judging whether included angles between one or more adjacent gradient change directions and the gradient change direction are within a set threshold value range or not; if yes, judging that no abnormity occurs; if not, judging that the abnormal condition occurs, and judging that the foreign matter occurs in the projection picture.
Further, the environment change recognition unit includes: an environment recognition unit and a foreign object recognition unit; the environment recognition unit is configured to compare the obtained discrimination value S with one or more set threshold value ranges to judge the type of the environment change; the types of the environmental changes at least include: temperature, illumination and humidity variations; the foreign matter identification unit is configured to collect projection pictures in real time, identify and lock foreign matters in the projection pictures, determine the motion track of the foreign matters according to the linked multi-frame projection pictures, and realize track tracking of the foreign matters.
Further, the method for identifying and locking the foreign object in the projection picture by the foreign object identification unit comprises the following steps: carrying out feature extraction on the projection picture to generate a feature map; the characteristic graph comprises characteristic information with different scales; performing region candidate identification on the feature map to obtain candidate region information of the projection picture; and comparing and identifying the candidate region information and the feature map with the trained foreign matter features to generate a foreign matter identification result, and locking the foreign matter part in the projection picture.
Further, the foreign object identification unit performs trajectory tracking based on the locked foreign object portion in each frame of the projection screen, and generates a result of trajectory tracking.
Further, the projection correction unit performs image inpainting on the projection based on the foreign matter analysis result, so that the method for removing the interference of the foreign matter on the projection performs the following steps: converting pixels of a foreign matter part in a projected image by using a pixel conversion model, and replacing the pixels corresponding to the foreign matter part by using a new pixel obtained by conversion so as to repair the foreign matter part; the pixel conversion model is represented using the following formula:
wherein R is101、R102、R103、R104、R105、R108、R109、R110、R111And R112The pixel values of six pixels are obtained by screening the peripheral symmetrical part by the corresponding pixel of the foreign body part to be replaced; PX is a pixel value of a corresponding pixel of the foreign substance portion to be replaced.
A projection method with environment adaptive adjustment capability.
Compared with the traditional method, the projection system and the method with the environment adaptive adjustment capability adjust the projection parameters or repair the picture by detecting the environmental parameters of the projected surrounding environment and detecting and tracking foreign matters appearing in the projected picture, thereby realizing the effect that the projection effect changes along with the change of the environment and improving the projection quality. The method is mainly realized by the following steps: 1. detection of the projection environment: the invention judges whether the projection environment is changed and the type of the change through the detection of the projection environment, the detection of the temperature, the humidity and the illumination intensity, so as to adjust the parameters of the projection and improve the quality of the projection; 2. detection of foreign matter: the invention judges whether the foreign matter enters the projection picture or not by detecting the foreign matter, and repairs each foreign matter in the projection picture according to the identification and tracking of the foreign matter so as to improve the projection quality.
Drawings
Fig. 1 is a schematic system diagram of a projection system with adaptive environment adjustment capability according to an embodiment of the present invention;
FIG. 2 is a schematic diagram illustrating the light direction of a projection system with environment adaptive adjustment capability and a method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram illustrating a foreign object entering a projection screen in a projection system and a method with adaptive adjustment capability according to an embodiment of the present invention;
fig. 4 is a schematic diagram illustrating a principle of pixel conversion of a foreign object in the projection system and method with adaptive adjustment capability according to an embodiment of the present invention.
Detailed Description
The method of the present invention will be described in further detail below with reference to the accompanying drawings and embodiments of the invention.
Example 1
As shown in fig. 1, a projection system with environment adaptive adjustment capability, the system comprising:
an environment change detection unit configured to detect whether a surrounding environment changes and to judge whether a foreign object enters the surrounding environment;
the environment change identification unit is configured for identifying the type of the environment change when the surrounding environment changes or foreign matters enter the surrounding environment, generating an environment change identification result, carrying out image identification on the foreign matters and carrying out track tracking on the foreign matters, and generating a foreign matter analysis result based on the image identification result of the foreign matters and the track tracking result of the foreign matters;
the projection correction unit is configured to correct the projection based on the environment change recognition result and the foreign object analysis result, and specifically includes: generating a projection correction parameter based on the environment change recognition result to correct the projection; and image repairing is carried out on the projection based on the foreign matter analysis result so as to remove the interference of the foreign matter on the projection.
Referring to fig. 2, a change of light of a projection screen with the entry of foreign matter is shown in fig. 2. When a foreign object enters the projection screen, if the projection screen is adjusted, the projection quality is degraded. When the foreign matter enters the projection picture, the light of the projection picture can change, whether the foreign matter enters the projection picture or not is judged through the change of the direction of the light, the judging efficiency can be improved, the picture does not need to be identified in real time, and therefore the system efficiency is improved.
Referring to fig. 3, fig. 3 shows a scene in which a foreign object enters the projection screen. The position of the foreign matter in the projection picture can be changed, so that the position of the foreign matter in the projection picture needs to be recorded in real time, the change of the projection picture caused by the foreign matter is repaired in real time, and the projection quality is improved.
Referring to fig. 4, fig. 4 shows that when the projection screen is repaired, for pixel repairing, a plurality of pixels are randomly and symmetrically selected around a pixel to be repaired to perform pixel repairing, so that the repairing quality can be improved.
Example 2
On the basis of the above embodiment, the environment change detection unit includes: a physical environment change detection unit and a foreign object detection unit; the physical environment change detection unit includes: a detection part consisting of a judgment part and a plurality of sensors; the detection part is configured to sense environmental parameters in real time; the judging part is configured to judge whether an environmental change occurs based on the sensed environmental parameter; the foreign matter detection unit is configured to collect a projection picture in real time and perform light direction analysis on the projection picture so as to judge whether foreign matters enter the projection picture.
Specifically, a pixel is defined as being composed of tiles of an image, the tiles having a specific location and assigned color values, and the color and location of the tiles determining how the image appears.
A pixel can be considered to be an indivisible unit or element in the entire image. Indivisible means that it cannot be cut into smaller units or elements, which exist as a single color cell. Each dot matrix image contains a certain number of pixels that determine the size of the image to be presented on the screen.
Example 3
On the basis of the above embodiment, the detection section includes: a temperature sensor, an illumination sensor and a humidity sensor; the judgment part judges whether the environment changes or not by using a preset judgment model after acquiring the environment parameters sensed by the sensors; the judgment model is expressed by the following formula:
wherein S is a discrimination value, and A is a temperature parameter detected by a temperature sensor; b is an illumination parameter detected by an illumination sensor; c is a temperature parameter detected by the temperature sensor; x is a discrimination coefficient, and the value range is as follows: 5-10; p is the discrimination probability, the value of which changes along with the projection time, and the change rule of which satisfies the following formula: p is 0.5T-2; wherein T is projection time; and when the value of the discrimination value calculated by the judgment model exceeds a set value, judging that the environment is changed.
Specifically, factors affecting the projection effect may cause the projection effect to be deteriorated due to environmental changes, in addition to the factors of the projection itself. Therefore, besides improving the projector or the projection device, the projector or the projection device also needs to monitor the environmental temperature, the illumination intensity and the humidity during projection, and adjust the projection effect according to the change of the environment, so as to improve the projection quality.
Specifically, a temperature sensor (temperature transducer) refers to a sensor that senses temperature and converts the sensed temperature into a usable output signal. The temperature sensor is the core part of the temperature measuring instrument and has a plurality of varieties. The measurement method can be divided into a contact type and a non-contact type, and the measurement method can be divided into a thermal resistor and a thermocouple according to the characteristics of sensor materials and electronic elements. The illumination sensor is a sensor for detecting illumination intensity, illumination for short, and the working principle is to convert the illumination intensity into a voltage value, and is mainly used for cultivation of agricultural and forestry greenhouses and the like. A temperature sensor (temperature transducer) refers to a sensor that senses temperature and converts it into a usable output signal. The temperature sensor is the core part of the temperature measuring instrument and has a plurality of varieties. The measurement method can be divided into a contact type and a non-contact type, and the measurement method can be divided into a thermal resistor and a thermocouple according to the characteristics of sensor materials and electronic elements. Human survival and social activities are closely related to humidity. With the development of modernization, it is difficult to find a domain independent of humidity. Due to the different application fields, the technical requirements for humidity sensors are also different. From the manufacturing point of view, the humidity sensor has different materials, structures and processes, and the performance and technical indexes (such as precision) of the humidity sensor are greatly different, so that the price is far from each other. For a user, when selecting a humidity sensor, the user needs to know what sensor is needed; under the condition that own financial resources allow, the product of which grade is selected is well balanced with the relation between 'requirement and possibility' so as not to act blindly. From our perspective of the user, we find the following problems to be significant.
Example 4
On the basis of the above embodiment, the method for determining whether a foreign object enters the projection screen by the foreign object detection unit includes the following steps: collecting a projection picture in real time, analyzing the light direction of the projection picture to judge whether the light direction in the projection picture is abnormal or not, and judging that foreign matters appear in the projection picture when the light direction is abnormal; and if the light direction is not abnormal, judging that no foreign matter is present in the projection picture.
Specifically, if a foreign object appears in the projection screen, the projection effect is obviously reduced, and if the projection effect is not adjusted for the foreign object entering the projection screen, the projection quality is reduced.
Example 5
On the basis of the previous embodiment, the method for judging the abnormal light direction comprises the following steps: analyzing the gradient change of the pixel values in the projection picture acquired in real time to judge whether the gradient change direction of the pixel values in the projection picture is abnormal or not; during judgment, defining the change of the pixel value from high to low as the positive direction of the gradient change, and defining the change of the pixel value from low to high as the negative direction of the gradient change, so as to generate a plurality of gradient change directions; and then analyzing the direction difference and identity change of all gradient change directions, which specifically comprises the following steps: aiming at a certain gradient change direction, judging whether included angles between one or more adjacent gradient change directions and the gradient change direction are within a set threshold value range or not; if yes, judging that no abnormity occurs; if not, judging that the abnormal condition occurs, and judging that the foreign matter occurs in the projection picture.
Specifically, the gradient is intended to be a vector (vector) indicating that the directional derivative of a certain function at that point takes a maximum value along that direction, i.e., the function changes the fastest and the rate of change is the greatest (modulo of the gradient) along that direction (the direction of this gradient) at that point.
Example 6
On the basis of the above embodiment, the environment change identifying unit includes: an environment recognition unit and a foreign object recognition unit; the environment recognition unit is configured to compare the obtained discrimination value S with one or more set threshold value ranges to judge the type of the environment change; the types of the environmental changes at least include: temperature, illumination and humidity variations; the foreign matter identification unit is configured to collect projection pictures in real time, identify and lock foreign matters in the projection pictures, determine the motion track of the foreign matters according to the linked multi-frame projection pictures, and realize track tracking of the foreign matters.
Example 7
On the basis of the previous embodiment, the method for identifying and locking the foreign object in the projection picture by the foreign object identification unit comprises the following steps: carrying out feature extraction on the projection picture to generate a feature map; the characteristic graph comprises characteristic information with different scales; performing region candidate identification on the feature map to obtain candidate region information of the projection picture; and comparing and identifying the candidate region information and the feature map with the trained foreign matter features to generate a foreign matter identification result, and locking the foreign matter part in the projection picture.
Example 8
On the basis of the above embodiment, the foreign object recognition unit performs trajectory tracking based on the locked foreign object portion in each frame of the projection screen, and generates a result of trajectory tracking.
Specifically, when the repair is performed,
example 9
On the basis of the above embodiment, the method for image inpainting the projection by the projection correction unit based on the foreign object analysis result to remove the interference of the foreign object on the projection performs the following steps: converting pixels of a foreign matter part in a projected image by using a pixel conversion model, and replacing the pixels corresponding to the foreign matter part by using a new pixel obtained by conversion so as to repair the foreign matter part; the pixel conversion model is represented using the following formula:
wherein R is101、R102、R103、R104、R105、R108、R109、R110、R111And R112The pixel values of six pixels are obtained by screening the peripheral symmetrical part by the corresponding pixel of the foreign body part to be replaced; PX is a pixel value of a corresponding pixel of the foreign substance portion to be replaced.
Specifically, when the foreign object enters the picture, the foreign object is greatly different from the projection picture, so that the pixels in the foreign object need to be repaired from outside to inside, and after the outermost layer of the pixels in the foreign object is repaired, the pixels are arranged inside layer by layer, so that the difference between each pixel and the pixels in the projection picture is reduced, and the projection quality is improved.
Example 10
A projection method with environment adaptive adjustment capability.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes and related descriptions of the storage device and the processing device described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
Those of skill in the art would appreciate that the various illustrative elements, method steps, described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that programs corresponding to the elements, method steps may be located in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. To clearly illustrate this interchangeability of electronic hardware and software, various illustrative components and steps have been described above generally in terms of their functionality. Whether these functions are performed in electronic hardware or software depends on the particular application and property constraints of the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The terms "first," "second," and the like are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
The terms "comprises," "comprising," or any other similar term are intended to cover a non-exclusive inclusion, such that a process, method, article, or unit/apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or unit/apparatus.
So far, the technical solutions of the present invention have been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of the present invention is obviously not limited to these specific embodiments. Equivalent modifications or substitutions of the related art marks may be made by those skilled in the art without departing from the principle of the present invention, and the technical solutions after such modifications or substitutions will fall within the protective scope of the present invention.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.
Claims (10)
1. A projection system with adaptive environment adjustment capability, the system comprising:
an environment change detection unit configured to detect whether a surrounding environment changes and to judge whether a foreign object enters the surrounding environment;
the environment change identification unit is configured for identifying the type of the environment change when the surrounding environment changes or foreign matters enter the surrounding environment, generating an environment change identification result, carrying out image identification on the foreign matters and carrying out track tracking on the foreign matters, and generating a foreign matter analysis result based on the image identification result of the foreign matters and the track tracking result of the foreign matters;
the projection correction unit is configured to correct the projection based on the environment change recognition result and the foreign object analysis result, and specifically includes: generating a projection correction parameter based on the environment change recognition result to correct the projection; and image repairing is carried out on the projection based on the foreign matter analysis result so as to remove the interference of the foreign matter on the projection.
2. The system of claim 1, wherein the environmental change detection unit comprises: a physical environment change detection unit and a foreign object detection unit; the physical environment change detection unit includes: a detection part consisting of a judgment part and a plurality of sensors; the detection part is configured to sense environmental parameters in real time; the judging part is configured to judge whether an environmental change occurs based on the sensed environmental parameter; the foreign matter detection unit is configured to collect a projection picture in real time and perform light direction analysis on the projection picture so as to judge whether foreign matters enter the projection picture.
3. The system of claim 2, wherein the detection section comprises: a temperature sensor, an illumination sensor and a humidity sensor; the judgment part judges whether the environment changes or not by using a preset judgment model after acquiring the environment parameters sensed by the sensors; the judgment model is expressed by the following formula:
wherein S is a discrimination value, and A is a temperature parameter detected by a temperature sensor; b is an illumination parameter detected by an illumination sensor; c is a temperature parameter detected by the temperature sensor; x is a discrimination coefficient, and the value range is as follows: 5-10; p is the discrimination probability, the value of which changes along with the projection time, and the change rule of which satisfies the following formula: p is 0.5T-2; wherein T is projection time; and when the value of the discrimination value calculated by the judgment model exceeds a set value, judging that the environment is changed.
4. The system of claim 3, wherein the method for the foreign object detection unit to determine whether a foreign object enters the projection screen comprises the steps of: collecting a projection picture in real time, analyzing the light direction of the projection picture to judge whether the light direction in the projection picture is abnormal or not, and judging that foreign matters appear in the projection picture when the light direction is abnormal; and if the light direction is not abnormal, judging that no foreign matter is present in the projection picture.
5. The system of claim 4, wherein the method for determining the abnormal direction of the light beam comprises the steps of: analyzing the gradient change of the pixel values in the projection picture acquired in real time to judge whether the gradient change direction of the pixel values in the projection picture is abnormal or not; during judgment, defining the change of the pixel value from high to low as the positive direction of the gradient change, and defining the change of the pixel value from low to high as the negative direction of the gradient change, so as to generate a plurality of gradient change directions; and then analyzing the direction difference and identity change of all gradient change directions, which specifically comprises the following steps: aiming at a certain gradient change direction, judging whether included angles between one or more adjacent gradient change directions and the gradient change direction are within a set threshold value range or not; if yes, judging that no abnormity occurs; if not, judging that the abnormal condition occurs, and judging that the foreign matter occurs in the projection picture.
6. The system of claim 5, wherein the environment change identification unit comprises: an environment recognition unit and a foreign object recognition unit; the environment recognition unit is configured to compare the obtained discrimination value S with one or more set threshold value ranges to judge the type of the environment change; the types of the environmental changes at least include: temperature, illumination and humidity variations; the foreign matter identification unit is configured to collect projection pictures in real time, identify and lock foreign matters in the projection pictures, determine the motion track of the foreign matters according to the linked multi-frame projection pictures, and realize track tracking of the foreign matters.
7. The system of claim 6, wherein the method for identifying and locking the alien material in the projection screen by the alien material identification unit performs the following steps: carrying out feature extraction on the projection picture to generate a feature map; the characteristic graph comprises characteristic information with different scales; performing region candidate identification on the feature map to obtain candidate region information of the projection picture; and comparing and identifying the candidate region information and the feature map with the trained foreign matter features to generate a foreign matter identification result, and locking the foreign matter part in the projection picture.
8. The system according to claim 7, wherein the alien material identification unit performs trajectory tracking based on a locked alien material portion in each frame of the projection screen, generating a result of trajectory tracking.
9. The system of claim 8, wherein the projection correction unit performs image inpainting on the projection based on the foreign object analysis result to remove the interference of the foreign object on the projection by performing the following steps: converting pixels of a foreign matter part in a projected image by using a pixel conversion model, and replacing the pixels corresponding to the foreign matter part by using a new pixel obtained by conversion so as to repair the foreign matter part; the pixel conversion model is represented using the following formula:
10. A projection method with adaptive adjustment capability based on the system of any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111192709.2A CN113949853B (en) | 2021-10-13 | 2021-10-13 | Projection system with environment adaptive adjustment capability |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111192709.2A CN113949853B (en) | 2021-10-13 | 2021-10-13 | Projection system with environment adaptive adjustment capability |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113949853A true CN113949853A (en) | 2022-01-18 |
| CN113949853B CN113949853B (en) | 2022-10-25 |
Family
ID=79330298
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111192709.2A Active CN113949853B (en) | 2021-10-13 | 2021-10-13 | Projection system with environment adaptive adjustment capability |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113949853B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001157980A (en) * | 1999-11-30 | 2001-06-12 | Sony Corp | Robot device, and control method thereof |
| US20040105085A1 (en) * | 1998-09-17 | 2004-06-03 | Nikon Corporation | Image formation characteristics adjustment method for projection optical system |
| US20050219523A1 (en) * | 2004-03-31 | 2005-10-06 | Hitachi, Ltd. | Foreign matter detecting system |
| JP2014093604A (en) * | 2012-11-01 | 2014-05-19 | Ricoh Co Ltd | Image projection device evaluation method, image projection device, image projection device manufacturing method, and image projection device evaluation system |
| CN104202547A (en) * | 2014-08-27 | 2014-12-10 | 广东威创视讯科技股份有限公司 | Method for extracting target object in projection picture, projection interaction method and system thereof |
| WO2015033598A1 (en) * | 2013-09-04 | 2015-03-12 | 日本電気株式会社 | Projection device, projection device control method, projection device control apparatus, and computer program thereof |
| KR101891328B1 (en) * | 2017-02-27 | 2018-08-24 | (주)에코메이텍 | Eco-friendly smart lighting control system according to the biorhythm and environment change |
| US20210006758A1 (en) * | 2018-03-27 | 2021-01-07 | Canon Kabushiki Kaisha | Iimage processing device, image display system, image processing method, and program |
-
2021
- 2021-10-13 CN CN202111192709.2A patent/CN113949853B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040105085A1 (en) * | 1998-09-17 | 2004-06-03 | Nikon Corporation | Image formation characteristics adjustment method for projection optical system |
| JP2001157980A (en) * | 1999-11-30 | 2001-06-12 | Sony Corp | Robot device, and control method thereof |
| US20050219523A1 (en) * | 2004-03-31 | 2005-10-06 | Hitachi, Ltd. | Foreign matter detecting system |
| JP2014093604A (en) * | 2012-11-01 | 2014-05-19 | Ricoh Co Ltd | Image projection device evaluation method, image projection device, image projection device manufacturing method, and image projection device evaluation system |
| WO2015033598A1 (en) * | 2013-09-04 | 2015-03-12 | 日本電気株式会社 | Projection device, projection device control method, projection device control apparatus, and computer program thereof |
| CN104202547A (en) * | 2014-08-27 | 2014-12-10 | 广东威创视讯科技股份有限公司 | Method for extracting target object in projection picture, projection interaction method and system thereof |
| KR101891328B1 (en) * | 2017-02-27 | 2018-08-24 | (주)에코메이텍 | Eco-friendly smart lighting control system according to the biorhythm and environment change |
| US20210006758A1 (en) * | 2018-03-27 | 2021-01-07 | Canon Kabushiki Kaisha | Iimage processing device, image display system, image processing method, and program |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113949853B (en) | 2022-10-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111047568B (en) | Method and system for detecting and identifying steam leakage defect | |
| JP4997252B2 (en) | How to identify the illumination area in an image | |
| US7936377B2 (en) | Method and system for optimizing an image for improved analysis of material and illumination image features | |
| CN111339951A (en) | Body temperature measuring method, device and system | |
| EP2194725B1 (en) | Method and apparatus for correcting a depth image | |
| WO2007074770A1 (en) | Defect inspection device for inspecting defect by image analysis | |
| JP4533836B2 (en) | Fluctuating region detection apparatus and method | |
| CN110766683B (en) | Pearl finish grade detection method and system | |
| CN113758932B (en) | Deep learning-based visual detection method for defects of lithium battery diaphragm | |
| CN109100363A (en) | A kind of differentiating method and system being bonded foreign matter defect and dust | |
| CN104135926A (en) | Image processing device, image processing system, image processing method, and program | |
| JP5168215B2 (en) | Appearance inspection device | |
| Christlein et al. | A study on features for the detection of copy-move forgeries | |
| CN102739951A (en) | Image processing apparatus, image processing method, and program | |
| JP7481956B2 (en) | Inference device, method, program and learning device | |
| CN116630327B (en) | Boiler state abnormity monitoring system based on thermodynamic diagram | |
| US20190273845A1 (en) | Vibration monitoring of an object using a video camera | |
| CN109544535B (en) | Peeping camera detection method and system based on optical filtering characteristics of infrared cut-off filter | |
| CN102739911A (en) | Image processing apparatus, image processing method, and computer readable medium | |
| CN108364306B (en) | Visual real-time detection method for high-speed periodic motion | |
| RU2363018C1 (en) | Method of selecting objects on remote background | |
| CN114612418A (en) | Method, device and system for detecting surface defects of mouse shell and electronic equipment | |
| JP2014064083A (en) | Monitoring device and method | |
| CN109767414A (en) | A kind of multi-focus image fusing method based on gray scale median reference | |
| CN113949853B (en) | Projection system with environment adaptive adjustment capability |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |