KR102530644B1 - Infrared interactive projection system - Google Patents

Abstract

An infrared interactive projection system according to an embodiment includes a beam projector for projecting an image on a screen, a sensor unit for recognizing an image on the screen, a sensor unit position adjusting unit for adjusting the position of the sensor unit, and image information from the sensor unit. It may include a control unit that reads and sends a position control signal of the sensor unit to the sensor unit position adjusting unit.

Description

Infrared interactive projection system {INFRARED INTERACTIVE PROJECTION SYSTEM}

An infrared interactive projection system is disclosed.

Digital content technology is being actively developed as digital content expressed in electronic form by combining codes, text, audio, image, video, and information of the five senses with ICT technology is promising. Digital contents are developing globally in the direction of convergence and utilization among heterogeneous types such as augmented reality, mobile, and high-definition devices.

Digital content technology may include immersive video content for realistic visualization, interactive content for natural interaction with users, emotional content for recognizing and expressing five senses and emotions, and content distribution/service for distribution.

In particular, interactive content is a technology that is central to the interaction between a user and a system for digital content service, and is driven in response to a certain action of a user in real time. Interaction contents can be used as educational services in various fields such as aviation training simulations and games.

For example, Korea Patent Registration No. 2014-0005522 (published on January 15, 2014) describes a method for building a real-time virtualization system that works with smart devices based on various platforms and real-time virtualization that works with smart devices based on various platforms. It is related to the system and provides possible effects such as dynamic operation of contents or applications.

The above background art is possessed or acquired by the inventor in the process of deriving the disclosure of the present application, and cannot necessarily be said to be known art disclosed to the general public prior to the present application.

An object according to an embodiment is to provide an infrared interactive projection system that enables contents that can be utilized in the field of exhibition experience and cultural facilities.

An object according to an embodiment is to provide an infrared interactive projection system that allows contents in an exhibition hall or museum to be changed from simple viewing to experiential learning contents that are experienced and felt.

An object according to an embodiment is to provide an infrared interactive projection system capable of actively responding to a user's action and actively coping with surrounding space-time environment information.

An object according to an embodiment is to provide an infrared interactive projection system that automatically adjusts the position of an image recognition sensor according to a screen projected on a screen and automatically performs coordinate recognition.

An object according to an embodiment is to provide an infrared interactive projection system that automatically adjusts a position of an infrared recognition sensor in order to prevent deterioration of infrared recognition performance by an external light source.

In order to solve the problems described above, an infrared interactive projection system according to an embodiment includes a beam projector for projecting an image on a screen, a sensor unit for recognizing an image on the screen, a sensor unit position adjusting unit for adjusting the position of the sensor unit, and and a control unit that reads image information from the sensor unit and transmits a position control signal of the sensor unit to the sensor unit position adjusting unit.

According to one side, the infrared interactive projection system according to an embodiment may include an image recognition sensor for recognizing an image on a screen by the beam projector and an infrared recognition sensor for recognizing an infrared image or an infrared marker on the screen.

According to one side, the sensor unit position adjustment unit may control the position of the image recognition sensor so that the image recognition sensor recognizes the entire screen in a pan-tilt-zoom method.

According to one aspect, the control unit may perform image correction so that the full-screen screen is recognized as a flat screen, and match the screen recognized as the flat image with coordinates of actual content.

According to one side, the infrared interactive projection system according to an embodiment may further include an infrared generator for projecting an infrared marker on the screen on which the test screen is projected.

According to one aspect, the infrared recognition sensor may recognize the infrared marker, and the controller may determine an identification degree of the recognized infrared marker.

According to one side, when the identification degree does not satisfy the set value, the sensor unit position adjustment unit adjusts the position of the infrared recognition sensor within a set range, and recognizes the infrared rays as a position where the identification degree satisfies the preset level. The position of the sensor can be selected.

According to one aspect, the controller may distinguish a recognition area and a non-recognition area of the recognition data of the identified infrared marker, and remove noise at a boundary between the recognition area and the non-recognition area.

An infrared interactive projection system according to an embodiment may enable content experience that can be used in the field of exhibition experience and cultural facilities.

An infrared interactive projection system according to an embodiment can change contents in an exhibition hall or museum from simple viewing to experiential learning contents that are experienced and felt.

An infrared interactive projection system according to an embodiment may provide experiential learning content capable of actively responding to a user's behavior and actively coping with surrounding space-time environment information.

Meanwhile, in the infrared interactive projection system according to an embodiment, by automatically adjusting the positions of the image recognition sensor and the infrared recognition sensor, the experiencer/learner can interact with the image projected by the beam projector with improved accuracy.

1 is a diagram schematically illustrating an infrared interactive projection system according to an embodiment.
2 is a conceptual diagram illustrating a distortion correction algorithm according to an angle of a camera in an infrared interactive projection system according to an exemplary embodiment.
3 is an exemplary embodiment of an infrared interactive projection system according to an exemplary embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, since various changes can be made to the embodiments, the scope of the patent application is not limited or limited by these embodiments. It should be understood that all changes, equivalents or substitutes to the embodiments are included within the scope of rights.

Terms used in the examples are used only for the purpose of explanation and should not be construed as limiting. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the embodiment belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present application, they should not be interpreted in an ideal or excessively formal meaning. don't

In addition, in the description with reference to the accompanying drawings, the same reference numerals are given to the same components regardless of reference numerals, and overlapping descriptions thereof will be omitted. In describing the embodiment, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the embodiment, the detailed description will be omitted.

In addition, in describing the components of the embodiment, terms such as first, second, A, B, (a), and (b) may be used. These terms are only used to distinguish the component from other components, and the nature, order, or order of the corresponding component is not limited by the term. When an element is described as being “connected,” “coupled to,” or “connected” to another element, that element may be directly connected or connected to the other element, but there may be another element between the elements. It should be understood that may be "connected", "coupled" or "connected".

Components included in one embodiment and components having common functions will be described using the same names in other embodiments. Unless stated to the contrary, descriptions described in one embodiment may be applied to other embodiments, and detailed descriptions will be omitted to the extent of overlap.

1 is a diagram schematically illustrating an infrared interactive projection system 10 according to an exemplary embodiment.

An infrared interactive projection system 10 according to an embodiment adjusts the position of a beam projector 100 for projecting an image on a screen S, a sensor unit 200 for recognizing an image on the screen, and the sensor unit 200. a sensor unit position adjusting unit 300 that reads image information from the sensor unit 200 and sends a signal to the sensor unit position adjusting unit 300 to control the position of the sensor unit 200; and a test screen An infrared generator 500 for projecting an infrared marker on the projected screen S may be included.

The sensor unit 200 includes an image recognition sensor 210 for recognizing an image of the screen S by the beam projector 100, and an infrared recognition sensor 220 for recognizing an infrared image or an infrared marker on the screen S. can include The infrared recognition sensor 220 may recognize an infrared marker, and the controller 400 may determine an identification degree of the recognized infrared marker.

Hereinafter, a process of adjusting the position of the image recognition sensor 220 of the infrared interactive projection system 10 according to an exemplary embodiment will be described with reference to FIG. 1 .

First, a test screen such as a video or image may be projected on the screen S from the beam projector 100 .

Next, the image recognition sensor 220 may recognize the screen of the screen S, and image data obtained thereby may be transmitted to the controller 400.

The controller 400 may read the received image data and adjust the position of the sensor unit 200 based on the read image data.

Specifically, the sensor unit position adjusting unit 300 may adjust the position of the sensor unit 200 so that the image recognition sensor 210 can recognize the entire screen (S) based on the received control signal.

For example, the sensor unit position adjusting unit 300 is connected to the image recognition sensor 210 and the infrared recognition sensor 220, and pan-tilt-zoom (pan-tilt-zoom) these image recognition sensors 210 And the position of the infrared recognition sensor 220 can be adjusted.

The controller 400 may perform image correction on the screen of the entire screen S through the infrared recognition sensor 220 . For example, the controller 400 applies a screen image correction algorithm (eg, barrel distortion and perspective transform) so that the entire screen S can be recognized as a flat screen. It can be recognized as a flat screen state.

Specifically, when a wide area is sampled with a camera image, radial distortion occurs in which corners are bent more than edges, and this distortion can be corrected through a barrel distortion algorithm.

In addition, when changing a 3D image to 2D through a camera, a distortion phenomenon may occur depending on the angle of the camera, and this phenomenon can be resolved through a projection correction algorithm. For example, the image before correction as shown in FIG. 2(a) may be corrected as shown in FIG. 2(b) through a projection correction algorithm.

Subsequently, the controller 400 may match the screen recognized as a flat image to the coordinates of actual experiential content.

Hereinafter, with reference to FIG. 1 again, an automatic adjustment process for improving infrared recognition performance of the infrared interactive projection system 10 according to an exemplary embodiment will be described.

First, a test screen such as a video or image may be projected on the screen S from the beam projector 100 .

An infrared marker may be projected from the infrared generator 500 toward the screen of the screen S.

The infrared recognition sensor 220 may recognize the projected infrared marker. In this case, infrared recognition data by the infrared marker may be transmitted to the controller 400 .

The recognition degree of the infrared recognition sensor 220 may be affected by an external light source, and the controller 400 may determine whether to adjust the position of the infrared recognition sensor 220 by analyzing the received infrared recognition data.

Specifically, if the controller 400 cannot recognize the boundary data of the infrared marker, such as the degree of identification of the received infrared recognition data does not satisfy a set value, a signal is sent to the sensor unit position adjusting unit 300 to send an infrared recognition sensor. By adjusting the position of (220), it can be selected as the position with the highest degree of identification.

For example, the control unit 400 sends a control signal to adjust the position of the infrared recognition sensor 220 within a certain range (eg, within ±10%) of the entire screen to the sensor unit position adjusting unit 300. can

The infrared recognition sensor 220 whose location is adjusted within a certain range transmits the infrared recognition data to the control unit 400, and a location that satisfies the predetermined degree of identification is selected based on the newly collected infrared recognition data from other locations. It can be. For example, the control unit 400 may select/adjust the position of the infrared recognition sensor 220 to a position where the identification degree of the infrared marker is highest within a certain range.

Then, in order to better recognize the infrared marker projected on the screen S, the control unit 400 can simplify and distinguish the identified infrared marker into a recognition area and a non-recognition area of recognition data. The controller 400 may remove noise on the interface between the recognition area and the non-recognition area in the simplified image source, and through this, only the interface of the infrared marker may be recognized.

3 shows an example in which the infrared interactive projection system 10 according to an embodiment is utilized.

Referring to FIG. 3, the screen basically displayed on the screen S may be the content that is the main culprit of global warming, and if the content is illuminated with an infrared flash, a solution can be directed so that it appears inside the infrared flash area. there is.

In addition to global warming, content such as human body structure and automobile structure can be directed so that the internal structure can be displayed when the corresponding content is illuminated with an infrared flash while the external appearance is displayed.

At this time, the interactive projection system 10 according to an embodiment, before the experiencer/learner starts experience/learning, the sensor unit position adjustment unit according to the screen projected on the screen S through the image recognition sensor 210 The position of the image recognition sensor 210 can be adjusted through (300). Through this, the image recognition sensor 210 is automatically adjusted to an optimal position, and recognizes outer corners to automatically recognize only necessary coordinates.

In addition, the interactive projection system 10 according to an embodiment automatically adjusts the position of the infrared recognition sensor 220 so that the infrared recognition is not affected by an external light source before the experiencer/learner starts experiencing/learning. Thus, the infrared recognition performance can be improved.

As such, in the case of interactive content using a beam projector, the infrared interactive projection system 10 according to an embodiment may be configured to operate by recognizing a situation based on a screen projected on the screen by various sensors.

The infrared interactive projection system 10 according to an embodiment allows sensors to normally recognize a screen, thereby eliminating the inconvenience of directly setting the positions of sensors and mapping coordinate values by professional technicians. .

The infrared interactive projection system 10 according to an embodiment can provide higher convenience by automatically adjusting the image recognition sensor 210 to an optimal position and automatically recognizing necessary coordinates.

In addition, the infrared interactive projection system 10 according to an exemplary embodiment may increase recognition performance by automatically adjusting an infrared sensor recognition value to a position with the highest recognition rate when infrared recognition is affected by an external light source.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the embodiment or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with limited drawings, those skilled in the art can apply various technical modifications and variations based on the above. For example, the described techniques may be performed in an order different from the method described, and/or components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

10: infrared interactive projection system
100: beam projector
200: sensor unit
210: image recognition sensor
220: infrared recognition sensor
300: sensor unit position adjusting unit
400: control unit
500: infrared generation unit
S: screen

Claims (8)

a beam projector that projects images onto a screen;
a sensor unit recognizing the image on the screen;
a sensor unit position adjusting unit for adjusting the position of the sensor unit; and
a control unit that reads image information from the sensor unit and transmits a position control signal of the sensor unit to the sensor unit position adjusting unit;
including,
Infrared interactive projection system.
According to claim 1,
The sensor unit,
an image recognition sensor for recognizing the image on the screen by the beam projector; and
an infrared recognition sensor for recognizing an infrared image or an infrared marker on the screen;
including,
Infrared interactive projection system.
According to claim 2,
The sensor unit position adjustment unit controls the position of the image recognition sensor so that the image recognition sensor recognizes the entire screen in a pan-tilt-zoom method.
Infrared interactive projection system.
According to claim 2,
The control unit performs image correction so that the full screen screen is recognized as a flat screen, and matches the screen recognized as the flat image with coordinates of actual content.
Infrared interactive projection system.
According to claim 2,
Further comprising an infrared generator for projecting an infrared marker on the screen on which the test screen is projected.
Infrared interactive projection system.
According to claim 5,
The infrared recognition sensor recognizes the infrared marker, and the control unit determines the degree of identification of the recognized infrared marker.
Infrared interactive projection system.
According to claim 6,
If the identification degree does not satisfy the set value, the sensor unit position adjustment unit adjusts the position of the infrared recognition sensor within a set range, and selects the position of the infrared recognition sensor at a position where the identification degree satisfies the preset degree. doing,
Infrared interactive projection system.
According to claim 7,
The control unit distinguishes a recognition area and a non-recognition area of the recognition data of the identified infrared marker, and removes noise at the boundary between the recognition area and the non-recognition area.
Infrared interactive projection system.

Images