WO2017065556A1 - Image projection apparatus, method for expanding projection area thereof, and non-temporary computer-readable recording medium - Google Patents

Abstract

Provided are an image projection apparatus, a method for expanding the projection area thereof, and a non-temporary computer-readable recording medium. An image projection apparatus according to one embodiment of the present invention may comprise: an optical module for projecting a beam in a surface direction extending from the placement surface on which the image projection apparatus is placed; a sensor module, located within a set distance from the image projection apparatus, for sensing another image projection apparatus; a communication module; and a processor for projecting, via the optical module, the image on the basis of the distance from the other image projection apparatus when communication is established with the other sensed image projection apparatus by means of the communication module.

Description

Image projection apparatus, its projection area expansion method and non-transitory computer readable recording medium

The present invention relates to an image projection apparatus, a projection area expansion method thereof, and a non-transitory computer readable recording medium, and more particularly, to calculate an expansion projection area by a plurality of image projection devices, and to calculate an image in the calculated expansion area. And a non-transitory computer readable recording medium.

A projector is a type of display device that displays an image by projecting an input image signal onto a screen using light emitted from a light source. Such projectors are used for various purposes in conference rooms, theaters, home theaters, and the like.

However, the existing projectors were inconvenient in that they were installed in a large, heavy, fixed location. Accordingly, although a pico projector that emphasizes portability has been developed, a cumbersome process of installing and focusing on a tripod is required to view a desired image. In addition, there is a problem that if a person or an object exists between the projector surface and the project, shadows are generated, which interferes with viewing content.

When a screen is expanded by using a plurality of projectors, an overlapping area is calculated by capturing an image projected by another device other than the projector, and correction of the overlapping area is performed. As such, since an image analysis process and the like are necessary, there is a problem in that it takes a long time to expand the screen.

According to an embodiment of the present invention for solving the above problems, an image that can calculate the entire projection area by using a relative position between a plurality of devices, and can generate content having a size and shape corresponding to the entire projection area A projection device, a method of expanding the projection area thereof, and a non-transitory computer readable recording medium may be provided.

An image projection apparatus according to an embodiment of the present invention, an optical module for projecting light in the direction of the surface extending from the placement surface on which the image projection apparatus is disposed, other image projection located within a certain distance range from the image projection apparatus When the sensor module for detecting a device, the communication module and the communication with the detected other image projection device through the communication module, the image is projected through the optical module based on the distance to the other image projection device. It may include a processor.

The processor may be configured to generate at least a portion of the content as the image according to a distance from the other image projection apparatus, and combine the image projected by the other image projection apparatus and the image to form one content. have.

The processor may be further configured to divide one content into a plurality of sub-images, control the optical module to project one of the plurality of sub-images according to the distance from the other image projection apparatus, and the plurality of subs. The other one of the images may be transmitted to the other image projection apparatus through the communication module.

The sensor module outputs a detection value for detecting at least one of a distance from the other image projector, a rotation angle of the image projector, and an angle between the image projector and the other image projector, The communication module may receive information of the other image projection apparatus, and the processor may process an image projected through the optical module based on the detected value and the received information.

The other image projection apparatus may include a sensor module that detects a rotation angle of the other image projection apparatus, and the information of the other image projection apparatus may be rotation angle information.

The processor may provide a screen for setting which one of a first projection area of the image projection device and a second projection area of the other image projection device is extended.

The processor may differently adjust the transparency of the first projection area of the image projection device that overlaps with the second projection area of the other image projection device.

When the enlargement ratio of the image is set, the processor may provide a guide message for guiding a position where the other image projection apparatus should be arranged.

The optical module may project light when one surface of the image projection apparatus is disposed close to the placement surface, and stop the light projection when one surface of the image projection apparatus is spaced apart from the placement surface. .

In another aspect, a method of expanding a projection area of an image projection apparatus may include detecting another image projection apparatus located within a predetermined distance from the image projection apparatus, and communicating with the detected other image projection apparatus. And projecting an image in a surface direction extending from an arrangement surface on which the image projection apparatus is disposed, based on the distance from the other image projection apparatus.

The projecting may include generating at least a portion of the content as the image according to a distance from the other image projection apparatus, and combining the image projected by the other image projection apparatus and the image to form one content. can do.

The projecting may include: dividing one content into a plurality of sub-images, projecting one of the plurality of sub-images, and a plurality of sub-images according to a distance from the other image projecting device. And transmitting the other to the other image projection apparatus.

The sensing may include outputting a detection value for detecting at least one of a distance from the other image projection apparatus, a rotation angle of the image projection apparatus, and an angle between the image projection apparatus and the other image projection apparatus. The communication may include receiving information of the other image projection apparatus, and the projecting may process the projected image based on the detected value and the received information.

The other image projector may be information about rotation angles detected by the other image projector.

The method may further include providing a screen for setting which one of the first projection area of the image projection device and the second projection area of the other image projection device to extend the projection area.

The method may further include differently adjusting transparency of the first projection area of the image projection device that overlaps with the second projection area of the other image projection device.

If the enlargement ratio of the image is set, the method may further include providing a guide message for guiding a position where the other image projection apparatus should be arranged.

The projecting may include projecting light when one surface of the image projection apparatus is disposed close to the layout surface, and stopping the light projection when one surface of the image projection apparatus is spaced apart from the layout surface. have.

On the other hand, non-transitory computer-readable recording medium including a program for executing a method for expanding the projection area of the image projection apparatus according to another embodiment of the present invention, other image projection is located within a certain distance range from the image projection apparatus Detecting a device, communicating with the detected other image projection device, and projecting an image in a direction extending from a placement surface on which the image projection device is disposed, based on a distance from the other image projection device; It may include a method of expanding the projection area of the image projection apparatus including.

According to various embodiments of the present disclosure as described above, a user may obtain an effect of quickly and easily projecting an image on a screen having an expanded size only by moving the plurality of image projectors in proximity.

1A and 1B are views for explaining a concept of an image projection apparatus according to an embodiment of the present invention;

2 is a schematic block diagram illustrating a configuration of an image projection apparatus according to an embodiment of the present invention;

3A is a block diagram for explaining in detail the configuration of an image projection apparatus according to an embodiment of the present invention;

3B illustrates an example of a module stored in a memory of an image projection apparatus according to an embodiment of the present invention;

3C is a diagram illustrating examples of an external device capable of receiving data by an image projection device according to an embodiment of the present invention;

4 is a view showing an optical module of the image projection apparatus according to an embodiment of the present invention;

5 to 7B are diagrams for determining a projection area expansion situation of an image projection apparatus according to an embodiment of the present invention;

8A to 8C are views illustrating various embodiments of positions where keys are arranged when the area extension function is activated through a key;

9 is a diagram illustrating a plurality of image projection apparatuses interlocking to project one content image according to an embodiment of the present invention;

10A to 11B are views illustrating region expansion around one image projection apparatus among a plurality of image projection apparatuses according to an embodiment of the present invention;

12A to 12C illustrate information necessary for determining an entire projection area in an image projection apparatus according to an embodiment of the present invention;

13A to 13E are views for explaining an overlapping area in which projection areas overlap;

14A to 15C are diagrams for describing a method of delivering image data, according to various embodiments of the present disclosure;

16A to 16F are diagrams for explaining a method of providing a guide message for guiding a position of an image projection apparatus for creating a specific enlarged area;

17 to 19 are flowcharts illustrating a method of expanding a projection area of an image projection apparatus, according to various embodiments of the present disclosure.

Hereinafter, with reference to the accompanying drawings a preferred embodiment of the present invention will be described in detail. In describing the present invention, when it is determined that the detailed description of the related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, terms to be described below are terms defined in consideration of functions in the present invention, and may vary according to a user, an operator, or a custom. Therefore, the definition should be made based on the contents throughout the specification.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are only used to distinguish one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes any one of a plurality of related items or a combination of a plurality of related items.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting and / or limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, the term including or having is intended to indicate that there is a feature, number, operation, operation, component, part, or a combination thereof described in the specification, one or more other features or numbers, operation It is to be understood that the present invention does not exclude in advance the possibility of the presence or the addition of an operation, a component, a part, or a combination thereof.

1A and 1B are diagrams for describing a concept of an image projection apparatus 100 according to an exemplary embodiment. For example, the image projection apparatus 100 may be implemented as a projector using a single focus optical system. In addition, the image projection apparatus 100 may be a projector using a projection lens mirror system.

 As shown in FIG. 1A, the image projection apparatus 100 according to an exemplary embodiment may project an image when the image projection apparatus 100 is located close to a horizontal surface (bottom surface) such as a table. In addition, as illustrated in FIG. 1B, the image projection apparatus 100 may project an image when positioned close to a vertical surface such as a wall surface. Image projection apparatus 100 according to an embodiment of the present invention is different from the general projector in that it projects an image on the installation surface. In addition, the image projection apparatus 100 according to an embodiment of the present invention has a difference from a general projector in that it is portable.

As such, the image projection apparatus 100 may project an image when the image is close to the target surface (projection surface) to be projected, so that the user may use the image projection function with a simple operation of laying down the image projection apparatus 100. And efficient power management is also possible. That is, the image projection apparatus 100 projects light when one surface of the image projection apparatus 100 is disposed close to the layout surface, and stops light projection when one surface of the image projection apparatus 100 is spaced apart from the layout surface. can do.

Referring to FIG. 2, the image projection apparatus 100-1 may include an optical module 160-1, a communication module 120-1, a sensor module 140-1, and a processor 110-1. .

The optical module 160-1 may project an image in a surface direction extending from the placement surface on which the image projection apparatus 100-1 is disposed. For example, the optical module 160-1 may include a lens and a mirror. The size of the image projected by the optical module 160-1 may be determined by the distance between the lens and the mirror. Since the size of the image projected by the image projection apparatus 100-1 is determined, even if a separate device does not capture the image projected by the plurality of image projection apparatuses 100-1, 100-2, the plurality of image projections The size and shape of the entire projection area can be determined using the relative position information between the devices 100-1 and 100-2. In addition, the projection distance may be fixed according to the specification of the optical module 160-1 due to the characteristics of the ultra short focus optical system. The configuration of the optical module 160-1 will be described in detail with reference to FIG. 4 below.

The sensor module 140-1 may include various types of sensors. For example, the sensor module 140-1 may include an ultrasonic sensor 144, a proximity sensor 147, and the like, which may sense another adjacent image projection device 100-2. In addition, the sensor module 140-1 may include a gyro sensor 142, an acceleration sensor 143, a geomagnetic sensor, or the like, which can know the rotation angle of the image projection apparatus 100-1. For example, when the image projection apparatus 100-1 is placed horizontally on the bottom surface, the front end direction may be defined as the x-axis direction, the lateral direction as the y-axis direction, and the direction perpendicular to the bottom surface may be defined as the z-axis. have. In this case, the rotation angle of the image projection apparatus 100-1 means the degree of rotation about the z axis. The rotation angle may alternatively be represented by the yaw angle.

The sensor module 140-1 may use at least one of a distance, an angle, and rotation angle information of the image projection apparatus 100-1 from another image projection apparatus 100-2, which is information necessary to calculate the total projection area using various sensors. You can output a sense value that detects one.

The communication module 120-1 may perform a function of communicating with another image projection apparatus 100-2 or the external device 400. For example, the communication module 120-1 may transmit and receive image data, rotation angle information, a control command, and the like with another image projection apparatus 100-2 using a WiFi mirroring method. The communication module 120-1 may use various methods of communication not only WiFi mirroring.

The processor 110-1 controls the overall configuration of the image projector 100-1. When the processor 110-1 communicates with the detected other image projection apparatus 100-2 through the communication module 120-1, the processor 110-1 is based on the distance from the other image projection apparatus 100-2 to the optical module 160. The image can be projected through -1).

The processor 110-1 may generate at least a portion of content as an image according to the distance from the other image projector 100-2 to project the image and the optical module 160-1 from the other image projector 100-2. ) Images may be combined to form a single content. Here, a part of the content means a part of space. For example, in the case of video content, a part of the content means a part of space for each frame constituting the video.

The processor 110-1 may divide one content into a plurality of sub images according to the distance from the other image projection apparatus 100-2. The processor 110-1 may control the optical module 160-1 to project one of the plurality of sub-images. In addition, the processor 110-1 may control the communication module 120-1 to transmit the other one of the plurality of sub-images to another image projection apparatus 100-2. By combining images projected by the plurality of image projectors 100-1 and 100-2, one content may be formed on the projection surface. The plurality of image projectors 100-1 and 100-2 may share sync information for syncing not only a plurality of sub-images, respectively.

For example, the processor 110-1 may output a sensed value output from the sensor module 140-1 (distance from another image projection apparatus 100-2, rotation angle of the image projection apparatus 100-1, and image projection). Information of another image projection apparatus 100-2 received through the communication module 120-1 and at least one of angles between the device 100-1 and the other image projection apparatus 100-2. The size and shape of the entire projection area can be determined.

The other image projection apparatus 100-2 may also include the sensor module 140-2 itself. In addition, the sensor module 140-2 may detect location information including a rotation angle of the other image projector 100-2. For example, the information of the other image projection apparatus 100-2 used by the processor 110-1 may be location information of another image projection apparatus.

The processor 110-1 may generate an image having a size and shape corresponding to the size and shape of the entire projection area. For example, the processor 110-1 may generate the projection image in the largest rectangular shape that may be included in the entire projection area.

According to an embodiment of the present disclosure, one image projection apparatus of the plurality of image projection apparatuses 100 for expanding the projection area may be determined as a master image projection apparatus in charge of overall control. For example, a method of determining an external device 400 transmitting image data and the first-facing image projection apparatus 100 as a master, a method of receiving a master selection from a user, and an image projection area having the widest of all projection areas. Various methods may be applied, such as a method of determining the image projection apparatus 100 occupying an area as a master.

3A is a block diagram illustrating in detail the configuration of the image projection apparatus 100 according to an exemplary embodiment. Referring to FIG. 3A, the image projector 100 may include one or more processors 110, a communication module 120, a memory 130, a sensor module 140, an input device 150, an optical module 160, and an interface. An audio module 180, a camera module 191, an indicator 192, a motor 193, a power management module 194, a battery 195, and a wireless charging module 196 may be included.

The processor 110 may control a plurality of hardware or software components connected to the processor 110 by driving an operating system or an application program, and may perform various data processing and operations including multimedia data. For example, the processor 110 may be implemented in the form of a system on chip (SoC). In addition, the processor 110 may further include a graphic processing unit (GPU).

The communication module 120 is configured as a wireless communication module to perform a wireless communication function with the outside. The communication module 120 may include various modules such as a WiFi module 121, a Bluetooth module 122, and a radio frequency (RF) module 123. In the case of using the WiFi module 121 or the BT module 122, various connection information such as SSID and session key may be transmitted and received first, and then various data may be transmitted and received using the communication connection.

In FIG. 3A, the WiFi module 121 and the BT module 122 are illustrated as separate blocks, but may be implemented in the form of an integrated chip (IC) or an IC package including several types of wireless communication modules.

The RF module 123 may transmit and receive data through the transmission and reception of RF signals. The RF module 123 may include a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), or the like. In FIG. 3A, although the WiFi module 121 and the BT module 122 share one RF module 123 with each other, RF signals may be transmitted and received through separate RF modules 123, respectively.

The communication module 120 may perform communication according to various communication standards such as IEEE, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), and the like.

The memory 130 may store various data, programs, or applications for driving and controlling the image projection apparatus 100. For example, the memory 130 may store information about the size and shape of the reference image. The memory 130 may include an internal memory 131. For example, the internal memory 131 may be volatile memory such as dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), or one time programmable ROM (OTPROM), programmable ROM (PROM), or erasable EPROM. and non-volatile memory such as programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, NAND flash memory, and NOR flash memory.

The sensor module 140 may detect a state of the image projector 100 and convert the detected information into an electrical signal. The sensor module 140 may include a gesture sensor 141, a gyro sensor 142, an acceleration sensor 143, an ultrasonic sensor 144, an infrared sensor 145, a hall sensor 146, a proximity sensor 147, and an illuminance sensor. 148 may be included. In addition, the sensor module 140 may include an olfactory sensor (E-nose sensor, not shown), an EMG sensor (electromyography sensor, not shown), an EEG sensor (electroencephalogram sensor, not shown), an ECG sensor (electrocardiogram sensor, not shown), It may include an iris sensor (not shown) or a fingerprint sensor (not shown), a pressure sensor (not shown).

The sensor module 140 may detect whether the image projection apparatus 100 is close to the placement surface. For example, the sensor module 140 may determine whether the sensor module 140 is close to the placement surface by using the illumination sensor 148 attached to one surface of the image projection apparatus 100. In addition, the sensor module 140 may detect a recognition mark marked with infrared rays using the infrared sensor 145. Through this, the sensor module 140 may detect the size and shape of the projected image.

In addition, the sensor module 140 may determine how much the image is rotated based on the reference direction by determining the degree of rotation of the image projection apparatus 100. The sensor module 140 may detect whether another image projection apparatus 100 ′ is adjacent to each other or a distance from the other image projection apparatus 100 ′.

The input device 150 may receive a user input. For example, the input device 150 may include a physical button, an optical key or a keypad.

The optical module 160 may project an image. The optical module 160 may include an illumination module 161 and a projection module 162. The projection module 162 may display an image by projecting light onto the projection surface. The projection module 162 may project light in a surface direction extending from the placement surface on which the image projection apparatus 100 is disposed.

The optical module 160 may project light when the image projector 100 is located on the placement surface or when the image projection device 100 is located within a predetermined distance from the placement surface. For example, when the image projection apparatus 100 is not close to the placement surface, the power management module 194 may block supplying power to the optical module 160 to prevent the optical module 160 from operating. Can be.

As the projection module 162 projects light, various methods such as DLP, LCOS, 3LCD, and laser may be used.

The interface 170 may include a high-definition multimedia interface (HDMI) 171 and a universal serial bus 172 (USB). The interface 170 may transmit and receive data by wired connection with an external device.

The audio module 180 may bidirectionally convert a voice and an electrical signal. The audio module 180 may process voice information input or output through the speaker 181, the microphone 182, or the like.

The camera module 191 may capture still images and videos. The camera module 191 may include an image sensor and the like, and may capture a projection image to analyze a property of the projection image.

The indicator 192 may display a state of the image projection apparatus 100 or some components thereof, for example, a booting state, a message state, or a charging state.

The motor 193 may convert electrical signals into mechanical vibrations.

The power management module 194 manages power of the image projector 100. For example, when one surface of the image projection apparatus 100 is disposed to be close to the placement surface on which the image is to be projected, the power management module 194 may apply power to the optical module 160.

The battery 195 may store or generate electricity, and supply power to the image projector 100 by using the stored or generated electricity. For example, the battery 195 may include a rechargeable battery or a solar battery.

The wireless charging module 196 may include a circuit capable of wireless charging, for example, a circuit such as a coil loop, a resonant circuit or a rectifier. The wireless charging module 169 may use a magnetic resonance method, a magnetic induction method, or an electromagnetic wave method as a wireless charging method.

Each of the above-described components of the image projection apparatus 100 according to various embodiments of the present disclosure may be configured with one or more components, and the name of the corresponding component may vary according to the type of device. . The image projection apparatus 100 according to various embodiments of the present disclosure may be configured to include at least one of the above components, and some components may be omitted or further include other components. In addition, some of the components of the image projection apparatus 100 according to various embodiments of the present disclosure are combined to form an entity, and thus may perform the same functions of the corresponding components before being combined. have.

3B is an example of a module stored in the memory 130 of the image projection apparatus 100 according to an embodiment of the present invention. Referring to FIG. 3B, the memory 130 includes an operating system 132, a signal processing module 133, a device position determination module 134, a projection surface analysis module 135, a projection image expandability determination module 136, and a user. It may include an input processing module 137.

The operating system 132 controls the overall operation of the image projection apparatus 100.

The signal processing module 133 may perform buffering or signal decoding so that the content received through the communication module 120 may be projected through the optical module 160. The signal processing module 133 may process the image data received by the image projection apparatus 100. The signal processing module 133 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, etc. on the video data.

The device position determination module 134 may determine whether the image projection apparatus 100 is located on the placement surface. For example, the device position determination module 134 may determine whether the image projection apparatus 100 is located on the placement surface or approached within a predetermined distance.

As another example, the device position determination module 134 may determine whether the surface on which the image projection apparatus 100 is located is perpendicular to or horizontal to the gravity direction (eg, perpendicular to the ground surface or horizontal).

The projection surface analysis module 135 may correct the image by analyzing the projector projection surface. For example, the projection surface analysis module 135 may correct geometric information color information of the projection image.

The projection image expandability determination module 136 may determine whether there is at least one other image projection apparatus in the vicinity of the image projection apparatus 100, and determine the expansion possibility of the projection image.

The user input processing module 137 senses a user input in the output projection image and processes data in response thereto.

3C is a diagram illustrating an example of external devices capable of receiving data by the image projection apparatus 100. According to an embodiment of the present disclosure, the image projection apparatus 100 may receive content to be projected from the external device 400 through the communication module 120 or the interface 170.

Examples of the external device 400 include a flexible device 400-1, a watch-type device 400-2, a tablet PC 400-3, a mobile device 400-4, a display device 400-5, a notebook computer. Computer 400-6, desktop computer 400-7, wearable device 400-8 such as smart glasses, and the like. The external device 400 is not limited thereto, and any external device 400 may be any device capable of transmitting content to the image projector 100 by wire or wirelessly. The image projector 100 may store the content received from the external device 400 in the memory 130.

4 is a diagram illustrating an example of an optical module 160 according to an exemplary embodiment. Referring to FIG. 4, the illumination optical system 11 and the projection lens unit 13 may be disposed in the housing 16. The light projected by the illumination optical system 11 may change the direction of light vertically through the prism 12. The projection lens unit 13 is composed of a combination of lenses 14, and the combination of lenses 14 serves to prevent an image from being distorted even at a small projection distance. In addition, the projection lens unit 13 may include a mirror 15, and may reflect light to the side through the mirror 15. The projection lens unit 13 enables the projection to the side projection surface even at a short projection distance by using the ultra short focus lens in combination of the lenses. In another example, the optical module 160 may be configured by horizontally positioning the illumination optical system 11 and the projection lens unit 13 except for the prism 12.

Hereinafter, features of the image projection apparatus 100 according to an exemplary embodiment will be described with reference to the drawings.

The image projection apparatus 100-1 according to an embodiment of the present invention determines whether the screen can be expanded without a separate device, and uses relative position information with another image projection apparatus 100-2. The expanded total projection area can be determined.

Referring to FIG. 5, the processor 110 may detect the proximity of another image projection apparatus 100-2 using the sensor module 140. When the other image projection apparatus 100-2 detects that the other image projection apparatus 100-2 has approached within a predetermined distance, the processor 110 may determine that the projection area is extended. For example, the processor 110 may expand and extend the projection area by using a magnetic sensor, a proximity sensor, an infrared sensor, a depth camera, a UWB radar, and the like included in the sensor module 140. It can be seen that another image projector 100-2 is in proximity. Since it is necessary to approach within a certain distance to extend the projection area, the processor 110 may activate the projection area extension function only when the approach of another image projection apparatus 100-2 is detected.

As another example, the processor 110 may activate the projection area extension function only when the approach of the other image projection apparatus 100-2 is detected and the communication with the other image projection apparatus 100-2 is detected.

For example, as illustrated in FIG. 6, whether to activate the projection area extension function may be guided by the color of the button. In the left figure of FIG. 6, since the two image projection apparatuses 100-1 and 100-2 approach within a certain distance, the processor 110 may display the color of the button as a color indicating activation (eg, green). Can be. In contrast, in the right figure of FIG. 6, since the two image projection apparatuses 100-1 and 100-2 are not within a certain distance, the processor 110 changes the color of the button to a color (for example, red) indicating inactivation. I can display it.

As another example, when the processor 110 activates the projection area extension function, the sensor module 140 may start to detect whether another image projection apparatus 100-2 is in proximity. Alternatively, the processor 110 may detect the presence of another image projector 100-2 using the communication module 120.

If the projection area extension function is activated but no other image projection apparatus 100-2 is in close proximity, the processor 110 may provide a guide message to inform the user that there is no other image projection apparatus 100-2 in proximity to the user. . For example, the processor 110 may provide a guide message to a user by using at least one of a guide image included in a laser, an LED, a mechanical sound, a voice guide, a vibration, and a projection image.

Referring to FIG. 7A, it can be seen that the user inputs the projection area extension function activation command to the image projection apparatus 100-1, but the other image projection apparatus 100-2 does not approach within a certain distance. The processor 110 may control the optical module 160 to project a guide message such as 'close two devices'.

As another example, as shown in FIG. 7B, the processor 110 communicates to send a control command that causes the paged external device 400 to provide a guide message, `` close two devices '' with an OSD message or voice. Module 120 can be controlled.

According to another embodiment of the present disclosure, after detecting that the other image projection apparatus 100-2 is in proximity, the processor 110 may again determine whether it is communicable with the other image projection apparatus 100-2. Can be. In addition, if there is no communication connection, the processor 110 may provide a guide message for the communication connection.

According to another embodiment of the present invention, when the other image projection apparatus 100-2 is not detected at the periphery for a preset time, the processor 110 does not have the other image projection apparatus 100-2 in the vicinity. You can also provide a guide message to inform the.

According to an embodiment of the present disclosure, a user input for allowing the plurality of image projectors 100 to be connected to the same network may be performed. Alternatively, a user input for activating the projection area extension function may be performed. For example, the processor 110 may receive such user input in a variety of ways, as shown in FIGS. 8A-8C.

Referring to FIG. 8A, the external device 400 and the first image projector 100-1 are paired with each other so that the screen of the external device 400 is projected by the first image projector 100-1. It can be seen. The processor 110-1 may receive a user input through an input device 150-1 (eg, a physical button) provided outside the image projection apparatus 100-1.

FIG. 8B is a diagram illustrating an embodiment in which a button for receiving a user input is included in a projection screen and provided. When the sensor module 140 detects a user gesture of pressing a button included in the projection screen, the processor 110 may determine that a network connection or a projection area extension function activation input has been received.

As another example, as illustrated in FIG. 8C, the first image projector 100-1 may receive a user input through the paired external device 400.

FIG. 9 is a diagram illustrating that the projection areas of the first image projection device 100-1 and the second image projection device 100-2 are integrated and extended to the entire projection area. It can be seen that the 'A' image provided by the external device 400 is projected on the entire projection area. In FIG. 9, a plurality of image projectors 100-1 and 100-2 are horizontally arranged, and the processor 110 may cover the entire projection area only by a distance between the plurality of image projectors 100-1 and 100-2. Can be calculated A case where the arrangement of the plurality of image projectors 100-1 and 100-2 is misaligned will be described in detail later with reference to FIG. 12.

10A and 10B illustrate a plurality of image projection apparatuses 100-1 and 100-2 according to an embodiment of the present invention connected to external devices 400-1 and 400-2, respectively. It is a figure which shows the extended case.

Referring to FIG. 10A, the first image projector 100-1 is paired with the first external device 400-1 to project an 'A' image provided by the first external device 400-1. Similarly, the second image projector 100-2 is paired with the second external device 400-2 to project the 'B' image provided by the second external device 400-2.

When the plurality of image projectors 100-1 and 100-2 are linked to project one content to the entire projection area, the image projected by any of the image projection devices 100-1 and 100-2 is linked. There is a need to determine whether to project.

For example, as shown in FIGS. 10A and 10B, the processor 110 may select to project the image projected by the image projection apparatus 100 that has requested the projection area expansion function in association. In FIG. 10A, in response to a user input through a button provided in the first image projector 100-1, the processor 110 may control the 'A' image to be projected in the entire extended projection area. In contrast, in FIG. 10B, in response to a user input through a button provided in the second image projector 100-1, the processor 110 may control the 'B' image to be projected in the entire extended projection area.

In another embodiment, the processor 110 may provide a screen for setting which of the first projection area and the second projection area to extend the projection area. The processor 110 may determine the entire projection area based on the area set by the screen. For example, the processor 110 may provide a screen including a UI to determine the entire projection area based on the set area. In the case of FIGS. 9 to 10B, the entire projection area of the same shape will be determined no matter which projection area is centered. However, as illustrated in FIGS. 11A and 11B, when the image projection directions of the plurality of image projection apparatuses 100-1 and 100-2 are different from each other, the entire projection area (edge blending screen) can be represented. There is a need to decide whether or not to decide.

In addition to the above-described method of providing a screen or UI, a method of expanding a projection area around the image projection apparatus 100 in which a user command for activating the projection area extension function is input, and connected to an external device 400 for delivering content. How to extend the projection area around the image projection device 100, how to extend the projection area around the image projection device 100 that the user last installed, the image projection device 100 last connected to the network Various methods may be applied, such as a method of extending the projection area around the center.

Hereinafter, a method of calculating an entire projection area according to an embodiment of the present invention will be described with reference to FIGS. 12A to 12C.

Image projection apparatus 100 according to an embodiment of the present invention has a projection area of a predetermined size and shape. Accordingly, the entire projection area can be calculated only by the relative arrangement information of the plurality of image projectors 100. In other words, without an image processing process through a separate device, the processor 110 can determine the form in which the plurality of projection areas overlap.

As shown in FIG. 12A, when the plurality of image projectors 100-1 and 100-2 are horizontally arranged, the processor 110 may calculate the entire projection area based on only the distance information between the devices. This is because the image projection apparatus 100 according to the exemplary embodiment of the present invention using the ultra short focus optical system has a constant projection area. For example, the processor 110 may measure the distance between the devices using the ultrasonic sensor 144.

Next, as shown in FIG. 12B, when the projection directions of the plurality of image projectors 100-1 and 100-2 are the same (when the rotation angles are the same), the processor 110 determines the distance between the devices. The entire projection area can be calculated from the information and the angle information between the devices. The processor 110 may determine the horizontal and vertical distances from the other image projection apparatus 100-2 using the distance information and the angle information. For example, the processor 110 may determine the horizontal and vertical distances by converting the (r, θ) coordinate values into the (x, y) coordinate values.

12C illustrates that the image projection apparatus 100-1 rotates the z axis (the axis perpendicular to the placement surface) as the rotation axis, and thus the image projection direction of the image projection apparatus 100-2 does not match. Figure is a diagram. In this case, the processor 110 may obtain rotation angle information of the image projection apparatus 100-1 by using the sensor module 140. For example, the sensor module 140 may detect the rotation angle of the image projector 100-1 through the geomagnetic sensor.

The processor 110 may determine the total projection area by combining distance information, angle information, and tilt information of the image projection apparatus 100-1 between the plurality of image projection apparatuses 100-1 and 100-2. . The processor 110 may control the communication module 120 to receive rotation angle information of the other image projector 100-2.

13A to 13E illustrate an example of expanding a screen by arranging a plurality of image projection apparatuses 100 in various forms.

FIG. 13A illustrates a case where the plurality of image projectors 100-1 and 100-2 are horizontally arranged, and FIG. 13B illustrates a case where the plurality of image projectors 100-1 and 100-2 are vertically arranged. The case is shown. The processor 100 determines an entire projection area, and among the entire projection areas, the first projection area by the first image projection apparatus 100-1 and the second projection area by the second image projection apparatus 100-2 are determined. It is possible to determine where overlapping regions overlap. Since light is overlapped and projected in the overlapping area, the processor 110 may adjust the transparency of the image projected on the overlapping area so that the brightness of the entire projection area is constant.

When using a larger number of image projection apparatuses 100 as shown in FIGS. 13C and 13D, regions in which the number of overlapping overlapping regions are different are generated. For example, the processor 110 may maintain a constant brightness of the entire projection area by adjusting an alpha value for each overlapping area.

As shown in FIG. 13E, when the plurality of image projectors 100-1 and 100-2 are rotated based on the gravity direction, the processor 110 may perform correction to rotate and reduce the projected image. In the case where the rotation and reduction correction is performed, as shown in the lower figure of FIG. 13E, the overlapped region is not parallel but has a parallelogram shape.

14A to 14C are diagrams illustrating a method of transmitting image data in the image projection apparatus 100 according to an exemplary embodiment.

Referring to FIG. 14A, a method of dividing content into a plurality of sub-images by the external device 400 may be applied. An image projected from the first image projector 100-1 will be displayed on the left side of the entire projection area, and an image projected from the second image projector 100-2 will be displayed on the right side of the entire projection area. The processor 110-1 may receive, through the communication module 120-1, data obtained by dividing the content into a plurality of sub-images (eg, a left A screen and a right A screen) in advance by the external device 400. have. The processor 110-1 transmits the remaining A screen data, other than the left A screen data, to be projected through the optical module 160-1, to the other image projection apparatus 100-2. 120-1 can be controlled.

FIG. 14B is a diagram illustrating an embodiment in which all devices 400, 100-1, and 100-2 share all image data. In this case, the processors 110-1 and 110-2 of the image projection apparatuses 100-1 and 100-2 divide the contents into a plurality of sub-images, and the optical modules 160-1 and 160-2 of the optical modules 160-1 and 160-2. ) To determine the sub image to be projected.

Referring to FIG. 14C, the processor 110-1 may divide content (A screen data) received from the external device 400 into a plurality of sub-images. The processor 110-1 projects one of the plurality of sub images (left A screen data) onto the projection surface through the optical module 160-1, and the other of the plurality of sub images (right A screen data). The communication module 120-1 may be controlled to transmit the data to the other image projection apparatus 100-2.

15A to 15C are diagrams for describing a procedure of transmitting data in a plurality of image projection apparatuses 100 according to various embodiments of the present disclosure. The data transferred between the image projection apparatuses 100 may include not only image data but also data on a projection area.

As shown in FIG. 15A, a method of distributing and transferring data by the image projector 100 connected to the external device 400 may be applied. That is, the image projection apparatus 100 connected to the external device 400 performs all the functions related to data distribution.

FIG. 15B is a diagram illustrating a method of sequentially transmitting data by the plurality of image projection apparatuses 100. For example, the image projection apparatus 100 may deliver only data used in another image projection apparatus among all the data, or may transmit the entire data again as it is.

As another example, for fast data transmission, a method of transmitting data may be taken as illustrated in FIG. 15C.

If another image projection apparatus 100-2 exists within a specific distance, the image projection apparatus 100-1 according to an embodiment of the present invention may calculate the entire projection area and generate content suitable for the image projection apparatus 100-1. However, when the image is to be enlarged by a specific ratio or size, a position where the plurality of image projectors 100-1 and 100-2 should be arranged is determined. In this case, the processor 110 may provide a guide message for guiding a position where the other image projection apparatus 100-2 should be disposed. The processor 110 may provide various guide messages as shown in FIGS. 16A-16F. For example, the guide message may be provided in at least one of an optical signal, an audio signal, a vibration signal, and an image signal.

16A illustrates an example of using a color of an LED as a method of using a light source. Referring to FIG. 16A, the image projection apparatus 100-1 may include an LED 192-1 as an indicator. For example, the position where the other image projection apparatus 100-2 is to be disposed may be a horizontal position (P point). When the other image projection apparatus 100-2 is not disposed at the corresponding position, the processor 110-1 may control the LED 192-1 to be displayed as a red light source. If the other image projection apparatus 100-2 is disposed at a corresponding position, the processor 110-1 may control the LED 192-1 to be displayed as a green light source.

As another example, the processor 110 may provide a guide to the user by varying the blinking speed of the LED 192-1 in proportion to the distance from the target point.

As another example, as shown in FIG. 16B, the shape of the light source may be used to indicate a direction to be moved. In the case of FIG. 16B, in order to express a shape such as an arrow, the indicator 192 may include a plurality of LED lamps.

Referring to FIG. 16C, the processor 110-1 may display a position where the other image projection apparatus 100-2 should be disposed by using a laser.

16D and 16E illustrate an embodiment in which the processor 110-1 provides a guide message for guiding a location where the other image projection apparatus 100-2 should be disposed according to a desired image ratio. When the other image projection apparatus 100-2 is disposed at points P3 of FIGS. 16D and 16, the enlarged entire projection area has an image ratio of 4: 3. If the other image projector 100-2 is disposed at the point P4, the entire enlarged projection area has an image ratio of 16: 9.

In addition, when the other image projection apparatus 100-2 is disposed at a position where the entire projection area has a specific image ratio, the processor 110-1 may cause the optical module 160 to project a guide message indicating the image ratio. Can be controlled. In the case of FIG. 16D, the processor 110-1 may control the optical module 160 to project a 16: 9 guide message. Likewise, in the case of FIG. 16E, the processor 110-1 may control the optical module 160 to project a 4: 3 guide message.

FIG. 16E is a diagram illustrating an embodiment of projecting a guide message for guiding a direction in which another image projection apparatus 100-2 should move. If the other image projection apparatus 100-2 is disposed at a position capable of constructing a desired extended screen, a guide message such as 'put on the screen extended position' may be provided through the projection screen.

In addition, the processor 110 may provide a distance between the plurality of image projectors 100 as an audio signal or a vibration signal. For example, the processor 110 may control the audio module 180 such that a voice signal is generated as the distance between the plurality of image projectors 100 approaches. As another example, the processor 110 may control the motor 193 so that vibration is generated as the distance between the plurality of image projectors 100 approaches.

According to various embodiments as described above, a user can project an image on a screen of an expanded size quickly and easily by only moving the plurality of image projectors in proximity.

17 to 19 are flowcharts illustrating a method of expanding a projection area of an image projection apparatus 100 according to various embodiments of the present disclosure.

Referring to FIG. 17, the image projection apparatus 100 detects whether another adjacent image projection apparatus 100-2 exists (S1710). For example, the image projection apparatus 100 may detect whether another image projection apparatus 100-2 is located within a predetermined distance range by using an ultrasonic sensor or a proximity sensor.

In operation S1720, the image projector 100 communicates with another detected image projector. Since the process of transmitting the area data and the image data is necessary, the image projection apparatus 100 may further determine the possibility of communication connection.

When communicating with another image projection apparatus 100-2, the image projection apparatus 100 displays an image based on the detected distance from the other image projection apparatus 100-2, on which the image projection apparatus 100 is disposed. It can project in the surface direction extending from the (S1730).

18 is a flowchart illustrating a method of expanding a projection area of the image projection apparatus 100 according to an embodiment of the present invention in more detail. 18 illustrates the interlocking operation with the other image projection apparatus 100-2 described in detail in operation S1730 in more detail.

Steps S1810 and S1820 correspond to steps S1710 and S1720, and a description thereof will be omitted.

When the image projection apparatus 100 detects the other image projection apparatus 100-2 and confirms that the communication is connected, the first projection area of the image projection apparatus 100 and the second projection of the other image projection apparatus 100-2 The entire projection area is determined by combining the areas (S1830). For example, the image projection apparatus 100 may determine how the first projection region and the second projection region are based on the relative distance, angle, and rotation angle information of the image projection apparatus 100 from another image projection apparatus 100-2. You can determine if it is deployed. By combining this information, the image projector 100 may determine the size and shape of the entire projection area.

The image projection apparatus 100 generates content having a size and shape corresponding to the size and shape of the entire projection area (S1840). In addition, the image projection apparatus 100 may determine an area occupied by the first projection region and the second projection region among the entire projection regions, and may determine the content portion that should be projected by each of the image projection apparatuses 100 and 100-2. have. That is, the image projecting apparatus 100 is configured to generate another content by combining the image projected by the other image projector 100-2 and the image projected by the image projecting apparatus 100 to form one content. 2) at least a part of the content may be generated as an image according to a distance from the content.

In operation S1850, the image projection apparatus 100 may divide the content into a plurality of sub-images. The image projection apparatus 100 projects a sub-image to be projected in the first projection area among the plurality of sub-images onto the projection surface, and the sub-image projection apparatus 100-2 to project the sub-image to be projected in the second projection area. It may be provided as (S1860).

19 is a flowchart illustrating a process of determining whether the image projection apparatus 100 according to an embodiment of the present invention can execute a projection area extension function.

First, the image projection apparatus 100 may receive a user command for activating the projection area extension function (S1910). In response to the user command, the image projection apparatus 100 determines whether the other image projection apparatus 100-2 is located within a predetermined distance (S1920). The image projection apparatus 100 may determine whether another image projection apparatus 100-2 exists within a predetermined distance by using a proximity sensor or an ultrasonic sensor. If there is no other image projection apparatus 100-2 within a predetermined distance (S1920-N), the image projection apparatus 100 may provide a guide message for distance movement (S1950). For example, the image projection apparatus 100 may provide a guide message for designating a specific position as well as moving the distance.

If it is determined that the other image projection apparatus 100-2 exists within a predetermined distance (S1920-Y), the image projection apparatus 100 checks whether each image projection apparatus is in a communication connection state (S1930). Since the projection area expansion function may be performed under the premise of transmitting and receiving data, when it is determined that the communication connection is not made (S1930-N), the image projection apparatus 100 may provide a guide for the communication connection ( S1960).

If it is determined that the communication connection is made (S1930-Y, S1970-Y), the image projection apparatus 100 may execute the projection area extension function in conjunction with the other image projection apparatus 100-2.

Various embodiments of the method of expanding the projection area of the image projection apparatus 100 overlap with the description of the embodiment of the image projection apparatus 100 and will be omitted.

The methods described above may be embodied in the form of program instructions that may be executed by various computer means and may be recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, although the present invention has been described with reference to the limited embodiments and the drawings, the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

Claims (15)

1. In the image projection apparatus,

   An optical module for projecting light in a surface direction extending from an arrangement surface on which the image projector is disposed;

   A sensor module for detecting another image projection apparatus located within a predetermined distance range from the image projection apparatus;

   Communication module; And

   And a processor configured to project the image through the optical module based on a distance from the other image projection apparatus when the detected other image projection apparatus communicates with the communication module.
2. The method of claim 1,

   The processor,

   At least a portion of the content is generated as the image according to a distance from the other image projector so that the image projected by the other image projector and the image are combined to form one content Device.
3. The method of claim 1,

   The processor,

   According to the distance from the other image projection apparatus, the content is divided into a plurality of sub-images, the optical module is controlled to project one of the plurality of sub-images, and the other of the plurality of sub-images And transmit to another image projecting device through the communication module.
4. The method of claim 3,

   The sensor module outputs a detection value for detecting at least one of a distance from the other image projector, a rotation angle of the image projector, and an angle between the image projector and the other image projector,

   The communication module,

   Receiving information of the other image projection apparatus,

   The processor,

   And an image projector processing the image projected through the optical module based on the detected value and the received information.
5. The method of claim 4, wherein

   The other image projection device includes a sensor module for detecting a rotation angle of the other image projection device,

   And the information of the other image projector is rotation angle information.
6. The method of claim 2,

   The processor,

   And a screen for setting which one of the first projection area of the image projection device and the second projection area of the other image projection device to extend the projection area.
7. The method of claim 1,

   The processor,

   And differently adjusting transparency of a region overlapping with a second projection region of the other image projection apparatus among the first projection regions of the image projection apparatus.
8. The method of claim 1,

   The processor,

   And a magnification ratio of the image, providing a guide message for guiding a position where the other image projection apparatus should be arranged.
9. The method of claim 1,

   The optical module,

   And projecting light when one surface of the image projection apparatus is disposed close to the layout surface, and stopping the light projection when one surface of the image projection apparatus is spaced apart from the layout surface.
10. In the projection area expansion method of the image projection device,

    Detecting another image projection apparatus located within a predetermined distance range from the image projection apparatus;

    Communicating with the detected other image projection apparatus; And

    And projecting an image based on a distance from the other image projecting device in a surface direction extending from an arrangement surface on which the image projecting device is disposed.
11. The method of claim 10,

    The projecting step,

    Projection area expansion, characterized in that to generate at least a portion of the content as the image according to the distance to the other image projection device to combine the image projected by the other image projection device and the image to form a single content. Way.
12. The method of claim 10,

    The projecting step,

    Dividing one content into a plurality of sub-images according to a distance from the other image projector;

    Projecting one of the plurality of sub-images; And

    And transmitting another one of the plurality of sub-images to the other image projection apparatus.
13. The method of claim 12,

    The detecting may include outputting a detection value for detecting at least one of a distance from the other image projection apparatus, a rotation angle of the image projection apparatus, and an angle between the image projection apparatus and the other image projection apparatus,

    The communicating may include receiving information of the other image projection apparatus.

    The projecting step may include processing the projected image based on the detected value and the received information.
14. The method of claim 13,

    And the information of the other image projection apparatus is rotation angle information detected by the other image projection apparatus.
15. The method of claim 11,

    And providing a screen for setting which one of a first projection area of the image projection device and a second projection area of the other image projection device to extend the projection area around. Zone expansion method.

Images