KR20180003269A - Beam projector and operating method thereof - Google Patents

Abstract

The present invention provides a method outputting so that an image projected by a beam projector is not distorted regardless of an installation environment of the beam projector. The beam projector according to the present invention comprises: a projection part projecting the image or a pattern; a projection adjustment part adjusting a position of the projection part; and a control part controlling the projection adjustment part so that the projection part projects the pattern toward a space in which the beam projector is located, analyzing a structure of the space in which the beam projector is located based on the projected pattern, obtaining at least one projection region based on the analyzed structure of the space, and projecting the image to one of the at least one of the projection region.

Description

[0001] DESCRIPTION [0002] BEAM PROJECTOR AND OPERATING METHOD THEREOF [

The present invention relates to a beam projector and a method of operating the same.

The present invention relates to a portable electronic device such as a smart phone or the like having a beam projector function.

Beam projector is a device that uses slides to project slides or moving images onto a screen. The beam projector can be divided into a fixed beam projector and a movable beam projector which are used at a fixed position according to size, weight, and the like. Particularly, as the mobile beam projector is getting smaller and lighter, it is easier to carry. In recent years, portable electronic devices having a beam projector function in portable electronic devices such as smart phones and digital cameras have appeared.

As a result, users can easily carry portable beam projectors, making it easy to use the beam projector anywhere in the home, school, company, or outdoor.

On the other hand, the user may have difficulty in installing the beam projector when using the beam projector. More specifically, since the conventional beam projector must be installed in front of the screen, if the beam projector is installed at a slight angle, the image is distorted and projected on the screen.

In addition, with the increasing use of portable beam projectors, various functions that the beam projector can provide are required.

SUMMARY OF THE INVENTION The present invention provides a method of outputting images so that images projected by a beam projector are not distorted regardless of an installation environment of the beam projector.

SUMMARY OF THE INVENTION The present invention provides a method of adjusting a region in which a beam projector projects an image without moving the beam projector.

The present invention provides a method of adjusting a region in which a beam projector projects an image using a device other than the beam projector.

The present invention provides a method of projecting a beam projector as well as a photograph, a moving image, and a notification widget image.

The beam projector according to an embodiment of the present invention controls a projection unit for projecting an image or pattern, a projection adjusting unit for adjusting the position of the projection unit, and a projection adjusting unit for projecting the projection unit toward a space in which the beam projector is located, And a control unit for analyzing a structure of the space in which the beam projector is located based on the projected pattern and acquiring at least one or more projection areas based on the structure of the analyzed space, The image can be projected onto the area.

In the beam projector according to an embodiment of the present invention, the control unit senses the shape change of the pattern projected from the projection unit, determines that the area where the shape change of the pattern is sensed is an inappropriate area for projection, The non-sensed area can be judged as an appropriate area for projection.

The beam projector according to an embodiment of the present invention may further include a camera for photographing an ambient space image in which the beam projector is located, and the control unit may analyze the structure of the space in which the beam projector is located based on the captured ambient space image have.

In the beam projector according to an embodiment of the present invention, the projection unit further projects a guideline for image correction, the camera further photographs the projected guideline, and the control unit compares the projected guideline with the photographed guideline A calibration image is generated based on a result, and when an image is projected, the image can be processed and projected together with the calibration image.

In the beam projector according to the embodiment of the present invention, the control unit detects the position of the user based on the photographed peripheral spatial image, and controls the projection unit to project the image in the projection area closer to the user's position in at least one of the projection areas Can be controlled.

In the beam projector according to the embodiment of the present invention, the control unit detects the direction of the user's gaze based on the photographed peripheral spatial image, and projects the image in the projection area corresponding to the gaze direction of the user among the at least one projection area The projection unit can be controlled.

The beam projector according to an embodiment of the present invention may further include a wireless communication unit for receiving a projection area selection command from the mobile terminal and the control unit may control the projection unit to project the image to the projection area corresponding to the projection area selection command have.

In the beam projector according to the embodiment of the present invention, the projection area selection command may include an instruction to drag and drop the simulation projection area displayed on the mobile terminal.

In the beam projector according to an embodiment of the present invention, the wireless communication unit further receives the notification information set in the mobile terminal, and the control unit controls the projection unit to project the same image as the notification screen image to be displayed on the mobile terminal based on the notification information can do.

In the beam projector according to an embodiment of the present invention, the wireless communication unit further receives a motion detection signal of the user from the wearable device, and the control unit controls the motion of the user for a predetermined time or more based on the motion detection signal of the user received from the wearable device. If the motion is not detected, the projection unit can be controlled to terminate the projection of the image.

According to various embodiments of the present invention, there is an effect that a distortion-free image can be provided to the user irrespective of the use environment of the beam projector.

According to various embodiments of the present invention, an area where a beam projector projects an image can be easily adjusted using a mobile terminal.

According to various embodiments of the present invention, it is possible to project various notifications widget images such as a calendar, a clock, and an announcement as well as photos and videos using a beam projector.

1 is a view for explaining an operation system between a mobile terminal and a beam projector according to the present invention.
2 is a block diagram illustrating a mobile terminal according to the present invention.
3 is a block diagram for explaining a beam projector related to the present invention.
4 is a side view of a beam projector according to an embodiment of the present invention.
5 is a flowchart illustrating a method of operating a beam projector according to an embodiment of the present invention.
6 is a view for explaining a method of analyzing a surrounding space structure using a pattern projection method according to the first embodiment of the present invention.
7 to 8 are views for explaining a method of analyzing the surrounding space structure using the room scanning method according to the second embodiment of the present invention.
9 is a diagram for explaining a method of acquiring a projection area according to an embodiment of the present invention.
10 is an image correction algorithm according to an embodiment of the present invention.
11 to 12 are exemplary diagrams illustrating a method of outputting images according to a distortion correction algorithm according to an embodiment of the present invention.
13 to 15 are diagrams for explaining a keystone correction method according to the first embodiment of the present invention.
16 is a diagram for explaining a keystone correction method according to a second embodiment of the present invention.
17 is a view for explaining a method of receiving a video output command according to an embodiment of the present invention.
18 to 19 are diagrams for explaining a method of receiving a video output command according to another embodiment of the present invention.
20 to 22 are views for explaining an image projection method according to a user's position or line of sight according to an embodiment of the present invention.
23 to 28 are diagrams for explaining a method of receiving a projection area selection command according to an embodiment of the present invention.
29 to 31 are views for explaining a method of projecting an image in an arbitrary region according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular < RTI ID = 0.0 > term < / RTI > includes plural representations unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.

However, it will be appreciated by those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, a digital signage, and the like, will be.

1 is a view for explaining an operation system between a mobile terminal and a beam projector according to the present invention.

According to the embodiment of the present invention, the mobile terminal 100 and the beam projector 200 can transmit and receive signals to each other. Specifically, the mobile terminal 100 may transmit a command to the beam projector 200 to adjust the projection area in which the beam projector 200 projects the image. The mobile terminal 100 can receive information on the projection area from which the beam projector 200 projects the image from the beam projector 200. [ Conversely, the beam projector 200 may transmit the spatial information about the periphery where the beam projector is installed to the mobile terminal 100. Also, the beam projector 200 can receive a command from the mobile terminal 100 to move the image projection area. In addition, various signals that can be transmitted and received between the mobile terminal 100 and the beam projector 200 will be described later in detail.

Next, the mobile terminal 100 that transmits and receives signals to and from the beam projector 200 will be described with reference to FIG.

2 is a block diagram illustrating a mobile terminal according to the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, and a power supply unit 190 ), And the like. The components shown in FIG. 2 are not essential for implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than the components listed above.

The wireless communication unit 110 may be connected between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and another mobile terminal 100 or between the mobile terminal 100 and the external server 100. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, A microphone 226, a battery gauge, an environmental sensor (for example, a barometer, a hygrometer, a thermometer, a radiation detection sensor, A thermal sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a plurality of application programs or applications running on the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Also, at least a part of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions (e.g., telephone call receiving function, message receiving function, and calling function) of the mobile terminal 100. Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and may be operated by the control unit 180 to perform the operation (or function) of the mobile terminal.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 2 to drive an application program stored in the memory 170. In addition, the controller 180 may operate at least two of the components included in the mobile terminal 100 in combination with each other for driving the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170. [

Hereinafter, the components listed above will be described in more detail with reference to FIG. 2 before explaining various embodiments implemented through the mobile terminal 100 as described above.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution And an external terminal, or a server on a mobile communication network established according to a long term evolution (AR), a long term evolution (AR), or the like.

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short-range communication module 114 is connected to the mobile terminal 100 and the wireless communication system through the wireless area networks, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 ) And the other mobile terminal 100 (or the external server). The short-range wireless communication network may be a short-range wireless personal area network.

Here, the other mobile terminal 100 may be a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 100 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least a part of the data processed by the mobile terminal 100 to the short- 114 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.

The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other functions of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal, in addition or alternatively. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, Or a plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. [ A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input means (or a mechanical key such as a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, And a touch key disposed on the touch panel. Meanwhile, the virtual key or the visual key can be displayed on a touch screen having various forms, for example, a graphic, a text, an icon, a video, As shown in FIG.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in the inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .

The touch sensor uses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, Detection.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the control unit 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object touching the touch screen (or a touch key provided on the touch screen). Whether to perform different controls or to perform the same control according to the type of the touch object may be determined according to the current state of the mobile terminal 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit the tactile effect through the direct contact, and the tactile effect can be felt by the user through the muscles of the finger or arm. The haptic module 153 may include two or more haptic modules 153 according to the configuration of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.

The interface unit 160 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or supplies power to each component in the mobile terminal 100 or allows data in the mobile terminal 100 to be transmitted to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

The interface unit 160 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs the storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operations related to the application program and the general operation of the mobile terminal 100. [ For example, when the state of the mobile terminal meets a set condition, the control unit 180 can execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing to recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the controller 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on the magnetic induction phenomenon and a magnetic resonance coupling based on the electromagnetic resonance phenomenon from an external wireless power transmission apparatus Power can be delivered.

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

Next, a communication system that can be implemented through the mobile terminal 100 according to the present invention will be described.

First, the communication system may use different wireless interfaces and / or physical layers. For example, wireless interfaces that can be used by a communication system include Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA) ), Universal mobile telecommunication systems (UMTS) (in particular Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A)), Global System for Mobile Communications May be included.

Hereinafter, for the sake of convenience of description, the description will be limited to CDMA. However, it is apparent that the present invention can be applied to all communication systems including an OFDM (Orthogonal Frequency Division Multiplexing) wireless communication system as well as a CDMA wireless communication system.

A CDMA wireless communication system includes at least one terminal 100, at least one base station (BS) (also referred to as a Node B or Evolved Node B), at least one Base Station Controllers (BSCs) , And a Mobile Switching Center (MSC). The MSC is configured to be coupled to a Public Switched Telephone Network (PSTN) and BSCs. The BSCs may be paired with the BS via a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL or xDSL. Thus, a plurality of BSCs may be included in a CDMA wireless communication system.

Each of the plurality of BSs may comprise at least one sector, and each sector may comprise an omnidirectional antenna or an antenna pointing to a particular direction of radial emission from the BS. In addition, each sector may include two or more antennas of various types. Each BS may be configured to support a plurality of frequency assignments, and a plurality of frequency assignments may each have a specific spectrum (e.g., 1.25 MHz, 5 MHz, etc.).

The intersection of sector and frequency assignment may be referred to as a CDMA channel. The BS may be referred to as a base station transceiver subsystem (BTSs). In this case, a combination of one BSC and at least one BS may be referred to as a "base station ". The base station may also indicate a "cell site ". Alternatively, each of the plurality of sectors for a particular BS may be referred to as a plurality of cell sites.

A broadcast transmission unit (BT) transmits a broadcast signal to terminals 100 operating in the system. The broadcast receiving module 111 shown in FIG. 2 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT.

In addition, a Global Positioning System (GPS) may be associated with the CDMA wireless communication system to identify the location of the mobile terminal 100. The satellite aids in locating the mobile terminal 100. Useful location information may be obtained by two or more satellites. Here, the position of the mobile terminal 100 can be tracked using all the techniques capable of tracking the location as well as the GPS tracking technology. Also, at least one of the GPS satellites may optionally or additionally be responsible for satellite DMB transmissions.

The location information module 115 included in the mobile terminal is for detecting, computing, or identifying the location of the mobile terminal, and may include a Global Position System (GPS) module and a WiFi (Wireless Fidelity) module. Optionally, the location information module 115 may perform any of the other functions of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal, in addition or alternatively.

The GPS module 115 calculates distance information and accurate time information from three or more satellites and then applies trigonometry to the calculated information to accurately calculate three-dimensional current location information according to latitude, longitude, and altitude can do. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time. However, it is difficult to accurately measure the position of the mobile terminal by using the GPS module in the shadow area of the satellite signal as in the room. Accordingly, a WPS (WiFi Positioning System) can be utilized to compensate the positioning of the GPS system.

The WiFi Positioning System (WPS) is a system in which a mobile terminal 100 uses a WiFi module included in the mobile terminal 100 and a wireless AP (wireless access point) transmitting or receiving a wireless signal with the WiFi module, Is a technology for tracking a location of a wireless local area network (WLAN) using WiFi.

The WiFi location tracking system may include a Wi-Fi location server, a mobile terminal 100, a wireless AP connected to the mobile terminal 100, and a database in which certain wireless AP information is stored.

The mobile terminal 100 connected to the wireless AP can transmit the location information request message to the Wi-Fi location server.

The Wi-Fi position location server extracts information of the wireless AP connected to the mobile terminal 100 based on the location information request message (or signal) of the mobile terminal 100. The information of the wireless AP connected to the mobile terminal 100 may be transmitted to the Wi-Fi position location server through the mobile terminal 100, or may be transmitted from the wireless AP to the Wi-Fi location server.

The information of the wireless AP to be extracted based on the location information request message of the mobile terminal 100 includes a MAC address, an SSID (Service Set IDentification), a Received Signal Strength Indicator (RSSI), a Reference Signal Received Power (RSRP) Reference Signal Received Quality), channel information, Privacy, Network Type, Signal Strength, and Noise Strength.

As described above, the Wi-Fi position location server can receive the information of the wireless AP connected to the mobile terminal 100 and extract the wireless AP information corresponding to the wireless AP to which the mobile terminal is connected from the pre-established database. In this case, the information of any wireless APs stored in the database includes at least one of MAC address, SSID, channel information, privacy, network type, radius coordinates of the wireless AP, building name, Available), the address of the AP owner, telephone number, and the like. At this time, in order to remove the wireless AP provided using the mobile AP or the illegal MAC address in the positioning process, the Wi-Fi location server may extract only a predetermined number of wireless AP information in order of RSSI.

Then, the Wi-Fi location server can extract (or analyze) the location information of the mobile terminal 100 using at least one wireless AP information extracted from the database. And compares the received information with the received wireless AP information to extract (or analyze) the location information of the mobile terminal 100.

As a method for extracting (or analyzing) the position information of the mobile terminal 100, a Cell-ID method, a fingerprint method, a triangulation method, and a landmark method can be utilized.

The Cell-ID method is a method of determining the position of the mobile station with the strongest signal strength among neighboring wireless AP information collected by the mobile terminal. Although the implementation is simple, it does not cost extra and it can acquire location information quickly, but there is a disadvantage that positioning accuracy is lowered when the installation density of the wireless AP is low.

The fingerprint method collects signal strength information by selecting a reference position in a service area, and estimates the position based on the signal strength information transmitted from the mobile terminal based on the collected information. In order to use the fingerprint method, it is necessary to previously convert the propagation characteristics into a database.

The triangulation method is a method of calculating the position of the mobile terminal based on the coordinates of at least three wireless APs and the distance between the mobile terminals. (Time of Arrival, ToA), Time Difference of Arrival (TDoA) in which a signal is transmitted, and the time difference between the wireless AP and the wireless AP, in order to measure the distance between the mobile terminal and the wireless AP. , An angle at which a signal is transmitted (Angle of Arrival, AoA), or the like.

The landmark method is a method of measuring the position of a mobile terminal using a landmark transmitter that knows the location.

Various algorithms can be utilized as a method for extracting (or analyzing) the location information of the mobile terminal.

The location information of the extracted mobile terminal 100 is transmitted to the mobile terminal 100 via the Wi-Fi location server, so that the mobile terminal 100 can acquire the location information.

The mobile terminal 100 may be connected to at least one wireless AP to obtain location information. At this time, the number of wireless APs required to acquire the location information of the mobile terminal 100 may be variously changed according to the wireless communication environment in which the mobile terminal 100 is located.

Next, the structure of the beam projector 200 according to the embodiment of the present invention will be described with reference to FIG.

3 is a block diagram for explaining a beam projector related to the present invention.

The beam projector 200 may include a wireless communication unit 210, a camera 220, a sensing unit 240, a projection unit 250, a projection control unit 260, and a power supply unit 290. The components shown in FIG. 3 are not essential for implementing the beam projector 200, so that the beam projector 200 described herein may have more or fewer components than the components listed above .

Hereinafter, each component will be described in detail.

The wireless communication unit 210 can transmit and receive signals using the mobile communication module or the short-range communication module with the mobile terminal 100. Specifically, the wireless communication unit 210 can transmit / receive a specific command or specific information to / from the mobile terminal 100. Alternatively, the wireless communication unit 210 may receive images such as photographs and moving images from the mobile terminal 100. In addition, the wireless communication unit 210 can receive broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel using a broadcast receiving module. Also, the wireless communication unit 210 can acquire the current position of the beam projector 200 using the position information module.

The camera 220 can take an image of the surroundings of the beam projector 200. The camera 220 is movable up to 360 degrees in the left-right direction and up to 90 degrees in the up-down direction. Therefore, it is possible to capture both objects and persons located in the vicinity of the beam projector 200.

The sensing unit 240 can detect the presence or absence of an object approaching a predetermined detection surface or an object in the vicinity of the sensing surface without mechanical contact by using electromagnetic force or infrared rays.

The camera 220 and the sensing unit 240 may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. Specifically, it is possible to scan the motion of the detection object close to the beam projector 200. In addition, when the proximity sensing object corresponds to a person, the camera 200 and the sensing unit 240 can be combined with each other to sense the direction of the user's gaze.

The projection unit 250 may include an image projection unit 251 and a pattern projection unit 252.

And serves to project an image signal of the image projecting unit 251. [ The image projecting unit 251 may be implemented in a form including a light source, a transmissive display device, a projection lens, and the like. In addition, the image projecting unit 251 may include a zoom lens for adjusting the size of the projected image on the projection area.

The pattern projection unit 252 functions to project a pattern to analyze the structure of the surrounding space. The pattern projection section 252 can project various types of patterns. In addition, the pattern projection unit 252 may be combined with a depth sensor to analyze a surrounding spatial structure or a projection area. Alternatively, the pattern projection unit 252 may be combined with the camera 220 to analyze the surrounding spatial structure or the projection area.

The projection unit 250 is divided into the image projecting unit 251 and the pattern projecting unit 252. The image projecting unit 251 and the pattern projecting unit 252 may have a single projection unit 252, May be provided.

The projection adjusting unit 260 controls the direction in which the beam projector 200 projects an image. Specifically, the projection adjusting unit 260 functions to adjust the position of the projection unit 250. For this purpose, the projection adjusting unit 260 may include a tilting unit 261 and a panning unit 262. The tilting part 261 moves the projection part 250 up and down and the panning part 262 moves the projection part 250 left and right. And can be moved vertically and horizontally by the camera 220, the sensing unit 240, and / or the projection unit 250 of the beam projector 200.

The memory 270 may store the image to be projected, the surrounding spatial information, and / or the projection area information.

The control unit 280 analyzes the surrounding space structure in combination with the wireless communication unit 210, the camera 220, the sensing unit 240, the projection unit 250, the projection control unit 260, and / or the memory 270 , Analyze the projection area, perform image correction, project an image, or transmit / receive a signal to / from the mobile terminal 100. That is, the control unit 280 may control any one or a combination of the above components to implement the various embodiments described below.

The power supply unit 290 receives external power and internal power under the control of the controller 280 and supplies power required for operation of the respective components. The power supply unit 290 may include a detachable battery.

Each component of the beam projector 200 can perform the same and similar functions as the components provided in the mobile terminal 100 in addition to the functions described above. Further, specific functions related to the present invention will be described in more detail below.

Next, an operation of the beam projector 200 will be described with reference to FIG.

4 is a side view of a beam projector according to an embodiment of the present invention.

As shown in FIG. 4, the beam projector 200 may include a power button 401.

In addition, the long groove 420 may be separated from the outside of the beam projector 200 in the vertical direction. The groove of the beam projector 200 is for photographing or projecting the camera 220 or the projection unit 250 while moving in the vertical direction. For example, the projection unit 250 is located inside the groove 220 as shown in FIG. 4, and the projection unit 250 can move up and down from the inside of the groove 220. Therefore, the projection unit 250 can project from 0 degrees to 90 degrees based on the bottom surface of the beam projector 200 and the direction pointed by the projection unit 250. In addition, since the beam projector 200 can be rotated 360 degrees in the left-right direction, the projection unit 250 can project all of the surrounding space except for the bottom of the beam projector 200.

Next, a method of operating the beam projector 200 according to an embodiment of the present invention will be described with reference to FIG.

5 is a flowchart illustrating a method of operating a beam projector according to an embodiment of the present invention.

First, the control unit 280 can analyze the spatial structure in which the beam projector 200 is located (S101).

The beam projector 200 can analyze the surrounding space structure in which the beam projector 200 is located by using various methods. First, according to the first embodiment of the present invention, the spatial structure in which the beam projector 200 is located can be analyzed using the pattern projection method. According to the second embodiment of the present invention, the spatial structure in which the beam projector 200 is located can be analyzed using a room scanning method. According to the third embodiment of the present invention, the surrounding space structure in which the beam projector 200 is located can be analyzed using a camera photographing method.

First, a pattern projection method according to a first embodiment of the present invention will be described with reference to FIG.

6 is a view for explaining a method of analyzing a surrounding space structure using a pattern projection method according to the first embodiment of the present invention.

The pattern projection section 252 can project a pattern toward the surrounding space in which the beam projector 200 is located. The pattern projection section 252 can project the pattern in the surrounding space in which the beam projector 200 is located while moving in the left and right and up and down directions.

The pattern projected from the beam projector 200 may include a horizontal stripe, a vertical stripe, and a cross stripe.

The control unit 280 can analyze the surrounding space structure by changing the shape of the pattern projected from the pattern projection unit 252. [ Specifically, when the shape of the pattern projected from the pattern projecting unit 252 is maintained, the controller 280 recognizes that there is no obstacle in the corresponding region, and an obstacle exists in the corresponding region if the projected pattern is distorted. An obstacle may include everything that is perceived as not suitable for projecting an image, such as a person, an object, a curved surface, or the like. Therefore, the control unit 280 is a region in which the shape of the pattern projected from the pattern projection unit 252 is kept constant, and the region in which the shape of the projected pattern is distorted is an inappropriate region for projecting the image . The control unit 280 may sense a change in the shape of the projected pattern using the camera 220 or the sensing unit 240.

6, the beam projector 200 can project a horizontal stripe pattern in the surrounding space by using the pattern projecting unit 252. [ When there is no obstacle in the projection direction, the projected horizontal stripe pattern is maintained in its shape. On the other hand, when the obstacles 601, 602, and 603 are present in the projection direction, the projected lateral stripe pattern can be deformed concave or convex. That is, when there is an obstacle in the projection direction, the projected horizontal stripe pattern is distorted.

As described above, according to one embodiment of the present invention, the control unit 280 can analyze the surrounding space structure by maintaining the shape of the pattern projected from the pattern projection unit 252. That is, the area where the shape of the pattern projected from the pattern projection unit 252 is maintained is an area suitable for projecting the image, and the area where the pattern of the pattern projected from the pattern projection unit 252 is distorted is the image Can be recognized as an inappropriate area for projection. However, even if the shape of the pattern projected from the pattern projection unit 252 is distorted, the control unit 280 can recognize the region and the image that are suitable for projecting the image again according to the degree of distortion, into an inappropriate region.

In addition, the control unit 280 can recognize the width of the surrounding space based on the projected range of the pattern projected from the pattern projection unit 252. [

Next, a method of analyzing the surrounding space structure using the room scanning method according to the second embodiment of the present invention will be described with reference to FIG. 7 to FIG.

The room scanning method is a method in which the controller 280 analyzes the surrounding space structure by recognizing the positions of the corners corresponding to the surrounding space in which the beam projector 200 is located. Generally, when the beam projector 200 is located indoors, the surrounding space may be generally in the form of a hexahedron. Accordingly, the controller 280 can recognize the four corner positions located on the ceiling of the indoor space, and analyze the spatial structure based on the recognized four corner positions. Specifically, the controller 280 can analyze the surrounding space structure by grasping edges, angles, distances, and the like of each surface based on the four corner positions.

7 to 8 are views for explaining a method of analyzing the surrounding space structure using the room scanning method according to the second embodiment of the present invention.

As shown in FIG. 7, the display unit 151 of the mobile terminal 100 may display the room scanning screen 700.

The room scanning screen 700 may be a screen in which the beam projector 200 displays a command to project toward each corner of the surrounding space. To this end, the room scanning screen 700 may include a space simulation screen 701, a corner selection icon 702, and an operation icon 703. The space simulation screen 700 is a screen for showing the position of the corner to be projected by the beam projector 200. The corner selection icon 702 is an icon for selecting a corner to be projected onto the beam projector 200. The operation icon 703 is an icon for adjusting the projection direction of the beam projector 200.

That is, the control unit 180 of the mobile terminal 100 may receive a command to select each corner through the corner selection icon 702. [ The control unit 180 can display the corner position corresponding to the selected corner on the spatial simulation screen 700. [ The user can select the operation icon 703 to project the corner displayed on the space simulation screen 700 to the beam projector 200. [ The control unit 180 of the mobile terminal 100 transmits a command for moving the projection direction in the selected direction to the beam projector 200 through the operation icon 703. [ The beam projector 200 can move the projection direction to the side corresponding to the received command. That is, the operation icon 703 of the mobile terminal 100 is selected so that the beam projector 200 projects the beam at a corner position corresponding to the first corner displayed on the space simulation screen 700, as shown in FIG. 8 Command can be received. By repeating this operation four times for each corner position, the controller 280 can recognize each corner position of the space. In addition, the control unit 280 can analyze the spatial structure based on the corner positions.

Next, a method of analyzing the surrounding space structure using the camera photographing method according to the third embodiment of the present invention will be described.

The camera 220 can photograph the surrounding space while moving in the left-right direction and the up-down direction. The control unit 280 can analyze the surrounding space structure based on the photographed image. Specifically, the control unit 280 can analyze the position and size of the obstacle, the color of the projection area, and the like based on the photographed image.

In addition, the sensing unit 240 may sense a surrounding space width, an obstacle position, and an obstacle size. The control unit 280 can analyze the surrounding space structure based on the detected surrounding space width, obstacle location, obstacle size, and the like.

In addition, the control unit 280 may analyze the surrounding space structure by combining the camera 200 and the sensing unit 240. In this case, the control unit 280 can analyze the surrounding space in more detail.

According to an embodiment of the present invention, the control unit 280 can analyze the surrounding space structure in which the beam projector 200 is located by combining the pattern projection method, the room scanning method, and the camera shooting method described above. In addition, the structure of the surrounding space can be grasped by using a method other than the method described above.

5 is described again.

The control unit 280 can acquire the projection area (S103).

The control unit 280 can acquire the projection area based on the analyzed surrounding spatial structure. For example, the control unit 280 may acquire an area where no obstacle is present as a projection area based on the analyzed surrounding space structure. Alternatively, the control unit 280 may acquire an area of a predetermined size or more out of the areas where no obstacle is present as the projection area. Specifically, a method of acquiring the projection area will be described with reference to FIG.

9 is a diagram for explaining a method of acquiring a projection area according to an embodiment of the present invention.

As shown in FIG. 9, the control unit 280 can acquire the first projection area, the second projection area, the third projection area, and the fourth projection area, which are areas of a predetermined size or more among the areas where no obstacle exists.

Alternatively, the control unit 280 may acquire, as a projection area, an area in which a certain size that can be projected is secured regardless of the presence or absence of an obstacle. For example, when the refrigerator is enlarged to a predetermined size on the refrigerator even if the refrigerator is detected as an obstacle during the analysis of the surrounding space structure, the control unit 280 can acquire the corresponding area as the projection area.

Alternatively, the control unit 280 may acquire the projection area in consideration of bending of the projection surface, color, and the like. That is, the controller 280 may exclude the black area from the projection area and acquire the area having the brightness higher than a certain reference as the projection area even if there is no obstacle in the analysis of the surrounding space structure.

In this manner, the control unit 280 can acquire the projection area in consideration of various factors.

5 is described again.

The control unit 280 may perform image correction on the acquired projection area (S105).

The control unit 280 may perform different image corrections according to the conditions of the respective projection areas with respect to the obtained projection areas. The conditions of the projection area may include the color of the projection area, the presence of an obstacle, and the degree of bending.

Next, a method of performing image correction according to an embodiment of the present invention will be described with reference to FIGS. 10 to 15. FIG.

10 is an image correction algorithm according to an embodiment of the present invention.

The control unit 280 may output a guideline for image correction (S201).

In particular, the control unit 280 may output a guideline for image correction for the obtained projection areas. The guideline may refer to an image that serves as a reference for outputting in order to detect the degree of distortion of the projection area. For example, the guideline may be an oblique pattern as shown in Fig. 11 (a), but this is merely exemplary and is not so limited.

The control unit 280 recognizes the characteristic of the projection area based on the guideline displayed in the projection area (S203).

For example, the control unit 280 can recognize the projection area as a flat surface when the guideline outputted and the guideline displayed on the projection area coincide with each other. On the other hand, if the outputted guide line does not coincide with the guide line displayed in the projection area, it can be recognized that there is an obstacle in the projection area or a curvature in the projection area. Alternatively, the control unit 280 can recognize that there is a convex obstacle in the area when the displayed guideline is bent in comparison with the guideline outputted. The control unit 280 can compare the guideline output by using the camera 220 with the guideline displayed in the projection area.

Also, the control unit 280 may recognize the characteristics of the projection area such as the brightness and color of the projection area through the outputted guide line.

The control unit 280 may generate a calibration image corresponding to the recognized projection area characteristic (S205).

Calibration refers to adjusting the color temperature, color balance, and other characteristics according to the characteristics and properties of the input / output system devices to make them appear as a standard.

The control unit 280 may generate a calibration image that corrects the image so that the image can be clearly seen when the image is projected on the corresponding projection area based on the recognized projection area characteristic. Alternatively, the control unit 280 may generate a calibration image to match the previously stored setting information when projecting an image based on the characteristic of the projection area. That is, when there is preset brightness, color information, and the like, the controller 280 may generate a calibration image to be interpolated so that the image is displayed according to predetermined brightness, color, and the like when the image is projected to the corresponding area.

The control unit 280 may map the calibration images corresponding to the projection areas and the projection areas and store them in the memory 270.

Next, the control unit 280 may project the deformed image obtained by processing the calibration image when projecting the image (S207).

The control unit 280 can process and project the calibration image corresponding to the projection area together with the image to be output when the image is projected. Accordingly, the control unit 280 can control so that images of a constant brightness, color, etc. are displayed regardless of which projection area the image is projected. Alternatively, the control unit 280 may control to display images of predetermined brightness, color, etc., regardless of which projection area the projection is projected on.

Next, an operation of processing a calibration image according to an embodiment of the present invention will be described with reference to FIGS. 11 to 12. FIG.

11 to 12 are exemplary diagrams illustrating a method of outputting images according to a distortion correction algorithm according to an embodiment of the present invention. 11 is an example of an image output according to the distortion correction according to the embodiment of the present invention, and FIG. 12 is an example of an image output according to the color correction according to an embodiment of the present invention.

11 (a) and 12 (a) are exemplary diagrams for outputting a guide line for image correction. In the present invention, the slant pattern is used as an example of the guideline, but the present invention is not limited thereto.

Next, Figs. 11 (b) and 12 (b) are examples of images in which the guideline is displayed in the projection area. Specifically, when there is a protruding part protruding from the projection area, a part of the guideline can be distorted and displayed as shown in Fig. 11 (b). In addition, when a specific area is dark in the projection area, a part of the guide lines may be darkened as shown in FIG. 12 (b).

The control unit 280 can recognize the characteristics of the projection area using the guideline image displayed in the projection area.

Next, Figs. 11 (c) and 12 (c) are examples of the calibration image generated corresponding to the recognized projection area characteristic. Specifically, the calibration image shown in Figs. 11 (c) and 12 (c) may be an interpolation image of the image shown in Figs. 11 (b) and 12 (b). The characteristics of the calibration image shown in Figs. 11 (c) and 12 (c) can be opposite to those of the images shown in Figs. 11 (b) and 12 (b).

For example, the calibration image of Fig. 11 (c) for correcting the distortion of Fig. 11 (b) may be an image that is warped as opposed to the direction of warping of the guideline of Fig. 11 (b). Further, the calibration image of Fig. 12 (c) for correcting the color of Fig. 12 (b) may include complementary colors of the colors indicated by the guidelines of Fig. 12 (b). In addition, the calibration image of Fig. 12 (c) may be a video image in which the dark region in the guide line in Fig. 12 (b) is a bright region and the bright region in the guide line in Fig. 12 (b) is a dark region. This has the effect of making the overall brightness uniform during video output.

11 (d) and 12 (d) are examples of images to be output and a calibration image are processed together and projected.

Even if there is an obstacle in the projection area, the image to be outputted and the calibration image are processed together and projected, so that the image can be displayed without distortion as shown in Figs. 11 (d) and 12 (d). 11 (b) and 12 (b), only the image to be outputted for the same projection area is projected. However, if the image to be output and the calibration image are processed together and output, An image as shown in Fig. 12 (d) can be displayed.

According to an embodiment of the present invention, an image correction may be performed by using a method other than the above image correction algorithm.

Next, the keystone correction according to the embodiment of the present invention will be described with reference to FIG. 13 to FIG.

13 to 15 are diagrams for explaining a keystone correction method according to the first embodiment of the present invention.

16 is a diagram for explaining a keystone correction method according to a second embodiment of the present invention.

Keystone correction refers to the correction that corrects the tilted image while the projector is stationary. Keystone correction is included in one of the types of image correction. The keystone correction may also be included in the image correction for the obtained projection area in step S105 together with distortion correction, color correction, and the like. The keystone correction may be required when the image projected by the beam projector 200 is displayed in a shape tilted to the projection area. Alternatively, the image projected by the beam projector 200 is not tilted, but may be required according to the direction of the user's gaze.

First, a keystone correction method according to the first embodiment of the present invention will be described.

As shown in FIG. 13, the beam projector 200 can project a pattern image 1300. The mobile terminal 100 can photograph the pattern image 1400 displayed in the projection area as shown in FIG. That is, the pattern image 1400 projected by the beam projector 200 can be photographed by the camera 121 of the mobile terminal 100.

The mobile terminal 100 may produce a keystone correction signal based on the photographed image 1410. [ The keystone correction signal may be a signal transmitted from the mobile terminal 100 to the beam projector 200 for keystone correction.

The mobile terminal 100 may generate a keystone correction signal using the photographed pattern image 1410. [ Specifically, the mobile terminal 100 may acquire four vertexes forming a quadrangle in the photographed pattern image 1410. FIG. For example, as shown in FIG. 14, four vertexes forming a quadrangle 1411 can be obtained in the photographed pattern image 1410. The control unit 180 may obtain the inverse compensation information corresponding to the rectangle 1411 formed by the four vertexes. The inverse compensation information may be information for projecting an image having a shape opposite to the square 1411. [ The control unit 180 may generate a keystone correction signal including the inverse compensation information. The beam projector 200 may process the image by processing the original image and the keystone correction signal including the inverse compensation information together. In this way, the image projected in a tilted form is compensated by the image of the opposite shape, so that the image can be corrected so that the image is not skewed. For example, the beam projector 200 can project a projected image onto an image 1500 as shown in FIG. 15 as a pattern image 1300 shown in FIG. 13 as a result of keystone correction.

Next, a keystone correction method according to a second embodiment of the present invention will be described with reference to FIG.

The keystone correction method according to the second embodiment of the present invention can perform keystone correction by applying a pixel transformation algorithm to each pixel of the projected image.

16 is a diagram for explaining a pixel conversion algorithm according to an embodiment of the present invention.

16 (a), P ', which is one point on the left, represents the pixel coordinates after performing the keystone correction, and P, which is one point on the right, represents the pixel coordinates before the keystone correction.

The control unit 280 can obtain the pixel coordinates P 'after the keystone correction has been performed through the equation shown in Fig. 16 (b). That is, the control unit 280 can obtain the coordinates after the keystone correction by applying the formula shown in FIG. 16 (b) to the coordinates of each pixel constituting the image before the keystone correction.

The matrix A 1 of FIG. 16B may be a matrix for transforming 2D (2 Dimension) image coordinates into 3D (3 Dimension) image coordinates. Temporary conversion to 3D image coordinates may be necessary to obtain the coordinates for which the keystone correction has been performed. The matrix A1 may be as shown in Fig. 16 (c).

The matrix T in FIG. 16 (b) is a matrix for applying the position shift of the beam projector 200, if any. The matrix T may be as shown in Fig. 16 (d).

The matrix R in FIG. 16 (b) may be a matrix including inclination information of the tilting unit 261 and the panning unit 262 of the beam projector 200. Specifically, the matrix R may be a matrix obtained by multiplying a matrix Rx, a matrix Ry, and a matrix Rz. The matrix Rx may be a matrix for adjusting the tilting unit 261 that adjusts the projection unit 250 in the vertical direction. The matrix Ry may be a matrix for adjusting the panning unit 262 that adjusts the projection unit 250 in the left-right direction. The matrix Rz may be a matrix for adjusting the image of the beam projector 200 in the z-axis direction.

First, the matrix Rx is described. The control unit 280 can obtain the tilt angle? Of the tilting unit 261 while projecting the pre-keystone correction image. The controller 280 can obtain an angle &thetas;, which is the same as the obtained angle ϕ and the inclination degree but opposite to the direction. That is, the control unit 280 can obtain? = (-?). The matrix Rx to which the obtained [theta] is to be applied may be as shown in Fig. 16 (e).

Next, the matrix Ry is described. The control unit 280 can obtain the angle? At which the panning unit 262 is tilted while projecting the pre-keystone correction image. The controller 280 can obtain an angle &thetas;, which is the same as the obtained angle ϕ and the inclination degree but opposite to the direction. That is, the control unit 280 can obtain? = (-?). The matrix Ry to which the obtained? Is to be applied may be as shown in Fig. 16 (f).

Next, the matrix Rz will be described. The matrix Rz can also be obtained in a manner similar to the matrix Rx and the matrix Ry. The matrix Rz may be as shown in Fig. 16 (g). However, in the present invention, the image projected by the beam projector 200 is mainly 2D, which may correspond to θ = 0 in this case.

Finally, A 2 in FIG. 16 (b) may be a matrix for converting 3D image coordinates converted for keystone correction back to 2D image coordinates. The matrix A < 2 > may be as shown in Fig. 16 (h).

As described above, the beam projector 200 can perform the keystone correction by applying the pixel transformation algorithm described with reference to FIG. 16, it is assumed that the image projected by the beam projector 200 is a 3D image. If the image projected by the beam projector 200 is a 2D image, the z values of the matrices shown in FIG. 16 may be equal to one.

5 is described again.

The control unit 280 can receive the video output command (S107). The control unit 280 may receive an instruction to project a specific image.

Next, a method of receiving a video output command will be described with reference to FIG.

17 is a view for explaining a method of receiving a video output command according to an embodiment of the present invention.

As shown in FIG. 17, the display unit 151 of the mobile terminal 100 may display a video selection screen 1600. FIG. The image selection screen 1600 is illustrative and may include other forms.

In addition, the beam projector 200 may include a separate display unit (not shown) so that the beam projector 200 can display the image selection screen 1600.

The image selection screen 1600 may include at least one of landscape images 1601 to 1603, a location image 1604, a movie image 1605, and a broadcast image 1606.

The landscape images 1601 to 1603 may be a still image or a moving image. In addition, the landscape images 1601 to 1603 may be images received from an external server or directly photographed images. By including the landscape image 1601, the user can have an effect of making the interior space feel different, or changing the interior space into a bright and cheerful atmosphere.

Place video (1604) can be a video for a famous sightseeing place. When the location image 1604 is included, if the user can not travel far, the user may feel the atmosphere of the travel location.

The movie image 1605 may be an image received from an external server. When the movie image 1605 is included, the movie can be viewed on a large screen without going to the movie theater. In addition, even when the user goes outdoors, such as camping, the movie image 1605 can be projected and the movie can be viewed from any place.

The broadcast image 1606 may be an image representing a broadcast signal received from a broadcast station. Therefore, there is an effect that the TV can be watched by the beam projector 200 even if there is no TV.

Since the images shown in Fig. 17 are merely illustrative, the image selection screen 1600 may include various images that can be projected to the beam projector 200. [

The control unit 280 can receive a video output command for selecting any one of the images 1601 to 1606 displayed on the video selection screen 1600. [

Alternatively, according to another embodiment of the present invention, the control unit 280 may receive a video output command through the notification setting screen 1700. [

18 to 19 are diagrams for explaining a method of receiving a video output command according to another embodiment of the present invention.

The display unit 151 of the mobile terminal 100 or the display unit (not shown) of the beam projector 200 may display the notification setting screen 1700 as shown in FIG.

The beam projector 200 can preset the image to be projected in various situations through the notification setting screen 1700. [ For example, as shown in FIG. 18, the notification setting screen 1700 may include first to third notification setting items 1701 to 1703 for controlling an image to be projected at a specific time. In addition, the notification setting screen 1700 may include a fourth notification setting item 1704 for controlling the image to be projected under specific conditions, such as when a person is detected in the vicinity.

According to the setting of the first notification setting item 1701, it is possible to output a specific sound while projecting an image at a predetermined time, and to set the alarm to operate as a morning call. Alternatively, by setting the second notification setting item 1702, a night sky image showing a star in the night time zone is projected, thereby helping the user to sleep while watching the star. Alternatively, by setting the third notification setting item 1703, it is effective to project a specific image on a weekend only and to feel a special atmosphere on weekends. Alternatively, when a person is detected in the vicinity of the beam projector 200 by setting the fourth notification setting item 1704, a romantic image may be projected to create a special atmosphere while the person is present.

In addition, an image included in each of the notification setting items 1701 to 1704 can be selected and selected as another image.

In addition to the above example, various widget screens can be projected through the notification setting screen 1700. [ That is, the beam projector 200 can transmit / receive signals to / from the mobile terminal 100 or the home server to project a widget screen.

For example, when the notification set in the mobile terminal 100 is operated, the mobile terminal 100 can transmit the notification information to the beam projector 200. The beam projector 200 can project an alarm widget screen as shown in Fig. 19 (a) and a certain widget screen as shown in Fig. 19 (b) based on the received notification information. Alternatively, the beam projector 200 receives an operation completion signal of the washing machine or an operation completion signal of the home appliance such as a rice cooker from the home server, and displays the washing completion notification screen and the state shown in FIG. 19 (d) The cooking completion notification screen can be projected as shown.

Alternatively, when a telephone is received in the mobile terminal 100, the mobile terminal 100 may transmit the telephone reception signal to the beam projector 200. [ The beam projector 200 can display a screen corresponding to the received telephone reception signal. In this case, the user has the effect of confirming that the mobile terminal 100 has been called without seeing the mobile terminal 100. This is particularly effective in preventing a situation in which the user does not receive a telephone call because the user has set the mobile terminal 100 in the silent or vibration mode at home.

In this way, the control unit 280 can receive various kinds of video output commands.

5 is described again.

The control unit 280 can determine whether the user's position or line of sight is detected (S109).

The control unit 280 may sense the position or line of sight of the user using the camera 220 or the sensing unit 240. Alternatively, the control unit 280 may detect the position or line of sight of the user by combining the camera 200 and the sensing unit 240. The control unit 280 can detect the position or line of sight of the user using motion tracking or a 360 degree camera.

When the user's position or line of sight is detected, the control unit 280 can project the image to the projection area that is closer to the user's position or to the projection area of the user's line of sight (S111).

Next, with reference to FIGS. 20 to 22, a method of projecting an image according to the position or line of sight of the user will be described.

20 to 22 are views for explaining an image projection method according to a user's position or line of sight according to an embodiment of the present invention.

The controller 280 can project the image to the projection area closest to the user's position when the user's position is sensed. The controller 280 can project the image to the projection area facing the user's eyes when the user's eyes are sensed. The controller 280 can project the image to the projection area closest to the user out of the projection areas facing the user's eyes when both the user's position and the user's gaze are detected.

For example, as shown in FIG. 20, the control unit 280 may obtain the first projection area 1901 and the second projection area 1902 in step S103. The control unit 280 can detect that the user's line of sight is in the right direction. Accordingly, the control unit 280 can project an image to the second projection area 1902, which is the direction of the user's gaze, of the first to second projection areas 1901 and 1902.

Alternatively, as shown in FIG. 21, the control unit 280 may detect that the user is located on the right side. Accordingly, the control unit 280 can project an image to the second projection area 2002 near the user from among the first and second projection areas 2001 and 2002.

21, when the beam projector 200 projects toward the user, the controller 280 can perform image correction on the user shape. To this end, the control unit 280 may acquire only the entire body shape of the user or the face shape of the user. That is, the entire user body shape as shown in FIG. 22 (a) or the user face shape as shown in FIG. 22 (b) can be obtained.

When projecting an image, the control unit 280 can project the image only in the remaining region except for the entire shape of the user body or the user's face shape. Alternatively, when projecting an image, the control unit 280 may control the image to be darkly projected only on the entire user body shape or the user face area.

This has the effect of preventing light from being projected onto the user's eyes.

5 is described again.

If the user's position or line of sight is not detected, the control unit 280 may determine whether a command to select the projection area has been received (S113).

Upon receiving the command to select the projection area, the control unit 280 can project the image to the selected projection area (S115).

The user can select where to project the image. The control unit 280 may receive a command to select a projection area.

Next, a method of receiving the projection area selection command will be described with reference to Figs. 23 to 28. Fig.

23 to 28 are diagrams for explaining a method of receiving a projection area selection command according to an embodiment of the present invention.

As shown in FIG. 23, the display unit 151 of the mobile terminal 100 can display the projection area selection screen 2200. [

The projection area selection screen 2200 may include an area selection item 2210, an area adjustment item 2220, and first to eighth option icons 2221 to 2229. [

First, an area selection item 2210 will be described with reference to FIGS. 23 to 24. FIG. The mobile terminal 100 may receive an instruction to select one of the projection areas through the area selection item 2210. [ The mobile terminal 100 may transmit a projection area selection command to the beam projector 200. [ The control unit 280 of the beam projector 200 can project an image at a position corresponding to the selected projection area according to the received command. For example, when the control unit 280 receives an instruction to select the first area from the area selection item 2210, the control unit 280 can project an image to an area corresponding to the first area, as shown in Fig. 24 (a) have. Upon receiving the instruction to select the second area from the area selection item 2210, the control unit 280 can project the image to the area corresponding to the second area as shown in Fig. 24 (b). Upon receiving the instruction to select the third area from the area selection item 2210, the control unit 280 can project the image to the area corresponding to the third area as shown in Fig. 24 (c). Upon receiving the instruction to select the fourth area from the area selection item 2210, the control unit 280 can project the image to the area corresponding to the fourth area as shown in Fig. 24 (d).

When the mobile terminal 100 receives the command to select the projection area, the mobile terminal 100 can transmit information on the selected projection area to the beam projector 200. [ The beam projector 200 can project an image on the selected projection area based on the information on the received projection area.

The user can easily select the projection area for projecting the image through the screen displayed on the mobile terminal 100 without directly adjusting the beam projector 200. [

Next, the area adjustment item 2220 will be described with reference to Figs. 25 to 26. Fig. There is a problem that only the approximate projection area can be selected using the area selection item 2210 described above. The area adjustment item 2220 is an item for finely adjusting the position of an image projected in the projection area.

As shown in FIG. 25, the mobile terminal 100 may receive an instruction to move the position of the image through the area adjustment item 2220. [ Specifically, the mobile terminal 100 may receive an image position movement command for dragging and dropping the position of the image displayed on the area adjustment item 2220. [ The mobile terminal 100 may transmit an image position movement command to the beam projector 200. [ The control unit 280 of the beam projector 200 may move the projection position of the image as shown in Fig. 26 based on the received image position movement command. That is, the beam projector 200 can move the projection position of the image to the position shown in Fig. 26 (b) at the position shown in Fig. 26 (a) based on the image position movement command.

The user can more finely adjust the projection position of the image through the screen displayed on the mobile terminal 100. [

Next, the operation of adjusting the keystone of the projected image will be described with reference to FIG. 27 to FIG.

As shown in FIG. 27, the area adjustment item 2220 may include at least one reference point at the border and center of the area adjustment item 2220. The mobile terminal 100 may receive a keystone adjustment command for dragging and dropping any one of the reference points. For example, as shown in FIG. 27, the mobile terminal 100 may receive a keystone adjustment command for dragging and dropping a reference point located at the upper left of the area adjustment item 2220 to the left. The mobile terminal 100 may transmit a keystone adjustment command to the beam projector 200. [ The controller 280 of the beam projector 200 may adjust the keystone of the projection image based on the received keystone adjustment command. The control unit 280 can project an image so that the upper left of the image is tilted to the left according to the keystone adjustment command for dragging and dropping the upper left reference point to the left. More specifically, the control unit 280 can project an image as shown in Fig. 28 (b) while projecting the image as shown in Fig. 28 (a) based on the keystone adjustment command.

The above-described projection area selection command, area adjustment selection command, and keystone adjustment command are merely illustrative.

Next, the first to eighth option icons 2221 to 2229 will be described. The first option icon 2221 may be an item for increasing the brightness of the projected image. The second option icon 2222 may be an item for lowering the brightness of the projected image. The third option icon 2223 may be an item for enlarging the projection image to the full screen. The fourth option icon 2224 may be an item for adjusting the image to be projected in its original size. The fifth option icon 2225 may be an item for enlarging the projected image. The sixth option icon 2226 may be an item to reduce the projected image. The seventh option icon 2227 may be an item that rotates the projection image counterclockwise. The eighth option icon 2228 may be an item that rotates the projection image clockwise. The first to eighth option icons 2221 to 2229 described above are merely illustrative and may further include other option icons.

5 is described again.

If the control unit 280 does not receive a command to select the projection area, the control unit 280 can project the image to an arbitrary projection area (S117).

Next, an operation of projecting an image to an arbitrary area will be described with reference to Figs. 29 to 31. Fig.

29 to 31 are views for explaining a method of projecting an image in an arbitrary region according to an embodiment of the present invention.

The control unit 280 can select an arbitrary projection area among the projection areas acquired in step S103 and project the image to the selected area.

Alternatively, the control unit 280 may select the projection area based on the image projection hysteresis among the projection areas, and project the image to the selected area. For example, the control unit 280 may receive an instruction to project a cloud image. The control unit 280 can acquire to which area the cloud image is projected based on the image projection history. Specifically, the control unit 280 can acquire a record of projecting the cloud image onto the ceiling area. The control unit 280 can project an image in the ceiling area as shown in Fig. 29 based on the image projection history.

Alternatively, the control unit 280 can select the projection area based on the surrounding spatial structure, and project the image to the selected area. For example, the control unit 280 can acquire an area suitable for projecting an image based on the surrounding spatial structure, and project the image to the obtained area as shown in Fig.

In addition, the beam projector 200 may include a plurality of image projecting units 251 to project images to a plurality of areas. The control unit 280 can receive an instruction to project a plurality of images. The control unit 280 can acquire a projection area capable of projecting each image and project a plurality of images as shown in FIG. At this time, the control unit 280 can acquire the projection area in consideration of the size of the image to be projected, and project the image to the obtained projection area.

According to another embodiment of the present invention, the beam projector 200 may be connected to a wearable device (not shown) to provide various operations to the user. For example, the user's movement can be detected through the wearable device. If no movement is detected for a predetermined time or longer through the wearable device, the wearable device can transmit a power off command to the beam projector 200. The beam projector 200 can turn off the power supply based on the transmitted time. According to this, the user can turn off the power automatically when he / she sleeps while watching the video.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Claims (10)

In the beam projector,
A projection unit for projecting an image or a pattern;
A projection adjusting unit adjusting a position of the projection unit; And
Controlling the projection adjusting unit so that the projection unit projects the pattern toward a space in which the beam projector is located; analyzing a structure of the space in which the beam projector is located based on the projected pattern; And a control unit for acquiring at least one or more projection areas,
Wherein the controller is configured to project the image to one of the at least one or more projection areas,
Beam projector. The method according to claim 1,
Wherein the control unit senses a shape change of the pattern projected by the projection unit and determines that the area where the shape change of the pattern is sensed is an inappropriate area for projection, Area,
Beam projector. The method according to claim 1,
Further comprising a camera for photographing an ambient space image in which the beam projector is located,
Wherein the controller analyzes the structure of the space in which the beam projector is located based on the photographed ambient spatial image,
Beam projector. The method of claim 3,
The projection unit further projects a guideline for image correction,
The camera further photographs the projected guideline,
Wherein the control unit generates a calibration image based on a result of comparing the projected guide line and the photographed guide line and processes the image together with the calibration image when projecting the image,
Beam projector. The method of claim 3,
Wherein the control unit senses the position of the user on the basis of the photographed peripheral spatial image and controls the projection unit to project the image in a projection area that is closer to the projection area than the position of the user among the at least one projection area.
Beam projector. The method of claim 3,
Wherein the control unit senses the user's gaze direction based on the photographed ambient spatial image and controls the projector to project the image in the projection area corresponding to the gaze direction of the user among the at least one projection area,
Beam projector. The method according to claim 1,
Further comprising a wireless communication unit for receiving a projection area selection command from the mobile terminal,
Wherein the control unit controls the projection unit to project the image in a projection area corresponding to the projection area selection command,
Beam projector. 8. The method of claim 7,
Wherein the projection area selection command includes an instruction to drag and drop a simulation projection area displayed on the mobile terminal,
Beam projector. 8. The method of claim 7,
Wherein the wireless communication unit further receives the notification information set in the mobile terminal,
Wherein the control unit controls the projection unit to project an image identical to a notification screen image to be displayed on the mobile terminal based on the notification information,
Beam projector. 8. The method of claim 7,
The wireless communication unit further receives a user's motion detection signal from the wearable device,
Wherein the control unit controls the projection unit to terminate the projection of the image if motion of the user is not detected for a predetermined time or more based on the motion detection signal of the user received from the wearable device,
Beam projector.

Images