WO2022191410A1

WO2022191410A1 - Eelectronic device and control method of same

Info

Publication number: WO2022191410A1
Application number: PCT/KR2022/000756
Authority: WO
Inventors: 야쿠비악안토니; 파비안 흐샤노프스키세자리; 키에쉬파벨; 프롱첵로만
Original assignee: 삼성전자주식회사
Priority date: 2021-03-10
Filing date: 2022-01-14
Publication date: 2022-09-15
Also published as: KR20220126977A

Abstract

Disclosed are an electronic device for projecting images and a control method of same. A control method of an electronic device according to the present disclosure comprises: a step for projecting a test image by means of a light source for projecting images; a step for transmitting light emission information pertaining to the test image to a camera device while the test image is being projected; a step for receiving a plurality of captured images from the camera device on the basis of the light emission information, the captured images being images captured of an area onto which the test image is projected at a frame rate synchronized with the refresh ratio at which the test image is projected; a step in which the electronic device acquires calibration information about a projection image to be projected onto the area, the calibration information being received on the basis of the plurality of captured images; and a step for adjusting the projection image according to the calibration information and projecting the projection image.

Description

Electronic device and its control method

The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device for projecting an image and a control method thereof.

Recently, a projector device for viewing a projected image by projecting light onto an area has been commercialized.

Accordingly, the projector has to go through a process of correcting the size and distortion of the projected image. Conventionally, the image projected through the projector device is photographed with a camera device, and correction information is obtained based on the captured image, and the obtained There is a correction method for correcting the projected image through the correction information. Accordingly, there is a need to synchronize the refresh rate of the test image projected from the projector device and the frame rate of the camera device in order to obtain accurate correction information.

The present disclosure has been made in response to the above necessity, and it is an object of the present disclosure to provide an electronic device for acquiring a captured image by synchronizing a refresh rate of a test image projected from an electronic device and a frame rate of a camera device, and a method for controlling the same .

According to an embodiment of the present disclosure for achieving the above object, an electronic device includes: a light emitting unit for projecting an image; communication interface; a memory storing at least one instruction; and a processor for controlling the electronic device by executing at least one instruction stored in the memory, wherein the processor projects a test image by means of a light emitting unit, and controls the test image while projecting the test image. Control the communication interface to transmit the light emission information to the camera device, and based on the light emission information, a plurality of images of the area on which the test image is projected at a frame rate synchronized with a refresh ratio at which the test image is projected controls the communication interface to receive the captured image of The projection image is adjusted and projected according to the information.

In an embodiment, the processor detects whether the light emitting unit emits light, and when it is detected that the light emitting unit emits light, controls the communication interface to transmit the light emission information to the camera device, and the refresh rate according to the light emission information The communication interface may be controlled to receive the photographed image obtained by photographing the area on which the test image is projected at a frame rate synchronized with the camera device.

In an embodiment, the light emitting unit may include a first light emitting unit emitting a first color, a second light emitting unit emitting a second color, and a third light emitting unit emitting a third color.

In one embodiment, when it is detected that the first light-emitting unit emits light, the processor controls the communication interface to transmit light-emitting information about the first light-emitting unit to the camera, and the first light-emitting unit at a first time interval The light emitting unit is controlled to project the test image through each of the sub, the second light emitting unit and the third light emitting unit, and when the second time elapses after the test image is projected through the third light emitting unit for a first time , control the light emitting unit to project the test image through the first light emitting unit for the first time, and transmit light emission information on the first light emitting unit to the camera device when the first light emitting unit emits light You can control the interface.

In an embodiment, the processor projects a test image of a first color through the first light emitting unit for a first time period, and transmits light emission information on the first light emitting unit sensed when the first light emitting unit emits light to the camera control the communication interface to transmit to , and when a second time elapses after the test image of the first color is projected for the first time, the second color is tested through the second light emitting unit for the first time Projecting an image, controlling the communication interface to transmit light emission information about the second light emitting unit sensed when the second light emitting unit emits light to the camera, and the test image of the second color is displayed for the first time When the second time elapses after being projected for a period of time, the test image of the third color is projected through the third light emitting unit for the first time period, and the third light emitting unit sensed when the third light emitting unit emits light The communication interface may be controlled to transmit light emission information for the camera to the camera.

In an embodiment, a first sensor for detecting whether the first light emitting part emits light, a second sensor for detecting whether the second light emitting part emits light, and a third sensor for detecting whether the third light emitting part emits light, The processor projects a test image of a first color through the first light emitting unit for a first time, and receives light emission information about the first light emitting unit sensed by the first sensor when the first light emitting unit emits light control the communication interface to transmit to a camera, and when the text image of the first color is projected for the first time, project the test image of the second color through the second light emitting unit for the first time, and The communication interface is controlled to transmit light emission information on the second light emitting unit sensed by the second sensor to the camera at the time the second light emitting unit emits light, and the text image of the second color is displayed for the first time. When projected, the test image of the third color is projected through the third light emitting unit for the first time, and light emission information on the third light emitting unit sensed by the third sensor when the third light emitting unit emits light may control the communication interface to transmit to the camera.

In an embodiment, the processor is configured to perform a first mixing of the first color, the second color, and the third color through the first light emitting unit, the second light emitting unit, and the third light emitting unit for the first time period. Projecting a test image, controlling the communication interface to transmit light emission information sensed when the first light emitting unit, the second light emitting unit, and the third light emitting unit emit light to the camera device, When a second time elapses after the mixed first test image is projected for the first time, the third color is emitted through the first light emitting unit, the second light emitting unit and the third light emitting unit for the first time period. The communication interface may be controlled to project the mixed second test image and transmit light emission information sensed when the first light emitting unit, the second light emitting unit, and the third light emitting unit emit light to the camera device .

In one embodiment, the correction information may include a two-dimensional pixel displacement map for distortion of the surface of the area on which the test image is projected and two-dimensional surface texture information for the color of the surface. can

In an embodiment, the processor may obtain a corrected projection image by performing a pixel shader using the 2D pixel displacement map and the 2D surface texture information.

In an embodiment, the light emitting unit is implemented as a single light emitting unit, and the processor sequentially displays a test image of a first color, a test image of a second color, and a test image of a third color using a color wheel to the area. can be projected onto the

Meanwhile, according to an embodiment of the present disclosure, a control method of an electronic device for projecting an image includes: projecting a test image by a light source for projecting an image; transmitting light emission information on the test image to a camera device while projecting the test image; receiving, from the camera device, a plurality of photographed images obtained by photographing an area on which the test image is projected at a frame rate synchronized with a refresh ratio at which the test image is projected, based on the light emission information; acquiring correction information of a projection image projected on the area by the electronic device based on the plurality of captured images; and adjusting and projecting the projected image according to the correction information.

In an embodiment, transmitting the light emission information to the camera device may include: detecting whether the light emitting unit emits light; and transmitting the light emission information to the camera device when it is detected that the light emitting unit emits light, wherein the receiving includes projecting the test image at a frame rate synchronized with the refresh rate according to the light emission information It may include; receiving the captured image of the captured area from the camera device.

In one embodiment, in the projecting of the test image, when it is detected that the first light emitting unit emits light, light emission information about the first light emitting unit is transmitted to the camera, and the first light emitting unit at first time intervals , projecting the test image through each of the second light emitting unit and the third light emitting unit; and when a second time elapses after the test image is projected through the third light emitting unit for the first time, the test image is projected through the first light emitting unit for the first time, and light emission information about the first light emitting unit is displayed. It may include; transmitting to the camera device.

In an embodiment, the transmitting of the light emission information to the camera device includes projecting a test image of a first color through the first light emitting unit for a first time, and detecting the first light emission when the first light emitting unit emits light. transmitting light emission information for the unit to the camera; When a second time elapses after the test image of the first color is projected for the first time, the test image of the second color is projected through the second light emitting unit for the first time, and the second light emitting unit transmitting light emission information on the second light emitting unit sensed at the time of light emission to the camera; and when the second time elapses after the test image of the second color is projected for the first time, the test image of the third color is projected through the third light emitting unit for the first time, and the third color and transmitting light emission information on the third light emitting unit sensed when the light emitting unit emits light to the camera.

In an embodiment, the projecting of the test image may include projecting a test image of a first color through the first light emitting unit for a first time, and determining whether the first light emitting unit emits light when the first light emitting unit emits light. transmitting light emission information on a first light emitting unit sensed by a first sensing sensor to the camera; When the text image of the first color is projected for the first time, the test image of the second color is projected through the second light emitting unit for the first time, and when the second light emitting unit emits light, the second transmitting light emission information on the second light emitting unit detected by a second sensor for detecting whether the light emitting unit emits light to the camera; and when the text image of the second color is projected for the first time, the test image of the third color is projected through the third light emitting unit for the first time, and when the third light emitting unit emits light, the second and transmitting, to the camera, light emission information on the third light emitting unit sensed by a third sensor that detects whether the light emitting unit emits light.

In an embodiment, the projecting of the test image includes the first color, the second color, and the third color through the first light emitting unit, the second light emitting unit and the third light emitting unit for the first time period. projecting the mixed first test image and transmitting light emission information detected when the first light emitting unit, the second light emitting unit, and the third light emitting unit emit light to the camera device; and when a second time elapses after the first test image in which the third color is mixed is projected for the first time, the first light emitting unit, the second light emitting unit, and the third light emitting unit are configured for the first time. projecting a second test image in which the third color is mixed, and transmitting light emission information detected when the first light emitting unit, the second light emitting unit, and the third light emitting unit emit light to the camera device; may include.

In an embodiment, the adjusting and projecting the projection image may include obtaining a corrected projection image by performing a pixel shader using the 2D pixel displacement map and the 2D surface texture information. .

In an embodiment, the light emitting unit is implemented as a single light emitting unit, and the projecting of the test image includes a test image of a first color, a test image of a second color, and a test image of a third color by using a color wheel. may be sequentially projecting on the area.

Through the above-described embodiments, the electronic device may improve the quality of the projected image by acquiring the captured image at a frame rate synchronized with the refresh rate of the test image.

1 is a block diagram illustrating a configuration of an electronic device according to the present disclosure.

FIG. 2 is a diagram for describing a process in which a camera device captures an image projected onto an area by an electronic device according to the present disclosure.

3 is a diagram illustrating a color wheel according to an embodiment of the present disclosure.

4 is a view for explaining an embodiment of photographing a test image at a shutter speed corresponding to a time point at which test images of green color, RED color, and BLUE color are projected according to the present disclosure.

5 is a view for explaining an embodiment of photographing a test image at a shutter speed corresponding to a time point at which test images of green color, RED color, and BLUE color are projected according to the present disclosure.

6 is a view for explaining an embodiment of projecting test images of green color, RED color, and BLUE color without a rest period by using a sensor corresponding to each of the green color, the RED color, and the BLUE color according to the present disclosure.

7 is a view for explaining an embodiment of simultaneously projecting test images of green color, RED color, and BLUE color and capturing the simultaneously projected test image.

8 is a sequence diagram illustrating an operation between an electronic device and a camera device according to the present disclosure.

9 is a flowchart illustrating a method of controlling an electronic device according to the present disclosure.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating a configuration of an electronic device according to the present disclosure. FIG. 2 is a diagram for explaining a process in which the camera device 200 captures an image projected on the projection area 10 by the electronic device according to the present disclosure.

Referring to FIG. 1 , the electronic device 100 may include a light source 110 , a communication interface 120 , a memory 130 , and a processor 140 . The electronic device 100 according to the present disclosure is an electronic device for displaying an image on one region by projecting light projected from the light emitting unit 110 onto one region (eg, a screen), and may be referred to as a projector device. .

The light source 110 is configured to project an image. Specifically, referring to FIG. 2 , the light emitting unit 110 may output light corresponding to an image to the projection area 10 located in front of the electronic device 100 . According to the present disclosure, the projection area 10 may be implemented as a screen for displaying a projected image, but the projection area 10 of the present disclosure is not limited thereto, and various projection areas such as an indoor wall area, a curtain area, etc. can be

In an embodiment, the light emitting unit 110 may include a lens and a mirror. The size of the image projected on an area located at a specific distance from the light emitting unit 110 may be preset based on the distance between the lens and the mirror.

In an embodiment, the light emitting unit 110 may include a first light emitting unit emitting a first color, a second light emitting unit emitting a second color, and a third light emitting unit emitting a third color. For example, the first color may be a green color, the second color may be a RED color, and the third color may be a BLUE color. In this case, the electronic device 100 may be referred to as an RGB projector.

In an embodiment, the light emitting unit 110 may further include a first light emitting unit, a second light emitting unit, a third light emitting unit, and a fourth light emitting unit emitting white color. In this case, the electronic device 100 may be referred to as an RGB + WHITE projector.

In an embodiment, the light emitting unit 110 may further include a first light emitting unit, a second light emitting unit, a third light emitting unit, and a fourth light emitting unit emitting a yellow color. In this case, the electronic device 100 may be referred to as an RGB + YELLOW projector.

Although it has been described in the above embodiment that the light emitting unit 110 includes a plurality of light emitting units emitting a single color, the present disclosure is not limited thereto. That is, the light emitting unit 110 may sequentially project a plurality of colors onto the projection area 10 through a single light emitting unit emitting a white color and a color wheel for projecting a plurality of colors.

3 is a diagram illustrating a color wheel according to an embodiment of the present disclosure. As the color wheel of FIG. 3 rotates at a predetermined period, the electronic device 100 may project a plurality of colors at predetermined time intervals. Specifically, the color wheel of FIG. 3 includes a first area 31 for projecting a GREEN color, a second area 32 for projecting a RED color, a third area 33 for projecting a BLUE color, and all colors. It may include a fourth area 34 for projecting (eg, a WHITE color). As the color wheel rotates counterclockwise, the electronic device 100 may sequentially project green, red, blue, and white colors at regular time intervals using a single white light source. GREEN, RED, BLUE, and WHITE colors may be sequentially projected through the color wheel of FIG. 3 , but the color wheel according to the present disclosure is not limited to the color wheel of FIG. 3 . That is, the color wheel according to the present disclosure may be configured to sequentially project a plurality of colors by being divided into a plurality of regions.

The communication interface 120 is a component for performing communication with an external device. Specifically, the communication interface 120 may communicate with an external device through wireless communication or wired communication.

For example, referring to FIG. 2 , when light emission of the light emitting unit 110 is detected, the communication interface 120 may transmit light emission information to the camera device 200 . The camera device 200 is configured to photograph a test image projected on the projection area 10 . That is, the camera device 200 may acquire a captured image by photographing a test image projected by the electronic device 100 on the projection area 10 based on the received light emission information.

In addition, the communication interface 120 may receive a captured image from the camera device 200 .

In an embodiment, the wireless communication is LTE, LTE Advance (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), Wireless Broadband (WiBro), or global System for Mobile Communications) may include cellular communication using at least one of. According to one embodiment, wireless communication is, for example, WiFi (wireless fidelity), Bluetooth, Bluetooth low energy (BLE), Zigbee (Zigbee), NFC (near field communication), magnetic secure transmission (Magnetic Secure Transmission), radio It may include at least one of a frequency (RF) or a body area network (BAN). Wired communication may include, for example, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard232 (RS-232), power line communication, or plain old telephone service (POTS). have. A network in which wireless communication or wired communication is performed may include at least one of a telecommunication network, for example, a computer network (eg, LAN or WAN), the Internet, or a telephone network.

The memory 130 may store various programs and data necessary for the operation of the electronic device 100 . Specifically, at least one instruction may be stored in the memory 130 . The processor 140 may perform the operation of the electronic device 100 by executing a command stored in the memory 130 .

The memory 130 may be implemented as a non-volatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), or a solid state drive (SSD). The memory 130 is accessed by the processor 140 , and reading/writing/modification/deletion/update of data by the processor 140 may be performed. In the present disclosure, the term "memory" refers to a memory 130, a ROM (not shown) in the processor 140, a RAM (not shown), or a memory card (not shown) mounted in the electronic device 100 (eg, micro SD). card, memory stick). In addition, programs and data for configuring various screens to be displayed in the display area of the display may be stored in the memory 130 .

The processor 140 may be electrically connected to the memory 130 to control overall operations and functions of the electronic device 100 .

The processor 140 may include one or a plurality of processors. In this case, the one or more processors are a general-purpose processor such as a central processing unit (CPU), an application processor (AP), and a graphics processing unit (GPU). It may be a graphics-only processor, such as a Visual Processing Unit (VPU), or an AI-only processor, such as a Neural Processing Unit (NPU).

The processor 140 executes one or more instructions stored in the memory of the electronic device 100 to control one or more components included in the electronic device 100, or control one or more components as a hardware circuit or chip, Alternatively, one or more components may be controlled as a combination of software and hardware.

The electronic device 100 according to the present disclosure transmits light emission information on the light emitting unit 110 to the camera device 200 , and a frame rate synchronized with a refresh rate of the projected image projected from the light emitter 110 . A calibration function for correcting an image to be projected may be performed by acquiring a photographed image. That is, the camera device 200 captures a test image at a predetermined shutter speed immediately upon receiving the light emission information from the electronic device 100 , so that the plurality of test images are projected at a frame rate synchronized with the refresh rate of the electronic device 100 . of the captured image can be obtained.

The correction function according to the present disclosure may include a test image projection module 141 , a light emission information acquisition module 142 , an image correction module 143 , and an image projection module 144 as shown in FIG. 1 . For example, each module may be stored in the memory 130 .

For example, when the power of the electronic device 100 is turned on, the correction function according to the present disclosure may be performed. For example, when a projection image is projected by the light emitting unit 110 of the electronic device 100, the correction function according to the present disclosure may be performed. For example, the correction function according to the present disclosure may be performed according to a user's correction command. For example, while the power of the electronic device 100 is turned on, a correction function may be performed at preset intervals. However, it is not limited to the above-described example, and the correction function according to the present disclosure may be performed in various ways.

When the correction function is executed, the plurality of modules 141 to 144 may be loaded into a memory (eg, a volatile memory) included in the processor 140 . That is, when the correction function is executed, the processor 140 may load the plurality of modules 141 to 144 from the nonvolatile memory to the volatile memory to execute respective functions of the plurality of modules 141 to 144 . Loading refers to an operation of loading and storing data stored in the non-volatile memory into the volatile memory so that the processor 140 can access it.

In one embodiment according to the present disclosure, as shown in FIG. 1 , a re-translation function may be implemented through a plurality of modules 141 to 144 stored in the memory 130 , but the retranslation function is not limited thereto, and the correction function is provided by an external server or an external server. It can be implemented in the device.

The plurality of modules 141 to 144 according to the present disclosure may be implemented by respective software, but is not limited thereto, and some modules may be implemented by a combination of hardware and software. In another embodiment, the plurality of modules 141 to 144 may be implemented as one software. Also, some modules may be implemented in the electronic device 100 , and some modules may be implemented in an external server or an external device.

The test image projection module 141 is configured to project a test image for correcting the projection image. The test image is an image for obtaining correction information including surface information and color information of the projection area 10 . For example, the test image may include a specific pattern. In addition, the processor 140 may correct the projected image based on a captured image obtained by capturing a test image obtained through the camera device 200 .

The test image projection module 141 may project a test image on the projection area 10 . As an embodiment, the test image projection module 141 may project the test image according to a predetermined refresh rate. The refresh rate may mean the number of still images projected from the light emitting unit 110 in one second. That is, when the refresh rate is 50hz, the light emitting unit 110 may project 50 still images per second.

In an embodiment, as will be described later in FIGS. 4, 5 and 6 , the test image projection module 141 sequentially projects a green color test image, a RED color test image, and a BLUE color test image according to a predetermined refresh rate. can do.

For example, as will be described later with reference to FIG. 7 , the test image projection module 141 may project a test image in which a green color, a RED color, and a BLUE color are mixed according to a predetermined refresh rate according to a predetermined refresh rate.

The light emission information obtaining module 142 is configured to detect whether the light emitting unit 110 emits light and obtain light emission information. The light emission information according to the present disclosure may be information about a time when light emission is started by the light emitting unit 110 . That is, when the test image is projected by the light emitting unit 110 , the light emitting information acquisition module 142 may acquire information about a time when the test image starts to be projected. As an embodiment, the light emission information may further include information on the color of the test image projected through the light emitter 110 .

In an embodiment, the light emission information obtaining module 142 may obtain light emission information by using a sensor for detecting whether the light emitting unit 110 emits light. The sensor may be implemented as a sensor that converts light energy into electrical energy, such as a photo diode. That is, when the test image is projected by the light emitting unit 110 , the light emission information obtaining module 142 may obtain light emission information by sensing light energy through a sensor.

In an embodiment, the sensor may be configured as a single sensor, but the present disclosure is not limited thereto. That is, as an example, the sensor includes a first sensor for detecting light energy of a GREEN series wavelength, a second sensor for detecting light energy of a RED series wavelength, and a third sensor for detecting light energy of a BLUE series wavelength can do.

As an embodiment, when the electronic device 100 is implemented as an RGB LED projector device including a chip for controlling a voltage on an LED diode, the light emitting information obtaining module 142 uses the chip to obtain a voltage. It is possible to obtain light emission information by sensing.

For example, when the test image is projected by the test image projecting module 141 , the luminescence information acquisition module 142 may detect whether the light emitting unit 110 emits light according to a refresh rate of the test image.

For example, as shown in FIG. 4 , the test image projection module 141 sequentially projects test images of green color, RED color, and BLUE color, and after a predetermined time (D) has elapsed, the green color, RED color and BLUE color test images can be projected sequentially. That is, when light emission information is obtained using a sensor such as a photo diode, the light emitting unit 110 goes through a predetermined rest period D, and the photo diode desaturates and then emits light again. , the light emission information obtaining module 142 may detect light emission again by the sensor.

Referring to FIG. 4 , the light emission information obtaining module 142 obtains light emission information on the time when the light emission of the light emitting unit 110 starts, that is, when the test image of the green color starts to be projected (1, 5, 9 time points). can do. In addition, the light emission information obtaining module 142 may transmit light emission information to the camera device 200 through the communication interface 120 . The present disclosure is not limited to the embodiment of FIG. 4 , and various embodiments of the present disclosure will be described later with reference to FIGS. 5 to 7 .

In the above embodiment, it has been described that the light emission information obtaining module 142 obtains light emission information using a sensor or a chip, but the present disclosure is not limited thereto, and various configurations for detecting whether the light emitting unit 110 emits light. light emission information can be obtained through

The image correction module 143 acquires a captured image obtained by photographing a test image projected from the camera device 200 through the test image projection module 141, and calibrates the projected image based on the obtained captured image. configuration for

As an embodiment, the image correction module 143 may acquire a captured image from the camera device 200 through the communication interface 120 . That is, the camera device 200 may acquire a captured image by photographing a test image based on the light emission information received from the electronic device 100 . As an example, referring to FIG. 4 , when the camera device 200 receives light emission information for one viewpoint from the electronic device 100 , the camera device 200 captures a test image projected on the projection area 10 according to a preset shutter speed. can For example, after the test image is projected by the electronic device 100 , a delay (interval C) between the time when the camera device 200 receives the light emission information and captures the test image may occur. Accordingly, the camera device 200 may capture the test image after a predetermined time (time C) has elapsed from the

time points

1, 5, and 9 when the electronic device 100 starts projecting the test image.

And, according to an embodiment of the present disclosure, the preset shutter speed may be preset according to the refresh rate of the test image projected by the test image projection module 141 .

For example, as shown in FIG. 4 , the test image projection module 141 sequentially projects test images of GREEN color, RED color, and BLUE color, and after a predetermined time (D) elapses, the green color, RED color, and BLUE color are displayed again. When the test images are sequentially projected, the shutter speed may be preset so that the test images are taken during the time points (views 1 to 4) at which the test images of the green color, the RED color, and the BLUE color are projected.

For example, as shown in FIG. 5 , the test image projection module 141 projects the test image of the green color, projects the test image of the RED color after a predetermined time (D), and tests the BLUE color after the lapse of a predetermined time (D) You can project an image. In this case, the luminescence information acquisition module 142 receives the luminescence information for the time points (

viewpoints

1, 5, and 9) at which the test images of the green color, the RED color, and the BLUE color are respectively projected through the communication interface 120 to the camera. may be transmitted to the device 200 . In addition, the camera device 200 may photograph the test image at a preset shutter speed corresponding to the time point at which the green color test image is projected (view 1 to view 4). Also, the camera device 200 may capture a test image at a preset shutter speed corresponding to a time point at which the RED color test image is projected (views 5 to 8). In addition, the camera device 200 may photograph the test image at a preset shutter speed corresponding to the timing at which the test image of the BLUE color is projected (viewpoints 9 to 12).

And, as an embodiment, a preset shutter speed corresponding to a time point at which a test image of each color is projected may be different for each color. That is, for example, the preset shutter speed corresponding to the green color is preset to be relatively shorter than the preset shutter speed of the other color, and the preset shutter speed corresponding to the BLUE color is relative to the preset shutter speed of the other color. It may be preset to be long. That is, as the wavelength distributions of the GREEN, RED, and BLUE series are different, the power spectrum distribution when the GREEN, RED, and BLUE series test images are projected is also different. That is, in consideration of the fact that quantum efficiency is different for each wavelength band, the present disclosure may preset a shutter speed for capturing GREEN, RED, and BLUE series test images. Quantum efficiency refers to a rate at which photons are converted into photons of different energy, and may mean a rate at which excitation energy is converted into light emission energy when light is emitted. For example, since quantum efficiency is relatively high in the wavelength band of the GREEN series, the preset shutter speed corresponding to the green color may be preset to be relatively shorter than the preset shutter speed of the other color.

When the camera device 200 acquires a captured image by capturing a test image according to the preset shutter speed and light emission information, the image correction module 143 receives the captured image through the communication interface 120, and through the captured image Correction information for calibrating the projection image may be obtained.

In an embodiment, the correction information includes a two-dimensional pixel displacement map for distortion of the surface of the projection region 10 onto which the test image is projected, and a two-dimensional surface texture for the color of the surface of the projection region 10 . texture) information. For example, the test image may include a specific pattern, and a two-dimensional pixel displacement map for the distortion of the surface of one region is obtained through a captured image in which the specific pattern is projected onto one region. can do. And, as an example, as shown in FIG. 4 , through the white color photographed image obtained by photographing at the shutter speed of the period during which the green color, RED color, and BLUE color test images are projected, the color of the surface of the projection area 10 is Two-dimensional surface texture information may be obtained. A method of correcting a projected image using a two-dimensional pixel displacement map and a two-dimensional surface texture is a conventionally known technique, and thus a detailed description thereof will be omitted.

In addition, the image correction module 143 may correct the projection image to be projected on the projection area 10 according to the correction information. In one embodiment, a rendered projection image can be obtained by performing a pixel shader technique that renders a projection image by calculating the color and other properties of each pixel based on the 2D pixel displacement map and the 2D surface texture. have.

The image projection module 144 is configured to project a projection image rendered according to the correction information onto the projection area 10 . Specifically, when the projection image rendered by the image correction module 143 is obtained, the image projection module 144 may control the light emitting unit 110 to project the rendered projection image. That is, the image correction module 143 renders the projection image by reflecting the distortion and color of the surface of the projection area 10 on which the projection image is to be projected through the correction information obtained through the camera device 200, and the image projection module ( 144 may control the light emitting unit 110 to project the rendered projection image.

Through the above-described embodiments, the present disclosure may acquire a rendered projection image without using a spatial filter. That is, conventionally, a spatial filter has to be used in order to reduce the vignette effect of darkening the outer portion of the projection image that may be generated in the projection image, but the electronic device 100 according to the present disclosure is It is possible to reduce the vignette effect that may be generated in the projected image without using a spatial filter.

Through the above-described embodiments, the electronic device may improve the quality of the projected image by acquiring correction information based on a captured image captured at a frame rate synchronized with a refresh rate of the test image.

Specifically, as shown in FIG. 4 , the electronic device 100 sequentially projects the test images of the green color, the RED color, and the BLUE color, and after a period of rest (D), the test image of the green color, the RED color, and the BLUE color is performed again. Images can be projected sequentially. That is, as shown in FIG. 4 , the electronic device 100 may project the test image at a refresh rate at which the test images of the green color, the RED color, and the BLUE color are projected during one view interval.

For example, when the refresh rate for projecting the test image of the electronic device 100 is 50 hz, the one-view interval may mean 1/50 second. However, the present invention is not limited thereto, and when the three viewpoint intervals at which the test images of the green color, the RED color, and the BLUE color are projected are viewed as one still image, the refresh rate at which the test image of the electronic device 100 is projected is 50hz. Considering up to, one time interval may mean 1/200 second.

Specifically, in an embodiment in which the electronic device 100 acquires light emission information using a sensor such as a photo diode, when the electronic device 100 uses one sensor, there is a rest period after projecting the test image. After the photo diode is desaturated through (D), the test image must be projected again, so that the electronic device 100 can detect light emission again by the sensor. That is, referring to FIG. 4 , after the rest period (D) from time 0 to time 1, when a projection image of green color is projected at time 1, the electronic device 100 may obtain light emission information for time 1 . Then, the electronic device 100 transmits the light emission information to the camera device 200 at one point in time, and after a delay of the interval C, when the camera device 200 receives the light emission information, the camera device 200 performs the light emission information in the B period. A photographed image may be acquired by photographing a test image at a shutter speed corresponding to . That is, if the green color projection image is projected for 1 to 2 time points and then the green color projection image is projected immediately for 2 to 3 time points, the test image is continuously projected, so a sensor such as a photo diode may not acquire light emission information at the 2 point in time.

And, after a test image of BLUE color is projected for a period of time 3 to 4, and after a certain rest period (D), when a test image of a green color is projected again, the electronic device 100 acquires luminescence information for the time 5, Light emission information may be transmitted to the camera device 200 . In addition, the camera device 200 may acquire a photographed image by photographing a test image at a shutter speed corresponding to period B after the delay of period C from the time point 5 .

Accordingly, in the embodiment shown in FIG. 4 , the camera device 200 is configured to project the test images of the green color, the RED color, and the BLUE color during the period (1 to 4, 5 to 8, 9 to 12). A shutter speed B may be preset to capture a test image.

Unlike the embodiment of FIG. 4 , the electronic device 100 puts a rest period D between the periods during which the test images of the green color, the RED color, and the BLUE color are projected, respectively, so that the test images of the green color, the RED color, and the BLUE color are projected. Light emission information may be transmitted to the camera device 200 to photograph each. That is, as shown in FIG. 5 , the electronic device 100 may project the test images of the green color, the RED color, and the BLUE color for a three-view interval, and may project the test image at a refresh rate including the pause period of the 1-view interval.

Specifically, referring to FIG. 5 , the electronic device 100 may project a test image of a green color from one to four views. In addition, the electronic device 100 may acquire light emission information for one time point, and transmit the light emission information to the camera device 200 at the first time point. And, after the delay of period E, when the camera device 200 receives the light emission information, the camera device 200 may acquire a photographed image by photographing a test image of green color at the shutter speed of period A.

Then, after the rest period D for the 4 to 5 time points, the electronic device 100 may project the test image of the RED color for the 5 to 8 time points. In addition, the electronic device 100 may obtain light emission information for the 5 viewpoints and transmit the emission information to the camera device 200 at the 5 viewpoints. And, after the delay of the period E, when the camera device 200 receives the light emission information, the camera device 200 may acquire a photographed image by photographing a test image of the RED color at the shutter speed of the period B.

In addition, after the idle period D from 8 to 9, the electronic device 100 may project a test image of the BLUE color from 9 to 12. Then, the electronic device 100 may acquire light emission information for the ninth time point and transmit the light emission information to the camera device 200 at the ninth time point. And, after the delay of period E, when the camera device 200 receives the light emission information, the camera device 200 may acquire a photographed image by photographing a test image of the BLUE color at the shutter speed of period C.

That is, when there is a rest period (D) between the periods during which the test images of green color, RED color, and BLUE color are projected as shown in FIG. 5, the photo diode is desaturated during the rest period (D). When the test image is projected after the rest period, the electronic device 100 may acquire light emission information by means of a photodiode.

And, according to an embodiment, the shutter speed of the camera device 200 may be differently predetermined according to the color of the test image projected by the electronic device 100 . For example, a preset shutter speed (A) of a photographed image photographed according to emission information for a green color is relatively shorter than a preset shutter speed (B, C) of a photographed image photographed according to emission information for another color and the preset shutter speed (C) of the photographed image taken according to the luminescence information for the BLUE color is relative to the preset shutter speed (A, B) of the photographed image photographed according to the luminescence information for the other color. It may be preset to be long.

6 is a view for explaining an embodiment of projecting test images of green color, RED color, and BLUE color without a rest period by using a sensor corresponding to each of the green color, the RED color, and the BLUE color according to the present disclosure. That is, as shown in FIG. 6 , the electronic device 100 may project the test image at a refresh rate at which the test images of the green color, the RED color, and the BLUE color are respectively projected during a three-view interval without a pause.

4 and 5 show an embodiment in which light emission information is obtained using a single photodiode, but the present disclosure is not limited thereto. That is, the present disclosure may use three sensors for detecting whether each of the green color, the RED color, and the BLUE color emits light. That is, when the light emitting unit 110 of the electronic device 100 is implemented as a first light emitting unit emitting a green color, a second light emitting unit emitting a RED color, and a third light emitting unit emitting a BLUE color, the electronic device ( 100) may include a first sensor for detecting whether the first light emitting unit emits light, a second sensor for detecting whether the second light emitting unit emits light, and a third sensor for detecting whether the third light emitting unit emits light.

And, as shown in FIG. 6 , when a test image of green color is projected at one point in time, the electronic device 100 detects whether light is emitted through the first sensor to obtain light emission information, and transmits light emission information to the camera device ( 200) can be transmitted. And, after the delay of period E from time 1, when the camera device 200 receives the luminescence information, the camera device 200 captures a test image of green color at the shutter speed of period B to obtain a photographed image. have.

Then, after the green color test image is projected from 1 to 4 views, the electronic device 100 may project the RED test image from 4 to 7 views. When the test image of the RED color is projected at the fourth time point, the electronic device 100 may detect whether light is emitted through the second sensor to obtain light emission information, and transmit the light emission information to the camera device 200 at the fourth time point. And, after the delay of period E from the time point 4, when the camera device 200 receives the light emission information, the camera device 200 acquires a photographed image by shooting a test image of the RED color at the shutter speed of the period C. have.

Then, after the test image of the RED color is projected from the 4th to the 7th time, the electronic device 100 may project the BLUE color test image from the 7th to the 10th time. When the test image of the BLUE color is projected at the seventh time point, the electronic device 100 may detect whether light is emitted through the third sensor to obtain light emission information, and transmit the light emission information to the camera device 200 at the seventh time point. And, after the delay of the interval E from the time point 7, when the camera device 200 receives the light emission information, the camera device 200 captures a test image of the BLUE color at the sutter speed of the D period to obtain a photographed image. have.

And, according to an embodiment, the shutter speed of the camera device 200 may be differently predetermined according to the color of the test image projected by the electronic device 100 . For example, a preset shutter speed (B) of a photographed image photographed according to emission information for a green color is relatively shorter than a preset shutter speed (C, D) of a photographed image photographed according to emission information for another color and the preset shutter speed (D) of the photographed image photographed according to the emission information for the BLUE color is relative to the preset shutter speed (B, C) of the photographed image photographed according to the emission information for the other color. It may be preset to be long.

In addition, in the above-described embodiment, it has been described that the light emission information is obtained using the first sensor, the second sensor, and the third sensor implemented as a photodiode, but the present disclosure is not limited thereto. That is, when the electronic device 100 is implemented as an RGB LED projector device including a chip for controlling a voltage on an LED diode, the electronic device 100 detects the voltage using the chip to detect light emission information. can be obtained.

For example, in an embodiment in which color expression is not a key factor, the electronic device 100 may simultaneously project test images of green color, RED color, and BLUE color.

Specifically, referring to FIG. 7 , the electronic device 100 simultaneously projects the first test image of the green color, the RED color, and the BLUE color for the time points 1 to 4 after the rest period B from 0 to 1 time. can In addition, the electronic device 100 may acquire light emission information at one time point and transmit the light emission information to the camera device 200 . Then, after the delay of the C period interval, when the camera device 200 receives the light emission information, the camera device 200 takes a first test image in which the green color, the RED color, and the BLUE color are mixed at the shutter speed of the A period. Thus, the captured image can be obtained.

Then, after the rest period B for the 4 to 5 time points, the electronic device 100 may simultaneously project the second test image of the green color, the RED color, and the BLUE color from the 5 point to the 8 point. In addition, the electronic device 100 may acquire light emission information at 5 viewpoints and transmit the light emission information to the camera device 200 . And, after the delay of the C period interval, when the camera device 200 receives the light emission information, the camera device 200 shoots a second test image in which the green color, the RED color, and the BLUE color are mixed at the shutter speed of the A period. Thus, the captured image can be obtained.

Referring to FIG. 8 , first, the electronic device 100 may project a test image ( S810 ). Specifically, the electronic device 100 may control the light emitting unit to project the test image onto one area. Then, while the test image is projected, the electronic device 100 may acquire light emission information on the test image ( S820 ). The light emission information according to the present disclosure may be information about a time when light emission is started by the light emitting unit. That is, when the test image is projected according to a preset refresh rate, the electronic device 100 may acquire information on a time when the test image starts to be projected based on the refresh rate.

Then, the electronic device 100 may transmit the light emission information to the camera device 200 (S830). In addition, the camera device 200 may acquire a plurality of captured images by capturing a test image at a frame rate determined based on the received light emission information ( S840 ). For example, a predetermined interval (delay time) may exist between a time point at which the electronic device 100 transmits light emission information and a time point at which the camera device 200 receives light emission information.

That is, the camera device 200 may acquire a photographed image by photographing a test image at a predetermined frame rate (shutter speed) at the point in time when the light emission information is received from the electronic device 100 , and A plurality of captured images may be acquired according to the received plurality of light emission information. That is, the camera device 200 may acquire a plurality of captured images corresponding to the number of times of light emission information received from the electronic device 100 . And, according to an embodiment, the predetermined frame rate (shutter speed) of the camera device 200 may be predetermined based on the refresh rate of the test image projected by the electronic device 100 .

For example, when the electronic device 100 sequentially projects test images of green color, RED color, and BLUE color and then sequentially projects test images of green color, RED color, and BLUE color again after a predetermined time elapses, GREEN The shutter speed may be preset so that the test image is captured for each color while the test image of the color, the RED color, and the BLUE color is projected.

For example, the electronic device 100 may project a test image of a green color, project a test image of a RED color after a predetermined time elapses, and project a test image of a BLUE color after a lapse of a predetermined time. In this case, the electronic device 100 may transmit luminescence information for a time point at which the test images of the green color, the RED color, and the BLUE color are respectively projected to the camera device 200 . In addition, the camera device 200 may take a test image at a preset shutter speed at a time point when the light emission information for the green color is received. In addition, the camera device 200 may take a test image at a preset shutter speed at a time point when light emission information for the RED color is received. Also, the camera device 200 may photograph a test image at a preset shutter speed at a time point when light emission information for a blue color is received.

As an embodiment, the shutter speed of the camera device 200 may be differently predetermined according to the color of the test image projected by the electronic device 100 . For example, the preset shutter speed of a photographed image photographed according to luminescence information for a green color is preset to be relatively shorter than a preset shutter speed of a photographed image photographed according to luminescence information for another color, and the BLUE color A preset shutter speed of a photographed image photographed according to luminescence information may be preset to be relatively longer than a preset shutter speed of a photographed image photographed according to luminescence information of another color.

Then, the camera device 200 may transmit a plurality of captured images taken according to the light emission information to the electronic device 100 (S850).

When the electronic device 100 receives the plurality of captured images, the electronic device 100 may obtain correction information of the projected image (S860). That is, the electronic device 100 may obtain correction information for correcting the projection image based on the plurality of captured images, and the correction information may include, for example, the correction information for the distortion of the surface of the one area on which the test image is projected. It may include a two-dimensional pixel displacement map and two-dimensional surface texture information for a color of a surface for one region.

Then, the electronic device 100 may adjust and project the projected image according to the correction information (S870). That is, the electronic device 100 may render a projection image to be projected on one region according to the correction information, and may project the rendered projection image onto one region.

Referring to FIG. 9 , the electronic device 100 may project a test image by a light emitting unit that projects the image ( S910 ).

In an embodiment, the light emitting unit may include a first light emitting unit emitting a first color, a second light emitting unit emitting a second color, and a third light emitting unit emitting a third color. However, the present disclosure is not limited thereto, and may include a single light emitting unit that emits a single color (eg, white color) and a color wheel that distinguishes a color of a projected image.

While projecting the test image, the electronic device 100 may transmit light emission information on the test image to the camera device 200 ( S920 ).

Specifically, the electronic device 100 may detect whether the light emitting unit emits light, and when it is detected that the light emitting unit emits light, the electronic device 100 may transmit light emission information to the camera device 200 .

In addition, the electronic device 100 may receive from the camera device 200 a plurality of photographed images obtained by photographing the area on which the test image is projected at a frame rate synchronized with the refresh rate of the test image determined by the light emission information (S930). ).

Specifically, the electronic device 100 may receive, from the camera device 200 , a photographed image obtained by photographing an area on which the test image is projected at a speed synchronized with the refresh rate of the electronic device 100 according to the light emission information. That is, the camera device 200 captures a test image at a predetermined shutter speed immediately upon receiving the light emission information, thereby acquiring a plurality of captured images at a frame rate synchronized with the refresh rate of the electronic device 100 .

Then, the electronic device 100 may acquire correction information of the projection image projected by the electronic device on the area based on the plurality of captured images ( S940 ). As an embodiment, the correction information may include a two-dimensional pixel displacement map for distortion of a surface of a region on which a test image is projected and two-dimensional surface texture information for a color of the surface.

Then, the electronic device 100 may adjust and project the projected image according to the correction information (S950). As an embodiment, the electronic device 100 may obtain a corrected projection image and project the corrected projection image by performing a pixel shader using the 2D pixel displacement map and 2D surface texture information.

The present embodiments can apply various transformations and can have various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of the specific embodiments, and should be understood to include various modifications, equivalents, and/or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, like reference numerals may be used for like components.

In describing the present disclosure, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present disclosure, a detailed description thereof will be omitted.

In addition, the above-described embodiments may be modified in various other forms, and the scope of the technical spirit of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to more fully and complete the present disclosure, and to fully convey the technical spirit of the present disclosure to those skilled in the art.

The terms used in the present disclosure are used only to describe specific embodiments, and are not intended to limit the scope of rights. The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present disclosure, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of a corresponding characteristic (eg, a numerical value, function, operation, or component such as a part). and does not exclude the presence of additional features.

In this disclosure, expressions such as “A or B,” “at least one of A and/and B,” or “one or more of A or/and B” may include all possible combinations of the items listed together. . For example, "A or B," "at least one of A and B," or "at least one of A or B" means (1) includes at least one A, (2) includes at least one B; Or (3) it may refer to all cases including both at least one A and at least one B.

As used in the present disclosure, expressions such as “first,” “second,” “first,” or “second,” may modify various elements, regardless of order and/or importance, and refer to one element. It is used only to distinguish it from other components, and does not limit the components.

A component (eg, a first component) is "coupled with/to (operatively or communicatively)" to another component (eg, a second component) When referring to "connected to", it should be understood that the certain element may be directly connected to the other element or may be connected through another element (eg, a third element).

On the other hand, when it is said that a component (eg, a first component) is "directly connected" or "directly connected" to another component (eg, a second component), the component and the It may be understood that other components (eg, a third component) do not exist between other components.

The expression "configured to (or configured to)" as used in this disclosure depends on the context, for example, "suitable for," "having the capacity to" ," "designed to," "adapted to," "made to," or "capable of." The term “configured (or configured to)” may not necessarily mean only “specifically designed to” in hardware.

Instead, in some circumstances, the expression “a device configured to” may mean that the device is “capable of” with other devices or parts. For example, the phrase “a processor configured (or configured to perform) A, B, and C” refers to a dedicated processor (eg, an embedded processor) for performing the operations, or by executing one or more software programs stored in a memory device. , may mean a generic-purpose processor (eg, a CPU or an application processor) capable of performing corresponding operations.

In an embodiment, a 'module' or 'unit' performs at least one function or operation, and may be implemented as hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'units' may be integrated into at least one module and implemented by at least one processor, except for 'modules' or 'units' that need to be implemented with specific hardware.

Meanwhile, various elements and regions in the drawings are schematically drawn. Accordingly, the technical spirit of the present invention is not limited by the relative size or spacing drawn in the accompanying drawings.

Meanwhile, the various embodiments described above may be implemented in a recording medium readable by a computer or a similar device using software, hardware, or a combination thereof. According to the hardware implementation, the embodiments described in the present disclosure are ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays) ), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing other functions may be implemented using at least one. In some cases, the embodiments described herein may be implemented by the processor itself. According to the software implementation, embodiments such as the procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

Meanwhile, the above-described method according to various embodiments of the present disclosure may be stored in a non-transitory readable medium. Such a non-transitory readable medium may be mounted and used in various devices.

The non-transitory readable medium refers to a medium that stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, cache, memory, etc., and can be read by a device. Specifically, the programs for performing the above-described various methods may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

According to an embodiment, the method according to various embodiments disclosed in this document may be provided by being included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product may be distributed in the form of a machine-readable storage medium (eg, compact disc read only memory (CD-ROM)) or online through an application store (eg, Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

In addition, although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and the technical field to which the disclosure belongs without departing from the gist of the present disclosure as claimed in the claims Various modifications may be made by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present disclosure.

Claims

An electronic device for projecting an image, comprising:

a light emitting unit for projecting an image (light source);

communication interface;

a memory storing at least one instruction; and

a processor for controlling the electronic device by executing at least one instruction stored in the memory;

The processor is

Projecting the test image by the light emitting part,

controlling the communication interface to transmit luminescence information for the test image to a camera device while projecting the test image;

Control the communication interface to receive from the camera device a plurality of photographed images obtained by photographing the area on which the test image is projected at a frame rate synchronized with a refresh rate at which the test image is projected based on the light emission information do,

obtaining calibration information of a projection image projected by the electronic device onto the area based on the plurality of captured images;

An electronic device that adjusts and projects a projected image according to the correction information.
According to claim 1,

The processor is

Detect whether the light emitting unit emits light,

When it is detected that the light emitting unit emits light, controlling the communication interface to transmit the light emission information to the camera device,

an electronic device controlling the communication interface to receive, from the camera device, the photographed image obtained by photographing the area on which the test image is projected at a frame rate synchronized with the refresh rate according to the light emission information.
3. The method of claim 2,

The electronic device of claim 1, wherein the light emitting unit includes a first light emitting unit emitting a first color, a second light emitting unit emitting a second color, and a third light emitting unit emitting a third color.
4. The method of claim 3,

The processor is

When it is detected that the first light emitting unit emits light, the communication interface is controlled to transmit light emission information about the first light emitting unit to the camera, and the first light emitting unit, the second light emitting unit and controlling the light emitting unit to project the test image through each of the third light emitting units,

When a second time elapses after the test image is projected through the third light emitting unit for a first time, the light emitting unit is controlled to project the test image through the first light emitting unit for the first time, and the first light emitting unit An electronic device for controlling the communication interface to transmit light emission information on the first light emitting unit to the camera device when light is emitted.
4. The method of claim 3,

The processor is

Controls the communication interface to project a test image of a first color through the first light emitting unit for a first time, and transmit light emission information about the first light emitting unit sensed when the first light emitting unit emits light to the camera do,

When a second time elapses after the test image of the first color is projected for the first time, the test image of the second color is projected through the second light emitting unit for the first time, and the second light emitting unit controlling the communication interface to transmit light emission information about the second light emitting unit sensed at the time of light emission to the camera,

When the second time elapses after the test image of the second color is projected for the first time, the test image of the third color is projected through the third light emitting unit for the first time, and the third light is emitted. An electronic device for controlling the communication interface to transmit the light emission information on the third light emitting unit sensed when the additional light is emitted to the camera.
4. The method of claim 3,

a first sensor for detecting whether the first light emitting part emits light, a second sensor for detecting whether the second light emitting part emits light, and a third sensor for detecting whether the third light emitting part emits light,

The processor is

A test image of a first color is projected through the first light emitting unit for a first time, and light emission information on the first light emitting unit sensed by the first sensor is transmitted to the camera when the first light emitting unit emits light control the communication interface so as to

When the text image of the first color is projected for the first time, the test image of the second color is projected through the second light emitting unit for the first time, and when the second light emitting unit emits light, the second controlling the communication interface to transmit light emission information about the second light emitting unit sensed by the sensor to the camera,

When the text image of the second color is projected for the first time, the test image of the third color is projected through the third light emitting unit for the first time, and when the third light emitting unit emits light, the third An electronic device for controlling the communication interface to transmit light emission information on the third light emitting unit sensed by the sensor to the camera.
4. The method of claim 3,

The processor is

A first test image in which the first color, the second color, and the third color are mixed is projected through the first light emitting unit, the second light emitting unit and the third light emitting unit for the first time, and the second controlling the communication interface to transmit light emission information sensed when the first light emitting unit, the second light emitting unit, and the third light emitting unit emit light to the camera device,

When a second time elapses after the first test image in which the third color is mixed is projected for the first time, through the first light emitting unit, the second light emitting unit and the third light emitting unit for the first time the communication interface to project a second test image in which the third color is mixed, and transmit light emission information detected when the first light emitting unit, the second light emitting unit, and the third light emitting unit emit light to the camera device electronic device that controls it.
According to claim 1,

The correction information includes a two-dimensional pixel displacement map for distortion of a surface of the area on which the test image is projected and two-dimensional surface texture information for a color of the surface.
9. The method of claim 8,

the processor

An electronic device for obtaining a corrected projection image by performing a pixel shader using the 2D pixel displacement map and the 2D surface texture information.
According to claim 1,

The light emitting unit is implemented as a single light emitting unit,

The processor is

An electronic device that sequentially projects a test image of a first color, a test image of a second color, and a test image of a third color on the region by using a color wheel.
In the control method of an electronic device for projecting an image,

Projecting a test image by a light source (light source) for projecting the image;

transmitting light emission information on the test image to a camera device while projecting the test image;

receiving, from the camera device, a plurality of photographed images obtained by photographing an area on which the test image is projected at a frame rate synchronized with a refresh ratio at which the test image is projected, based on the light emission information;

acquiring correction information of a projection image projected on the area by the electronic device based on the plurality of captured images; and

Control method including; adjusting and projecting the projected image according to the correction information.
12. The method of claim 11,

The step of transmitting the light emission information to the camera device,

detecting whether the light emitting unit emits light; and

When it is detected that the light emitting unit emits light, transmitting the light emission information to the camera device;

The receiving step is

and receiving, from the camera device, the photographed image obtained by photographing the area on which the test image is projected at a frame rate synchronized with the refresh rate according to the light emission information.
13. The method of claim 12,

The control method according to claim 1, wherein the light emitting unit includes a first light emitting unit emitting a first color, a second light emitting unit emitting a second color, and a third light emitting unit emitting a third color.
14. The method of claim 13,

Projecting the test image comprises:

When it is detected that the first light emitting unit emits light, light emission information about the first light emitting unit is transmitted to the camera, and each of the first light emitting unit, the second light emitting unit, and the third light emitting unit at a first time interval projecting the test image through and

When a second time elapses after the test image is projected through the third light emitting unit for the first time, the test image is projected through the first light emitting unit for the first time and the light emission information for the first light emitting unit is displayed. A control method comprising a; transmitting to the camera device.
14. The method of claim 13,

The step of transmitting the light emission information to the camera device,

projecting a test image of a first color through the first light emitting unit for a first time, and transmitting light emission information on the first light emitting unit sensed when the first light emitting unit emits light to the camera;

When a second time elapses after the test image of the first color is projected for the first time, the test image of the second color is projected through the second light emitting unit for the first time, and the second light emitting unit transmitting light emission information on the second light emitting unit sensed at the time of light emission to the camera; and

When the second time elapses after the test image of the second color is projected for the first time, the test image of the third color is projected through the third light emitting unit for the first time, and the third light is emitted. and transmitting, to the camera, the light emission information of the third light emitting unit sensed when the additional light is emitted.