WO2023113201A1

WO2023113201A1 - Electronic device and control method therefor

Info

Publication number: WO2023113201A1
Application number: PCT/KR2022/016225
Authority: WO
Inventors: 김형철; 이태영; 채성호
Original assignee: 삼성전자주식회사
Priority date: 2021-12-17
Filing date: 2022-10-24
Publication date: 2023-06-22

Abstract

The present electronic device comprises: a projection unit; a first sensor unit; a second sensor unit; and a processor, which acquires state information about the electronic device on the basis of sensing data acquired through the first sensor unit, acquires state information about a projection surface on the basis of the sensing data acquired through the second sensor unit, corrects a projection image on the basis of the state information about the electronic device and the state information about the projection surface, and controls the projection unit so that the corrected projection image is output onto the projection surface.

Description

Electronic device and its control method

The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device outputting a corrected projection image on a projection surface and a control method thereof.

When an electronic device performing a projection function outputs a projected image, the electronic device may correct the projected image according to the arrangement of the electronic device and the projection direction toward the projection surface and finally output the projected image.

Here, a representative example of correcting an image may include keystone correction. Keystone correction may refer to an operation of correcting a trapezoidal image into a rectangular shape. Specifically, whether or not keystone correction is necessary may be determined according to a direction in which the electronic device projects toward the projection surface. The function for automatically performing keystone correction may be a keystone correction function.

However, there may occur a case in which a leveling correction function is required in addition to keystone correction. Leveling may refer to an operation of rotating an image based on a direction in which the projection surface is viewed.

Here, when the image is corrected by considering only the tilt (or state) of the electronic device, there is a problem in that distortion caused by rotation of the projection surface cannot be corrected.

In addition, conversely, when an image is corrected by considering only the inclination (or state) of the projection surface, distortion caused by rotation of the electronic device itself cannot be corrected.

If distortion exists despite automatically performing the keystone correction function or the leveling correction function, it is inconvenient for the user to directly manipulate the detailed correction operation.

The present disclosure has been devised to improve the above problems, and an object of the present disclosure is an electronic device that corrects an image based on state information of the electronic device and state information of the projection surface and outputs the corrected image to the projection surface, and control thereof. in providing a way.

An electronic device according to the present embodiment for achieving the above object obtains state information of the electronic device based on sensing data acquired through a projection unit, a first sensor unit, a second sensor unit, and the first sensor unit, and , Obtain state information of the projection surface based on sensing data obtained through the second sensor unit, correct a projection image based on the state information of the electronic device and the state information of the projection surface, and correct the projected image. and a processor controlling the projection unit to output ? to the projection surface.

Meanwhile, the state information of the electronic device includes x-axis rotation information and y-axis rotation information of the electronic device, and the state information of the projection surface includes y-axis rotation information of the projection surface and It may include z-axis rotation information.

Meanwhile, the processor levels and corrects the projected image based on x-axis rotation information of the electronic device, y-axis rotation information of the electronic device, y-axis rotation information of the projection surface, and z-axis rotation information of the projection surface Based on the keystone correction of the projected image.

Meanwhile, the second sensor unit includes a first distance sensor and a second distance sensor, and the processor determines the first distance and the second distance between the first distance sensor and the projection surface obtained from the first distance sensor. State information of the projection surface may be obtained based on a second distance obtained from a sensor and a second distance between the second distance sensor and the projection surface.

Meanwhile, the second sensor unit further includes a third distance sensor, and the processor determines z of the projection surface based on a first distance obtained from the first distance sensor and a second distance obtained from the second distance sensor. Obtain axis rotation information, and based on at least one of the first distance and the second distance and a third distance between the third distance sensor and the projection surface obtained from the third distance sensor, the projection surface y-axis rotation information of can be obtained.

Meanwhile, the processor identifies a projection area on the projection surface where the projection image is projected, obtains a fourth distance between the first distance sensor and a position corresponding to the projection area from the first distance sensor, and A fifth distance between the second distance sensor and a position corresponding to the projection area may be acquired from a second distance sensor, and a focus of the electronic device may be determined based on the fourth distance and the fifth distance.

Meanwhile, the processor determines the focus of the electronic device by identifying a distance sensor corresponding to a smaller distance among the fourth distance and the fifth distance and assigning a higher weight to sensing data obtained from the identified distance sensor. and output the corrected projection image to the projection surface based on the determined focus of the electronic device.

Meanwhile, the projection unit includes a projection lens, and when a lens shift function is performed with respect to the projection lens, the processor moves the second sensor unit based on movement information corresponding to the lens shift function. can

Meanwhile, the processor obtains a projection distance between the electronic device and the projection surface through the second sensor unit, determines a ratio of the corrected projection image based on the obtained projection distance, and determines a ratio of the corrected projection image based on the determined ratio. The projection unit may be controlled to output the corrected projection image to the projection surface.

Meanwhile, the first sensor unit may include at least one of a gravity sensor, an acceleration sensor, and a gyro sensor, and the second sensor unit may include at least one ToF sensor.

A control method of an electronic device including a first sensor unit and a second sensor unit according to the present embodiment includes obtaining state information of the electronic device based on sensing data acquired through the first sensor unit and the second sensor unit. Obtaining state information of the projection surface based on sensing data acquired through a unit, correcting a projection image based on the state information of the electronic device and the state information of the projection surface, and converting the corrected projection image to the projection surface. It includes the step of outputting to the slope.

Meanwhile, the correcting of the projected image may include leveling and correcting the projected image based on x-axis rotation information of the electronic device, y-axis rotation information of the electronic device, y-axis rotation information of the projection surface, and the projection surface The projected image may be keystone-corrected based on z-axis rotation information of .

Meanwhile, the second sensor unit includes a first distance sensor and a second distance sensor, and the obtaining of the state information of the projection surface is between the first distance sensor obtained from the first distance sensor and the projection surface. State information of the projection surface may be obtained based on a first distance and a second distance between the second distance sensor and the projection surface obtained from the second distance sensor.

Meanwhile, the second sensor unit further includes a third distance sensor, and the obtaining of state information of the projection surface includes a first distance obtained from the first distance sensor and a second distance obtained from the second distance sensor. Obtain z-axis rotation information of the projection surface based on, and obtain a distance between at least one of the first distance and the second distance and the third distance sensor and the projection surface obtained from the third distance sensor. 3 It is possible to obtain y-axis rotation information of the projection surface based on the distance.

Meanwhile, the control method includes identifying a projection area where the projection image is projected on the projection surface, obtaining a fourth distance between the first distance sensor and a position corresponding to the projection area from the first distance sensor. Obtaining a fifth distance between the second distance sensor and a position corresponding to the projection area from the second distance sensor, and determining a focus of the electronic device based on the fourth distance and the fifth distance. It may further include steps to do.

Meanwhile, the determining of the focus may include identifying a distance sensor corresponding to a smaller distance among the fourth distance and the fifth distance, and assigning a higher weight to sensing data acquired from the identified distance sensor to determine the electronic device. Determining a focus of and outputting the projection image may include outputting the corrected projection image to the projection surface based on the determined focus of the electronic device.

Meanwhile, the control method may further include moving the second sensor unit based on movement information corresponding to the lens shift function when performing a lens shift function with respect to the projection lens of the electronic device. can

Meanwhile, the control method may include obtaining a projection distance between the electronic device and the projection surface through the second sensor unit, determining a ratio of the corrected projection image based on the obtained projection distance, and The method may further include outputting the corrected projection image to the projection surface based on the ratio.

1 is a perspective view illustrating an external appearance of an electronic device according to an embodiment of the present disclosure.

2 is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure.

FIG. 3 is a block diagram showing the configuration of the electronic device of FIG. 2 in detail.

4 is a perspective view illustrating an external appearance of an electronic device according to other embodiments of the present disclosure.

5 is a perspective view illustrating an external appearance of an electronic device according to another embodiment of the present disclosure.

6 is a perspective view illustrating an external appearance of an electronic device according to another embodiment of the present disclosure.

7 is a perspective view illustrating an external appearance of an electronic device according to another embodiment of the present disclosure.

8 is a perspective view illustrating a state in which the electronic device of FIG. 7 is rotated.

9 is a flowchart illustrating an operation of correcting a projected image using state information of an electronic device and state information of a projection surface.

10 is a diagram for explaining z-axis rotation information of an electronic device.

11 is a diagram for explaining y-axis rotation information of an electronic device.

12 is a diagram for explaining x-axis rotation information of an electronic device.

13 is a diagram for explaining rotation information of an electronic device.

14 is a flowchart illustrating an operation of correcting a projected image based on rotation information of an electronic device.

15 is a diagram for explaining rotation information of the projection surface.

16 is a diagram for explaining z-axis rotation information of a projection surface.

17 is a flowchart illustrating an operation of correcting a projected image based on z-axis rotation information of a projection surface.

18 is a diagram for explaining an operation of obtaining z-axis rotation information of a projection surface.

19 is a view for explaining the light receiving unit of the second sensor unit.

20 is a diagram for explaining y-axis rotation information of a projection surface.

21 is a flowchart illustrating an operation of correcting a projected image based on y-axis rotation information of a projection surface.

22 is a diagram for explaining an operation of obtaining y-axis rotation information of a projection surface.

23 is a table for explaining whether leveling correction or keystone correction is performed based on state information of an electronic device and state information of a projection surface.

24 is a flowchart for explaining whether leveling correction or keystone correction is performed based on state information of an electronic device and state information of a projection surface.

25 is a diagram for explaining a second sensor unit according to various embodiments.

26 is a diagram for explaining an offset of a projection lens.

27 is a flowchart illustrating an operation of outputting a projected image in consideration of a ratio of the projected image.

28 is a diagram for explaining an operation of outputting a projection image in consideration of a projection distance.

29 is a view for explaining the arrangement of the first distance sensor and the second distance sensor included in the second sensor unit.

30 is a diagram for explaining an operation of outputting a projection image in a state in which the projection surface is not rotated along the z-axis.

31 is a diagram for explaining the reason for correcting a projection image in consideration of state information of the projection surface in a state in which the projection surface is rotated along the z-axis.

32 is a diagram for explaining an operation of correcting a projected image in a state in which the projection surface is not rotated along the y-axis.

33 is a diagram for explaining the reason for correcting a projection image in consideration of state information of the projection surface in a state in which the projection surface is rotated along the y-axis.

34 is a flowchart for explaining an operation of determining a focus based on a distance between a projection area and a distance sensor.

35 is a diagram for explaining an operation of determining a focus based on a distance between a projection area and a distance sensor.

36 is a flowchart illustrating an operation of determining a focus by assigning a weight to a distance between a projection area and a distance sensor.

37 is a diagram for explaining an operation of determining a focus by assigning a weight to a distance between a projection area and a distance sensor.

38 is a diagram for explaining an operation of determining a focus based on a distance between a projection area and a distance sensor in a state in which the projection surface is rotated along the z-axis.

39 is a flowchart for explaining an operation of controlling the second sensor unit according to whether a lens shift function is performed.

40 is a diagram for explaining an operation of controlling the second sensor unit according to the lens shift function.

41 is a flowchart for explaining an operation of correcting a projection image based on x-axis rotation information of a projection surface.

42 is a diagram for explaining an operation of correcting a projection image based on x-axis rotation information of a projection surface.

43 is a flowchart illustrating a method of controlling an electronic device according to an exemplary embodiment.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

The terms used in the embodiments of the present disclosure have been selected from general terms that are currently widely used as much as possible while considering the functions in the present disclosure, but they may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technologies, and the like. . In addition, in a specific case, there is also a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the disclosure. Therefore, terms used in the present disclosure should be defined based on the meaning of the term and the general content of the present disclosure, not simply the name of the term.

In this specification, expressions such as “has,” “can have,” “includes,” or “can include” indicate the existence of a corresponding feature (eg, numerical value, function, operation, or component such as a part). , which does not preclude the existence of additional features.

The expression at least one of A and/or B should be understood to denote either "A" or "B" or "A and B".

Expressions such as "first," "second," "first," or "second," as used herein, may modify various components regardless of order and/or importance, and may refer to one component It is used only to distinguish it from other components and does not limit the corresponding components.

A component (e.g., a first component) is "(operatively or communicatively) coupled with/to" another component (e.g., a second component); When referred to as "connected to", it should be understood that an element may be directly connected to another element, or may be connected through another element (eg, a third element).

Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "comprise" or "consist of" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other It should be understood that the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof is not precluded.

In the present disclosure, a “module” or “unit” performs at least one function or operation, and may be implemented in hardware or software or a combination of hardware and software. In addition, a plurality of "modules" or a plurality of "units" are integrated into at least one module and implemented by at least one processor (not shown), except for "modules" or "units" that need to be implemented with specific hardware. It can be.

In this specification, the term user may refer to a person using an electronic device or a device (eg, an artificial intelligence electronic device) using an electronic device.

Hereinafter, an embodiment of the present disclosure will be described in more detail with reference to the accompanying drawings.

1 is a perspective view illustrating an external appearance of an electronic device 100 according to an embodiment of the present disclosure.

Referring to FIG. 1 , the electronic device 100 may include a head 103, a body 105, a projection lens 110, a connector 130, or a cover 107.

The electronic device 100 may be a device of various types. In particular, the electronic device 100 may be a projector device that enlarges and projects an image onto a wall or a screen, and the projector device may be an LCD projector or a digital light processing (DLP) projector using a digital micromirror device (DMD). .

In addition, the electronic device 100 may be a home or industrial display device, or a lighting device used in daily life, a sound device including a sound module, a portable communication device (eg, a smartphone), It may be implemented as a computer device, a portable multimedia device, a wearable device, or a home appliance. Meanwhile, the electronic device 100 according to an embodiment of the present disclosure is not limited to the above-described devices, and the electronic device 100 may be implemented as an electronic device 100 having two or more functions of the above-described devices. For example, the electronic device 100 may be used as a display device, a lighting device, or a sound device by turning off a projector function and turning on a lighting function or a speaker function according to manipulation of a processor, and AI including a microphone or communication device. Can be used as a speaker.

The main body 105 is a housing forming an exterior, and may support or protect components (eg, the components shown in FIG. 3 ) of the electronic device 100 disposed inside the main body 105 . The body 105 may have a structure close to a cylindrical shape as shown in FIG. 1 . However, the shape of the main body 105 is not limited thereto, and according to various embodiments of the present disclosure, the main body 105 may be implemented in various geometric shapes such as a column, a cone, and a sphere having a polygonal cross section.

The size of the main body 105 may be a size that a user can hold or move with one hand, may be implemented in a very small size for easy portability, and may be implemented in a size that can be placed on a table or coupled to a lighting device.

The material of the main body 105 may be implemented with matte metal or synthetic resin so as not to be stained with user's fingerprints or dust, or the exterior of the main body 105 may be made of a smooth gloss.

A friction area may be formed on a portion of the exterior of the body 105 so that a user can grip and move the main body 105 . Alternatively, the main body 105 may be provided with a bent gripping portion or a support 108a (see FIG. 4 ) that the user can grip in at least a portion of the area.

The projection lens 110 is formed on one surface of the main body 105 to project light passing through the lens array to the outside of the main body 105 . The projection lens 110 of various embodiments may be an optical lens coated with low dispersion in order to reduce chromatic aberration. The projection lens 110 may be a convex lens or a condensing lens, and the projection lens 110 according to an embodiment may adjust the focus by adjusting the positions of a plurality of sub-lenses.

The head 103 is provided to be coupled to one surface of the main body 105 to support and protect the projection lens 110 . The head 103 may be coupled to the main body 105 so as to be swivelable within a predetermined angular range based on one surface of the main body 105 .

The head 103 is automatically or manually swiveled by a user or a processor to freely adjust the projection angle of the projection lens 110 . Alternatively, although not shown in the drawings, the head 103 is coupled to the main body 105 and includes a neck extending from the main body 105, so that the head 103 is tilted or tilted to adjust the projection angle of the projection lens 110. can be adjusted

The electronic device 100 adjusts the direction of the head 103 and adjusts the emission angle of the projection lens 110 while the position and angle of the main body 105 are fixed, so that light or an image can be projected to a desired location. there is. In addition, the head 103 may include a handle that the user can grasp after rotating in a desired direction.

A plurality of openings may be formed on the outer circumferential surface of the main body 105 . Audio output from the audio output unit may be output to the outside of the main body 105 of the electronic device 100 through the plurality of openings. The audio output unit may include a speaker, and the speaker may be used for general purposes such as multimedia playback, recording playback, and audio output.

According to an embodiment of the present disclosure, a heat dissipation fan (not shown) may be provided inside the main body 105, and when the heat dissipation fan (not shown) is driven, air or heat inside the main body 105 passes through a plurality of openings. can emit. Therefore, the electronic device 100 can discharge heat generated by driving the electronic device 100 to the outside and prevent the electronic device 100 from overheating.

The connector 130 may connect the electronic device 100 to an external device to transmit/receive electrical signals or receive power from the outside. According to an embodiment of the present disclosure, the connector 130 may be physically connected to an external device. At this time, the connector 130 may include an input/output interface, and may communicate with an external device through wired or wireless communication or receive power. For example, the connector 130 may include an HDMI connection terminal, a USB connection terminal, an SD card receiving groove, an audio connection terminal, or a power outlet, or may include Bluetooth, Wi-Fi, or wireless connection to an external device wirelessly. A charging connection module may be included.

In addition, the connector 130 may have a socket structure connected to an external lighting device, and may be connected to a socket receiving groove of the external lighting device to receive power. The size and standard of the connector 130 having a socket structure may be variously implemented in consideration of a receiving structure of a coupleable external device. For example, according to the international standard E26, the diameter of the junction of the connector 130 may be implemented as 26 mm, and in this case, the electronic device 100 replaces a conventionally used light bulb and an external lighting device such as a stand. can be coupled to Meanwhile, when fastened to a socket located on an existing ceiling, the electronic device 100 is projected from top to bottom, and when the electronic device 100 is not rotated by coupling the socket, the screen cannot be rotated either. Accordingly, the electronic device 100 is socket-coupled to the ceiling stand so that the electronic device 100 can rotate even when the socket is coupled and power is supplied, and the head 103 is moved from one side of the main body 105. It swivels and adjusts the emission angle to project the screen to a desired position or rotate the screen.

The connector 130 may include a coupling sensor, and the coupling sensor may sense whether or not the connector 130 is coupled with an external device, a coupling state, or a coupling target, and transmit the sensor to the processor, based on the received detection value. Driving of the electronic device 100 may be controlled.

The cover 107 can be coupled to and separated from the main body 105 and can protect the connector 130 so that the connector 130 is not constantly exposed to the outside. The shape of the cover 107 may have a shape continuous with the body 105 as shown in FIG. 1, or may be implemented to correspond to the shape of the connector 130. The cover 107 can support the electronic device 100, and the electronic device 100 can be used by being coupled to the cover 107 and coupled to or mounted on an external cradle.

In the electronic device 100 according to various embodiments, a battery may be provided inside the cover 107 . A battery may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell or a fuel cell.

Although not shown in the drawings, the electronic device 100 may include a camera module, and the camera module may capture still images and moving images. According to one embodiment, the camera module may include one or more lenses, image sensors, image signal processors, or flashes.

Although not shown in the drawings, the electronic device 100 may include a protective case (not shown) to protect the electronic device 100 and easily carry it, or a stand supporting or fixing the main body 105. (not shown), and may include a bracket (not shown) coupled to a wall or partition.

In addition, the electronic device 100 may provide various functions by being connected to various external devices using a socket structure. As an example, the electronic device 100 may be connected to an external camera device using a socket structure. The electronic device 100 may use the projection unit 111 to provide an image stored in a connected camera device or an image currently being captured. As another embodiment, the electronic device 100 may be connected to a battery module to receive power using a socket structure. Meanwhile, the electronic device 100 may be connected to an external device using a socket structure, but this is merely an example, and may be connected to an external device using another interface (eg, USB, etc.).

2 is a block diagram illustrating a configuration of an electronic device 100 according to an embodiment of the present disclosure.

Referring to FIG. 2 , the electronic device 100 may include a projection unit 111 , a sensor unit 113 and a processor 114 .

The projection unit 111 may output an image to be output from the electronic device 100 to the projection surface. The projection unit 111 may include a projection lens 110 .

The projection unit 111 may perform a function of outputting an image on a projection surface. A detailed description related to the projection unit 111 is described in FIG. 3 . Here, although described as a projection unit, the electronic device 100 may project images in various ways. Here, the projection unit 111 may include a projection lens 110 . Here, the projection surface may be a part of a physical space on which an image is output or a separate screen.

Here, the sensor unit 113 may include at least one of the first sensor unit 113-1 and the second sensor unit 113-2. Here, the first sensor unit 113 - 1 may mean a sensor unit that obtains sensing data for analyzing state information of the electronic device 100 . Here, the second sensor unit 113 - 2 may mean a sensor unit that obtains sensing data for analyzing state information of the projection surface 10 .

The processor 114 may perform overall control operations of the electronic device 100 . Specifically, the processor 114 functions to control the overall operation of the electronic device 100 .

Here, the keystone correction function may be performed according to various methods.

According to an embodiment, the processor 114 may automatically perform a keystone correction function. Specifically, the processor 114 may automatically perform a keystone correction function based on the obtained state information. When the keystone correction function is performed automatically, the keystone correction function may be described as an auto-keystone function.

According to another embodiment, the keystone correction function may be performed manually. Specifically, the processor 114 may perform a keystone correction function according to a user's input or user's manipulation. For example, the user may use the keystone correction function to make the projected image rectangular by manipulating the electronic device 100 while viewing the projected image on the projection surface.

Here, the keystone correction function may be a function to solve a problem that a trapezoidal image is output on the projection surface due to the inclination of the electronic device 100 . Here, the keystone correction function may be a function of correcting an image so that a trapezoidal image output on the projection surface is output as a rectangular or square image. The keystone correction function may be described as keystone correction. Depending on the direction of keystone correction, it can be divided into left and right keystone correction or up and down keystone correction.

Meanwhile, the leveling correction function may be performed according to various methods.

According to an embodiment, the processor 114 may automatically perform a leveling correction function. Specifically, the processor 114 may automatically perform a leveling correction function based on the obtained state information. When the leveling correction function is performed automatically, the leveling correction function may be described as an auto-leveling function.

According to another embodiment, the leveling correction function may be performed manually. Specifically, the processor 114 may perform a leveling correction function according to a user's input or user's manipulation. For example, the user may use the leveling correction function to rotate the projected image by manipulating the electronic device 100 while viewing the projected image on the projection surface.

Here, the leveling correction function may mean a function of rotating an image. Specifically, the processor 114 may control the projected image to be output by rotating the image by a specific angle using a leveling correction function.

According to an embodiment, the processor 114 may perform a leveling correction function using software. The processor 114 may correct the image so that the rotated image is output using the leveling correction function. Also, the processor 114 may control the projection unit 111 to output the rotated image.

According to another embodiment, the processor 114 may perform a leveling correction function using hardware. The processor 114 may rotate the image by rotating the projection lens 110 included in the projection unit 111 . Also, the processor 114 may rotate an image by controlling a fixing member included in the electronic device 100 . Here, the fixing member may refer to a member that contacts a specific surface so that the electronic device 100 can be fixed. The processor 114 may rotate or adjust the length of the fixing member to control an image to be rotated and output.

Also, the processor 114 may obtain a final projection image by performing at least one of a keystone correction function and a leveling correction function, and control the projection unit 111 to output the final projection image to the projection surface.

Here, since the projection image is output after at least one of the keystone correction function and the leveling correction function is performed, the electronic device 100 can provide a projection image suitable for the user.

Meanwhile, the processor 114 may provide a projected image according to various methods.

According to an embodiment, the processor 114 may output a corrected projection image after at least one of a keystone correction function and a leveling correction function is performed.

According to another embodiment, the processor 114 outputs an original projected image before the keystone correction function and the leveling correction function are performed, and outputs the corrected projected image after at least one of the keystone correction function and the leveling correction function is performed. can be printed out.

The electronic device 100 may include a sensor unit 113, and the sensor unit 113 may include a first sensor unit 113-1 and a second sensor unit 113-2.

Here, the first sensor unit 113 - 1 may include at least one sensor for sensing the state of the electronic device 100 . Here, the state of the electronic device 100 may mean a tilt or rotation angle. That is, the first sensor unit 113 - 1 may include a sensor for measuring an inclination of the electronic device 100 or a rotation angle of the electronic device 100 . For example, the first sensor unit 113-1 may include at least one of a gravity sensor, an acceleration sensor, and a gyro sensor.

Here, the second sensor unit 113 - 2 may include at least one sensor for sensing the state of the projection surface 10 . Here, the state of the projection surface 10 may mean a tilt or rotation angle. That is, the second sensor unit 113 - 2 may include a sensor for measuring an inclination of the projection surface 10 or a rotation angle of the projection surface 10 . The second sensor unit 113 - 2 may include a distance sensor for measuring a distance to the projection surface 10 . For example, the second sensor unit 113-2 may include at least one Time of Flight (ToF) sensor.

Meanwhile, the processor 114 acquires state information of the electronic device 100 based on the sensing data obtained through the first sensor unit 113-1, and obtains state information obtained through the second sensor unit 113-2. Acquiring state information of the projection surface 10 based on the sensing data, correcting the projected image based on the state information of the electronic device 100 and the state information of the projection surface 10, and converting the corrected projection image to the projection surface The projection unit 111 can be controlled to output to (10).

Here, the state information of the electronic device 100 may include an inclination of the electronic device 100 or a rotation angle of the electronic device 100 . Specifically, the state information of the electronic device 100 may include at least one of x-axis rotation information, y-axis rotation information, and z-axis rotation information of the electronic device 100 of the electronic device 100. can A detailed description related to this is described in FIGS. 10 to 13 . A description related to the x-axis rotation information of the electronic device 100 will be described in FIG. 12 . A description related to the y-axis rotation information of the electronic device 100 will be described in FIG. 11 . A description related to z-axis rotation information of the electronic device 100 is described in FIG. 10 .

Here, the state information of the projection surface 10 may include a tilt of the projection surface 10 or a rotation angle of the electronic device 100 . Specifically, the state information of the projection surface 10 may include at least one of x-axis rotation information of the projection surface 10, y-axis rotation information of the projection surface 10, or z-axis rotation information of the projection surface 10. can A detailed description related to this is described in FIG. 15 . A description related to the x-axis rotation information of the projection surface 10 will be described in FIGS. 41 and 42 . Descriptions related to the y-axis rotation information of the projection surface 10 will be described in FIGS. 20 to 22 . A description related to z-axis rotation information of the projection surface 10 will be described in FIGS. 16 to 18 .

Here, the x-axis may be described as a first axis, the y-axis as a second axis, and the z-axis as a third axis.

Here, the processor 114 may correct the projected image based on at least one of state information of the electronic device 100 and state information of the projection surface 10 .

Here, the operation of correcting the projected image may include at least one of a leveling correction operation and a keystone correction operation. A description related to the correction operation is described in FIGS. 23 and 24 .

Here, after an operation of correcting the projection image is performed, the processor 114 may control the projection unit 111 to output the corrected projection image to the projection surface 10 .

Meanwhile, the state information of the electronic device 100 may include x-axis rotation information and y-axis rotation information of the electronic device 100, and the state information of the projection surface 10 is the projection surface ( 10) may include y-axis rotation information and z-axis rotation information of the projection surface 10.

According to various embodiments, rotation information included in state information of the electronic device 100 may be different.

According to an embodiment, the state information of the electronic device 100 may include x-axis rotation information and y-axis rotation information of the electronic device 100 . The processor 114 may identify how much the electronic device 100 is rotated in the x-axis and the y-axis based on the sensing data obtained through the first sensor unit 113-1. The z-axis rotation information of the electronic device 100 may indicate which direction the electronic device 100 faces among north, south, east and west. However, since the user places the electronic device 100 on the projection surface 10 as a result, z-axis rotation information of the electronic device 100 may be unnecessary. Accordingly, the processor 114 may perform a correction operation using the z-axis rotation information of the projection surface 10 instead of the z-axis rotation information of the electronic device 100 .

According to another embodiment, the state information of the electronic device 100 may include x-axis rotation information of the electronic device 100, y-axis rotation information of the electronic device 100, and z-axis rotation information of the electronic device 100. can Here, the processor 114 may obtain z-axis rotation information of the electronic device 100 through a geomagnetic sensor or the like. Here, the geomagnetic sensor may be implemented in a form included in the first sensor unit 113-1 or included in a separate third sensor unit (not shown).

According to various embodiments, rotation information included in state information of the projection surface 10 may be different.

According to an embodiment, the state information of the projection surface 10 may include y-axis rotation information and z-axis rotation information of the projection surface 10 . The processor 114 may identify how much the projection surface 10 is rotated in the y-axis and z-axis based on the sensing data acquired through the second sensor unit 113-2. The x-axis rotation information of the projection surface 10 may represent the degree of horizontal tilt of the left and right in the direction in which the electronic device 100 views the projection surface 10 . However, in general, there may not be much possibility of a situation where the projection surface 10 is tilted. Accordingly, the second sensor unit 113 - 2 may not identify the x-axis rotation information of the projection surface 10 in order to reduce processing time and increase data processing efficiency.

According to another embodiment, the state information of the projection surface 10 may include x-axis rotation information of the projection surface 10, y-axis rotation information of the projection surface 10, and z-axis rotation information of the projection surface 10. can In an unusual situation, there is a possibility that the left and right horizontality of the projection surface 10 is tilted. Accordingly, the processor 114 may obtain a captured image including a test image (or projection image) output through a camera (not shown). Also, the processor 114 may obtain x-axis rotation information of the projection surface 10 based on the captured image. A description related to this is described in FIGS. 41 and 42 .

Meanwhile, the processor 114 levels and corrects the projected image based on the x-axis rotation information of the electronic device 100, and generates the y-axis rotation information of the electronic device 100, the y-axis rotation information of the projection surface 10 and the projection image. The projected image may be keystone corrected based on the z-axis rotation information of the slope 10 .

When the electronic device 100 is rotated along the x-axis, the processor 114 may perform leveling correction by rotating the projected image clockwise or counterclockwise.

When the electronic device 100 is rotated along the y-axis, the processor 114 may perform keystone correction (vertical keystone correction or up/down keystone correction) to remove distortion in the vertical direction of the projected image.

When the projection surface 10 is rotated along the y-axis, the processor 114 may perform keystone correction (vertical keystone correction or up/down keystone correction) to remove distortion generated in the vertical direction of the projected image.

When the projection surface 10 is rotated in the z-axis, the processor 114 may perform keystone correction (horizontal keystone correction or left and right keystone correction) to remove distortion generated in the horizontal direction of the projected image.

Descriptions related to this are described in FIGS. 23 and 24 .

Meanwhile, the second sensor unit 113-2 includes a first distance sensor 113-2-1 and a second distance sensor 113-2-2, and the processor 114 includes the first distance sensor 113 -2-1) between the first distance sensor 113-2-1 and the projection surface 10 (d1) and the second distance obtained from the second distance sensor (113-2-2) (113-2-2) State information of the projection surface 10 may be obtained based on the second distance d2 between the distance sensor 113-2-2 and the projection surface 10 .

Here, the processor 114 may obtain first sensing data through the first distance sensor 113-2-1. The processor 114 may obtain a first distance d1 between the first distance sensor 113-2-1 and the projection surface 10 based on the first sensing data.

Here, the processor 114 may acquire second sensing data through the second distance sensor 113-2-2. The processor 114 may obtain a second distance d2 between the second distance sensor 113-2-2 and the projection surface 10 based on the second sensing data.

Also, the processor 114 may obtain state information of the projection surface 10 based on the first distance d1 and the second distance d2. A detailed description related to this is described in FIGS. 16 to 22.

Meanwhile, the second sensor unit 113-2 may further include a third distance sensor 113-2-3, and the processor 114 may obtain the first distance sensor 113-2-1. Z-axis rotation information of the projection surface 10 is obtained based on the first distance d1 and the second distance d2 obtained from the second distance sensor 113-2-2, and the first distance or the second distance based on at least one of the distances and the third distance d3 between the third distance sensor 113-2-3 and the projection surface 10 obtained from the third distance sensor 113-2-3 The y-axis rotation information of (10) can be obtained.

Here, the processor 114 may obtain z-axis rotation information of the projection surface 10 based on the first distance d1 and the second distance d2.

Here, the processor 114 may obtain third sensing data from the third distance sensor 113-2-3. The processor 114 may obtain a third distance d3 between the third distance sensor 113-2-3 and the projection surface 10 based on the third sensing data.

Also, the processor 114 may obtain y-axis rotation information of the projection surface 10 based on the first distance d1 and the third distance d3. According to another embodiment, the processor 114 may obtain y-axis rotation information of the projection surface 10 based on the second distance d2 and the third distance d3.

An operation of obtaining z-axis rotation information of the projection surface 10 is described in FIGS. 16 to 19 .

An operation of obtaining y-axis rotation information of the projection surface 10 is described in FIGS. 20 to 22 .

On the other hand, in order to obtain the y-axis rotation information and the z-axis rotation information of the projection surface 10, the first distance sensor 113-2-1 instead of the third distance sensor 113-2-3 ) and the second distance sensor 113-2-2 can be used. A related arrangement structure may be the same as that of the electronic device 100 - 2 of FIG. 25 . As in the electronic device 100-2 of FIG. 25, the two distance sensors may be disposed differently in both horizontal and vertical positions. Here, the electronic device 100 - 2 may acquire both y-axis rotation information and z-axis rotation information of the projection surface 10 through two distance sensors.

Meanwhile, the processor 114 identifies a projection area where a projection image is projected on the projection surface 10, and connects the first distance sensor 113-2-1 to the projection area from the first distance sensor 113-2-1. A fourth distance d4 between positions corresponding to is obtained, and a fifth distance d4 between the second distance sensor 113-2-2 and a position corresponding to the projection area is obtained from the second distance sensor 113-2-2. The distance d5 may be obtained, and the focus of the electronic device 100 may be determined based on the fourth distance d4 and the fifth distance d5.

Here, the focal point of the electronic device 100 may mean a focal point corresponding to a projection image output from the projection lens 110 . The focal point of the electronic device 100 may be described as a focal point of the projection lens 110 or a projection focal point.

Specific operations related to this are described in FIGS. 34 to 35 .

Meanwhile, the processor 114 identifies a distance sensor corresponding to a smaller distance between the fourth distance d4 and the fifth distance d5, and assigns a higher weight to sensing data obtained from the identified distance sensor, so that the electronic device A focal point of 100 may be determined and a corrected projection image based on the determined focal point of the electronic device may be output to the projection surface 10 .

Specific operations related to this are described in FIGS. 36 and 37 .

Meanwhile, when the projection unit 111 includes the projection lens 110 and the processor 114 performs a lens shift function with respect to the projection lens 110, movement information corresponding to the lens shift function Based on this, the second sensor unit 113-2 can be moved.

Here, the lens shift function may indicate a function of changing (or shifting) an image projection direction of the projection lens 110 . Here, the movement information may include at least one of coordinate information and direction information used to change the projection direction of the image.

Here, the coordinate information may include absolute coordinates in a 3-dimensional (or 2-dimensional) space. The processor 114 may move the projection lens 110 based on the coordinate information. Also, the processor 114 may change the projection direction of the projection lens 110 based on the coordinate information.

Here, the direction information may include a distance value moving up, down, left, or right. The processor 114 may move the projection lens 110 based on the direction information. Also, the processor 114 may change the projection direction of the projection lens 110 based on the direction information.

Specific operations related to this are described in FIGS. 39 to 40 .

Meanwhile, the processor 114 obtains the projection distance between the electronic device 100 and the projection surface 10 through the second sensor unit 113-2, and the ratio of the corrected projection image based on the acquired projection distance. may be determined, and the projection unit 111 may be controlled to output a corrected projection image to the projection surface 10 based on the determined ratio.

Here, the projection distance is the first distance d1 between the first distance sensor 113-2-1 and the projection surface 10 or the distance between the second distance sensor 113-2-2 and the projection surface 10. It may be obtained based on at least one of the two distances d2.

According to an embodiment, the processor 114 may determine the projection distance as one of the first distance d1 and the second distance d2.

According to another embodiment, the processor 114 may determine the projection distance using both the first distance d1 and the second distance d2. For example, the processor 114 may determine the projection distance as an average value of the first distance d1 and the second distance d2.

Specific operations related to this are described in FIGS. 27 to 28 .

Meanwhile, the electronic device 100 according to various embodiments may perform an image correction operation in consideration of both the rotated state of the electronic device 100 and the rotated state of the projection surface 10 . Therefore, there is no distortion or rotation that causes user discomfort in the projected image output on the projection surface 10 . Accordingly, the electronic device 100 can minimize situations in which a user manually performs an image correction function.

FIG. 3 is a block diagram showing the configuration of the electronic device 100 of FIG. 2 in detail.

Referring to FIG. 3 , the electronic device 100 includes a projection unit 111, a memory 112, a sensor unit 113, a processor 114, a user interface 115, an input/output interface 116, an audio output unit ( 117), a power supply unit 118, and a shutter unit 120. Meanwhile, the configuration shown in FIG. 3 is merely an embodiment, and some configurations may be omitted and new configurations may be added.

Meanwhile, the contents already described in FIG. 2 are omitted.

The projection unit 111 is a component that projects an image to the outside. According to an embodiment of the present disclosure, the projection unit 111 may use various projection methods (eg, a cathode-ray tube (CRT) method, a liquid crystal display (LCD) method, a digital light processing (DLP) method, and a laser method). etc.) can be implemented. As an example, the principle of the CRT method is basically the same as that of a CRT monitor. The CRT method enlarges the image with a lens in front of the cathode ray tube (CRT) and displays the image on the screen. Depending on the number of cathode ray tubes, it is divided into a 1-tube type and a 3-tube type, and in the case of a 3-tube type, red, green, and blue cathode ray tubes can be separately implemented.

As another example, the LCD method is a method of displaying an image by transmitting light from a light source through a liquid crystal. The LCD method is divided into a single-panel type and a three-panel type. In the case of the three-panel type, the light from the light source is separated into red, green, and blue by a dichroic mirror (a mirror that reflects only light of a specific color and passes the rest) and transmits the liquid crystal. After that, the light can gather in one place again.

As another example, the DLP method is a method of displaying an image using a DMD (Digital Micromirror Device) chip. The projection unit of the DLP method may include a light source, a color wheel, a DMD chip, a projection lens, and the like. Light output from a light source may exhibit a color while passing through a rotating color wheel. The light that passed through the color wheel is input to the DMD chip. The DMD chip includes numerous micromirrors and reflects light input to the DMD chip. The projection lens may play a role of enlarging light reflected from the DMD chip to an image size.

As another example, the laser method includes a diode pumped solid state (DPSS) laser and a galvanometer. For lasers that output various colors, three DPSS lasers are installed for each RGB color, and then lasers with optical axes overlapped using special mirrors are used. The galvanometer includes a mirror and a high power motor to move the mirror at high speed. For example, a galvanometer can rotate a mirror at up to 40 KHz/sec. The galvanometer is mounted according to the scanning direction. In general, since the projector scans in a plane, the galvanometer can also be arranged separately in the x and y axes.

Meanwhile, the projection unit 111 may include various types of light sources. For example, the projection unit 111 may include at least one light source among a lamp, LED, and laser.

The projection unit 111 may output an image in a 4:3 aspect ratio, a 5:4 aspect ratio, or a 16:9 wide aspect ratio according to the purpose of the electronic device 100 or the user's settings, and may output an image in a WVGA (854*480) aspect ratio depending on the aspect ratio. ), SVGA(800*600), XGA(1024*768), WXGA(1280*720), WXGA(1280*800), SXGA(1280*1024), UXGA(1600*1200), Full HD(1920*1080) ), etc., can output images at various resolutions.

Meanwhile, the projection unit 111 may perform various functions for adjusting an output image under the control of the processor 114 . For example, the projection unit 111 may perform functions such as zoom, keystone, quick corner (4 corner) keystone, and lens shift.

Specifically, the projection unit 111 may enlarge or reduce the image according to the distance from the screen (projection distance). That is, a zoom function may be performed according to the distance from the screen. In this case, the zoom function may include a hardware method of adjusting the screen size by moving a lens and a software method of adjusting the screen size by cropping an image. Meanwhile, when the zoom function is performed, the focus of the image needs to be adjusted. For example, methods for adjusting the focus include a manual focus method and a motorized method. The manual focus method refers to a method of manually focusing, and the motorized method refers to a method of automatically focusing using a motor built into the projector when a zoom function is performed. When performing the zoom function, the projection unit 111 may provide a digital zoom function through software, and may provide an optical zoom function that performs a zoom function by moving a lens through a driving unit.

Also, the projection unit 111 may perform a keystone correction function. If the height is not right for the front projection, the screen may be distorted up or down. The keystone correction function means a function of correcting a distorted screen. For example, if distortion occurs in the left and right directions of the screen, it can be corrected using the horizontal keystone, and if distortion occurs in the vertical direction, it can be corrected using the vertical keystone. The quick corner (4 corner) keystone correction function corrects the screen when the central area of the screen is normal but the corner area is out of balance. The lens shift function is a function that moves the screen as it is when the screen is out of the screen.

Meanwhile, the projection unit 111 may provide zoom/keystone/focus functions by automatically analyzing the surrounding environment and the projection environment without user input. Specifically, the projection unit 111 determines the distance between the electronic device 100 and the screen detected through sensors (depth camera, distance sensor, infrared sensor, illuminance sensor, etc.) and the space where the electronic device 100 is currently located. Zoom/Keystone/Focus functions can be automatically provided based on information about the image and the amount of ambient light.

Also, the projection unit 111 may provide a lighting function using a light source. In particular, the projection unit 111 may provide a lighting function by outputting a light source using LEDs. According to one embodiment, the projection unit 111 may include one LED, and according to another embodiment, the electronic device may include a plurality of LEDs. Meanwhile, the projection unit 111 may output a light source using a surface-emitting LED according to an implementation example. Here, the surface-emitting LED may refer to an LED having a structure in which an optical sheet is disposed above the LED so that light sources are uniformly distributed and output. Specifically, when the light source is output through the LED, the light source may be evenly dispersed through the optical sheet, and the light source dispersed through the optical sheet may be incident to the display panel.

Meanwhile, the projection unit 111 may provide a user with a dimming function for adjusting the intensity of the light source. Specifically, when a user input for adjusting the intensity of a light source is received from a user through the user interface 115 (eg, a touch display button or a dial), the projection unit 111 displays a light source corresponding to the received user input. It is possible to control the LED to output the intensity of.

Also, the projection unit 111 may provide a dimming function based on the content analyzed by the processor 114 without user input. In detail, the projection unit 111 may control the LED to output the intensity of the light source based on information about currently provided content (eg, content type, content brightness, etc.).

Meanwhile, the projection unit 111 may control the color temperature under the control of the processor 114 . Here, the processor 114 may control the color temperature based on content. Specifically, if the content is identified as being output, the processor 114 may obtain color information for each frame of the content for which output is determined. Also, the processor 114 may control the color temperature based on the obtained color information for each frame. Here, the processor 114 may obtain at least one main color of a frame based on color information for each frame. Also, the processor 114 may adjust the color temperature based on the obtained at least one primary color. For example, the color temperature controllable by the processor 114 may be classified into a warm type or a cold type. Here, it is assumed that a frame to be output (hereinafter referred to as an output frame) includes a scene in which a fire has occurred. The processor 114 may identify (or obtain) that the main color is red based on the color information included in the current output frame. Also, the processor 114 may identify a color temperature corresponding to the identified main color (red). Here, the color temperature corresponding to red may be a warm type. Meanwhile, the processor 114 may use an artificial intelligence model to obtain color information or a primary color of a frame. According to an embodiment, the artificial intelligence model may be stored in the electronic device 100 (eg, the memory 112). According to another embodiment, the artificial intelligence model may be stored in an external server communicable with the electronic device 100 .

Meanwhile, the electronic device 100 may control a lighting function in conjunction with an external device. Specifically, the electronic device 100 may receive lighting information from an external device. Here, the lighting information may include at least one of brightness information and color temperature information set by an external device. Here, the external device is a device connected to the same network as the electronic device 100 (eg, an IoT device included in the same home/work network) or a device that is not on the same network as the electronic device 100 but can communicate with the electronic device ( For example, a remote control server). For example, it is assumed that an external lighting device (IoT device) included in the same network as the electronic device 100 outputs red light with a brightness of 50. The external lighting device (IoT device) may directly or indirectly transmit lighting information (eg, information indicating that red light is output with a brightness of 50) to the electronic device 100 . Here, the electronic device 100 may control the output of the light source based on lighting information received from an external lighting device. For example, when lighting information received from an external lighting device includes information for outputting red light with a brightness of 50, the electronic device 100 may output red light with a brightness of 50.

Meanwhile, the electronic device 100 may control a lighting function based on biometric information. Specifically, the processor 114 may obtain user's biometric information. Here, the biometric information may include at least one of the user's body temperature, heart rate, blood pressure, respiration, and electrocardiogram. Here, the biometric information may include various types of information in addition to the information described above. For example, an electronic device may include a sensor for measuring biometric information. The processor 114 may obtain user's biometric information through a sensor and control the output of the light source based on the obtained biometric information. As another example, the processor 114 may receive biometric information from an external device through the input/output interface 116 . Here, the external device may refer to a user's portable communication device (eg, a smart phone or a wearable device). The processor 114 may obtain user's biometric information from an external device and control the output of the light source based on the obtained biometric information. Meanwhile, according to an implementation example, the electronic device may identify whether the user is sleeping, and if the user is identified as sleeping (or preparing for sleep), the processor 114 determines the light source based on the user's biometric information. You can control the output.

The memory 112 may store at least one command related to the electronic device 100 . Also, an operating system (O/S) for driving the electronic device 100 may be stored in the memory 112 . Also, various software programs or applications for operating the electronic device 100 may be stored in the memory 112 according to various embodiments of the present disclosure. Also, the memory 112 may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

Specifically, various software modules for operating the electronic device 100 may be stored in the memory 112 according to various embodiments of the present disclosure, and the processor 114 executes various software modules stored in the memory 112. Thus, the operation of the electronic device 100 may be controlled. That is, the memory 112 is accessed by the processor 114, and data can be read/written/modified/deleted/updated by the processor 114.

Meanwhile, in the present disclosure, the term memory 112 refers to a memory 112, a ROM (not shown) in the processor 114, a RAM (not shown), or a memory card (not shown) mounted in the electronic device 100 (eg For example, micro SD card, memory stick) may be used as a meaning including.

The sensor unit 113 may include at least one sensor. Specifically, the sensor unit 113 may include at least one of a tilt sensor that senses the tilt of the electronic device 100 and an image sensor that captures an image. Here, the tilt sensor may be an acceleration sensor or a gyro sensor, and the image sensor may mean a camera or a depth camera. In addition, the sensor unit 113 may include various sensors other than a tilt sensor or an image sensor. For example, the sensor unit 113 may include an illuminance sensor and a distance sensor. In addition, the sensor unit 113 may include a lidar sensor.

User interface 115 may include various types of input devices. For example, user interface 115 may include physical buttons. In this case, the physical button may include a function key, a direction key (eg, a 4-direction key), or a dial button. According to one embodiment, the physical button may be implemented as a plurality of keys. According to another embodiment, the physical button may be implemented as one key. Here, when the physical button is implemented as one key, the electronic device 100 may receive a user input in which one key is pressed for a critical period of time or longer. When a user input in which one key is pressed for a critical period of time or more is received, the processor 114 may perform a function corresponding to the user input. For example, processor 114 may provide a lighting function based on user input.

Also, the user interface 115 may receive a user input using a non-contact method. When a user input is received through a contact method, physical force must be transmitted to the electronic device. Therefore, a method for controlling the electronic device regardless of physical force may be required. Specifically, the user interface 115 may receive a user gesture and perform an operation corresponding to the received user gesture. Here, the user interface 115 may receive a user's gesture through a sensor (eg, an image sensor or an infrared sensor).

Also, the user interface 115 may receive a user input using a touch method. For example, the user interface 115 may receive a user input through a touch sensor. According to an embodiment, the touch method may be implemented as a non-contact method. For example, the touch sensor may determine whether the user's body has approached within a critical distance. Here, the touch sensor may identify a user input even when the user does not contact the touch sensor. Meanwhile, according to another implementation example, the touch sensor may identify a user input in which a user contacts the touch sensor.

Meanwhile, the electronic device 100 may receive user input in various ways other than the above-described user interface. As an example, the electronic device 100 may receive a user input through an external remote control device. Here, the external remote control device may be a remote control device corresponding to the electronic device 100 (eg, an electronic device-specific control device) or a user's portable communication device (eg, a smartphone or a wearable device). Here, the user's portable communication device may store an application for controlling the electronic device. The portable communication device may obtain a user input through a stored application and transmit the acquired user input to the electronic device 100 . The electronic device 100 may receive a user input from a portable communication device and perform an operation corresponding to a user's control command.

Meanwhile, the electronic device 100 may receive a user input using voice recognition. According to an embodiment, the electronic device 100 may receive a user's voice through a microphone included in the electronic device. According to another embodiment, the electronic device 100 may receive a user's voice from a microphone or an external device. Specifically, the external device may acquire a user voice through a microphone of the external device and transmit the obtained user voice to the electronic device 100 . The user's voice transmitted from the external device may be audio data or digital data obtained by converting the audio data (eg, audio data converted into a frequency domain). Here, the electronic device 100 may perform an operation corresponding to the received user voice. Specifically, the electronic device 100 may receive audio data corresponding to a user's voice through a microphone. And, the electronic device 100 may convert the received audio data into digital data. In addition, the electronic device 100 may convert the converted digital data into text data using a speech to text (STT) function. According to an embodiment, the STT (Speech To Text) function may be performed directly in the electronic device 100,

According to another embodiment, a speech to text (STT) function may be performed in an external server. The electronic device 100 may transmit digital data to an external server. The external server may convert digital data into text data and obtain control command data based on the converted text data. The external server may transmit control command data (this time, text data may also be included) to the electronic device 100 . The electronic device 100 may perform an operation corresponding to the user's voice based on the obtained control command data.

Meanwhile, the electronic device 100 may provide a voice recognition function using one assistant (or artificial intelligence assistant, eg, Bixby™, etc.), but this is only an example and through a plurality of assistants. A voice recognition function may be provided. In this case, the electronic device 100 may provide a voice recognition function by selecting one of a plurality of assists based on a trigger word corresponding to the assist or a specific key present on the remote control.

Meanwhile, the electronic device 100 may receive a user input using screen interaction. Screen interaction may refer to a function of identifying whether a predetermined event occurs through an image projected on a screen (or a projection surface) by an electronic device and acquiring a user input based on the predetermined event. Here, the predetermined event may refer to an event in which a predetermined object is identified at a specific location (eg, a location where a UI for receiving a user input is projected). Here, the predetermined object may include at least one of a user's body part (eg, a finger), a pointing stick, and a laser point. When a predetermined object is identified at a location corresponding to the projected UI, the electronic device 100 may identify that a user input for selecting the projected UI has been received. For example, the electronic device 100 may project a guide image to display a UI on the screen. And, the electronic device 100 can identify whether the user selects the projected UI. Specifically, the electronic device 100 may identify that the user has selected the projected UI when a predetermined event is identified at the location of the projected UI. Here, the projected UI may include at least one or more items. Here, the electronic device 100 may perform spatial analysis to identify whether a predetermined event is located at the location of the projected UI. Here, the electronic device 100 may perform spatial analysis through a sensor (eg, an image sensor, an infrared sensor, a depth camera, a distance sensor, etc.). The electronic device 100 may identify whether a predetermined event occurs at a specific location (the location where the UI is projected) by performing spatial analysis. And, if it is identified that a predetermined event occurs at a specific location (the location where the UI is projected), the electronic device 100 may identify that a user input for selecting a UI corresponding to the specific location has been received.

The input/output interface 116 is a component for inputting/outputting at least one of an audio signal and a video signal. The input/output interface 116 may receive at least one of audio and video signals from an external device and output a control command to the external device.

Meanwhile, in an embodiment of the present disclosure, the input/output interface 116 includes HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), USB C-type, DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (Dsubminiature) and DVI (Digital Visual Interface) may be implemented as at least one wired input/output interface. According to an embodiment, the wired input/output interface may be implemented as an interface for inputting/outputting only audio signals and an interface for inputting/outputting only video signals, or may be implemented as one interface for inputting/outputting both audio and video signals.

In addition, the electronic device 100 may receive data through a wired input/output interface, but this is merely an example, and power may be supplied through the wired input/output interface. For example, the electronic device 100 may receive power from an external battery through USB C-type or from an outlet through a power adapter. As another example, an electronic device may receive power from an external device (eg, a laptop computer or a monitor) through a DP.

Meanwhile, in an embodiment of the present disclosure, the input/output interface 116 is Wi-Fi, Wi-Fi Direct, Bluetooth, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), and Long Term Evolution (LTE) communication It may be implemented as a wireless input/output interface that performs communication using at least one of the communication methods. Depending on the implementation example, the wireless input/output interface may be implemented as an interface for inputting/outputting only audio signals and an interface for inputting/outputting only video signals, or may be implemented as one interface for inputting/outputting both audio and video signals.

Also, an audio signal may be input through a wired input/output interface, and a video signal may be input through a wireless input/output interface. Alternatively, an audio signal may be input through a wireless input/output interface and a video signal may be input through a wired input/output interface.

The audio output unit 117 is a component that outputs an audio signal. In particular, the audio output unit 117 may include an audio output mixer, an audio signal processor, and a sound output module. The audio output mixer may synthesize a plurality of audio signals to be output into at least one audio signal. For example, the audio output mixer may combine an analog audio signal and another analog audio signal (eg, an analog audio signal received from the outside) into at least one analog audio signal. The sound output module may include a speaker or an output terminal. According to an embodiment, the sound output module may include a plurality of speakers, and in this case, the sound output module may be disposed inside the main body, and the sound emitted by covering at least a part of the diaphragm of the sound output module may be emitted through a sound conduit ( waveguide) and can be transmitted to the outside of the main body. The sound output module includes a plurality of sound output units, and since the plurality of sound output units are symmetrically disposed on the exterior of the main body, sound can be emitted in all directions, that is, in all directions of 360 degrees.

The power supply unit 118 may receive power from the outside and supply power to various components of the electronic device 100 . The power supply unit 118 according to an embodiment of the present disclosure may receive power through various methods. As an example, the power supply unit 118 may receive power using the connector 130 shown in FIG. 1 . In addition, the power supply unit 118 may receive power using a 220V DC power cord. However, the present invention is not limited thereto, and the electronic device may receive power using a USB power cord or a wireless charging method.

In addition, the power supply unit 118 may receive power using an internal battery or an external battery. The power supply unit 118 according to an embodiment of the present disclosure may receive power through an internal battery. For example, the power supply unit 118 may charge power of an internal battery using at least one of a 220V DC power cord, a USB power cord, and a USB C-Type power cord, and may receive power through the charged internal battery. . In addition, the power supply unit 118 according to an embodiment of the present disclosure may receive power through an external battery. For example, when the electronic device and the external battery are connected through various wired communication methods such as a USB power cord, a USB C-Type power cord, and a socket home, the power supply unit 118 may receive power through the external battery. That is, the power supply unit 118 may directly receive power from an external battery, or may charge an internal battery through an external battery and receive power from the charged internal battery.

The power supply unit 118 according to the present disclosure may receive power using at least one of the plurality of power supply methods described above.

Meanwhile, with respect to power consumption, the electronic device 100 may have power consumption equal to or less than a preset value (eg, 43W) due to a socket type and other standards. In this case, the electronic device 100 may vary power consumption to reduce power consumption when using a battery. That is, the electronic device 100 may vary power consumption based on a power supply method and power usage.

Meanwhile, the electronic device 100 according to an embodiment of the present disclosure may provide various smart functions.

Specifically, the electronic device 100 is connected to a portable terminal device for controlling the electronic device 100, and a screen output from the electronic device 100 can be controlled through a user input input from the portable terminal device. For example, the mobile terminal device may be implemented as a smart phone including a touch display, and the electronic device 100 receives and outputs screen data provided by the mobile terminal device from the mobile terminal device, and inputs data from the mobile terminal device. A screen output from the electronic device 100 may be controlled according to a user input.

The electronic device 100 may share content or music provided by the portable terminal device by connecting to the portable terminal device through various communication methods such as Miracast, Airplay, wireless DEX, and Remote PC.

Also, the mobile terminal device and the electronic device 100 may be connected through various connection methods. As an embodiment, the portable terminal device may perform a wireless connection by searching for the electronic device 100 or the electronic device 100 may search for the portable terminal device and perform a wireless connection. And, the electronic device 100 may output content provided by the portable terminal device.

As an embodiment, when a predetermined gesture is detected through the display of the portable terminal device after placing the portable terminal device near the electronic device while specific content or music is being output (eg, motion tap view), the electronic device 100 may output content or music currently being output on the portable terminal device.

In an embodiment, while specific content or music is being output from the portable terminal device, the portable terminal device is brought closer to the electronic device 100 by a predetermined distance or less (eg, non-contact tap view), or the portable terminal device is close to the electronic device 100. When contact is made twice at a short interval (eg, contact tap view), the electronic device 100 may output content or music currently being output on the portable terminal device.

In the above-described embodiment, it has been described that the same screen as that provided by the portable terminal device is provided by the electronic device 100, but the present disclosure is not limited thereto. That is, when a connection is established between the portable terminal device and the electronic device 100, the portable terminal device outputs a first screen provided by the portable terminal device, and in the electronic device 100, the first screen is provided by a different portable terminal device. A second screen may be output. For example, the first screen may be a screen provided by a first application installed on the portable terminal device, and the second screen may be a screen provided by a second application installed on the portable terminal device. For example, the first screen and the second screen may be different screens provided by one application installed in the portable terminal device. Also, as an example, the first screen may be a screen including a remote control type UI for controlling the second screen.

The electronic device 100 according to the present disclosure may output a standby screen. For example, when the electronic device 100 is not connected to an external device or when there is no input received from the external device for a preset time, the electronic device 100 may output a standby screen. Conditions for the electronic device 100 to output the standby screen are not limited to the above examples, and the standby screen may be output under various conditions.

The electronic device 100 may output a standby screen in the form of a blue screen, but the present disclosure is not limited thereto. For example, the electronic device 100 may obtain an irregular object by extracting only the shape of a specific object from data received from an external device, and output an idle screen including the obtained irregular object.

The shutter unit 120 may include at least one of a shutter, a fixing member, a rail, a body, or a motor.

Here, the shutter may block light output from the projection unit 111 . Here, the fixing member may fix the position of the shutter. Here, the rail may be a path for moving the shutter and the fixing member. Here, the body may be configured to include a shutter and a fixing member. Here, the motor may be a component that generates driving power for movement (eg, movement of the body) or rotation (eg, rotation of the shutter) of components in the shutter unit 120 .

4 is a perspective view illustrating an external appearance of an electronic device 100 according to other embodiments of the present disclosure.

Referring to FIG. 4 , the electronic device 100 may include a support (or referred to as a “handle”) 108a.

The support 108a of various embodiments may be a handle or a hook provided for a user to grip or move the electronic device 100, or the support 108a may be a main body ( 105) may be a stand supporting the.

As shown in FIG. 4, the support 108a may be coupled to or separated from the outer circumferential surface of the main body 105 in a hinge structure, and may be selectively separated and fixed from the outer circumferential surface of the main body 105 according to the user's needs. The number, shape, or arrangement of the supports 108a may be variously implemented without limitation. Although not shown in the drawing, the support 108a is built into the main body 105 and can be taken out and used by the user as needed, or the support 108a can be implemented as a separate accessory and detachable from the electronic device 100. there is.

The support 108a may include a first support surface 108a-1 and a second support surface 108a-2. The first support surface 108a-1 may be a surface facing the outside of the body 105 in a state where the support 108a is separated from the outer circumferential surface of the body 105, and the second support surface 108a-2 is the support (108a) may be a surface facing the inner direction of the main body 105 in a state separated from the outer circumferential surface of the main body 105.

The first support surface 108a-1 is developed from the lower part of the body 105 to the upper part of the body 105 and may move away from the body 105, and the first support surface 108a-1 is flat or uniformly curved. can have a shape. The first support surface 108a-1 is the case where the electronic device 100 is mounted so that the outer surface of the body 105 touches the bottom surface, that is, when the projection lens 110 is disposed facing the front direction, the body ( 105) can be supported. In an embodiment including two or more supports 108a, the angle of exit of the head 103 and the projection lens 110 may be adjusted by adjusting the distance between the two supports 108a or the hinge opening angle.

The second support surface 108a-2 is a surface in contact with the user or an external mounting structure when the support 108a is supported by the user or an external mounting structure, and prevents the user from slipping when the electronic device 100 is supported or moved. It may have a shape corresponding to the gripping structure of the hand or the external mounting structure. The user may direct the projection lens 110 toward the front, fix the head 103, hold the support 108a, move the electronic device 100, and use the electronic device 100 like a flashlight.

The support groove 104 is provided on the main body 105 and is a groove structure that can be accommodated when the support rod 108a is not in use, and as shown in FIG. It can be implemented as a home structure. Through the support groove 104, the support 108a can be stored on the outer circumferential surface of the main body 105 when the support 108a is not in use, and the outer circumferential surface of the main body 105 can be kept smooth.

Alternatively, the support 108a may have a structure in which the support 108a is stored inside the body 105 and the support 108a is pulled out of the body 105 in a situation where the support 108a is needed. In this case, the support groove 104 may have a structure drawn into the main body 105 to accommodate the support rod 108a, and the second support surface 108a-2 may be in close contact with the outer circumferential surface of the main body 105 or a separate support rod. A door (not shown) that opens and closes the groove 104 may be included.

Although not shown in the drawings, the electronic device 100 may include various types of accessories that help use or store the electronic device 100. For example, the electronic device 100 may include the electronic device 100 A protective case (not shown) may be included to protect and easily transport the electronic device 100 by being coupled to a tripod (not shown) or an external surface that supports or fixes the main body 105. Possible brackets (not shown) may be included.

5 is a perspective view illustrating an external appearance of an electronic device 100 according to another embodiment of the present disclosure.

Referring to FIG. 5 , the electronic device 100 may include a support (or referred to as a “handle”) 108b.

The support 108b of various embodiments may be a handle or a hook provided for a user to grip or move the electronic device 100, or the support 108b may be a main body ( 105) may be a stand that supports it so that it can be directed at an arbitrary angle.

Specifically, as shown in FIG. 5, the support 108b may be connected to the main body 105 at a predetermined point (eg, 2/3 to 3/4 of the height of the main body) of the main body 105. . When the support 108 is rotated in the direction of the main body, the main body 105 can be supported at an arbitrary angle in a state where the main body 105 is laid down in the lateral direction.

6 is a perspective view illustrating an external appearance of an electronic device 100 according to another embodiment of the present disclosure.

Referring to FIG. 6 , the electronic device 100 may include a support (or referred to as a “stand”) 108c. The support 108c of various embodiments includes a base plate 108c-1 provided to support the electronic device 100 on the ground and two support members 108c connecting the base plate 108-c and the main body 105. -2) may be included.

In one embodiment of the present disclosure, the two support members (108c-2) have the same height, so that one end surface of the two support members (108c-2) is provided on one outer circumferential surface of the main body 105 and the hinge member (108c). -3) can be combined or separated.

The two supporting members may be hingedly connected to the main body 105 at a predetermined point (eg, 1/3 to 2/4 of the height of the main body) of the main body 105 .

When the two support members and the main body are coupled by the hinge member 108c-3, the main body 105 is rotated based on the imaginary horizontal axis formed by the two hinge members 108c-3 so that the projection lens 110 The emission angle of can be adjusted.

Although FIG. 6 shows an embodiment in which two support members 108c-2 are connected to the body 105, the present disclosure is not limited thereto, and one support member and the body as shown in FIGS. 7 and 8 ( 105) may be connected by one hinge member.

7 is a perspective view illustrating an external appearance of an electronic device 100 according to another embodiment of the present disclosure.

FIG. 8 is a perspective view illustrating a rotated state of the electronic device 100 of FIG. 7 .

7 and 8, the support 108d of various embodiments includes a base plate 108d-1, a base plate 108-c, and a body 105 provided to support the electronic device 100 on the ground. It may include one support member (108d-2) connecting the.

Also, the end face of one support member 108d-2 may be coupled or separated by a groove provided on one outer circumferential surface of the body 105 and a hinge member (not shown).

When one support member (108d-2) and the main body 105 are coupled by one hinge member (not shown), as shown in FIG. 8, based on a virtual horizontal axis formed by one hinge member (not shown) The body 105 can be rotated.

Meanwhile, the supports shown in FIGS. 4, 5, 6, 7, and 8 are merely examples, and the electronic device 100 may have supports in various positions or shapes.

9 is a flowchart illustrating an operation of correcting a projected image using state information of the electronic device 100 and state information of the projection surface 10. Referring to FIG.

Referring to FIG. 9 , the electronic device 100 may acquire state information of the electronic device 100 (S905). Specifically, the electronic device 100 may acquire state information of the electronic device 100 through the first sensor unit 113-1. State information of the electronic device 100 is additionally described in FIGS. 10 to 14 .

And, the electronic device 100 may acquire state information of the projection surface 10 (S910). Specifically, the electronic device 100 may acquire state information of the projection surface 10 through the second sensor unit 113-2. State information of the projection surface 10 is additionally described in FIGS. 15 to 22 .

Then, the electronic device 100 may correct the projected image based on the state information of the electronic device 100 and the state information of the projection surface 10 (S915). Specifically, the electronic device 100 may perform leveling correction or keystone correction on the projected image based on state information of the electronic device 100 and state information of the projection surface 10 . A correction operation for the projected image is described in FIGS. 23 and 24 . Here, step S915 may be replaced by an operation in which the electronic device 100 corrects the projected image based on at least one of state information of the electronic device 100 and state information of the projection surface 10 .

And, the electronic device 100 may output the corrected projection image (S920).

10 is a diagram for explaining z-axis rotation information of the electronic device 100 .

The embodiment 1010 of FIG. 10 shows a projection image 1011 output in a state in which the electronic device 100 is not rotated on the z-axis basis. A description related to the z-axis of the electronic device 100 is described in FIG. 13 .

The embodiment 1020 of FIG. 10 shows a projection image 1021 output in a state in which the electronic device 100 is rotated on the z-axis basis. Here, it is assumed that the electronic device 100 is rotated by a certain angle 1022 based on the z-axis.

11 is a diagram for explaining y-axis rotation information of the electronic device 100 .

The embodiment 1110 of FIG. 11 shows a state in which the electronic device 100 is not rotated based on the y-axis. A description related to the y-axis of the electronic device 100 is described in FIG. 13 .

Example 1120 of FIG. 11 shows a state in which the electronic device 100 is rotated based on the y-axis. Here, it is assumed that the electronic device 100 is rotated by a predetermined angle 1122 based on the y-axis.

12 is a diagram for explaining x-axis rotation information of the electronic device 100 .

The embodiment 1210 of FIG. 12 shows a state in which the electronic device 100 is not rotated based on the x-axis. A description related to the x-axis of the electronic device 100 is described in FIG. 13 . Here, the reference horizontal line 1211 may be the same as the horizontal line of the electronic device 100 that is not rotated based on the x-axis.

The embodiment 1220 of FIG. 12 shows a state in which the electronic device 100 is rotated based on the x-axis. Here, it is assumed that the electronic device 100 is rotated by a predetermined angle 1222 based on the x-axis. Here, there may be a difference between the reference horizontal line 1211 and the horizontal line 1221 of the electronic device by a predetermined angle 1222 .

13 is a diagram for explaining rotation information of the electronic device 100. Referring to FIG.

The embodiment 1310 of FIG. 13 is a graph defining rotation directions along the x, y, and z axes. Rotation around the x-axis can be defined as roll, rotation around the y-axis as pitch, and rotation around the z-axis as yaw.

In the embodiment 1320 of FIG. 13 , the rotation direction of the projection surface 10 may be described as the rotation direction defined in the embodiment 1310. The x-axis rotation information of the projection surface 10 may correspond to a roll rotating based on the x-axis of the projection surface 10 . The y-axis rotation information of the projection surface 10 may correspond to a pitch that rotates based on the y-axis of the projection surface 10 . The z-axis rotation information of the projection surface 10 may correspond to yaw rotating based on the z-axis of the projection surface 10 .

Meanwhile, the x-axis rotation information may be described as first-axis rotation information or horizontal distortion information. Also, the y-axis rotation information may be described as second-axis rotation information or vertical tilt information. Also, the z-axis rotation information may be described as third-axis rotation information or horizontal tilt information.

Meanwhile, the first sensor unit 113-1 may obtain state information of the electronic device 100. Here, the state information of the electronic device 100 may mean a rotation state of the electronic device 100 . Here, the first sensor unit 113-1 may include at least one of a gravity sensor, an acceleration sensor, and a gyro sensor. The x-axis rotation information and the y-axis rotation information of the electronic device 100 may be determined based on sensing data acquired through the first sensor unit 113-1. However, it may be difficult to set a specific criterion for z-axis rotation information of the electronic device 100 unless it is based on north, south, east, west, and the like. Accordingly, the electronic device 100 may consider state information of the projection surface 10 without separately considering z-axis rotation information of the electronic device 100 . Specifically, the electronic device 100 may perform an image correction operation in consideration of z-axis rotation information of the projection surface 10 .

14 is a flowchart illustrating an operation of correcting a projected image based on rotation information of the electronic device 100. Referring to FIG.

Referring to FIG. 14 , the electronic device 100 may acquire x-axis rotation information and y-axis rotation information of the electronic device 100 (S1405). Specifically, the electronic device 100 may acquire rotation information related to the electronic device 100 through the first sensor unit 113-1.

Then, the electronic device 100 may correct the projected image based on the x-axis rotation information and the y-axis rotation information of the electronic device 100 (S1410). Specifically, the electronic device 100 performs leveling correction on the projection image based on the x-axis rotation information of the electronic device 100, and performs keystone correction on the projection image based on the y-axis rotation information of the electronic device 100. correction can be made.

Then, the electronic device 100 may output a projected image after the correction operation is performed (S1415). Here, the output projection image may be an image on which at least one of leveling correction and keystone correction has been performed.

15 is a diagram for explaining rotation information of the projection surface 10.

The embodiment 1510 of FIG. 15 is a graph defining rotation directions along the x, y, and z axes. Rotation around the x-axis can be defined as roll, rotation around the y-axis as pitch, and rotation around the z-axis as yaw.

In the embodiment 1520 of FIG. 15 , the rotation direction of the projection surface 10 may be described as the rotation direction defined in the embodiment 1510 . The x-axis rotation information of the projection surface 10 may correspond to a roll rotating based on the x-axis of the projection surface 10 . The y-axis rotation information of the projection surface 10 may correspond to a pitch that rotates based on the y-axis of the projection surface 10 . The z-axis rotation information of the projection surface 10 may correspond to yaw rotating based on the z-axis of the projection surface 10 .

Meanwhile, the x-axis rotation information may be described as first-axis rotation information. Also, the y-axis rotation information may be described as second-axis rotation information. Also, the z-axis rotation information may be described as third-axis rotation information.

16 is a diagram for explaining z-axis rotation information of the projection surface 10 .

The embodiment 1610 of FIG. 16 is a view from above of the electronic device 100 in which the electronic device 100 outputs a projected image in a state in which the projection surface 10 is not rotated in the z-axis. Assume that the electronic device 100 is placed on the table 20 .

The embodiment 1620 of FIG. 16 describes a situation in which the electronic device 100 outputs a projected image in a state where the projection surface 10 is rotated counterclockwise by a certain angle θ1 with respect to the z-axis. ) is a view from above. Assume that the electronic device 100 is placed on the table 20 .

17 is a flowchart illustrating an operation of correcting a projected image based on z-axis rotation information of the projection surface 10. Referring to FIG.

Referring to FIG. 17 , the electronic device 100 may obtain a first distance between the first distance sensor 113-2-1 and the projection surface 10 (S1705). The distance may be described as distance information. The first distance may be d1 of FIG. 18 .

And, the electronic device 100 may obtain a second distance between the second distance sensor 113-2-2 and the projection surface 10 (S1710). The first distance may be d2 of FIG. 18 .

Then, the electronic device 100 may acquire z-axis rotation information of the projection surface 10 based on the first distance and the second distance (S1715). A detailed description related to this will be described in FIG. 18 .

And, the electronic device 100 may correct the projected image based on the z-axis rotation information of the projection surface 10 (S1720). Specifically, the electronic device 100 may perform keystone correction on the projected image based on z-axis rotation information of the projection surface 10 .

And, the electronic device 100 may output the corrected projection image (S1725).

18 is a diagram for explaining an operation of obtaining z-axis rotation information of the projection surface 10. Referring to FIG.

The embodiment 1810 of FIG. 18 shows a state in which the projection surface 10 is not rotated in the z-axis. The embodiment 1810 may correspond to the embodiment 1610 of FIG. 16 . The electronic device 100 may obtain a first distance d1 between the first distance sensor 113-2-1 and the projection surface 10. Specifically, the electronic device 100 outputs light through the light emitting unit of the first distance sensor 113-2-1 and receives light reflected through the light receiving unit of the first distance sensor 113-2-1. can The electronic device 100 may obtain the first distance d1 based on the time when light is output through the light emitter and the time when light reflected through the light receiver is received.

The electronic device 100 may obtain the second distance d2 between the second distance sensor 113-2-2 and the projection surface 10. Specifically, the electronic device 100 outputs light through the light emitting unit of the second distance sensor 113-2-2 and receives reflected light through the light receiving unit of the second distance sensor 113-2-2. can The electronic device 100 may obtain the second distance d2 based on the time when light is output through the light emitter and the time when light reflected through the light receiver is received.

Here, if the first distance d1 and the second distance d2 are the same, the electronic device 100 may identify that the projection surface 10 is not rotated along the z-axis. Also, the electronic device 100 may determine that the z-axis rotation information of the projection surface 10 is '0 degree'.

The embodiment 1820 of FIG. 18 shows a state in which the projection surface 10 is rotated by a certain angle θ1 with respect to the z-axis. The embodiment 1820 may correspond to the embodiment 1620 of FIG. 16 . The electronic device 100 may obtain a first distance d1 between the first distance sensor 113-2-1 and the projection surface 10. Also, the electronic device 100 may obtain the second distance d2 between the second distance sensor 113-2-2 and the projection surface 10. Since descriptions related to the first distance d1 and the second distance d2 have been described in the embodiment 1810, redundant descriptions will be omitted.

Here, if the first distance d1 and the second distance d2 are not the same, the electronic device 100 may identify the projection surface 10 as being rotated along the z-axis. In addition, the electronic device 100 determines the first distance d1, the second distance d2, and the distance between the first distance sensor 113-2-1 and the second distance sensor 113-2-2 (d_sensor ), z-axis rotation information of the projection surface 10 may be obtained.

The embodiment 1830 of FIG. 18 shows a process of calculating z-axis rotation information of the projection surface 10. The electronic device 100 may calculate the rotation angle θ1 of the projection surface 10 in the z-axis by substituting '(d2-d1)/(d_sensor)' into the arctangent function (tan^-1).

19 is a view for explaining the light receiving unit of the second sensor unit.

Referring to the embodiment 1910 of FIG. 19 , the distance sensor included in the second sensor unit 113-2 may include both a light emitting unit and a light receiving unit. Specifically, the second sensor unit 113-2 of the electronic device 100 may include a first distance sensor 113-2-1 and a second distance sensor 113-2-2. Also, the first distance sensor 113-2-1 may include a first light emitting unit 113-2-1-1 and a first light receiving unit 113-2-1-2. Here, the first light emitting unit 113-2-1-1 functions to emit (or output) light, and the first light receiving unit 113-2-1-2 functions to receive the reflected light. can be done Here, the reflected light may mean light emitted (or output) from the first light emitting unit 113-2-1-1 and reflected by a specific object (eg, projection surface). Also, the second distance sensor 113-2-2 may include a second light emitting unit 113-2-2-1 and a first light receiving unit 113-2-2-2.

Referring to the embodiment 1920 of FIG. 19 , the distance sensor included in the second sensor unit 113-2 may include a light emitting unit, and the light receiving unit may be disposed at a separate location other than the distance sensor. Specifically, the second sensor unit 113-2 of the electronic device 100 may include a first distance sensor 113-2-1 and a second distance sensor 113-2-2. Here, the first distance sensor 113-2-1 and the second distance sensor 113-2-2 may perform a function of reflecting (or outputting) light. Here, the light receiving unit 1901 may receive the reflected light. Since the wavelength or frequency of the light output from the first distance sensor 113-2-1 and the light output from the second distance sensor 113-2-2 are different, the electronic device 100 determines that the received light is the first It is possible to identify whether the distance sensor 113-2-1 outputs or the second distance sensor 113-2-2 outputs it.

20 is a diagram for explaining y-axis rotation information of the projection surface 10.

Referring to the embodiment 2010 of FIG. 20 , a state in which the projection surface 10 is not rotated based on the y-axis is shown.

Referring to the embodiment 2020 of FIG. 20 , a state in which the projection surface 10 is rotated based on the y-axis is shown. Specifically, it is assumed that the projection surface 10 is rotated by a certain angle θ2 with respect to the y-axis.

21 is a flowchart illustrating an operation of correcting a projected image based on y-axis rotation information of the projection surface 10. Referring to FIG.

Referring to FIG. 21 , the electronic device 100 may obtain a first distance between the first distance sensor 113-2-1 and the projection surface 10 (S2105). Here, the first distance may be d1 of FIG. 22 .

And, the electronic device 100 may obtain a third distance between the third distance sensor 113-2-3 and the projection surface 10 (S2110). Here, the third distance may be d3 of FIG. 22 .

Then, the electronic device 100 may obtain y-axis rotation information of the projection surface 10 based on the first distance and the third distance (S2115). A detailed description related to this is described in FIG. 22 .

And, the electronic device 100 may correct the projected image based on the y-axis rotation information of the projection surface 10 (S2120). Specifically, the electronic device 100 may perform keystone correction on the projection image based on the y-axis rotation information of the projection surface 10 .

And, the electronic device 100 may output a projected image (S2125). Specifically, the electronic device 100 may output a projection image on which keystone correction has been performed (S2125).

Meanwhile, in FIG. 21, the operation using the first distance sensor 113-2-1 and the third distance sensor 113-2-3 to acquire the y-axis rotation information of the projection surface 10 has been described, but implementation According to an example, the second distance sensor 113-2-2 may be used instead of the first distance sensor 113-2-1. Different distance sensors having different heights may be used to acquire y-axis rotation information of the projection surface 10 .

22 is a diagram for explaining an operation of obtaining y-axis rotation information of the projection surface 10. Referring to FIG.

The embodiment 2210 of FIG. 22 indicates that the projection surface 10 is not rotated based on the y-axis. Embodiment 2210 may correspond to embodiment 2010 of FIG. 20 . The electronic device 100 determines the first distance d1 between the first distance sensor 113-2-1 and the projection surface 10 based on the sensing data acquired by the first distance sensor 113-2-1. can be obtained. In addition, the electronic device 100 determines the third distance between the third distance sensor 113-2-3 and the projection surface 10 based on the sensing data obtained from the third distance sensor 113-2-3. d3) can be obtained. Here, if the first distance d1 and the third distance d3 are the same, the electronic device 100 may identify that the projection surface 10 is not rotated based on the y-axis.

In the embodiment 2220 of FIG. 22 , the projection surface 10 is rotated based on the y-axis. Embodiment 2220 may correspond to embodiment 2020 of FIG. 20 . If the first distance d1 is not equal to the third distance d3, the electronic device 100 may identify that the projection surface 10 is rotated based on the y-axis. In addition, the electronic device 100 determines the first distance d1, the third distance d3, and the height difference between the first distance sensor 113-2-1 and the third distance sensor 113-2-3 (d_sensor Based on -H), y-axis rotation information of the projection surface 10 may be obtained.

Example 2230 of FIG. 22 shows a process of calculating y-axis rotation information of the projection surface 10 . The electronic device 100 may calculate the rotation angle θ2 of the projection surface 10 in the y-axis by substituting '(d1-d3)/(d_sensor-H)' into the inverse tangent function (tan^-1). there is.

Meanwhile, in FIG. 22 , an operation of obtaining y-axis rotation information of the projection surface 10 using the third distance sensor 113-2-3 has been described. However, according to the implementation example, the first distance sensor 113-2-1 and the second distance sensor 113 without the third distance sensor 113-2-3 in order to obtain the y-axis rotation information of the projection surface 10 -2-2) only. A related arrangement structure may be the same as that of the electronic device 100 - 2 of FIG. 25 . As in the electronic device 100-2 of FIG. 25, the two distance sensors may be disposed differently in both horizontal and vertical positions. Here, the electronic device 100 - 2 may acquire both y-axis rotation information and z-axis rotation information of the projection surface 10 through two distance sensors.

23 is a table for explaining whether leveling correction or keystone correction is performed based on state information of the electronic device 100 and state information of the projection surface 10 .

Referring to table 2310 of FIG. 23 , the electronic device 100 may perform a correction operation based on at least one of state information of the electronic device 100 and state information of the projection surface 10 . Specifically, the state information of the electronic device 100 may include x-axis rotation information and y-axis rotation information of the electronic device 100 of the electronic device 100 . In addition, the state information of the projection surface 10 may include y-axis rotation information and z-axis rotation information of the projection surface 10 .

Here, the electronic device 100 may perform leveling correction (or leveling correction function) based on the x-axis rotation information of the electronic device 100 . In addition, the electronic device 100 performs keystone correction (or keystone correction function).

Specifically, when the electronic device 100 is rotated along the x-axis, the electronic device 100 may perform leveling correction by rotating the projected image clockwise or counterclockwise.

When the electronic device 100 is rotated along the y-axis, the electronic device 100 may perform keystone correction (vertical keystone correction or up/down keystone correction) to remove distortion generated in the vertical direction of the projected image.

When the projection surface 10 is rotated along the y-axis, the electronic device 100 may perform keystone correction (vertical keystone correction or up and down keystone correction) to remove distortion generated in the vertical direction of the projected image.

When the projection surface 10 is rotated in the z-axis, the electronic device 100 may perform keystone correction (horizontal keystone correction or left and right keystone correction) to remove distortion generated in the horizontal direction of the projected image.

Meanwhile, since the projection surface 10 is generally rotated along the y-axis or z-axis, it is not assumed that the projection surface 10 rotates along the x-axis. 41 and 42 in relation to the x-axis rotation information of the projection surface 10.

24 is a flowchart for explaining whether leveling correction or keystone correction is performed based on state information of the electronic device 100 and state information of the projection surface 10 .

Referring to FIG. 24 , the electronic device 100 may acquire x-axis rotation information and y-axis rotation information of the electronic device 100 (S2405). Specifically, the electronic device 100 may acquire rotation information of the electronic device 100 through the first sensor unit 113-1.

In addition, the electronic device 100 determines the first distance d1 between the first distance sensor 113-2-1 and the projection surface 10, the second distance sensor 113-2-2 and the projection surface 10 ) and a third distance d3 between the third distance sensor 113-2-3 and the projection surface 10 may be obtained (S2410).

Then, the electronic device 100 may obtain z-axis rotation information of the projection surface 10 based on the first distance d1 and the second distance d2 (S2415). Also, the electronic device 100 may obtain y-axis rotation information of the projection surface 10 based on the first distance d1 and the third distance d3 (S2420).

Then, the electronic device 100 may perform leveling correction on the projected image based on the x-axis rotation information of the electronic device 100 (S2425).

And, the electronic device 100 performs keystone correction on the projected image based on the y-axis rotation information of the electronic device 100, the y-axis rotation information of the projection surface 10, and the z-axis rotation information of the projection surface 10. It can be performed (S2430).

Then, the electronic device 100 may output a projection image after at least one of leveling correction and keystone correction is performed (S2435). If both the electronic device 100 and the projection surface 10 are not rotated, the electronic device 100 may not perform leveling correction and keystone correction. Similarly, according to the rotation information, at least one of step S2425 or step S2430 may be omitted.

25 is a diagram for explaining the second sensor unit 113-2 according to various embodiments.

An embodiment 2510 of FIG. 25 illustrates an electronic device 100 using two distance sensors. The electronic device 100 may include a first distance sensor 113-2-1 and a second distance sensor 113-2-2.

In the electronic device 100-1, the first distance sensor 113-2-1 and the second distance sensor 113-2-2 may be disposed horizontally.

Also, in the electronic device 100-2, the first distance sensor 113-2-1 and the second distance sensor 113-2-2 may be disposed not horizontally. In the electronic device 100-2, the first distance sensor 113-2-1 and the second distance sensor 113-2-2 may be differently disposed horizontally and vertically. Like the electronic device 100-2, if the first distance sensor 113-2-1 and the second distance sensor 113-2-2 are neither horizontal nor perpendicular to each other, the third distance sensor 113-2-2 3) may not be necessary. Accordingly, the third distance sensor 113-2-3 and the third distance d3 disclosed in FIGS. 21, 22, and 24 correspond to the second distance sensor 113-2-2 and the second distance d2. can be replaced with

An embodiment 2520 of FIG. 25 illustrates an electronic device 100 using three distance sensors. The electronic device 100 may include a first distance sensor 113-2-1, a second distance sensor 113-2-2, and a third distance sensor 113-2-3.

In the electronic device 100-3, the first distance sensor 113-2-1 and the second distance sensor 113-2-2 are horizontally disposed, and the third distance sensor 113-2-3 is It may be disposed not perpendicular to the distance sensor 113-2-1 and the second distance sensor 113-2-2.

In the electronic device 100-4, the first distance sensor 113-2-1 and the second distance sensor 113-2-2 are horizontally disposed, and the third distance sensor 113-2-3 is It may be disposed perpendicular to the distance sensor 113-2-1 (or the second distance sensor 113-2-2). Here, the projection lens 110 may be disposed between the first distance sensor 113-2-1 and the second distance sensor 113-2-2.

In the electronic device 100-5, the first distance sensor 113-2-1 and the second distance sensor 113-2-2 are horizontally disposed, and the third distance sensor 113-2-3 is It may be disposed perpendicular to the distance sensor 113-2-1 (or the second distance sensor 113-2-2). Here, the first distance sensor 113-2-1, the second distance sensor 113-2-2, and the third distance sensor 113-2-3 are all directed in the same direction relative to the projection lens 110. (left or right).

An embodiment 2530 of FIG. 25 illustrates an electronic device 100 using four distance sensors. The electronic device 100 includes a first distance sensor 113-2-1, a second distance sensor 113-2-2, a third distance sensor 113-2-3, and a fourth distance sensor 113-2. -4) may be included.

In the electronic device 100-5, the first distance sensor 113-2-1 and the second distance sensor 113-2-2 are horizontally disposed, and the third distance sensor 113-2-3 and the The 4 distance sensors 113-2-4 may be arranged vertically.

26 is a diagram for explaining the offset of the projection lens 110.

Referring to FIG. 26 , an embodiment 2610 shows the arrangement of the projection lens 110 in a situation where the offset of the projection lens 110 is 0%. Embodiment 2620 shows the arrangement of the projection lens 110 in a situation where the offset of the projection lens 110 is 100%. Embodiment 2630 shows the arrangement of the projection lens 110 in a situation where the offset of the projection lens 110 is 150%. Example 2640 shows the arrangement of the projection lens 110 in a situation where the offset of the projection lens 110 is 200%. Here, the offset may be determined according to the characteristics of the projection lens 110 and may be changed by user settings of the electronic device 100 . For example, the basic offset may be set to offset 100% as in the embodiment 2620.

27 is a flowchart for explaining an operation of outputting a projected image in consideration of a ratio of the projected image.

Referring to FIG. 27 , the electronic device 100 may acquire state information of the electronic device 100 (S2705). Then, the electronic device 100 may obtain state information of the projection surface 10 (S2710).

Then, the electronic device 100 may correct the projected image based on the state information of the electronic device 100 and the state information of the projection surface 10 (S2715). Here, step S2715 may be replaced with an operation in which the electronic device 100 corrects the projected image based on at least one of state information of the electronic device 100 and state information of the projection surface 10 .

And, the electronic device 100 may acquire distance information between the electronic device 100 and the projection surface (S2720). Then, the electronic device 100 may determine the ratio of the projected image based on the obtained distance information (S2725). Then, the electronic device 100 may output the projected image based on the corrected projection image in step S2715 and the ratio determined in step S2725 (S2730).

The embodiment 2810 of FIG. 28 may mean the first distance d1 to be sensed by the first distance sensor 113-2-1. The electronic device 100 may identify the sensing size according to the distance.

Meanwhile, the sensing size according to the distance d1 may be different according to the performance of the first distance sensor 113-2-1. The electronic device 100 may store the sensing size for each distance corresponding to the performance of the first distance sensor 113-2-1. In addition, the electronic device 100 may analyze the sensing data based on the sensing size for each distance corresponding to the performance.

Here, the first distance d1 may be used as a projection distance. Meanwhile, the electronic device 100 may obtain the second distance d2 by using the second distance sensor 113-2-2 in addition to the first distance sensor 113-2-1. According to an embodiment, the electronic device 100 may determine the projection distance as one of the first distance d1 and the second distance d2. According to another embodiment, the electronic device 100 may determine the projection distance using both the first distance d1 and the second distance d2. For example, the processor 114 may determine the projection distance as an average value of the first distance d1 and the second distance d2.

In the embodiment 2820 of FIG. 28 , the projection ratio may be projection distance/image horizontal length. Here, the projection ratio may be different according to the performance (or property) of the electronic device 100, and the projection distance or image size may be determined according to the predetermined projection ratio.

In the embodiment 2830 of FIG. 28 , the horizontal length of the image may be projection distance/projection ratio. Here, if the projection ratio is determined, the horizontal length of the image may be determined according to the projection distance.

Here, the horizontal length of the image may indicate the size of the image output on the projection surface. Therefore, even if the projection ratio is the same, if the projection distance increases, the horizontal length of the image may increase.

29 is a diagram for explaining the arrangement of the first distance sensor and the second distance sensor included in the second sensor unit 113-2.

The embodiment 2910 of FIG. 29 represents a situation in which the first distance sensor 113-2-1 and the second distance sensor 113-2-2 are spaced apart by a distance d_2910. Here, the sensing angle of the first distance sensor 113-2-1 may be θ_2911, and the distance between the first distance sensor 113-2-1 and the projection surface 10 may be d_2911. Also, the sensing angle of the second distance sensor 113-2-2 may be θ_2912, and the distance between the second distance sensor 113-2-2 and the projection surface 10 may be d_2912. Here, the electronic device 100 includes a sensing angle (θ_2911) of the first distance sensor 113-2-1 and a distance (d_2911) between the first distance sensor 113-2-1 and the projection surface 10, The sensing angle (θ_2912) of the second distance sensor 113-2-2, the distance between the second distance sensor 113-2-2 and the projection surface 10 (d_2912), and the first distance sensor 113-2 -1) and the distance (d_2910) between the second distance sensor 113-2-2, the overlapping sensing distance (d_s1) may be obtained.

The embodiment 2920 of FIG. 29 shows a situation in which the first distance sensor 113-2-1 and the second distance sensor 113-2-2 are separated by a distance d_2920. Here, the sensing angle of the first distance sensor 113-2-1 may be θ_2911, and the distance between the first distance sensor 113-2-1 and the projection surface 10 may be d_2911. Also, the sensing angle of the second distance sensor 113-2-2 may be θ_2912, and the distance between the second distance sensor 113-2-2 and the projection surface 10 may be d_2912. Here, the electronic device 100 includes a sensing angle (θ_2911) of the first distance sensor 113-2-1 and a distance (d_2911) between the first distance sensor 113-2-1 and the projection surface 10, The sensing angle (θ_2912) of the second distance sensor 113-2-2, the distance between the second distance sensor 113-2-2 and the projection surface 10 (d_2912), and the first distance sensor 113-2 -1) and the distance (d_2920) between the second distance sensor 113-2-2, the overlapping sensing distance (d_s2) may be obtained.

The electronic device 100 may obtain different overlapping sensing distances according to the distance between the first distance sensor 113-2-1 and the second distance sensor 113-2-2. Here, an optimal overlapping sensing distance may exist according to the performance of the projection lens 110 . Here, the optimal overlapping sensing distance may be described as a critical range. If the redundant sensing distance is too large, calculation accuracy of sensing data acquired through the distance sensor may decrease. Therefore, an optimal overlapping sensing distance may exist according to the distance between the projection lens 110 and the projection surface 10 .

The electronic device 100 may obtain a redundant sensing distance using the first distance sensor 113-2-1 and the second distance sensor 113-2-2 at the current location. And, the electronic device 100 may identify whether the overlapping sensing distance is within a critical range. If the overlapping sensing distance is out of the critical range, the electronic device 100 uses a user interface (UI) including guide information for notifying that the current arrangement of the electronic device 100 is incorrect and guide information indicating an appropriate arrangement distance. can output The user may move the location of the electronic device 100 based on the output UI.

30 is a diagram for explaining an operation of outputting a projection image in a state in which the projection surface 10 is not rotated along the z-axis.

It is assumed that the electronic device 100 of FIG. 30 includes the first sensor unit 113-1 and does not include the second sensor unit 113-2.

A plan view 3011 of FIG. 30 shows the electronic device 100 outputting a projection image on the projection surface 10 .

A front view 3012 of FIG. 30 indicates that a projected image is output in a situation corresponding to the plan view 3011 .

In the plan view 3011, since the projection surface 10 is not rotated based on the z-axis, the projection image can be normally output even though z-axis rotation information of the projection surface 10 is not considered.

FIG. 31 is a diagram for explaining the reason for correcting a projection image in consideration of state information of the projection surface 10 in a state in which the projection surface 10 is rotated along the z-axis.

It is assumed that the electronic device 100 of FIG. 31 includes the first sensor unit 113-1 and does not include the second sensor unit 113-2.

A plan view 3111 of FIG. 31 shows that the projection surface 10 is rotated by a certain angle θ1 in the z-axis.

A front view 3112 of FIG. 31 indicates that the projected image is distorted and output in a situation corresponding to the plan view 3011 . Here, since the electronic device 100 of FIG. 31 does not include the second sensor unit 113-2, state information of the projection surface 10 may not be acquired. Therefore, the electronic device 100 cannot know that the projection surface 10 is rotated about the z-axis.

A front view 3113 of FIG. 31 shows a projected image output after a correction operation is performed in a situation corresponding to the plan view 3011 . When the electronic device 100 does not include the second sensor unit 113-2, the electronic device 100 cannot know that the projection surface 10 is rotated about the z-axis. Accordingly, the electronic device 100 may not be able to solve the problem of distortion of the projected image even if the correction operation is performed.

Therefore, the second sensor unit 113-2 may be required to completely perform the correction operation.

32 is a diagram for explaining an operation of correcting a projected image in a state in which the projection surface 10 is not rotated along the y-axis.

It is assumed that the electronic device 100 of FIG. 32 includes the first sensor unit 113-1 and does not include the second sensor unit 113-2.

A plan view 3211 of FIG. 32 indicates that the projection surface 10 is not rotated based on the y-axis and the electronic device 100 is rotated based on the y-axis.

A front view 3212 of FIG. 32 indicates that the projected image is distorted and output in the situation of the plan view 3211 .

A front view 3213 of FIG. 32 shows a projected image output after a correction operation is performed in a situation corresponding to the plan view 3211 . Since the electronic device 100 does not include the second sensor unit 113-2, the projected image is corrected by considering only the state information of the electronic device 100 without considering the state information of the projection surface 10. . Here, since the projection surface 10 is not rotated on the basis of the y-axis, the projected image can be normally output even if the electronic device 100 corrects the projected image by considering only state information of the electronic device 100 .

FIG. 33 is a diagram for explaining the reason for correcting a projection image in consideration of state information of the projection surface 10 in a state in which the projection surface 10 is rotated along the y-axis.

The embodiment 3310 of FIG. 33 assumes that the electronic device 100 includes only the first sensor unit 113-1 and does not include the second sensor unit 113-2.

A side view 3311 of the embodiment 3310 indicates that the projection surface 10 is rotated by a predetermined angle θ2 based on the y-axis and the electronic device 100 is also rotated by a predetermined angle (not shown) based on the y-axis.

The front view 3312 of the embodiment 3310 indicates that the projected image is distorted and output in the situation of the side view 3311 .

A front view 3313 of the embodiment 3310 represents a projected image output after a correction operation is performed in the situation of the side view 3311 . Since the electronic device 100 of the embodiment 3310 does not include the second sensor unit 113-2, information about the y-axis rotation of the projection surface 10 cannot be obtained. Therefore, the electronic device 100 cannot perform a correction operation in consideration of the state information of the projection surface 10 . The electronic device 100 may perform a correction operation by considering only state information of the electronic device 100 . Accordingly, some distortion may remain in the projected image output from the plan view 3313 .

In the embodiment 3320 of FIG. 33 , it is assumed that the electronic device 100 includes both the first sensor unit 113-1 and the second sensor unit 113-2.

A side view 3321 of the embodiment 3320 indicates that the projection surface 10 is rotated by a predetermined angle θ2 based on the y-axis and the electronic device 100 is also rotated by a predetermined angle (not shown) based on the y-axis.

The front view 3322 of the embodiment 3320 indicates that the projected image is distorted and output in the situation of the side view 3321 .

A front view 3323 of the embodiment 3320 represents a projected image output after a correction operation is performed in the situation of a side view 3321 . Since the electronic device 100 of the embodiment 3320 includes the second sensor unit 113-2, it is possible to obtain y-axis rotation information of the projection surface 10. Accordingly, the electronic device 100 may perform a correction operation considering both the state information of the electronic device 100 and the state information of the projection surface 10 . Accordingly, distortion may not exist in the projected image output from the plan view 3323 .

Referring to FIG. 34 , the electronic device 100 may identify a projection area on the projection surface 10 (S3405). Then, the electronic device 100 may obtain a fourth distance between the first distance sensor 113-2-1 and the projection area (S3410). Here, the fourth distance may correspond to d4 of FIG. 35 .

Then, the electronic device 100 may obtain a fifth distance between the second distance sensor 113-2-2 and the projection area (S3415). Here, the fifth distance may correspond to d5 of FIG. 34 .

And, the electronic device 100 can identify whether the fifth distance is smaller than the fourth distance (S3420). If the fifth distance is smaller than the fourth distance (S3420-Y), the electronic device 100 may determine the focus based on the sensing data obtained from the second distance sensor 113-2-2 (S3425). Here, the sensing data acquired by the second distance sensor 113-2-2 is the second distance d2 between the second distance sensor 113-2-2 and the projection surface 10 or the second distance sensor ( 113-2-2) and the fifth distance d5 between the projection areas. That is, the electronic device 100 may determine the focus based on the proximity sensor in the projection area. Here, the focal point may mean a focal point used to output a projected image. According to an implementation example, the electronic device 100 may determine the focus using the fifth distance d5.

If the fifth distance is not smaller than the fourth distance (S3420-N), the electronic device 100 may determine the focus based on the sensing data obtained from the first distance sensor 113-2-1 (S3430). Here, the sensing data acquired by the first distance sensor 113-2-1 is the first distance d1 between the first distance sensor 113-2-1 and the projection surface 10 or the first distance sensor ( 113-2-1) and the fourth distance d4 between the projection areas. That is, the electronic device 100 may determine the focus based on the proximity sensor in the projection area. Here, the focal point may mean a focal point used to output a projected image. According to an implementation example, the electronic device 100 may determine the focus using the fourth distance d4.

Referring to the embodiment 3511 of FIG. 35 , the electronic device 100 may determine the projection area 3501 by avoiding the obstacle object 30 on the projection surface 10 . Here, the obstacle object 30 may mean an object that is not suitable for outputting a projection image. For example, the obstacle object 30 may mean a picture frame, a glass window, and the like. The first distance sensor 113-2-1 may acquire the distance d1 between the first distance sensor 113-2-1 and the projection surface 10 . Also, the first distance sensor 113-2-1 may acquire the distance d4 between the first distance sensor 113-2-1 and the projection area 3501 . The second distance sensor 113-2-2 may acquire the distance d2 between the second distance sensor 113-2-2 and the projection surface 10 . Also, the second distance sensor 113-2-2 may acquire the distance d5 between the second distance sensor 113-2-2 and the projection area 3501 .

A front view 3512 of FIG. 35 indicates that the projection image 3502 is output without considering the obstacle object 30 . When the electronic device 100 determines the projection area without considering the obstacle object 30, the position of the obstacle object 30 and the projection area may overlap.

A front view 3513 of FIG. 35 indicates that a projection image 3503 is output considering the obstacle object 30 . The electronic device 100 may identify the projection area 3501 by considering the position of the obstacle object 30 . Here, the projection area 3501 may mean an area in which the obstacle object 30 is not located on the projection surface 10 . And, the electronic device 100 may output a projection image 3503 to the identified projection area 3501 .

Referring to FIG. 36 , steps S3605, S3610, S3615, and S3620 may correspond to steps S3405, S3410, S3415, and S3420, so duplicate descriptions are omitted.

If the fifth distance is smaller than the fourth distance (S3620-Y), the electronic device 100 assigns the first distance sensor 113-2-1 to the sensing data obtained from the second distance sensor 113-2-2. The focus may be determined by assigning a greater weight than the sensing data obtained in .

If the fifth distance is not smaller than the fourth distance (S3620-N), the electronic device 100 transmits the sensing data obtained from the first distance sensor 113-2-1 to the second distance sensor 113-2-2. The focus may be determined by assigning a greater weight than the sensing data obtained in .

Here, since the sensing data obtained from the first distance sensor 113-2-1 and the sensing data obtained from the second distance sensor 113-2-2 have been described in FIG. 34 , redundant descriptions will be omitted.

Referring to FIG. 37, the embodiment 3711, the front view 3712, and the front view 3713 may correspond to the embodiment 3511, the front view 3512, and the front view 3513 of FIG. omit the explanation.

Equation 3714 of FIG. 37 represents a process of calculating a weight for determining a focus according to a location of an identification area 3701 . W1 is a first weight applied to the sensing data obtained from the first distance sensor 113-2-1, and W2 is a second weight applied to the sensing data obtained from the second distance sensor 113-2-2. can

Here, as shown in the front view 3712, 'a' may mean the horizontal length of the entire area where the projected image can be output. Accordingly, '2/a' may mean half of the horizontal length of the entire area in which the projected image can be output. According to another implementation example, the horizontal length of the entire area on which the projection image can be output may be replaced with the horizontal length of the projection surface 10 .

Here, 'b' may mean a distance by which the projection area 3701 or the projection image 3703 in the front view 3713 is moved from the center toward the second distance sensor 113-2-2.

Here, the first weight W1 applied to the sensing data obtained from the first distance sensor 113-2-1 is 'a/2-b' and obtained from the second distance sensor 113-2-2. The second weight W2 applied to one sensed data may be 'a/2+b'. Accordingly, when the distance (b) of the projection area 3701 moved in the direction of the second distance sensor 113-2-2 increases, the sensing data acquired from the second distance sensor 113-2-2 is given a greater weight. can be applied

38 is a diagram for explaining an operation of determining a focus based on a distance between a projection area and a distance sensor in a state in which the projection surface 10 is rotated along the z-axis.

Since the embodiment 3811 of FIG. 38 may correspond to the embodiment 3511 of FIG. 35, redundant description is omitted. However, unlike the embodiment 3511 of FIG. 35 , the embodiment 3811 indicates that the projection surface 10 is rotated by a certain angle θ1 based on the z-axis.

A front view 3812 of FIG. 38 shows that the projected image 3802 is output without considering the obstacle object 30 . When the electronic device 100 determines the projection area without considering the obstacle object 30, the position of the obstacle object 30 and the projection area may overlap. A front view 3812 of FIG. 38 shows that a projected image is output in a state in which keystone correction is not performed without considering the position of the obstacle object 30 .

A front view 3813 of FIG. 38 indicates that a projection image 3803 is output considering the obstacle object 30 . The electronic device 100 may identify the projection area 3801 by considering the position of the obstacle object 30 . Here, the projection area 3801 may mean an area in which the obstacle object 30 is not located on the projection surface 10 . And, the electronic device 100 may output a projection image 3803 to the identified projection area 3801 . A front view 3813 of FIG. 38 indicates that a projection area is identified in consideration of the position of the obstacle object 30 and a projection image on which keystone correction is performed is output to the identified projection area.

39 is a flowchart for explaining an operation of controlling the second sensor unit 113-2 according to whether a lens shift function is performed.

Referring to FIG. 39 , the electronic device 100 may acquire state information of the electronic device 100 through the first sensor unit 113-1 (S3905). And, the electronic device 100 may identify whether the lens shift function is performed (S3910).

When the lens shift function is performed (S3910-Y), the electronic device 100 may move the second sensor unit 113-2 based on movement information corresponding to the lens shift (S3915). Here, the movement information corresponding to the lens shift may include the degree to which the projection angle of the projection lens 110 is changed. Accordingly, an operation of moving the second sensor unit 113-2 may mean an operation of changing a divergence (or output) angle of light emitted from the light emitting unit from the second sensor unit 113-2. Here, “moving” may be described as “shifting”.

For example, when the projection angle of the projection lens 110 is moved to the right by 5 degrees, the electronic device 100 determines the emission angle (or output angle) of the distance sensor included in the second sensor unit 113-2. can be moved to the right by the same 5 degrees.

Then, the electronic device 100 may acquire state information of the projection surface 10 through the second sensor unit 113-2 after moving the second sensor unit 113-2 (S3920).

On the other hand, if the lens shift function is not performed (S3910-N), state information of the projection surface 10 may be obtained directly through the second sensor unit 113-2 (S3920).

Then, the electronic device 100 may correct the projected image based on the state information of the electronic device 100 and the state information of the projection surface 10 (S3925). Here, operation S3925 may be replaced with an operation of correcting the projected image based on at least one of state information of the electronic device 100 and state information of the projection surface 10 .

And, the electronic device 100 may output the corrected projection image (S3930).

40 is a diagram for explaining an operation of controlling the second sensor unit 113-2 according to the lens shift function.

An embodiment 4010 of FIG. 40 shows a state in which the lens shift function is not performed. A side view 4011 shows that the lens shift function is not performed in the embodiment 4010 so that a projected image is output in parallel to the projection surface 10 through the projection lens 110 . A front view 4012 shows a projection image output parallel to the projection surface 10 based on the embodiment 4010 . Since it is assumed that the projection surface 10 is not rotated and the lens shift function is not performed, distortion may not exist in the projected image.

The embodiment 4020 of FIG. 40 shows a state in which the projection lens 110 is shifted downward as a lens shift function is performed. A side view 4021 shows that a lens shift function is performed in the embodiment 4020 to output a projected image to a region below the projection surface 10 through the projection lens 110 . A front view 4022 shows a projection image output to an area under the projection surface 10 based on the embodiment 4020 .

The embodiment 4030 of FIG. 40 shows a state in which the projection lens 110 is shifted upward as a lens shift function is performed. A side view 4031 shows that a lens shift function is performed in the embodiment 4030 to output a projection image to an area above the projection surface 10 through the projection lens 110 . A front view 4032 shows a projection image output to an area above the projection surface 10 based on the embodiment 4030 .

In the

embodiments

4020 and 4030, it is assumed that the projection surface 10 is not rotated but the lens shift function is performed. Therefore, some distortion may exist in the projected image. Accordingly, a separate correction operation may be performed according to the lens shift function. In order to accurately perform the correction operation, it is necessary to move the second sensor unit 113-2 to correspond to the lens shift function.

41 is a flowchart for explaining an operation of correcting a projected image based on x-axis rotation information of the projection surface 10. Referring to FIG.

Referring to FIG. 41 , the electronic device 100 may output a test image (S4105). Here, the test image may refer to a projected image initially projected. According to an embodiment, the test image may refer to a pre-stored image. Here, the pre-stored image is an image displayed for a correction operation and may mean an image including a brand logo or a predetermined pattern. According to another embodiment, the test image may mean a projected image that a user wants to output.

Here, the electronic device 100 may acquire a captured image in which the test image is output on the projection surface 10 (S4110). Specifically, the electronic device 100 may include a camera, and may capture an image of the projection surface 10 located in front of the electronic device 100 through the camera. Here, a projected image output by the electronic device 100 may be output on the projection surface 10 . Accordingly, the captured image obtained by the electronic device 100 through the camera may include the projection surface 10 on which the projected image is output.

Here, the electronic device 100 may acquire x-axis rotation information of the projection surface 10 based on the captured image (S4115). And, the electronic device 100 may correct the projection image based on the x-axis rotation information of the projection surface 10 (S4120). Here, the electronic device 100 may perform leveling correction on the projection image based on the x-axis rotation information of the projection surface 10 . And, the electronic device 100 may output a projected image (S4125).

42 is a diagram for explaining an operation of correcting a projected image based on x-axis rotation information of the projection surface 10. Referring to FIG.

The embodiment 4210 of FIG. 42 indicates that the electronic device 100 outputs the projection image 4211 without considering the state in which the projection surface 10 is rotated about the x-axis. It is assumed that the projection surface 10 is rotated about the x-axis by a certain angle θ3. Even though the projection surface 10 is rotated based on the x-axis, the electronic device 100 can output the projection image 4211 as it is. Here, the projection image 4211 may not be parallel to the projection surface 10 . If the projection surface 10 and the output projection image are not parallel, the user may feel eye fatigue. Accordingly, an image correction operation may be required so that the projection surface 10 and the output projection image are parallel.

The embodiment 4220 of FIG. 42 indicates that the electronic device 100 outputs a projection image 4221 in consideration of a state in which the projection surface 10 is rotated about the x-axis. It is assumed that the projection surface 10 is rotated about the x-axis by a certain angle θ3. Since the projection surface 10 is rotated on the basis of the x-axis, the electronic device 100 can obtain x-axis rotation information of the projection surface 10 and project projection surface 10 based on the x-axis rotation information. A correction operation may be performed on the image. Specifically, the electronic device 100 may perform a leveling correction operation on the projection image based on the x-axis rotation information of the projection surface 10 . Here, the corrected projection image 4221 may be output with the projection surface 10 parallel to it.

43 is a flowchart for explaining a control method of the electronic device 100 according to an embodiment.

Referring to FIG. 43 , the control method of the electronic device 100 including the first sensor unit 113-1 and the second sensor unit 113-2 is obtained through the first sensor unit 113-1. Acquiring state information of the electronic device 100 based on the sensing data, acquiring state information of the projection surface 10 based on the sensing data obtained through the second sensor unit 113-2, Correcting the projection image based on the state information of the device 100 and the state information of the projection surface 10 and outputting the corrected projection image to the projection surface 10 are included.

On the other hand, the state information of the electronic device 100 includes x-axis rotation information and y-axis rotation information of the electronic device 100, and the state information of the projection surface 10 is the projection surface 10 It may include y-axis rotation information of and z-axis rotation information of the projection surface 10.

On the other hand, the step of correcting the projected image is leveling and correcting the projected image based on the x-axis rotation information of the electronic device 100, the y-axis rotation information of the electronic device 100 and the y-axis rotation information of the projection surface 10 And based on the z-axis rotation information of the projection surface 10, the projection image may be keystone corrected.

Meanwhile, the second sensor unit 113-2 includes a first distance sensor 113-2-1 and a second distance sensor 113-2-2, and obtains state information of the projection surface 10. The first distance between the first distance sensor 113-2-1 and the projection surface 10 obtained from the first distance sensor 113-2-1 and the second distance sensor 113-2-2 State information of the projection surface 10 may be obtained based on the second distance between the projection surface 10 and the second distance sensor 113-2-2 obtained from .

Meanwhile, the second sensor unit 113-2 further includes a third distance sensor 113-2-3, and the step of acquiring state information of the projection surface 10 includes the first distance sensor 113-2-3. Based on the first distance obtained from 1) and the second distance obtained from the second distance sensor 113-2-2, z-axis rotation information of the projection surface 10 is obtained, and the first distance or the second distance Obtain y-axis rotation information of the projection surface 10 based on at least one of the distances and the third distance between the third distance sensor 113-2-3 and the projection surface 10 obtained from the third distance sensor can do.

On the other hand, the control method includes the step of identifying a projection area where a projection image is projected on the projection surface 10, from the first distance sensor 113-2-1 to the first distance sensor 113-2-1 and the projection area. Obtaining a fourth distance between the corresponding positions, obtaining a fifth distance between the second distance sensor 113-2-2 and the position corresponding to the projection area from the second distance sensor 113-2-2 The method may further include determining a focus of the electronic device 100 based on the fourth and fifth distances.

Meanwhile, in the step of determining the focus, a distance sensor corresponding to a smaller distance among the fourth and fifth distances is identified, and a larger weight is given to sensing data obtained from the identified distance sensor to determine the focus of the electronic device 100. In the step of determining and outputting a projected image, a projected image corrected based on the determined focus of the electronic device 100 may be output to the projection surface 10 .

Meanwhile, when a lens shift function is performed with respect to the projection lens 110 of the electronic device 100, the control method uses the second sensor unit 113-2 based on movement information corresponding to the lens shift function. A step of moving may be further included.

Meanwhile, the control method includes obtaining a projection distance between the electronic device 100 and the projection surface 10 through the second sensor unit 113-2, and calculating a corrected projection image ratio based on the acquired projection distance. The step of determining and outputting the projected image corrected based on the determined ratio to the projection surface 10 may be further included.

Meanwhile, the first sensor unit 113-1 may include at least one of a gravity sensor, an acceleration sensor, and a gyro sensor, and the second sensor unit 113-2 may include at least one ToF sensor.

Meanwhile, the method of controlling an electronic device as shown in FIG. 43 may be executed on an electronic device having the configuration of FIG. 2 or 3 and may also be executed on an electronic device having other configurations.

Meanwhile, the methods according to various embodiments of the present disclosure described above may be implemented in the form of an application that can be installed in an existing electronic device.

In addition, the methods according to various embodiments of the present disclosure described above may be implemented only by upgrading software or hardware of an existing electronic device.

In addition, various embodiments of the present disclosure described above may be performed through an embedded server included in an electronic device or an external server of at least one of an electronic device and a display device.

Meanwhile, according to an exemplary embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage media (eg, a computer). can A device is a device capable of calling a stored command from a storage medium and operating according to the called command, and may include an electronic device according to the disclosed embodiments. When a command is executed by a processor, the processor may perform a function corresponding to the command directly or by using other components under the control of the processor. An instruction may include code generated or executed by a compiler or interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium does not contain a signal and is tangible, but does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

Also, according to an embodiment of the present disclosure, the method according to the various embodiments described above may be included in a computer program product and provided. Computer program products may be traded between sellers and buyers as commodities. The computer program product may be distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)) or online through an application store (eg Play Store™). In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

In addition, each of the components (eg, modules or programs) according to various embodiments described above may be composed of a single object or a plurality of entities, and some sub-components among the aforementioned sub-components may be omitted, or other sub-components may be used. Components may be further included in various embodiments. Alternatively or additionally, some components (eg, modules or programs) may be integrated into one entity and perform the same or similar functions performed by each corresponding component prior to integration. According to various embodiments, operations performed by modules, programs, or other components may be executed sequentially, in parallel, repetitively, or heuristically, or at least some operations may be executed in a different order, may be omitted, or other operations may be added. can

Although the preferred embodiments of the present disclosure have been shown and described above, the present disclosure is not limited to the specific embodiments described above, and is common in the technical field belonging to the present disclosure without departing from the gist of the present disclosure claimed in the claims. Of course, various modifications and implementations are possible by those with knowledge of, and these modifications should not be individually understood from the technical spirit or perspective of the present disclosure.

Claims

In electronic devices,

projection unit;

a first sensor unit;

a second sensor unit; and

obtaining state information of the electronic device based on sensing data acquired through the first sensor unit;

obtaining state information of a projection surface based on sensing data obtained through the second sensor unit;

Correcting a projected image based on state information of the electronic device and state information of the projection surface;

and a processor controlling the projection unit to output the corrected projection image to the projection surface.
According to claim 1,

State information of the electronic device,

Including x-axis rotation information and y-axis rotation information of the electronic device,

State information of the projection surface,

Electronic device comprising y-axis rotation information of the projection surface and z-axis rotation information of the projection surface.
According to claim 2,

the processor,

Leveling and correcting the projected image based on x-axis rotation information of the electronic device;

and keystone correcting the projected image based on y-axis rotation information of the electronic device, y-axis rotation information of the projection surface, and z-axis rotation information of the projection surface.
According to claim 1,

The second sensor unit,

a first distance sensor and a second distance sensor;

the processor,

Based on the first distance between the first distance sensor and the projection surface obtained from the first distance sensor and the second distance between the second distance sensor and the projection surface obtained from the second distance sensor, the projection surface An electronic device that acquires state information of.
According to claim 4,

The second sensor unit,

Further comprising a third distance sensor;

the processor,

obtaining z-axis rotation information of the projection surface based on a first distance obtained from the first distance sensor and a second distance obtained from the second distance sensor;

Obtaining y-axis rotation information of the projection surface based on at least one of the first distance and the second distance and a third distance between the third distance sensor and the projection surface obtained from the third distance sensor to do, electronic devices.
According to claim 4,

the processor,

identifying a projection area where the projection image is projected on the projection surface;

obtaining a fourth distance between the first distance sensor and a position corresponding to the projection area from the first distance sensor;

obtaining a fifth distance between the second distance sensor and a position corresponding to the projection area from the second distance sensor;

An electronic device that determines a focus of the electronic device based on the fourth distance and the fifth distance.
According to claim 6,

the processor,

Identifying a distance sensor corresponding to a smaller distance among the fourth distance and the fifth distance;

determining a focus of the electronic device by assigning a higher weight to sensing data acquired from the identified distance sensor;

and outputs the corrected projection image to the projection surface based on the determined focus of the electronic device.
According to claim 1,

the projection unit,

Includes a projection lens;

the processor,

When a lens shift function is performed on the projection lens, the electronic device moves the second sensor unit based on movement information corresponding to the lens shift function.
According to claim 1,

the processor,

Obtaining a projection distance between the electronic device and the projection surface through the second sensor unit;

determining a ratio of the corrected projection image based on the obtained projection distance;

and controlling the projection unit to output the corrected projection image to the projection surface based on the determined ratio.
According to claim 1,

The first sensor unit,

At least one of a gravity sensor, an acceleration sensor, or a gyro sensor;

The second sensor unit,

An electronic device comprising at least one ToF sensor.
A control method of an electronic device including a first sensor unit and a second sensor unit,

obtaining state information of the electronic device based on sensing data acquired through the first sensor unit;

obtaining state information of a projection surface based on sensing data acquired through the second sensor unit;

correcting a projection image based on state information of the electronic device and state information of the projection surface; and

and outputting the corrected projection image to the projection surface.
According to claim 11,

State information of the electronic device,

Including x-axis rotation information and y-axis rotation information of the electronic device,

State information of the projection surface,

y-axis rotation information of the projection surface and z-axis rotation information of the projection surface.
According to claim 12,

In the step of correcting the projected image,

Leveling and correcting the projected image based on x-axis rotation information of the electronic device;

and performing keystone correction on the projected image based on y-axis rotation information of the electronic device, y-axis rotation information of the projection surface, and z-axis rotation information of the projection surface.
According to claim 11,

The second sensor unit,

a first distance sensor and a second distance sensor;

Obtaining state information of the projection surface,

Based on a first distance between the first distance sensor and the projection surface obtained from the first distance sensor and a second distance between a second distance sensor and the projection surface obtained from the second distance sensor, the projection surface Obtaining state information of, a control method.
According to claim 14,

The second sensor unit,

further comprising a third distance sensor;

Obtaining state information of the projection surface,

obtaining z-axis rotation information of the projection surface based on a first distance obtained from the first distance sensor and a second distance obtained from the second distance sensor;

Obtaining y-axis rotation information of the projection surface based on at least one of the first distance and the second distance and a third distance between the third distance sensor and the projection surface obtained from the third distance sensor How to do, control.