KR20230045357A - Electronic apparatus and controlling method thereof - Google Patents

Abstract

An electronic device of the present invention includes: a projection unit; a sensor unit; and a processor controlling the projection unit to output a projected image, identifying the location of each of a plurality of users and the location of an obstacle based on sensing data acquired through the sensor unit, identifying the projection direction based on the location of each of the plurality of users, identifying a projection area based on the location of the obstacle and the identified projection direction, and controlling the projection unit to rotate and output the projected image based on the projection direction and projection area.

Description

Electronic device and its control method {ELECTRONIC APPARATUS AND CONTROLLING METHOD THEREOF}

The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device for identifying a projection direction and a projection area in consideration of a plurality of user positions and obstacle positions, and a control method thereof.

The electronic device may output an image on a screen or projection surface. People or obstacles may exist in the projection space. Therefore, when an image is projected at an arbitrary location, there is a problem in that some images are overlapped with people or obstacles.

In order to solve this problem, the user has to directly change the arrangement position of the electronic device or manually change the projection direction of the lens, which is inconvenient.

In addition, when the electronic device is installed on the ceiling or at a high location, it is difficult for the user to manually operate the electronic device.

The present disclosure has been devised to improve the above problems, and an object of the present disclosure is to determine a projection direction in consideration of a user's location, identify a projection area in consideration of the projection direction and the position of an obstacle, and determine the projection direction and projection area. It is an object of the present invention to provide an electronic device that outputs a projected image based on the present invention and a method for controlling the same.

An electronic device according to the present embodiment for achieving the above object controls the projection unit to output a projection unit, a sensor unit, and a projected image, and based on sensing data obtained through the sensor unit, a plurality of user positions and Identify the location of an obstacle, identify a projection direction based on the location of each of the plurality of users, identify a projection area based on the location of the obstacle and the identified projection direction, and determine the projection direction and the projection area and a processor controlling the projection unit to rotate and output the projected image based on the projected image.

Meanwhile, the processor may predict the gaze direction of each of the plurality of users based on the location of each of the plurality of users, and identify the projection direction based on the average direction of the gaze directions of each of the plurality of users.

Meanwhile, the processor identifies the shape of the projection surface, identifies the projection direction in units of 90 degrees if the shape of the projection surface is perpendicular, and identifies the projection direction in units of 1 degree if the shape of the projection surface is circular. can

Meanwhile, the sensor unit may include a voice sensor and a Time of Flight (ToF) sensor, and the processor identifies the location of each of the plurality of users and the location of the obstacle based on sensing data acquired through the ToF sensor. And, based on the sensing data obtained through the voice sensor, the location of each of the plurality of users can be identified.

Meanwhile, the sensor unit may include a camera, and the processor identifies a position of each of the plurality of users and a gaze direction of each of the plurality of users based on a photographed image obtained through the camera, and the plurality of users The projection direction may be identified based on each location and the gaze direction of each of the plurality of users.

Meanwhile, the processor identifies a plurality of pattern objects included in the projection surface based on sensing data acquired through the sensor unit, divides the projection surface into a plurality of areas based on the plurality of pattern objects, and Among the areas, one area corresponding to the projection direction may be identified as the projection area.

Meanwhile, the processor may identify one of the plurality of areas as a projection area based on the color, size, or relative position of each of the plurality of pattern objects.

Meanwhile, the processor obtains a first projection image of a first resolution based on the size of the projection area, and obtains a second projection image of a second resolution when the size of the first projection image is less than a threshold value; When the size of the second projection image is greater than or equal to a threshold value, the projection unit may be controlled to output the second projection image to the projection area.

Meanwhile, when a plurality of projection directions are identified based on the location of each of the plurality of users, the processor may control the projection unit to output a guide UI for selecting one projection direction among the plurality of projection directions.

Meanwhile, the guide UI may include a plurality of UIs representing each of a plurality of projection directions, and the processor controls the projection unit to output each of the plurality of UIs in a rotated state based on each of the plurality of projection directions. can do.

A control method of an electronic device including a sensor unit according to the present embodiment includes outputting a projected image, identifying locations of a plurality of users and obstacles based on sensing data obtained through the sensor unit, and the plurality of Identifying a projection direction based on the position of each user of the screen, identifying a projection area based on the location of the obstacle and the identified projection direction, and rotating the projection image based on the projection direction and the projection area. It includes the step of outputting.

Meanwhile, the identifying of the projection direction may include predicting the gaze direction of each of the plurality of users based on the location of each of the plurality of users, and determining the projection direction based on the average direction of the gaze directions of each of the plurality of users. can be identified.

Meanwhile, the control method may further include identifying a shape of the projection surface, and identifying the projection direction may include identifying the projection direction in units of 90 degrees when the shape of the projection surface is perpendicular. If the shape of is circular, the projection direction can be identified in units of 1 degree.

Meanwhile, the sensor unit may include a voice sensor and a Time of Flight (ToF) sensor, and identifying the location of each of a plurality of users and the location of an obstacle may include the plurality of users based on sensing data obtained through the ToF sensor. The location of each user and the location of the obstacle may be identified, and the location of each of the plurality of users may be identified based on sensing data obtained through the voice sensor.

Meanwhile, the sensor unit may include a camera, and the identifying the position of each of the plurality of users may include the position of each of the plurality of users and the gaze of each of the plurality of users based on a photographed image obtained through the camera. A direction may be identified, and in the identifying of the projection direction, the projection direction may be identified based on the position of each of the plurality of users and the gaze direction of each of the plurality of users.

Meanwhile, the method may further include identifying a plurality of pattern objects included in the projection surface based on sensing data obtained through the sensor unit, and dividing the projection surface into a plurality of regions based on the plurality of pattern objects. In the identifying of the projection area, one area corresponding to the projection direction among the plurality of areas may be identified as the projection area.

Meanwhile, in the identifying the projection area, one area among the plurality of areas may be identified as the projection area based on the color, size, or relative position of each of the plurality of pattern objects.

Meanwhile, the control method may include obtaining a first projection image of a first resolution based on the size of the projection area, and obtaining a second projection image of a second resolution if the size of the first projection image is less than a threshold value. and outputting the second projection image to the projection area when the size of the second projection image is greater than or equal to a threshold value.

Meanwhile, the control method may further include outputting a guide UI for selecting one projection direction from among the plurality of projection directions when a plurality of projection directions are identified based on the location of each of the plurality of users. .

Meanwhile, the guide UI may include a plurality of UIs representing each of a plurality of projection directions, and outputting the guide UI may include outputting each of the plurality of UIs in a rotated state based on each of the plurality of projection directions. can do.

1 is a perspective view illustrating an external appearance of an electronic device according to an embodiment of the present disclosure.
2A is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure.
FIG. 2B is a block diagram showing the configuration of the electronic device of FIG. 2A in detail.
3 is a perspective view illustrating an external appearance of an electronic device according to other embodiments of the present disclosure.
4 is a perspective view illustrating an external appearance of an electronic device according to another embodiment of the present disclosure.
5 is a perspective view illustrating an external appearance of an electronic device according to another embodiment of the present disclosure.
6A is a perspective view illustrating an external appearance of an electronic device according to another embodiment of the present disclosure.
6B is a perspective view illustrating a rotated state of the electronic device of FIG. 6A.
7 is a flowchart illustrating a projection operation of an electronic device.
8 is a diagram for explaining an operation of identifying a projection direction in consideration of a location of one user according to an exemplary embodiment.
9 is a diagram for explaining an operation of identifying a projection direction in consideration of a location of one user according to another embodiment.
10 is a flowchart illustrating an operation of identifying a projection direction in consideration of locations of a plurality of users.
11 is a flowchart illustrating an operation of identifying a projection direction in consideration of positions of a plurality of groups.
12 is a diagram for explaining an operation of identifying a projection direction in consideration of locations of a plurality of users according to an exemplary embodiment.
13 is a diagram for explaining an operation of identifying a projection direction in consideration of locations of a plurality of users according to another embodiment.
14 is a diagram for explaining an operation of identifying a projection direction in consideration of locations of a plurality of users according to another embodiment.
15 is a diagram for explaining an operation of identifying a projection direction in consideration of locations of a plurality of users according to another embodiment.
16 is a flowchart for explaining an operation of projecting in consideration of the positions of a user and an obstacle.
17 is a diagram for explaining an operation of projecting in consideration of the positions of a user and an obstacle.
18 is a flowchart for explaining an operation of determining a resolution of a projected image.
19 is a diagram for explaining an operation of determining a resolution of a projected image.
20 is a flowchart for explaining an operation of determining an optimal resolution according to the size of a projected image.
21 is a diagram for explaining an operation of determining an optimal resolution according to the size of a projected image.
22 is a flowchart for explaining an operation of determining a projection area according to a pattern existing on a projection surface.
23 is a flowchart illustrating an operation of determining a projection area in consideration of a pattern existing on a projection surface, according to an exemplary embodiment.
24 is a flowchart illustrating an operation of determining a projection area in consideration of a pattern existing on a projection surface according to another embodiment.
25 is a flowchart illustrating an operation of determining a projection area in consideration of a pattern existing on a projection surface according to another embodiment.
26 is a flowchart illustrating an operation of outputting a guide UI when a plurality of projection directions are identified.
27 is a diagram for explaining a case in which a plurality of projection directions are identified according to an exemplary embodiment.
28 is a diagram for explaining a case in which a plurality of projection directions are identified according to another embodiment.
29 is a diagram for explaining an operation of outputting a guide UI according to an embodiment.
30 is a diagram for explaining an operation of outputting a guide UI according to another embodiment.
31 is a diagram for explaining an operation of outputting a guide UI according to another embodiment.
32 is a diagram for explaining an operation of outputting a guide UI according to another embodiment.
Referring to FIG. 33 , it is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

The terms used in the embodiments of the present disclosure have been selected from general terms that are currently widely used as much as possible while considering the functions in the present disclosure, but they may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technologies, and the like. . In addition, in a specific case, there is also a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the disclosure. Therefore, terms used in the present disclosure should be defined based on the meaning of the term and the general content of the present disclosure, not simply the name of the term.

In this specification, expressions such as “has,” “can have,” “includes,” or “can include” indicate the existence of a corresponding feature (eg, numerical value, function, operation, or component such as a part). , which does not preclude the existence of additional features.

The expression at least one of A and/or B should be understood to denote either "A" or "B" or "A and B".

Expressions such as "first," "second," "first," or "second," as used herein, may modify various components regardless of order and/or importance, and may refer to one component It is used only to distinguish it from other components and does not limit the corresponding components.

A component (e.g., a first component) is "(operatively or communicatively) coupled with/to" another component (e.g., a second component); When referred to as "connected to", it should be understood that an element may be directly connected to another element, or may be connected through another element (eg, a third element).

Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "comprise" or "consist of" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other It should be understood that the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof is not precluded.

In the present disclosure, a “module” or “unit” performs at least one function or operation, and may be implemented in hardware or software or a combination of hardware and software. In addition, a plurality of "modules" or a plurality of "units" are integrated into at least one module and implemented by at least one processor (not shown), except for "modules" or "units" that need to be implemented with specific hardware. It can be.

In this specification, the term user may refer to a person using an electronic device or a device (eg, an artificial intelligence electronic device) using an electronic device.

Hereinafter, an embodiment of the present disclosure will be described in more detail with reference to the accompanying drawings.

1 is a perspective view illustrating an external appearance of an electronic device 100 according to an embodiment of the present disclosure.

Referring to FIG. 1 , the electronic device 100 may include a head 103, a body 105, a projection lens 110, a connector 130, or a cover 107.

The electronic device 100 may be a device of various types. In particular, the electronic device 100 may be a projector device that enlarges and projects an image onto a wall or a screen, and the projector device may be an LCD projector or a digital light processing (DLP) projector using a digital micromirror device (DMD). .

In addition, the electronic device 100 may be a home or industrial display device, or a lighting device used in daily life, a sound device including a sound module, a portable communication device (eg, a smartphone), It may be implemented as a computer device, a portable multimedia device, a wearable device, or a home appliance. Meanwhile, the electronic device 100 according to an embodiment of the present disclosure is not limited to the above-described devices, and the electronic device 100 may be implemented as an electronic device 100 having two or more functions of the above-described devices. For example, the electronic device 100 may be used as a display device, a lighting device, or a sound device by turning off a projector function and turning on a lighting function or a speaker function according to manipulation of a processor, and AI including a microphone or communication device. Can be used as a speaker.

The main body 105 is a housing that forms an exterior, and may support or protect components (eg, the components shown in FIG. 2B ) of the electronic device 100 disposed inside the main body 105 . The body 105 may have a structure close to a cylindrical shape as shown in FIG. 1 . However, the shape of the main body 105 is not limited thereto, and according to various embodiments of the present disclosure, the main body 105 may be implemented in various geometric shapes such as a column, a cone, and a sphere having a polygonal cross section.

The size of the main body 105 may be a size that a user can hold or move with one hand, may be implemented in a very small size for easy portability, and may be implemented in a size that can be placed on a table or coupled to a lighting device.

The material of the main body 105 may be implemented with matte metal or synthetic resin so as not to be stained with user's fingerprints or dust, or the exterior of the main body 105 may be made of a smooth gloss.

A friction area may be formed on a portion of the exterior of the body 105 so that a user can grip and move the main body 105 . Alternatively, the main body 105 may be provided with a bent gripping portion or a support 108a (see FIG. 3 ) that the user can grip in at least a portion of the area.

The projection lens 110 is formed on one surface of the main body 105 to project light passing through the lens array to the outside of the main body 105 . The projection lens 110 of various embodiments may be an optical lens coated with low dispersion in order to reduce chromatic aberration. The projection lens 110 may be a convex lens or a condensing lens, and the projection lens 110 according to an embodiment may adjust the focus by adjusting the positions of a plurality of sub-lenses.

The head 103 is provided to be coupled to one surface of the main body 105 to support and protect the projection lens 110 . The head 103 may be coupled to the main body 105 so as to be swivelable within a predetermined angular range based on one surface of the main body 105 .

The head 103 is automatically or manually swiveled by a user or a processor to freely adjust the projection angle of the projection lens 110 . Alternatively, although not shown in the drawings, the head 103 is coupled to the main body 105 and includes a neck extending from the main body 105, so that the head 103 is tilted or tilted to adjust the projection angle of the projection lens 110. can be adjusted

The electronic device 100 adjusts the direction of the head 103 and adjusts the emission angle of the projection lens 110 while the position and angle of the main body 105 are fixed, so that light or an image can be projected to a desired location. there is. In addition, the head 103 may include a handle that the user can grasp after rotating in a desired direction.

A plurality of openings may be formed on the outer circumferential surface of the main body 105 . Audio output from the audio output unit may be output to the outside of the main body 105 of the electronic device 100 through the plurality of openings. The audio output unit may include a speaker, and the speaker may be used for general purposes such as multimedia playback, recording playback, and audio output.

According to an embodiment of the present disclosure, a heat dissipation fan (not shown) may be provided inside the main body 105, and when the heat dissipation fan (not shown) is driven, air or heat inside the main body 105 passes through a plurality of openings. can emit. Therefore, the electronic device 100 can discharge heat generated by driving the electronic device 100 to the outside and prevent the electronic device 100 from overheating.

The connector 130 may connect the electronic device 100 to an external device to transmit/receive electrical signals or receive power from the outside. According to an embodiment of the present disclosure, the connector 130 may be physically connected to an external device. At this time, the connector 130 may include an input/output interface, and may communicate with an external device through wired or wireless communication or receive power. For example, the connector 130 may include an HDMI connection terminal, a USB connection terminal, an SD card receiving groove, an audio connection terminal, or a power outlet, or may include Bluetooth, Wi-Fi, or wireless connection to an external device wirelessly. A charging connection module may be included.

In addition, the connector 130 may have a socket structure connected to an external lighting device, and may be connected to a socket receiving groove of the external lighting device to receive power. The size and standard of the connector 130 having a socket structure may be variously implemented in consideration of a receiving structure of a coupleable external device. For example, according to the international standard E26, the diameter of the junction of the connector 130 may be implemented as 26 mm, and in this case, the electronic device 100 replaces a conventionally used light bulb and an external lighting device such as a stand. can be coupled to Meanwhile, when fastened to a socket located on an existing ceiling, the electronic device 100 is projected from top to bottom, and when the electronic device 100 is not rotated by coupling the socket, the screen cannot be rotated either. Accordingly, the electronic device 100 is socket-coupled to the ceiling stand so that the electronic device 100 can rotate even when the socket is coupled and power is supplied, and the head 103 is moved from one side of the main body 105. It swivels and adjusts the emission angle to project the screen to a desired position or rotate the screen.

The connector 130 may include a coupling sensor, and the coupling sensor may sense whether or not the connector 130 is coupled with an external device, a coupling state, or a coupling target, and transmit the sensor to the processor, based on the received detection value. Driving of the electronic device 100 may be controlled.

The cover 107 can be coupled to and separated from the main body 105 and can protect the connector 130 so that the connector 130 is not constantly exposed to the outside. The shape of the cover 107 may have a shape continuous with the body 105 as shown in FIG. 1, or may be implemented to correspond to the shape of the connector 130. The cover 107 can support the electronic device 100, and the electronic device 100 can be used by being coupled to the cover 107 and coupled to or mounted on an external cradle.

In the electronic device 100 according to various embodiments, a battery may be provided inside the cover 107 . A battery may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell or a fuel cell.

Although not shown in the drawings, the electronic device 100 may include a camera module, and the camera module may capture still images and moving images. According to one embodiment, the camera module may include one or more lenses, image sensors, image signal processors, or flashes.

Although not shown in the drawings, the electronic device 100 may include a protective case (not shown) to protect the electronic device 100 and easily carry it, or a stand supporting or fixing the main body 105. (not shown), and may include a bracket (not shown) coupled to a wall or partition.

In addition, the electronic device 100 may provide various functions by being connected to various external devices using a socket structure. As an example, the electronic device 100 may be connected to an external camera device using a socket structure. The electronic device 100 may use the projection unit 111 to provide an image stored in a connected camera device or an image currently being captured. As another embodiment, the electronic device 100 may be connected to a battery module to receive power using a socket structure. Meanwhile, the electronic device 100 may be connected to an external device using a socket structure, but this is merely an example, and may be connected to an external device using another interface (eg, USB, etc.).

2A is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure.

Referring to FIG. 2A , the electronic device 100 includes a projection unit 111 , a sensor unit 113 and a processor 114 .

The projection unit 111 may output an image to be output from the electronic device 100 to the projection surface. The projection unit 111 may include a projection lens 110 .

The projection unit 111 may perform a function of outputting an image on a projection surface. A detailed description related to the projection unit 111 is described in FIG. 2B. Here, although described as a projection unit, the electronic device 100 may project images in various ways. Here, the projection unit 111 may include a projection lens 110 . Here, the projection surface may be a part of a physical space on which an image is output or a separate screen.

The sensor unit 113 may include a sensor for identifying the user's location and the location of an obstacle. The sensor unit 113 may include at least one of a ToF sensor, a voice sensor, and a camera. Here, the camera may be described as an image sensor.

The processor 114 may perform overall control operations of the electronic device 100 . Specifically, the processor 114 functions to control the overall operation of the electronic device 100 .

The processor 114 controls the projection unit 111 to output a projected image, identifies the location of each of a plurality of users and the location of an obstacle based on the sensing data obtained through the sensor unit 113, and determines the location of a plurality of users. The projection unit 111 is configured to identify a projection direction based on each position, identify a projection area based on the position of the obstacle and the identified projection direction, and output a rotated projection image based on the projection direction and projection area. You can control it.

Here, the sensor unit 113 may include a sensor for identifying objects around the electronic device 100 . Here, the user or obstacle may be described as a user object or an obstacle object.

Here, the processor 114 may obtain sensing data including information related to the surrounding space through the sensor unit 113 . Here, the processor 114 may analyze the presence or absence of surrounding objects and the location of the surrounding objects based on the sensing data. Here, the processor 114 may analyze the sensing data to identify whether the surrounding object is a user object or an obstacle object. In analyzing the sensing data, a plurality of sensors may be used instead of a single sensor.

Here, the processor 114 may identify (or determine) a projection direction based on the user's location. Here, the projection direction may mean a direction in which the electronic device 100 outputs a projection image using the projection unit 111 . Description related to the projection direction will be described in FIGS. 9 and 10 .

Here, the processor 114 may identify the projection area based on the location of the obstacle and the identified projection direction. Here, the projection area may mean an area where a projection image is output. In addition to simply considering the position of the obstacle, the processor 114 may identify the projection area by considering both the position of the obstacle and the projection direction. Since the area where the projection image is to be output varies according to the projection direction, the processor 114 may determine the projection area by considering both the projection direction and the position of the obstacle as well as considering only the position of the obstacle.

Here, the processor 114 may output a projection image based on the projection direction and projection area. Here, the output operation may be described as a projection operation.

Various embodiments may exist depending on whether the operation of outputting the projection image is performed before the operation of identifying the projection direction.

According to an embodiment, the processor 114 may output a projection image according to a default setting value. Also, the processor 114 may identify a projection direction and a projection area. Also, the processor 114 may change the location of the output projection image based on the projection direction and projection area. For example, the processor 114 may control the projection unit 111 to rotate the output projection image according to the identified projection direction and projection area.

According to another embodiment, the processor 114 may identify a projection direction and a projection area before outputting a projection image. Also, the processor 114 may control the projection unit 111 to output a projection image based on the identified projection direction and projection area.

Meanwhile, various embodiments may exist for the processor 114 to output a projection image based on a projection direction and a projection area.

According to an embodiment, the processor 114 may generate a new projection image to output the projection image based on the projection direction and projection area. The processor 114 may change the original image to generate a new image corresponding to the projection direction and projection area. Also, the processor 114 may control the projection unit 111 to output the generated new image to the projection area.

According to another embodiment, the processor 114 may physically control the projection unit 111 to output a projection image based on a projection direction and a projection area.

Meanwhile, the processor 114 may predict the gaze direction of each of the plurality of users based on the location of each of the plurality of users, and identify the projection direction based on the average direction of the gaze directions of each of the plurality of users.

Here, the processor 114 may identify a plurality of user locations based on sensing data acquired through the sensor unit 113 . Also, the processor 114 may predict the gaze direction of each of the plurality of users based on the positions of the plurality of users. Here, the line of sight direction may mean a direction in which an image can be viewed from a user's position.

According to an embodiment, the gaze direction may mean a direction in which an image is predicted to be viewed from a user's location. For example, when the first user is located in the center of the projection space, all directions may be directions of the gaze. However, when the second user is located right near the wall of the projection space, the second user's line of sight direction may be a direction excluding the direction of the wall.

According to another embodiment, the gaze direction may refer to the direction of the user's current gaze. In order to track the gaze direction, sensing data obtained through the sensor unit 113 may be image data.

Here, the processor 114 may obtain an average direction by obtaining the gaze direction of each of a plurality of users. The processor 114 may determine a final projection direction using an average direction to determine a projection direction most suitable for a plurality of users. An operation of determining a projection direction related to a plurality of users is described with reference to FIGS. 10 to 15 .

Meanwhile, the processor 114 identifies the shape of the projection surface, identifies the projection direction in units of 90 degrees if the shape of the projection surface is orthogonal, and identifies the projection direction in units of 1 degree if the shape of the projection surface is circular. can

Here, the projection surface may refer to a surface on which a projection image may be output. The projection surface means an area where a projected image can be output through the projection unit 111, and the projection area can mean an area where a projected image is output. Accordingly, the projection surface may include the projection area, and the size of the projection surface may be greater than the size of the projection area.

Here, the processor 114 may identify the shape of the projection surface based on sensing data obtained through the sensor unit 113 . Also, the processor 114 may adjust a unit for identifying the projection direction based on the shape of the projection surface.

Specifically, if the projection surface has a right angle, the processor 114 may determine the projection direction in units of 90 degrees. Here, 90 degrees is only an example, and the projection direction may actually be calculated as 45 degrees or other angles. However, if the projection surface is perpendicular, it may be most efficient to determine the projection direction at 90 degrees. The shape of the projection surface 11 in FIG. 8 represents a right angle.

Also, if the shape of the projection surface is circular, the processor 114 may determine the projection direction in units of 1 degree. Here, 1 degree is only an example, and the projection direction may actually be calculated at various angles other than 1 degree. The shape of the projection surface 11 in FIG. 9 represents a circular shape.

Meanwhile, the sensor unit 113 may include a voice sensor and a Time of Flight (ToF) sensor, and the processor 114 may determine the location of each of a plurality of users and the location of an obstacle based on sensing data acquired through the ToF sensor. It is possible to identify and identify the location of each of a plurality of users based on the sensing data obtained through the voice sensor.

Here, the processor 114 may identify the location of an object around the electronic device 100 based on sensing data acquired through the ToF sensor. Here, it may be difficult to easily distinguish whether an object identified only by sensing data acquired through the ToF sensor is a user object or an obstacle object. Accordingly, the processor 114 may obtain sensing data related to the user's voice through the voice sensor. Here, the voice sensor may mean a microphone. According to an implementation example, the voice sensor may include a plurality of microphones.

As a result, the processor 114 may use the voice sensor to prepare for a situation where the user's location cannot be clearly identified only with the sensing data obtained from the ToF sensor.

Meanwhile, the sensor unit 113 may include a camera, and the processor 114 identifies a location of each of a plurality of users and a gaze direction of each of a plurality of users based on a photographed image obtained through the camera, and a plurality of A projection direction may be identified based on the position of each user and the gaze direction of each of a plurality of users.

Here, the processor 114 may identify an object around the electronic device 100 based on a captured image obtained through a camera. Also, the processor 114 may identify the location of the user object and the location of the obstacle object based on the photographed image.

Also, the processor 114 may identify gaze directions of a plurality of user objects based on the photographed images acquired through the camera. Specifically, the processor 114 may identify the eye gaze direction of the user object by identifying the pupil object.

Meanwhile, the processor 114 identifies a plurality of pattern objects included in the projection surface based on the sensing data obtained through the sensor unit 113, divides the projection surface into a plurality of regions based on the plurality of pattern objects, and , One area corresponding to the projection direction among a plurality of areas may be identified as a projection area.

Here, the pattern object may mean at least one of a color pattern, a material pattern, a line pattern, and a figure pattern. A plurality of areas having different color patterns may refer to areas having different colors. A plurality of regions having different material patterns may refer to regions having different materials. A plurality of regions having different line patterns may mean regions having different types of lines or different directions of lines. The figure pattern may mean a region in which the type of figure or the direction of the figure is different. An operation of dividing a plurality of regions based on a pattern will be described with reference to FIGS. 23 to 25 . Specifically, the first area 11-1, the second area 11-2, and the third area 11-3 of FIG. 23 may mean a plurality of areas divided into different patterns.

Meanwhile, the processor 114 may identify one of the plurality of areas as the projection area based on the color, size, or relative position of each of the plurality of pattern objects.

Here, the processor 114 may identify an area including a pattern object having a preset color among a plurality of pattern objects as a projection area. Also, the processor 114 may identify an area including a pattern object having the largest size among a plurality of pattern objects as a projection area. Also, the processor 114 may identify an area including a pattern object located at the center of a plurality of pattern objects as a projection area.

Meanwhile, the processor 114 obtains a first projection image of a first resolution based on the size of the projection area, and obtains a second projection image of a second resolution when the size of the first projection image is less than a threshold value; If the size of the second projection image is equal to or greater than the threshold value, the projection unit 111 may be controlled to output the second projection image to the projection area.

Here, the resolution may mean the horizontal and vertical ratios of the projected image. The first resolution may refer to a basic resolution set in the electronic device 100 . The processor 114 may acquire a first projection image based on a first resolution that is basically set. Here, the processor 114 needs to output a projection image of the first resolution to the projection area. Accordingly, the processor 114 may change the size of the projection image of the first resolution based on the size of the projection area. If the projection area is large, the projection image of the first resolution is large, but if the projection area is small, the projection image of the first resolution may be small. If the projected image is too small, it may be unsuitable for viewing by the user. Accordingly, in order to solve this problem, the processor 114 may acquire the second projection image based on the second resolution rather than the first resolution. And, if the size of the second projection image obtained based on the second resolution is greater than or equal to the threshold value, the processor 114 may output the second projection image to the projection area. Specific operations related to resolution are described in FIGS. 18 to 21 .

Meanwhile, the processor 114 controls the projection unit 111 to output a guide UI for selecting one of the plurality of projection directions when a plurality of projection directions are identified based on the location of each of the plurality of users. can Descriptions related to this will be described in FIGS. 27 to 29.

Meanwhile, the guide UI includes a plurality of UIs representing each of a plurality of projection directions, and the processor 114 controls the projection unit 111 to output each of the plurality of UIs in a rotated state based on each of the plurality of projection directions. can do. A description related to this is described in FIG. 31 .

Meanwhile, the processor 114 may identify a projection direction and a projection area when a preset event occurs. Here, the preset event is an event in which the power of the electronic device 100 is changed from an off state to an on state, an event in which a position change of a nearby object is detected while the power of the electronic device 100 is turned on, or an event in which the electronic device 100 is powered on. It may include at least one event among events in which a user input (eg, an input through a remote control or an input through a physical button) is received in a power-on state.

On the other hand, the processor 114 may not be able to identify an optimal projection direction. This is because there may be users located opposite to each other. When a projection direction suitable for all users is not identified, the processor 114 outputs a guide image including at least one of information indicating that a projection direction suitable for all users is not identified or information guiding some users to change their locations. can Descriptions related to this are described in FIGS. 14 and 15 .

Meanwhile, the electronic device 100 may output a projected image while being disposed on a ceiling or wall. This is because the location of the user can be easily identified when placed on the ceiling or wall, and projected images can be projected in various locations.

Since the electronic device 100 outputs a projection image based on the projection direction and projection area, it can provide a projection image in a direction suitable for a plurality of users. Since the optimal projection direction and projection area are determined even if the plurality of users do not change their current positions, user convenience can be enhanced.

FIG. 2B is a block diagram showing the configuration of the electronic device of FIG. 2A in detail.

Referring to FIG. 2B , the electronic device 100 includes a projection unit 111, a memory 112, a sensor unit 113, a processor 114, a user interface 115, an input/output interface 116, an audio output unit ( 117), a power supply unit 118, a communication interface 119, and a shutter unit 120. Meanwhile, the configuration shown in FIG. 2B is merely an example, and some configurations may be omitted and new configurations may be added.

Meanwhile, the contents already described in FIG. 2A are omitted.

The projection unit 111 is a component that projects an image to the outside. According to an embodiment of the present disclosure, the projection unit 111 may use various projection methods (eg, a cathode-ray tube (CRT) method, a liquid crystal display (LCD) method, a digital light processing (DLP) method, and a laser method). etc.) can be implemented. As an example, the principle of the CRT method is basically the same as that of a CRT monitor. The CRT method enlarges the image with a lens in front of the cathode ray tube (CRT) and displays the image on the screen. Depending on the number of cathode ray tubes, it is divided into a 1-tube type and a 3-tube type, and in the case of a 3-tube type, red, green, and blue cathode ray tubes can be separately implemented.

As another example, the LCD method is a method of displaying an image by transmitting light from a light source through a liquid crystal. The LCD method is divided into a single-panel type and a three-panel type. In the case of the three-panel type, the light from the light source is separated into red, green, and blue by a dichroic mirror (a mirror that reflects only light of a specific color and passes the rest) and transmits the liquid crystal. After that, the light can gather in one place again.

As another example, the DLP method is a method of displaying an image using a DMD (Digital Micromirror Device) chip. The projection unit of the DLP method may include a light source, a color wheel, a DMD chip, a projection lens, and the like. Light output from a light source may exhibit a color while passing through a rotating color wheel. The light that passed through the color wheel is input to the DMD chip. The DMD chip includes numerous micromirrors and reflects light input to the DMD chip. The projection lens may play a role of enlarging light reflected from the DMD chip to an image size.

As another example, the laser method includes a diode pumped solid state (DPSS) laser and a galvanometer. For lasers that output various colors, three DPSS lasers are installed for each RGB color, and then lasers with optical axes overlapped using special mirrors are used. The galvanometer includes a mirror and a high power motor to move the mirror at high speed. For example, a galvanometer can rotate a mirror at up to 40 KHz/sec. The galvanometer is mounted according to the scanning direction. In general, since the projector scans in a plane, the galvanometer can also be arranged separately in the x and y axes.

Meanwhile, the projection unit 111 may include various types of light sources. For example, the projection unit 111 may include at least one light source among a lamp, LED, and laser.

The projection unit 111 may output an image in a 4:3 aspect ratio, a 5:4 aspect ratio, or a 16:9 wide aspect ratio according to the purpose of the electronic device 100 or the user's settings, and may output an image in a WVGA (854*480) aspect ratio depending on the aspect ratio. ), SVGA(800*600), XGA(1024*768), WXGA(1280*720), WXGA(1280*800), SXGA(1280*1024), UXGA(1600*1200), Full HD(1920*1080) ), etc., can output images at various resolutions.

Meanwhile, the projection unit 111 may perform various functions for adjusting an output image under the control of the processor 114 . For example, the projection unit 111 may perform functions such as zoom, keystone, quick corner (4 corner) keystone, and lens shift.

Specifically, the projection unit 111 may enlarge or reduce the image according to the distance from the screen (projection distance). That is, a zoom function may be performed according to the distance from the screen. In this case, the zoom function may include a hardware method of adjusting the screen size by moving a lens and a software method of adjusting the screen size by cropping an image. Meanwhile, when the zoom function is performed, the focus of the image needs to be adjusted. For example, methods for adjusting the focus include a manual focus method and a motorized method. The manual focus method refers to a method of manually focusing, and the motorized method refers to a method of automatically focusing using a motor built into the projector when a zoom function is performed. When performing the zoom function, the projection unit 111 may provide a digital zoom function through software, and may provide an optical zoom function that performs a zoom function by moving a lens through a driving unit.

Also, the projection unit 111 may perform a keystone function. If the height is not right for the front projection, the screen may be distorted up or down. The keystone function means a function of correcting a distorted screen. For example, if distortion occurs in the left and right directions of the screen, it can be corrected using the horizontal keystone, and if distortion occurs in the vertical direction, it can be corrected using the vertical keystone. The quick corner (4 corner) keystone function corrects the screen when the central area of the screen is normal but the corner area is not balanced. The lens shift function is a function that moves the screen as it is when the screen is out of the screen.

Meanwhile, the projection unit 111 may provide zoom/keystone/focus functions by automatically analyzing the surrounding environment and the projection environment without user input. Specifically, the projection unit 111 determines the distance between the electronic device 100 and the screen detected through sensors (depth camera, distance sensor, infrared sensor, illuminance sensor, etc.) and the space where the electronic device 100 is currently located. Zoom/Keystone/Focus functions can be automatically provided based on information about the image and the amount of ambient light.

Also, the projection unit 111 may provide a lighting function using a light source. In particular, the projection unit 111 may provide a lighting function by outputting a light source using LEDs. According to one embodiment, the projection unit 111 may include one LED, and according to another embodiment, the electronic device may include a plurality of LEDs. Meanwhile, the projection unit 111 may output a light source using a surface-emitting LED according to an implementation example. Here, the surface-emitting LED may refer to an LED having a structure in which an optical sheet is disposed above the LED so that light sources are uniformly distributed and output. Specifically, when the light source is output through the LED, the light source may be evenly dispersed through the optical sheet, and the light source dispersed through the optical sheet may be incident to the display panel.

Meanwhile, the projection unit 111 may provide a user with a dimming function for adjusting the intensity of the light source. Specifically, when a user input for adjusting the intensity of a light source is received from a user through the user interface 240 (eg, a touch display button or a dial), the projection unit 111 displays a light source corresponding to the received user input. It is possible to control the LED to output the intensity of.

Also, the projection unit 111 may provide a dimming function based on the content analyzed by the processor 114 without user input. In detail, the projection unit 111 may control the LED to output the intensity of the light source based on information about currently provided content (eg, content type, content brightness, etc.).

Meanwhile, the projection unit 111 may control the color temperature under the control of the processor 114 . Here, the processor 114 may control the color temperature based on content. Specifically, if the content is identified as being output, the processor 114 may obtain color information for each frame of the content for which output is determined. Also, the processor 114 may control the color temperature based on the obtained color information for each frame. Here, the processor 114 may obtain at least one main color of a frame based on color information for each frame. Also, the processor 114 may adjust the color temperature based on the obtained at least one primary color. For example, the color temperature controllable by the processor 114 may be classified into a warm type or a cold type. Here, it is assumed that a frame to be output (hereinafter referred to as an output frame) includes a scene in which a fire has occurred. The processor 114 may identify (or obtain) that the primary color is red based on color information included in the current output frame. Also, the processor 114 may identify a color temperature corresponding to the identified main color (red). Here, the color temperature corresponding to red may be a warm type. Meanwhile, the processor 114 may use an artificial intelligence model to obtain color information or a primary color of a frame. According to an embodiment, the artificial intelligence model may be stored in the electronic device 100 (eg, memory 112). According to another embodiment, the artificial intelligence model may be stored in an external server communicable with the electronic device 100 .

Meanwhile, the electronic device 100 may control a lighting function in conjunction with an external device. Specifically, the electronic device 100 may receive lighting information from an external device. Here, the lighting information may include at least one of brightness information and color temperature information set by an external device. Here, the external device is a device connected to the same network as the electronic device 100 (eg, an IoT device included in the same home/work network) or a device that is not on the same network as the electronic device 100 but can communicate with the electronic device ( For example, a remote control server). For example, it is assumed that an external lighting device (IoT device) included in the same network as the electronic device 100 outputs red light with a brightness of 50. The external lighting device (IoT device) may directly or indirectly transmit lighting information (eg, information indicating that red light is output with a brightness of 50) to the electronic device 100 . Here, the electronic device 100 may control the output of the light source based on lighting information received from an external lighting device. For example, when lighting information received from an external lighting device includes information for outputting red light with a brightness of 50, the electronic device 100 may output red light with a brightness of 50.

Meanwhile, the electronic device 100 may control a lighting function based on biometric information. Specifically, the processor 114 may obtain user's biometric information. Here, the biometric information may include at least one of the user's body temperature, heart rate, blood pressure, respiration, and electrocardiogram. Here, the biometric information may include various types of information in addition to the information described above. For example, an electronic device may include a sensor for measuring biometric information. The processor 114 may obtain user's biometric information through a sensor and control the output of the light source based on the obtained biometric information. As another example, the processor 114 may receive biometric information from an external device through the input/output interface 116 . Here, the external device may refer to a user's portable communication device (eg, a smart phone or a wearable device). The processor 114 may obtain user's biometric information from an external device and control the output of the light source based on the obtained biometric information. Meanwhile, according to an implementation example, the electronic device may identify whether the user is sleeping, and if the user is identified as sleeping (or preparing for sleep), the processor 114 determines the light source based on the user's biometric information. output can be controlled.

The memory 112 may store at least one command related to the electronic device 100 . Also, an operating system (O/S) for driving the electronic device 100 may be stored in the memory 112 . Also, various software programs or applications for operating the electronic device 100 may be stored in the memory 112 according to various embodiments of the present disclosure. Also, the memory 112 may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

Specifically, various software modules for operating the electronic device 100 may be stored in the memory 112 according to various embodiments of the present disclosure, and the processor 114 executes various software modules stored in the memory 112. Thus, the operation of the electronic device 100 may be controlled. That is, the memory 112 is accessed by the processor 114, and data can be read/written/modified/deleted/updated by the processor 114.

Meanwhile, in the present disclosure, the term memory 112 refers to a memory 112, a ROM (not shown) in the processor 114, a RAM (not shown), or a memory card (not shown) mounted in the electronic device 100 (eg For example, micro SD card, memory stick) may be used as a meaning including.

The sensor unit 113 may include at least one sensor. Specifically, the sensor unit 113 may include at least one of a tilt sensor that senses the tilt of the electronic device 100 and an image sensor that captures an image. Here, the tilt sensor may be an acceleration sensor or a gyro sensor, and the image sensor may mean a camera or a depth camera. Also, the sensor unit 113 may include various sensors other than a tilt sensor or an image sensor. For example, the sensor unit 113 may include an illuminance sensor and a distance sensor. In addition, the sensor unit 113 may include a lidar sensor.

User interface 115 may include various types of input devices. For example, user interface 115 may include physical buttons. In this case, the physical button may include a function key, a direction key (eg, a 4-direction key), or a dial button. According to one embodiment, the physical button may be implemented as a plurality of keys. According to another embodiment, the physical button may be implemented as one key. Here, when the physical button is implemented as one key, the electronic device 100 may receive a user input in which one key is pressed for a critical period of time or more. When a user input in which one key is pressed for a critical period of time or more is received, the processor 114 may perform a function corresponding to the user input. For example, processor 114 may provide a lighting function based on user input.

Also, the user interface 115 may receive a user input using a non-contact method. When a user input is received through a contact method, physical force must be transmitted to the electronic device. Therefore, a method for controlling the electronic device regardless of physical force may be required. Specifically, the user interface 115 may receive a user gesture and perform an operation corresponding to the received user gesture. Here, the user interface 115 may receive a user's gesture through a sensor (eg, an image sensor or an infrared sensor).

Also, the user interface 115 may receive a user input using a touch method. For example, the user interface 115 may receive a user input through a touch sensor. According to an embodiment, the touch method may be implemented as a non-contact method. For example, the touch sensor may determine whether the user's body has approached within a critical distance. Here, the touch sensor may identify a user input even when the user does not contact the touch sensor. Meanwhile, according to another implementation example, the touch sensor may identify a user input in which a user contacts the touch sensor.

Meanwhile, the electronic device 100 may receive user input in various ways other than the above-described user interface. As an example, the electronic device 100 may receive a user input through an external remote control device. Here, the external remote control device may be a remote control device corresponding to the electronic device 100 (eg, an electronic device-specific control device) or a user's portable communication device (eg, a smartphone or a wearable device). Here, the user's portable communication device may store an application for controlling the electronic device. The portable communication device may obtain a user input through a stored application and transmit the acquired user input to the electronic device 100 . The electronic device 100 may receive a user input from a portable communication device and perform an operation corresponding to a user's control command.

Meanwhile, the electronic device 100 may receive a user input using voice recognition. According to an embodiment, the electronic device 100 may receive a user's voice through a microphone included in the electronic device. According to another embodiment, the electronic device 100 may receive a user's voice from a microphone or an external device. Specifically, the external device may acquire a user voice through a microphone of the external device and transmit the obtained user voice to the electronic device 100 . The user's voice transmitted from the external device may be audio data or digital data obtained by converting the audio data (eg, audio data converted into a frequency domain). Here, the electronic device 100 may perform an operation corresponding to the received user voice. Specifically, the electronic device 100 may receive audio data corresponding to a user's voice through a microphone. And, the electronic device 100 may convert the received audio data into digital data. In addition, the electronic device 100 may convert the converted digital data into text data using a speech to text (STT) function. According to an embodiment, the STT (Speech To Text) function may be performed directly in the electronic device 100,

According to another embodiment, a speech to text (STT) function may be performed in an external server. The electronic device 100 may transmit digital data to an external server. The external server may convert digital data into text data and obtain control command data based on the converted text data. The external server may transmit control command data (this time, text data may also be included) to the electronic device 100 . The electronic device 100 may perform an operation corresponding to the user's voice based on the obtained control command data.

Meanwhile, the electronic device 100 may provide a voice recognition function using one assistant (or artificial intelligence assistant, eg, Bixby™, etc.), but this is only an example and through a plurality of assistants. A voice recognition function may be provided. In this case, the electronic device 100 may provide a voice recognition function by selecting one of a plurality of assists based on a trigger word corresponding to the assist or a specific key present on the remote control.

Meanwhile, the electronic device 100 may receive a user input using screen interaction. Screen interaction may refer to a function of identifying whether a predetermined event occurs through an image projected on a screen (or a projection surface) by an electronic device and acquiring a user input based on the predetermined event. Here, the predetermined event may refer to an event in which a predetermined object is identified at a specific location (eg, a location where a UI for receiving a user input is projected). Here, the predetermined object may include at least one of a user's body part (eg, a finger), a pointing stick, and a laser point. When a predetermined object is identified at a location corresponding to the projected UI, the electronic device 100 may identify that a user input for selecting the projected UI has been received. For example, the electronic device 100 may project a guide image to display a UI on the screen. And, the electronic device 100 can identify whether the user selects the projected UI. Specifically, the electronic device 100 may identify that the user has selected the projected UI when a predetermined event is identified at the location of the projected UI. Here, the projected UI may include at least one or more items. Here, the electronic device 100 may perform spatial analysis to identify whether a predetermined event is located at the location of the projected UI. Here, the electronic device 100 may perform spatial analysis through a sensor (eg, an image sensor, an infrared sensor, a depth camera, a distance sensor, etc.). The electronic device 100 may identify whether a predetermined event occurs at a specific location (the location where the UI is projected) by performing spatial analysis. And, if it is identified that a predetermined event occurs at a specific location (the location where the UI is projected), the electronic device 100 may identify that a user input for selecting a UI corresponding to the specific location has been received.

The input/output interface 116 is a component for inputting/outputting at least one of an audio signal and a video signal. The input/output interface 116 may receive at least one of audio and video signals from an external device and output a control command to the external device.

Meanwhile, in an embodiment of the present disclosure, the input/output interface 116 includes HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), USB C-type, DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (Dsubminiature) and DVI (Digital Visual Interface) may be implemented as at least one wired input/output interface. According to an embodiment, the wired input/output interface may be implemented as an interface for inputting/outputting only audio signals and an interface for inputting/outputting only video signals, or may be implemented as one interface for inputting/outputting both audio and video signals.

In addition, the electronic device 100 may receive data through a wired input/output interface, but this is merely an example, and power may be supplied through the wired input/output interface. For example, the electronic device 100 may receive power from an external battery through USB C-type or from an outlet through a power adapter. As another example, an electronic device may receive power from an external device (eg, a laptop computer or a monitor) through a DP.

Meanwhile, in an embodiment of the present disclosure, the input/output interface 116 is Wi-Fi, Wi-Fi Direct, Bluetooth, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP) and Long Term Evolution (LTE) communication It may be implemented as a wireless input/output interface that performs communication using at least one of the communication methods. Depending on the implementation example, the wireless input/output interface may be implemented as an interface for inputting/outputting only audio signals and an interface for inputting/outputting only video signals, or may be implemented as one interface for inputting/outputting both audio and video signals.

Also, an audio signal may be input through a wired input/output interface, and a video signal may be input through a wireless input/output interface. Alternatively, an audio signal may be input through a wireless input/output interface and a video signal may be input through a wired input/output interface.

The audio output unit 117 is a component that outputs an audio signal. In particular, the audio output unit 117 may include an audio output mixer, an audio signal processor, and a sound output module. The audio output mixer may synthesize a plurality of audio signals to be output into at least one audio signal. For example, the audio output mixer may combine an analog audio signal and another analog audio signal (eg, an analog audio signal received from the outside) into at least one analog audio signal. The sound output module may include a speaker or an output terminal. According to an embodiment, the sound output module may include a plurality of speakers, and in this case, the sound output module may be disposed inside the main body, and the sound emitted by covering at least a part of the diaphragm of the sound output module may be emitted through a sound conduit ( waveguide) and can be transmitted to the outside of the main body. The sound output module includes a plurality of sound output units, and since the plurality of sound output units are symmetrically disposed on the exterior of the main body, sound can be emitted in all directions, that is, in all directions of 360 degrees.

The power supply unit 118 may receive power from the outside and supply power to various components of the electronic device 100 . The power supply unit 118 according to an embodiment of the present disclosure may receive power through various methods. As an example, the power supply unit 118 may receive power using the connector 130 shown in FIG. 1 . In addition, the power supply unit 118 may receive power using a 220V DC power cord. However, the present invention is not limited thereto, and the electronic device may receive power using a USB power cord or a wireless charging method.

In addition, the power supply unit 118 may receive power using an internal battery or an external battery. The power supply unit 118 according to an embodiment of the present disclosure may receive power through an internal battery. For example, the power supply unit 118 may charge power of an internal battery using at least one of a 220V DC power cord, a USB power cord, and a USB C-Type power cord, and may receive power through the charged internal battery. . In addition, the power supply unit 118 according to an embodiment of the present disclosure may receive power through an external battery. For example, when the electronic device and the external battery are connected through various wired communication methods such as a USB power cord, a USB C-Type power cord, and a socket home, the power supply unit 118 may receive power through the external battery. That is, the power supply unit 118 may directly receive power from an external battery, or may charge an internal battery through an external battery and receive power from the charged internal battery.

The power supply unit 118 according to the present disclosure may receive power using at least one of the plurality of power supply methods described above.

Meanwhile, with respect to power consumption, the electronic device 100 may have power consumption equal to or less than a preset value (eg, 43W) due to a socket type and other standards. In this case, the electronic device 100 may vary power consumption to reduce power consumption when using a battery. That is, the electronic device 100 may vary power consumption based on a power supply method and power usage.

The communication interface 119 is a component that performs communication with various types of external devices according to various types of communication methods. For example, the communication interface 119 may include a Wi-Fi module, a Bluetooth module, an infrared communication module, and a wireless communication module. The Wi-Fi module and the Bluetooth module perform communication using the Wi-Fi method and the Bluetooth method, respectively. In addition to the above-mentioned communication method, the wireless communication module can use Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), LTE Advanced (LTE-A), 4th Generation (4G), 5G (5th Generation) may include at least one communication chip that performs communication according to various wireless communication standards.

Meanwhile, the electronic device 100 according to an embodiment of the present disclosure may provide various smart functions.

Specifically, the electronic device 100 is connected to a portable terminal device for controlling the electronic device 100, and a screen output from the electronic device 100 can be controlled through a user input input from the portable terminal device. For example, the mobile terminal device may be implemented as a smart phone including a touch display, and the electronic device 100 receives and outputs screen data provided by the mobile terminal device from the mobile terminal device, and inputs data from the mobile terminal device. A screen output from the electronic device 100 may be controlled according to a user input.

The electronic device 100 may share content or music provided by the portable terminal device by connecting to the portable terminal device through various communication methods such as Miracast, Airplay, wireless DEX, and Remote PC.

Also, the mobile terminal device and the electronic device 100 may be connected through various connection methods. As an embodiment, the portable terminal device may perform a wireless connection by searching for the electronic device 100 or the electronic device 100 may search for the portable terminal device and perform a wireless connection. And, the electronic device 100 may output content provided by the portable terminal device.

As an embodiment, when a predetermined gesture is detected through the display of the portable terminal device after placing the portable terminal device near the electronic device while specific content or music is being output (eg, motion tap view), the electronic device 100 may output content or music currently being output on the portable terminal device.

In an embodiment, while specific content or music is being output from the portable terminal device, the portable terminal device is brought closer to the electronic device 100 by a predetermined distance or less (eg, non-contact tap view), or the portable terminal device is close to the electronic device 100. When contact is made twice at a short interval (eg, contact tap view), the electronic device 100 may output content or music currently being output on the portable terminal device.

In the above-described embodiment, it has been described that the same screen as that provided by the portable terminal device is provided by the electronic device 100, but the present disclosure is not limited thereto. That is, when a connection is established between the portable terminal device and the electronic device 100, the portable terminal device outputs a first screen provided by the portable terminal device, and in the electronic device 100, the first screen is provided by a different portable terminal device. A second screen may be output. For example, the first screen may be a screen provided by a first application installed on the portable terminal device, and the second screen may be a screen provided by a second application installed on the portable terminal device. For example, the first screen and the second screen may be different screens provided by one application installed in the portable terminal device. Also, as an example, the first screen may be a screen including a remote control type UI for controlling the second screen.

The electronic device 100 according to the present disclosure may output a standby screen. For example, when the electronic device 100 is not connected to an external device or when there is no input received from the external device for a preset time, the electronic device 100 may output a standby screen. Conditions for the electronic device 100 to output the standby screen are not limited to the above examples, and the standby screen may be output under various conditions.

The electronic device 100 may output a standby screen in the form of a blue screen, but the present disclosure is not limited thereto. For example, the electronic device 100 may obtain an irregular object by extracting only the shape of a specific object from data received from an external device, and output an idle screen including the acquired irregular object.

The shutter unit 120 may include at least one of a shutter 121 , a fixing member 122 , a rail 123 , a body 124 , and a motor 125 .

Here, the shutter 121 may block light output from the projection unit 111 . Here, the fixing member 122 may fix the position of the shutter 121 . Here, the rail 123 may be a path for moving the shutter 121 and the fixing member 122 . Here, the body 124 may have a configuration including a shutter 121 and a fixing member 122 . Here, the motor 125 provides driving power for movement of components in the shutter unit 120 (for example, movement of the body 124) or rotation of components (for example, rotation of the shutter 121). It may be a configuration that causes

3 is a perspective view illustrating an external appearance of an electronic device 100 according to other embodiments of the present disclosure.

Referring to FIG. 3 , the electronic device 100 may include a support (or referred to as a “handle”) 108a.

The support 108a of various embodiments may be a handle or a hook provided for a user to grip or move the electronic device 100, or the support 108a may be a main body ( 105) may be a stand supporting the.

As shown in FIG. 3, the support 108a may be coupled to or separated from the outer circumferential surface of the main body 105 in a hinge structure, and may be selectively separated and fixed from the outer circumferential surface of the main body 105 according to the user's needs. The number, shape, or arrangement of the supports 108a may be variously implemented without limitation. Although not shown in the drawing, the support 108a is built into the main body 105 and can be taken out and used by the user as needed, or the support 108a can be implemented as a separate accessory and detachable from the electronic device 100. there is.

The support 108a may include a first support surface 108a-1 and a second support surface 108a-2. The first support surface 108a-1 may be a surface facing the outside of the body 105 in a state where the support 108a is separated from the outer circumferential surface of the body 105, and the second support surface 108a-2 is the support (108a) may be a surface facing the inner direction of the main body 105 in a state separated from the outer circumferential surface of the main body 105.

The first support surface 108a-1 is developed from the lower part of the body 105 to the upper part of the body 105 and may move away from the body 105, and the first support surface 108a-1 is flat or uniformly curved. can have a shape. The first support surface 108a-1 is the case where the electronic device 100 is mounted so that the outer surface of the body 105 touches the bottom surface, that is, when the projection lens 110 is disposed facing the front direction, the body ( 105) can be supported. In an embodiment including two or more supports 108a, the angle of exit of the head 103 and the projection lens 110 may be adjusted by adjusting the distance between the two supports 108a or the hinge opening angle.

The second support surface 108a-2 is a surface that comes into contact with the user or an external mounting structure when the support 108a is supported by the user or an external mounting structure, and prevents the user from slipping when the electronic device 100 is supported or moved. It may have a shape corresponding to the gripping structure of the hand or the external mounting structure. The user may direct the projection lens 110 toward the front, fix the head 103, hold the support 108a, move the electronic device 100, and use the electronic device 100 like a flashlight.

The support groove 104 is provided on the main body 105 and is a groove structure that can be accommodated when the support 108a is not in use, and as shown in FIG. It can be implemented as a home structure. Through the support groove 104, the support 108a can be stored on the outer circumferential surface of the main body 105 when the support 108a is not in use, and the outer circumferential surface of the main body 105 can be kept smooth.

Alternatively, the support 108a may have a structure in which the support 108a is stored inside the body 105 and the support 108a is pulled out of the body 105 in a situation where the support 108a is needed. In this case, the support groove 104 may have a structure drawn into the main body 105 to accommodate the support rod 108a, and the second support surface 108a-2 may be in close contact with the outer circumferential surface of the main body 105 or a separate support rod. A door (not shown) that opens and closes the groove 104 may be included.

Although not shown in the drawings, the electronic device 100 may include various types of accessories that help use or store the electronic device 100. For example, the electronic device 100 may include the electronic device 100 A protective case (not shown) may be included to protect and easily transport the electronic device 100 by being coupled to a tripod (not shown) or an external surface that supports or fixes the main body 105. Possible brackets (not shown) may be included.

4 is a perspective view illustrating an external appearance of an electronic device 100 according to another embodiment of the present disclosure.

Referring to FIG. 4 , the electronic device 100 may include a support (or referred to as a “handle”) 108b.

The support 108b of various embodiments may be a handle or a hook provided for a user to grip or move the electronic device 100, or the support 108b may be a main body ( 105) may be a stand that supports it so that it can be directed at an arbitrary angle.

Specifically, as shown in FIG. 4, the support 108b may be connected to the main body 105 at a predetermined point (eg, 2/3 to 3/4 of the height of the main body) of the main body 105. . When the support 108 is rotated in the direction of the main body, the main body 105 can be supported at an arbitrary angle in a state where the main body 105 is laid down in the lateral direction.

5 is a perspective view illustrating an external appearance of an electronic device 100 according to another embodiment of the present disclosure.

Referring to FIG. 5 , the electronic device 100 may include a support (or referred to as “support”) 108c. The support 108c of various embodiments includes a base plate 108c-1 provided to support the electronic device 100 on the ground and two support members 108c connecting the base plate 108-c and the main body 105. -2) may be included.

In one embodiment of the present disclosure, the two support members (108c-2) have the same height, so that one end surface of the two support members (108c-2) is provided on one outer circumferential surface of the main body 105 and the hinge member (108c). -3) can be combined or separated.

The two supporting members may be hingedly connected to the main body 105 at a predetermined point (eg, 1/3 to 2/4 of the height of the main body) of the main body 105 .

When the two support members and the main body are coupled by the hinge member 108c-3, the main body 105 is rotated based on the imaginary horizontal axis formed by the two hinge members 108c-3 so that the projection lens 110 The emission angle of can be adjusted.

Although FIG. 5 shows an embodiment in which two support members 108c-2 are connected to the body 105, the present disclosure is not limited thereto, and one support member and the body as shown in FIGS. 6A and 6B ( 105) may be connected by one hinge member.

6A is a perspective view illustrating an external appearance of an electronic device 100 according to another embodiment of the present disclosure.

FIG. 6B is a perspective view illustrating a state in which the electronic device 100 of FIG. 6A is rotated.

Referring to FIGS. 6A and 6B, the support 108d of various embodiments includes a base plate 108d-1, a base plate 108-c, and a body 105 provided to support the electronic device 100 on the ground. It may include one support member (108d-2) connecting the.

Also, the end face of one support member 108d-2 may be coupled or separated by a groove provided on one outer circumferential surface of the body 105 and a hinge member (not shown).

When one support member (108d-2) and the main body 105 are coupled by one hinge member (not shown), as shown in FIG. 6B, based on a virtual horizontal axis formed by one hinge member (not shown) The body 105 can be rotated.

Meanwhile, the supports shown in FIGS. 3, 4, 5, 6A, and 6B are merely examples, and the electronic device 100 may have supports in various positions or shapes.

7 is a flowchart for explaining a projecting operation of the electronic device 100 .

Referring to FIG. 7 , the electronic device 100 may identify the user's location (S705). Then, the electronic device 100 may identify the projection direction based on the user's location (S710). And, the electronic device 100 can identify the location of the obstacle (S715). And, the electronic device 100 can identify the projection area based on the projection direction and the position of the obstacle (S720). And, the electronic device 100 may output a projection image based on the projection direction and projection area. Here, the operation of outputting the projected image may refer to an operation of controlling the projection unit 111 to display the projected image on the projection surface.

8 is a diagram for explaining an operation of identifying a projection direction in consideration of a location of one user according to an exemplary embodiment.

Referring to the embodiment 810 of FIG. 8 , the electronic device 100 may output a projection image 811 to a preset projection area. Embodiment 810 may be a general projection operation.

Referring to the embodiment 820 of FIG. 8 , when the user 10 is identified, the electronic device 100 may identify the location of the user 10 . And, the electronic device 100 can identify the projection surface 11 . Here, the electronic device 100 may identify the projection direction based on the location of the user 10 . Here, the projection direction may refer to a direction for projecting an image in accordance with a viewing position of the user 10 . Here, the electronic device 100 may identify a projection area based on the projection surface 11 . And, the electronic device 100 may output the projection image 821 based on the projection direction and projection area. For example, the electronic device 100 may determine a projection direction for outputting a projection image in consideration of the location of the user 10 .

Here, the projection direction of the embodiment 810 and the projection direction of the embodiment 820 may differ by 180 degrees.

9 is a diagram for explaining an operation of identifying a projection direction in consideration of a location of one user according to another embodiment.

Referring to the embodiment 910 of FIG. 9 , the electronic device 100 may output a projection image 911 to a preset projection area. Embodiment 910 may be a general projection operation.

Referring to the embodiment 920 of FIG. 9 , the electronic device 100 may identify a projection direction based on the location of the user 10 . Since the user 10 is in the 1 o'clock direction, the electronic device 100 can identify a projection direction corresponding to the 1 o'clock direction. In addition, a projection image 921 may be output based on a projection direction suitable for the user 10 located in the 1 o'clock direction.

Here, the projection direction of the embodiment 910 and the projection direction of the embodiment 920 may differ by 30 degrees. Other explanations are described in FIG. 8 .

10 is a flowchart illustrating an operation of identifying a projection direction in consideration of locations of a plurality of users.

Referring to FIG. 10 , the electronic device 100 may determine whether a plurality of user objects are identified (S1005). If a plurality of user objects are not identified (S1005-N), the electronic device 100 may identify a projection direction based on the location of the user object (S1010).

When a plurality of user objects are identified (S1005-Y), the electronic device 100 may identify average positions of the plurality of user objects (S1015). And, the electronic device 100 may identify the projection direction based on the average positions of a plurality of user objects (S1020).

Also, the electronic device 100 may identify the projection area (S1025). And, the electronic device 100 may output a projection image based on the projection direction and projection area (S1030).

11 is a flowchart illustrating an operation of identifying a projection direction in consideration of positions of a plurality of groups.

Referring to FIG. 11 , the electronic device 100 may determine whether a plurality of user objects are identified (S1105). If a plurality of user objects are not identified (S1105-N), the electronic device 100 may identify a projection direction based on the location of the user object (S1110).

If a plurality of user objects are identified (S1105-Y), the electronic device 100 may perform grouping based on the locations of the plurality of user objects (S1115). Then, the electronic device 100 may determine whether a plurality of groups are identified based on the result of the grouping operation (S1120). If a plurality of groups are not identified, the electronic device 100 may identify a projection direction based on the location of each user object (S1110).

When the plurality of groups are identified (S1120-Y), the electronic device 100 may identify the projection direction based on the average position of each of the plurality of groups and the weight of each of the plurality of groups (S1125).

Also, the electronic device 100 may identify the projection area (S1130). And, the electronic device 100 may output a projection image based on the projection direction and projection area (S1135).

12 is a diagram for explaining an operation of identifying a projection direction in consideration of locations of a plurality of users according to an exemplary embodiment.

Referring to the embodiment 1210 of FIG. 12 , the electronic device 100 may output a projection image 1211 to a preset projection area. Example 1210 may be a general projection operation.

Referring to the embodiment 1220 of FIG. 12 , the electronic device 100 may identify a plurality of users 10-1, 10-2, 10-3, and 10-4. Also, the electronic device 100 may identify the locations of the plurality of users 10-1, 10-2, 10-3, and 10-4. Here, the electronic device 100 may identify projection directions based on the locations of the plurality of users 10-1, 10-2, 10-3, and 10-4. A direction suitable for viewing by all of the plurality of users 10-1, 10-2, 10-3, and 10-4 may be a direction rotated by 90 degrees in a clockwise direction. Accordingly, the electronic device 100 can identify the projection area based on the projection direction and the projection surface 11 . And, the electronic device 100 may output the projection image 1221 in the projection direction and projection area.

Here, the projection direction of the embodiment 1210 and the projection direction of the embodiment 1220 may differ by 90 degrees.

13 is a diagram for explaining an operation of identifying a projection direction in consideration of locations of a plurality of users according to another embodiment.

Referring to the embodiment 1310 of FIG. 13 , the electronic device 100 may output a projection image 1311 to a preset projection area. Example 1310 may be a general projection operation.

Referring to the embodiment 1320 of FIG. 13 , the electronic device 100 may identify a plurality of users 10-1, 10-2, 10-3, 10-4, 10-5, and 10-6. there is. Also, the electronic device 100 may identify the locations of the plurality of users 10-1, 10-2, 10-3, 10-4, 10-5, and 10-6. Here, the electronic device 100 may identify projection directions based on the locations of the plurality of users 10-1, 10-2, 10-3, 10-4, 10-5, and 10-6. A direction suitable for viewing by all of the plurality of users 10-1, 10-2, 10-3, 10-4, 10-5, and 10-6 may be a direction rotated by 180 degrees. Accordingly, the electronic device 100 can identify the projection area based on the projection direction and the projection surface 11 . And, the electronic device 100 may output the projection image 1321 in the projection direction and projection area.

Here, the projection direction of the embodiment 1310 and the projection direction of the embodiment 1320 may differ by 180 degrees.

14 is a diagram for explaining an operation of identifying a projection direction in consideration of locations of a plurality of users according to another embodiment.

Referring to the embodiment 1410 of FIG. 14 , the electronic device 100 may output a projection image 1411 to a preset projection area. Example 1410 may be a general projection operation.

Referring to the embodiment 1420 of FIG. 14 , the electronic device 100 includes a plurality of users 10-1, 10-2, 10-3, 10-4, 10-5, 10-6, 10-7, 10-8) can be identified. Also, the electronic device 100 may identify the locations of the plurality of users 10-1, 10-2, 10-3, 10-4, 10-5, 10-6, 10-7, and 10-8. there is. Here, the electronic device 100 projects based on the locations of the plurality of users 10-1, 10-2, 10-3, 10-4, 10-5, 10-6, 10-7, and 10-8. direction can be identified. The orientation suitable for viewing by all of the multiple users (10-1, 10-2, 10-3, 10-4, 10-5, 10-6, 10-7, 10-8) is the orientation rotated 180 degrees. can Accordingly, the electronic device 100 can identify the projection area based on the projection direction and the projection surface 11 . And, the electronic device 100 may output the projection image 1421 in the projection direction and projection area.

Here, the projection direction of the embodiment 1410 and the projection direction of the embodiment 1420 may differ by 180 degrees.

Meanwhile, the determined projection direction may not be suitable for the user 10 - 8 . However, since a projection direction suitable for all users may not exist, the projection direction may be determined in consideration of all users.

If a projection direction unsuitable for some users 10-8 is determined, the electronic device 100 provides information indicating that a projection direction or projection area suitable for all users is not identified or the location of some users 10-8. A guide image including at least one of information guiding change may be output.

15 is a diagram for explaining an operation of identifying a projection direction in consideration of locations of a plurality of users according to another embodiment.

Referring to the embodiment 1510 of FIG. 15 , the electronic device 100 may output a projection image 1511 to a preset projection area. Example 1510 may be a general projection operation.

Referring to the embodiment 1520 of FIG. 15 , the electronic device 100 may identify a plurality of users 10-1, 10-2, 10-3, 10-4, 10-5, and 10-6. there is. Also, the electronic device 100 may identify the locations of the plurality of users 10-1, 10-2, 10-3, 10-4, 10-5, and 10-6. Here, the electronic device 100 may identify projection directions based on the locations of the plurality of users 10-1, 10-2, 10-3, 10-4, 10-5, and 10-6. A direction suitable for viewing by all of the plurality of users 10-1, 10-2, 10-3, 10-4, 10-5, and 10-6 may be a direction rotated by 180 degrees. Accordingly, the electronic device 100 can identify the projection area based on the projection direction and the projection surface 11 . And, the electronic device 100 may output the projection image 1521 in the projection direction and projection area.

Here, the projection direction of the embodiment 1510 and the projection direction of the embodiment 1520 may differ by 180 degrees.

Meanwhile, the determined projection direction may not be suitable for the user 10 - 6 . However, since a projection direction suitable for all users may not exist, the projection direction may be determined in consideration of all users.

If a projection direction unsuitable for some users 10-6 is determined, the electronic device 100 provides information indicating that a projection direction or projection area suitable for all users is not identified or the location of some users 10-6. A guide image including at least one of information guiding change may be output.

16 is a flowchart for explaining an operation of projecting in consideration of the positions of a user and an obstacle.

Referring to FIG. 16 , the electronic device 100 may identify objects around the electronic device 100 (S1605). And, the electronic device 100 may determine whether a user object is identified (S1610). When the user object is identified (S1610-Y), the electronic device 100 may identify a projection direction based on the location of the user object (S1615).

Meanwhile, if the user object is not identified (S1610-N), the electronic device 100 may determine whether an obstacle object is identified (S1620). When the obstacle object is identified (S1620-Y), the electronic device 100 may identify a projection area based on the position of the obstacle object (S1625).

Meanwhile, if the obstacle object is not identified (S1620-N), the electronic device 100 may identify a preset area as a projection area (S1630).

And, the electronic device 100 may output a projection image based on the projection direction and projection area (S1635).

17 is a diagram for explaining an operation of projecting in consideration of the positions of a user and an obstacle.

Referring to the embodiment 1710 of FIG. 17 , the electronic device 100 may output a projection image 1711 to a preset projection area. Example 1710 may be a general projection operation. For example, the electronic device 100 may determine a projection area by considering only the projection surface 11 and output a projection image to the determined projection area.

Referring to the embodiment 1720 of FIG. 17 , the electronic device 100 may identify a projection area based on the projection surface 11 and the obstacle 12 . Specifically, when the obstacle 12 is identified, the electronic device 100 may identify the position of the obstacle 12 . And, the electronic device 100 can identify the projection area based on the positions of the projection surface 11 and the obstacle 12 . The electronic device 100 may identify an area where the obstacle 12 is excluded from the entire area of the projection surface 11 as a projection area. Here, the electronic device 100 may output a projection image 1721 to the projection area.

18 is a flowchart for explaining an operation of determining a resolution of a projected image.

Referring to FIG. 18 , the electronic device 100 may identify a projection direction (S1805). And, the electronic device 100 can identify the projection area (S1810). Here, the operation of identifying the projection direction and the operation of identifying the projection area are described with reference to FIGS. 7 to 19 , and redundant descriptions thereof are omitted.

Here, the electronic device 100 can identify whether a projection image of the first resolution can be output to the projection area (S1815). If it is identified that the projection image of the first resolution can be output to the projection area (S1815-Y), the electronic device 100 can output the projection image of the first resolution to the projection area (S1820).

Meanwhile, if it is identified that the projection image of the first resolution cannot be output to the projection area (S1815-N), the electronic device 100 may identify whether a projection image of the second resolution can be output to the projection area (S1825). . If it is identified that the projection image of the second resolution can be output to the projection area (S182-Y), the electronic device 100 can output the projection image of the second resolution (S1830).

Meanwhile, if it is identified that the projection image of the second resolution cannot be output to the projection area (S1825-N), the electronic device 100 may acquire a projection image of the third resolution based on the projection area (S1835). . Also, the electronic device 100 may output a projection image of a third resolution based on the projection direction and projection area (S1840).

19 is a diagram for explaining an operation of determining a resolution of a projected image.

Referring to the embodiment 1910 of FIG. 19 , the electronic device 100 may identify a projection area by considering the projection surface 11 and the obstacle 12 . Also, the electronic device 100 may output a projection image having a resolution of 16:9 to the projection area.

Referring to the embodiment 1920 of FIG. 19 , the electronic device 100 may identify a projection area by considering the projection surface 11 and the obstacle 12 . Also, the electronic device 100 may output a projection image 1911 having a resolution of 4:3 to the projection area.

Here, the size of the obstacle 12 of the embodiment 1910 and the size of the obstacle 12 of the embodiment 1920 may be different. Accordingly, the size of the projection area of the embodiment 1910 and the size of the projection area of the embodiment 1920 may be different, and the electronic device 100 outputs projection images of different resolutions based on the size of the projection area. can do.

20 is a flowchart for explaining an operation of determining an optimal resolution according to the size of a projected image.

Referring to FIG. 20 , the electronic device 100 may identify a projection direction (S2005). And, the electronic device 100 can identify the projection area (S2010). Here, the operation of identifying the projection direction and the operation of identifying the projection area are described with reference to FIGS. 7 to 19 , and redundant descriptions thereof are omitted.

Here, the electronic device 100 may acquire a first projection image of a first resolution based on the size of the projection area (S2015). Also, the electronic device 100 may acquire the size (or width) of the first projected image (S2020). In addition, the electronic device 100 may identify whether the size (or width) of the first projection image is greater than or equal to a threshold value (S2025). Here, if the size (or width) of the first projection image is greater than or equal to the threshold value (S2025-Y), the electronic device 100 may output the first projection image of the first resolution to the projection area (S2030).

Meanwhile, if the size (or width) of the first projection image is less than the threshold value (S2025-N), the electronic device 100 may obtain a second projection image of a second resolution based on the size of the projection area ( S2035). And, the electronic device 100 may output a second projection image of a second resolution to the projection area (S2040).

21 is a diagram for explaining an operation of determining an optimal resolution according to an area of a projected image.

Referring to the embodiment 2110 of FIG. 21 , the electronic device 100 may identify a projection area based on the projection surface 11 and the obstacle 12 . Also, the electronic device 100 may obtain a projection image 2111 having a first resolution (preset resolution) based on the size of the projection area.

However, the absolute size of the projection image 2111 may be small because of the resolution (eg, 16:9) to be displayed within the projection area. Due to this, the user may have a problem of viewing a small-sized projected image. Accordingly, the electronic device 100 may acquire a projection image having a second resolution instead of the first resolution (preset resolution) based on the size of the projection area. Here, the criterion for determining the above problem may be the width of the projected image of the first resolution. If the area of the projected image of the first resolution is less than the threshold value, the electronic device 100 may determine that the first resolution is not suitable.

For example, the second resolution may be a preset resolution according to priority. As another example, the second resolution may be an optimal resolution corresponding to the size of the projection area.

Referring to the embodiment 2120 of FIG. 21 , the electronic device 100 may obtain a projection image 2121 based on the second resolution instead of the first resolution. The electronic device 100 may acquire a projection image 2121 of a second resolution, not the first resolution, to solve the problem that the projection image of the first resolution is displayed too small in the projection area. Also, the electronic device 100 may output the projection image 2121 of the second resolution to the projection area.

22 is a flowchart for explaining an operation of determining a projection area according to a pattern existing on a projection surface.

Referring to FIG. 22 , the electronic device 100 may identify an object (S2205). Also, the electronic device 100 may determine whether a user object is identified (S2210). Here, when the user object is identified (S2210-Y), the electronic device 100 may identify a projection direction based on the location of the user object (S2215).

Meanwhile, if the user object is not identified (S2210-N), the electronic device 100 may determine whether an obstacle object is identified (S2220). Here, when the obstacle object is identified (S2220-Y), the electronic device 100 may identify a projection area based on the obstacle object (S2225).

Meanwhile, if the obstacle object is not identified (S2220-N), the electronic device 100 may identify a preset area as a projection area (S2230). Here, the preset area may simply mean the front of the electronic device 100, and may mean an area where a projection image is output with a default setting value without changing settings related to the projection function.

Meanwhile, the electronic device 100 may determine whether a plurality of pattern objects are identified on the projection surface (S2235). Here, the pattern object may refer to an object that forms a pattern according to color, pattern, and the like. Also, a pattern object may mean a region having a pattern. Here, if a plurality of pattern objects are identified on the projection surface (S2235-Y), the electronic device 100 may change an area including one pattern object among the plurality of pattern objects to a projection area (S2240). That is, when the projection surface is divided into a plurality of patterns, the electronic device 100 may determine an area corresponding to one pattern as the projection area. And, the electronic device 100 may output a projection image based on the projection direction and projection area.

Meanwhile, if a plurality of pattern objects are not identified on the projection surface (S2235-N), the electronic device 100 may directly output a projection image based on the projection direction and projection area.

As a result, the existing projection area can be changed only when a plurality of pattern objects are identified on the projection surface.

23 is a flowchart illustrating an operation of determining a projection area in consideration of a pattern existing on a projection surface, according to an exemplary embodiment.

Referring to the embodiment 2310 of FIG. 23 , the electronic device 100 may output a projection image 2311 on the projection surface 11 . Example 2310 may be a general projection operation.

Referring to the embodiment 2320 of FIG. 23 , the electronic device 100 analyzes the projection surface and divides the projection surface into first area 11-1, second area 11-2, and third area 11-1. 3) can be distinguished. The classification criterion may be at least one of edge, color, and pattern. For example, the first region 11-1 may have a mint-colored plain pattern, the second region 11-2 may have a white plain pattern, and the third region 11-3 may have a white hatched pattern. Here, the electronic device 100 may divide the projection surface into three regions 11-1, 11-2, and 11-3 based on colors and patterns. Here, the electronic device 100 may determine one of the three areas as the projection area. Here, a criterion for determining one area among a plurality of areas may be a size (or width) or a relative position.

For example, the electronic device 100 may determine one area among a plurality of areas as the projection area based on the size (or width). For example, the electronic device 100 may determine an area having the largest size among a plurality of areas as the projection area.

As another example, the electronic device 100 may determine one area among a plurality of areas as the projection area based on the relative location. For example, the electronic device 100 may determine an area located in the middle of a plurality of areas as a projection area.

In embodiment 2320, the electronic device 100 may determine the largest second area 11-2 as the projection area. Also, the electronic device 100 may obtain a projection image 2321 based on the size of the second region 11-2. And, the electronic device 100 may output the projected image 2321 to the second area 11-2.

24 is a flowchart illustrating an operation of determining a projection area in consideration of a pattern existing on a projection surface according to another embodiment.

Referring to the embodiment 2410 of FIG. 24 , the electronic device 100 may output a projection image 2411 on the projection surface 11 . Example 2410 may be a general projection operation.

Referring to the embodiment 2420 of FIG. 24 , the electronic device 100 may analyze the projection surface 11 and divide it into a plurality of regions 11-1 and 11-2. The first region 11-1 may have a plain gray pattern and the second region 11-2 may have a plain white pattern. Here, the electronic device 100 may acquire the size of the first area 11-1 and the size of the second area 11-2. Also, the electronic device 100 may compare the size of the first area 11-1 and the size of the second area 11-2, and determine an area having a larger size as the projection area. For example, since the size of the second area 11-2 is greater than the size of the first area 11-1, the electronic device 100 may determine the second area 11-2 as the projection area. there is. Also, the electronic device 100 may obtain a projection image 2421 based on the size of the second region 11-2. And, the electronic device 100 may output the projected image 2421 to the second area 11-2.

25 is a flowchart illustrating an operation of determining a projection area in consideration of a pattern existing on a projection surface according to another embodiment.

Referring to the embodiment 2510 of FIG. 25 , the electronic device 100 may output a projection image 2511 on the projection surface 11 . Example 2510 may be a general projection operation.

Referring to the embodiment 2520 of FIG. 25 , the electronic device 100 may analyze the projection surface 11 and divide it into a plurality of regions 11-1, 11-2, and 11-3. The first region 11-1 may have a plain gray pattern, the second region 11-2 may have a plain white pattern, and the third region 11-3 may have a plain mint color pattern. Here, the electronic device 100 may determine the projection area based on the relative positions of the plurality of areas 11-1, 11-2, and 11-3. For example, the electronic device 100 may determine a middle area among a plurality of areas as the projection area. The electronic device 100 may determine the second area 11-2 as a projection area. Also, the electronic device 100 may obtain a projection image 2521 based on the size of the second area 11-2. And, the electronic device 100 may output the projected image 2521 to the second area 11-2.

26 is a flowchart illustrating an operation of outputting a guide UI when a plurality of projection directions are identified.

Referring to FIG. 26 , the electronic device 100 may identify locations of a plurality of user objects (S2605). Also, the electronic device 100 may identify average positions of a plurality of user objects (S2610). Also, the electronic device 100 may identify the projection direction based on the average position (S2615).

Here, the electronic device 100 may determine whether a plurality of projection directions are identified (S2620). Situations in which a plurality of projection directions are identified are described in FIGS. 27 to 28 . When a plurality of projection directions are identified (S2620-Y), the electronic device 100 may output a guide UI for user selection (S2625). Here, the guide UI may be described as a guide image. And, the electronic device 100 may obtain a projection direction based on the user input received through the output guide UI (S2630). And, the electronic device 100 can identify the projection area (S2635).

Meanwhile, if a plurality of projection directions are not identified (S2620-N), the electronic device 100 can immediately identify the projection area (S2635).

And, the electronic device 100 may output a projection image based on the projection direction and projection area (S2640).

27 is a diagram for explaining a case in which a plurality of projection directions are identified according to an exemplary embodiment.

Referring to FIG. 27 , a first user 10 - 1 may be identified on the left side of the electronic device 100 and a second user 10 - 2 may be identified on the right side of the electronic device 100 . Here, the electronic device 100 may identify projection directions based on the locations of the plurality of users 10-1 and 10-2.

However, two projection directions may be identified according to the locations of the plurality of users 10-1 and 10-2. Like the embodiment 2710, the projection direction may be the front. Also, like the embodiment 2720, the projection direction may be rotated 180 degrees clockwise. The projection image 2711 output in the embodiment 2710 and the projection image 2721 output in the embodiment 2720 may differ by 180 degrees in projection directions. However, there may be no visual difference between the plurality of users 10-1 and 10-2 in any projection direction. In this case, the electronic device 100 may output a guide UI for guiding the user's selection.

28 is a diagram for explaining a case in which a plurality of projection directions are identified according to another embodiment.

Referring to FIG. 28 , the electronic device 100 may analyze the projection surface and divide it into a first area 11-1 and a second area 11-2. Here, it is assumed that the size of the first area 11-1 and the size of the second area 11-2 are the same. The electronic device 100 may not be able to determine any one area as the projection area based on the size or relative position of the plurality of areas 11-1 and 11-2. The projected image 2811 output in the embodiment 2810 may be output on the first area 11-1. The projected image 2821 output in the embodiment 2820 may be output to the second area 11-2. Since there is no criterion for selecting one area among the plurality of areas 11-1 and 11-2, the electronic device 100 can identify a plurality of projection directions.

29 is a diagram for explaining an operation of outputting a guide UI according to an embodiment.

Referring to FIG. 29 , the electronic device 100 may output a guide UI for guiding selection of one projection direction among a plurality of projection directions.

In the embodiment 2910, the electronic device 100 may output a UI 2911 corresponding to the first projection direction. The UI 2911 corresponding to the first projection direction may include at least one of text information indicating the first projection direction, a UI for selecting the first projection direction, and a UI for displaying the second projection direction.

In the embodiment 2920, the electronic device 100 may output a UI 2921 corresponding to the second projection direction. The UI 2921 corresponding to the second projection direction includes text information indicating the second projection direction, a UI for displaying the first projection direction, a UI for selecting the second projection direction, and a UI for displaying the third projection direction. may include at least one of them.

30 is a diagram for explaining an operation of outputting a guide UI according to another embodiment.

Referring to the embodiment 3010 of FIG. 30 , the electronic device 100 may determine a projection direction and projection area most suitable for the user, and generate a projection image based on the determined projection direction and projection area. And, in the process of generating the projected image, the electronic device 100 may output a guide UI 3011. Here, the guide UI 3011 may include text information indicating that a calculation operation for optimal setting is currently being performed. Here, the guide UI 3011 may be output in a preset area without considering the user or an obstacle.

Referring to the embodiment 3020 of FIG. 30 , when the electronic device 100 generates a projection image based on optimal settings, it can output a guide UI 3021 to notify that optimal settings have been completed. Here, the guide UI 3021 may be output by reflecting the projection direction and projection area in consideration of the user or obstacle.

31 is a diagram for explaining an operation of outputting a guide UI according to another embodiment.

Referring to FIG. 31 , the electronic device 100 may output a guide UI 3110 for guiding selection of a projection direction. Here, the guide UI 3110 includes text information 3111 for notifying that it is a UI for selecting a projection direction, information 3112 for notifying a first projection direction, UI 3113 for selecting a first projection direction, and a first projection direction. 2 It may include at least one of information 3114 for notifying the projection direction, UI 3115 for selecting the second projection direction, and UI 3116 for providing a service for the user to directly determine the projection direction.

Here, information 3112 for notifying the first projection direction and information 3114 for notifying the second projection direction may be displayed based on each projection direction. For example, it is assumed that the second projection direction is a direction rotated 180 degrees clockwise. As shown in FIG. 31 , information 3114 for notifying the second projection direction may be output clockwise rotated by 180 degrees.

Here, a UI 3116 for providing a service in which a user directly determines a projection direction is described in FIG. 32 .

32 is a diagram for explaining an operation of outputting a guide UI according to another embodiment.

Referring to FIG. 32 , the electronic device 100 may provide a function for guiding the user to directly adjust the projection direction. Specifically, the electronic device 100 may output a guide UI 3210 for adjusting the projection direction. Here, the guide UI 3210 includes text information 3211 for guiding selection of a projection direction, UI 3212 illustrating the projection direction, UI 3213 indicating a rotation angle, and UI 3214 for adjusting the rotation angle. , 3215), a UI 3216 for finally selecting a projection direction, and a UI 3217 for canceling a function for the user to directly select a projection direction. For example, when a user input for adjusting the rotation angle is received through the UIs 3214 and 3215, the electronic device 100 may adjust and output the rotation angle of the projected image included in the UI 3212. When the rotation angle of the projected image included in the UI 3212 is changed, the user can easily know how the image is output according to the rotation angle selected by the user.

Referring to FIG. 33 , it is a flowchart illustrating a control method of the electronic device 100 according to an embodiment of the present disclosure.

Referring to FIG. 33 , the control method of the electronic device 100 including the sensor unit 113 includes outputting a projected image, and positions of each of a plurality of users based on sensing data acquired through the sensor unit 113. and identifying the location of the obstacle (S3305), identifying a projection direction based on the location of each of a plurality of users (S3310), identifying a projection area based on the location of the obstacle and the identified projection direction (S3315). ) and rotating and outputting the projection image based on the projection direction and projection area (S3320).

Meanwhile, in identifying the projection direction, the direction of the gaze of each of the plurality of users may be predicted based on the location of each of the plurality of users, and the direction of projection may be identified based on the average direction of the gaze directions of each of the plurality of users.

Meanwhile, the control method may further include the step of identifying the shape of the projection surface, and the step of identifying the projection direction is if the shape of the projection surface identifying the projection direction in units of 90 degrees is circular if the shape of the projection surface is a right angle. The projection direction can be identified in units of 1 degree.

Meanwhile, the sensor unit 113 may include a voice sensor and a Time of Flight (ToF) sensor, and the step of identifying the location of each of a plurality of users and the location of an obstacle is based on sensing data obtained through the ToF sensor. The location of each of the plurality of users and the location of the obstacle may be identified, and the location of each of the plurality of users may be identified based on sensing data obtained through a voice sensor.

Meanwhile, the sensor unit 113 may include a camera, and the step of identifying the location of each of the plurality of users may include the location of each of the plurality of users and the gaze direction of each of the plurality of users based on a photographed image obtained through the camera. , and identifying the projection direction may include identifying the projection direction based on the location of each of the plurality of users and the gaze direction of each of the plurality of users.

Meanwhile, the step of identifying a plurality of pattern objects included in the projection surface based on the sensing data acquired through the sensor unit 113 and dividing the projection surface into a plurality of areas based on the plurality of pattern objects are further included. In the step of identifying the projection area, one area corresponding to the projection direction among the plurality of areas may be identified as the projection area.

Meanwhile, in the identifying the projection area, one of the plurality of areas may be identified as the projection area based on the color, size, or relative position of each of the plurality of pattern objects.

Meanwhile, the control method includes obtaining a first projection image of a first resolution based on the size of the projection area, obtaining a second projection image of a second resolution if the size of the first projection image is less than a threshold value, and The method may further include outputting the second projection image to the projection area when the size of the second projection image is equal to or greater than the threshold value.

Meanwhile, the control method may further include outputting a guide UI for selecting one of the plurality of projection directions when a plurality of projection directions are identified based on the location of each of the plurality of users.

Meanwhile, the guide UI may include a plurality of UIs representing each of a plurality of projection directions, and outputting the guide UI may output each of the plurality of UIs in a rotated state based on each of the plurality of projection directions.

Meanwhile, the method of controlling an electronic device as shown in FIG. 33 may be executed on an electronic device having the configuration of FIG. 2A or 2B and may also be executed on an electronic device having other configurations.

Meanwhile, the methods according to various embodiments of the present disclosure described above may be implemented in the form of an application that can be installed in an existing electronic device.

In addition, the methods according to various embodiments of the present disclosure described above may be implemented only by upgrading software or hardware of an existing electronic device.

In addition, various embodiments of the present disclosure described above may be performed through an embedded server included in an electronic device or an external server of at least one of an electronic device and a display device.

Meanwhile, according to an exemplary embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage media (eg, a computer). can A device is a device capable of calling a stored command from a storage medium and operating according to the called command, and may include an electronic device according to the disclosed embodiments. When a command is executed by a processor, the processor may perform a function corresponding to the command directly or by using other components under the control of the processor. An instruction may include code generated or executed by a compiler or interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium does not contain a signal and is tangible, but does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

Also, according to an embodiment of the present disclosure, the method according to the various embodiments described above may be included in a computer program product and provided. Computer program products may be traded between sellers and buyers as commodities. The computer program product may be distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)) or online through an application store (eg Play Store™). In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

In addition, each of the components (eg, modules or programs) according to various embodiments described above may be composed of a single object or a plurality of entities, and some sub-components among the aforementioned sub-components may be omitted, or other sub-components may be used. Components may be further included in various embodiments. Alternatively or additionally, some components (eg, modules or programs) may be integrated into one entity and perform the same or similar functions performed by each corresponding component prior to integration. According to various embodiments, operations performed by modules, programs, or other components may be executed sequentially, in parallel, repetitively, or heuristically, or at least some operations may be executed in a different order, may be omitted, or other operations may be added. can

Although the preferred embodiments of the present disclosure have been shown and described above, the present disclosure is not limited to the specific embodiments described above, and is common in the technical field belonging to the present disclosure without departing from the gist of the present disclosure claimed in the claims. Of course, various modifications and implementations are possible by those with knowledge of, and these modifications should not be individually understood from the technical spirit or perspective of the present disclosure.

100: electronic device
111: projection unit
113: sensor unit
114: processor

Claims (20)

In electronic devices,
projection unit;
sensor unit; and
Control the projection unit to output a projected image;
Identifying the location of each of a plurality of users and the location of an obstacle based on the sensing data obtained through the sensor unit;
Identifying a projection direction based on the location of each of the plurality of users;
identifying a projection area based on the location of the obstacle and the identified projection direction;
and a processor controlling the projection unit to rotate and output the projection image based on the projection direction and the projection area. According to claim 1,
the processor,
Predicting a gaze direction of each of the plurality of users based on the location of each of the plurality of users;
and identifying the projection direction based on an average direction of gaze directions of each of the plurality of users. According to claim 1,
the processor,
identify the shape of the projection surface;
If the shape of the projection surface is orthogonal, identifying the projection direction in units of 90 degrees;
If the shape of the projection surface is circular, the projection direction is identified in units of 1 degree. According to claim 1,
The sensor unit,
voice sensor and
Including a Time of Flight (ToF) sensor,
the processor,
Identifying the location of each of the plurality of users and the location of the obstacle based on sensing data obtained through the ToF sensor;
An electronic device that identifies the location of each of the plurality of users based on sensing data obtained through the voice sensor. According to claim 1,
The sensor unit,
including a camera;
the processor,
Identifying a position of each of the plurality of users and a gaze direction of each of the plurality of users based on a photographed image obtained through the camera;
The electronic device that identifies the projection direction based on the position of each of the plurality of users and the gaze direction of each of the plurality of users. According to claim 1,
the processor,
Identifying a plurality of pattern objects included in the projection surface based on sensing data obtained through the sensor unit;
Dividing a projection surface into a plurality of areas based on the plurality of pattern objects;
The electronic device identifies one area corresponding to the projection direction among the plurality of areas as the projection area. According to claim 6,
the processor,
and identifying one of the plurality of areas as a projection area based on a color, size, or relative position of each of the plurality of pattern objects. According to claim 1,
the processor,
Obtaining a first projection image of a first resolution based on the size of the projection area;
If the size of the first projection image is less than a threshold value, obtaining a second projection image of a second resolution;
and controlling the projection unit to output the second projection image to the projection area when the size of the second projection image is greater than or equal to a threshold value. According to claim 1,
the processor,
Controlling the projection unit to output a guide UI for selecting one projection direction from among the plurality of projection directions when a plurality of projection directions are identified based on the location of each of the plurality of users. According to claim 9,
The guide UI,
Includes a plurality of UIs representing each of a plurality of projection directions;
the processor,
Controlling the projection unit to output each of the plurality of UIs in a rotated state based on each of the plurality of projection directions. In the control method of an electronic device including a sensor unit,
outputting a projected image;
identifying a location of each of a plurality of users and a location of an obstacle based on sensing data acquired through the sensor unit;
identifying a projection direction based on the location of each of the plurality of users;
identifying a projection area based on the position of the obstacle and the identified projection direction; and
and rotating and outputting the projection image based on the projection direction and the projection area. According to claim 11,
Identifying the projection direction,
Predicting a gaze direction of each of the plurality of users based on the location of each of the plurality of users;
and identifying the projection direction based on an average direction of gaze directions of each of the plurality of users. According to claim 11,
Further comprising: identifying the shape of the projection surface;
Identifying the projection direction,
If the shape of the projection surface is orthogonal, identifying the projection direction in units of 90 degrees
If the shape of the projection surface is circular, the projection direction is identified in units of 1 degree. According to claim 11,
The sensor unit,
voice sensor and
Including a Time of Flight (ToF) sensor,
Identifying the location of each of the plurality of users and the location of the obstacle,
Identifying the location of each of the plurality of users and the location of the obstacle based on sensing data obtained through the ToF sensor;
Based on the sensing data obtained through the voice sensor to identify the location of each of the plurality of users, the control method. According to claim 11,
The sensor unit,
including a camera;
Identifying the location of each of the plurality of users,
Identifying a position of each of the plurality of users and a gaze direction of each of the plurality of users based on a photographed image obtained through the camera;
Identifying the projection direction,
and identifying the projection direction based on the position of each of the plurality of users and the gaze direction of each of the plurality of users. According to claim 11,
identifying a plurality of pattern objects included in a projection surface based on sensing data acquired through the sensor unit;
Dividing the projection surface into a plurality of areas based on the plurality of pattern objects; further comprising,
Identifying the projection area,
and identifying one area corresponding to the projection direction among the plurality of areas as the projection area. According to claim 16,
Identifying the projection area,
and identifying one of the plurality of areas as a projection area based on a color, size, or relative position of each of the plurality of pattern objects. According to claim 11,
obtaining a first projection image of a first resolution based on the size of the projection area;
obtaining a second projection image having a second resolution if the size of the first projection image is less than a threshold value; and
and outputting the second projection image to the projection area when the size of the second projection image is greater than or equal to a threshold value. According to claim 11,
If a plurality of projection directions are identified based on the location of each of the plurality of users, outputting a guide UI for selecting one projection direction from among the plurality of projection directions. According to claim 19,
The guide UI,
Includes a plurality of UIs representing each of a plurality of projection directions;
The step of outputting the guide UI,
and outputting each of the plurality of UIs in a rotated state based on each of the plurality of projection directions.

Images