KR20240054140A - Electronic apparatus, and method of operating the electronic apparatus - Google Patents

Abstract

An electronic device and a method of operating the electronic device are provided. The electronic device includes a display, memory storing one or more instructions, and at least one processor. The at least one processor controls the display to display a virtual space by executing the one or more instructions, and determines an object to be captured in the virtual space based on a first gesture for capturing the virtual space. And, based on the second gesture for selecting the capture mode, the capture mode is determined, and a capture image capturing the virtual space is generated according to the determined capture mode.

Description

Electronic device and method of operating the electronic device {ELECTRONIC APPARATUS, AND METHOD OF OPERATING THE ELECTRONIC APPARATUS}

Various embodiments relate to an electronic device and a method of operating the electronic device, and more specifically, to an electronic device that captures a virtual space and a method of operating the electronic device.

Recently, interest in next-generation media environments that provide users with the ability to experience content in a virtual space similar to real space is growing. In particular, metaverse is in the spotlight as a representative service that provides virtual space to users. Metaverse is a compound word of meta, meaning processing and abstraction, and universe, meaning the real world, and means a three-dimensional virtual world. The core technologies of this metaverse are virtual reality (VR), It is an extended reality (XR) technology that encompasses augmented reality (AR) and mixed reality (MR). There are various ways to implement virtual space, but they have in common the characteristic of using virtual 3D images to interact with users in real space in real time.

An electronic device may be used to display a virtual space screen so that the user can enjoy the most spatial content. In particular, there are cases where you want to share or record your experience in a virtual space using an electronic device with others. In this case, when the image the user sees in a virtual space is captured as a simple 2D image, there are limitations in expressing the various views and emotions experienced by the user.

An electronic device according to an embodiment of the present disclosure includes a display, a memory storing one or more instructions, and at least one processor. The at least one processor controls the display to display a virtual space by executing the one or more instructions. The at least one processor determines an object to be captured in the virtual space based on a first gesture for capturing the virtual space. The at least one processor determines the capture mode based on a second gesture for selecting the capture mode. The at least one processor generates a capture image capturing the virtual space according to the determined capture mode.

A method of operating an electronic device according to an embodiment of the present disclosure includes controlling a display to display a virtual space, and determining an object to be captured in the virtual space based on a first gesture for capturing the virtual space. A step of determining the capture mode based on a second gesture for selecting a capture mode, and generating a capture image capturing the virtual space according to the determined capture mode.

FIG. 1 is a diagram for explaining a capture service of an electronic device according to an embodiment.
Figure 2 is a block diagram showing the configuration of an electronic device according to an embodiment.
FIG. 3 is a flowchart illustrating an example of a method of operating an electronic device according to an embodiment.
Figure 4 is a flowchart showing a method of operating an electronic device that provides a capture service according to an embodiment.
FIG. 5 is a diagram illustrating the operation of an electronic device that initiates a capture service according to an embodiment.
FIG. 6 is a diagram illustrating an operation of an electronic device that determines a capture mode, according to an embodiment.
Figure 7 is a diagram showing a type of multi-view capture mode among capture modes according to an embodiment.
FIG. 8 is a diagram illustrating an operation of an electronic device that determines a capture area according to an embodiment.
FIG. 9 is a diagram illustrating an operation of an electronic device that determines a capture area according to an embodiment.
FIG. 10 is a diagram illustrating a method of detecting a first gesture through a sensor of an electronic device according to an embodiment.
FIG. 11 is a diagram illustrating a method of detecting a second gesture through a sensor of an electronic device according to an embodiment.
FIG. 12 is a diagram illustrating a method of detecting a third gesture through a sensor of an electronic device according to an embodiment.
Figure 13 is a detailed block diagram showing the configuration of an electronic device according to an embodiment.
Figure 14 is a block diagram showing the configuration of a server according to an embodiment.

In the present disclosure, the expression “at least one of a, b, or c” refers to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “a, b and c", or variations thereof.

Below, with reference to the attached drawings, embodiments of the present disclosure will be described in detail so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in many different forms and is not limited to the embodiments described herein.

Although it has been described in general terms currently used in consideration of the functions mentioned in the present disclosure, it may mean various other terms depending on the intention or precedents of those skilled in the art, the emergence of new technologies, etc. Therefore, the terms used in this disclosure should not be interpreted only by the name of the term, but should be interpreted based on the meaning of the term and the overall content of this disclosure.

Additionally, the terms used in the present disclosure are merely used to describe specific embodiments and are not intended to limit the present disclosure.

When it is said that a part "includes" a certain element throughout the specification, this means that, unless specifically stated to the contrary, it does not exclude other elements but may further include other elements. In addition, terms such as "... unit" and "module" used in the specification refer to a unit that processes at least one function or operation, which may be implemented as hardware or software, or as a combination of hardware and software. .

Below, with reference to the attached drawings, embodiments will be described in detail so that those skilled in the art can easily implement the present invention. However, the present invention may be implemented in many different forms and is not limited to the embodiments described herein. In order to clearly explain the present invention in the drawings, parts unrelated to the description are omitted, and similar parts are given similar reference numerals throughout the specification.

In embodiments of this specification, the term “user” refers to a person who controls a system, function, or operation, and may include a developer, administrator, or installer.

Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

FIG. 1 is a diagram for explaining a capture service of an electronic device according to an embodiment.

Referring to FIG. 1, an electronic device 100 according to an embodiment of the present disclosure may be an electronic device capable of outputting images. According to one example, the electronic device 100 may be implemented as various types of electronic devices including a display. The electronic device 100 may be fixed or mobile, and may be a digital TV capable of receiving digital broadcasting, but is not limited thereto.

The electronic device 100 according to an embodiment of the present disclosure may provide a virtual space. A virtual space is a space representing a virtual reality that is different from actual reality, and the user can experience various virtual spaces through the user's projected avatar. Virtual space can be implemented as a three-dimensional spatial image. For example, the electronic device 100 may provide content including images, videos, texts, applications, etc. implemented as three-dimensional spatial images.

The electronic device 100 according to an embodiment of the present disclosure includes a desktop, a smart phone, a tablet personal computer, a mobile phone, a video phone, an e-book reader, Laptop personal computer, netbook computer, digital camera, Personal Digital Assistants (PDA), Portable Multimedia Player (PMP), camcorder, navigation, wearable device, smart watch, It may include at least one of a home network system, a security system, a medical device, a head mounted display (HMD), a hemispherical display, a large display, and a projector display.

The electronic device 100 according to an embodiment of the present disclosure may provide a capture service. The capture service according to an embodiment of the present disclosure may be a service that captures an image of a virtual space viewed by a user or stores the captured image. A user of the electronic device 100 may capture an image of a virtual space to record an experience in the virtual space. In this case, if the virtual space is captured as a two-dimensional image from the user's first-person perspective, it is difficult to record the sense of space and experience that the user felt in the virtual space.

The electronic device 100 according to an embodiment of the present disclosure captures images of the virtual space viewed by the user through a capture service as well as 2D images or single-view images, as well as 3D images and multi-view images. view) can be captured as an image, etc. Accordingly, the electronic device 100 can generate captured images containing various views and emotions experienced by the user in a virtual space.

The capture service according to an embodiment of the present disclosure may be executed through gestures, touches, and other various interactions corresponding to user commands in the user's space. The electronic device 100 may provide a capture service through gestures, touches, etc. in the user's space. The electronic device 100 can capture the virtual space by detecting the user's gestures, touches, etc. in the space even without a separate operating device. For example, gestures in space include pointing, swiping, zooming in, zooming out, and dragging, all pointing to the same point for a certain period of time. It may include (drag) motion, pinch-in, pinch-out motion, etc. In the present disclosure, the gesture in the user's space is exemplified as a hand gesture, but is not limited thereto.

The capture service according to an embodiment of the present disclosure may include a capture service initiation (100A) step, a capture mode determination (100B) step, and a capture area determination (100C) step. The electronic device 100 according to an embodiment of the present disclosure may generate a capture image by performing a capture service initiation (100A) operation, a capture mode determination (100B) operation, and a capture area determination (100C) operation. . However, without being limited thereto, the electronic device 100 may generate a capture image by performing only the capture service initiation (100A) operation and the capture mode determination (100B) operation, the capture service initiation (100A) operation, and the capture mode determination (100B) operation. A captured image may be generated by performing only the area determination (100C) operation.

First, in the capture service initiation (100A) step, the electronic device 100 according to an embodiment of the present disclosure may initiate the capture service based on the user's first gesture 10. For example, the electronic device 100 may detect the first gesture 10 pointing to the object 50 included in the virtual space. For example, when it is determined that the first gesture 10 exists, the electronic device 100 may start a capture service. For example, the electronic device 100 may determine the object 50 to be captured according to the pointing position of the first gesture 10. For example, the electronic device 100 may display an emphasis icon 70 on the object 50 to indicate that the object 50 to be captured has been determined.

The electronic device 100 according to an embodiment of the present disclosure may generate a captured image 15 based on the first gesture 10. The captured image 15 may be a captured image according to a preset capture mode and a preset capture area. For example, the preset capture mode may be a single-view capture mode for the current user's viewing point, and the preset capture area may be a predetermined range of virtual space around the object 50, but is not limited thereto. . The electronic device 100 according to an embodiment of the present disclosure may generate a captured image 15 when the pointing operation according to the first gesture 10 is canceled. However, it is not limited to this. For example, the electronic device 100 may generate the captured image 15 when the pointing motion according to the first gesture 10 is maintained for a certain period of time. The captured image 15 may be displayed in some area of the electronic device 100. For example, the captured image 15 may be displayed in the upper right area of the electronic device 100.

Next, in the capture mode determination step 100B, the electronic device 100 according to an embodiment of the present disclosure may determine the capture mode based on the user's second gesture 20. For example, the electronic device 100 may detect the second gesture 20 of swiping in one direction in space. One direction may be any one of an upward direction, a downward direction, a left direction, and a right direction. The electronic device 100 according to an embodiment of the present disclosure may change the capture mode when it is determined that the second gesture 20 for selecting the capture mode exists. For example, the electronic device 100 may change from a preset capture mode to another capture mode according to the second gesture 20. For example, capture modes may include multi-view capture mode and 3D capture mode. For example, the multi-viewpoint capture mode may be a capture mode that generates capture images for a plurality of viewpoints rotated with respect to the object 50. For example, the 3D capture mode may be a capture mode that generates a 3D capture image of the object 50.

The electronic device 100 according to an embodiment of the present disclosure may generate the captured image 25 based on the second gesture 20. For example, the user may select the multi-viewpoint capture mode through the second gesture 20, and the electronic device 100 may determine the capture mode as the multi-viewpoint capture mode by detecting the second gesture 20. . For example, the electronic device 100 may generate captured images 25 for a plurality of viewpoints rotated with respect to the object 50 according to a multi-viewpoint capture mode. For example, the captured image 25 may be a captured image for four viewpoints rotated by 90 degrees with respect to the object 50.

When it is determined that the second gesture 20 for selecting a capture mode does not exist, the electronic device 100 according to an embodiment of the present disclosure may determine the capture mode as a preset capture mode without changing the capture mode. there is. For example, if the second gesture 20 is not detected for a certain period of time after the first gesture 10 is detected, the electronic device 100 may determine the capture mode to be a preset capture mode. For example, the electronic device 100 may generate a captured image according to a preset capture mode.

Next, in the capture area determination step 100C, the electronic device 100 according to an embodiment of the present disclosure may determine the capture area based on the user's third gesture 30. For example, the electronic device 100 may detect the third gesture 30 of zooming in or out in space. The electronic device 100 according to an embodiment of the present disclosure may change the capture area when it is determined that there is a third gesture 30 that sets the capture area. For example, the electronic device 100 may expand or contract a preset capture area according to the third gesture 30. For example, when the capture area is expanded, the range of virtual space to be captured may be expanded. For example, when the capture area is reduced, the extent of the virtual space to be captured may be reduced.

The electronic device 100 according to an embodiment of the present disclosure may generate a captured image in which the capture area is expanded or reduced based on the third gesture 30. For example, the electronic device 100 can expand the capture area and generate the expanded capture image 35 by detecting a zoom-in operation.

If it is determined that the third gesture 30 for setting the capture area does not exist, the electronic device 100 according to an embodiment of the present disclosure may determine the capture area to be a preset capture area without changing the capture area. there is. For example, the electronic device 100 may generate a captured image according to a preset capture area.

The electronic device 100 according to an embodiment of the present disclosure may generate captured images containing various views and emotions experienced by the user in a virtual space through a capture service.

Figure 2 is a block diagram showing the configuration of an electronic device according to an embodiment.

Referring to FIG. 2 , the electronic device 100 according to one embodiment may include a processor 110, a display 120, a memory 130, and a sensor 140.

The display 120 according to one embodiment may display a virtual space under the control of the processor 110. The display 120 according to one embodiment may provide captured images containing various views and emotions experienced by the user in a virtual space under the control of the processor 110.

The memory 130 according to one embodiment may store various data, programs, or applications for driving and controlling the electronic device 100. A program stored in memory 130 according to one embodiment may include one or more instructions. A program (one or more instructions) or application stored in the memory 130 may be executed by the processor 110.

The memory 130 according to one embodiment may be a flash memory type, a hard disk type, a multimedia card micro type, or a card type memory (for example, SD or Memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), It may include at least one type of storage medium among magnetic memory, magnetic disk, and optical disk.

The sensor 140 according to one embodiment can detect the presence, location, and type of actions such as gestures and touches in the user's space. For example, sensor 140 may include at least one sensor. For example, the sensor 140 may include a distance sensor, an image sensor, etc.

The processor 110 according to one embodiment controls the overall operation of the electronic device 100, controls signal flow between internal components of the electronic device 100, and performs data processing.

The processor 110 according to one embodiment may include at least one of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), and a Video Processing Unit (VPU). Alternatively, the processor 110 according to one embodiment may be implemented in the form of a System On Chip (SoC) that integrates at least one of a CPU, GPU, and VPU. Alternatively, the processor 110 may further include a Neural Processing Unit (NPU).

The processor 110 according to one embodiment may control operations of the electronic device 100 to be performed by executing one or more instructions stored in the memory 130.

The processor 110 according to an embodiment of the present disclosure may control the display 120 to display a virtual space. The processor 110 according to an embodiment of the present disclosure may determine an object to be captured in the virtual space based on the first gesture for capturing the virtual space. The processor 110 according to an embodiment of the present disclosure may determine the capture mode based on the second gesture for selecting the capture mode. The processor 110 according to an embodiment of the present disclosure may generate a capture image that captures a virtual space according to the determined capture mode.

The processor 110 according to an embodiment of the present disclosure may determine whether a first gesture pointing to an object exists through at least one sensor 140.

The processor 110 according to an embodiment of the present disclosure may determine the position of the user's hand through the first sensor. . The processor 110 according to an embodiment of the present disclosure may determine the pointing direction of the user's hand through the second sensor. The processor 110 according to an embodiment of the present disclosure may determine the location of an object in the virtual space pointed by the user's hand, based on the location of the user's hand and the pointing direction.

The processor 110 according to an embodiment of the present disclosure may control the display 120 to display a highlight icon indicating that an object to be captured has been determined, based on the first gesture.

The capture mode according to an embodiment of the present disclosure includes a single-view capture mode that generates a capture image for the current viewpoint, a multi-view capture mode that generates capture images for a plurality of viewpoints rotated with respect to the object, and a capture mode for generating a capture image for the object. It may include any one of the 3D capture modes that generate a 3D captured image.

The processor 110 according to an embodiment of the present disclosure may generate a captured image according to the determined capture mode, based on determining that the second gesture exists. The processor 110 according to an embodiment of the present disclosure may generate a capture image according to a preset capture mode based on determining that the second gesture does not exist.

The processor 110 according to an embodiment of the present disclosure may determine whether a second gesture exists based on the movement of the user's hand detected through at least one sensor 140.

The processor 110 according to an embodiment of the present disclosure may generate a capture image according to the next capture mode based on the user's hand moving in the first direction. The processor 110 according to an embodiment of the present disclosure may generate a capture image according to a previous capture mode based on the user's hand moving in a second direction opposite to the first direction.

The processor 110 according to an embodiment of the present disclosure may determine the range of the virtual space to be captured based on the third gesture for setting the capture area.

The processor 110 according to an embodiment of the present disclosure may generate a capture image in which the range of the virtual space to be captured is expanded or reduced based on the determination that a third gesture exists. The processor 110 according to an embodiment of the present disclosure may generate a capture image according to a preset capture area based on determining that the third gesture does not exist.

The processor 110 according to an embodiment of the present disclosure is based on the user's hands zooming in or out detected through at least one sensor 140, and the third The presence or absence of a gesture can be determined.

FIG. 3 is a flowchart illustrating an example of a method of operating an electronic device according to an embodiment.

Referring to FIG. 3 , in operation S310, a method of operating the electronic device 100 according to an embodiment of the present disclosure may include controlling the display to display a virtual space.

In operation S320, the method of operating the electronic device 100 according to an embodiment of the present disclosure may include determining an object to be captured in the virtual space based on a first gesture for capturing the virtual space. .

In operation S330, the method of operating the electronic device 100 according to an embodiment of the present disclosure may include determining a capture mode based on a second gesture for selecting the capture mode. A method of operating the electronic device 100 according to an embodiment of the present disclosure may include determining whether a first gesture pointing to an object exists through at least one sensor 140.

A method of operating the electronic device 100 according to an embodiment of the present disclosure may include generating a captured image according to a determined capture mode based on determining that a second gesture exists. A method of operating the electronic device 100 according to an embodiment of the present disclosure may include generating a capture image according to a preset capture mode based on determining that the second gesture does not exist.

A method of operating the electronic device 100 according to an embodiment of the present disclosure includes generating a capture image according to the next capture mode based on a user's hand moving in a first direction, and a second direction opposite to the first direction. It may include generating a capture image according to the previous capture mode based on the user's hand moving.

A method of operating the electronic device 100 according to an embodiment of the present disclosure may include determining whether a second gesture exists based on the movement of the user's hand detected through at least one sensor 140. there is.

In operation S340, the method of operating the electronic device 100 according to an embodiment of the present disclosure may include generating a capture image that captures a virtual space according to the determined capture mode.

The capture mode according to an embodiment of the present disclosure includes a single-view capture mode that generates a capture image for the current viewpoint, a multi-view capture mode that generates capture images for a plurality of viewpoints rotated with respect to the object, and It may include at least one of the 3D capture modes for generating a 3D capture image.

The method of operating the electronic device 100 according to an embodiment of the present disclosure may further include determining the range of the virtual space to be captured based on a third gesture for setting the capture area. A method of operating the electronic device 100 according to an embodiment of the present disclosure may include generating a capture image in which the range of the virtual space to be captured is expanded or reduced based on determining that a third gesture exists. there is. A method of operating the electronic device 100 according to an embodiment of the present disclosure may include generating a capture image according to a preset capture area based on determining that the third gesture does not exist.

Figure 4 is a flowchart showing a method of operating an electronic device that provides a capture service according to an embodiment.

Referring to FIG. 4 , in operation S405, the electronic device 100 according to an embodiment of the present disclosure may control the display to display a virtual space.

In operation S410, the electronic device 100 according to an embodiment of the present disclosure may determine whether the first gesture exists. For example, the electronic device 100 may identify the first gesture through a sensor. For example, the first gesture may be an action of pointing to an object in space. The electronic device 100 according to an embodiment of the present disclosure may perform operation S415 based on determining that the first gesture exists. For example, the electronic device 100 may perform operation S405 again based on determining that the first gesture does not exist.

In operation S415, the electronic device 100 according to an embodiment of the present disclosure may determine an object to be captured in the virtual space based on it being determined that the first gesture exists. For example, the electronic device 100 may initiate a capture service. For example, the electronic device 100 may determine an object to capture according to the pointing position of the first gesture. For example, based on the first gesture, the electronic device 100 may provide a highlight icon indicating that a capture service has started. Also, for example, the electronic device 100 may generate a captured image for the determined object based on the first gesture. The captured image may be a captured image according to a preset capture mode and a preset capture area. For example, the preset capture mode may be a single view capture mode, but is not limited thereto. The preset capture mode may be either a multi-view capture mode or a 3D capture mode. For example, a preset capture area may be a range of virtual space defined around an object.

In operation S420, the electronic device 100 according to an embodiment of the present disclosure may determine whether a second gesture exists. For example, the electronic device 100 may identify the second gesture through a sensor. For example, the second gesture may be a movement of the hand in one direction in space. For example, the electronic device 100 may perform operations S430 and S435 based on determining that the second gesture exists. For example, the electronic device 100 may perform operation S425 based on determining that the second gesture does not exist.

In operation S425, the electronic device 100 according to an embodiment of the present disclosure may determine the capture mode to be a preset capture mode based on determining that the second gesture does not exist. The electronic device 100 according to an embodiment of the present disclosure may generate a captured image according to a preset capture mode.

In operation S430, the electronic device 100 according to an embodiment of the present disclosure may determine a capture mode based on determining that a second gesture exists. The electronic device 100 may determine the capture mode to be a changed capture mode based on the second gesture for selecting the capture mode. For example, the electronic device 100 may change the capture mode from a preset capture mode to a capture mode selected by the user based on the second gesture. The user can select a capture mode by changing it to another capture mode or select a preset capture mode again.

In operation S435, the electronic device 100 according to an embodiment of the present disclosure may generate a captured image according to the determined capture mode. For example, the electronic device 100 may generate a captured image according to a single-view capture mode, a multi-view capture mode, and a 3D capture mode.

In operation S440, the electronic device 100 according to an embodiment of the present disclosure may determine whether a third gesture exists. For example, the electronic device 100 may identify the third gesture through a sensor. For example, the third gesture may be an operation to zoom in and out in space. For example, the electronic device 100 may perform operations S450 and S455 based on determining that a third gesture exists. For example, the electronic device 100 may perform operation S445 based on determining that the third gesture does not exist.

In operation S445, the electronic device 100 according to an embodiment of the present disclosure may determine the capture area to be a preset capture area based on determining that the third gesture does not exist. The electronic device 100 according to an embodiment of the present disclosure may generate a captured image according to a preset capture area.

In operation S450, the electronic device 100 according to an embodiment of the present disclosure may determine a capture area based on determining that a third gesture exists. The electronic device 100 may determine the capture area based on the third gesture that sets the capture area. For example, the electronic device 100 may change the capture area from a preset capture area to a set capture area based on the third gesture. The user can expand or contract the capture area and maintain the preset capture area.

In operation S455, the electronic device 100 according to an embodiment of the present disclosure may generate a captured image according to the determined capture area. For example, the electronic device 100 may generate a captured image with an expanded or reduced capture area based on the third gesture.

FIG. 5 is a diagram illustrating the operation of an electronic device that initiates a capture service according to an embodiment.

Referring to FIG. 5 , the electronic device 100 according to an embodiment of the present disclosure may start a capture service based on the user's first gesture 510. For example, the electronic device 100 may detect a first gesture 510 pointing to an object 550 included in a virtual space. For example, the user can remain still for a certain period of time and point to the same point. For example, when the electronic device 100 detects a user's pointing motion that remains stationary for a certain period of time, the electronic device 100 may start a capture service.

The electronic device 100 according to an embodiment of the present disclosure may provide a user interface indicating that a capture service is starting. For example, the electronic device 100 may display an emphasis icon 560 indicating that a capture service is starting. For example, as a capture service is started, determining the object 550 present at the pointing position of the first gesture 510 and generating a capture image may take a certain amount of time. The electronic device 100 may determine the object 550 and display a highlight icon 560 while performing an operation to generate a captured image. For example, the highlight icon 560 may be a circular icon existing on the object 550, but is not limited thereto. For example, the highlight icon 560 may exist in various states to inform the user that “capture service is starting.”

The electronic device 100 according to an embodiment of the present disclosure may determine the object 550 present at the pointing position. The electronic device 100 according to an embodiment of the present disclosure may provide a user interface notifying that the object 550 has been determined. For example, the electronic device 100 may display an emphasis icon 570 indicating that the object 550 has been determined. For example, the highlight icon 570 may be a double circular icon present on the object 550, but is not limited thereto. For example, highlight icon 570 may exist in various states to inform the user that “an object has been determined.”

Additionally, the electronic device 100 according to an embodiment of the present disclosure may generate a captured image 515 including an object 550 in a virtual space. For example, the captured image 515 may be a captured image according to a preset capture mode and a preset capture area. For example, the preset capture mode may be a single-view capture mode for the first-person perspective that the current user is looking at, but is not limited to this. For example, the preset capture mode may be a multi-view capture mode, which will be described later, or a 3D capture mode. Additionally, for example, the preset capture area may be a predetermined range of virtual space around the object 550, but is not limited thereto.

For example, object 550 may be in a stationary state or in an operating state. For example, when the object 550 is in a stationary state, the captured image 515 may include an image of the object in a stationary state. For example, when the object 550 is in an operating state, the captured image 515 may include an image of the object in a state in which the pointing operation according to the first gesture 510 is released. For example, when the object 550 is in an operating state, the captured image 515 may include an image of the object after the pointing motion according to the first gesture 510 has elapsed for a certain period of time.

The electronic device 100 according to an embodiment of the present disclosure may display the captured image 515 in a partial area of the electronic device 100. For example, the electronic device 100 may display the captured image 515 in the upper right area of the electronic device 100.

FIG. 6 is a diagram illustrating an operation of an electronic device that determines a capture mode, according to an embodiment.

Referring to FIG. 6 , the electronic device 100 according to an embodiment of the present disclosure may determine a capture mode based on the user's second gesture 620. For example, the electronic device 100 may detect the second gesture 620 of swiping in one direction in space. One direction may be any one of an upward direction, a downward direction, a left direction, and a right direction. For example, the electronic device 100 can detect the second gesture 620 of swiping to the right and determine the capture mode.

For example, capture mode 601 may include a single-view capture mode 602, a multi-view capture mode 604, and a 3D capture mode 606.

For example, the captured image 622 according to the single-view capture mode 602 may have a 2D image of the first-person perspective that the current user is looking at. For example, if the user is currently looking at the left side of the object 650 (e.g., a bird), the captured image 622 according to the single view capture mode 602 is the left side of the object 650. You can have a 2D image for .

For example, the captured image 624 according to the multi-viewpoint capture mode 604 may have images for a plurality of viewpoints rotated with respect to the object 650. For example, the captured image 624 according to the multi-viewpoint capture mode 604 may have images for four viewpoints rotated by 90 degrees with respect to the object 650. For example, the captured image 624 may have 2D images of the left, front, back, and right sides of the object 650. In the present disclosure, the captured image 624 according to the multi-viewpoint capture mode 604 is illustrated as having four viewpoints, but is not limited thereto. The captured image 624 according to the multi-viewpoint capture mode 604 may be less than four views or may be more than four views. The number of viewpoints of the captured image 624 according to the multi-viewpoint capture mode 604 may be preset or changed according to the user's settings. The multi-view capture mode 604 will be described in detail in FIG. 7.

For example, the captured image 626 according to the 3D capture mode 606 may have a 3D image of the object 650. For example, the captured image 626 according to the 3D capture mode 606 may be an image containing various views experienced by the user.

Capture mode 601 according to an embodiment of the present disclosure can be changed to the next capture mode by swiping in one direction. For example, the capture mode 601 can be changed from the single-view capture mode 602 to the multi-view capture mode 604 (see ① in FIG. 6), and from the multi-view capture mode 604 to the 3D capture mode ( 606) (see ② in FIG. 6), and from the 3D capture mode 606 to the single view capture mode 602 (see ③ in FIG. 6). Additionally, although not shown, the capture mode 601 may be changed to the previous capture mode by swiping in the opposite direction.

The electronic device 100 according to an embodiment of the present disclosure may generate a captured image according to the next capture mode based on the second gesture 620 moving in the right direction. For example, the electronic device 100 may generate a captured image 622 according to the single-view capture mode 602 as the capture service is initiated and the object 650 to be captured is determined. For example, the electronic device 100 may generate a captured image 624 according to the multi-viewpoint capture mode 604 based on the second gesture 620 moving in the right direction (see ① in FIG. 6 ). Additionally, for example, the electronic device 100 may generate a captured image 626 according to the 3D capture mode 606 based on the second gesture 620 moving in the right direction (② in FIG. 6 reference). Additionally, for example, the electronic device 100 may again generate a captured image 622 according to the single view capture mode 602 based on the second gesture 620 moving in the right direction (FIG. 6 (see ③).

Additionally, the electronic device 100 according to an embodiment of the present disclosure may generate a captured image according to the previous capture mode based on the second gesture 620 moving in the left direction. For example, the electronic device 100 changes from the single-view capture mode 602 to the 3D capture mode 606, from the 3D capture mode 606 to the multi-view capture mode 604, or from the multi-view capture mode 604. It is also possible to change from 604 to single view capture mode 602.

When it is determined that the second gesture 620 for selecting a capture mode does not exist, the electronic device 100 according to an embodiment of the present disclosure may determine the capture mode as a preset capture mode without changing the capture mode. there is. For example, if the second gesture 620 is not detected for a certain period of time after the first gesture 510 is detected, the electronic device 100 may determine the capture mode to be a preset capture mode. For example, the electronic device 100 may generate a capture image according to a preset capture mode, that is, a capture image 622 according to the single view capture mode 602.

Figure 7 is a diagram showing a type of multi-view capture mode among capture modes according to an embodiment.

Referring to FIG. 7 , a captured image 624 according to a multi-view capture mode (604 in FIG. 6 ) is illustrated.

In one embodiment of the present disclosure, the captured image according to the multi-viewpoint capture mode 604 may be any one of the first captured image 701, the second captured image 702, and the third captured image 703. .

For example, the first captured image 701 may have images of a plurality of single viewpoints rotated with respect to the object 750. For example, the first captured image 701 may have images of various viewpoints from which an avatar corresponding to the user looks at the object 750 within the virtual space 700, in addition to the user's current viewpoint 710. . For example, the first captured image 701 may have images from four viewpoints rotated by 90 degrees with respect to the object 750. For example, the four viewpoints include a first viewpoint 710 looking at the object 750 from the left side in the virtual space 700, a first viewpoint 720 looking at the object 750 from the rear, and an object ( It may include a second viewpoint 730 looking at the object 750 from the right side, and a third viewpoint 740 looking at the object 750 from the front. For example, the first captured image 701 may have 2D images of the left side, front side, back side, and right side. The first captured image 701 may correspond to the captured image 624 of FIG. 6 .

In the present disclosure, the captured image 624 according to the multi-viewpoint capture mode 604 is illustrated as having four viewpoints, but is not limited thereto. The captured image 624 according to the multi-viewpoint capture mode 604 may be less than four views or may be more than four views. The number of viewpoints of the captured image 624 according to the multi-viewpoint capture mode 604 may be set in advance or changed according to the user's settings.

For example, the second captured image 702 may have images of a plurality of single viewpoints rotated with respect to the object 750 and a 3D image. For example, the second captured image 702 may have a combination of 2D images and 3D images for the left side, front, and back.

For example, the third captured image 703 may have an image that preferentially represents a viewpoint at which the characteristics of the object 750 are reflected. For example, in the case of a bird, the characteristics of the bird are generally best seen when viewed from the front. The electronic device 100 may determine the priority based on the specification of the object 750 and generate images for a plurality of viewpoints according to the priority. For example, the third captured image 703 may have images of the front, right, and back sides of the object 750 in order of priority. Or, for example, when the object 750 is a building (not shown), the 3D image shows the characteristics of the building better than the 2D image, so the third capture image 703 is a 3D image of the building and a front image. You can have it. In this case, the first image of the third captured image 703 may be an image from a viewpoint unrelated to the user's current viewpoint.

The electronic device 100 according to an embodiment of the present disclosure can capture an image of the virtual space viewed by the user not only as a simple 2D image, but also as a multi-viewpoint image, a 3D image, and a composite image. The electronic device 100 according to an embodiment of the present disclosure is capable of generating an image of a virtual space from a viewpoint other than the user's current viewpoint, thereby capturing various views and emotions experienced by the user in the virtual space. It can be amplified. .

FIG. 8 is a diagram illustrating an operation of an electronic device that determines a capture area according to an embodiment.

Referring to FIG. 8 , the electronic device 100 according to an embodiment of the present disclosure may determine a capture area based on the user's third gesture 830. For example, the electronic device 100 may detect a third gesture 830 of zooming in (832) or zooming out (831) in space. The electronic device 100 according to an embodiment of the present disclosure may change the capture area when it is determined that there is a third gesture 830 that sets the capture area. For example, the electronic device 100 may expand or reduce a preset capture area according to the third gesture 830.

For example, the electronic device 100 may generate a capture image 835 with an expanded capture area based on the third gesture 830 of zooming in 832 in space. The capture image 835 may have a capture area with an expanded range of virtual space. The extended capture image 835 may be a 2D captured image.

If it is determined that the third gesture 830 for setting the capture area does not exist, the electronic device 100 according to an embodiment of the present disclosure does not change the capture area and captures the image 815 according to the preset capture area. ) can be created.

The electronic device 100 according to an embodiment of the present disclosure can amplify the various views and emotions experienced by the user in the virtual space by arbitrarily enlarging or reducing the range of the virtual space viewed by the user and capturing it. .

FIG. 9 is a diagram illustrating an operation of an electronic device that determines a capture area according to an embodiment.

Referring to FIG. 9 , the electronic device 100 according to an embodiment of the present disclosure may generate a captured image in which the capture area is expanded or reduced based on the third gesture 930. For example, the electronic device 100 can expand the capture area and generate an expanded capture image 935 by detecting the third gesture 930 of zooming in 932 in space. The extended capture image 935 may be a 3D captured image.

FIG. 10 is a diagram illustrating a method of detecting a first gesture through a sensor of an electronic device according to an embodiment.

The electronic device 100 according to an embodiment of the present disclosure may determine whether a first gesture 1010 pointing to an object 1050 exists. The sensor 140 may detect the first gesture 1010 pointing to the object 1050. The processor 110 may determine whether the first gesture 1010 exists through the sensor 140. The electronic device 100 according to an embodiment of the present disclosure may start a capture service based on determining that the first gesture 1010 exists. The electronic device 100 according to an embodiment of the present disclosure may determine an object 1050 to be captured in the virtual space based on determining that the first gesture 1010 exists.

The electronic device 100 according to an embodiment of the present disclosure may determine the position of the user's hand 1001 and the distance between the user's hand 1001 and the electronic device 100 through the distance sensor 150.

For example, the electronic device 100 according to an embodiment of the present disclosure may determine the position of the user's hand 1001 through the distance sensor 150. The distance sensor 150 can detect the distance between the user's hand 1001 and the distance sensor 150. The electronic device 100 according to an embodiment of the present disclosure may include a plurality of distance sensors 151, 152, and 153, and the plurality of distance sensors 151, 152, and 153 include the first distance sensor 151. , it may include a second distance sensor 152, and a third distance sensor 153. For example, the first distance sensor 151 may detect the first distance D1 between the user's hand 1001 and the first distance sensor 151. The second distance sensor 152 may detect the second distance D2 between the user's hand 1001 and the second distance sensor 152. The third distance sensor 153 may detect the third distance D3 between the user's hand 1001 and the third distance sensor 153.

For example, the electronic device 100 according to an embodiment of the present disclosure may determine the position of the user's hand 1001 based on sensing data detected by the plurality of distance sensors 151, 152, and 153. You can. For example, the processor 110 may determine the position (X, Y) of the user's hand 1001 based on the first distance (D1), the second distance (D2), and the third distance (D3). there is. Here, the position of the user's hand 1001 may be the position of the user's fingertip pointing at the object 1050. For example, the electronic device 100 according to an embodiment of the present disclosure may detect the location of the feature point 1001, which is the location of the user's fingertip. For example, the first gesture 1010 may have one feature point 1001.

For example, the electronic device 100 according to an embodiment of the present disclosure may determine the distance D4 between the electronic device 100 and the user's hand 1001. For example, the electronic device 100 according to an embodiment of the present disclosure determines the user's hand 1001 through the positions (X0, Y0) of the electronic device 100 and a plurality of distance sensors 151, 152, and 153. ) The distance D4 between the electronic device 100 and the user's hand 1001 can be determined based on the positions (X, Y).

For example, the electronic device 100 according to an embodiment of the present disclosure may determine the pointing direction 1005 and pointing position 1004 indicated by the user's hand 1001 through the image sensor 160. The pointing direction 1005 refers to the direction the user's hand 1001 points. The pointing position 1004 refers to the position pointed by the user's hand 1001. The pointing position 1004 may be the same as the position of the object 1050 displayed on the electronic device 100, but is not limited thereto.

For example, the image sensor 160 may track the user's hand 1001. The electronic device 100 according to an embodiment of the present disclosure may determine the pointing direction 1005 and pointing position 1004 indicated by the user's hand 1001 based on the image tracked from the image sensor 160. .

The electronic device 100 according to an embodiment of the present disclosure, based on at least one of the position (X, Y) of the user's hand 1001, the pointing position 1004, and the pointing direction 1005, the user's hand ( The location of the object 1050 in the virtual space pointed by 1001 can be determined.

Meanwhile, in FIG. 10 , the plurality of distance sensors 151, 152, and 153 are illustrated as being located at three of the four corners of the electronic device 100, but the present invention is not limited thereto. The plurality of distance sensors 151, 152, and 153 may be more than three or less than three. Additionally, the plurality of distance sensors 151, 152, and 153 may be located anywhere inside the electronic device 100, rather than at a corner of the electronic device 100. In addition, the image sensor 160 is illustrated as being located at the top of the electronic device 100, but is not limited thereto.

FIG. 11 is a diagram illustrating a method of detecting a second gesture through a sensor of an electronic device according to an embodiment.

The electronic device 100 according to an embodiment of the present disclosure may determine whether the second gesture 1120 exists based on the movement of the user's hands 1101 and 1102. The sensor 140 can detect whether the user's hands 1101 and 1102 are moving and the direction of movement. The processor 110 may determine whether the second gesture 1120 exists through the sensor 140. The electronic device 100 according to an embodiment of the present disclosure may determine a capture mode based on determining that the second gesture 1120 exists. The electronic device 100 according to an embodiment of the present disclosure may generate a captured image according to the selected capture mode. In contrast, the electronic device 100 according to an embodiment of the present disclosure may generate a captured image according to a preset capture mode based on determining that the second gesture 1120 does not exist.

The electronic device 100 according to an embodiment of the present disclosure monitors the change in position of the user's hands 1101 and 1102 and the distance D5 between the user's hands 1101 and 1102 and the electronic device 100 through the distance sensor 150. , D6) Changes can be judged.

For example, the second gesture 1120 may be a swiping operation from left to right. The electronic device 100 according to an embodiment of the present disclosure can determine the first positions (X1, Y1) and the second positions (X2, Y2) of the user's hands (1101, 1102) through the distance sensor 150. there is. The electronic device 100 according to an embodiment of the present disclosure performs a swiping operation through a change in the position of the user's hands 1101 and 1102 moving from the first position (X1, Y1) to the second position (X2, Y2). It can be detected. In this case, the feature point of the user's hand (1101, 1102) may be one.

Or, for example, the electronic device 100 according to an embodiment of the present disclosure may have a fifth distance D5 and a sixth distance D6, which are the distances between the electronic device 100 and the user's hands 1101 and 1102. ) can be determined. The electronic device 100 according to an embodiment of the present disclosure may detect a swiping operation based on the distance changed from the fifth distance D5 to the sixth distance D6.

For example, the electronic device 100 according to an embodiment of the present disclosure can determine the type of gesture through changes in the positions of the user's hands 1101 and 1102, thereby selectively deactivating the image sensor 160. You can. When the electronic device 100 according to an embodiment of the present disclosure determines the second gesture 1120, the distance sensor 150 may be activated and the image sensor 160 may be deactivated, so that the first or third gesture It can operate with lower power than when judging gestures.

FIG. 12 is a diagram illustrating a method of detecting a third gesture through a sensor of an electronic device according to an embodiment.

The electronic device 100 according to an embodiment of the present disclosure determines whether the third gesture 1230 exists based on the user's hands zooming in or out. You can. The sensor 140 can detect the motion of the user's hands and the position of the user's hands. The processor may determine whether the third gesture 1230 exists through a sensor. The electronic device 100 according to an embodiment of the present disclosure may determine the range of the virtual space to be captured based on the third gesture 1230. The electronic device 100 according to an embodiment of the present disclosure may generate a captured image in which the range of the virtual space to be captured is expanded or reduced based on the determination that the third gesture 1230 exists. In contrast, the electronic device 100 according to an embodiment of the present disclosure may generate a capture image according to a preset capture area based on determining that the third gesture 1230 does not exist.

The electronic device 100 according to an embodiment of the present disclosure determines a change in the position of the user's hand and a change in the distance between the user's hand and the electronic device 100 according to an embodiment of the present disclosure through the distance sensor 150. You can.

For example, the third gesture 1230 may be an operation of zooming in or out with two hands. The electronic device 100 according to an embodiment of the present disclosure detects the third position (X3, Y3), fourth position (X4, Y4), and fifth position (X5, Y5) of the user's hand through the distance sensor 150. , and the sixth position (X6, Y6) can be determined. The electronic device 100 according to an embodiment of the present disclosure has a third position (X3, Y3), a fourth position (X4, Y4), a fifth position (X5, Y5), and a sixth position (X6, Y6). Zoom-in or zoom-out motion can be detected through changes in position. In this case, there may be four feature points of the user's hand.

Or, for example, the electronic device 100 according to an embodiment of the present disclosure may determine the distance between the electronic device 100 and the user's hand. For example, the electronic device 100 according to an embodiment of the present disclosure may determine the seventh distance D7 between the third position (X3, Y3) of the user's hand and the electronic device 100. Likewise, the electronic device 100 according to an embodiment of the present disclosure is configured to operate at the fourth location (X4, Y4), the fifth location (X5, Y5), and the sixth location (X6, Y6), respectively. The distance of the electronic device 100 according to one embodiment may be determined.

For example, the electronic device 100 according to an embodiment of the present disclosure may determine the user's hand motion through the image sensor 160. For example, the electronic device 100 according to an embodiment of the present disclosure may determine a zoom-in or zoom-out operation using two hands through the image sensor 160.

Figure 13 is a detailed block diagram showing the configuration of an electronic device according to an embodiment.

The electronic device 1300 of FIG. 13 may be an example of the electronic device 100 of FIG. 2 . Hereinafter, descriptions that overlap with those described in FIG. 2 will be omitted.

Referring to FIG. 13, the electronic device 1300 may include a processor 1301 and a memory 1370. The processor 1301 and memory 1370 included in the electronic device 1300 may perform the same operations as the processor 110 and memory 130 included in the electronic device 100 of FIG. 2 .

In one embodiment, the electronic device 1300 includes, in addition to the processor 1301 and the memory 1370, a communication interface 1320, a sensor 1330, an input/output unit 1340, a display 1350, and an input interface ( 1360) may be further included. Display 1350 may correspond to display 120 of FIG. 2 . Sensor 1330 may correspond to sensor 140 of FIG. 2 .

In one embodiment, the communication interface 1320 can connect the electronic device 1300 to a peripheral device, external device, server, mobile terminal, etc. under the control of the processor 1301. The communication interface 1320 may include at least one communication module capable of performing wireless communication. The communication interface 1320 may include at least one of a wireless LAN module, a Bluetooth module, and a wired Ethernet depending on the performance and structure of the electronic device 1300.

The sensor 1330 detects the user's image, or the user's interaction, gesture, and touch, and may include a distance sensor 1331, an image sensor 1332, a gesture sensor, and an illumination sensor. The distance sensor 1331 may include various sensors that detect the distance between the electronic device 100 and the user, such as an ultrasonic sensor, an infrared radiation (IR) sensor, and a time of flight (TOF) sensor. The distance sensor 1331 can detect the distance from the user and transmit sensing data to the processor 110. The image sensor 1332 detects the user's gesture through a camera, etc., converts the received image into an electrical signal, and transmits it to the processor 110. The gesture sensor can detect movement speed or direction through an acceleration sensor or gyro sensor. The illuminance sensor can detect the surrounding illuminance.

The input/output unit 1340 receives video (e.g., dynamic image signals, still image signals, etc.) and audio (e.g., voice signals, music signals, etc.) from external devices under the control of the processor 1301. and additional information can be received. The input/output unit 1340 may include one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, and a USB port.

The display 1350 can output on the screen content received from a broadcasting station or from an external device such as an external server or external storage medium, or provided by various apps, such as an OTT service provider or a metaverse content provider.

The input interface 1360 may receive or output a user's input for controlling the electronic device 1300. The input interface includes a touch panel that detects the user's touch, a button that receives the user's push operation, a wheel that receives the user's rotation operation, a keyboard, a dome switch, and a microphone for voice recognition. , may include various types of user input devices including a motion detection sensor that senses motion, but is not limited thereto.

In one embodiment, the memory 1370 may store a rendering module 1371, a gesture determination module 1372, and a capture control module 1373.

The processor 1301 according to an embodiment may execute one or more instructions stored in each of the rendering module 1371, the gesture determination module 1372, and the capture control module 1373 to perform operations according to the present disclosure. .

The processor 1301 according to one embodiment may render a virtual space based on data received from an external server or metaverse content provider by executing one or more instructions stored in the rendering module 1371.

The processor 1301 according to one embodiment may identify a hand gesture in space based on sensing data from the sensor 1330 by executing one or more instructions stored in the gesture determination module 1372. For example, the processor 1301 may identify the presence or absence of a hand gesture, the type of hand gesture, the location and direction of the hand gesture, etc., based on the sensing data of the sensor 1330.

The processor 1301 according to one embodiment may perform a capture service operation according to the properties of the identified hand gesture by executing one or more instructions stored in the capture control module 1373. For example, the processor 1301 may initiate a capture service based on determining that the first gesture exists. For example, the processor 1301 may determine the capture mode based on determining that a second gesture exists. For example, the processor 1301 may determine the capture area based on determining that a third gesture exists.

Figure 14 is a block diagram showing the configuration of a server according to an embodiment.

Referring to FIG. 14, the server 200 is a device that generates virtual space content and provides virtual space content so that users of various clients can access the virtual space content. The server 200 can create and provide avatars that reflect users of various clients. The server 200 provides virtual space content to the electronic device 100, which is an example of a client, and manages the coordinates of objects (e.g., avatars) in the virtual space in response to input from the user of the electronic device 100. You can. In other words, the server 200 allows users in real space and objects in virtual space to interact.

The server 200 according to one embodiment may include a processor 210, a communication interface 220, and a memory 230.

The communication interface 220 according to one embodiment can transmit and receive data or signals with the electronic device 100. For example, the communication interface 220 may include a Wi-Fi module, a Bluetooth module, an infrared communication module, a wireless communication module, a LAN module, an Ethernet module, a wired communication module, etc. At this time, each communication module may be implemented in the form of at least one hardware chip.

The communication interface 220 according to one embodiment may transmit a virtual space including an avatar to the electronic device 100 under the control of the processor 210.

The processor 210 according to one embodiment controls the overall operation of the server 200 and signal flow between internal components of the server 200, and performs the function of processing data.

The processor 210 according to one embodiment may include at least one of a Central Processing Unit (CPU), a Graphic Processing Unit (GPU), and a Video Processing Unit (VPU). Alternatively, depending on the embodiment, it may be implemented in the form of a SoC (System On Chip) integrating at least one of CPU, GPU, and VPU. Alternatively, the processor 210 may further include a Neural Processing Unit (NPU).

The memory 230 according to one embodiment may store various data, programs, or applications for driving and controlling the server 200. A program stored in memory 230 may include one or more instructions. A program (one or more instructions) or application stored in the memory 230 may be executed by the processor 210. Memory 230 according to one embodiment may include one or more instructions for generating metaverse virtual space content. The memory 230 according to one embodiment may store virtual space content.

A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' only means that it is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is semi-permanently stored in a storage medium and temporary storage media. It does not distinguish between cases where it is stored as . For example, a 'non-transitory storage medium' may include a buffer where data is temporarily stored.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. A computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store or between two user devices (e.g. smartphones). It may be distributed in person or online (e.g., downloaded or uploaded). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) is stored on a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server. It can be temporarily stored or created temporarily.

Claims (20)

display 120;
a memory 130 that stores one or more instructions; and
Comprising at least one processor 110,
The at least one processor 110 executes the one or more instructions,
Control the display 120 to display a virtual space,
Based on the first gesture for capturing the virtual space, determine an object to capture within the virtual space,
Based on the second gesture for selecting a capture mode, determine the capture mode,
The electronic device 100 generates a capture image capturing the virtual space according to the determined capture mode. According to claim 1,
The electronic device 100 further includes at least one sensor 140,
The at least one processor 110,
The electronic device 100 determines whether the first gesture pointing to the object exists through the at least one sensor 140. According to clause 2,
The at least one sensor 140 includes a first sensor and a second sensor,
The at least one processor 110,
Determine the position of the user's hand through the first sensor,
Determine the pointing direction of the user's hand through the second sensor,
The electronic device 100 determines the position of the object in the virtual space pointed by the user's hand, based on the position of the user's hand and the pointing direction. According to any one of claims 1 to 3,
The at least one processor 110,
Based on the first gesture, the electronic device 100 controls the display 120 to display a highlight icon indicating that the object to be captured has been determined. According to any one of claims 1 to 4,
The capture mode is,
A single view capture mode that generates the captured image for the current view point; and
The electronic device 100 includes a multi-viewpoint capture mode that generates the captured images for a plurality of viewpoints rotated with respect to the object. According to clause 5,
The capture mode is,
The electronic device 100 further includes a 3D capture mode for generating a 3D capture image of the object. The method according to any one of claims 1 to 6,
The at least one processor 110,
Based on it being determined that the second gesture exists, generating the capture image according to the determined capture mode,
The electronic device 100 generates the captured image according to a preset capture mode based on determining that the second gesture does not exist. The method according to any one of claims 1 to 7,
The electronic device 100 further includes at least one sensor 140,
The at least one processor 110,
The electronic device 100 determines whether a second gesture exists based on the movement of the user's hand detected through the at least one sensor 140. According to clause 8,
The at least one processor 110,
Based on the user's hand moving in a first direction, generate the captured image according to the next capture mode,
The electronic device 100 generates the captured image according to a previous capture mode based on the user's hand moving in a second direction opposite to the first direction. The method according to any one of claims 1 to 9,
The at least one processor 110,
The electronic device 100 determines the range of the virtual space to be captured based on the third gesture for setting the capture area. According to claim 10,
The at least one processor 110,
Based on the determination that the third gesture exists, generate the captured image in which the range of the virtual space to be captured is expanded or reduced,
The electronic device 100 generates the captured image according to a preset capture area based on determining that the third gesture does not exist. According to claim 10,
The electronic device 100 further includes at least one sensor 140,
The at least one processor 110,
An electronic device ( 100). In a method of operating the electronic device 100,
Controlling the display 120 to display a virtual space;
Based on a first gesture for capturing the virtual space, determining an object to capture within the virtual space;
determining the capture mode based on a second gesture for selecting the capture mode; and
A method of operating the electronic device 100, including generating a capture image capturing the virtual space according to the determined capture mode. According to claim 13,
Based on the first gesture for capturing the virtual space, determining an object to be captured in the virtual space includes:
A method of operating an electronic device 100, including determining whether the first gesture pointing to the object exists through at least one sensor 140. The method of claim 13 or 14,
The capture mode is,
A single view capture mode that generates the captured image for the current view point;
a multi-viewpoint capture mode that generates the captured images for a plurality of viewpoints rotated with respect to the object; and
A method of operating the electronic device 100, including at least one of a 3D capture mode for generating a 3D capture image of the object. The method according to any one of claims 13 to 15,
The step of determining the capture mode based on the second gesture for selecting the capture mode includes:
based on determining that the second gesture exists, generating the captured image according to the determined capture mode; and
A method of operating the electronic device 100, including generating the captured image according to a preset capture mode based on determining that the second gesture does not exist. The method according to any one of claims 13 to 16,
A method of operating the electronic device 100, including determining whether a second gesture exists based on the movement of the user's hand detected through at least one sensor 140. According to claim 17,
The step of determining whether a second gesture exists based on the movement of the user's hand detected through the at least one sensor 140 includes:
Based on the user's hand moving in a first direction, generating the captured image according to a next capture mode; and
A method of operating the electronic device 100, including generating the captured image according to a previous capture mode based on the user's hand moving in a second direction opposite to the first direction. The method according to any one of claims 13 to 18,
A method of operating the electronic device 100, further comprising determining the range of the virtual space to be captured based on the third gesture for setting the capture area. According to clause 19,
The step of determining the range of the virtual space to be captured based on the third gesture for setting the capture area includes:
generating the captured image in which the range of the virtual space to be captured is expanded or reduced based on determining that the third gesture exists; and
A method of operating the electronic device 100, including generating the captured image according to a preset capture area based on determining that the third gesture does not exist.

Images