JP2020108112A - Electronic apparatus and method for controlling the same - Google Patents

Abstract

To perform cut-out, from a VR image, a VR image in a narrower range on flat display, while designating an area near an end of a flat display screen as a cut-out center.SOLUTION: An electronic apparatus comprises: display control means that performs flat display for containing a first video range of a VR content in a rectangle on a first screen, and displays an indicator indicating an area cut out from the VR content on a second screen; switching means that switches from the first screen to the second screen; control means that controls to perform circular scroll display for scrolling the VR content in a first direction according to a first operation on the second screen and sequentially displaying an image area by the amount of scroll from an end in a direction opposite to the first direction, and not to perform the circular scroll display even when the first operation is performed; and creation means that creates an edited VR content having a second video range narrower than the first video range based on the area indicated by the indicator.SELECTED DRAWING: Figure 7

Description

The present invention relates to an electronic device and its control method.

2. Description of the Related Art In recent years, an imaging device capable of shooting a VR (Virtual Reality) image having an image in a range wider than a human viewing angle, such as an omnidirectional image and an omnidirectional image, has become widespread. On the other hand, an image format specialized for the front 180° has also been announced, and there is an increasing demand for cropping a VR image into a 180° image.

Patent Document 1 proposes a method of extracting a part of a region where a touch operation of a VR image is performed, performing distortion correction, and superimposing and displaying the image on a screen. Patent Document 2 proposes a method of specifying the setting of the clipping region of an image by changing the size of the clipping frame or changing the magnification of the image while fixing the clipping frame.

JP, 2016-123127, A JP, 2014-165523, A

When cutting out a 180° cutout region from a VR image, the user can see the entire VR image from a bird's eye view by making a flat display that fits a 360° effective video range into a rectangle. However, if a 180° cutout area is specified in the flat display state, there is a problem that it is difficult to specify the edge area on the flat display as the cutout center.

The present invention has been made in view of the above problems, and when a VR image in a narrower range is cut out from a VR image on a flat display, an area near the screen edge of the flat display can be designated as the cutout center. An object is to provide a device and a control method thereof.

In order to solve the above problems, the electronic device of the present invention,
On the first screen, a flat display that fits the first video range of the VR content into a rectangle is performed, and on the second screen, an area cut out from the VR content is displayed on the VR content that is flatly displayed in the rectangular area. Display control means for controlling to display the indicating indicator,
Switching means for switching from the first screen to the second screen in response to a user's instruction to set the cutout range;
On the second screen, in response to the first operation, the flat-displayed VR content is scrolled in the first direction without scrolling the indicator, and the VR content is scrolled in response to the scroll. Image areas corresponding to the scroll amount in the first direction are sequentially displayed from the end of the rectangular area in the second direction opposite to the first direction toward the first direction. Circular scroll display of the same content
Control means for controlling so that the cyclic scroll display is not performed on the first screen even when the first operation is performed;
Generating means for generating an edited VR content having a second video range narrower than the first video range of the VR content based on the area indicated by the indicator on the second screen;
It is characterized by having.

When cutting out a VR image in a narrower range from the VR image on the flat display, an area near the screen edge of the flat display can be designated as the cutout center.

It is a block diagram of a display control device. It is an external view of a display control device. It is a flowchart which shows the cut-out process from a VR image to a 180 degree image. It is a flowchart which shows a cutting direction setting process. It is a flowchart which shows the edge area confirmation process in VR display. It is a display example at the time of performing a cutting process from a VR image to a 180° image. It is a display example when the cutting direction is changed by right scrolling. It is a display example when the cutting direction is changed by left scrolling. It is a display example of a method of confirming an end region in VR display. It is an example of various displays of a VR image.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration example of a display control device 100 as an example of an electronic device. The CPU 101, the memory 102, the non-volatile memory 103, the image processing unit 104, the display 105, the operation unit 106, the recording medium I/F 107, the external I/F 109, and the communication I/F 110 are connected to the internal bus 150. .. The voice output unit 112 and the posture detection unit 113 are also connected to the internal bus 150. The respective units connected to the internal bus 150 can exchange data with each other via the internal bus 150.

The CPU 101 is a control unit that controls the entire display control device 100, and includes at least one processor or circuit. The memory 102 is, for example, a RAM (a volatile memory using a semiconductor element or the like). The CPU 101 controls each unit of the display control device 100 by using the memory 102 as a work memory according to a program stored in the non-volatile memory 103, for example. The non-volatile memory 103 stores image data, audio data, other data, various programs for operating the CPU 101, and the like. The non-volatile memory 103 is composed of, for example, a flash memory or a ROM. The CPU 101 executes processing of each unit of the display control unit, the control unit, the generation unit, and the boundary display unit included in the display control device 100.

The image processing unit 104, under the control of the CPU 101, an image stored in the non-volatile memory 103 or the recording medium 108, a video signal acquired via the external I/F 109, or an image acquired via the communication I/F 110. Various image processing is performed on the above. The image processing performed by the image processing unit 104 includes A/D conversion processing, D/A conversion processing, image data encoding processing, compression processing, decoding processing, enlargement/reduction processing (resizing), noise reduction processing, and color conversion. Processing etc. are included. In addition, various image processing such as panoramic expansion, mapping processing, and conversion of a VR image that is a wide-range image having a wide-range image even if not an omni-directional image or an omni-directional image is performed. The image processing unit 104 may be composed of a dedicated circuit block for performing specific image processing. Further, depending on the type of image processing, the CPU 101 can perform image processing according to a program without using the image processing unit 104.

The display 105 displays an image, a GUI screen forming a GUI (Graphical User Interface), or the like under the control of the CPU 101. The CPU 101 controls each unit of the display control device 100 so as to generate a display control signal according to a program, generate a video signal to be displayed on the display 105, and output the video signal to the display 105. The display 105 displays an image based on the generated/outputted image signal. The display control device itself may include an interface for outputting a video signal to be displayed on the display 105, and the display 105 may be an external monitor (TV, HMD, etc.).

The operation unit 106 is an input device for receiving a user operation, which includes a character information input device such as a keyboard, a pointing device such as a mouse or a touch panel, a button, a dial, a joystick, a touch sensor, and a touch pad. The touch panel 106a is an input device configured to be superimposed on the display 105 in a planar manner and to output coordinate information according to the touched position.

A recording medium 108 such as a memory card, a CD or a DVD can be attached to and detached from the recording medium I/F 107. The recording medium I/F 107 reads data from the attached recording medium 108 and writes data to the recording medium 108 under the control of the CPU 101. The external I/F 109 is an interface for connecting to an external device by a wired cable or wirelessly and inputting/outputting a video signal and an audio signal. The communication I/F 110 is an interface for communicating with an external device, the Internet 111, or the like to send and receive various data such as files and commands.

The voice output unit 112 outputs voices of moving images and music data, operation sounds, ring tones, various notification sounds, and the like. The audio output unit 112 includes an audio output terminal 112a (described later) for connecting earphones and the like and a speaker 112b (described later). The audio output unit 112 outputs audio data to an external speaker by wireless communication or the like. May be.

The posture detection unit 113 detects the posture (tilt) of the display control device 100 with respect to the gravity direction and the posture of the display control device 100 with respect to each of the yaw direction, pitch direction, and roll direction axes. Based on the posture detected by the posture detection unit 113, whether the display control device 100 is horizontally held, vertically held, faced upward, faced downward, or in an oblique posture. Can be determined. In addition, it is possible to determine whether or not the display control device 100 is tilted in a rotation direction such as a yaw direction, a pitch direction, and a roll direction, and whether the display control device 100 is rotated in the rotation direction. One sensor or a combination of a plurality of sensors such as an acceleration sensor, a gyro sensor, a geomagnetic sensor, an orientation sensor, and an altitude sensor can be used as the attitude detection unit 113.

The operation unit 106 includes a touch panel 106a. The CPU 101 can detect the following operations on the touch panel 106a or the states thereof.
A new touch on the touch panel 106a by a finger or pen that has not touched the touch panel 106a, that is, the start of touch (hereinafter referred to as touch-down).
A state where a finger or a pen is touching the touch panel 106a (hereinafter, referred to as touch-on).
A finger or pen moving while touching the touch panel 106a (hereinafter, referred to as Touch-Move)
-The finger or pen touching the touch panel 106a is separated from the touch panel 106a, that is, the touch ends (hereinafter, referred to as Touch-Up).
A state in which nothing is touched on the touch panel 106a (hereinafter, referred to as touch-off)

When touch down is detected, touch on is also detected. After touchdown, touchon is normally detected unless touchup is detected. Even if a touch move is detected, touch-on is detected at the same time. Even if the touch-on is detected, the touch move is not detected unless the touch position is moved. When it is detected that all the touched fingers or pens are touched up, touch-off is detected.

These operations/states and the position coordinates of the finger or pen touching the touch panel 106a are notified to the CPU 101 through the internal bus, and the CPU 101 performs any operation (touch operation) on the touch panel 106a based on the notified information. ) Is performed. With respect to the touch move, the moving direction of the finger or the pen moving on the touch panel 106a can be determined for each vertical component/horizontal component on the touch panel 106a based on the change in the position coordinates. When it is detected that the touch move is performed over the predetermined distance, it is determined that the slide operation is performed.

An operation of quickly moving a certain distance while touching the finger on the touch panel 106a and then releasing the finger is called a flick. In other words, the flick is an operation of quickly tracing the touch panel 106a with a finger. When it is detected that a touch move is performed over a predetermined distance or more at a predetermined speed or more, and a touch-up is detected as it is, it can be determined that a flick has been performed (it can be determined that a flick follows a slide operation).

Further, a touch operation of simultaneously touching a plurality of points (for example, two points) to bring the touch positions closer to each other is called a pinch-in, and a touch operation of moving the touch positions away from each other is called a pinch-out. Pinch out and pinch in are collectively referred to as a pinch operation (or simply pinch). The touch panel 106a may be any of various types of touch panels such as a resistance film type, a capacitance type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. Good. There is a method of detecting that there is a touch due to the touch on the touch panel, and a method of detecting that there is a touch due to the approach of the finger or pen to the touch panel, but any method may be used.

FIG. 2 is an external view of a display control device 100 that is an example of an electronic device. The display control device 100 is a display device such as a smartphone. The display 105 is a display unit that displays images and various information. The display 105 is configured integrally with the touch panel 106a, and can detect a touch operation on the display surface of the display 105. The display control device 100 can display a VR image (VR content) on the display 105 in a VR manner. For example, a VR image captured by a digital camera (omnidirectional camera; omnidirectional camera) is acquired via the communication I/F 110 (the VR image transferred by wireless communication is received) and recorded in the recording medium 108. be able to. The VR image recorded on the recording medium 108 in this manner can be VR-displayed (displayed in the VR view) on the display 105. Further, a recording medium on which a VR image captured by a digital camera is recorded is directly connected to the recording medium I/F 107, and the VR image is read out from the recording medium and reproduced, thereby displaying a VR on the display 105 (displayed in a VR view). ) Is also possible. It is also possible to acquire a VR image (shared VR image) recorded in a server device or the like connected to the network via the SNS or the like and display the VR image. In the present embodiment, the operation unit 106 includes a touch panel 106a and operation units 106b, 106c, 106d and 106e. The operation unit 106b is a power button that receives an operation for switching the power of the display control device 100 on and off. The operation unit 106c and the operation unit 106d are volume buttons for increasing or decreasing the volume of the sound output from the sound output unit 112. The operation unit 106e is the display 1
This is a home button for displaying the home screen on 05. The audio output terminal 112a is an earphone jack and is a terminal that outputs an audio signal to an earphone, an external speaker, or the like. The speaker 112b is a main body built-in speaker that outputs sound.

The display control device 100 can display the VR image (VR content) in the VR on the display 105. The VR image is an image that can be displayed in VR (displayed in the display mode “VR view”). The VR image is an omnidirectional image (omnidirectional image) captured by an omnidirectional camera (omnidirectional camera) or a panoramic image having a wider image range (effective image range) than the display range that can be displayed on the display unit at one time. Etc. shall be included. The VR image includes not only a still image but also a moving image and a live view image (image obtained from a camera in almost real time). The VR image has a maximum visual range of 360 degrees in the vertical direction (vertical angle, angle from zenith, elevation angle, depression angle, altitude angle, pitch angle) and 360 degrees in the horizontal direction (horizontal angle, azimuth angle, yaw angle). Has (effective video range). Further, even if the VR image is less than 360 degrees up and down and less than 360 degrees left and right, it can be displayed on a wide range of view angles (viewing range) wider than the view angle that can be captured by a normal camera, or at once on the display unit. Images with a wider video range (effective video range) than the display range are also included. For example, an image taken with a omnidirectional camera capable of shooting a subject in a horizontal direction (horizontal angle, azimuth angle) of 360 degrees and a vertical field of view of 210 degrees (angle of view) centered on the zenith is It is a type of VR image. Further, for example, an image captured by a camera capable of capturing a subject in a horizontal direction (horizontal angle, azimuth angle) of 180 degrees and a vertical field of 180 degrees centering on the horizontal direction (angle of view) is a VR image. It is a kind. That is, a VR image is an image that has a visual range of 160 degrees (±80 degrees) or more in each of the vertical direction and the horizontal direction, and that has a wider visual range than a range that a human can visually recognize at one time. Is a kind of. When this VR image is VR-displayed (display mode: "VR view" is displayed), the posture of the display device (display device that displays the VR image) is changed in the left-right rotation direction, so that the left-right direction (horizontal rotation direction) is changed. Allows you to view seamless, omnidirectional video. In the vertical direction (vertical rotation direction), a seamless omnidirectional image can be viewed within ±105 degrees from directly above (zenith), but there is no image above 105 degrees from directly above. It becomes a blank area. The VR image can also be said to be an “image in which the video range is at least a part of the virtual space (VR space)”.

The VR display (VR view) is a display method (display mode) capable of changing the display range, in which a video image in a visual field range corresponding to the attitude of the display device is displayed in the VR image. When a head mounted display (HMD), which is a display device, is mounted and viewed, an image in a visual field range corresponding to the orientation of the user's face is displayed. For example, in a VR image, an image with a viewing angle (angle of view) centered at 0° in a horizontal direction (a specific azimuth, for example, north) and 90° in a vertical direction (90° from the zenith, that is, horizontal) at a certain point in time. Is displayed. From this state, when the posture of the display device is reversed upside down (for example, when the display surface is changed from southward to northward), 180 degrees (reverse azimuth, for example, south) of the same VR image is rotated vertically. The display range is changed to an image with a viewing angle centered at 90 degrees (horizontal) in the direction. When the user is watching the HMD, if the user turns their face from north to south (that is, if they face back), the image displayed on the HMD will change from the image in the north to the image in the south. is there. With such a VR display, it is possible to provide the user with a visual feeling as if he/she were in the VR image (VR space). A smartphone attached to VR goggles (head mount adapter) can be said to be a type of HMD.

The display method of the VR image is not limited to the above. Instead of changing the posture, the display range may be moved (scrolled) according to a user operation on the touch panel, direction buttons, or the like. Even in the case of VR display (display mode “VR view”), the display range is changed according to the posture change, touch move to the touch panel, drag operation to the mouse, etc. May be changed.

In the present embodiment, a VR image having a video range (effective video range) of 360 degrees in the vertical and horizontal directions at the maximum, and a VR image having a video range of 180 degrees in the vertical and horizontal directions (effective video range). The cutting operation and processing will be described. Note that, hereinafter, a VR image having a video range (effective video range) of 360 degrees in the vertical and horizontal directions at the maximum is referred to as a 360-degree VR image. A VR image having a video range (effective video range) of 180 degrees of visual field in the vertical and horizontal directions is referred to as a 180-degree VR image. The process of cutting out a 180-degree VR image from a 360-degree VR image is conceptually a process of cutting out a hemisphere from a virtual sphere onto which a 360-degree video image is mapped. The cutout described in the present embodiment is not a process of cutting out a normal rectangular image (planar image), but a process of cutting out an image that can be viewed as a VR image even after cutout (that can be viewed in a VR view by mapping on a sphere). Is. Since the image after cutting has an effective image range of 180 degrees in the vertical and horizontal directions, when it is mapped on a sphere, an effective image of a hemisphere (a captured image or the like) is mapped. The remaining hemisphere corresponds to the invalid video range, and the image filled with a single color or a predetermined pattern, or a video that is complemented in some way is mapped. When viewing such a VR image after cutout in the VR view, the user can visually recognize the image in a front width range of 180 degrees (90 degrees from the center in the vertical and horizontal directions). The reason for performing such a cutting process is as follows.

First, the amount of image data can be reduced. The cut-out 180-degree VR image has a smaller amount of data than the 360-degree VR image. Therefore, it is possible to suppress the capacity pressure of the recording medium during storage. In addition, it is possible to reduce the amount of communication data when transmitting and receiving, and to reduce the processing load when displaying, and accordingly, there are effects such as improvement in processing speed and response speed, and reduction in power consumption.

Secondly, unnecessary subjects can be deleted. For example, in most cases of capturing a VR image having an effective image range for a field of view of 360 degrees, it is inevitable that the photographer himself/herself will be reflected. However, when the photographer wants to photograph a landscape instead of the photographer himself, the photographer himself is an unnecessary subject and is not intended. When an unintended image is captured, it prevents the viewer from concentrating the viewer's attention on the image such as a landscape that the photographer thought was the subject. In addition, confidential information such as the face of a passerby or the license plate of a passing vehicle is often captured, which may be undesirable from the viewpoint of privacy and security. These problems can be avoided by cutting out only the range intended by the photographer and discarding the images in other unnecessary ranges by the cutout process.

Thirdly, it is possible to reduce the physical burden on the user who views the VR view. When viewing a VR image of 360 degrees in a VR view, an image exists behind the viewing user. If the image is for 180 degrees ahead, the viewer can look around by simply changing the direction of his/her neck, but if he wants to look behind him, he must twist his/her upper body or change the standing direction. However, the physical burden is rather high. Such a physical movement to look behind is not suitable for sitting on a chair for viewing unless the chair is a swivel chair. On the other hand, in a VR image of 180 degrees, the entire body can be overlooked simply by changing the direction of one's own neck, so that the physical burden on viewing is relatively small. If the viewer recognizes that the VR image is a 180-degree VR image by a guide display or a display that shows that the range exceeding 180 degrees is an invalid area, the viewer may try to look behind. Absent. Therefore, it is possible to prevent the viewer from performing a physical action such as looking back.

Fourth, it is possible to display the VR image of 360 degrees in correspondence with the recording format for the VR image of 180 degrees. When the recording format of a 360-degree VR image is different from the recording format of a 180-degree VR image, a playback device (playback application software) that only supports viewing of a 180-degree VR image can output a 360-degree VR image. You cannot view the image. However, if a 180-degree VR image is generated by cutting out a 360-degree VR image, it can be viewed even by a playback device that is only capable of viewing the 180-degree VR image. Further, even if both the 180-degree VR image viewing and the 360-degree VR image viewing are supported, it is necessary to switch between the 180-degree VR image viewing mode and the 360-degree VR image viewing mode. In some cases, the switching operation is troublesome. However, if a 180-degree VR image is generated by cutting out from a 360-degree VR image, it is possible to sequentially switch and display a plurality of VR images without switching the display mode for the 180-degree VR image. Also, two 180-degree VR images for the right eye and the left eye, respectively, captured by two camera units installed at a distance apart by parallax toward the subject in the same direction, are displayed so that they can be viewed stereoscopically. A display mode (binocular VR view) is assumed. If a 180-degree VR image for the right eye and a 180-degree VR image for the left eye are cut out and recorded from the 360-degree VR image, it is possible to view even with such a two-eye VR view.

In the present embodiment, an example in which a 180-degree VR image is cut out and generated from a 360-degree VR image will be described. However, a VR image having an effective video range narrower than the effective video range of the VR image before cutting is cut out. The processing can be applied to VR images with other viewing angles. That is, the VR image before cutout is not limited to the VR image of 360 degrees, and the VR image after cutout is not limited to the VR image of 180 degrees.

In each process described below, an example in which various touch buttons are displayed and a touch operation on each touch button is received as a user operation to proceed the process will be described. Specifically, the touch operation of receiving instructions for various touch buttons may be a touch-up from a touch reaction area corresponding to the touch button or a touch-down to a touch reaction area corresponding to the touch button. Moreover, the present invention is not limited to this, and each instruction described as being accepted by an operation on a touch button described later may be accepted by another user operation. For example, an operation to each physical button, an operation to select a display item using the direction keys and press the enter button, an operation to select a display item using the mouse, a voice command, or the like may be used.

The operation of the embodiment of the present invention will be described below with reference to FIGS.
FIG. 3 is a flowchart showing an example of a cutting process from the 360-degree VR image to the 180-degree VR image by the display control device 100. Each process in this flowchart is realized by the CPU 101 expanding a program stored in the nonvolatile memory 103 into the memory 102 and executing the program.

When the display control device 100 is powered on and a VR image (VR content) is selected from the images recorded on the recording medium 108 or the images acquired from the communication destination, the process of FIG. 3 is started.

In S301, the CPU 101 reads the VR image to be displayed from the communication destination via the recording medium 108 or the communication I/F 110. The CPU 101 acquires information indicating a video range (effective video range) attached as attribute information of the VR image, and displays the VR image in a flat display that fits the effective video range in a rectangle. The effective image range of the VR image displayed flat on the display 105 in S301 is an example of the first effective image range. In the case of the VR view, it is displayed by mapping it on a virtual sphere, but in the flat display, it is displayed as a whole in a rectangle by the equirectangular projection. Therefore, the subject is distorted in a portion from the rectangular end portion as compared with the case of displaying in the VR view.

The information indicating the effective image range is information indicating which angle range of the effective image the VR image has in the vertical direction and the horizontal direction. The information indicating the effective image range may be any information as long as it can identify the effective image range of the VR image, and is angle information represented by an angle of view, a viewing angle, an azimuth angle, an elevation angle, a depression angle, an altitude angle, a steradian, and the like. Alternatively, it may be position information such as the number of pixels on the top and bottom, and the left and right, and coordinates.

Further, the information indicating the effective video range may be model information of the camera that captured the VR image (the range that can be photographed can be specified by specifying the model), zoom information at the time of photographing, or the like. When the CPU 101 acquires the information indicating the effective video range, the CPU 101 also specifies (calculates) the invalid video range (non-video range) based on the difference between the upper, lower, left and right 360 degrees. On the contrary, the information indicating the invalid video range may be acquired from the attribute information of the VR image, and the valid video range may be calculated from the information, or both the information indicating the valid video range and the information indicating the invalid video range may be obtained. It may be acquired from the attribute information of the VR image.

FIG. 6A shows a display example (display example on the first screen) of the flat display in S301. Since the image uses the equirectangular projection, the image is distorted unlike the real one. The user can switch to the cutout mode of the VR image 601 by operating the cutout button 602. The cutout button 602 is an operation button that receives a setting instruction of the cutout range from the user. Further, an instruction icon for transitioning to the VR view may be displayed. In response to an operation on this instruction icon, the same image can be transitioned from the flat display to the VR view. If a touch move is performed on the display area of the VR image 601 during the flat display in S301, the image is switched to another image (the next image in a predetermined order such as a file name order, Or switch to the display of the previous image). The flat display in S301 is a screen for the user to identify an image to be displayed or edited. When the images are switched by touch move, the VR image 601 is slid (scrolled) in the touch move direction following the touch move, but the outside of the end of the VR image 601 shown in FIG. The non-image area of, or the image after switching is displayed. That is, unlike the scroll in the cutout region setting process of FIG. 4, the cyclic scrolling in which the end portion cannot be identified is not performed.

In S302, the CPU 101 determines whether or not there is a touch operation on the cutout button 602, that is, whether there is an instruction to set the cutout range on the touch panel 106a. If there is an instruction to set the cutout range, the process proceeds to S303, and if there is no instruction to set the cutout range, the process ends. If the process proceeds to S303, the mode transitions to a mode for setting a cutout range for cutting out a VR image at 180°.

In S303, the CPU 101 displays a selection screen for selecting whether or not to perform the zenith correction, receives the parameters related to the zenith correction input on the touch panel 106a, and performs the zenith correction when it is desired to perform the zenith correction. I do. FIG. 6B shows a display example of a selection screen for selecting whether or not to perform the zenith correction displayed in S303. The zenith correction selection dialog 603 of FIG. 6B is displayed by operating the cutout button 602. The zenith correction selection dialog 603 has a button 604 and a button 605. The user operates the button 604 to select the zenith axis before the VR image is cut out. When the button 605 is selected, the zenith axis is not corrected before the VR image cutout process.

In S304, the CPU 101 displays the cutout UI on the display 105. That is, the display screen described in S301 is switched to the cutout UI screen according to a cutout range setting instruction from the user (switching control). FIG. 6C shows a display example (display example of the second screen) of the cutout UI displayed in S304. The cutout area frame 606 is an indicator that indicates an area of 180° cut out from the VR image. The cutout area frame 606 is displayed on the VR image (VR content) flat-displayed in the rectangular area. The cut-out area frame 606 does not indicate an accurate cut-out range, but indicates a rough range. The non-cutout region 608 indicates a region that is not included in the 180° cutout region.

The user operates the cutout determination (completion) button 611 to set the cutout area 607 surrounded by the cutout area frame 606 as the cutout area. By operating the button for selecting the zenith cutout button 612, an area of 180° around the zenith direction (upward direction of VR content) is set as a cutout area. By operating the button to select the nadir cutout button 613, an area of 180° centering around the nadir direction (downward direction of VR content) is set as a cutout area. The CPU 101 can generate the edited VR content having an effective video range narrower than the effective video range before the cutout based on the set cutout area. As described above, the CPU 101 does not scroll the VR content in the vertical direction, and cuts out the VR content in the vertical direction by a button operation (operation without scrolling operation) by the user.

In step S<b>305, the CPU 101 determines whether touchdown has been detected in the central area inside the cutout area 607 in the display area of the VR image displayed flat on the display 105. The central region inside the cutout region 607 is a region inside the left and right portions of the cutout region frame 606, which are the left and right boundaries of the cutout region 607, by a predetermined width or more. When the touchdown to the central area is detected, the process proceeds to S306, and when the touchdown to the central area is not detected, the process proceeds to S307.

In S306, the CPU 101 executes cutout direction setting processing. The clipping direction (range of image to be clipped) is set based on the area surrounded by the clipping area frame 606 shown in FIG. 6C. The effective video range of the clipped area is an example of the second effective video range. The CPU 101 at least matches the center of the area surrounded by the cutout area frame 606 shown in FIG. 6C with the center of the actually cut effective image range (second effective image range). To control. However, since the cutout area frame 606 shown by being superimposed on the flat display does not accurately represent the cutout boundary of the hemisphere, the range shown by the cutout area frame 606 and the effective image area actually cut out (second The effective video range) does not completely match. For example, the range of the area surrounded by the cutout area frame 606 may be made larger than the actually cut out effective image range (180°). The cutout direction setting process will be described later with reference to FIG.

In S307, the CPU 101 executes VR edge area confirmation processing. The VR end area confirmation processing will be described later with reference to FIG.

In S308, the CPU 101 determines whether or not a touch operation has been performed on the cutout determination button 611, that is, whether or not there is a cutout instruction. If there is a cutout instruction, the process proceeds to S309, and if there is no cutout instruction, the process ends.

In step S309, the CPU 101 clips an image in the range of 180° in the clipping direction set in step S306, and saves the image clipped in the VR 180° format in the recording medium 108. That is, the cut-out VR image is recorded on the recording medium 108.

The cut-out VR image (image file that can be displayed in VR view) recorded in S309 will be described. If the VR image that has been cut out is a still image, the image that is obtained by transforming the image within the cutout range into a rectangle by the equirectangular cylindrical projection and storing it is generated in multiple files in one file in the multi-picture format. And record. When a VR image (original image) of 360 degrees before being cut out is displayed as a normal plane image instead of a VR view, an image drawn by the equirectangular projection in a rectangle as shown in FIG. Become. This is displayed in S301. When a range of 180 degrees is cut out from the original image by the process described in FIG. 4, when the normal image is displayed instead of the VR view, as shown in FIG. The image drawn by the projection method is recorded. At this time, the same image obtained by copying the image within the cutout range is recorded in the same file as a right-eye image and a left-eye image, respectively, even if there is no parallax. Note that two 180-degree ranges are cut out from one 360-degree VR image before cut-out so as to have a pseudo parallax (that is, the range between the left-eye image and the right-eye image is slightly different). May be. The file name of the VR image of the clipped still image is, for example, “123456.vr.jpg”, and the three-character character string “.vr” is described before the extension “.jpg”. When the image thus saved as a still image file is reproduced and displayed in the VR view, the image in FIG. 10B is displayed in a hemisphere-mapped state. FIG. 10D shows an example in which a VR image file of a cut-out still image is reproduced and displayed in the twin-lens VR view (display example on the display 105 in a state where the VR goggle is not attached).

If the cut-out VR image is a moving image, the images (moving images) in which the images in the cutting range are mapped in a circle or an ellipse instead of the equirectangular projection are arranged side by side (side-by-side) in the image of one moving image. Generate and record the created video file. At this time, the same image obtained by copying the image within the cutout range is recorded side by side as a right-eye image and a left-eye image, respectively, even if there is no parallax. When such a moving image is displayed as a normal plane image instead of the VR view, it is displayed as shown in FIG. Note that two 180-degree ranges are cut out from one 360-degree VR image before cut-out so as to have a pseudo parallax (that is, the range between the left-eye image and the right-eye image is slightly different). May be. The file name of the VR image of the cut-out moving image is, for example, “123456.vr.mp4”, and the character string “.vr” of three characters is described before the extension “.mp4”. FIG. 10D shows a display example of a frame (display example in the display 105 in a state where the VR goggle is not attached) when the VR image file of the cut-out moving image is reproduced and displayed in the twin-lens VR view. It is similar to the example shown.

FIG. 4 is a flowchart showing an example of the cutout direction setting process of S306 in FIG. The cutout direction setting process is realized by the CPU 101 expanding the program stored in the non-volatile memory 103 into the memory 102 and executing the program.

In S401, the CPU 101 determines whether a right scroll input has been performed on the touch panel 106a. The input of right scroll is an operation of scrolling an image to the right, and corresponds to a scroll instruction in the right direction. The input of right scroll is, for example, a touch move for moving to the right or an operation for sliding a scroll bar (not shown) to the left. If the right scroll input has been performed, the process proceeds to S402, and if the right scroll input has not been performed, the process proceeds to S404.

In S402, when the CPU 101 receives a right scroll input from the user, the CPU 101 scrolls (slides) the image to the right. The CPU 101 sequentially displays the image area corresponding to the scroll amount in the right direction of the display 105 from the left end of the display 105 toward the right direction in accordance with the scroll. Note that the position of the cutout area frame 606 on the screen is fixed and does not scroll even if a scroll input is made.

In S403, the CPU 101 moves the area on the left side excluding the image area on the right side by the scroll amount to the right by the scroll amount and displays it. That is, the CPU 101 scrolls the VR content displayed flat in the rectangular area of the display 105 in the right direction. Further, in response to the scroll, the CPU 101 sequentially displays image areas corresponding to the right scroll amount of the VR content from the left end of the rectangular area opposite to the right direction to the right direction. Let

7A to 7E show display examples by the scroll performed in S402 and S403. The right scroll 701 in FIG. 7B represents scroll input in the right direction with respect to FIG. 7A. When the right scroll 701 is input, the processes of S402 and S403 of FIG. 4 are executed. For example, in S401, it is assumed that the user has scrolled to the right end side of the display 105 by the scroll amount D1. In S402, the CPU 101 sequentially displays the image area 7011 for the scroll amount (D1) surrounded by the dotted line from the left end of the display 105 toward the right. Next, in step S403, the CPU 101 moves the left area 7012 surrounded by the alternate long and short dash line excluding the image area 7011 corresponding to the scroll amount (D1) to the right by the scroll amount (D1) to be displayed. When these processes are executed, the display 105 has a display as shown in FIG.

The right scroll 703 in FIG. 7D represents scroll input in the right direction with respect to FIG. 7C. When the right scroll 703 is input, as in the case of inputting the right scroll 701, the processes of S402 and S403 of FIG. 4 are executed and the display of FIG.

As described above, in the scrolling performed in S402 and S403, if the image is scrolled to the right, the part which is scrolled out of the right display area and disappears successively enters from the left end of the display area toward the right. Is displayed. Then, by repeating the right scroll input, it is possible to endlessly scroll without hitting. That is, it is a circular scroll display of the same content without making the boundaries such as the left and right ends of the VR image 601 conscious. By doing so, the portion located at the end of the display area in the display example of FIG. 6A can be located at the center of the cutout area frame 606. Then, it is possible to instruct to make a 180-degree centered area around that position (a range of 90-degree circumference around that position) with no breaks as the VR image after being cut out. It should be noted that the circular scroll display need only be capable of designating an arbitrary azimuth of the VR image at the center, and therefore need not be infinitely circulable, but may be circulated at least once.

In S404, the CPU 101 determines whether or not a left scroll input is made to the touch panel 106a on the side opposite to the right direction. The input of the left scroll is an operation of scrolling the image to the left, and corresponds to a scroll instruction in the left direction. The input of the left scroll is, for example, a touch move for moving to the left or an operation for sliding a scroll bar (not shown) to the right. When the input of the left scroll is performed, the process proceeds to S405, and when the input of the right scroll is not performed, the process proceeds to S407.

In step S405, when the CPU 101 receives a left scroll input from the user, the CPU 101 scrolls (slides) the image to the left. The CPU 101 sequentially displays the image area corresponding to the scroll amount to the left of the display 105 from the right end of the display 105 toward the left in accordance with the scroll. Note that the position of the cutout area frame 606 on the screen is fixed and does not scroll even if a scroll input is made.

In step S<b>406, the CPU 101 moves the area on the right side excluding the image area on the left for the scroll amount to the left by the scroll amount and displays it. That is, the CPU 101 scrolls the VR content displayed flat in the rectangular area of the display 105 in the left direction. Further, in response to the scroll, the CPU 101 sequentially displays image areas corresponding to the leftward scroll amount of the VR content from the right end of the rectangular area opposite to the left direction to the right direction. Let

FIGS. 8A to 8E show display examples by scrolling performed in S402 and S403. The left scroll 801 in FIG. 8B represents scroll input in the left direction with respect to FIG. 8A. When the left scroll 801 is input, the processes of S405 and S406 of FIG. 4 are executed. For example, in S404, it is assumed that the user has scrolled to the left end side of the display 105 by the scroll amount D2, as opposed to FIG. 7B. In step S405, the CPU 101 sequentially displays the image area 8011 of the scroll amount (D2) surrounded by the dotted line from the right end of the display 105 toward the left. Next, in S406, the CPU 101 moves the left area 8012 surrounded by the alternate long and short dash line excluding the image area 8011 corresponding to the scroll amount (D2) to the left by the scroll amount (D2) to be displayed. When these processes are executed, the display 105 has a display as shown in FIG.

The left scroll 803 in FIG. 8D represents scroll input in the left direction with respect to FIG. 8C. When the left scroll 803 is input, as in the case where the left scroll 801 is input, the processes of S405 and S406 of FIG. 4 are executed and the display of FIG.

As described above, in the scroll performed in S404 and S405, if the image is scrolled to the left, the part that is scrolled to the outside of the left display area and disappears successively enters from the right end of the display area to the left. Is displayed. Then, if the input of the left scroll is repeated, it is possible to endlessly scroll without hitting. That is, it is a circular scroll display of the same content without making the boundaries such as the left and right ends of the VR image 601 conscious. By doing so, the portion located at the end of the display area in the display example of FIG. 6A can be located at the center of the cutout area frame 606. Then, it is possible to instruct to make a 180-degree centered area around that position (a range of 90-degree circumference around that position) with no breaks as the VR image after being cut out.

In step S407, the CPU 101 determines whether or not a touch operation has been performed on the reset button 610, that is, whether or not an operation for resetting the cutout direction has been received. If the reset instruction has been issued, the operation proceeds to S408, and if the reset instruction has not been issued, the operation proceeds to S409. The reset cutting-out direction position is the setting of the cutting-out direction set at the time of the process of S304 of FIG. In S408, the CPU 101 sets the cutout direction to the initial position.

In step S<b>409, the CPU 101 determines whether or not the cutout determination button 611 has been touched, that is, whether or not a cutout direction determination instruction operation has been received. If the cutout direction determination instruction has been issued, the process ends, and if the cutout direction determination instruction has not been issued, the process proceeds to S401. If Yes is determined in S409, Yes is also determined in S308. That is, in the present embodiment, the cutout direction determination instruction and the cutout instruction are the same instruction. However, the cutout direction determination instruction and the cutout instruction may be performed by different operations. For example, a preview display showing the range of the VR image after clipping is performed in response to the instruction to determine the clipping direction, and then an image file of the VR image that has already been clipped is generated by the clipping instruction. You can

Note that, by scrolling in the left-right direction described in S401 to S406, it is possible to specify the azimuth in the range of the VR image after clipping, out of the VR image before clipping. The elevation angle of the VR image after the clipping is 180 degrees from the zenith to the nadir, centering around the horizontal direction (direction of 90 degrees from the zenith, or 90 degrees from the zenith after correction if the zenith correction is performed). Fixed to a range of degrees. By doing this, it is possible to prevent the complexity of specifying the cutout range. In addition, the VR image after clipping can be set to 180 degrees centering on the front (horizontal direction) as viewed from the viewer, and the range behind the zenith and the range behind the nadir. Can be excluded. As a result, it is possible to prevent viewing in an unreasonable posture in which the user looks backward while looking at the VR view.

When the zenith cutout button 612 is touched, the cutout range is centered on the zenith (the zenith after correction if the zenith correction is performed) regardless of the range (direction specified by the user) indicated by the cutout region frame 606. The range is 90 degrees in all directions. This is the upper hemisphere range when the virtual sphere is equally divided vertically. When the zenith cutout button 613 is touched, the cutout range is the zenith (the zenith after correction if the zenith correction is performed, regardless of the range indicated by the cutout area frame 606 (the direction specified by the user). ) Is the center and the range is 90 degrees in all directions. This is the lower hemisphere range when the virtual sphere is equally divided vertically. When the zenith cutout button 612 and the nadir cutout button 613 are touched, it is considered that the cutout instruction has been given, and the file generation of the cutout VR image in S309 of FIG. 3 is performed. By doing so, it is possible to prevent unnatural cutting such that a hemisphere in which the virtual sphere before cutting is diagonally cut is generated. That is, it is possible to easily generate a cut-out VR image that can see the entire sky above the horizon, and a cut-out VR image that can see the entire room viewed from the ceiling and the entire dish on the table viewed from the table. ..

FIG. 5 is a flowchart showing an example of the VR edge region confirmation processing of S307 in FIG. The VR end area confirmation processing is realized by the CPU 101 expanding the program stored in the non-volatile memory 103 into the memory 102 and executing the program. The VR edge region confirmation process is a process that allows the user to confirm the edge region of the VR image to be clipped by displaying the boundary of the clipped region and a region including the border in VR.

In step S501, the CPU 101 determines whether or not the left and right end regions of the cutout region 607 are touched in the display region of the displayed VR image, not the above-described central region, as an instruction to confirm the end of the cutout range. To do. The left and right edge areas include an area within a predetermined width (left edge area) including the left side of the cutout area frame 606, which is the left and right boundary of the cutout area 607, and the right side of the cutout area frame 606 → a predetermined width from the side. It is an area within (right end area). If the left and right edge areas have been touched, the process proceeds to S502, and if the edge areas have not been touched, the processing ends. The instruction to confirm the end of the cutout range is not limited to this. For example, an icon for instructing confirmation of the end of the cutout range may be displayed, and touching of this icon may be an instruction for confirmation of the end of the cutout range. Further, in the display area of the displayed VR image, the left side of the left side of the cutout area frame 606 or the right side of the right side of the cutout area frame 606 may be touched to confirm the end of the cutout range.

In S502, the CPU 101 reads the VR image acquired in S301. Further, the information indicating the video range (effective video range) attached as the attribute information of the VR image is acquired. The information indicating the effective image range is information indicating which angle range of the effective image the VR image has in the vertical direction and the horizontal direction. The information indicating the effective video range may be information that can specify the effective video range of the VR image, and may be position information such as an angle of view, a viewing angle, an azimuth angle, an elevation angle, the number of left and right pixels, and coordinates. Further, the information indicating the effective video range may be model information of the camera that captured the VR image (the range that can be photographed can be specified by specifying the model), zoom information at the time of photographing, or the like.

When the CPU 101 acquires the information indicating the effective video range, the CPU 101 also specifies (calculates) the invalid video range (non-video range) based on the difference between the upper, lower, left and right 360 degrees. On the contrary, the information indicating the invalid video range may be acquired from the attribute information of the VR image, and the valid video range may be calculated from the information, or both the information indicating the valid video range and the information indicating the invalid video range may be obtained. It may be acquired from the attribute information of the VR image.

In S503, the CPU 101 determines whether or not the right end area is touched. If the right edge area is touched, the process proceeds to S504, and if the right edge area is not touched, S5.
Go to 05.

In S504, the CPU 101 performs display processing of the right end area of the VR image acquired in S502 based on the display range within the cutout area frame 606 of the VR image. The original data (original image) of the VR image is a distorted image using, for example, the equirectangular projection, and is an image in a format in which the position of each pixel can be associated with the coordinates of the surface of the sphere. The original image of this VR image is mapped onto a sphere, and a part of it is cut out and displayed. That is, the image displayed in S504 is an image obtained by cutting out and enlarging a part of the VR image, and is an image in which the distortion of the original image is removed (or reduced). In this case, the CPU 101 displays the VR image to be displayed in the azimuth range of 90° (a total of 180°) to the left and right around the center line of the area surrounded by the cutout area frame 606, and the elevation from the zenith to the nadir. The range of depression angle is the effective range. The CPU 101 sets the other ranges as outside the valid range (invalid range, exclusion range outside the cutout range). The CPU 101 can confirm the situation of the end on the boundary line between the valid range and the invalid range on the right side by displaying the right end region centering on the boundary line between the valid range and the invalid range.

In S505, the CPU 101 performs display processing of the left end area of the VR image acquired in S502 based on the display range within the cutout area frame 606 of the VR image. The display method is the same as S504. Here, by displaying the left end region centered on the boundary line between the effective range and the invalid range, it is possible to confirm the situation of the end on the boundary line between the effective range and the invalid range on the left side.

In S506, the CPU 101 determines whether a touch move has been detected, based on the information notified from the touch panel 106a. If the touch move is detected, the process proceeds to S507, and if the touch move is not detected, the process proceeds to S508.

In step S507, the CPU 101 changes the display range of the VR image according to the direction of the slide operation by the touch move (the direction of the touch move). For example, when it is determined that the touch move direction is the left direction, the display range of the VR image is shifted (slide) by the amount touch-moved to the left direction, so that the user can feel the operation of moving the VR image itself. It can be operated. At this time, the display position on the display 105 of the area outside the cutout range is fixed. Therefore, the touch move shifts the relative relationship between the region outside the cutout range and the displayed range inside the cutout range, and changes the cutout range (cutout direction) for the VR image before cutout. In this way, it is possible to set the cut-out range by finely adjusting how far the cut-out range is set, while checking the boundaries of the cut-out range.

In S508, the CPU 101 determines whether or not a cutout instruction operation has been performed on the touch panel 106a. If there is a cutout instruction, the process proceeds to S509, and if there is no cutout instruction, the process proceeds to S510.

In step S<b>509, the CPU 101 cuts out an image in the range of 180° in the cutout direction specified in step S<b>508, and saves the image in the recording medium 108 in the VR 180° format. The generated image file is the same as that described in S309.

In S510, the CPU 101 determines, based on the information notified from the touch panel 106a, whether or not a return instruction has been issued by a touch operation of the return button. If the return instruction is issued, the process proceeds to S511, and if the return instruction is not issued, the process returns to S506.

In step S511, the CPU 101 reads the VR image acquired in step S502, acquires information indicating a video range (effective video range) attached as attribute information of the VR image, and performs VR in a flat display in which the effective video range is contained in a rectangle. Display the image. When the display range is changed in S507, the center position of the flat-displayed image is set based on the information on the center of the changed display range. After the display, the VR end area confirmation processing ends.

The edge confirmation display of the VR edge area confirmation processing will be described with reference to FIG. This display is the display performed in S504 and S505 of FIG.

FIG. 9A is a diagram showing a state in which the right end side is displayed when the VR image is VR-displayed. FIG. 9A is displayed, for example, by touching a non-cutout area 608 on the right side of the cutout area frame 606 in FIG. 6C or on the right side. Touching the non-cutout area 608 on the right side of the cutout area frame 606 or on the right side is an example of a “confirmation instruction” from the user. The confirmation instruction is an operation of designating a boundary to be confirmed or an area including the boundary in the area surrounded by the cutout area frame 606. The right side effective range 901 and the ineffective range 902 are displayed in VR display (VR view). The VR display (VR view) is a display form that is mapped to a virtual sphere, and is a display form that is modified from the flat display. Therefore, the distorted portion in the flat display can be accurately confirmed with the shape in which the distortion is corrected. The invalid area 902 may be masked and displayed in black, white, pattern display, or the like. By displaying the boundary almost at the center, it is possible to confirm what the right boundary line of the VR image is. By arranging the return button 903 and the cutout button 904 on the invalid area 902, the user can confirm the area including the right effective area 901 and the right boundary line of the VR image and identify the boundary.

FIG. 9B is a diagram showing a state in which the left end side is displayed when the VR image is displayed in VR. FIG. 9B is displayed, for example, by touching (confirmation instruction) the non-cutout area 608 on the left side or the left side of the cutout area frame 606 in FIG. 6C. The left effective range 905 and the invalid range 906 are displayed in VR display. The invalid area 906 may be masked and displayed in black, white, or pattern display. By displaying the boundary almost at the center, it is possible to confirm what the left boundary line of the VR image is. As in FIG. 9A, by placing the return button 903 and the cutout button 904 on the invalid range 906, the user confirms the left effective range 905 and the area including the left boundary line of the VR image, and sets the boundary. It is possible to identify.

Although an example of touching the top of the frame of the cutout region frame 606 or the non-cutout region 608 is shown as the confirmation instruction from the user, the present invention is not limited thereto. For example, the CPU 101 may display an icon on the touch panel 106a for designating a boundary to be confirmed in the area surrounded by the cutout area frame 606. By touching the icon, the user can confirm the area including the boundary on the screen of FIG. 9A or 9B and identify the boundary. The screen of FIG. 9A or FIG. 9B is provisional information displayed for the user to confirm the boundary information and identify the boundary.

As described above, according to the above-described embodiment, when 180° cropping of the VR image is performed from the flat display, the direction of the image edge on the flat display can be set to the central region after the cropping.

Further, when the VR image is not in the cutout edit state, the user's operability can be improved by scrolling the left and right images by advancing the image.

The various controls described as being performed by the CPU 101 may be performed by one piece of hardware, or a plurality of pieces of hardware (for example, a plurality of processors or circuits) may share the processing to control the entire apparatus. You may go.

Although the present invention has been described in detail based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various embodiments within the scope not departing from the gist of the present invention are also included in the present invention. included. Furthermore, each of the above-described embodiments is merely an example of the present invention, and the embodiments may be combined as appropriate.

Further, in the above-described embodiment, the case where the present invention is applied to a smartphone has been described as an example, but the present invention is not limited to this example and can be applied to any device that can display a VR image on the display unit. Is. For example, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, printer devices including displays, digital photo frames, music players, game machines, electronic book readers, video players, and the like. Further, the present invention can be applied to a digital camera, a television device, a projection device, a tablet terminal, an AI speaker, a home electric device, an in-vehicle device, a medical device and the like.
<Other embodiments>

The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. It can also be realized by the processing. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100: Display control device 101: CPU 105: Display 106: Operation unit

Claims (18)

On the first screen, a flat display that fits the first video range of the VR content into a rectangle is performed, and on the second screen, an area cut out from the VR content is displayed on the VR content that is flatly displayed in the rectangular area. Display control means for controlling to display the indicating indicator,
Switching means for switching from the first screen to the second screen in response to a user's instruction to set the cutout range;
On the second screen, in response to the first operation, the flat-displayed VR content is scrolled in the first direction without scrolling the indicator, and the VR content is scrolled in response to the scroll. Image areas corresponding to the scroll amount in the first direction are sequentially displayed from the end of the rectangular area in the second direction opposite to the first direction toward the first direction. Circular scroll display of the same content
Control means for controlling so that the cyclic scroll display is not performed on the first screen even when the first operation is performed;
Generating means for generating an edited VR content having a second video range narrower than the first video range in the VR content based on the area indicated by the indicator on the second screen;
An electronic device comprising: The electronic device according to claim 1, wherein the control unit causes a center of a range indicated by the indicator and a center of the second video range in the VR content displayed in a flat display to match or substantially match each other. .. The electronic device according to claim 1, wherein the indicator indicates a range narrower than the rectangular area. The electronic device according to claim 1, wherein the first direction is a right direction or a left direction with respect to the VR content. The orientation of the second video range when the first video range is mapped to a virtual sphere changes according to the circular scroll display in the first direction on the second screen. The electronic device according to any one of claims 1 to 4. The electronic device according to any one of claims 1 to 5, wherein the control unit does not scroll the second screen in a third direction perpendicular to the first direction. .. The elevation angle or the depression angle of the second image range is not changed when the first image range is mapped to a virtual sphere in accordance with the scrolling of the VR content on the second screen. Item 7. The electronic device according to any one of items 1 to 6. 8. The electronic device according to claim 1, wherein the first operation is a slide operation of touching the rectangular area and moving a touch position in the first direction. The control means, when receiving the setting instruction from the user, confirms with the user whether or not to perform zenith correction,
The electronic device according to any one of claims 1 to 8, wherein: 10. The control unit receives an instruction for cutting out the VR content centering on the zenith or centering on the nadir, by an operation that does not involve a scrolling operation. The electronic device according to the item. 11. The electronic device according to claim 1, further comprising a recording unit configured to generate and record a file storing the edited VR content generated by the generation unit. The electronic device according to claim 11, wherein the recording unit generates one still image file that stores a plurality of images based on the second video range. The electronic device according to claim 12, wherein a character string ".vr" is described before the extension in the file name of the still image file. 14. The electronic device according to claim 11, wherein the recording unit generates one moving image file in which a plurality of moving images based on the second image range are arranged. The electronic device according to claim 14, wherein a character string ".vr" is described before the extension in the file name of the moving image file. On the first screen, a flat display that fits the first video range of the VR content into a rectangle is performed, and on the second screen, an area cut out from the VR content is displayed on the VR content that is flatly displayed in the rectangular area. A display control step of controlling to display the indicating indicator,
A switching step of switching from the first screen to the second screen in accordance with a cutout range setting instruction from a user;
On the second screen, in response to the first operation, the flat-displayed VR content is scrolled in the first direction without scrolling the indicator, and the VR content is scrolled in response to the scroll. Image areas corresponding to the scroll amount in the first direction are sequentially displayed from the end of the rectangular area in the second direction opposite to the first direction toward the first direction. Circular scroll display of the same content
On the first screen, a control step of controlling not to perform the cyclic scroll display even if the first operation is performed,
A generation step of generating an edited VR content having a second video range narrower than the first video range in the VR content based on the area indicated by the indicator on the second screen;
A method for controlling an electronic device, comprising: A program for causing a computer to function as each unit of the electronic device according to any one of claims 1 to 15. A computer-readable storage medium that stores a program for causing a computer to function as each unit of the electronic device according to claim 1.

Images