JP7187307B2 - Electronic device and its control method - Google Patents

Description

The present invention relates to an electronic device and its control method.

2. Description of the Related Art In recent years, imaging apparatuses capable of capturing VR (Virtual Reality) images having a wider range of viewing angles than the human eye, such as omnidirectional images and omnidirectional images, have become widespread. On the other hand, an image format specialized for forward 180° has also been announced, and the demand for clipping a VR image into a 180° image is increasing.

Japanese Patent Application Laid-Open No. 2002-200001 proposes a method of extracting a partial region of a VR image where a touch operation has been performed, performing distortion correction, and superimposing and displaying it on the screen. Japanese Patent Application Laid-Open No. 2002-200002 proposes a method of specifying the setting of an image clipping area by changing the size of the clipping frame or by changing the magnification of the image while the clipping frame is fixed.

JP 2016-123127 A JP 2014-165523 A

When a 180° clipping region is clipped from a VR image, the user can view the entire VR image from a bird's-eye view by displaying a flat display that fits the 360° effective video range in a rectangle. However, when an attempt is made to specify a 180° clipping area in the flat display state, there is a problem that it is difficult to specify the edge area on the flat display as the clipping center.

In view of the above-mentioned problems, the present invention provides an electronic device that can specify an area near the edge of the flat display screen as the center of extraction when clipping a VR image in a narrower range from a VR image on a flat display. The object is to provide a device and its control method.

In order to solve the above problems, the electronic device of the present invention includes:
On the first screen, a flat display is performed in which the first image range of the VR content is contained in a rectangle, and on the second screen, an area cut out from the VR content is displayed on the VR content that is flatly displayed in the rectangular area. display control means for controlling to display an indicator showing
switching means for switching from the first screen to the second screen in response to an instruction to set a cutout range from a user;
In the second screen, scrolling the flat-displayed VR content in a first direction without scrolling the indicator according to a first operation, and scrolling the VR content according to the scrolling. The image area corresponding to the scroll amount in the first direction is sequentially displayed in the first direction from the end of the rectangular area in the second direction opposite to the first direction. Circular scroll display of the same content,
control means for controlling not to perform the cyclic scrolling display on the first screen even if the first operation is performed;
generating means for generating edited VR content having a second video range narrower than the first video range of the VR content, based on the area indicated by the indicator on the second screen;
characterized by having

When clipping a VR image in a narrower range from a VR image on a flat display, an area near the edge of the flat display screen can be specified as the clipping center.

1 is a block diagram of a display control device; FIG. 1 is an external view of a display control device; FIG. FIG. 11 is a flow chart showing clipping processing from a VR image to a 180° image; FIG. 9 is a flowchart showing a cutout direction setting process; 10 is a flowchart showing edge region confirmation processing in VR display. It is an example of a display at the time of clipping processing from a VR image to a 180° image. It is a display example when the clipping direction is changed by right scrolling. It is a display example when the clipping direction is changed by left scrolling. It is a display example of the edge area confirmation method in the VR display. It is an example of various displays of VR images.

Preferred embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a configuration example of a display control device 100 as an example of electronic equipment. A CPU 101, a memory 102, a nonvolatile memory 103, an image processing unit 104, a display 105, an operation unit 106, a recording medium I/F 107, an external I/F 109, and a communication I/F 110 are connected to the internal bus 150. . An audio output unit 112 and a posture detection unit 113 are also connected to the internal bus 150 . Each unit connected to the internal bus 150 is capable of exchanging data with each other via the internal bus 150 .

The CPU 101 is a control unit that controls the entire display control device 100 and includes at least one processor or circuit. The memory 102 is, for example, a RAM (a volatile memory using a semiconductor element, etc.). The CPU 101 controls each part of the display control device 100 according to a program stored in the nonvolatile memory 103, for example, using the memory 102 as a work memory. The nonvolatile memory 103 stores image data, audio data, other data, various programs for the CPU 101 to operate, and the like. The nonvolatile memory 103 is composed of, for example, flash memory or ROM. The CPU 101 executes the processes of the display control means, control means, generation means, and boundary display means of the display control device 100 .

Under the control of the CPU 101 , the image processing unit 104 processes images stored in the nonvolatile memory 103 and the recording medium 108 , video signals obtained via the external I/F 109 , and images obtained via the communication I/F 110 . etc. are subjected to various image processing. The image processing performed by the image processing unit 104 includes A/D conversion processing, D/A conversion processing, image data encoding processing, compression processing, decoding processing, enlargement/reduction processing (resize), noise reduction processing, color conversion, and so on. processing, etc. It also performs various image processing such as panorama development, mapping processing, and conversion of an omnidirectional image or a VR image that is a wide-range image having a wide-range image, even if it is not omnidirectional. The image processing unit 104 may be composed of a dedicated circuit block for performing specific image processing. Further, depending on the type of image processing, the CPU 101 can perform image processing according to a program without using the image processing unit 104 .

The display 105 displays an image, a GUI screen that constitutes a GUI (Graphical User Interface), and the like, under the control of the CPU 101 . The CPU 101 controls each unit of the display control device 100 to generate a display control signal according to a program, generate a video signal for display on the display 105 , and output the video signal to the display 105 . The display 105 displays an image based on the generated/output image signal. Note that the display control device itself includes an interface for outputting a video signal for display on the display 105, and the display 105 may be configured with an external monitor (television, HMD, etc.).

The operation unit 106 is an input device for accepting user operations, including a character information input device such as a keyboard, a pointing device such as a mouse and a touch panel, buttons, dials, joysticks, touch sensors, and touch pads. It should be noted that the touch panel 106a is an input device that is superimposed on the display 105 and configured in a two-dimensional manner so as to output coordinate information corresponding to the touched position.

A recording medium 108 such as a memory card, CD, or DVD can be detachably attached to the recording medium I/F 107 . The recording medium I/F 107 reads data from the attached recording medium 108 and writes data to the recording medium 108 under the control of the CPU 101 . The external I/F 109 is an interface for connecting with an external device via a wired cable or wirelessly and inputting/outputting a video signal and an audio signal. The communication I/F 110 is an interface for communicating with an external device, the Internet 111, etc., and transmitting/receiving various data such as files and commands.

The audio output unit 112 outputs audio of video and music data, operation sounds, ringtones, various notification sounds, and the like. The audio output unit 112 includes an audio output terminal 112a (described later) for connecting an earphone or the like and a speaker 112b (described later). The audio output unit 112 outputs audio data to an external speaker through wireless communication or the like. may

The posture detection unit 113 detects the posture (inclination) of the display control device 100 with respect to the direction of gravity, and the posture of the display control device 100 with respect to each axis of the yaw direction, the pitch direction, and the roll direction. Based on the orientation detected by the orientation detection unit 113, whether the display control device 100 is held horizontally, held vertically, directed upward, downward, or oblique. etc. can be determined. In addition, it is possible to determine whether or not the display control device 100 is tilted in the rotation directions such as the yaw direction, the pitch direction, and the roll direction, and whether the display control device 100 is rotated in the rotation direction. One sensor or a combination of a plurality of sensors such as an acceleration sensor, a gyro sensor, a geomagnetic sensor, an orientation sensor, an altitude sensor, etc. can be used as the orientation detection unit 113 .

Note that the operation unit 106 includes a touch panel 106a. The CPU 101 can detect the following operations or states on the touch panel 106a.
- A finger or pen that has not touched the touch panel 106a newly touches the touch panel 106a, that is, the start of touch (hereinafter referred to as Touch-Down)
A state in which a finger or pen touches the touch panel 106a (hereinafter referred to as Touch-On)
・The finger or pen is moving while touching the touch panel 106a (hereinafter referred to as Touch-Move)
- The finger or pen touching the touch panel 106a is separated from the touch panel 106a, that is, the end of the touch (hereinafter referred to as Touch-Up)
A state in which nothing is touched on the touch panel 106a (hereinafter referred to as Touch-Off)

When touchdown is detected, touchon is also detected at the same time. After touchdown, touchon continues to be detected unless touchup is detected. Touch-on is detected at the same time when touch-move is detected. Even if touch-on is detected, touch-move is not detected if the touch position does not move. Touch-off is detected when it is detected that all the fingers and pens that were in touch have touched up.

The CPU 101 is notified of these operations/states and the coordinates of the position where the finger or pen touches the touch panel 106a through the internal bus. ) has been performed. As for the touch move, the movement direction of the finger or pen moving on the touch panel 106a can also be determined for each vertical component/horizontal component on the touch panel 106a based on the change in the position coordinates. If it is detected that the touch-move has been performed for a predetermined distance or more, it is determined that the slide operation has been performed.

An operation of touching the touch panel 106a with a finger and quickly moving it by a certain distance and then releasing it is called a flick. A flick is, in other words, an operation of quickly tracing the touch panel 106a as if flicking it with a finger. It can be determined that a flick has been performed when a touch-move of a predetermined distance or more at a predetermined speed or more is detected, and a touch-up is detected as it is (it can be determined that a flick has occurred following a slide operation).

Further, a touch operation of simultaneously touching a plurality of points (for example, two points) to bring the touch positions closer to each other is called pinch-in, and a touch operation of moving the touch positions away from each other is called pinch-out. Pinch-out and pinch-in are collectively called pinch operation (or simply pinch). The touch panel 106a may use any type of touch panel among various types of touch panels such as a resistive film type, an electrostatic capacity type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. good. There is a method of detecting that there is a touch when there is contact with the touch panel, and a method of detecting that there is a touch when there is an approach of a finger or pen to the touch panel.

FIG. 2 is an external view of a display control device 100, which is an example of an electronic device. The display control device 100 is, for example, a display device such as a smartphone. A display 105 is a display unit that displays images and various types of information. The display 105 is configured integrally with the touch panel 106a so that a touch operation on the display surface of the display 105 can be detected. The display control device 100 is capable of VR-displaying a VR image (VR content) on the display 105 . For example, a VR image captured by a digital camera (omnidirectional camera; omnidirectional camera) is acquired via the communication I/F 110 (receives the VR image transferred by wireless communication) and is recorded in the recording medium 108. be able to. The VR image recorded on the recording medium 108 in this manner can be VR-displayed (displayed in a VR view) on the display 105 . Also, a recording medium in which a VR image captured by a digital camera is recorded is directly connected to the recording medium I/F 107, and the VR image is read out from the recording medium and played back to display the VR on the display 105 (display in VR view). ) is also possible. It is also possible to obtain VR images (shared VR images) recorded in a server device or the like connected to a network via SNS and display them in VR. In this embodiment, the operation unit 106 includes a touch panel 106a and operation units 106b, 106c, 106d, and 106e. The operation unit 106b is a power button that receives an operation for switching the power of the display control device 100 between on and off. An operation unit 106 c and an operation unit 106 d are volume buttons for increasing or decreasing the volume of audio output from the audio output unit 112 . The operation unit 106e is the display 1
05 to display the home screen. The audio output terminal 112a is an earphone jack, and is a terminal for outputting an audio signal to an earphone, an external speaker, or the like. The speaker 112b is a built-in speaker for outputting sound.

The display control device 100 is capable of VR-displaying a VR image (VR content) on the display 105 . A VR image is an image that can be displayed in VR (displayed in the display mode “VR view”). VR images include an omnidirectional image (omnidirectional image) captured by an omnidirectional camera (omnidirectional camera), or a panoramic image with a video range (effective video range) wider than the display range that can be displayed at once on the display unit. etc. shall be included. VR images include not only still images but also moving images and live-view images (images obtained from cameras in almost real time). The VR image has a maximum visual range of 360 degrees in the vertical direction (vertical angle, angle from the zenith, elevation angle, depression angle, altitude angle, pitch angle) and 360 degrees in the horizontal direction (horizontal angle, azimuth angle, yaw angle). (Effective video range). In addition, even if the VR image is less than 360 degrees vertically and 360 degrees horizontally, it can be displayed at a wide angle of view (viewing range) that is wider than the angle of view that can be taken with a normal camera, or on the display unit at once. An image having a video range (effective video range) wider than the display range is also included. For example, an image captured by an omnidirectional camera capable of capturing a subject with a field of view (angle of view) of 360 degrees in the horizontal direction (horizontal angle, azimuth angle) and a vertical angle of 210 degrees centered on the zenith is It is a kind of VR image. Also, for example, an image captured by a camera capable of capturing a subject with a field of view (angle of view) of 180 degrees in the horizontal direction (horizontal angle, azimuth angle) and 180 degrees in the vertical angle centered on the horizontal direction is a VR image. It is one kind. That is, an image that has a video range of 160 degrees (±80 degrees) or more in the vertical direction and the horizontal direction and has a video range that is wider than the range that can be visually recognized by humans at once is a VR image. is a kind of When this VR image is displayed in VR (display mode: "VR view"), by changing the posture of the display device (display device that displays the VR image) in the left and right direction, can view seamless omnidirectional images. In the vertical direction (vertical rotation direction), seamless omnidirectional images can be viewed within a range of ±105 degrees from directly above (zenith), but no images exist within a range exceeding 105 degrees from directly above. It becomes a blank area. A VR image can also be said to be "an image whose video range is at least part of a virtual space (VR space)".

VR display (VR view) is a display method (display mode) that allows the display range to be changed by displaying an image within a viewing range corresponding to the posture of the display device. When the user wears a head-mounted display (HMD) as a display device to view the video, the video is displayed within the visual range corresponding to the orientation of the user's face. For example, in the VR image, at a certain point in time, the viewing angle (angle of view) is centered at 0 degrees in the horizontal direction (a specific direction, such as north) and 90 degrees in the vertical direction (90 degrees from the zenith, that is, horizontal). shall be displayed. From this state, if the posture of the display device is reversed (for example, if the display surface is changed from facing south to facing north), the same VR image can be displayed by 180 degrees in the left and right direction (opposite orientation, for example, south), and up and down. The display range is changed to an image with a viewing angle centered at 90 degrees (horizontal) in the direction. In the case where the user is viewing the HMD, if the user turns his face from north to south (that is, turns his back), the image displayed on the HMD will also change from the north image to the south image. be. With such VR display, it is possible to provide the user with a sense (immersive feeling) as if he or she were visually present in the VR image (inside the VR space). A smartphone attached to VR goggles (head mount adapter) can be said to be a kind of HMD.

Note that the display method of the VR image is not limited to the above. The display range may be moved (scrolled) according to the user's operation on the touch panel, direction buttons, or the like, instead of changing the posture. Even when displaying in VR display (display mode "VR view"), in addition to changing the display range due to changes in posture, the display range changes according to touch-move to the touch panel, drag operation to the mouse, pressing of the direction button, etc. may be changed.

In this embodiment, a VR image having a visual range (effective video range) of 360 degrees vertically and horizontally at maximum is converted to a VR image having a visual range (effective video range) of 180 degrees vertically and horizontally. The extraction operation and processing will be described. In the following, a VR image having a video range (effective video range) corresponding to a field of view of 360 degrees vertically and horizontally at maximum is referred to as a 360-degree VR image. Also, a VR image having a video range (effective video range) corresponding to a field of view of 180 degrees vertically and horizontally is referred to as a 180-degree VR image. Conceptually, the process of cutting out a 180-degree VR image from a 360-degree VR image is a process of cutting out a hemisphere from a virtual sphere on which a 360-degree video is entirely mapped. The clipping described in this embodiment is not a process of clipping a normal rectangular image (planar image), but a process of clipping an image that can be viewed as a VR image even after clipping (mapped onto a sphere and viewable in a VR view). is. Since the clipped image has an effective video range of 180 degrees vertically and horizontally, when mapped on a sphere, a hemispherical effective video (photographed image, etc.) is mapped. The rest of the hemisphere becomes an invalid image range, and images that are filled with a single color or a predetermined pattern or that are complemented in some way are mapped. When viewing such a cut-out VR image in a VR view, the user can visually recognize the image within a range of 180 degrees in width in front (a range of 90 degrees to the left, right, top and bottom from the center). The reasons for performing such clipping processing are as follows.

First, the amount of image data can be reduced. The clipped 180-degree VR image has a smaller data amount than the 360-degree VR image. Therefore, it is possible to suppress the capacity pressure of the recording medium at the time of saving. In addition, it is possible to reduce the amount of communication data to be transmitted and received, and to reduce the processing load to display, thereby improving processing speed and response speed, and reducing power consumption.

Second, unnecessary subjects can be deleted. For example, in most cases of capturing a VR image having an effective video range of 360 degrees, it is inevitable that the photographer himself will appear in the picture. However, if what the photographer wants to photograph is not the photographer himself but a landscape or the like, the photographer himself is an unnecessary subject and is unintended. If an unintended image is captured, it hinders the viewer from concentrating on the image such as the landscape that the photographer considered to be the main subject. In addition, information that should be kept confidential, such as the face of a passerby or the license plate of a passing vehicle, is often captured, which is undesirable from the viewpoint of privacy and security. These problems can be avoided by clipping only the range intended by the photographer and discarding other unnecessary ranges of the image.

Thirdly, it is possible to reduce the physical burden on the user watching in the VR view. When viewing a 360-degree VR image in a VR view, the image exists even behind the viewing user. Viewers can see a 180-degree image in front of them by simply turning their head, but if they want to see behind them, they have to twist their upper body or change the direction in which they stand. However, the physical burden is rather high. Such a physical movement to look behind is not suitable for viewing from a seat, unless it is a swivel chair. On the other hand, with a 180-degree VR image, the viewer can see the entire scene simply by changing the direction of his/her head, so the physical burden of viewing the image is relatively small. If the viewer recognizes that the VR image is 180 degrees through a guide display or a display that indicates that the range beyond 180 degrees is an invalid area, the viewer may try to look behind. do not have. Therefore, it is possible to prevent the viewer from performing physical actions such as looking behind.

Fourthly, a 360-degree VR image can be displayed in correspondence with a recording format for a 180-degree VR image. If the recording format for 360-degree VR images and the recording format for 180-degree VR images are different, a playback device (playback application software) that only supports viewing of 180-degree VR images will not be able to record 360-degree VR images. Images cannot be viewed. However, if a 180-degree VR image is generated by clipping from a 360-degree VR image, it becomes possible to view even a playback device that can only view 180-degree VR images. Also, even if both 180-degree VR image viewing and 360-degree VR image viewing are supported, it is necessary to switch between the 180-degree VR image viewing mode and the 360-degree VR image viewing mode. In some cases, the switching operation is troublesome. However, if a 180-degree VR image is generated by extracting a 360-degree VR image, a plurality of VR images can be displayed by switching one after another without switching the display mode for the 180-degree VR image. In addition, two 180-degree VR images for the right eye and left eye, captured by two camera units installed at a distance equal to the parallax, facing the subject in the same direction, are displayed so that they can be viewed stereoscopically. A display mode (dino VR view) is assumed. If a 180-degree VR image for the right eye and a 180-degree VR image for the left eye are cut out from a 360-degree VR image and recorded, it is possible to view even such a twin-lens VR view.

In the present embodiment, an example in which a 180-degree VR image is generated by cutting out a 360-degree VR image will be described. The processing can also be applied to VR images with other viewing angles. That is, the VR image before clipping is not limited to a 360-degree VR image, and the VR image after clipping is not limited to a 180-degree VR image.

In each process to be described later, an example will be described in which various touch buttons are displayed, and a touch operation to the various touch buttons is accepted as a user operation to proceed with the process. A touch operation for receiving instructions for various touch buttons may specifically be a touch-up from a touch-responsive area corresponding to a touch button, or a touch-down from a touch-responsive area corresponding to a touch button. Further, the present invention is not limited to this, and each instruction explained as being received by operating a touch button to be described later may be received by another user's operation. For example, it may be an operation on each physical button, an operation of selecting a display item using a direction key and pressing an enter button, an operation of selecting a display item using a mouse, a voice command, or the like.

The operation of the embodiment of the present invention will now be described with reference to FIGS.
FIG. 3 is a flowchart showing an example of clipping processing from a 360-degree VR image to a 180-degree VR image by the display control device 100 . Each process in this flow chart is implemented by the CPU 101 developing a program stored in the nonvolatile memory 103 in the memory 102 and executing the program.

When the power of the display control device 100 is turned on and a VR image (VR content) is selected from among images recorded on the recording medium 108 and images obtained from communication destinations, the processing in FIG. 3 is started.

In S<b>301 , the CPU 101 reads a VR image to be displayed from the recording medium 108 or the communication destination via the communication I/F 110 . The CPU 101 acquires information indicating a video range (effective video range) attached as attribute information of the VR image, and displays the VR image in a flat display that encloses the effective video range in a rectangle. The effective video range of the VR image displayed flat on the display 105 in S301 is an example of the first effective video range. In the VR view, the image is displayed by mapping it on a virtual sphere, but in the flat display, the entire image is displayed in a rectangle using an equirectangular projection or the like. Therefore, the subject is more distorted than when displayed in the VR view in a portion near the edge of the rectangle.

The information indicating the effective image range is information indicating which angular range of effective image the VR image has in the vertical direction and the horizontal direction. The information indicating the effective video range may be any information that can specify the effective video range of the VR image, and is angle information represented by angle of view, viewing angle, azimuth angle, elevation angle, depression angle, altitude angle, steradian, and the like. Alternatively, it may be positional information such as the number of pixels on the top, bottom, left, and right, or coordinates.

The information indicating the effective image range may be model information of the camera that captured the VR image (specifying the model makes it possible to specify the shootable range), zoom information at the time of shooting, or the like. When the information indicating the effective video range is acquired, the CPU 101 also specifies (calculates) the invalid video range (non-video range) based on the difference between 360 degrees vertically and horizontally. Conversely, information indicating the invalid video range may be obtained from the attribute information of the VR image, and the effective video range may be calculated from the information. It may be acquired from the attribute information of the VR image.

FIG. 6A shows a display example of flat display (display example on the first screen) in S301. Since it is an image using equirectangular projection, it is a distorted image unlike the real thing. The user can switch to a clipping mode for the VR image 601 by operating a button to select the clipping button 602 . A cutout button 602 is an operation button for accepting a cutout range setting instruction from the user. Also, an instruction icon for transitioning to the VR view may be displayed. According to the operation on this instruction icon, the same image can be transitioned from flat display to VR view. Note that if a touch move is performed on the display area of the VR image 601 during flat display in S301, image switching to another image (next image in a predetermined order such as file name order, or switch to the display of the previous image). The flat display in S301 is a screen for the user to identify an image to be displayed or edited. When image switching is performed by touch-move, the VR image 601 is slid (scrolled) in the direction of the touch-move following the touch-move. , or the image after switching is displayed. In other words, unlike the scrolling in the clipping area setting process of FIG. 4, no cyclical scrolling is performed in which the end portion cannot be identified.

In S302, the CPU 101 determines whether or not there has been a touch operation on the crop button 602, that is, whether or not an instruction to set a crop range has been given to the touch panel 106a. If there is an instruction to set the extraction range, the process proceeds to S303, and if there is no instruction to set the extraction range, the process is terminated. When proceeding to S303, the mode is changed to a mode for setting a clipping range for clipping the VR image at 180°.

In S303, the CPU 101 displays a selection screen for selecting whether or not to perform zenith correction, and receives parameters related to zenith correction input to the touch panel 106a. I do. FIG. 6B shows a display example of the selection screen displayed in S303 for selecting whether or not to perform the zenith correction. A zenith correction selection dialog 603 shown in FIG. The zenith correction selection dialog 603 has buttons 604 and 605 . When the user operates a button 604, correction of the zenith axis is executed before the VR image clipping process. Also, when the button 605 is selected, correction of the zenith axis is not executed before the VR image clipping processing.

In S<b>304 , the CPU 101 displays a cutout UI on the display 105 . That is, the display screen described in S301 is switched to the UI screen for clipping in accordance with the user's instruction to set the clipping range (switching control). FIG. 6C shows a display example of the cutout UI (display example of the second screen) displayed in S304. A clipping area frame 606 is an indicator that indicates the 180° area to be clipped from the VR image. A cutout area frame 606 is displayed on the VR image (on the VR content) displayed flat in a rectangular area. Note that the clipping area frame 606 does not indicate an accurate clipping range, but indicates a rough range. A non-cutout region 608 indicates a region that is not included in the 180° region to be cut out.

By the user's button operation of selecting the crop determination (completion) button 611, the crop area 607 surrounded by the crop area frame 606 is set as the crop area. By button operation to select the zenith clipping button 612, an area of 180° around the zenith direction (upward direction of the VR content) is set as a clipping area. By button operation to select the nadir clipping button 613, an area of 180° around the nadir direction (downward direction of the VR content) is set as a clipping area. The CPU 101 can generate edited VR content having an effective video range narrower than the effective video range before clipping, based on the set clipping region. In this way, the CPU 101 does not scroll the VR content in the vertical direction, and cuts out the VR content in the vertical direction by the user's button operation (an operation that does not involve a scrolling operation).

In S<b>305 , the CPU 101 determines whether a touchdown has been detected in the center area inside the cutout area 607 in the display area of the VR image displayed flat on the display 105 . The central area inside the cutout area 607 is an area that is a predetermined width or more inside the left and right portions of the cutout area frame 606 that is the left and right boundaries of the cutout area 607 . If touchdown to the central area is detected, the process proceeds to S306, and if touchdown to the central area is not detected, the process proceeds to S307.

In S306, the CPU 101 executes a cutout direction setting process. The clipping direction (the range of the clipped image) is set based on the area surrounded by the clipping area frame 606 shown in FIG. 6(c). The effective image range of the clipped area is an example of the second effective image range. The CPU 101 causes at least the center of the region surrounded by the clipping region frame 606 shown in FIG. to control. However, the cutout area frame 606 superimposed on the flat display does not accurately represent the cutout boundary of the hemisphere. effective video range) does not completely match. For example, the range of the area surrounded by the clipping area frame 606 may be larger than the effective image range (180°) that is actually clipped. The clipping direction setting process will be described later with reference to FIG.

In S307, the CPU 101 executes VR edge area confirmation processing. The VR edge region confirmation processing will be described later using FIG.

In S<b>308 , the CPU 101 determines whether or not there has been a touch operation on the cutout decision button 611 , that is, whether or not there has been a cutout instruction. If there is a clipping instruction, the process proceeds to step S309, and if there is no clipping instruction, the process ends.

In S<b>309 , the CPU 101 cuts out an image within a range of 180° in the cutout direction set in S<b>306 , and saves the cut out image in the VR 180° format in the recording medium 108 . That is, the clipped VR image is recorded on the recording medium 108 .

The clipped VR image (image file that can be displayed in the VR view) recorded in S309 will be described. If the clipped VR image is a still image, the image within the clipped range is deformed into a rectangle using the equirectangular projection method, and multiple images are stored in one file in a multi-picture format. to record. When the 360-degree VR image (original image) before cropping is displayed as a normal plane image instead of a VR view, it is an image drawn in an equirectangular projection within a rectangle as shown in FIG. 10(a). Become. In S301, it is displayed like this. When a 180-degree range is cut out from this original image by the processing described in FIG. An image rendered in the projection is recorded. At this time, the same image obtained by copying the image within the clipping range is recorded in the same file as the image for the right eye and the image for the left eye, respectively, even if there is no parallax. Two 180-degree ranges are extracted from one 360-degree VR image before extraction so as to have a pseudo parallax (that is, the ranges of the image for the left eye and the image for the right eye are slightly different). may The file name of the extracted still image VR image is, for example, "123456.vr.jpg", and a three-letter string ".vr" is written before the extension ".jpg". When an image saved as a still image file in this way is reproduced and displayed in a VR view, the image in FIG. 10B is mapped on a hemisphere and displayed. FIG. 10D shows an example of reproducing and displaying a clipped still image VR image file in a twin-lens VR view (an example of display on the display 105 when the VR goggles are not worn).

If the clipped VR image is a video, the video (video) in which the images within the clipped range are mapped in a circle or ellipse instead of the equirectangular projection is arranged side by side in the video of one video. generate and record a video file At this time, the same image obtained by copying the image within the clipping range is recorded side by side as an image for the right eye and an image for the left eye, respectively, even if there is no parallax. When such a moving image is displayed not as a VR view but as a normal planar image, it is displayed as shown in FIG. 10(c). Two 180-degree ranges are extracted from one 360-degree VR image before extraction so as to have a pseudo parallax (that is, the ranges of the image for the left eye and the image for the right eye are slightly different). may The file name of the VR image of the clipped moving image is, for example, "123456.vr.mp4", and the three-character string ".vr" is written before the extension ".mp4". FIG. 10(d) shows a display example of a frame (display example on the display 105 when the VR goggles are not worn) when a VR image file of a cut-out moving image is reproduced and displayed in a twin-lens VR view. Similar to the example shown.

FIG. 4 is a flow chart showing an example of the extraction direction setting process of S306 in FIG. The extraction direction setting process is realized by the CPU 101 developing a program stored in the nonvolatile memory 103 in the memory 102 and executing the program.

In S401, the CPU 101 determines whether or not an input for right scrolling has been performed on the touch panel 106a. The right scroll input is an operation for scrolling the image to the right, and corresponds to an instruction to scroll to the right. The right scroll input is, for example, a touch move to move to the right or an operation to slide a scroll bar (not shown) to the left. If the right scroll input has been performed, the process proceeds to S402, and if the right scroll input has not been performed, the process proceeds to S404.

In S402, the CPU 101 scrolls (slides) the image in the right direction upon receiving an input to scroll right from the user. The CPU 101 sequentially displays an image area corresponding to the scroll amount of the display 105 rightward from the left end of the display 105 toward the right in accordance with the scrolling. Note that the position of the clipping area frame 606 on the screen is fixed, and scrolling does not occur even if there is a scroll input.

In S403, the CPU 101 moves the area on the left side excluding the image area on the right side by the scroll amount to the right by the scroll amount and displays it. That is, the CPU 101 scrolls the VR content displayed flat in the rectangular area of the display 105 in the right direction. Further, in accordance with the scrolling, the CPU 101 sequentially displays the image areas of the VR content corresponding to the amount of rightward scrolling from the left end of the rectangular area in the direction opposite to the rightward direction toward the rightward. Let

7A to 7E show examples of display by scrolling performed in S402 and S403. A right scroll 701 in FIG. 7(b) represents a scroll input in the right direction with respect to FIG. 7(a). When the right scroll 701 is input, the processes of S402 and S403 in FIG. 4 are executed. For example, in S401, it is assumed that the user scrolls to the right end of the display 105 by the scroll amount D1. In S402, the CPU 101 sequentially displays the scroll amount (D1) image area 7011 surrounded by the dotted line from the left end of the display 105 toward the right direction. Next, in S403, the CPU 101 moves the left area 7012 enclosed by the dashed line, excluding the image area 7011 by the scroll amount (D1), to the right by the scroll amount (D1) and displays it. When these processes are executed, the display 105 becomes a display as shown in FIG. 7(c).

A right scroll 703 in FIG. 7(d) represents a scroll input in the right direction with respect to FIG. 7(c). When the right scroll 703 is input, the processing of S402 and S403 in FIG. 4 is executed in the same manner as when the right scroll 701 is input, resulting in the display of FIG. 7(e).

In this manner, in the scrolling performed in S402 and S403, if the image is scrolled to the right, the portion that has been scrolled out of the display area on the right side and disappeared will enter the display area one after another from the left end to the right. is displayed. And if you repeat the right scroll input, you can scroll infinitely without bumping. That is, it is a cyclic scrolling display of the same content that does not make the user conscious of the boundary such as the left and right ends of the VR image 601 . By doing so, it is possible to position the portion positioned at the end of the display area in the display example of FIG. Then, it is possible to instruct that a continuous region of 180 degrees around that position (a range of 90 degrees around that position) be used as a VR image after clipping. In the cyclical scrolling display, it is sufficient that any orientation of the VR image can be designated as the center, so it is not necessary to be able to circulate infinitely, and it is sufficient to be able to circulate at least once.

In S404, the CPU 101 determines whether or not an input for scrolling to the left in the opposite direction to the right direction has been performed on the touch panel 106a. The left scroll input is an operation for scrolling the image leftward, and corresponds to a leftward scroll instruction. The left scroll input is, for example, a touch move to move to the left or an operation to slide a scroll bar (not shown) to the right. If the left scroll input is performed, the process proceeds to S405, and if the right scroll input is not performed, the process proceeds to S407.

In S405, the CPU 101 scrolls (slides) the image in the left direction upon receiving an input for left scrolling from the user. The CPU 101 sequentially displays an image area corresponding to the amount of leftward scrolling of the display 105 from the right end of the display 105 toward the left in accordance with the scrolling. Note that the position of the clipping area frame 606 on the screen is fixed, and scrolling does not occur even if there is a scroll input.

In S406, the CPU 101 moves the area on the right side excluding the image area on the left side by the scroll amount to the left by the scroll amount and displays it. That is, the CPU 101 scrolls the VR content displayed flat in the rectangular area of the display 105 in the left direction. Further, in accordance with the scrolling, the CPU 101 sequentially displays the image areas corresponding to the leftward scrolling amount of the VR content from the right end of the rectangular area in the direction opposite to the leftward direction toward the right. Let

FIGS. 8A to 8E show display examples by scrolling performed in S402 and S403. A left scroll 801 in FIG. 8(b) represents a scroll input in the left direction with respect to FIG. 8(a). When left scroll 801 is input, the processing of S405 and S406 in FIG. 4 is executed. For example, in S404, it is assumed that the user scrolls to the left end side of the display 105 by the scroll amount D2, contrary to FIG. 7B. In S405, the CPU 101 sequentially displays the image area 8011 of the scroll amount (D2) surrounded by the dotted line from the right end of the display 105 toward the left. Next, in S406, the CPU 101 moves the left area 8012 surrounded by the dashed line, excluding the image area 8011 by the scroll amount (D2), to the left by the scroll amount (D2) and displays it. When these processes are executed, the display 105 becomes a display as shown in FIG. 8(c).

A left scroll 803 in FIG. 8(d) represents a scroll input in the left direction with respect to FIG. 8(c). When the left scroll 803 is input, the processing of S405 and S406 in FIG. 4 is executed as in the case of inputting the left scroll 801, resulting in the display of FIG.

In this way, in the scrolling performed in S404 and S405, if the image is scrolled to the left, the portion that has been scrolled out of the display area on the left side and disappeared will enter one after another from the right end of the display area to the left. is displayed. By repeatedly inputting the left scroll, it is possible to scroll infinitely without bumping into each other. That is, it is a cyclic scrolling display of the same content that does not make the user conscious of the boundary such as the left and right ends of the VR image 601 . By doing so, it is possible to position the portion positioned at the end of the display area in the display example of FIG. Then, it is possible to instruct that a continuous region of 180 degrees around that position (a range of 90 degrees around that position) be used as a VR image after clipping.

In S407, the CPU 101 determines whether or not there has been a touch operation on the reset button 610, that is, whether or not an operation for resetting the cropping direction has been received. If the reset instruction has been issued, the process proceeds to S408, and if the reset instruction has not been issued, the process proceeds to S409. The reset orientation position is the setting of the orientation set during the process of S304 in FIG. In S408, the CPU 101 sets the cutout direction to the initial position.

In S<b>409 , the CPU 101 determines whether or not there is a touch operation on the cutout determination button 611 , that is, whether or not an operation to set the cutout direction has been received. If an instruction to determine the extraction direction has been issued, the process ends, and if no instruction to determine the extraction direction has been issued, the process advances to step S401. If S409 determines Yes, then S308 also determines Yes. That is, in the present embodiment, the instruction to determine the cutout direction and the cutout instruction are the same instruction. However, the determination instruction of the extraction direction and the extraction instruction may be performed by separate operations. For example, a preview display showing the range of the VR image after extraction is performed in response to an instruction to determine the extraction direction, and then an image file of the extracted VR image is generated in response to the extraction instruction. You can do it.

By scrolling in the horizontal direction described in S401 to S406, it is possible to specify the orientation of the range of the VR image after clipping out of the VR image before clipping. The elevation/depression angle of the cropped VR image is an elevation/depression angle of 180 from the zenith to the nadir centered on the horizontal direction (the direction of 90 degrees from the zenith. If the zenith has been corrected, the direction of 90 degrees from the zenith after correction). Fixed to a range of degrees. By doing so, it is possible to prevent the complexity of specifying the extraction range. In addition, the VR image after clipping can be 180 degrees centered on the front (horizontal direction) as seen from the viewing user, and the rear range beyond the zenith and the rear range beyond the nadir can be excluded. This makes it possible to prevent viewing in an unreasonable posture such as leaning back and looking behind when viewing in a VR view.

Note that when the crop zenith button 612 is touched, the cropping range is centered on the zenith (corrected zenith if corrected) regardless of the range indicated by the cropping area frame 606 (orientation specified by the user). , the range is 90 degrees in all directions. This is the upper hemispheric range when the phantom sphere is equally divided vertically. Also, when the crop nadir button 613 is touched, the cropping range is set to the nadir (if the zenith is corrected, the corrected nadir) regardless of the range indicated by the cropping area frame 606 (orientation specified by the user). ) is the center, and the range is 90 degrees in all directions. This is the lower hemispheric range when the phantom sphere is equally divided vertically. When the zenith clipping button 612 or the nadir clipping button 613 is touched, it is assumed that a clipping instruction has also been given, and processing is performed up to file generation of the clipped VR image in S309 of FIG. By doing so, it is possible to prevent unnatural clipping such as generating a hemisphere obtained by obliquely cutting the phantom sphere before clipping. That is, it is possible to easily generate a cropped VR image that overlooks the entire sky above the horizon, a cropped VR image that overlooks the entire room as seen from the ceiling, and the entire dish on the table as seen from above the table. .

FIG. 5 is a flow chart showing an example of the VR edge region confirmation processing of S307 in FIG. The VR edge area confirmation process is implemented by the CPU 101 developing a program stored in the nonvolatile memory 103 into the memory 102 and executing the program. The VR edge area confirmation process is a process that allows the user to check the edge area of the clipped VR image by displaying the boundary of the clipped area and the area including the boundary in VR.

In S501, the CPU 101 determines whether or not the right and left end regions of the cutout region 607 are touched, not the above-described center region, in the display region of the displayed VR image, as an instruction to confirm the ends of the cutout range. do. The left and right end regions are regions (left end regions) within a predetermined width from the left side including the left side of the cutout region frame 606 that is the left and right boundary of the cutout region 607, and the right side of the cutout region frame 606 → predetermined width from the side. within (rightmost region). If the left and right end regions have been touched, the process proceeds to S502, and if the end regions have not been touched, the processing ends. The confirmation instruction for the edge of the clipping range is not limited to this. For example, an icon may be displayed for instructing confirmation of the end of the extraction range, and touching the icon may be used as an instruction to confirm the end of the extraction range. Further, the confirmation of the edge of the cutout range may be indicated by touching the left side of the left side of the cutout area frame 606 or the right side of the right side of the cutout area frame 606 in the display area of the displayed VR image.

In S502, the CPU 101 reads the VR image acquired in S301. Also, information indicating a video range (effective video range) attached as attribute information of the VR image is acquired. The information indicating the effective image range is information indicating which angular range of effective image the VR image has in the vertical direction and the horizontal direction. The information indicating the effective video range may be any information that can specify the effective video range of the VR image, and may be positional information such as angle of view, viewing angle, azimuth angle, elevation angle, number of left and right pixels, and coordinates. The information indicating the effective image range may be model information of the camera that captured the VR image (specifying the model makes it possible to specify the shootable range), zoom information at the time of shooting, or the like.

When the information indicating the effective video range is acquired, the CPU 101 also specifies (calculates) the invalid video range (non-video range) based on the difference between 360 degrees vertically and horizontally. Conversely, information indicating the invalid video range may be obtained from the attribute information of the VR image, and the effective video range may be calculated from the information. It may be acquired from the attribute information of the VR image.

In S503, the CPU 101 determines whether or not the aforementioned right end area has been touched. If the right end area is touched, the process proceeds to S504; if the right end area is not touched, S5
Go to 05.

In S504, the CPU 101 performs display processing for the right end area of the VR image acquired in S502, based on the display range within the cutout area frame 606 of the VR image. The original data (original image) of the VR image is, for example, a distorted image using equirectangular projection, and is an image of a format in which the position of each pixel can be associated with the coordinates of the surface of a sphere. The original image of this VR image is mapped onto a sphere, and a part of it is cut out and displayed. That is, the image displayed in S504 is an image obtained by clipping and enlarging a part of the VR image, and is an image from which the distortion of the original image has been removed (or reduced). In this case, the CPU 101 displays the VR image to be displayed in a range of 90° left and right (180° in total) around the center line of the area surrounded by the clipping area frame 606, and an elevation from the zenith to the nadir. The effective range is the range of depression angles. The CPU 101 sets other ranges as outside the valid range (invalid range, exclusion range outside the extraction range). The CPU 101 displays the right end area centering on the boundary line between the valid range and the invalid range, so that the state of the edge on the boundary line between the valid range and the invalid range on the right side can be confirmed.

In S505, the CPU 101 performs display processing of the left end area of the VR image acquired in S502, based on the display range within the cutout area frame 606 of the VR image. The display method is the same as in S504. Here, by displaying the left end area centering on the boundary line between the valid range and the invalid range, it is possible to check the state of the edge on the border line between the valid range and the invalid range on the left side.

In S506, the CPU 101 determines whether a touch move has been detected based on information notified from the touch panel 106a. If the touch-move is detected, the process proceeds to S507, and if the touch-move is not detected, the process proceeds to S508.

In S507, the CPU 101 changes the display range of the VR image according to the direction of the slide operation by touch move (direction of touch move). For example, when the touch-move direction is determined to be leftward, the display range of the VR image is shifted (slid) to the left by the amount of the touch-move. can be operated. At this time, the display position on the display 105 of the area outside the cutout range is fixed. Therefore, by touch-move, the relative relationship between the area outside the cutout range and the displayed range inside the cutout range is shifted, and the cutout range (cutout direction) for the VR image before the cutout is changed. In this way, while confirming the boundaries of the clipping range, it is possible to set the clipping range by finely adjusting how far to fit within the clipping range.

In S<b>508 , the CPU 101 determines whether or not there is an operation for instructing extraction on the touch panel 106 a. If there is a cutting instruction, the process proceeds to S509, and if there is no cutting instruction, the process proceeds to S510.

In S509, the CPU 101 cuts out the image within a range of 180° in the cutout direction specified in S508, and saves the image in the recording medium 108 in the VR180° format. The generated image file is the same as that described in S309.

In S510, the CPU 101 determines whether or not a return instruction has been given by a return button touch operation, based on information notified from the touch panel 106a. If the return instruction has been issued, the process proceeds to S511, and if the return instruction has not been issued, the process returns to S506.

In S511, the CPU 101 reads the VR image acquired in S502, acquires information indicating the video range (effective video range) attached as attribute information of the VR image, and displays the VR image in a flat display that fits the effective video range in a rectangle. Display an image. When the display range is changed in S507, the center position of the image displayed flat is set based on the information about the center of the display range after the change. After the display, the VR edge region confirmation processing ends.

The edge confirmation display of the VR edge area confirmation process will be described with reference to FIG. This display is the display performed in S504 and S505 of FIG.

FIG. 9(a) is a diagram showing a state in which the right end side is displayed when a VR image is VR-displayed. FIG. 9A is displayed, for example, by touching the top of the right frame of the cropping area frame 606 or the right non-cutting area 608 in FIG. 6C. Touching the non-cropped area 608 on the right side of the cropped area frame 606 or on the right side is an example of a "confirmation instruction" from the user. The confirmation instruction is an operation of designating a boundary to be confirmed or an area including the boundary in the area surrounded by the clipping area frame 606 . A right valid range 901 and an invalid range 902 are displayed in VR display (VR view). The VR display (VR view) is a display form mapped onto a virtual sphere, and is a display form deformed from the flat display. Therefore, the portion that was distorted in the flat display can be accurately confirmed in the shape in which the distortion is corrected. The invalid range 902 may be displayed by masking with black, white, pattern display, or the like. By displaying the boundary almost in the center, it is possible to check the condition of the right boundary line of the VR image. By arranging the return button 903 and the clipping button 904 on the invalid range 902, the user can confirm the area including the right valid range 901 and the right border line of the VR image, and can identify the border.

FIG. 9(b) is a diagram showing a state where the left end side is displayed when the VR image is VR-displayed. FIG. 9(b) is displayed, for example, by touching (confirmation instruction) the non-cutout area 608 on the left side of the cutout area frame 606 or on the left side of the cutout area frame 606 in FIG. 6(c). A left effective area 905 and an ineffective area 906 are displayed in VR display. The invalid range 906 may be displayed by masking with black, white, pattern display, or the like. By displaying the boundary almost in the center, it is possible to check the state of the left boundary line of the VR image. By arranging the return button 903 and the clipping button 904 on the invalid range 906 as in FIG. 9A, the user can check the left valid range 905 and the area including the left border of the VR image, It is possible to identify

Although an example of touching the top of the cropping area frame 606 or the non-cutting area 608 as a confirmation instruction from the user has been shown, this is not restrictive. For example, the CPU 101 may display, on the touch panel 106a, an icon for designating a boundary to be checked in the area surrounded by the cutout area frame 606. FIG. By touching the icon, the user can confirm the area including the boundary on the screen of FIG. 9(a) or 9(b) and identify the boundary. The screen of FIG. 9(a) or FIG. 9(b) is provisional information displayed for the user to confirm the boundary information and identify the boundary.

As described above, according to the above-described embodiment, when the 180° clipping of the VR image is performed from the flat display, the direction of the edge of the image on the flat display can be set to the central region after clipping.

Furthermore, when the VR image is not cut out and edited, the user's operability can be improved by scrolling left and right by image feed.

Note that the various controls described above that are performed by the CPU 101 may be performed by one piece of hardware, or a plurality of pieces of hardware (for example, a plurality of processors or circuits) may share the processing to control the entire apparatus. may be performed.

Moreover, although the present invention has been described in detail based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention can be applied to the present invention. included. Furthermore, each embodiment described above merely shows one embodiment of the present invention, and it is also possible to combine each embodiment as appropriate.

In addition, in the above-described embodiment, the case where the present invention is applied to a smartphone has been described as an example, but this is not limited to this example, and any device that can display a VR image on the display unit can be applied. is. For example, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, printers equipped with displays, digital photo frames, music players, game machines, electronic book readers, video players, and the like. In addition, the present invention can also be applied to digital cameras, television devices, projection devices, tablet terminals, AI speakers, home appliances, vehicle-mounted devices, medical devices, and the like.
<Other embodiments>

The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by processing to It can also be implemented by a circuit (for example, ASIC) that implements one or more functions.

100: Display control device 101: CPU 105: Display 106: Operation unit

Claims (18)

On the first screen, a flat display is performed in which the first image range of the VR content is contained in a rectangle, and on the second screen, an area cut out from the VR content is displayed on the VR content that is flatly displayed in the rectangular area. display control means for controlling to display an indicator showing
switching means for switching from the first screen to the second screen in response to an instruction to set a cutout range from a user;
In the second screen, scrolling the flat-displayed VR content in a first direction without scrolling the indicator according to a first operation, and scrolling the VR content according to the scrolling. The image area corresponding to the scroll amount in the first direction is sequentially displayed in the first direction from the end of the rectangular area in the second direction opposite to the first direction. Circular scroll display of the same content,
control means for controlling not to perform the cyclic scrolling display on the first screen even if the first operation is performed;
generating means for generating edited VR content having a second video range narrower than the first video range of the VR content, based on the area indicated by the indicator on the second screen;
An electronic device comprising: 2. The electronic device according to claim 1, wherein the control means causes the center of the range indicated by the indicator in the flat-displayed VR content to match or substantially match the center of the second image range. . 3. The electronic device according to claim 1, wherein the indicator indicates a range narrower than the rectangular area. 4. The electronic device according to any one of claims 1 to 3, wherein the first direction is a rightward direction or a leftward direction with respect to the VR content. The orientation of the second image range when the first image range is mapped onto a virtual sphere changes according to the cyclic scrolling display in the first direction on the second screen. The electronic device according to any one of claims 1 to 4. 6. The electronic device according to claim 1, wherein the control means does not scroll the second screen in a third direction perpendicular to the first direction. . The elevation angle or the depression angle of the second image range when the first image range is mapped onto the virtual sphere is not changed according to the scrolling of the VR content on the second screen. Item 7. The electronic device according to any one of Items 1 to 6. The electronic device according to any one of claims 1 to 7, wherein the first operation is a slide operation of touching the rectangular area and moving the touch position in the first direction. When receiving the setting instruction from the user, the control means confirms with the user whether or not to perform zenith correction.
The electronic device according to any one of claims 1 to 8, characterized in that: 10. The control unit according to any one of claims 1 to 9, wherein the control unit receives an instruction to cut out the VR content centered on the zenith or the nadir by an operation that does not involve a scrolling operation. The electronic equipment described in the paragraph. 11. The electronic device according to any one of claims 1 to 10, further comprising recording means for generating and recording a file containing the edited VR content generated by said generating means. 12. The electronic device according to claim 11, wherein said recording means generates one still image file storing a plurality of images based on said second video range. 13. The electronic device according to claim 12, wherein the file name of the still image file includes a character string ".vr" before the extension. 14. The electronic device according to any one of claims 11 to 13, wherein said recording means generates one moving image file in which a plurality of moving images based on said second image range are arranged. 15. The electronic device according to claim 14, wherein the file name of the moving image file includes a character string ".vr" before the extension. On the first screen, a flat display is performed in which the first image range of the VR content is contained in a rectangle, and on the second screen, an area cut out from the VR content is displayed on the VR content that is flatly displayed in the rectangular area. a display control step for controlling to display an indicator showing
a switching step of switching from the first screen to the second screen in response to a user's instruction to set an extraction range;
In the second screen, scrolling the flat-displayed VR content in a first direction without scrolling the indicator according to a first operation, and scrolling the VR content according to the scrolling. The image area corresponding to the scroll amount in the first direction is sequentially displayed in the first direction from the end of the rectangular area in the second direction opposite to the first direction. Circular scroll display of the same content,
a control step of controlling not to perform the cyclic scrolling display on the first screen even if the first operation is performed;
a generation step of generating edited VR content having a second video range narrower than the first video range of the VR content, based on the area indicated by the indicator on the second screen;
A control method for an electronic device, comprising: A program for causing a computer to function as each means of the electronic device according to any one of claims 1 to 15. A computer-readable storage medium storing a program for causing a computer to function as each means of the electronic device according to any one of claims 1 to 15.

Images