JP2018180051A - Electronic device and control method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic device which can display a content including a wide video range more properly when the content includes a non-video range.SOLUTION: An electronic device includes: detection means of detecting an attitude of the electronic device; and display control means for controlling a part of VR content to display as a display range, and changing a position of the display range in accordance with the detected attitude. When the VR content includes a narrow non-video range, in the video range of the VR content, after the display range reaches one end of the video range in accordance with the change of attitude in a specific rotation direction, the display range is changed to the other end of the video range in accordance with additional change of attitude in the specific rotation direction. When the VR content includes a wide non-video range, in the video range, after the display range reaches one end of the video range in accordance with the change of attitude in the specific rotation direction, the display range is not changed even though the attitude is changed further in the specific rotation direction.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an electronic device, a control method of the electronic device, a program, and a storage medium, and more particularly to a control method for displaying an image having a wide video range.

  2. Description of the Related Art In recent years, imaging devices capable of capturing an image having an image in a wider range than a human viewing angle, such as omnidirectional images and omnidirectional images, are in widespread use. In addition, by displaying a part of the image having such a wide range of image on the display and changing the range (display range) of the image to be displayed on the display by following the change of the attitude of the device, the sense of immersion or There is also known a method of providing a highly realistic display.

  In Patent Document 1, a video display system detects a user's gaze direction and displays video data in a predetermined range aligned with the gaze direction when a video taken by an omnidirectional camera is viewed on a head mounted display (HMD) Has been proposed.

JP, 2017-22665, A

  In generation of video content to be displayed by the HMD or the like, the shooting angle of view of the imaging device at the time of content shooting is various, and the angle of view may be changed at the time of content editing. Therefore, the video content may have a video only in a partial range (for example, 120 degrees up and down, 220 degrees left and right), not a 360-degree (all directions) video of the entire circumference. Since the effective video range of such video content is not connected at 360 degrees around, an end exists in a certain range of video (effective video range), and an area beyond the end becomes a non-video range. As a method of displaying a part of such video content as a display range, the display range is moved beyond one end of the effective video range, a non-video range is displayed in the process, and the display range is further moved in the same direction. There is a conceivable method of displaying an image of the effective image range on the other end side.

  In video content with video that is wider than the human viewing angle, the non-video range is located behind or directly below when the center of the effective video range is at the front, and the user at the center of the effective video range is at the front It is often located in a direction that makes it difficult for the eyes to turn. However, as described above, in order to display the effective image range of the other end after displaying the non-image range beyond one end, when the non-image range is wide, the non-image range has to be passed long . There is a problem that it is necessary to take many postures that make it difficult to turn the line of sight, and it is difficult to understand which range is displayed, when passing the non-image range for a long time. Rather, moving the display range in the reverse direction to display the effective video range at the other end may make it easier to understand where it is displayed and may be simpler.

  Therefore, the present invention provides an electronic device, a control method of the electronic device, a program, and a storage medium capable of performing more preferable display when there is a non-video range in content having a wide video range. To aim.

The electronic device according to the present invention controls the display unit to display a part of the range of the VR content as a display range, and detects the posture of the electronic device according to the posture detected by the detection unit. Display control means for changing the position of the display range, and when a part of the VR content to be displayed is a non-image range and the non-image range is narrower than a specific amount, in the image range of the VR content After the display range reaches one end of the video range according to the posture change in the specific rotation direction of the electronic device, the video range from the one end according to the posture change in the specific rotation direction of the electronic device Change the display range to the other end of the VR content, and part of the VR content to be displayed is a non-video range, and the non-video range is wider than the specified amount, the video range of the VR content After the display range reaches one end of the video range according to the posture change in the specific rotation direction of the slave device, the video range from the one end even if there is a further posture change in the specific rotation direction of the electronic device And display control means that does not change the display range to the other end of the display.

  According to the present invention, more preferable display can be performed when there is a non-video range in content having a wide video range.

FIG. 2 is a configuration block diagram of the electronic device 100. FIG. 2 is an external view of the electronic device 100. FIG. 2 is an external view of a VR goggles to which the electronic device 100 can be attached. It is a flowchart of VR display processing. It is a positional relationship of a display range in VR display processing, and a display example. It is a positional relationship of a display range in VR display processing, and a display example. It is a flowchart of the other example of VR display processing.

  FIG. 1 shows an example of the configuration of an electronic device 100 as an example of a display control device to which the present invention can be applied. The electronic device 100 can be configured using a display device such as a smartphone.

  In FIG. 1, a CPU 101, a memory 102, a non-volatile memory 103, an image processing unit 104, a display 105, an operation unit 106, a storage medium I / F 107, an external I / F 109, and a communication I / F 110 It is connected. Further, the voice output unit 112 and the posture detection unit 113 are also connected to the internal bus 150. The units connected to the internal bus 150 can exchange data with one another via the internal bus 150.

  The CPU 101 is a control unit that controls the entire electronic device 100, and includes at least one processor. The memory 102 is made of, for example, a RAM (a volatile memory using a semiconductor element or the like). The CPU 101 controls the respective units of the electronic device 100 using the memory 102 as a work memory in accordance with, for example, a program stored in the non-volatile memory 103. The non-volatile memory 103 stores image data, audio data, other data, various programs for the CPU 101 to operate, and the like. The non-volatile memory 103 is configured by, for example, a flash memory or a ROM.

The image processing unit 104 is an image stored in the non-volatile memory 103 or the storage medium 108, a video signal acquired through the external I / F 109, or an image acquired through the communication I / F 110 based on control of the CPU 101. Perform various image processing on For image processing performed by the image processing unit 104, A / D conversion processing, D / A conversion processing, image data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resize), noise reduction processing, color conversion Processing etc. are included. It also performs various image processing such as panoramic development, mapping processing, and conversion of a wide area image having a wide range of data even if it is not an omnidirectional image or an omnidirectional image. The image processing unit 104 may be configured by a dedicated circuit block for performing specific image processing. Further, depending on the type of image processing, the CPU 101 can perform image processing according to a program without using the image processing unit 104.

  The display 105 displays an image or a GUI screen that configures a graphical user interface (GUI) on the basis of control of the CPU 101. The CPU 101 generates a display control signal according to a program, generates a video signal to be displayed on the display 105, and controls each part of the electronic device 100 to output the generated video signal to the display 105. The display 105 displays an image based on the output video signal. Note that the electronic device 100 itself may have an interface for outputting a video signal to be displayed on the display 105, and the display 105 may be configured by an external monitor (such as a television).

  The operation unit 106 is an input device for receiving a user operation including a character information input device such as a keyboard, a pointing device such as a mouse or a touch panel, a button, a dial, a joystick, a touch sensor, a touch pad, and the like. Note that the touch panel is an input device that is planarly configured to be superimposed on the display 105, and coordinate information corresponding to the touched position is output.

  The storage medium I / F 107 can be loaded with a storage medium 108 such as a memory card, a CD, or a DVD, and reads data from the loaded storage medium 108 or writes data to the storage medium 108 under control of the CPU 101. I do. The external I / F 109 is an interface that is connected to an external device by a wired cable or wirelessly to input and output video signals and audio signals. The communication I / F 110 is an interface for communicating with an external device or the Internet 111 to transmit and receive various data such as files and commands.

  The sound output unit 112 outputs sounds of moving images and music data, operation sounds, ring tones, various notification sounds, and the like. The audio output unit 112 includes an audio output terminal 112a for connecting an earphone or the like and a speaker 112b, but audio output may be performed by wireless communication or the like.

  The posture detection unit 113 detects the posture of the electronic device 100 with respect to the direction of gravity. Based on the posture detected by the posture detection unit 113, whether the electronic device 100 is held horizontally, vertically, upward, downward, or diagonally, etc. Can be determined. As the posture detection unit 113, at least one of an acceleration sensor, a gyro sensor, a geomagnetic sensor, an orientation sensor, and the like can be used, and a plurality can be used in combination.

The operation unit 106 includes a touch panel 106 a. The CPU 101 can detect the following operation or state on the touch panel 106a.
The fact that a finger or pen that has not touched the touch panel 106 a has newly touched the touch panel 106 a, that is, the start of the touch (hereinafter referred to as touch-down).
-A state in which a finger or a pen is touching the touch panel 106a (hereinafter referred to as "Touch-On")
-A finger or pen moving while touching the touch panel 106a (hereinafter referred to as "Touch-Move")
-A finger or pen touching the touch panel 106a having left the touch panel 106a, that is, the end of the touch (hereinafter referred to as "touch-up")
A state in which nothing is touched on the touch panel 106 a (hereinafter referred to as touch-off)

  When touch down is detected, touch on is also detected at the same time. After touch down, touch on normally continues to be detected unless touch up is detected. Also when touch move is detected, touch on is detected simultaneously. Even if the touch on is detected, if the touch position is not moved, the touch move is not detected. When it is detected that all the fingers and pens touched have touched up, touch-off is detected.

  These operations / states and position coordinates where a finger or pen is touching on the touch panel 106a are notified to the CPU 101 through the internal bus, and the CPU 101 performs any operation (touch operation on the touch panel 106a based on the notified information) To determine if the With regard to the touch move, the movement direction of the finger or pen moving on the touch panel 106a can also be determined for each vertical component and horizontal component on the touch panel 106a based on the change in position coordinates. When it is detected that the touch move is performed for a predetermined distance or more, it is determined that the slide operation has been performed. An operation such as moving quickly by a certain distance while touching a finger on the touch panel 106a and releasing it as it is is called a flick. In other words, flicking is an operation of tracing quickly on the touch panel 106 a so as to flip it with a finger. When a touch move of a predetermined distance or more is detected at a predetermined speed or more, if touch-up is detected as it is, it can be determined that flicking has been performed (it can be determined that flicking has occurred following a slide operation). Furthermore, a touch operation in which multiple touch positions (for example, 2 points) are simultaneously touched to bring the touch positions closer to each other is called pinch in, and a touch operation to move the touch positions away from each other is called pinch out. Pinch out and pinch in are collectively referred to as pinch operation (or simply, pinch). The touch panel 106a may be any of various touch panels such as resistive film type, capacitive type, surface acoustic wave type, infrared type, electromagnetic induction type, image recognition type, optical sensor type, etc. Good. There are a method of detecting that there is a touch when there is a touch on the touch panel, and a method of detecting that there is a touch when there is a finger or a pen approaching the touch panel, any method may be used.

  An example of an external view of the electronic device 100 is shown in FIG. The display 105 is a display unit that displays an image and various information. As described above, the display 105 is configured integrally with the touch panel 106 a, and can detect a touch operation on the display surface of the display 105. The operation unit 106 includes operation units 106 b, 106 c, 106 d, 106 as shown. The operation unit 106 b is a power button that receives an operation to switch on and off the power of the electronic device 100. The operation unit 106 c and the operation unit 106 d are volume buttons for increasing and decreasing the volume of the sound output from the sound output unit 112. The operation unit 106 e is a home button for displaying a home screen on the display 105.

FIG. 3 shows an external view of a VR goggle (head mount adapter) to which the electronic device 100 can be attached. The electronic device 100 can also be used as a head mounted display by being attached to the VR goggles. The insertion slot 301 is an insertion slot for inserting the electronic device 100. The whole of the electronic device 100 can be inserted into the VR goggles by pointing the display surface of the display 105 to the head band 302 side (that is, the user side) for fixing the VR goggles to the user's head. By thus mounting the VR goggles to which the electronic device 100 is mounted, the user views the display 105 of the electronic device 100 without holding the electronic device 100 by hand while the VR goggles are mounted on the head. can do. In this case, when the user moves the head or the entire body, the posture of the electronic device 100 also changes. The attitude detection unit 113 detects a change in the attitude of the electronic device 100 at this time, and the CPU 101 performs a VR display process described later based on the change in the attitude. In this case, detecting the posture of the electronic device 100 by the posture detection unit 113 is equivalent to detecting the posture of the head of the user (the direction in which the user's gaze is facing).

  The electronic device 100 can display a VR image (VR content) on the display 105 by VR.

  The VR image is an image capable of VR display. The VR image includes an omnidirectional image (all-sky image) captured by an omnidirectional camera (all-sky camera) or a panoramic image having a video range (effective video range) wider than the display range that can be displayed on the display means at one time Shall be included. In addition, images that can be VR-displayed are included in VR images (VR content), even if they are images created using computer graphics (CG) as well as images shot with a camera. The VR image includes not only a still image but also a moving image and a live view image (an image acquired in substantially real time from a camera). The VR image has an image range (effective image range) at the maximum in the vertical direction (vertical angle, angle from zenith, elevation angle, depression angle, altitude angle) 360 degrees, and horizontal direction (horizontal angle, azimuth angle) 360 degrees Have. Also, even if the VR image is less than 360 degrees vertically and less than 360 degrees horizontally, it can be displayed on a wide angle of view (field of view range) wider than the angle of view that can be photographed with a normal camera It also includes an image having a video range (effective video range) wider than the display range. For example, an image taken with a omnidirectional camera capable of shooting an object with a field of view (for angle of view) of 360 ° in the horizontal direction (horizontal angle, azimuth angle) and a vertical angle of 210 ° centered on zenith is It is a kind of VR image. That is, an image range having a field of view of 180 degrees (± 90 degrees) or more in each of the vertical direction and the horizontal direction, and an image range larger than the range that can be visually recognized by human at one time is a VR image It is a kind of When this VR image is displayed in VR, by changing the posture in the left and right rotation direction, it is possible to view an omnidirectional video without joint in the left and right direction (horizontal rotation direction). In the vertical direction (vertical rotation direction), you can view a seamless omnidirectional image in the range of ± 105 degrees when viewed from directly above (zenith), but the image is more than 105 degrees from directly above It becomes a blank area which does not exist. The VR image can also be referred to as an “image whose image range is at least a part of a virtual space (VR space)”.

  The VR display is a display method capable of changing a display range, which displays an image of a visual field range according to the attitude of the electronic device 100 detected by the attitude detection unit 113 among the VR images. When the electronic device 100 is attached to the VR goggles and viewed, an image of a visual field range according to the direction of the user's face is displayed. For example, an image of a viewing angle (field angle) centered at 0 degrees in a horizontal direction (a specific azimuth, for example, north) and 90 degrees in a vertical direction (90 degrees from the zenith, that is, horizontal) Shall be displayed. From this state, when the attitude of the electronic device 100 is reversed (for example, when the display surface is changed from south to north), 180 degrees in the horizontal direction (reverse orientation, for example, south) of the same VR image, The display range is changed to an image of a viewing angle centered on 90 degrees (horizontal) in the vertical direction. In the case where the user views the electronic device 100 attached to the VR goggles, if the user directs the face from north to south (that is, when the user faces the back), the image displayed on the electronic device 100 is also a video of the north It is to change to the picture of the south. With such a VR display, it is possible to provide the user with a feeling as if it were visually present in the VR image (in the VR space).

  FIG. 4 shows a flowchart of VR display processing performed by the electronic device 100. This process is realized by the CPU 101 developing the program stored in the non-volatile memory 103 in the memory 102 and executing the program. The power of the electronic device 100 is turned on, and a VR image (VR content) is selected among the images recorded in the storage medium 108 and the images acquired from the communication destination, and the VR display is used among a plurality of display methods. When the display is designated, the process of FIG. 4 is started.

In S401, the CPU 101 reads a VR image to be displayed from the storage medium 108 or the communication destination via the communication I / F. In addition, information indicating a video range (effective video range) attached as attribute information of the VR image is acquired. The information indicating the effective video range is information indicating which angular range the effective range of the VR image has in the vertical and horizontal directions. The information indicating the effective image range may be any information that can specify the effective image range of the VR image, and is angle information represented by an angle of view, a view angle, an azimuth angle, an elevation angle, a depression angle, an altitude angle, a steradian, etc. It may also be position information such as the number of upper and lower and left and right pixels and coordinates. Further, the information indicating the effective image range may be model information of the camera that has captured the VR image (specifying the model can identify the image captureable range), zoom information at the time of shooting, or the like. Upon acquiring the information indicating the effective video range, the CPU 101 also specifies (calculates) the invalid video range (non-video range) by the difference between the upper, lower, left, and right 360 degrees. Conversely, information indicating the invalid video range may be obtained from the attribute information of the VR image, and the valid video range may be calculated therefrom, or both information indicating the valid video range and information indicating the invalid video range may be used. You may acquire from the attribute information of VR image.

  In S402, the CPU 101 acquires the attitude (attitude information) detected by the attitude detection unit 113.

  In S403, the CPU 101 provisionally calculates a display range indicating a range to be displayed in the VR image based on the posture obtained in S402 (calculates a provisional display range). In the subsequent processing, it is determined whether or not the video of the temporary display range calculated here should actually be displayed.

In S404, the CPU 101 determines whether the distance from the temporary display range to the invalid video range is within a predetermined distance (within a predetermined amount) which is a threshold. If it is within the predetermined distance, the process proceeds to S406, and if it is separated from the predetermined distance, the process proceeds to S405. The process of S404 will be described using FIG. 5 (a1). In FIG. 5 (a1), an effective video range 501 is obtained by mapping the entire effective video range in the VR image on a two-dimensional plane. An invalid video range 502 shown in gray indicates an area (non-video range) which is not an effective video range in the VR image among the full range (all directions) 360 degrees on the left and right and the range 180 degrees on the upper and lower sides. There is no image in this area, and if it is to be displayed, it will be displayed as a blank area, such as being displayed in a single color such as black or gray. A display range 503 indicates a range currently displayed (before posture change) on the display 105 among the VR images. When the display range 503 is at the position shown in FIG. 5 (a1), the display 105 performs the display as shown in FIG. 5 (a2). The provisional display range 504 is an angle of view moved from the display range 503 by the change of the posture detected by the posture detection unit 113. The distance from the temporary display range determined in S404 to the invalid video range is the following value.
The distance a1 between the right end of the temporary display range 504 and the right end of the effective video range 501
The distance a2 between the upper end of the temporary display range 504 and the upper end of the effective video range 501
The distance a3 between the left end of the temporary display range 504 and the left end of the effective video range 501
The distance a4 between the lower end of the temporary display range 504 and the lower end of the effective video range 501

The end of the effective video range 501 is a portion in contact with the boundary between the effective video range 501 and the invalid video range 502. If one of the distances a1 to a4 is equal to or less than the threshold distance Ath, the process advances to step S406; otherwise, the process advances to step S405. The threshold Ath is, for example, about 30% of the width of the display range 503 in the horizontal direction, and when any of the distances a1 to a4 becomes equal to or less than the threshold Ath, moving the display range in the same direction It indicates that the end of the effective image range will be reached. In addition, since the example which compares a distance with a threshold value was demonstrated as description of a process of S404 here, since it demonstrated using a two-dimensional top view, it does not restrict to this. As long as it is possible to determine whether the end of the temporary display range 404 and the effective video range 501 is close, the angle difference between the angle indicating the end of the effective video range 501 and the angle indicating the end of the temporary display range 404 is compared with the threshold You may In addition, a distance At in which all of the distances a1 to a4 are thresholded
Although the example compared with h was demonstrated, it does not restrict to this. For example, only the shortest distance among the distances a1 to a4 may be compared with the distance Ath, and if it becomes equal to or less than the distance Ath, the process may advance to S406, otherwise it may advance to S405. Further, of the distances a1 to a4, the end of the temporary display range 504 is away from the end of the effective video range according to the moving direction from the display range 503 before the posture change to the temporary display range 504 calculated after the posture change. The distance may not be used for determination. In the illustrated example, the distance a3 may not be compared with the threshold Ath. Further, instead of comparing all the distances a1 to a4 with the same threshold value Ath, they may be compared with different threshold values for each of the distances a1 to a4. For example, the distances a1 and a3 in the left-right direction are compared with the distance Ath1, and when the distance Ath1 or less, the process proceeds to S406. The distances a2 and a4 in the vertical direction are compared with the distance Ath2 (<Ath1), and when the distance Ath2 or less, the process proceeds to S406. Then, in the other cases, the process proceeds to S405. In this way, in the case where the posture change in the lateral direction, which is a direction in which a person can easily move the neck large, is effective for the display range earlier than in the case of the posture change in the vertical direction. The user can be alerted that the end of the is likely to be reached.

  In S405, the CPU 101 updates the display range to the temporary display range calculated in S403, and displays the video of the updated display range on the display 105. Further, since it is determined that the distance to the invalid video range is not within the predetermined distance in S404, the range guide is not displayed. If the range guide is displayed before the change in posture, the CPU 101 hides the range guide. The range guide will be described later.

  FIG. 5A1 shows the positional relationship of the display range 503 in the VR image in the situation of S405, and FIG. 5A2 shows a display example in this case. The temporary display range 504 illustrated in FIG. 5A1 is an example of the temporary display range calculated when there is a change in the clockwise posture from the display range 403 displayed in S405. Therefore, it is assumed that the provisional display range 504 of the position illustrated in FIG. 5A1 is not acquired in S405. The distance between the right end of the display range 503 and the right end of the effective video range 501 is larger than the threshold Ath, and the distances are larger (the same applies to other distances). FIG. 5A2 is a display example in the case where the position corresponding to the display range 503 in FIG. 5A1 is displayed on the display 105 by VR. Since the range guide 510 described later is not displayed, the visual recognition of the VR image is not hindered.

  In S406, the CPU 101 determines whether any end (side) of the temporary display range 404 has reached one end of the effective video range. That is, it is determined whether any one of the distances a1 to a4 has become zero. If one of the ends (sides) of the temporary display range 404 reaches one end of the effective video range, the process advances to step S408; otherwise, the process advances to step S407.

  In S407, the CPU 101 updates the display range to the temporary display range calculated in S403, and displays the video of the updated display range on the display 105. Further, since this situation is the case where it is determined in S404 that the distance to the invalid video range is within the predetermined distance, the CPU 101 displays the range guide as a notification indicating that the distance is within the predetermined distance.

FIG. 5 (b1) shows the positional relationship of the display range 503 in the VR image in the situation of S407, and FIG. 5 (b2) shows a display example in this case. Although the display range 503 has moved to the right from FIG. 5 (a1) and the display range 503 has not reached the end of the effective video range 501, the distance between the right end of the display range 503 and the right end of the effective video range 501 is It is less than the threshold Ath, and the distance is short. FIG. 5 (b 2) is a display example when the position corresponding to the display range 503 in FIG. 5 (b 1) is VR-displayed on the display 105. A range guide 510 is displayed superimposed on the VR-displayed image. The range guide 510 includes an effective video range (hatched portion 511), a display range (white portion 512) which is a range currently displayed by VR, and an invalid video range (black portion 513) among 360 degrees of surroundings. Is shown. By looking at the range guide 510, the user can recognize which range (positional relationship) in the entire VR image is the currently displayed range (display range). In the example of FIG. 5 (b 2), it is understood that the white part 512 is close to the black part 513, and when the line of sight (display range) is moved further to the right, it will reach an invalid video range.

  In addition, the range guide 510 of FIG. 5 (b2) has shown the effective imaging range, the invalid imaging range, and the display range in 360 degree of left-right directions. In addition to this, an effective video range, an invalid video range, and a range guide indicating a display range in the vertical direction 360 degrees or 180 degrees may be separately displayed. That is, both of the range guide 510 in the left and right direction and the range guide in the up and down direction may be displayed. In addition, when both displays, it interferes with the visual recognition of the image displayed in VR, so either one of the range guide 510 in the horizontal direction and the range guide in the vertical direction is displayed or It is also possible to switch dynamically so as not to display any of them. For example, when the distance a1 or the distance a3 which is the distance between the display range 503 and the effective video range 501 in the left-right direction becomes equal to or less than the threshold Ath due to the change in posture immediately before, the range guide 510 in the left-right direction is displayed. The range guide in the vertical direction may not be displayed. When the distance a2 or the distance a4, which is the distance between the display range 503 and the effective video range 501, in the vertical direction becomes equal to or less than the threshold Ath due to a change in posture immediately before, a range guide in the vertical direction is displayed, The range guide 510 in the left-right direction may not be displayed. This allows the user to grasp the positional relationship of the currently viewed range (display range) with respect to the direction likely to reach the end of the effective video range. Alternatively, the component in the lateral direction and the component in the vertical direction in the movement vector from the immediately preceding posture may be compared, and the range guide of the larger movement component may be displayed.

In S408, the CPU 101 determines whether the amount by which the provisional display range 504 exceeds the effective video range 501 exceeds a threshold Bth (predetermined amount). FIG. 5 (c 1) shows an example of the positional relationship when the temporary display range 504 exceeds the effective video range 501. In S408, it is determined whether the distance b, which is the amount by which the temporary display range 504 exceeds the effective video range 501, exceeds the threshold Bth. If the distance b exceeds the threshold Bth, the process proceeds to step S410. If not, the process proceeds to step S409. The amount by which the provisional display range 504 exceeds the effective video range 501 (the excess amount from the end of the effective video range 501) is as follows in more detail.
When the right end of the temporary display range 504 exceeds the right end of the effective video range 501 (that is, when a1 <0): the distance between the right end of the temporary display range 504 and the right end of the effective video range 501 When the upper end exceeds the upper end of the effective video range 501 (that is, when a2 <0): the distance between the upper end of the temporary display range 504 and the upper end of the effective video range 501-The left end of the temporary display range 504 is the effective video range 501 When it exceeds the left end of (ie, when a3 <0): the distance between the left end of the temporary display range 504 and the left end of the effective video range 501-The lower end of the temporary display range 504 exceeds the lower end of the effective video range 501 In the case (that is, in the case of a4

  The threshold Bth is a variable determined by the width of the invalid video range (the width of the effective video range), and is the sum of the width of the invalid video range and the width of the display range in the moving direction of the display range. That is, when the excess amount reaches the threshold Bth, the temporary display range is a range that just touches the opposite end of the effective video range.

In S408, it is determined whether or not the amount by which the provisional display range 504 exceeds the effective video range 501 exceeds the threshold Bth (predetermined amount). This is whether the amount of change in posture exceeds the threshold It is equivalent to judgment. That is, from the state where display range 503 is in contact with the end of effective video range 501, it is equivalent to the determination of whether or not the change in the attitude of electronic device 100 in the specific rotation direction has occurred with the change amount at which the excess reaches Bth. It is. The change in posture in the specific rotation direction is a change that causes the temporary display range 504 to move in the direction exceeding the effective video range. Therefore, the determination in S408 may be based on the posture.

  In S409, the CPU 101 updates the display range not to the temporary display range calculated in S403, but to a range in contact with the end of the effective video range 501 in the direction from the display range before movement to the temporary display range calculated in S403. Further, the CPU 101 displays, on the display 105, an image of the display range updated in the VR image. Further, since this situation is the case where it is determined in S404 that the distance to the invalid video range is within the predetermined distance, the CPU 101 displays the range guide.

  FIG. 5C1 shows the positional relationship of the display range 503 in the VR image in the situation of S409, and FIG. 5C2 shows a display example on the display 105 in this case. The display range 503 moves further to the right than FIG. 5 (b 1), reaches the end of the effective video range 501, and the right end of the display range 503 is in contact with the right end of the effective video range 501. Due to the change in the attitude of the electronic device 100 immediately before this, the temporary display range 504 is out of the effective video range 501 as shown in FIG. 5C, but the display range 503 is not this temporary display range 504 but the effective video range It is set to a range in contact with the right end of 501. That is, even if the user changes the attitude of the electronic device and moves the display range 503 to the right, the display range 503 is temporarily stopped at the position where it abuts on the right end of the effective video range 501, unless Yes in S408 and S410. Does not move the display range further. For example, when the user wears and watches the electronic device 100 in the VR goggles, the display range can be moved to the right (see the right side of the VR image) by turning the face to the right. However, when the display range reaches the right end of the effective video range, the movement of the display range (scroll to the left) is temporarily stopped, and the display range is limited unless the face is turned to the right any longer at 408 and S410. does not change.

  FIG. 5C2 is a display example when the position corresponding to the display range 503 in FIG. 5C1 is displayed on the display 105 by VR. A range guide 510 is displayed superimposed on the VR-displayed image. In the range guide 510, the white part indicating the display range is in contact with the black part indicating the invalid video range, and it can be identified that the display range has reached the end of the effective video range. Further, the CPU 101 displays an end indicator 520 on the right side of FIG. 5 (c2) corresponding to the right side which is the side in contact with the effective video range 501 among the four sides of the display range 503. The end indicator 520 is a semi-transparent or non-transparent display object displayed in the area along the end of the VR-displayed VR image (the end of the display area of the display 105). The end indicator 520 means that at least a part of the side on which the end indicator 520 is displayed reaches the end of the effective image range. By looking at this end indicator 520, the user can recognize that there is no image even if the display range is moved further to the right in the example of FIG. 5 (c2). Further, as described above, even if the attitude of the electronic device 100 is changed, the movement of the display range (the scrolling of the image to the left) is temporarily stopped at the end of the effective image range. In this case, if only the displayed video (image) is viewed, the user may misidentify that the movement of the display range is stopped due to some processing abnormality such as dropped frames due to lack of processing power or failure. Also, even if the movement of the display range is not temporarily stopped at the end of the effective video range, the display of the blank area may not be partially displayed due to some display processing abnormality, because the display of the blank area includes the invalid video range. It is difficult for the user to judge whether the area has been generated. However, in this embodiment, since the end indicator 520 is displayed in this case, the user can correctly recognize that it is not a processing abnormality but a normal operation that occurs because the display range has reached the end of the effective image range. In addition, since the blank state display (display such as black not related to the effective video range) corresponding to the invalid video range is not performed, the quality of the VR display can be maintained at high quality. If the display in a blank state (display such as black not related to the effective video range) is performed, the feeling of virtual reality may be faded by looking at this, and the user's sense of immersion may be disturbed. On the other hand, in the present embodiment, even if there is an invalid video range, an area corresponding to the invalid video range is not displayed, so that the immersive feeling can be prevented from being disturbed.

  The notification to be displayed when the display range reaches the end of the effective video range is not limited to the display of the end indicator 520. The display form of the range guide 510 is changed according to the display range reaching the end of the effective video range (such as blinking display or color change), a message such as “The end has been reached”, other display items May be displayed (such as notification icon display). In addition, the display does not display the range guide 510 until the display range reaches the end of the effective image range, and the end is reached by displaying the range guide 510 in response to the display range reaching the end of the effective image range You may notify that. In terms of preventing inhibition of the user's sense of immersion, such as changing the display form of the range guide or covering one side rather than displaying the display object covering one side such as the end indicator 520 Notification by display of other display items which are not things is preferable. In addition, the fact that the display range has reached the end of the effective image range can also be recognized by the range guide 510, so that even if the end is reached, additional display objects such as the end indicator 520 should not be displayed. Good. Conversely, from the viewpoint of clearly notifying the reason for stopping the movement of the display range, the end indicator 520 is displayed, and the area of the end indicator 520 is increased as the excess amount of the provisional display range from the effective video range increases. The display may be changed according to the excess amount. The temporary display range is exceeded when there is an instruction to change the display range to an area where the display range reaches the end of the effective video range and further beyond the end (instruction by posture change, user operation, etc.) It is. Also, notification that the end such as the end indicator 520 has been reached is not performed only when the display range reaches the end of the effective video range, but when the provisional display range exceeds the end of the effective video range, that is, the end This may be performed when there is a change in posture for displaying an area beyond the area. In this case, even if the display range has reached the end of the effective image range, no notification is made that the end of the end indicator 520 or the like has been reached if the attitude is stable without change.

  In S410, the CPU 101 determines whether the width of the invalid video range in the moving direction from the display range before moving to the temporary display range calculated in S403 is narrower than a threshold Cth (specific amount). The width of the invalid image range can be expressed by the number of pixels, the length, or the distance when the VR image is mapped on a two-dimensional plane, but is displayed by the angle of view, viewing angle, azimuth, elevation, depression, elevation, steradian, etc. It can also be expressed as angle information. Therefore, the threshold Cth used for the determination in S410 may be the number of pixels, the length, or the threshold Cth of the distance, or may be the threshold Cth of the angle information. The threshold Cth is, for example, the width of the display range in the movement direction. If the width of the invalid video range is smaller than the threshold Cth, the process advances to step S411; otherwise, the process advances to step S409.

  6 (a1) and 6 (b1) show a comparative example of the width of the invalid video range and the width of the display range as an example of the threshold Cth when the moving direction of the display range is the right. Both FIG. 6 (a1) and FIG. 6 (b1) illustrate what mapped the VR image on the two-dimensional plane as a center as an invalid imaging | video range. 6 (a1) and 6 (b1), the effective image range in the left-right direction of the VR image is different, and the VR image of FIG. 6 (a1) is more effective than the VR image of FIG. 6 (b1) Is wide (the invalid video range is narrow). The width c in FIGS. 6A1 and 6B1 is the width (length) in the left-right direction of the invalid video range. In FIG. 6 (a1), the width c in the left-right direction of the invalid video range is narrower than the width X1 (= Cth) in the left-right direction of the display range 503. Therefore, if a range corresponding to the display range 503 shown in FIG. 6 (a1) is displayed on the display 105, as shown in FIG. 6 (a2), the effective video range is displayed at least in part and the entire screen is a blank area. It never happens. In this case, it is determined as Yes in S410. On the other hand, in FIG. 6 (a2), the width c in the left-right direction of the invalid video image range is wider than the width X1 (= Cth) in the left-right direction of the display range 503. Therefore, if the range corresponding to the display range 503 shown in FIG. 6 (b1) is displayed on the display 105, the entire screen becomes a blank area as shown in FIG. 6 (b2). In this case, it is determined as No in S410.

  If it is determined No in S410, the process does not advance to S411, and the display range does not move to the opposite end of the effective video range no matter how much the temporary display range moves to the right. That is, even if the user changes the attitude of the electronic device 100 in the same direction, the opposite end of the effective video range is not displayed. In order to display the opposite end of the effective video range, it is necessary to change the attitude of the electronic device 100 in the reverse direction. In the example in which the electronic device 100 is attached to the VR goggles, the display range does not exceed the right end of the effective image range no matter how much the face is turned to the right. If you want to see the area to the left of the effective image range, you need to turn your face to the left. This is because the width of the invalid video range in the left-right direction is wide, and the continuity (relevancy) of the right and left videos of the effective video range across the invalid video range is low. For example, the further right side of the subject (building with a white wall in the example of FIG. 6 (b1)) shown at the right end of the effective image range is not shown at the left end of the effective image range but is interrupted. In this case, when the image is switched from the right end range to the left end range according to the posture change in which the face is turned to the right, the image with low relevance to the subject captured at the right end of the effective image range (Another building in the example of FIG. 6 (b1)) will be displayed. When the user sees such a display change, the image at the left end of the displayed effective image range can not be understood as the image further to the right of the image at the right end viewed immediately before You may feel discomfort such as immersive feeling decrease. Therefore, in the present embodiment, when the width of the invalid video range in the moving direction is wide, the display range is not changed from one end of the effective video range to the opposite end. Although the example in which the threshold Cth is set to the amount corresponding to the width of the display range has been described, it may be set to an amount corresponding to a fixed angle such as an amount for 270 degrees or an amount for 180 degrees. Further, the threshold Cth is set to the effective video range so that the display range does not exceed the end of the effective video range when the width of the invalid video range is compared with the width of the invalid video range and the width of the invalid video range is wide. It may be a width.

  In step S411, the CPU 101 updates the display range to a range in the effective video range that is in contact with the end opposite to the end to which the display range before movement was in contact, and updates the video of the updated display range in the VR image. It is displayed on the display 105. When the threshold Bth is the sum of the width of the invalid video range and the width of the display range in the movement direction, the range in contact with the end opposite to the end where the display range before movement was in contact is an excess amount equal to the threshold Bth Equal to the provisional display range set. Further, since this situation is the case where it is determined in S404 that the distance to the invalid video range is within the predetermined distance, the CPU 101 displays the range guide.

  FIG. 5 (d1) shows the positional relationship of the display range 503 in the VR image in the situation of S411, and FIG. 5 (d2) shows a display example on the display 105 in this case. Although the display range 503 is in contact with the right end of the effective video range 501 in FIG. 5 (c1), as a result of the attitude of the electronic device 100 further changing the display range to the right, the display range 503 is effective in FIG. 5 (d1) This range is in contact with the left end (the opposite end of the right end) of the video range 501. FIG. 5D2 is a display example in the case where the position corresponding to the display range 503 in FIG. 5D1 is VR displayed on the display 105. A range guide 510 is displayed superimposed on the VR-displayed image. In the range guide 510, the white part indicating the display range is in reverse contact with the black part indicating the invalid video range and the example in FIG. 5C, and the display range is the reverse of the effective video range. It can identify that it moved to the end. Also, the end indicator 520 is not displayed. This is because the change in posture immediately before is not a change such as moving the display range beyond the left end of the effective video range.

It should be noted that it can be understood that the display range has moved to the other end of the effective video range on the way from the determination that the excess amount exceeds the threshold Bth in S408 to the display in FIG. 5 (d2) in S411. An animation may be displayed. For example, as shown in FIG. 6 (a2), the image 601 of the display range before movement, the blank area 602, and the image 603 of the display range after movement move quickly to the left (scroll), and the image 603 of the display range after movement It may be displayed as moving in from the right. By sandwiching such a display, the user can easily recognize that the display range has moved to the opposite end. At this time, since the display range passes through the invalid video range, the display range overlaps the invalid video range in the range guide 510. The overlapping range is displayed in a display form distinguishable from the non-overlapping range (in the example shown, it is displayed in gray different from white or black).

  According to the above-described VR processing, when the user changes the posture of the electronic device and moves the display range 503 to the right, the display range 503 can be displayed as shown in FIGS. 5 (a1), 5 (b1), 5 (c1). , And (d1) sequentially move. In this movement process, the display range changes smoothly according to the change in posture up to FIG. 5 (a1), FIG. 5 (b1), and FIG. 5 (c1), but FIG. 5 (c1) to FIG. 5 (d1) Over time, movement of the display range is temporarily stopped even if posture change continues. Then, when the temporary display range excess amount reaches the threshold Bth, the display range 503 moves from FIG. 5 (c1) to FIG. 5 (d1).

  In the VR display process described above, an example in which the range guide 510 is displayed when the display range is within a predetermined distance from the end of the effective video range has been described. However, an invalid video range is displayed on the VR image to be displayed. It may be displayed when it exists, and may not be displayed when it does not exist. That is, whether or not the range guide 510 is to be displayed may be switched depending on whether the invalid video range exists in the VR image to be displayed.

  In the above-described VR display processing, an example in which the range guide 510 is displayed when the display range is within a predetermined distance from the end of the effective image range has been described. However, whether the range guide 510 is within the predetermined distance from the end of the effective image range It may be displayed regardless of whether or not. That is, the range guide 510 may be displayed even when the display range is more than a predetermined distance from the end of the effective video range. When the range guide 510 is displayed even when the display range is further than the predetermined distance from the end of the effective video range, another display range is within the predetermined distance from the end of the effective video range. It is even better to notify that the end has approached by a method. For example, in accordance with the fact that the display range is within a predetermined distance from the end of the effective video range, display items other than the range guide 510 such as icons, messages and symbols may be displayed. Further, even if the display form of the range guide 510 originally displayed is changed from the first display form to the second display form in response to the display range being within a predetermined distance from the end of the effective video range. Good (eg, blink, change color, etc.)

  Further, in the VR display process described above, when the display range reaches the end of the effective video range, the end indicator 520 is displayed after holding the display range in contact with the end, thereby notifying that the end has been reached. An example has been described. However, the present invention is not limited to this, and instead of the processing of S409, the display range is moved beyond the end of the effective video range to a part of the invalid video range, but invalid video is exceeded by a predetermined amount (Bmax equivalent amount described later) By not showing the range, it may be notified that the end has been reached.

FIG. 6C1 shows the positional relationship between the effective video range and the display range in this case. In (c1) of FIG. 6, there is a change in the posture of the electronic device 100, and the excess amount b of the temporary display range 504 from the effective video range 501 exceeds the maximum width Bmax of the invalid video range included in the display range 503. It is an example of positional relationship. FIG. 6C2 is a display example of VR display on the display 105 when the display range 503 is at the position of FIG. 6C1. Until the temporary display range 504 exceeds the maximum width Bmax, the display range is updated within the range of the temporary display range including the invalid video range, and the video of the updated display range is displayed. The blank area (area beyond the end of the effective video range) corresponding to the invalid video range included in the display range is displayed by being filled with a single color or the like. That is, according to the attitude change of electronic device 100, a blank area having a width corresponding to the amount of attitude change is displayed until temporary display range 504 exceeds maximum width Bmax. When the temporary display range 504 exceeds the maximum width Bmax, the display range is not the temporary display range, and is held in a range not exceeding the maximum width Bmax as shown in FIG. 6 (c1). A range in which the excess amount of B becomes the maximum width Bmax is displayed as the display range 503. The maximum width Bmax is set to a value smaller than the width of the display range 503. The display range 503 shown in FIG. 6 (c1) is held until the excess amount b of the temporary display range 504 from the effective video range 501 exceeds the maximum width Bmax of the invalid video range included in the display range 503 and exceeds the threshold Bth. And the display as shown in FIG. 6 (c2) is performed. With such a display, the area beyond the end of the currently displayed image is a blank area, and the user can intuitively understand that the image does not exist. At this time, since the display range partially overlaps the invalid video range, the display range and the invalid video range overlap in the range guide 510. The overlapping range is displayed in a display form distinguishable from the non-overlapping range (in the example shown, it is displayed in gray different from white or black). When the excess amount b of the temporary display range 504 from the effective video range 501 exceeds Bth, the processing as described above is performed.

  In the VR display process described above, an example in which the range guide is displayed when the display range is within a predetermined distance from the end of the effective video range has been described, but at least a part of the display range includes the invalid video range. It is good also as what is displayed according to. As in the case where the maximum width Bmax described above is wider than the width of the display range, the setting of the display range (display range not including the effective video range) including only the invalid video range may be allowed. In that case, the range guide may be displayed in response to the entire display range becoming an invalid video range.

  In the above-described VR display process, an example in which the range guide 510 indicates the effective video range, the display range, and the invalid video range has been described, but the display range may not be shown. If the valid video range and the invalid video range are indicated, the user can recognize that the display of the blank area is due to the invalid video range and the processing is not abnormal.

<Modification>
Instead of the VR display process described with reference to FIG. 4, the VR display process shown in FIG. 7 may be performed. The VR display process in FIG. 7 omits the processes of S408 and S411 in FIG. 4 and adds S711 instead.

  The processes of S401 to S409 are the same as those described in FIG. If it is determined in S406 that the provisional display range has reached the end of the effective video range, the processing of S410 is performed.

  In S410, the CPU 101 determines whether the width of the invalid video range is smaller than the threshold Cth. If the width of the invalid video range is smaller than the threshold Cth, the process proceeds to step S711. If the width of the invalid video range is equal to or larger than the threshold Cth, the process proceeds to step S409.

  In S409, the CPU 101 performs the same process as the process described in FIG. That is, the display range does not extend beyond the end of the effective video range, and the range beyond the end (ineffective video range) is not displayed in the VR display.

  In S711, the CPU 101 updates the display range with the temporary display range calculated in S403, and displays the video of the updated display range on the display 105. In this situation, the display range includes an invalid video range which is a range beyond the end. Therefore, in this case, display as shown in FIG. 6 (c2) and FIG. 6 (a2) is performed.

According to the VR display processing of FIG. 7, when the width of the invalid video range is smaller than the threshold Cth, the movement of the display range is stopped even if there is a posture change whose temporary display range exceeds the end of the valid display range. Absent. According to the VR display processing of FIG. 7, in such a case, the display range can be smoothly moved to the effective video range at the opposite end via the display of the blank area. On the other hand, when the width of the invalid video range is equal to or more than the threshold Cth, when the provisional display range reaches the end of the effective display range, the display range stops without moving even if there is a posture change in the same direction. . As described above, depending on whether the width of the invalid video range is smaller than the threshold Cth, it is different whether to display the blank area beyond the end of the display range or to stop the display range without displaying the blank area. .

  By this, for example, a user who is wearing the VR goggles and looks at the electronic device 100 sees that the display range does not move while turning the face to the right, and the destination is not displayed even if it is turned more than that. Notice early and stop turning his face to the right. Specifically, when the user turns the face a further 10 times after the display range is stopped, the user notices that the destination is not displayed even if the face is turned any more, and the face stops turning to the right. Therefore, it is possible to prevent an unnecessary face rotation operation (for example, an operation of rotating the face by 90 degrees after the display range is stopped).

  If the center of the effective image range is the display range when the electronic device 100 is mounted on the VR goggles and the user faces the front, the center of the invalid display range is behind the user as viewed from the user. When the invalid display range is narrow (when the width of the invalid video range is less than the threshold Cth), there is also an effective video range behind, which makes the user look back on the background. However, when the invalid display range is wide (when the width of the invalid video range is equal to or larger than the threshold Cth), there is no effective video range behind the user, and the user has little meaning to look back. Also, to look at the left diagonal back where the opposite edge of the effective video range is displayed from the right diagonal back where the right edge of the effective video range is displayed, look backward at the back and move the sight clockwise further It is easier to move the sight line counterclockwise via the front than on the structure of the human body. Therefore, as in the process described in FIG. 7, when the invalid video range is wide and there is little meaning to look back, the movement of the display range is stopped early, and the user is guided not to move behind. . By this, it is possible to prevent wasteful operations that are difficult to perform such as looking back, and to make the VR display visually comfortable.

  In the above-described embodiment, an example of performing single-lens VR display in which one image of one display range is displayed on one screen has been described as an example of VR display. The VR display is not limited to the single-lens VR display. The present invention displays a single display range in two display areas in one screen, or in a two-eye VR display in which two display areas slightly shifted in consideration of parallax are displayed in two display areas in one screen. Is also applicable.

  In the above-described embodiment, although the example in which the present invention is applied to the VR display moving the display range based on the attitude of the electronic device 100 detected by the attitude detection unit 113 has been described, the present invention is not limited thereto. The present invention is also applicable to the case where the display range is moved based on the scroll instruction operation from the user instead of moving the display range based on the posture. For example, in another display mode different from the VR display mode, the display range is moved (scrolled) not according to a change in posture but in response to a user's touch move on the touch panel 106a or an operation on a direction button such as a cross key. It is possible. Also in this case, it is possible to obtain the temporary display range according to the scroll instruction operation, and to perform the processing of S404 to S411 of FIG. 4 and the processing of S404 to S711 of FIG. That is, even in the case of moving the display range by touch move, when the display range approaches or reaches the end of the effective video range, notification indicating that it has approached or reached is performed. Also, if the width of the invalid video range is less than the predetermined width, it is possible to scroll beyond the end of the valid video range by touch move, but if the width of the invalid video range is equal to or more than the predetermined width The movement of the display range does not exceed the end of the effective video range.

According to the processing described above, control is performed to display the range guide 510 and the end indicator 520 when the display range reaches the end from the position not including the end in the effective video range of the VR image. By doing this, it can be recognized that the reason why the display range is not moved further is that the end of the effective video range is reached. Therefore, it is possible to prevent misidentification as the cause due to other factors such as reduction in processing capacity due to high load processing, processing abnormality, and failure.

  Moreover, according to the above-mentioned process, if the width of the invalid video range is smaller than the predetermined width, it is possible to change the display range to the opposite end beyond the end of the valid video range, but the width of the invalid video range is predetermined. The display range is controlled so as not to move beyond the end of the effective video range if the width of the video image is over the width of. By doing this, when the invalid video range is narrow, it is possible to display the video at the opposite end of the effective video range with a small change in posture. On the other hand, in the case where the invalid video range is wide, it is possible to suppress the user from making a difficult posture change such as looking back behind and further moving the sight line further.

  In VR content having a wider range of image than human viewing angle, the non-image range is located behind or directly below the center of the effective image range, and the user sets the center of the effective image range to the front It is often located in a direction that makes it difficult for the eyes to turn. However, in order to display the effective image range of the other end after displaying the non-image range beyond one end, when the non-image range is wide, the non-image range has to be passed long. If you go through a long non-image area, you have to take a lot of postures that make it difficult to turn your gaze, and it is difficult to understand which area is displayed. Rather, moving the display range in the reverse direction to display the effective video range at the other end is easier to understand where it is displayed and is simpler. According to the present embodiment, the display range does not move beyond the end of the effective video range if the width of the invalid video range is equal to or greater than the predetermined width, so the user moves the display direction in the reverse direction to make the other end effective. Try to display the video range. In this way, it is possible to suppress a situation where it is necessary to take many postures that make it difficult to direct the line of sight by passing a long non-image area, and a situation where it is difficult to understand which area is displayed. Thus, more suitable display can be performed after reaching the end of the video range of the VR content.

  The above-described various controls described as being performed by the CPU 101 may be performed by one piece of hardware, or a plurality of pieces of hardware may control the entire apparatus by sharing processing.

  Further, although the present invention has been described in detail based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. Furthermore, each embodiment mentioned above shows only one embodiment of the present invention, and it is also possible to combine each embodiment suitably.

  In the above-described embodiment, the present invention is applied to the electronic device 100 such as a smartphone as an example, but the present invention is not limited to this example and control is performed to display a part of the VR image. It is applicable if it is the electronic device which is possible. Of course, it is also possible to apply to a head mounted display (HMD) instead of a smartphone. The present invention is also applicable to personal computers and PDAs, mobile phone terminals and portable image viewers, printer devices equipped with displays, digital photo frames and the like. Further, the present invention is applicable to a music player, a game machine, an electronic book reader, a tablet terminal, a smartphone, a projection device, a home appliance device equipped with a display, an in-vehicle device, and the like.

(Other embodiments)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

  100: electronic device 101: CPU 113: attitude detection unit

Claims (14)

An electronic device,
Detection means for detecting the attitude of the electronic device;
Display control means for performing control to display a partial range of VR content as a display range on a display means, and changing the position of the display range according to the posture detected by the detection means,
When a part of the VR content to be displayed is a non-video range and the non-video range is narrower than a specific amount, display is performed according to a change in posture of the electronic device in a specific rotation direction in the video range of the VR content After the range reaches one end of the video range, the display range is changed from the one end to the other end of the video range according to a further posture change in the specific rotation direction of the electronic device;
When a part of the VR content to be displayed is in the non-video range, and the non-video range is wider than the specific amount, the posture change in the specific rotation direction of the electronic device is performed in the video range of the VR content. A display control means that does not change the display range from the one end to the other end of the video range even if there is further posture change in the specific rotation direction of the electronic device after the display range reaches one end of the video range When,
Electronic equipment characterized by having. A display control unit that controls to display a partial range of VR content as a display range on a display unit, and changes the position of the display range according to an operation from a user,
When part of the VR content to be displayed is in the non-video range and the non-video range is narrower than the specific amount, the display range is one end of the video range according to a predetermined operation in the video range of the VR content. After reaching, the display range is changed from the one end to the other end of the image range according to the further predetermined operation,
When a part of the VR content to be displayed is in the non-video range and the non-video range is wider than the specific amount, the display range is the video range in the video range of the VR content according to the predetermined operation. An electronic apparatus comprising display control means which does not change the display range from the one end to the other end of the video range even if the predetermined operation is performed after the one end is reached. The electronic device according to claim 1, wherein the specific amount is an amount corresponding to 180 degrees of an angle of view. The electronic apparatus according to claim 1, wherein the specific amount is an amount corresponding to a width of the display range in a moving direction of the display range. The electronic apparatus according to claim 1, wherein the specific amount is an amount corresponding to a width of a video range of the VR content in a moving direction of the display range. The display control means performs control to display a blank area corresponding to the non-image area while changing the display area from the one end to the other end when the non-image area is narrower than a specific amount. The electronic device according to any one of claims 1 to 5, wherein: Even when the non-image range is narrower than a specific amount, the display control means further displays the display range from the one end until the amount of change in posture change in the specific rotational direction of the electronic device exceeds a threshold. The electronic device according to claim 1, wherein the electronic device does not change. The display control means is controlled to perform display indicating that the display range has reached one end when the display range has reached one end of the video range of the VR content. The electronic device according to any one of to 7. The display control means further changes the attitude of the electronic device in the specific rotation direction after the display range reaches one end of the video range of the VR content according to the attitude change in the specific rotation direction of the electronic device. The display range is changed from the one end to the other end of the image range, and control is performed to display that the display range has reached the one end. Or the electronic device as described in 7. The display control means controls to display a display range representing a positional relationship between a video range, a non-video range, and a display range of the VR content, as well as a partial range of the VR content. The electronic device according to any one of claims 1 to 9. A control method of an electronic device,
Detecting the attitude of the electronic device;
A display control step of performing control to display a partial range of VR content as a display range on a display unit, and changing the position of the display range according to the posture detected in the detection step,
When a part of the VR content to be displayed is a non-video range and the non-video range is narrower than a specific amount, display is performed according to a change in posture of the electronic device in a specific rotation direction in the video range of the VR content After the range reaches one end of the video range, the display range is changed from the one end to the other end of the video range according to a further posture change in the specific rotation direction of the electronic device;
When a part of the VR content to be displayed is in the non-video range, and the non-video range is wider than the specific amount, the posture change in the specific rotation direction of the electronic device is performed in the video range of the VR content. Display control step that does not change the display range from the one end to the other end of the video range even if there is further posture change in the specific rotation direction of the electronic device after the display range reaches one end of the video range When,
And controlling the electronic device. A display control step of performing control to display a partial range of VR content as a display range on a display unit, and changing the position of the display range according to an operation from a user,
When part of the VR content to be displayed is in the non-video range and the non-video range is narrower than the specific amount, the display range is one end of the video range according to a predetermined operation in the video range of the VR content. After reaching, the display range is changed from the one end to the other end of the image range according to the further predetermined operation,
When a part of the VR content to be displayed is in the non-video range and the non-video range is wider than the specific amount, the display range is the video range in the video range of the VR content according to the predetermined operation. A control method of an electronic device, comprising a display control step of not changing a display range from the one end to the other end of the image range even if the predetermined operation is performed after the one end is reached.   The program for functioning a computer as each means of the electronic device as described in any one of Claims 1-10.   A computer readable storage medium storing a program for causing a computer to function as each means of the electronic device according to any one of claims 1 to 10.

Images