JP2022137023A - Program, Information Processing Apparatus, and Method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program for, an information processing apparatus, and a method of improving operability in operations relating to browsing images.

SOLUTION: A program according to the present invention lets a processor execute a step S1003 for allowing a user to browse an entire celestial sphere image, a step S1005 of executing a first processing for an image when a first operation as a movement operation including an initial operation is carried out with respect to a touch screen, and a step S1008 of executing a second processing for an image which is different from the first processing, when a second operation as a movement operation without any initial operation is carried out with respect to the touch screen.

SELECTED DRAWING: Figure 10

COPYRIGHT: (C)2022,JPO&INPIT

Description

The present invention relates to a program, an information processing device, and a method.

In Patent Document 1, in a state in which an omnidirectional image or a panoramic image is displayed, by inputting a movement operation of moving an indicator that is in contact with a touch panel while maintaining the contact, various operations can be performed on the omnidirectional image or the panoramic image. An image display device is disclosed that executes the processing of .

Further, there is known an application that reproduces a moving image (video) and allows a viewer to view the moving image, and executes processing related to the moving image by receiving a movement operation.

JP 2015-46949 A

Such technology has room for improving operability.

An object of one aspect of the present invention is to improve the operability of operations related to viewing videos.

According to one aspect of the invention, there is provided a program executed by a computer comprising a processor, memory and touch screen. The program causes the processor to cause the user to browse the video; if a first operation, which is a moving operation including an initial operation, is performed on the touch screen, perform a first process related to the video; executing a second process related to the image that is different from the first process when a second operation, which is a movement operation that does not include the initial operation, is performed on the screen.

According to one aspect of the present invention, there is an effect of improving the operability of operations related to browsing of images.

It is a figure showing the outline of the composition of the animation distribution system according to an embodiment. 2 is a block diagram showing an example hardware configuration of a smartphone according to an embodiment; FIG. FIG. 4 is a diagram for explaining the field of view of an omnidirectional camera according to an embodiment; 2 is a block diagram showing an example hardware configuration of an omnidirectional camera according to an embodiment; FIG. It is a figure which shows an example of imaging|photography of a to-be-photographed object using a moving image imaging system. It is a block diagram showing an example of a hardware configuration of a server according to an embodiment. 1 is a block diagram representing a smartphone as a modular configuration according to an embodiment; FIG. 3 is a block diagram showing a detailed configuration of modules of a smart phone according to an embodiment; FIG. FIG. 3 is a diagram showing an omnidirectional image according to an embodiment and an example of display of the omnidirectional image on a smartphone; FIG. 4 is a sequence diagram showing a part of processing executed in a smartphone and a part of processing executed in a server according to an embodiment; 9 is a flowchart showing movement operation determination processing executed in a smartphone according to an embodiment; FIG. 10 is a diagram showing a display example of an omnidirectional video on a smartphone, according to an embodiment; FIG. 10 is a diagram showing a display example of an omnidirectional video on a smartphone, according to an embodiment; FIG. 10 is a diagram showing a display example of an omnidirectional video on a smartphone, according to an embodiment;

Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same parts are given the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated. In one or more of the embodiments presented in this disclosure, elements of each embodiment may be combined with each other and the combined result shall also form part of the embodiments presented in this disclosure.

[Video distribution system configuration]
The configuration of the video distribution system 100 will be described with reference to FIG. FIG. 1 is a diagram showing an outline of the configuration of video distribution system 100 according to the present embodiment.

Video distribution system 100 includes video shooting systems 110A, 110B, 110C, and 110D, smartphones 160A, 160B, 160C, and 160D (computers, information processing devices), server 170, and network 2, as an example. Video distribution system 100 is a system that distributes videos shot by video shooting systems 110A, 110B, 110C, and 110D to smartphones 160A, 160B, 160C, and 160D via network 2 and server 170, respectively. Hereinafter, smartphones 160A, 160B, 160C, and 160D are also collectively referred to as smartphone 160 .

[Smartphone 160]
Smartphone 160 allows the user of smartphone 160 to view the distributed video. In other words, it can be said that the user of the smartphone 160 is a viewer of the distributed video. Smartphone 160 is configured to be able to communicate with server 170 via network 2 . The number of smartphones 160 configuring video distribution system 100 is not limited to four, and may be three or less or five or more.

Smartphone 160 will be described in more detail with reference to FIG. FIG. 2 is a block diagram showing an example of the hardware configuration of smartphone 160 according to the present embodiment. Smartphone 160 includes a processor 210, a memory 220, a storage 230, a touch screen 240, and a communication interface 250 as main components. Each component is connected to bus 260 respectively.

Processor 210 executes a series of instructions contained in a program stored in memory 220 or storage 230 based on a signal provided to smart phone 160 or based on the establishment of a predetermined condition. In one aspect, processor 210 is implemented as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), MPU (Micro Processor Unit), FPGA (Field-Programmable Gate Array), or other device.

Memory 220 temporarily stores programs and data. The program is loaded from storage 230, for example. The data includes data entered into smartphone 160 and data generated by processor 210 . In one aspect, memory 220 is implemented as random access memory (RAM) or other volatile memory.

Storage 230 permanently holds programs and data. The storage 230 is implemented as, for example, a ROM (Read-Only Memory), hard disk device, flash memory, or other non-volatile storage device. The programs stored in storage 230 may include an application program, a simulation program, and a user authentication program for allowing users to view moving images. The data stored in storage 230 includes data and objects for each program. In another aspect, storage 230 may be implemented as a removable storage device such as a memory card. In yet another aspect, instead of storage 230 built into smart phone 160, a configuration using programs and data stored in an external storage device may be used. In the case of such a configuration, the smartphone 160 communicates via the network 2 or by short-range wireless communication such as WiFi (registered trademark) (Wireless Fidelity), Bluetooth (registered trademark), and NFC (Near Field Communication). Programs and data stored on the external storage device may be used.

A touch screen 240 is an electronic component that includes a touch panel 241 and a display 242 . The touch panel 241 detects the position at which a user operation (mainly physical contact operation such as touch operation, slide operation, swipe operation, and tap operation) is input on the input surface, and outputs information indicating the position as an input signal. It has a function to send as The touch panel 241 may include a touch sensing section (not shown). The touch sensing unit may employ any type of system, such as a capacitive system or a resistive film system. The display 242 is configured by, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display.

The communication interface 250 is connected to the network 2 and communicates with other computers connected to the network 2 (for example, the server 170). In one aspect, the communication interface 250 is implemented as a wired communication interface such as a LAN (Local Area Network), or a wireless communication interface such as WiFi, Bluetooth, NFC, or the like. Communication interface 250 is not limited to the one described above.

In one aspect, processor 210 accesses storage 230, loads one or more programs stored in storage 230 into memory 220, and executes the sequences of instructions contained in the programs. The one or more programs may include an operating system of computer 200, an application program for allowing a user to view moving images, and the like. Processor 210 displays moving images received via network 2, server 170, and communication interface 250 on touch screen 240 (display 242).

[Movie shooting system 110A]
Returning to FIG. 1, the details of the video shooting system 110A will be described. The movie shooting system 110A is a system for shooting a movie (video) of the subject 150 . Movie shooting system 110A according to the present embodiment shoots an omnidirectional video in which each frame is an omnidirectional image. The video shooting system 110A includes, as an example, an omnidirectional camera 120, an omnidirectional video generation device 130, and a display device 140. In the present embodiment, moving image capturing systems 110B, 110C, and 110D will be described as including omnidirectional camera 120, omnidirectional image generating device 130, and display device 140, like moving image capturing system 110A. . Hereinafter, the moving image capturing systems 110A, 110B, 110C, and 110D are also collectively referred to as the moving image capturing system 110. FIG. The number of moving picture shooting systems 110 constituting the moving picture distribution system 100 is not limited to four, and may be three or less or five or more.

(omnidirectional camera 120)
The omnidirectional camera 120 has a plurality of image capturing units and captures an image of the subject 150 . As an example, omnidirectional camera 120 includes two imaging units. Specifically, the omnidirectional camera 120 includes a first imaging section 121 and a second imaging section 122 .

The first image pickup unit 121 and the second image pickup unit 122 are configured to pick up moving images. It is configured. Henceforth, the moving image which the 1st imaging part 121 and the 2nd imaging part 122 image may be called a "photographed image."

FIG. 3 is a diagram for explaining the field of view of omnidirectional camera 120 according to an embodiment. As an example, the first imaging unit 121 and the second imaging unit 122 are arranged in the omnidirectional camera 120 so as to capture images in opposite directions. The first imaging unit 121 has, as an example, a field of view 311 shown in FIG. Further, the second imaging unit 122 has, as an example, a field of view 312 shown in FIG. The field of view 311 and the field of view 312 can also be expressed as imaging regions of the first imaging unit 121 and the second imaging unit 122, respectively.

Since FIG. 3 is a top view of the omnidirectional camera 120, the field of view 311 and the field of view 312 are shown as a circle (fan shape) with a part missing. However, the first imaging section 121 and the second imaging section 122 also have a field of view in the vertical direction (the direction perpendicular to the paper surface). That is, the field of view 311 and the field of view 312 are actually spherical with a part missing. Therefore, the fields of view of the omnidirectional camera 120 are two fields of view of a sphere that are in opposite directions and are partly missing. As a result, the omnidirectional camera 120 can capture an area all around the omnidirectional camera 120 (360 degrees).

FIG. 4 is a block diagram showing an example of the hardware configuration of omnidirectional camera 120 according to an embodiment. As shown in FIG. 4, the omnidirectional camera 120 includes, as main components, a processor 411, a memory 412, a storage 413, a first imaging unit 121, a second imaging unit 122, and an input/output interface 414. , and a communication interface 415 . Each component is respectively connected to bus 416 .

Processor 411 executes a series of instructions contained in a program stored in memory 412 or storage 413 based on a signal given to omnidirectional camera 120 or based on the establishment of a predetermined condition. Run. In one aspect, processor 411 is implemented as a CPU, GPU, MPU, FPGA, or other device.

Memory 412 temporarily stores programs and data. The program is loaded from storage 413, for example. The data includes data input to omnidirectional camera 120 and data generated by processor 411 . In one aspect, memory 412 is implemented as RAM or other volatile memory.

Storage 413 permanently holds programs and data. The storage 413 is implemented as, for example, a ROM, hard disk device, flash memory, or other non-volatile storage device. The programs stored in the storage 413 may include a program for capturing an image, a program for communicating with other devices, and the like. The data stored in the storage 413 may include captured video (captured video data).

In another aspect, storage 413 may be implemented as a removable storage device such as a memory card. In still another aspect, instead of storage 413 built into omnidirectional camera 120, a configuration using programs and data stored in an external storage device may be used. In the case of such a configuration, the omnidirectional camera 120 can access programs and data stored in the external storage device through communication via the network 2 or short-range wireless communication such as WiFi, Bluetooth, and NFC. may be used.

The first image capturing unit 121 and the second image capturing unit 122 capture captured images as described above. Input/output interface 414 communicates signals with input/output devices. In one aspect, the input/output interface 414 is implemented using USB, DVI, HDMI (registered trademark) or other terminals. The input/output interface 414 is not limited to those described above. Communication interface 1775 is connected to network 2 and communicates with devices connected to network 2 . In one aspect, the communication interface 415 is implemented as, for example, a wired communication interface such as LAN, or a wireless communication interface such as WiFi, Bluetooth, NFC. Communication interface 415 is not limited to those described above. Note that the processor 411 uses the communication interface 415 to transmit the captured image to the omnidirectional image generation device 130 in real time.

(Spherical image generation device 130)
The omnidirectional image generation device 130 uses the captured image acquired from the omnidirectional camera 120 to generate an omnidirectional image. In one aspect, omnidirectional video generation device 130 acquires captured video from omnidirectional camera 120 via network 2 .

The omnidirectional video generation device 130 acquires the captured video captured by the first imaging unit 121 of the omnidirectional camera 120 and the captured video captured by the second imaging unit 122 . As shown in FIG. 3, the field of view 131 of the first imaging section 121 and the field of view 132 of the second imaging section 122 partially overlap each other. Therefore, the captured image captured by the first imaging unit 121 of the omnidirectional camera 120 and the captured image captured by the second imaging unit 122 partially overlap each other. The omnidirectional image generation device 130 distorts the corresponding two frames included in these two captured images, and stitches the two distorted frames. "Two corresponding frames" are two frames that have the same photographing time. The omnidirectional image generation device 130 generates an omnidirectional image by performing stitching processing on all two corresponding frames. The omnidirectional video generation device 130 transmits the generated omnidirectional video to the server 170 via the network 2 .

The omnidirectional camera 120 may have a function of generating an omnidirectional video and transmitting it to the server 170 . In this example, the video shooting system 110 may not include the omnidirectional video generation device 130 .

(Display device 140)
The display device 140 acquires the omnidirectional video generated by the omnidirectional video generating device 130 via the network 2 and the server 170 and displays it. As a result, the subject 150 can take an image while confirming the omnidirectional video imaged by the subject 150 . As an example, display device 140 may store the same application program as the application program stored in storage 230 of smartphone 160 for allowing the user to view moving images (omnidirectional video). In other words, display device 140 may display an omnidirectional image using the application program.

[Server 170]
Server 170 distributes the omnidirectional video received from each of video shooting systems 110 to smartphone 160 . In one aspect, when server 170 receives a first instruction based on a user's input to smartphone 160 , server 170 transmits to smartphone 160 the omnidirectional video indicated by the first instruction. That is, the first instruction is an instruction to transmit a specific omnidirectional video.

[Shooting a subject]
FIG. 5 is a diagram showing an example of photographing of subject 150 using moving image photographing system 110A. In this embodiment, an example in which subject 150 is a woman will be described. As in this example, when the subject 150 is a human being, the subject 150 can also be expressed as a video distributor.

As an example, the subject 150 speaks to the viewer (the user of the smart phone 160), acts, performs, sings, plays a game, or performs daily activities during shooting. In other words, the viewer views these motions and behaviors of the subject 150 as an example by viewing the omnidirectional video. Note that the motions and behaviors of the subject 150 during shooting are not limited to this example.

Spherical camera 120 photographs subject 150 from a first position. In the example of FIG. 5 , the subject 150 is positioned in front of the field of view of the first imaging unit 121 and faces the omnidirectional camera 120 . In other words, in the example of FIG. 5, the subject 150 is captured by the first imaging section 121 . Note that the first imaging unit 121 is not shown in FIG. 5 because it is hidden by the display device 140 .

As an example, as shown in FIG. 5, the display device 140 is arranged above the omnidirectional camera 120 so that the display area faces the subject 150 side. As a result, the subject 150 can check the omnidirectional video captured by the subject 150 while looking at the imaging unit of the omnidirectional camera 120 (the first imaging unit 121 in the example of FIG. 5). In other words, the subject 150 can confirm the omnidirectional video captured by the subject 150 while maintaining the line of sight of the camera.

As an example, an application program for allowing a user to view an omnidirectional video may have a function of inputting comments, etc. while the viewer views the omnidirectional video, and a function of displaying the comments, etc. good. As a result, the subject 150 can visually recognize the comment input by the viewer viewing the omnidirectional video captured by the subject 150, and can respond to the comment. Note that the application program may have a function of displaying the execution of processing based on the viewer's input as a notification. As an example, the function may display a notification indicating that a process for billing the viewer has been performed and the gift object has been presented to the subject 150 .

[Hardware Configuration of Server 170]
Server 170 according to the present embodiment will be described in more detail with reference to FIG. FIG. 6 is a block diagram showing an example hardware configuration of server 170 according to an embodiment. The server 170 includes a processor 611, a memory 612, a storage 613, an input/output interface 614, and a communication interface 615 as main components. Each component is respectively connected to bus 616 .

Processor 611 executes a series of instructions contained in a program stored in memory 612 or storage 613 based on a signal given to server 170 or based on the establishment of a predetermined condition. In one aspect, processor 611 is implemented as a CPU, GPU, MPU, FPGA, or other device.

Memory 612 temporarily stores programs and data. The program is loaded from storage 613, for example. Data includes data input to server 170 and data generated by processor 611 . In one aspect, memory 612 is implemented as RAM or other volatile memory.

Storage 613 permanently holds programs and data. The storage 613 is implemented as, for example, a ROM, hard disk device, flash memory, or other non-volatile storage device.

In another aspect, storage 613 may be implemented as a removable storage device such as a memory card. In still another aspect, instead of the storage 613 built into the server 170, a configuration using programs and data stored in an external storage device may be used. In such a configuration, the server 170 can access programs and data stored in the external storage device by communication via the network 2 or short-range wireless communication such as WiFi, Bluetooth (registered trademark), and NFC. may be used.

Input/output interface 614 communicates signals with input/output devices. In one aspect, the input/output interface 614 is implemented using USB, DVI, HDMI (registered trademark), or other terminals. Input/output interface 614 is not limited to those described above.

Communication interface 615 is connected to network 2 and communicates with omnidirectional video generation device 130 , display device 140 , and smart phone 160 connected to network 2 . In one aspect, communication interface 615 is implemented as, for example, a LAN or other wired communication interface, or a WiFi, Bluetooth, NFC or other wireless communication interface. Communication interface 615 is not limited to those described above.

In one aspect, processor 611 accesses storage 613, loads into memory 612 one or more programs stored in storage 613, and executes the sequences of instructions contained in the programs. The one or more programs may include an operating system of server 170, an application program for delivering omnidirectional video to smartphone 160 and display device 140, and the like. Processor 611 may distribute the omnidirectional video to smartphone 160 and display device 140 via communication interface 615 or input/output interface 614 .

Here, although not shown, the details of the module configuration of the server 170 will be described. Server 170 includes a control module, a memory module, and a communication control module. In one aspect, the control module is implemented by processor 611 . A memory module is implemented by memory 612 or storage 613 . A communication control module is realized by the communication interface 615 .

Upon receiving the first instruction from smartphone 160 , the control module transmits the omnidirectional video to smartphone 160 . As an example, the control module performs live streaming of omnidirectional video (live streaming). Live streaming is a type of streaming that downloads data and plays it back at the same time. It distributes video and audio in real time, converts (encodes) the data in real time, and plays it back as it is. That is, the control module streams the omnidirectional video received from the omnidirectional video generating device 130 in real time. In other words, the omnidirectional video can also be expressed as a live streaming video.

That is, in the video distribution system 100, (1) transmission of captured video from the omnidirectional camera 120 to the omnidirectional video generation device 130, (2) generation of omnidirectional video by the omnidirectional video generation device 130, and , transmission of the omnidirectional video to the server 170, and (3) transmission of the omnidirectional video from the server 170 to the smartphone 160 that has transmitted the first instruction are performed in real time. Thereby, the viewer can view the omnidirectional video of the subject 150 currently being shot. Note that the first instruction may be transmitted from the display device 140 .

[Module Configuration of Smartphone 160]
The module configuration of smartphone 160 will be described with reference to FIGS. 7 and 8. FIG. FIG. 7 is a block diagram representing a modular configuration of smartphone 160 according to one embodiment. FIG. 8 is a block diagram showing a detailed configuration of modules of smartphone 160 according to an embodiment.

As shown in FIG. 7 , smart phone 160 includes control module 710 , memory module 720 , and communication control module 730 . In one aspect, control module 710 is implemented by processor 210 . In another aspect, multiple processors 210 may act as control modules 710 . Memory module 720 is implemented by memory 220 or storage 230 . Communication control module 730 is implemented by communication interface 250 .

As shown in FIG. 8 , the control module 710 includes a video control module 811 , an operation determination module 812 , a video switching module 813 and a UI control module 814 .

The video control module 811 controls the omnidirectional video viewed by the user. The video control module 811, for example, transmits a first instruction to the server 170 based on an operation input by the user to the touch screen 240, and reproduces the omnidirectional video indicated by the first instruction. Here, "reproducing an omnidirectional image" refers to receiving an omnidirectional image and displaying it on the touch screen 240 (display 242).

Playback of omnidirectional video will be described with reference to FIG. FIG. 9 is a diagram showing an omnidirectional image according to an embodiment and an example of display of the omnidirectional image on smartphone 160 .

As described above, omnidirectional camera 120 captures an area all around omnidirectional camera 120 (360 degrees). Therefore, the omnidirectional video can be expressed as a sphere. In other words, it can be expressed that the omnidirectional image is attached to the outer edge of the sphere. In the example of FIG. 9A, the upper half (hemisphere) of the omnidirectional image 910 is illustrated in order not to complicate the explanation.

On the other hand, it is preferable that the smartphone 16 displays a partial area of the omnidirectional image on the display 242 in consideration of the interest of the moving image, the ease of visual recognition of the moving image by the user, and the like. In other words, in the present embodiment, reproducing an omnidirectional image means displaying a partial area of the omnidirectional image on display 242 . Hereinafter, the partial area will be referred to as a "display area".

Setting of the display area will be described. A center 911 of the omnidirectional image 910 corresponds to the position of the omnidirectional camera 120 at the shooting site. As an example, the video control module 811 sets the center 911 as a reference point 912 for determining the display area. As an example, the video control module 811 determines, based on the reference line 913 extending from the reference point 912 in the direction toward the outer edge of the sphere (hemisphere) and the size of the display 242 of the smartphone 16, the display 242 at the start of playback of the omnidirectional video 910. Set the display area 914 . Specifically, the video control module 811 sets a display area 914 having substantially the same size as the display 242 and centering on the point where the reference line 913 intersects the omnidirectional image 910 (that is, the outer edge of the sphere).

The direction in which the reference line 913 extends (the reference direction of the omnidirectional image) corresponds, for example, to the direction from the omnidirectional camera 120 toward the subject 150 at the shooting site. The direction in which the reference line 913 extends can also be expressed as the front direction of the omnidirectional video. The video control module 811 displays the set display area 914 on the display 242 as shown in FIG. 9B. As a result, an image including the object 150 is displayed on the display 242 at the time the playback of the omnidirectional image is started.

Also, the video control module 811 changes the display area based on an operation input by the user to the touch screen 240, for example. As an example, the video control module 811 identifies a straight line extending in a direction different from the reference line 913 according to the operation. Then, a display area having substantially the same size as the display 242 centered on the point where the straight line intersects the omnidirectional image 910 is specified, and the display area is displayed on the display 242 . In other words, this process can be said to be a process of moving the position of the intersection of the straight line extending from the reference point and the omnidirectional image 910 based on the operation input to the touch screen 240 by the user. Alternatively, this process can also be said to be a process of moving the display area 914 based on an operation input to the touch screen 240 by the user.

The operation determination module 812 receives a user's input operation based on the output of the touch screen 240 (touch panel 241). Specifically, the operation determination module 812 detects that a user's finger or the like has approached the touch screen 240 as coordinates of a coordinate system consisting of a horizontal axis and a vertical axis of the surface forming the touch screen 240 . For example, the operation determination module 812 receives an input operation on the touch panel 241, detects the coordinates of the input position of the input operation, and identifies the type of the input operation. The operation determination module 812 identifies, for example, a touch operation, a slide operation, a swipe operation, a tap operation, and the like, as types of input operations. Further, when the continuously detected input is interrupted, the operation determination module 812 detects that the contact input from the touch screen 240 has been released.

An operation determination module 812 determines a user's operation on the touch screen 240 . The operation determination module 812 performs, for example, (1) “approach operation”, (2) “release operation”, (3) “tap operation”, (4) “double tap operation”, (5) “long press operation (long press operation)”. touch operation)”, (6) “drag operation (swipe operation)”, (7) “move operation”, (8) “flick operation”, and other user operations are discriminated. User operations determined by the operation determination module 812 are not limited to the above. For example, if the touch screen 240 has a mechanism capable of detecting the amount of pressure applied by the user to the touch screen 240, the operation determination module 812 determines the amount of pressure applied by the user.

(1) An “approach operation” is an operation by which the user brings a finger or the like closer to the touch screen 240 . The touch screen 240 detects that the user's finger or the like approaches (including that the user's finger or the like touches the touch screen 240), and controls a signal corresponding to the detected coordinates of the touch screen 240. Output to module 710 . The control module 710 determines that the touch screen 240 is in the “touch-on state” when the approach is detected from the state in which the approach of the user's finger or the like to the touch screen 240 is not detected.

(2) “Release operation” is an operation for stopping the state in which the user is operating the touch screen 240 to approach it. The operation determination module 812 determines that the user's operation is a “release operation” when, for example, the user touches the touch screen 240 with a finger or the like and then removes the finger from the touch screen 240 . The control module 710 determines that the state has changed from the "touch-on state" to the "touch-off state" when the state of detecting the approach of the user's finger or the like to the touch screen 240 changes to the state of not detecting the approach. do.

(3) “Tap operation” means that after the user performs an approach operation of approaching the touch screen 240 with a finger or the like, a release operation is performed at the position where the approach operation was performed. The operation determination module 812 changes the output of the touch screen 240 from a state in which an approach operation is not detected (a state in which the user's finger or the like is away from the touch screen 240 and the touch screen 240 does not detect the approach of the user's finger or the like). , the detected coordinates are held as the "initial touch position". When the coordinates of the initial touch position and the coordinates of the release operation are substantially the same (when the coordinates of the release operation are detected within a certain range from the coordinates at which the approach operation is detected), the operation determination module 812 First, the user's operation is determined as a "tap operation".

(4) A “double-tap operation” is an operation in which a user performs a tap operation twice within a certain period of time. For example, the operation determination module 812 determines that the user's operation is a "double-tap operation" when the tap operation is determined again at the coordinates of the tap operation within a certain period of time after determining that the user's operation is a tap operation. do.

(5) A “long press operation” is an operation in which the user keeps pressing the touch screen 240 . The touch screen 240 detects the user's operation and determines the approach operation, and if the time at which the approach operation continues at the coordinates at which the approach operation is detected exceeds a certain period of time, the touch screen 240 detects the user's operation as " long press operation" ("long press operation" may be referred to as "long touch operation").

(6) A “drag operation” is an operation in which the user slides a finger or the like while maintaining a close state in which the finger or the like is brought close to the touch screen 240 .

(7) “Move operation” refers to a series of operations in which the user performs a release operation by moving the position where the finger or the like is approaching the touch screen 240 while maintaining the approach operation on the touch screen 240 .

(8) "Flick operation" refers to an operation in which the user performs a move operation in a time shorter than a predetermined time. A flick operation is an operation such that the user flicks a finger on the touch screen 240 .

The operation determination module 812 performs a first movement operation (first operation), a second It is determined whether it is a move operation (second operation) or a third move operation (third operation). The move operation corresponds to, for example, the drag operation and the flick operation among the various operations described above, but is not limited to these. Details of the first move operation, the second move operation, and the third move operation will be described later.

The video switching module 813 changes the omnidirectional video to be reproduced, that is, the omnidirectional video displayed on the display 242 based on the user's input operation on the touch screen 240 . Specifically, when the first omnidirectional video is being reproduced, the video switching module 813 stops the reproduction of the first omnidirectional video based on the operation input by the user to the touch screen 240. Then, a second omnidirectional image different from the first omnidirectional image is reproduced.

The UI control module 814 controls a user interface (hereinafter referred to as “UI”) displayed on the display 242 superimposed on the omnidirectional video. The UI control module 814 hides the UI, for example, based on an operation input to the touch screen 240 by the user.

[Processing flow]
FIG. 10 is a sequence diagram showing a part of the processing executed in smartphone 160 and the processing executed in server 170 according to an embodiment. In this embodiment, a series of processes on the viewer side will be described as being executed by smartphone 160A. However, the processing may be executed by other smartphones 160B, 160C, and 160D, or part or all of the processing may be executed by the server 170.

In step S<b>1011 , the processor 611 of the server 170 receives the omnidirectional image from the omnidirectional image generation device 130 . Specifically, the processor 611 receives omnidirectional images from each of the omnidirectional image generation devices 130 included in the moving image capturing system 110 that is currently capturing images. In other words, when multiple moving image capturing systems 110 are simultaneously capturing images, processor 611 receives multiple omnidirectional images.

In step S1001, touch panel 241 of smartphone 160A accepts a playback operation for the first omnidirectional video. The operation may be, for example, a tap operation on a UI showing the first omnidirectional video on the touch screen 240 displaying multiple UIs showing each of the omnidirectional videos viewable by the user. The screen may be displayed, for example, immediately after starting an application (hereinafter simply referred to as "application") for allowing the user to view moving images. Also, the plurality of UIs may be thumbnail images of each of the plurality of viewable omnidirectional videos. In step S1002, processor 210 of smartphone 160A transmits to server 170 an instruction to reproduce the first omnidirectional video based on the operation to reproduce the first omnidirectional video.

In step S1012, processor 611 transmits the first omnidirectional video to smartphone 160A in response to receiving the instruction to reproduce the first omnidirectional video.

At step S1003, the processor 210, as the video control module 811, reproduces the received first omnidirectional video.

Although not shown in FIG. 10 , the processor 210 functions as the operation determination module 812 to determine whether the movement operation is the first movement operation, the second movement operation, or the third movement operation when the movement operation is input to the touch panel 241 . to determine which is which. Details of this process will be described later with reference to FIG. FIG. 11 is a flowchart showing movement operation determination processing executed in smartphone 160 according to an embodiment.

FIG. 12 is a diagram showing a display example of omnidirectional video on smartphone 160A, according to an embodiment. As an example, the processor 210 displays a display area 1214A, which is part of the omnidirectional image 910, and UIs 1221A, 1221B, and 1221C on the display 242, as shown in FIG. 12(A). Hereinafter, the UIs 1221A, 1221B, and 1221C will be collectively referred to as the UI 1221 as well. It is also assumed that a display area 1214A shown in FIG. 12A is a display area corresponding to the reference line 913, that is, the front of the omnidirectional image.

In step S1004, touch panel 241 accepts a first movement operation. Step S1004 corresponds to a case where the processor 210 determines that the movement operation is the first movement operation. As an example, as shown in FIG. 12A, the first movement operation is performed by bringing a finger 1230 into contact with the touch screen 240, waiting for a predetermined threshold (hereinafter simply referred to as “threshold”) seconds or longer, and moving the finger. This is an operation to move 1230 . In other words, the first movement operation can also be expressed as a movement operation in which the standby time, which is the time during which the finger 1230 is not moved while keeping the contact after touching the touch screen 240, is equal to or greater than the threshold seconds. . The first movement operation can also be expressed as a movement operation including an initial operation of not moving the finger 1230 for more than a threshold number of seconds while keeping the contact after touching the touch screen 240 with the finger 1230 . In the example of FIG. 12A, the finger 1230 is moved in the first direction 1240 by the first movement operation. The first direction 1240 is the right direction in FIG. 12(A).

A specific value (number of seconds) of the “predetermined threshold seconds” is appropriately set according to the performance (response) of the touch panel 241 . As an example, the value can be set to a suitable value within the range of 0.01 seconds to 0.1 seconds.

Note that the first movement operation is specifically assumed to be a drag operation performed after waiting for a threshold number of seconds, but is not limited to a drag operation as long as the movement operation satisfies the above conditions. For example, the first movement operation may be a flick operation that satisfies the above conditions.

In step S1005, the processor 210, as the video control module 811, changes the display area based on the first movement operation. Specifically, processor 210 moves the display area within the first omnidirectional video according to the moving direction and moving distance of the first moving operation. In the example of FIG. 12A, since the finger 1230 is moved rightward, the processor 210 moves the display area rightward by a distance corresponding to the moving distance of the finger 1230, for example. In other words, it can be said that the processing of changing the display area of the omnidirectional image based on the first movement operation is processing according to the movement direction and the movement distance of the first movement operation. As a result, display area 1214A is changed to display area 1214B, and as shown in FIG. 12B, display 242 displays the right side of object 150, which was not visible to the viewer before the first movement operation. be done. Note that the right side of the subject 150 is the right side of the subject 150 viewed from the user (viewer).

In this way, smartphone 160A according to the present embodiment can change the area displayed on touch screen 240 in omnidirectional video by the first movement operation. The user of smartphone 160A can visually recognize an area that was not displayed on touch screen 240 at the start of playback of the omnidirectional video by executing the first movement operation.

FIG. 13 is a diagram showing a display example of omnidirectional video on smartphone 160A, according to an embodiment. In step S1006, touch panel 241 accepts a second movement operation. Step S1006 corresponds to a case where the processor 210 determines that the movement operation is the second movement operation. The second moving operation is, for example, an operation of touching the touch screen 240 with the finger 1230 and moving the finger 1230 before the threshold seconds elapse, as shown in FIG. 13(A). In other words, the second moving operation can also be expressed as a moving operation for which the standby time described above is less than the threshold seconds. Also, the second movement operation can be expressed as a movement operation that does not include the initial operation described above. In the example of FIG. 13A, finger 1230 is moved in first direction 1240 . The first direction 1240 is the right direction in FIG. 13(A). In the present embodiment, the condition for determining the second movement operation includes "the operation is to move the pointer such as the finger 1230 in the horizontal direction in FIG. 13A". In other words, the second movement operation is an operation of moving the indicator in the left-right direction with a wait time of less than the threshold seconds.

Note that the second movement operation is specifically assumed to be a flick operation in the left and right direction (normal flick operation in the left and right direction) performed without waiting for the threshold seconds. As long as it is a movement operation, it is not limited to a flick operation. For example, the second move operation may be a drag operation that satisfies the above conditions.

Processor 210, as moving image switching module 813, switches the first omnidirectional image to the second omnidirectional image based on the second movement operation. Specifically, processor 210 transmits an instruction to reproduce the second omnidirectional video to server 170 in step S1007. In step S1013, the processor 611 stops transmission of the first omnidirectional video and transmits the second omnidirectional video to the smartphone 160A upon receiving the reproduction instruction for the second omnidirectional video.

In step S1008, the processor 210, as the video control module 811, reproduces the received second omnidirectional video. Specifically, as shown in FIG. 13B, a display area 1314 that is part of the second omnidirectional image is displayed on the display 242 . The second omnidirectional image is an omnidirectional image different from the first omnidirectional image, and includes, for example, a subject 1350 different from the subject 150 .

In this way, smartphone 160A according to the present embodiment can change the first omnidirectional image to a second omnidirectional image different from the first omnidirectional image by the second movement operation. The user of smartphone 160A can zap a plurality of omnidirectional images through the second movement operation.

It can be said that the process of switching the omnidirectional video based on the second movement operation is a process according to the movement direction of the second movement operation. As an example, if the direction of the second movement operation is the first direction 1240, that is, the right direction in FIG. Switch to video. On the other hand, if the direction of the second movement operation is different from the first direction 1240, that is, the left direction in FIG. Switch to a different third omnidirectional image.

FIG. 14 is a diagram showing a display example of omnidirectional video on smartphone 160A, according to an embodiment. In step S1009, touch panel 241 receives a third movement operation. Step S1009 corresponds to a case where the processor 210 determines that the movement operation is the third movement operation. The third movement operation is, for example, an operation of touching the touch screen 240 with the finger 1230 and moving the finger 1230 before the threshold seconds elapse, as shown in FIG. In other words, the third movement operation can also be expressed as a movement operation for which the waiting time described above is less than the threshold seconds. Also, the third movement operation can be expressed as a movement operation that does not include the initial operation described above. In the example of FIG. 14A, finger 1230 is moved in second direction 1440 . The second direction 1440 is the upward direction in FIG. 14(A). In the present embodiment, the condition for determining the third movement operation includes "the operation is to move the pointer such as the finger 1230 upward in FIG. 14A". In other words, the third movement operation is an operation of moving the indicator upward with a wait time of less than the threshold seconds.

Note that the third movement operation is specifically assumed to be a vertical flick operation (a normal vertical flick operation) that is performed without waiting for the threshold seconds. As long as it is a movement operation, it is not limited to a flick operation. For example, the third move operation may be a drag operation that satisfies the above conditions.
In step S1010, the processor 210, as the UI control module 814, erases the UI 1221 from the screen based on the third movement operation. Specifically, as shown in FIG. 14B, on the display 242, the UI 1221 is hidden and only the display area 1214A is displayed.

An application that allows a user to browse moving images preferably uses a UI in order to improve the operability of the application. On the other hand, when the UI is displayed on the display, the UI reduces the visibility of the moving image. On the other hand, smartphone 160A according to the present embodiment can hide UI 1221 by the third movement operation, thereby preventing deterioration in visibility of omnidirectional video due to the UI. In other words, the smartphone 160A can prevent the occurrence of an invisible part in the omnidirectional video by superimposing the UI 1221 on the omnidirectional video.

Note that it is desirable that the UI 1221 that has become hidden can be redisplayed based on the user's operation. As an example, the processor 210, as the UI control module 814, redisplays the hidden UI 1221 based on a fourth move operation different from the first move operation, the second move operation, and the third move operation. The fourth movement operation may be, for example, an operation of moving the indicator downward with a wait time of less than threshold seconds. In other words, the fourth movement operation may be a movement operation in the opposite direction to the third movement operation with a wait time of less than the threshold seconds.

(Moving operation determination processing)
Details of the movement operation determination process will be described with reference to FIG. 11 . As a premise of the flow shown in FIG. 11, the touch panel 241 accepts a movement operation. In other words, touch panel 241 detects movement of the position touched by finger 1230 (change in position coordinates). It is also assumed that the display 242 displays an omnidirectional image and the UI 1221 . In step S1101, the processor 210, as the operation determination module 812, determines whether or not the waiting time for the move operation is equal to or greater than a first time, ie, threshold seconds.

If it is determined that the standby time is longer than or equal to the first hour (YES in step S1101), in step S1102 processor 210, as operation determination module 812, determines that the movement operation received by touch panel 241 is the first movement operation.

On the other hand, if it is determined that the standby time is less than the first time (NO in step S1101), in step S1103, the processor 210, as the operation determination module 812, determines whether the movement direction of the movement operation is the first direction, or It is determined whether it is the second direction. As an example, the processor 210 determines whether the direction of movement is left or right or upward.

If it is determined that the movement direction is the first direction, for example, the left or right direction (A in step S1103), processor 210, as operation determination module 812, determines that the movement operation received by touch panel 241 is the first direction in step S1104. 2 Determined as a move operation. On the other hand, if it is determined that the movement direction is the second direction, for example, the upward direction (B of step S1103), in step S1105, the processor 210 operates as the operation determination module 812 to move the movement operation received by the touch panel 241 to the third direction. Determined as a move operation.

When determining that the movement direction is neither the first direction nor the second direction, for example, when determining that the movement operation is downward while the UI 1221 is displayed, the processor 210 controls the touch panel 241. determines that the received move operation is an invalid move operation, and does not execute any processing.

[Effect]
As described above, the processor 210 of the smartphone 160 executes the process of changing the display area according to the first movement operation, which is the movement operation including the initial operation. In addition, omnidirectional video switching processing is executed in response to a second movement operation that is a movement operation that does not include an initial operation. In this way, by associating different processes with the movement operation depending on whether or not there is an initial operation, smartphone 160 can be caused to execute two different processes with a simple movement operation. As a result, the operability of operations related to video viewing is improved.

In an omnidirectional video displayed on a smartphone or the like, it is common to change the display area by a movement operation. On the other hand, switching between videos to be viewed is also realized by a movement operation. Therefore, when a plurality of omnidirectional images can be browsed, the operation for changing the display area and the operation for switching the omnidirectional images overlap as movement operations. It is conceivable that the operation for one process is different from the move operation, but since both processes are generally performed by the move operation, such a change may confuse the user.

Therefore, as described above, smartphone 160 according to the present embodiment determines that two moving operations are different operations depending on the presence or absence of the initial operation in the moving operations. Then, display area change processing is executed by a movement operation including the initial operation, and omnidirectional video switching processing is executed by a movement operation that does not include the initial operation. As a result, both the processing for changing the display area and the processing for switching moving images can be performed by moving operations. Therefore, the user can cause the smartphone 160 to execute any process by inputting an intuitive (familiar) operation.

In addition, the user can cause smartphone 160 to execute display area change processing and omnidirectional video switching processing while the omnidirectional video is being reproduced. Therefore, it is possible to realize an application with good operability for operations related to video browsing.

In addition, the processor 210 of the smartphone 160 determines that the movement operation in the first direction is the second movement operation, and that the movement operation in the second direction is the third movement operation, among the movement operations that do not include the initial operation. Then, the processor 210 hides the UI 1221 based on the third movement operation. In this way, by associating different processes with the movement operation depending on the presence or absence of the initial operation and the direction, smartphone 160 can be caused to execute various processes with a simple movement operation. As a result, the operability of operations related to video viewing is further improved.

[Modification]
The processor 210, as the video control module 811, may automatically start receiving the first omnidirectional video immediately after starting the application and reproduce the first omnidirectional video. In other words, processor 210 may automatically select and play one of the plurality of viewable spherical images. In this case, the operation for reproducing the first omnidirectional video corresponds to the operation for activating the application.

The process executed by the processor 210 based on the third move operation is not limited to erasing the UI. For example, the processor 210 may display a plurality of UIs (thumbnail images) respectively representing a plurality of omnidirectional videos viewable by the user, based on the third movement operation. As an example, processor 210 may reproduce an omnidirectional video indicated by the UI that has received the tap operation when a tap operation to any one of the plurality of UIs is received. That is, in this example, the user can stop playing the first omnidirectional video and play another omnidirectional video by inputting the third movement operation to smartphone 160A. This example is particularly effective when the second movement operation is required a plurality of times in order to view the omnidirectional video that the user wants to view.

The moving operation determination process is not limited to the example of FIG. 11 . As an example, the processor 210 may determine whether or not the finger 1230 moved on the touch screen 240 in place of the process of step S1101 before the first time, that is, the threshold seconds passed. good. In other words, the processor 210 determines the movement operation by determining whether the finger 1230 has moved before the predetermined time elapses, not whether the waiting time is equal to or greater than the predetermined threshold. good too.

In this example, when determining that the movement has not occurred by the time the first time elapses, the processor 210 determines that the movement operation received by the touch panel 241 is the first movement operation. On the other hand, if it is determined that the movement has occurred before the first time elapses, the processor 210 performs determination processing in step S1103 to determine whether the movement operation is the second movement operation or the third movement operation. to run.

If the second movement operation is received while the UI 1221 is hidden by the third movement operation, the processor 210 may display the UI 1221 while reproducing another omnidirectional video. Alternatively, processor 210 may play another omnidirectional video and keep UI 1221 hidden.

When the omnidirectional image being reproduced is switched to another omnidirectional image by the second movement operation, the omnidirectional image after switching may not be reproduced until a predetermined user operation is received.

The videos viewed by the user are not limited to omnidirectional videos. For example, the moving image viewed by the user may be a two-dimensional image, in other words, an image whose entirety is displayed on the display 242 . In this case, since the display area changing process does not occur, the first moving operation may be associated with a process different from the display area changing process. As an example, processor 210 may display a plurality of UIs (thumbnail images) respectively indicating a plurality of omnidirectional videos viewable by the user when determining the first movement operation.

As an example, the smartphone 160 may execute the omnidirectional video switching process by the first movement operation, and execute the display area change process by the second movement operation. In another example, the UI 1221 may be hidden by the second movement operation, and the omnidirectional video switching process may be executed by the third movement operation.

The terminal device used by the user to view the moving image may be a terminal device equipped with a touch panel, and is not limited to the smartphone 160 . For example, the terminal device used by the user to browse moving images may be a tablet terminal, a game machine (game terminal) equipped with a touch panel, or the like.

Although the embodiments of the present disclosure have been described above, the technical scope of the present invention should not be construed to be limited by the description of the embodiments. It should be understood by those skilled in the art that this embodiment is merely an example, and that various modifications of the embodiment are possible within the scope of the invention described in the claims. The technical scope of the present invention should be determined based on the scope of the invention described in the claims and their equivalents.

[Additional notes]
The contents of one aspect of the present invention are listed below.

(Item 1) Explained the program. According to one aspect of the disclosure, the program is executed by a computer (smartphone 160) with a processor (210), memory (220), and touch screen (240). The program causes the processor to perform a step (S1003) of causing the user to browse the image (omnidirectional image 910), and when a first operation, which is a movement operation including an initial operation, is performed on the touch screen, A step of executing a first process (S1005); and, when a second operation, which is a movement operation that does not include an initial operation, is performed on the touch screen, a second process related to the image, which is different from the first process, is executed. Step (S1008) and are executed.

(Item 2) In the viewing step of (Item 1), for a first omnidirectional image among a plurality of omnidirectional images that can be viewed, a partial area of the first omnidirectional image is displayed on the touch screen. to display. In the step of executing the first process, as the first process, a process of changing the area to be displayed on the touch screen in the first omnidirectional video is executed. In the step of executing the second process, as the second process, a process of changing the first omnidirectional image to a second omnidirectional image among the plurality of omnidirectional images is executed.

(Item 3) In (Item 1) or (Item 2), the second operation is a movement operation in the first direction (1240). The program instructs the processor to perform the first processing and the second processing when a third operation, which is a movement operation in a second direction (1440) different from the first direction and does not include the initial operation, is performed on the touch screen. A step (S1010) of performing a third process related to the video, which is different from the above, is further performed.

(Item 4) In the viewing step of (Item 3), a user interface component (UI 1221) for accepting user operations is displayed on the touch screen along with the image. In the step of executing the third process, the user interface component is hidden as the third process.

(Item 5) In (item 1) to (item 4), the initial operation is an operation in which, after the pointer (finger 1230) is brought into contact with the touch screen, it is not moved for the first time while maintaining the contact.

(Item 6) In (Item 5), the program instructs the processor whether or not the waiting time from the start of the touch of the pointer to the touch screen to the start of movement of the pointer is equal to or longer than a first time. is further executed (S1101). In the step of executing the first process, the first process is executed when it is determined in the determining step that the standby time is equal to or longer than the first time. In the step of executing the second process, the second process is executed if the waiting time is determined to be less than the first time in the determining step.

(Item 7) In (Item 5), the program instructs the processor, when the pointer moves on the touch screen, to move the pointer to the touch screen until the first time elapses from when the pointer starts to touch the touch screen. A step of determining whether or not the object has moved is further executed. In the step of executing the first process, the first process is executed when it is determined in the determining step that the pointer has not moved. In the step of executing the second process, the second process is executed when it is determined in the determining step that the pointer has moved.

(Item 8) The information processing device has been described. According to one aspect of the present disclosure, the information processing device (smartphone 160) includes a storage unit (memory 220) that stores a program executed by the information processing device, and by executing the program, controls the operation of the information processing device. and a touch screen (240). The control unit causes the user to browse the image (omnidirectional image 910), and when a first operation, which is a movement operation including an initial operation, is performed on the touch screen, executes a first process related to the image, When a second operation, which is a movement operation that does not include an initial operation, is performed on the touch screen, a second process related to video, which is different from the first process, is performed.

(Item 9) Explained how to run the program. According to one aspect of the disclosure, the program is executed by a computer (smartphone 160) with a processor (210), memory (220), and touch screen (240). The method comprises the step of allowing the user to view an image (omnidirectional image 910) (S1003); A step of executing a first process (S1005); and, when a second operation, which is a movement operation that does not include an initial operation, is performed on the touch screen, a second process related to the image, which is different from the first process, is executed. and a step (S1008).

2 network, 100 moving image distribution system, 110, 110A, 110B, 110C, 110D moving image shooting system, 120 omnidirectional camera, 121 first imaging unit, 122 second imaging unit, 130 omnidirectional video generation device, 140 display device , 150 subject, 160, 160A, 160B, 160C, 160D smartphone (computer, information processing device), 170 server, 210, 411, 611 processor (control unit), 220, 412, 612 memory (storage unit), 230, 413 , 613 storage, 240 touch screen, 241 touch panel, 242 display, 250,415,615 communication interface, 260,416,616 bus, 311,312 field of view, 414 input/output interface, 710 control module, 720 memory module, 730 communication control Modules 811 video control module 812 operation determination module 813 video switching module 814 UI control module 910 omnidirectional video 911 center 912 reference point 913 reference line 914, 1214A, 1214B, 1314 display area 1221 , 1221A, 1221B, 1221C UI, 1230 finger (pointer), 1240 first direction, 1440 second direction

Claims (9)

A program executed by a computer with a processor, memory and touch screen, comprising:
The program causes the processor to:
allowing the user to view the video;
a step of executing a first process related to the image when a first operation, which is a movement operation including an initial operation, is performed on the touch screen;
and executing a second process related to the image that is different from the first process when a second operation that is a movement operation that does not include the initial operation is performed on the touch screen. . In the viewing step, for a first omnidirectional image among a plurality of viewable omnidirectional images, a partial area of the first omnidirectional image is displayed on the touch screen;
In the step of executing the first process, as the first process, a process of changing an area to be displayed on the touch screen in the first omnidirectional video is executed,
In the step of executing the second process, as the second process, the process of changing the first omnidirectional image to a second omnidirectional image among the plurality of omnidirectional images is executed. Item 1. The program according to item 1. the second operation is a moving operation in a first direction;
The program causes the processor to perform the first process and the 3. The program according to claim 1, further causing execution of a step of executing a third process related to said video, which is different from said second process. In the browsing step, a user interface component for accepting a user's operation is displayed on the touch screen together with the image;
4. The program according to claim 3, wherein in the step of executing the third process, the user interface component is hidden as the third process. 5. The program according to any one of claims 1 to 4, wherein the initial operation is an operation in which, after bringing the pointer into contact with the touch screen, the pointer is kept in contact and is not moved for a first period of time. The program further instructs the processor to determine whether a waiting time from the start of touching the touch screen by the pointer to the start of movement of the pointer is equal to or longer than a first time. let it run,
In the step of executing the first process, if it is determined in the determining step that the standby time is equal to or longer than the first time period, the first process is performed;
6. The program according to claim 5, wherein, in the step of executing the second process, the second process is executed when the waiting time is determined to be less than the first time in the determining step. The program instructs the processor, when the pointer moves on the touch screen, that the pointer has moved by the time the first time elapses from the start of the touch of the pointer on the touch screen. Further execute a step of determining whether or not
In the step of executing the first process, when it is determined in the determining step that the pointer is not moving, the first process is performed;
6. The program according to claim 5, wherein, in the step of executing the second process, the second process is executed when it is determined in the step of determining that the pointer has moved. An information processing device,
The information processing device is
a storage unit that stores a program to be executed by the information processing device;
a control unit that controls the operation of the information processing device by executing the program;
with a touch screen and
The control unit
let the user view the video,
when a first operation, which is a movement operation including an initial operation, is performed on the touch screen, executing a first process related to the image;
An information processing device that, when a second operation, which is a movement operation that does not include the initial operation, is performed on the touch screen, performs a second process related to the image, which is different from the first process. A method for a computer having a processor, memory and touch screen to execute a program comprising:
The method comprises: the processor;
allowing the user to view the video;
a step of executing a first process related to the image when a first operation, which is a movement operation including an initial operation, is performed on the touch screen;
and performing a second process related to the image that is different from the first process when a second operation, which is a movement operation that does not include the initial operation, is performed on the touch screen.

Images