JP7464895B2 - Information processing device, function display method, and function display program - Google Patents

Description

The present invention relates to an information processing device, a function display method, and a function display program.

In recent years, various online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") that are delivered to information processing devices such as mobile terminals via computer networks have become widespread.

Here, examples of apps include apps for viewing distributed manga and apps for editing images. Such apps are provided with multiple functions, such as a function for advancing or rewinding the progress of the manga displayed on the screen (flip function) and a function for cutting out and processing part of the manga image (trimming function). The user appropriately selects a desired function from among these multiple functions and has the app execute it.

In order to improve the ease of use of various functions, i.e., convenience for users, devices and methods are disclosed in Patent Documents 1 and 2.

Patent document 1 discloses a user interface device in which, when an option displayed in a first menu is selected, a second menu is further displayed. The user interface device disclosed in patent document 1 discloses that a user drags a pen into the upper right quadrant of the first menu to select the "Paste" menu option, and then, without lifting the pen from the screen, drags the pen into the lower quadrant of the second menu to select the "Clipboard c" menu option.

Patent Document 2 also discloses a method of editing data in which, when a user touches a display unit with a pen at any point in an area to be edited, an editing icon is displayed on the display unit with that point as its center, and if the process corresponding to the selected icon requires the specification of more detailed processing, an editing sub-icon corresponding to the more detailed processing is displayed on the display unit with the point where the pen is positioned as its center.

Japanese Patent Application Laid-Open No. 07-200126 Japanese Patent Application Laid-Open No. 09-204426

The devices and methods disclosed in Patent Documents 1 and 2 display a submenu corresponding to a menu selected by the user, and the user selects the menu he or she wishes to execute from the submenu. In other words, with the above devices and methods, for example, the user cannot successively select different menus (functions) while executing a menu (function) that he or she has selected. For this reason, there is room for improving the convenience of users in selecting functions.

The present invention has been made in consideration of the above circumstances, and aims to provide an information processing device, a function display method, and a function display program that can further improve the convenience of users in selecting functions.

To solve the above problems, the information processing device, function display method, and function display program of the present invention employ the following means.

In order to solve the above problem, an "information processing device" according to one aspect of the present invention includes a functional image display means for displaying a first functional image or a second functional image on a touch panel display as an image indicating a function selectable by a user, and a function execution means for executing a function corresponding to the first functional image or the second functional image contacted by a pointer when a pointer contacts the first functional image or the second functional image displayed on the touch panel display, and the functional image display means displays the second functional image corresponding to the second function on the touch panel display when the pointer contacts the first functional image and the first function corresponding to the first functional image is being executed.

In order to solve the above problem, a "function display method" according to one aspect of the present invention includes a first step of displaying a first or second function image on a touch panel display by a function image display means as an image showing a function selectable by a user, and a second step of causing a function execution means to execute a function corresponding to the first or second function image that has been contacted by the indicator when a pointer comes into contact with the first or second function image displayed on the touch panel display, and the function image display means displays the second function image corresponding to the second function on the touch panel display while the indicator is contacting the first function image and the first function corresponding to the first function image is being executed.

In order to solve the above problem, the "function display program" of one aspect of the present invention causes a computer to function as a function image display means for displaying a first function image or a second function image on a touch panel display as an image indicating a function selectable by a user, and a function execution means for executing a function corresponding to the first function image or the second function image contacted by a pointer when a pointer contacts the first function image or the second function image displayed on the touch panel display, and the function image display means displays the second function image corresponding to the second function on the touch panel display when the pointer contacts the first function image and the first function corresponding to the first function image is being executed.

The above-mentioned "information processing device" may be subject to various technical limitations, as exemplified below. In addition, technical limitations of the same nature may be applied to the processing steps executed by the "function display method" or the functions of the "function display program."

The functional image display means displays the second functional image in the vicinity of the first functional image that is in contact with the indicator.

The functional image display means displays the second functional image in a display area of another first functional image corresponding to a function less related to the first function corresponding to the first functional image selected using the indicator.

The functional image display means displays a plurality of the first functional images using the contact position of the indicator on the touch panel display as a reference position, and displays the second functional image on the opposite side of the reference position to the first functional image selected using the indicator.

The second function is a function related to the first function that is being executed.

The second function has the same effect as the first function being executed, but has a different degree of effect.

The second function is a function that the user may select after the first function that is currently being executed is terminated.

Each of the above functions has a relationship with other functions.

When the indicator is moved away from the touch panel display while the second functional image is being displayed on the touch panel display, the functional image display means stops displaying the second functional image and continues displaying the first functional image.

When the function execution means stops the execution of the first function, it returns the display of the touch panel display to the state it was in when the execution of the first function started.

When the function execution means stops execution of the second function, it returns the display of the touch panel display to the state when execution of the second function started or the state when execution of the first function started.

The first function or the second function is a rewind function that reverses the progress of the content displayed on the touch panel display, or a forward function that advances the progress of the content.

The present invention has the effect of improving the convenience of function selection by the user.

1 is a configuration diagram of a manga distribution system according to an embodiment of the present invention. FIG. 2 is a block diagram showing an electrical configuration of a server according to an embodiment of the present invention. FIG. 2 is a block diagram showing an electrical configuration of a mobile terminal according to an embodiment of the present invention. FIG. 13 is a diagram showing a first functional image displayed on the mobile terminal according to the embodiment of the present invention. FIG. 13 is a diagram showing a second function image displayed on the mobile terminal according to the embodiment of the present invention. FIG. 13 is a diagram showing another second function image displayed on the mobile terminal according to the embodiment of the present invention. FIG. 13 is a diagram showing another second function image displayed on the mobile terminal according to the embodiment of the present invention. FIG. 2 is a functional block diagram relating to a manga viewing function of a mobile terminal according to an embodiment of the present invention. 10 is a flowchart showing a flow of a manga viewing process on a mobile terminal according to an embodiment of the present invention.

Below, an embodiment of an information processing device, a function display method, and a function display program according to the present invention will be described with reference to the drawings. In this embodiment, as an example, a form will be described in which manga is delivered from a server to a mobile terminal, which is an information processing device, and the delivered manga is viewed by a user using the mobile terminal.

[1. Configuration of manga distribution system]
1 is a schematic diagram of a manga distribution system 1 according to this embodiment. The manga distribution system 1 includes a communication line 2, a plurality of mobile terminals 3, and a server 4.

Communication line 2 forms a computer network and is, for example, a wide area communication line provided by an electric power company.

The mobile terminal 3 is, for example, an information processing terminal such as a smartphone, tablet terminal, or notebook computer, and is used by the user to utilize online services distributed via the communication line 2. The mobile terminal 3 includes a touch panel display 3a that displays images, a speaker 3b that outputs sound, a microphone 3c that inputs sound, and a camera 3d that captures an image of a subject. Here, the touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor accepts various input operations performed using a pointing object such as a finger, a stylus, or a pen.

The server 4 is an information processing device that distributes online services to the mobile terminal 3 via the communication line 2.

The manga distribution system 1 according to this embodiment distributes manga in the form of digital data from the server 4 to the mobile terminal 3 via the communication line 2 as one of the online services. The manga referred to here is an example of content formed by a series of still images, which are composed of pictures and have a story-like nature as a whole. The user uses dedicated application software (hereinafter referred to as the "manga viewing app") to view the manga distributed to the mobile terminal 3. The manga viewing app is pre-installed on the mobile terminal 3. As an example, the manga viewing app can display manga on the mobile terminal 3 page by page, and can also enlarge or reduce the manga displayed page by page. Note that the manga viewing app can function even when the mobile terminal 3 and the server 4 are not communicating (offline state) as long as manga data has been downloaded from the server 4 to the mobile terminal 3.

2. Server Configuration
FIG. 2 is a block diagram showing the electrical configuration of the server 4 according to the present embodiment.

The server 4 according to this embodiment includes a CPU (Central Processing Unit) 20, which is the main control unit that controls the operation of the entire server 4, a ROM (Read Only Memory) 22 in which various programs and various data are pre-stored, a RAM (Random Access Memory) 24 used as a work area when the CPU 20 executes various programs, and a HDD (Hard Disk Drive) 26 as a storage means for storing various programs and various data.

The HDD 26 stores manga data indicating the manga to be distributed to the mobile terminal 3. Note that the storage means is not limited to the HDD 26, and may be other storage media, such as a semiconductor memory such as a flash memory.

The server 4 further includes an operation input unit 28, which is composed of a keyboard, a mouse, etc. and accepts input of various operations, a monitor 30, such as a liquid crystal display device, which displays various images, and an external interface 32, which is connected to other information processing devices, such as a mobile terminal 3, via the communication line 2 and transmits and receives various data to and from the other information processing devices.

The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to each other via a system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, grasp the operation state of the operation input unit 28, display images on the monitor 30, and send and receive various data to and from other information processing devices, etc. via the external interface 32.

[3. Electrical configuration of the mobile terminal]
FIG. 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3. As shown in FIG.

In addition to the components shown in FIG. 1, the mobile terminal 3 includes a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and an operation button 48.

The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), etc., and controls the overall operation of the mobile terminal 3.

The main memory unit 42 is composed of, for example, RAM or DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processes based on various programs.

The auxiliary storage unit 44 is, for example, a non-volatile memory such as a flash memory, and stores various data such as images, as well as programs used in the processing of the main control unit 40. The programs stored in the auxiliary storage unit 44 are, for example, an OS (Operating System) for implementing the basic functions of the mobile terminal 3, drivers for controlling various hardware, and programs for implementing e-mail, web browsing, and various other functions. The auxiliary storage unit 44 also stores in advance a manga viewing application for displaying manga distributed from the server 4 on the touch panel display 3a. In the following description, the touch panel display 3a is also referred to as the screen 3a.

The communication unit 46 is, for example, a network interface controller (NIC), and has a function of connecting to the communication line 2. Note that the communication unit 46 may have a function of connecting to a wireless local area network (LAN), a function of connecting to a wireless wide area network (WAN), and a function of enabling short-range wireless communication such as Bluetooth (registered trademark), infrared communication, etc., instead of or together with the NIC.

The operation buttons 48 are provided on the side of the mobile terminal 3 and include a power button for starting and stopping the mobile terminal 3 and a button for adjusting the volume of the sound output by the speaker 3b.

The main control unit 40, main memory unit 42, auxiliary memory unit 44, communication unit 46, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and operation buttons 48 are electrically connected to each other via a system bus 49. Therefore, the main control unit 40 can access the main memory unit 42 and auxiliary memory unit 44, display images on the touch panel display 3a, grasp the operation state of the touch panel display 3a and the operation buttons 48 by the user, input sound to the microphone 3c, output sound from the speaker 3b, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

[4. Various functions related to manga viewing]
The user reads the manga distributed from the server 4 using a manga viewing app installed on the mobile terminal 3. This manga viewing app is equipped with various functions, and the user selects a function as necessary and has the manga viewing app execute it.

The manga viewing app according to this embodiment displays images (hereinafter referred to as "functional images") indicating functions selectable by the user on the screen 3a in response to a user's touch operation on the touch panel display 3a (screen 3a). Then, when the user selects a functional image using a pointer, the manga viewing app executes the function corresponding to the selected functional image. Note that in the following description, the process related to the display of functional images is referred to as functional image display processing, and the process related to the execution of a function corresponding to a functional image selected by the user is referred to as function execution processing.

As will be described in detail later, the functional image display process according to this embodiment displays a first functional image and a second functional image on the screen 3a as functional images selectable by the user. The first functional image and the second functional image are displayed on the screen 3a at different times, and correspond to different functions.

[4-1. Display of first functional image and execution of first function]
In the functional image display process according to the present embodiment, when the screen 3a is pressed and held long (hereinafter referred to as "first long press") using an indicator, the first functional image is displayed on the screen 3a with the first long press position as a reference position. The first long press refers to a case where the indicator goes from not touching the screen 3a to touching it, and the contact of the indicator at the same position continues for a predetermined time or more. In addition, the first functional image displayed on the screen 3a when the first long press is performed may not be only one functional image, but may be a functional image group having multiple functional images each showing a different function. In addition, the position on the screen 3a where the first long press is performed is not limited. In other words, the position of the first functional image displayed on the screen 3a changes depending on the first long press position.

Figure 4 is a diagram illustrating the positional relationship between the first long press position 50A and the first functional image 52. Note that the example in Figure 4 shows a state in which a manga is displayed on the screen 3a, although there is no indication, and the pages or frames of the displayed manga scroll from right to left in Figure 4. In other words, the manga progresses from right to left.

The functional image display process according to this embodiment displays multiple first functional images 52 with a first long press position 50A, which is the contact position of the indicator on the screen 3a, as the reference position. In the example of FIG. 4, the user's thumb is the indicator, and the position on the screen 3a where this thumb performs the first long press is the first long press position 50A. The functional image display process then displays four different types of first functional images 52A, 52B, 52C, 52D on all four sides (up, down, left, and right) with the first long press position 50A as the reference position (center).

In the example of FIG. 4, the first functional image 52A is displayed to the right of the first long press position 50A and corresponds to a rewind function that rewinds the progress (pages or frames) of the manga displayed on the screen 3a at a predetermined speed. The first functional image 52B is displayed to the left of the first long press position 50A and corresponds to a forward function that advances the progress of the manga displayed on the screen 3a at a predetermined speed. The first functional image 52C is displayed above the first long press position 50A and corresponds to a share function that cuts out the image of the manga displayed on the screen 3a and posts (shares) it to a predetermined online service. The first functional image 52D is displayed below the first long press position 50A and corresponds to a clip function that cuts out the image of the manga displayed on the screen 3a and stores it in the mobile device 3.

The image to be shared or clipped is the image that corresponds to the first long press position 50A, and for example, a frame including the first long press position 50A may be cut out and used as the image to be shared or clipped, or the entire image displayed on the screen 3a when the first long press is performed may be used as the image to be shared or clipped. In addition, when the function execution process executes the share function or clip function, for example, the range of the image to be shared or clipped is shown, and a button image is displayed on the screen 3a to prompt the user to confirm the execution.

The arrangement positions of the first functional images 52 shown in FIG. 4 are one example and are not limited to this. For example, when a manga scrolls from top to bottom, the first functional image 52A corresponding to the back function may be displayed above the first long press position 50A, and the first functional image 52B corresponding to the forward function may be displayed below the first long press position 50A. In addition, the positional relationship of the multiple first functional images 52 may also be based on the first long press position 50A. For example, the multiple first functional images 52 may be displayed in a line in a predetermined direction relative to the first long press position 50A, or the multiple first functional images 52 may be displayed separately in the left-right or up-down direction relative to the first long press position 50A.

When the user selects one of the multiple first functional images 52, the user moves the finger from the first long press position 50A to the desired first functional image 52 while keeping the indicator in contact with the screen 3a (hereinafter referred to as a "slide operation"). Then, when the finger is slid to the desired first functional image 52 (for example, in the direction of arrow A) and a second long press is performed in which this state is maintained for a predetermined period of time or longer, the function execution process executes the function corresponding to the first functional image 52. The position on the screen 3a where the second long press is performed is referred to as the second long press position 50B.

The function execution process according to this embodiment executes the first function corresponding to the first functional image 52 that was pressed and held for the second time only if the second long press is continued. For example, when the first functional image 52A corresponding to the rewind function is pressed and held for the second time, the manga progress, in other words the page, is automatically rewound at a predetermined speed. Also, when the first functional image 52B corresponding to the forward function is pressed and held for the second time, the manga progress (page) is automatically forwarded at a predetermined speed.

Then, when the second long press on the first function image 52 is released, for example, by the finger performing the second long press being removed from the screen 3a or the finger performing the second long press being displaced from the first function image 52, the function execution process stops the first function being executed. Note that in the following description, the act of the user removing an indicator, such as a finger, from the screen 3a is also referred to as touch-off.

[4-2. Display of second function image and execution of second function]
The functional image display process according to this embodiment displays a second functional image corresponding to a second function on the touch panel display 3a (screen 3a) when a pointer comes into contact with the first functional image 52 and a first function corresponding to the first functional image 52 is being executed. That is, the functional image display process according to this embodiment displays a second functional image on the screen 3a when a first function is selected and starts to be executed. That is, the functional image display process according to this embodiment realizes multiplexing of functions.

In this way, the functional image display process according to this embodiment displays the second functional image on the screen 3a only while the first function is being executed, allowing the user to execute a desired function while continuing to select other functions, thereby further improving the convenience of the user in selecting functions.

The display of the second function image 54 will be described in detail with reference to FIG. 5. FIG. 5 shows an example in which the user slides his/her thumb from the first long press position 50A and long presses (second long press) the desired first function image 52 among the multiple first function images 52 shown in FIG. 4. As shown in FIG. 5, when the user's finger presses and holds the first function image 52A (second long press), the second function image 54 (54A) is displayed on the screen 3a while the corresponding first function continues to be executed.

Here, the second function is a function different from the first function being executed, but is, for example, a function related to the first function being executed.

For example, the second function has the same effect as the first function being executed, but the degree of effect is different. Functions with the same effect are, in other words, functions with the same action or processing content. Functions with a different degree of effect are, in other words, functions with the same action or processing content but with different degrees of effect, for example, functions with different speeds for the rewind function or forward function, or functions with different trimming ranges.

5, the function corresponding to the second function image 54A is a high-speed rewind function that rewinds the manga faster than the rewind function corresponding to the first function image 52A. That is, the high-speed rewind function, which is the second function, has the same effect as the rewind function, which is the first function selected by the user, but has a different degree of effect. Also, for example, when the first function being executed is a forward function (medium-speed forward function), a forward function with a different speed (high-speed forward function, low-speed forward function) is used. Also, when the first function being executed is a rewind function (medium-speed rewind function), a rewind function with a different speed (high-speed rewind function, low-speed rewind function) is used.

The second function may also be a function that the user may select after the first function currently being executed has been terminated.

For example, if a user executes the forward function as the first function, there is a possibility that the user may advance too far ahead in the manga pages, and in order to resolve this, the user may execute the rewind function after executing the forward function. For this reason, when the first function being executed is the forward function, the second function is set as the rewind function. Similarly, when the first function being executed is the rewind function, the second function is set as the forward function. In other words, the forward function and the rewind function are in the same category of functions, although they have different effects.

In addition, if the first function being executed is the forward function, the second function may be a foreshadowing jump function (details will be described later). That is, it is assumed that when a user executes the back function to search for a foreshadowing image corresponding to a specific scene, but is unable to find it immediately, the foreshadowing image is instantly displayed on screen 3a using the foreshadowing jump function. For this reason, if the first function being executed is the back function, the second function may be the foreshadowing jump function.

Furthermore, the second function may change depending on the duration of execution of the first function being executed. For example, if the first function being executed is a forward function and the duration of execution exceeds a predetermined time (e.g., 10 seconds), the second function is set to a high-speed forward function. Note that until the above-mentioned predetermined time has elapsed, a second function image 54 corresponding to a function other than the high-speed forward function (e.g., a return function) may be displayed on the screen 3a, and when the duration of execution exceeds the predetermined time, the second function image 54 corresponding to the high-speed forward function may be displayed. Also, when the duration of execution of the first function being executed exceeds the predetermined time, the display of the second function image 54 may be started. In other words, the second function image 54 is not displayed unless the duration of execution of the first function exceeds the predetermined time.

The second function related to the first function being executed may also be determined according to the frequency of use of the second function that is executed after the first function is terminated. For example, when multiple second function images 54 are displayed as in FIG. 6 described below, the second function image 54 corresponding to the most frequently used second function is displayed in a position closest to the first function image 52 corresponding to the first function being executed. Also, the second function image 54 corresponding to the less frequently used second function may not be displayed, and the second function image 54 corresponding to the more frequently used second function may be displayed.

Here, each function is associated with other functions.

For example, a table showing other functions with their relevance to each function (hereinafter referred to as the "functional relevance table") is stored in the mobile terminal 3 or the server 4. The functional image display process displays a second functional image 54 corresponding to the first function being executed on the screen 3a based on this functional relevance table. Specifically, when the first functional image 52 is pressed and held for a second time, the functional image display process executes the first function corresponding to the first functional image 52 and sets the function most relevant to the first function as the second function. The functional image display process then displays the second functional image 54 corresponding to the second function on the screen 3a.

Table 1 below is an example of a function relevance table, showing the relevance of each function to other functions. In the example of Table 1, the relevance is shown as a number, with the smaller the number, the higher the relevance.

The function relevance table may also include the frequency of use of a second function that is executed after the first function is terminated. That is, the frequency of use of each function is included in the function relevance table in association with other functions. The frequency of use of each function included in the function relevance table is updated as appropriate.

Table 2 below is an example of a function relevance table showing the frequency of use of each function, and indicates the number of times the second function was executed after the first function was finished; the higher this number, the higher the frequency of use. In other words, the more frequently the second function is used, the higher its relevance to the first function. The frequency of use of each function may be tallied for each user of the mobile terminal 3, and the function relevance table may be updated. This will result in a different function relevance table for each user. The frequency of use for multiple users may also be tallied by the server 4, and the function relevance table updated. This will result in the same function relevance table for multiple users.

In the examples of Tables 1 and 2, each function is ranked in terms of its relevance to other functions, but this is not limiting. It is also possible to define only one function that is related to each function, and make that function the second function that can be selected while the first function is being executed.

In this way, by making the second function a function related to the first function, the user can intuitively understand the functions that he or she can select, thereby improving the convenience of the user's function selection.

The functional image display process according to this embodiment also displays the second functional image 54 in the vicinity of the first functional image 52 that is in contact with the indicator, i.e., in the vicinity of the first long press position 50A. This allows the user to easily and quickly execute the second function even while the first function is being executed.

The functional image display process, during execution of the first function corresponding to the first functional image 52 selected using the pointer, displays a second functional image 54 in the display area of another first functional image 52 corresponding to a function less related to the first function corresponding to the selected first functional image 52. A second function less related to the first function is, for example, a function that is contradictory to the first function, or a function whose action or processing content is completely different. A contradictory function is a function whose effects are contradictory, such as a forward function against a back function, and a function whose action or processing content is completely different is a share function, clip function, trim function, etc., against a forward function or a back function.

More specifically, for example, the display area of the second function image 54 is determined based on the function relevance table described above. As an example, let us take a case where four first function images 52 corresponding to a medium speed rewind function, a medium speed forward function, a trimming function, and a foreshadowing jump function are displayed, and the user selects the medium speed rewind function. In this case, since the function least related to the medium speed rewind function in the function relevance table shown in Table 1 is the foreshadowing jump function, the second function image corresponding to the second function is displayed in the display area of the first function image 52 corresponding to the foreshadowing jump function.

The functional image display process may also display a second functional image 54 on the opposite side of the reference position (first long press position 50A) from the selected first functional image 52 during execution of the first function corresponding to the first functional image 52 selected using the pointer.

Referring to FIG. 5, when the user presses and holds the first functional image 52A (second long press), the function corresponding to the first functional image 52A is executed. Then, the second functional image 54A is displayed in the display area of the first functional image 52B, which is on the opposite side of the first long press position 50A from the first functional image 52A. In other words, some of the first functional images 52 are dynamically changed to the second functional images 54. Note that in the example of FIG. 5, the display of the first functional images 52C and 52D is stopped, but this is not limiting, and the first functional images 52C and 52D may remain displayed.

As a result, the user can intuitively know that the second function image 54 has been displayed on the screen 3a, and can easily and quickly execute the second function even while the first function is being executed. In addition, because the second function image 54 is appropriately separated from the selected first function image 52, the user is prevented from accidentally pressing the second function image 54 due to the finger moving away from the first function image 52.

When the user executes the second function while the first function is being executed, for example, the user moves (slides) the thumb to the second function image 54 without removing the thumb from the screen 3a and presses and holds the second function image 54 (third long press). As a result, the function execution process stops the first function corresponding to the first function image 52 and starts execution of the second function corresponding to the second function image 54. Note that the second function is executed only when the user's pointer is in contact with the second function image 54, and when the pointer is removed from the second function image 54 (touch-off), the second function being executed is stopped.

The display state of the first function image 52 and the second function image 54 while the second function is being executed remains the same as before the second function is executed. This allows the user to select the first function related to the second function even while the second function is being executed.

Figure 6 is another example of the display state of the second function image 54. In the example of Figure 6, the second function image 54A is displayed on the opposite side of the first long press position 50A from the first function image 52 selected by the user, the second function image 54B is displayed above the second function image 54A, and the second function image 54C is displayed below the second function image 54A. The second function image 54B corresponds to the slow rewind function, and the second function image 54C corresponds to the slow forward function.

Figure 7 shows another example of the display state of the second function image 54, in which the second function image 54 is not displayed on the opposite side of the first long press position 50A to the first function image 52 selected by the user as shown in Figures 5 and 6, but is displayed with the first function image 52 selected by the user, in other words, the second long press position 50B, as the reference position. In the example of Figure 7, the second function image 54A corresponding to the high-speed return function is displayed above the second long press position 50B (first function image 52A), and the second function image 54B corresponding to the low-speed return function is displayed below the second long press position 50B (first function image 52A).

In addition, when the indicator (user's finger) touches off the screen 3a while the second function image 54 is displayed on the screen 3a, the function image display process stops (deletes) the display of the second function image 54 and continues to display the first function image 52. Note that, in the function execution process, when the indicator touches off the screen 3a while the second function is being executed, the execution of the second function is stopped. This allows the user to immediately select the first function image 52 to execute the desired first function even if the user touches off the screen 3a to stop the execution of the second function, thereby improving the user's convenience in selecting functions. Note that, if the user does not select the first function image 52 within a predetermined time (e.g., within 3 seconds) after touching off, the function image display process stops the display of the first function image 52.

However, without being limited to this, when the indicator is touched off while the second function image 54 is being displayed, the display of the second function image 54 may be stopped together with the first function image 52. Also, only when the first function has been continuously executed for a predetermined time or more, the second function image 54 may continue to be displayed on the screen 3a even after touching off, allowing the user to select the second function. In this case, if the indicator is touched off when the continuous execution of the first function has been less than the predetermined time, the first function is stopped, and the display of the second function image 54 together with the first function image 52 is stopped.

In addition, if the indicator moves away from the first functional image 52 or the second functional image 54 without touching off, the currently running function may be stopped or the currently running function may be continued. The process to be performed when the indicator moves away from the functional image is determined in advance by settings. In addition, if the indicator moves away from the first functional image 52 or the second functional image 54 by more than a predetermined distance (a predetermined number of dots), the currently running function may be stopped.

[4-3. Other functions]
The manga viewing application according to the present embodiment may have a trimming function, a comment addition function, an information addition function, a character correlation diagram display function, a search history storage function, etc., in addition to the rewind function, the forward function, the share function, and the clip function. These functions may be executed as the first function or the second function.

[4-3-1. Trimming function]
The trimming function is a function that changes the range of an image to be shared or clipped. For example, when the share function or clip function is executed as the first function, the second function image 54 corresponding to the trimming function is displayed on the screen 3a. Specifically, when the user selects the second function image 54 corresponding to the trimming function, for example, the range of the image to be shared or clipped (trimming range) expands or shrinks around the first long press position 50A.

[4-3-2. Comment Addition Function]
The comment addition function is a function for adding a comment to an image to be shared or clipped. For example, when the share function or clip function is executed as the first function, a second function image 54 corresponding to the comment addition function is displayed on the screen 3a. Then, when the user selects the second function image 54 indicating the comment addition function, for example, a text box for adding a comment to the image to be shared or clipped is displayed on the screen 3a. The comment may be superimposed at a predetermined position on the image to be shared or clipped, or may be added as metadata.

[4-3-3. Information addition function]
The information addition function is a function that adds predetermined information to an image to be shared or clipped. For example, when the share function or clip function is executed as the first function, a second function image 54 corresponding to the information addition function is displayed on the screen 3a. The predetermined information is, for example, information indicating the copyright of the image to be shared or clipped, information indicating the user who shared or clipped the image (user ID), information indicating the date when the image was shared or clipped, etc. This information may be superimposed at a predetermined position on the image to be shared or clipped, or may be added as metadata.

[4-3-4. Character correlation diagram display function]
The character correlation diagram display function is a function for displaying a correlation diagram showing the relationships between the characters appearing in a manga on the screen 3a. For example, when the user performs a first long press on the screen 3a, a first function image 52 corresponding to the character correlation diagram display function is displayed on the screen 3a as the first function. Also, for example, when the first long press position 50A overlaps with an image showing a character included in the character correlation diagram or when a character included in the character correlation diagram exists in a frame overlapping the first long press position 50A, the first function image 52 corresponding to the character correlation diagram display function is displayed on the screen 3a. Note that the character correlation diagram stops being displayed on the screen 3a when the user's finger is touched off the screen 3a.

[4-3-5. Search history storage function]
The search history storage function is a function that associates an image of a manga scene displayed on screen 3a when execution of the rewind function ends (hereinafter referred to as a "foreshadowing image") with an image of the manga scene displayed on screen 3a when execution of the rewind function begins (hereinafter referred to as an "original image"), and stores them in HDD 26 of server 4. In other words, the search history storage function is a function that automatically stores a history of when the user rewent the progression (pages) of the manga in order to search for (search for) foreshadowing images thought to be related to the original image.

As an example, the functional image display process according to this embodiment displays a second functional image 54 corresponding to the search history storage function on the screen 3a when the back function is executed as the first function.

A method of using the search history storage function according to this embodiment will be described. The user rewinds the progress of the manga by executing the first function, the rewind function, and continues executing the rewind function until he finds a foreshadowing image that seems to be related to the original image. Then, when an image that the user thinks is a foreshadowing image is displayed on the screen 3a, the user stops the long press (second long press) of the first function image 52 corresponding to the rewind function, moves his finger to the second function image 54 corresponding to the search history storage function and performs a long press (third long press), thereby executing the search history storage function. The search history storage function regards the scene (image) displayed on the screen 3a at the start of execution of the rewind function as the original image, and the scene (image) displayed on the screen 3a at the timing of the third long press as the foreshadowing image, and transmits search history information relating these to the server 4 via the communication unit 46 for storage.

In this way, the search history storage function associates the original image with the foreshadowing image and stores them in the server 4 simply by performing a touch operation on the screen 3a. Therefore, the user can easily store foreshadowing for manga scenes in the server 4.

The server 4 also adds the stored search history information to the corresponding manga. The manga with the added search history information is separately delivered from the server 4 to the mobile terminal 3.

The search history information stored in the server 4 does not necessarily have to be the original image and foreshadowing image itself, but may be, for example, the position (coordinates) of the page or frame of the manga that contains the original image and foreshadowing image.

Also, a first function image 52 corresponding to a search history storage function may be displayed as the first function. In this form, when the user selects the search history storage function, the rewind function is executed, making it possible to rewind the progress of the manga displayed on the screen 3a. The search history storage function stores in the server 4 search history information that associates the image at which the user rewinds and stops the progress of the manga as a foreshadowing image, and the image at the start of execution of the rewind function as the original image.

The search history storage function may be a part of the rewind function, and when the rewind function is stopped by touching off during its execution, a message may be displayed on screen 3a to confirm whether or not to store the image displayed on screen 3a as a foreshadowing image. In this case, when the user performs an operation in response to the message indicating an intention to store, search history information with the image at the start of execution of the rewind function as the original image is stored in server 4.

In addition, any user who uses the manga viewing app can store the search history information in the server 4. For this reason, the interpretation of the original image and the foreshadowing image may differ depending on the user, and multiple users may store search history information in the server 4, which may result in multiple foreshadowing images being associated with one original image. In such a case, the server 4 may perform a process of determining the foreshadowing image to be associated with the original image by statistical processing such as majority voting, or may store all the search history information as is.

The server 4 delivers the manga with the search history information added to the mobile terminal 3. Therefore, the manga viewing app can show the foreshadowing image associated with the original image not only to the user who has stored the search history information in the server 4, but also to other users.

For example, the manga viewing app may have a foreshadowing jump function that changes the display state of screen 3a from a state in which an original image is displayed to a state in which a foreshadowing image associated with the original image is displayed, based on search history information added to the distributed manga. In other words, when an original image is displayed on screen 3a, the foreshadowing jump function instantly changes the display of screen 3a to a foreshadowing image associated with the original image in response to a user operation.

The foreshadowing jump function may provide a notification indicating the presence of a foreshadowing image associated with the original image when the original image is displayed on screen 3a. The notification may, for example, display a message saying "Foreshadowing present" on screen 3a when the original image is displayed on screen 3a, or highlight the outline of the page or frame containing the original image. This allows the user to instantly display the foreshadowing image on screen 3a when the original image is displayed on screen 3a in order to check foreshadowing. When the message saying "Foreshadowing present" is displayed on screen 3a, a first function image 52 corresponding to the foreshadowing jump function may be displayed on screen 3a.

In this way, the search history storage function adds search history information to the manga distributed to the mobile terminal 3, and the foreshadowing jump function makes the search history information available not only to the user who stored it on the server 4, but also to other users, so that the manga distributed from the server 4 is formed as CGM (Consumer Generated Media).

[4-4. Touch-off process]
As described above, the first function being executed is stopped when the indicator is moved away (touched off) from the first functional image 52. Also, when the indicator is moved away (touched off) from the second functional image 54, the second function being executed is stopped.

Conventionally, when the forward or back function is completed, the current page of the manga remains displayed on screen 3a. Therefore, if the user wants to return the manga display to the state it was in before the forward or back function was started, the user must perform the reverse operation to return the manga display, which is inconvenient.

Therefore, the function execution process according to this embodiment may perform a touch-off process to return the display of the screen 3a to the state when execution of the first function is started when execution of the first function is stopped. Furthermore, the function execution process according to this embodiment may perform a touch-off process to return the display of the screen 3a to the state when execution of the second function is started or the state when execution of the first function is started when execution of the second function is stopped when execution of the second function is stopped. Note that the state when execution is started is the display state of the screen 3a immediately before the execution of the function selected by the user is started. This improves the user's convenience regarding function execution and stopping.

The functions that are the target of the touch-off process are, for example, the return function and the forward function. In other words, for each function according to this embodiment, whether or not to execute the touch-off process is preset.

For example, if the user touches off while the rewind or forward function is being executed as the first function, the manga displayed on screen 3a will return to the state it was in when the rewind or forward function was first executed.

When the first function and the second function are both the back or forward function, if the user touches off while the second function is being executed, the manga displayed on the screen 3a returns to the state it was in when the first or second function was started. Note that it may be preset whether the state returns to the state when the first or second function was started when touching off while the second function is being executed. Also, if the user returns their finger to the second long press position 50B (the previously selected first function image 52) while the back or forward function is being executed as the second function, execution of the second function may be stopped and the manga displayed on the screen 3a may be returned to the state it was in when the second function was started.

[5. Functional block of manga viewing function]
8 is a functional block diagram relating to a manga viewing function executed by a manga viewing application installed in the mobile terminal 3 according to this embodiment. The main control unit 40 included in the mobile terminal 3 includes a manga display control unit 60, a scroll control unit 62, a functional image display unit 64, and a function execution unit 66. The processes executed by each function included in the main control unit 40 are realized by a program stored in the auxiliary storage unit 44.

The manga display control unit 60 displays the manga distributed from the server 4 on the screen 3a.

The scroll control unit 62 scrolls the manga displayed on the screen 3a in response to an operation on the screen 3a by a pointer.

The functional image display unit 64 displays the first functional image 52 or the second functional image 54 on the screen 3a as an image indicating a function selectable by the user. The functional image display unit 64 displays the second functional image 54 on the screen 3a when an indicator touches the first functional image 52 and the first function corresponding to the first functional image 52 is being executed. The functional image display unit 64 also performs the above-mentioned functional image display processes.

When a pointer comes into contact with the first functional image 52 or the second functional image 54 displayed on the screen 3a, the function execution unit 66 executes a function corresponding to the first functional image 52 or the second functional image 54 that the pointer has come into contact with. The function execution unit 66 also performs each of the function execution processes described above.

[6. Manga viewing process flowchart]
9 is a flowchart showing the flow of a manga viewing process executed by the main control unit 40 included in the mobile terminal 3. A program for executing the manga viewing process (manga viewing application) is stored in a predetermined area of the auxiliary storage unit 44 in advance.

First, in step 100, the manga display control unit 60 displays the manga distributed from the server 4 on the screen 3a.

In the next step 102, the scroll control unit 62 determines whether or not the user has performed a scroll operation on the screen 3a, and if the determination is positive, the process proceeds to step 104.

In step 104, the scroll control unit 62 scrolls the manga displayed on the screen 3a in response to the user's scrolling operation.

In the next step 106, the functional image display unit 64 determines whether a first long press has been performed on the screen 3a, and if the determination is positive, the process proceeds to step 108, and if the determination is negative, the process proceeds to step 124.

In step 108, the functional image display unit 64 displays the first functional image 52 on the screen 3a.

In the next step 110, the function execution unit 66 determines whether the user has selected the first function image 52 by determining whether the user has pressed and held the first function image 52 (second long press), and if the determination is affirmative, the process proceeds to step 112. On the other hand, if the determination is negative, the process proceeds to step 124.

In step 112, the function execution unit 66 executes the first function corresponding to the first function image 52 selected by the user (second long press), and the function image display unit 64 displays the second function image 54 on the screen 3a.

In the next step 114, the function execution unit 66 determines whether or not the user's finger has touched off the screen 3a. If the determination is positive, the process proceeds to step 122, and if the determination is negative, the process proceeds to step 116.

In step 116, the function execution unit 66 determines whether the user has selected the second function image 54 by determining whether the user has pressed and held the second function image 54 (third long press), and if the determination is positive, the process proceeds to step 118. On the other hand, if the determination is negative, the process returns to step 112 and the execution of the first function continues.

In step 118, the function execution unit 66 executes the second function corresponding to the second function image 54 selected by the user (third long press).

In the next step 120, the function execution unit 66 determines whether or not the user's finger has touched off the screen 3a. If the determination is positive, the process proceeds to step 122. If the determination is negative, the process returns to step 118 and the execution of the second function continues.

In step 122, the function execution unit 66 stops the function being executed, the function image display unit 64 stops displaying the first function image 52 or the second function image 54, and the process proceeds to step 124. If a function for which a touch-off process is set is being executed, the function execution unit 66 executes the touch-off process set for that function.

In step 124, the manga display control unit 60 determines whether the manga displayed on screen 3a has ended, and if the determination is affirmative, the manga viewing process ends, whereas if the determination is negative, the process proceeds to step 102 and the manga display continues. As an example, the manga display control unit 60 determines that the manga has ended when the manga displayed on screen 3a cannot be scrolled any further.

As described above, the manga viewing process according to this embodiment displays the first function image 52 or the second function image 54 on the touch panel display 3a as an image indicating a function selectable by the user, and when a pointer comes into contact with the first function image 52 or the second function image 54, executes the function corresponding to the first function image 52 or the second function image 54 that the pointer touches. Then, the manga viewing process displays the second function image 54 on the touch panel display while the first function corresponding to the first function image 52 is being executed.

In this way, by displaying the second function image 54 on the screen 3a while the first function is being executed, the user can execute a desired function and still select other functions. Therefore, the manga viewing process according to this embodiment can further improve the convenience of the user in selecting functions.

7. Other embodiments
The present invention has been described above using the above-mentioned embodiments, but the technical scope of the present invention is not limited to the scope described in the above-mentioned embodiments. Various modifications or improvements can be made to the above-mentioned embodiments without departing from the gist of the invention, and the forms in which such modifications or improvements are made are also included in the technical scope of the present invention. In addition, the above-mentioned embodiments may be appropriately combined.

[7-1. Other embodiment 1]
In the above embodiment, the content is a comic book, but the present invention is not limited to this. For example, the content may be a video, or the content may be a novel composed of text.

[7-2. Other embodiment 2]
In the above embodiment, the second function image 54 is displayed simultaneously with the start of execution of the first function, but the present invention is not limited to this. The second function image 54 may be displayed on the screen 3 a after a predetermined time has elapsed or at a predetermined timing after the start of execution of the first function.

For example, when a rewind function is being executed as the first function, a second function image 54 may be displayed so that a slow rewind function or a slow forward function can be selected as the second function when the vicinity of a predetermined content is displayed.

The predetermined content is, for example, a foreshadowing image stored in association with an original image corresponding to a manga when execution of the first function begins. As a result, when a user is searching for a foreshadowing image associated with an original image using the rewind function, the function image display process displays a second function image 54 corresponding to the slow rewind function or the slow forward function on the screen 3a when the vicinity of the foreshadowing image is displayed on the screen 3a.

Therefore, when the user is executing the rewind function to search for a foreshadowing image, if a second function image 54 corresponding to the slow rewind function is displayed on screen 3a, this is selected and executed. This prevents the manga display from going back beyond the foreshadowing image, improving convenience for the user. Also, even if the rewind function goes back beyond the foreshadowing image, the foreshadowing image can be easily displayed on screen 3a by selecting and executing the slow forward function as the second function.

The functional image display process determines whether or not the user is searching for a foreshadowing image associated with the original image based on the search history information added to the manga. In other words, when the rewind function is executed starting from the original image indicated in the search history information, the functional image table display process determines that the user is searching for a foreshadowing image associated with that original image. Then, when the manga is rewound to the vicinity of the page or frame containing the foreshadowing image indicated in the search history information, the functional image display process displays a second functional image 54 corresponding to the slow rewind function or slow forward function on the screen 3a.

[7-3. Other embodiment 3]
When the user alternately repeats the execution of the first function and the execution of the second function, the first function image 52 and the second function image 54 displayed on the screen 3a may be dynamically changed.

For example, when a high-speed forward function is being executed as the first function, an image corresponding to a high-speed reverse function is displayed as the second function image 54, and when the second function image 54 is selected and the high-speed reverse function is being executed, the first function image 52 selectable by the user dynamically changes to an image corresponding to a medium-speed forward function. Furthermore, when the medium-speed forward function is selected and executed, an image corresponding to a medium-speed reverse function is displayed as the second function image 54, and when the medium-speed reverse function is selected and executed, an image corresponding to a slow-speed forward function is displayed as the first function image 52. Then, when the slow-speed forward function is selected and executed, an image corresponding to a slow-speed reverse function is displayed as the second function image 54.

In other words, in the above example, the first function and the second function change dynamically as follows: First function: high-speed forward function → Second function: high-speed return function → First function: medium-speed forward function → Second function: medium-speed return function → First function: low-speed forward function → Second function: low-speed return function

This allows the user to gradually slow down the forward and rewind speed, improving convenience for the user when, for example, they want to search for a desired scene by alternating between the forward and rewind functions.

[7-4. Other embodiment 4]
When the user selects the rewind or forward function, a slide bar for adjusting the speed is displayed on screen 3a, and the rewind/forward speed may be changed depending on the direction and magnitude of the user's swipe operation following the first long press operation.

[7-5. Other embodiment 5]
Furthermore, the flow of the manga viewing process described in the above embodiment is also one example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the present invention.

3. Mobile terminal (information processing device)
3a Screen (touch panel display)
52 First functional image 54 Second functional image 64 Functional image display section (functional image display means)
66 Function execution unit (function execution means)

Claims (3)

a processor, the processor comprising:
The manga content is displayed on the screen.
When the manga displayed on the screen is a content whose progress is controlled by scrolling pages or frames in the left-right direction, a first function image corresponding to a manga advance function or a first function for going back is displayed in the left-right direction of a position based on the first operation in response to a first operation received on the screen,
When the manga displayed on the screen is a content whose progress is controlled by vertically scrolling pages or frames, a first function image corresponding to a manga advance function or a first function for going back is displayed in the vertical direction of a position based on the first operation in response to a first operation received on the screen ,
after receiving a second operation to select the first functional image, displaying a plurality of second functions having the same effect as the first function but different degrees of effect;
determining a frequency of use of the second functions for each of the first functions based on a second function image selected based on the third operation from among second function images corresponding to the plurality of second functions and a first function image selected by the second operation;
displaying a second functional image corresponding to a second function that is used more frequently after the second operation for selecting the first functional image is accepted, and not displaying a second functional image corresponding to a second function that is used less frequently after the second operation for selecting the first functional image is accepted;
Information processing device. The processor displays the manga content on the screen.
a processor, when the manga displayed on the screen is a content whose progress is controlled by scrolling pages or frames in a left-right direction, displays a first functional image corresponding to a manga advance function or a manga rewind function in a left-right direction from a position where the first operation is a reference position in response to a first operation received on the screen;
a processor, when the manga displayed on the screen is a content whose progress is controlled by vertically scrolling pages or frames, displays a first functional image corresponding to a manga advance function or a manga rewind function in the vertical direction of a position based on the first operation received on the screen in accordance with a first operation;
a processor, after accepting a second operation to select the first functional image, displays a plurality of second functions having the same effect as the first function but different degrees of effect;
a processor determines a frequency of use of the second functions for each first function based on a second function image selected based on a third operation from among second function images corresponding to the plurality of second functions and a first function image selected by the second operation;
the processor displays a second functional image corresponding to a second function that is used more frequently after receiving a second operation to select the first functional image, and does not display a second functional image corresponding to a second function that is used less frequently after receiving a second operation to select the first functional image;
Information processing methods. The processor displays the manga content on the screen.
a processor, when the manga displayed on the screen is a content whose progress is controlled by scrolling pages or frames in the left-right direction, displays a first functional image corresponding to a manga advance function or a manga rewind function in the left-right direction of a position based on a first operation received on the screen in accordance with a first operation;
a processor that, when the manga displayed on the screen is a content whose progress is controlled by vertically scrolling pages or frames, displays a first functional image corresponding to a manga advance function or a manga rewind function in the vertical direction of a position based on a first operation received on the screen in accordance with a first operation;
displaying a plurality of second functions having the same effect as the first function but different degrees of effect, after receiving a second operation of selecting the first functional image from the processor;
causing the processor to determine a frequency of use of the second functions for each first function based on a second function image selected based on the third operation from among second function images corresponding to the plurality of second functions and a first function image selected by the second operation;
a processor that displays a second functional image corresponding to a second function that is used more frequently after the second operation for selecting the first functional image is accepted, and does not display a second functional image corresponding to a second function that is used less frequently after the second operation for selecting the first functional image is accepted;
A program that executes a process.

Images