JPWO2016039122A1 - Program, recording medium, information processing apparatus, and notification method - Google Patents

Abstract

A program executed in a computer executes a process of acquiring information indicating an operation input made, and a process of notifying operation contents corresponding to the operation input indicated by the acquired information after a predetermined time delay .

Description

  The present invention relates to a program, a recording medium, an information processing apparatus, and a notification method, and more particularly to a technique for improving operability in consideration of a response to an operation input.

  An information processing apparatus including a game machine or the like is generally configured to execute a predetermined operation corresponding to an operation input made by a user or the like. Normally, when it is detected that an operation input has been made, a process corresponding to the input is performed within a certain time. For example, the process result is presented to the user as a screen display, so that the user can respond to the operation input ( I understand that there was a response.

  However, when the operation input interface is wirelessly connected, or when the device that accepts the operation input is different from the device that performs the corresponding processing and they are connected for communication, communication delay of information related to the operation input occurs. At this time, the user may be given an impression that the responsiveness is lowered.

  Various techniques have been developed in the past in order to absorb such response delay due to processing or communication. In Patent Document 1, when playing a battle game using a plurality of game devices, the position of the character operated by each other device is prevented from being inconsistent due to a communication delay. A technique for predicting information such as the position of an opponent character that takes into account a delay time based on the reception history of information and making it match in a pseudo manner is disclosed.

JP 2006-320502 A

  By the way, although the above-mentioned patent document 1 discloses that the position of the opponent character is predicted based on the processing result of the operation input made on another game device, the operation input made on the game device of the player is disclosed. The response delay related to was not considered.

  Responsiveness to the operation input is not limited to that based on the communication delay as described above. For example, when various processes are executed in parallel, depending on the processing capability of the information processing device, the time until the processing result corresponding to the operation input is presented may be delayed, and the response to the user is reduced. Can give the impression. Alternatively, when information related to operation input is transmitted to an external device and a result of processing performed in the external device is received as a response, the processing capability of the external device, processing executed in parallel in the device, Furthermore, the time until the processing result corresponding to the operation input is presented may be delayed due to various factors such as a communication delay in data transmission / reception, which may give the user an impression that the responsiveness is lowered.

  As described above, the responsiveness to the operation input performed by the user is an important element from the viewpoint of operability, but there has been no technology for improving the operability while allowing a delay caused by processing or communication. .

  At least one embodiment of the present invention has been made in view of the above-described problems, and provides a program, a recording medium, an information processing apparatus, and a notification method that improve operability in consideration of a response to an operation input. For the purpose.

  In order to achieve the above object, a program according to at least one embodiment of the present invention obtains information indicating an operation input made by a computer having a notification means for notifying an operation content corresponding to the operation input made. And a process for causing the notification means to notify the operation content corresponding to the operation input indicated by the acquired information with a predetermined time delay.

  With such a configuration, according to at least one embodiment of the present invention, operability can be improved in consideration of a response to an operation input.

  Other features and advantages of the present invention will become apparent from the following description with reference to the accompanying drawings. In the accompanying drawings, the same or similar components are denoted by the same reference numerals.

The accompanying drawings are included in the specification, constitute a part thereof, show an embodiment of the present invention, and are used to explain the principle of the present invention together with the description.
The figure which showed the system configuration | structure of the game system which concerns on embodiment of this invention. The block diagram which showed the function structure of the server 100 which concerns on embodiment of this invention. The block diagram which showed the mechanism structure of the client apparatus 200 which concerns on embodiment of this invention. , , , , The figure for demonstrating the notification of the operation content in the client apparatus 200 which concerns on embodiment of this invention. The flowchart which illustrated the reflection time acquisition process performed in the server 100 which concerns on embodiment of this invention. The flowchart which illustrated the output screen generation process performed in the client apparatus 200 which concerns on embodiment of this invention The figure which illustrated the operation input history table concerning the embodiment of the present invention The flowchart which illustrated the touch input judgment processing performed in the client apparatus 200 which concerns on Embodiment 2 of this invention. , The figure for demonstrating the movement of the object detection area | region in a touch input judgment process

[Embodiment 1]
Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. Note that an embodiment described below is an example of an information processing apparatus, a server that renders a game screen based on an operation input made in a client device and provides the game device to the client device, and an operation corresponding to the operation input made An example will be described in which the present invention is applied to a game system including a client device capable of displaying a content notification superimposed on a game screen. However, the present invention is not limited to display output (screen), and can be applied to any device capable of notifying operation content corresponding to an operation input made.

  Also, in this embodiment, the time (delay amount, response delay) required from when an operation input is made until the processing result corresponding to the operation input is reflected on the game screen is a relatively remarkable example. An example including communication will be described, but the implementation of the present invention is not limited to this. That is, as described above, the delay until the processing result corresponding to the operation input is reflected depends on the amount of processing executed in parallel or the amount of processing based on the operation input, even when communication is not required. Since it may occur, it will be easily understood that the present invention is not limited to the system configuration of the present embodiment.

  In this specification, “operation content” means, for example, information indicating which button is used, information indicating which command is received, and the like regarding the user interface used by the user in the use of the game content, Alternatively, the input content determined in the processing in relation to the operation input, such as information indicating the input position or input direction of the so-called analog stick, is indicated.

《Game system configuration》
FIG. 1 is a diagram showing a system configuration of a game system according to an embodiment of the present invention.

  In the game system of the present embodiment, a user who uses the client device 200 can receive service provision related to the use of game content by connecting the device to the server 100. In the game system of the present embodiment, a game screen related to game content displayed on the client device 200 is drawn by the server 100 and provided to the client device 200 via the network 300. That is, various processes relating to game content and drawing processing of the game screen are executed in the server 100, and the client device 200 detects operation input made by the user, transmits information indicating the operation input to the server 100, and server 100 The game screen received from is displayed.

  Further, as shown in the figure, in the game system of the present embodiment, a plurality of client devices 200 can be connected to the server 100, and information indicating operation inputs received from each of the plurality of client devices 200 in the server 100 in parallel. And may be configured to be processable. The processing performed for each client device 200 may be related to game content played only by the user of the client device 200, or related to game content played by users of the plurality of client devices 200 at the same time. It may be.

<Configuration of Server 100>
Hereinafter, the functional configuration of the server 100 will be described with reference to the block diagram of FIG.

  The server control unit 101 is a control device such as a CPU, and controls the operation of each block included in the server 100. The server control unit 101 controls the operation of each block by reading out the operation program of each block stored in the server storage medium 102, for example, and expanding and executing it in the server memory 103.

  The server storage medium 102 is a storage device that permanently stores information, such as a nonvolatile memory or an HDD. In addition to the operation program for each block of the server 100, the server storage medium 102 includes a program related to game content provided to the client device 200, various data for generating a game screen related to the game content, and service usage Information for managing a person is stored. The server memory 103 is a storage device used as a temporary data storage area such as a RAM. The server memory 103 may be used not only as a development area for the operation program of each block, but also as a storage area for intermediate data output in the operation of each block. The server memory 103 may also serve as a game screen generation area by the server drawing unit 104.

  The server drawing unit 104 is a drawing device such as a GPU. The server drawing unit 104 performs a game screen drawing process to be transmitted to each client device 200 based on a drawing command issued based on a calculation result of a process (game process) related to the game content executed by the server control unit 101. Do. For example, data necessary for generating the game screen is read from the server storage medium 102 by the server control unit 101 and stored in a cache memory or the like of the server drawing unit 104 (not shown), and the server drawing unit 104 draws the data. The result calculated based on the command is rendered as a game screen.

  In this embodiment, for the sake of simplicity, it is assumed that the game screen is drawn on the server 100. However, the drawing process is performed by sending a drawing command and data to an external device such as a drawing server. There may be. In this case, the game screen may be transmitted from the external device to the client device 200.

  The server measuring unit 105 measures the time until the operation input is reflected on the game screen for the operation input made in each client device 200. Since the time until the operation input is reflected on the game screen is simple in the present embodiment, “after the operation input is detected in the client apparatus 200, the server 100 reflects the processing result based on the information indicating the operation input. However, the embodiment of the present invention is not limited to this. For example, the time until the operation input is reflected on the game screen is “the game screen on which the processing result based on the information indicating the operation input is reflected on the client device 200 after the operation input is detected on the client device 200. It may be defined as “time until display”. In this case, the time measurement may be performed in the client device 200. Alternatively, information identifying the acquired timing such as a frame number or a time stamp corresponding to the information indicating the operation input is transmitted and the information of the operation input reflecting the processing result is added to the header of the game screen or the like. And may be measured by being transmitted. Alternatively, the time until the operation input is reflected on the game screen may be defined as a fixed value in consideration of the maximum delay amount in consideration of the current communication state and the number of parallel processes in the server 100. In this case, the display timing may be forcibly controlled so that the game screen received by the client device 200 is displayed after a predetermined time has elapsed since the operation input was made. Alternatively, for client devices 200 connected from the same area, accessing the server 100 via the same service provider, or using the same game content, the other client devices 200 are measured in advance. The set or set time may be set as the time until the operation input is reflected on the game screen.

  The server communication unit 106 is a communication interface that the server 100 has. The server communication unit 106 is connected to the client device 200 via the network 300 and transmits / receives data to / from the client device 200. In transmitting the game screen, the server communication unit 106 may encode and transmit the target game screen based on the game screen of a plurality of frames.

<Configuration of Client Device 200>
Next, the functional configuration of the client apparatus 200 will be described with reference to the block diagram of FIG.

  The control unit 201 is a control device such as a CPU, for example, and controls the operation of each block included in the client device 200. The control unit 201 controls the operation of each block by, for example, reading the operation program of each block stored in the storage medium 202 and developing it in the memory 203 and executing it. Note that when the game screen received from the server 100 is encoded, the control unit 201 may perform a decoding process to generate a game image related to the frame.

  The storage medium 202 is a storage device that permanently stores information, such as a nonvolatile memory or an HDD. The storage medium 202 is a graphic user interface for notifying the operation content corresponding to the operation input made for superimposing on the game screen received from the server 100 in addition to the operation program of each block of the client device 200. (GUI) Images and the like are stored. The memory 203 is a storage device used as a temporary data storage area such as a RAM. The memory 203 may be used not only as a development area for the operation program of each block, but also as a storage area for intermediate data output in the operation of each block. The memory 203 may also serve as a game screen generation area by the drawing unit 204.

  The drawing unit 204 is a drawing device such as a GPU. The drawing unit 204 only needs to perform a simple drawing process such as superimposing a predetermined GUI image on the game screen received from the server 100, and has the same drawing performance as the server drawing unit 104 of the server 100. There is no need to have something. The drawing unit 204 may be a so-called on-board GPU or the like.

  The display unit 205 is a display device such as an LCD. The display unit 205 may be integrated with the client device 200 or may be an external display device that is detachable from the client device 200.

  The operation input unit 206 is a user interface that the client device 200 has, such as a predetermined game pad and a keyboard. In the present embodiment, hardware as an input device is connected to the client device 200, and the buttons and analog sticks on the hardware (the xy coordinates indicated by the inclination of the stick-like member up and down, left and right, etc.) are used as analog values. Each of the physical operation members such as (output) functions as a user interface. When the operation input unit 206 detects an operation input made on various user interfaces, the operation input unit 206 outputs a control signal corresponding to the operation input to the control unit 201.

  The communication unit 207 is a communication interface that the client device 200 has. The communication unit 207 is connected to the server 100 via the network 300 and transmits / receives data to / from the server 100.

<< Notification mode of operation contents >>
Next, in the service provision in the game system according to the present embodiment, an operation content notification mode on the game screen presented to the user of each client device 200 will be described with reference to the drawings.

  As described above, in the client device 200 according to the present embodiment, a screen in which a GUI image for notifying operation content corresponding to the operation input made on the game screen received from the server 100 is superimposed as the output screen. Is displayed. Since the time until the processing result corresponding to the operation input is reflected is delayed due to the communication delay or the processing load on the server 100, the operation input reflected on the received game screen is the current determination time point (frame). This is different from the operation input detected by the operation input unit 206. Accordingly, in the present embodiment, the drawing unit 204 superimposes on the game screen a GUI image that notifies the operation content corresponding to the operation input reflected on the received game screen. That is, since the GUI image for notifying the operation content corresponding to the operation input reflecting the processing result is superimposed on the game screen in the current frame, the operation content corresponding to the operation input made by the user Will be delayed and notified on the output screen. By doing so, it is possible to at least notify the user which input among the operation inputs performed by the user is reflected on the game screen of the current frame.

  In the present embodiment, in addition to this, the operation content corresponding to the operation input detected in the current frame is also notified on the output screen. That is, on the output screen, at least the operation content corresponding to the operation input made at present and the operation content corresponding to the operation input reflected on the game screen of the current frame are notified in an identifiable manner. By doing in this way, it can be further notified to the user that the operation input performed by the user viewing the displayed game image is accepted. The operation input detected in the current frame may be an operation input that is treated as detected in the current frame. In this case, the time when the operation input is made is, for example, one frame before or the like. It may be an operation input made within a period different from the frame.

  Furthermore, in this embodiment, in order to notify the user of the time, processing status, or delay time from when the operation input is made until the processing result corresponding to the operation input is reflected on the game screen, The GUI image related to the notification of the corresponding operation content is displayed on the output screen while the notification mode is sequentially changed over time. By doing so, it is possible to further notify the user of the time until the processing result corresponding to one operation input performed by the user is reflected and the processing delay state.

  By combining these notification modes, the game system according to the present embodiment allows the user to receive the processing result even if a processing or communication delay occurs until the processing result corresponding to the operation input is reflected. Information indicating the reflection delay can be notified. Therefore, it is possible to notify the user that the operation is performed while predicting the processing result in consideration of the delay until the reflection, so that the operability can be improved.

  For example, when an operation input for tilting the analog stick to the left by the user is performed in the client device 200 of the present embodiment, the operation content of the operation input detected by the operation input unit 206, that is, position movement in the left direction, A GUI image as shown in FIG. 4A related to notification of direction selection or the like is superimposed on the game screen of the current frame. In the example of FIG. 4A, a GUI image 401 having a predetermined area and brightness is displayed at a position corresponding to the left direction in the circular circle 400 in order to indicate that the GUI image has been input. After that, the rendering unit 204 sequentially changes (increases) the area and the luminance as shown in FIGS. 4B to 4C based on the information on the time until the acquired processing result is reflected (reflection time), for example. And 403 are notified. Then, the notification mode is changed so that the GUI image 404 (FIG. 4D) having an area and brightness that clearly indicate that the game image of the frame in which the processing result is reflected is finally displayed. Thereafter, the notification may be deleted on the next frame or the output screen after a predetermined frame has elapsed (FIG. 4E). 4A to 4D are based on the reflection time information received from the server 100 during the period from when the operation input is received until the processing result corresponding to the operation input is reflected on the game screen. Control is made so that the notification mode changes step by step. With this series of notification mode changes, the user is notified that the operation input made is accepted, the time interval until the processing result corresponding to the operation input is reflected, and the processing result is reflected. be able to.

  In the example shown in FIGS. 4A to 4E, for the sake of simplicity, it is assumed that no other input is made after the operation input is reflected until the operation input is reflected. Implementation of the invention is not limited to this. That is, when operation input is performed for continuous frames or intermittently, the operation input detected at each determination time, such as each frame period or each input period determined by the sampling rate of the operation input unit 206, is sequentially handled. You may make it superimpose the GUI image which concerns on the notification which shows having been input into the game image of the frame to perform. In addition, since the notification that the operation input sequentially detected in this way has been reflected after the predetermined reflection time has elapsed, the user reflects any operation input performed by the user from the notified operation content. You can easily understand what is being done.

  Needless to say, the notification mode need not be limited to the mode shown in FIGS. That is, it is recognized by the user that the notification mode of the operation content corresponding to the operation input made in the implementation of the present invention is reflected with a predetermined time delay after the corresponding operation input is made until the processing result is reflected. Anything can be used if possible. That is, for example, when the user intermittently performs different operation inputs, even if the operation content corresponding to the operation input is notified as shown in FIG. You can keep track of time. Further, when the notification mode is changed according to the elapsed time relating to the delay, not only the transition method and the GUI image as illustrated in FIGS. 4A to 4E but the corresponding processing result is reflected after the operation input is made. Any transition method or GUI image that allows the user to perceive up to may be used. In addition, in the example of FIGS. 4A to 4E, the GUI image 404 as shown in FIG. 4D having an area and brightness that clearly indicates that the reflection has been performed is displayed to notify the user that the reflection has been made. Further, it may be explicitly indicated by using a character string, a symbol, or the like indicating that the GUI image has a color change or reflection.

<< Reflection time acquisition process >>
Here, specific processing of the reflection time acquisition processing executed in the server 100 of the present embodiment having the above-described configuration will be described using the flowchart of FIG. The processing corresponding to the flowchart can be realized by the server control unit 101 reading, for example, a corresponding processing program stored in the server storage medium 102, developing it in the server memory 103, and executing it. The reflection time acquisition process will be described as being started when the server control unit 101 determines that the reflection time is acquired, for example. The reflection time acquisition timing is the number of client devices 200 that provide the service of the server 100 when, for example, a service provision request is made from each of the client devices 200 or when information indicating the first operation input is received after the service provision is started. May be when the total amount of computation in the server 100 has changed, when a predetermined time has passed for measurement of the reflection time, or the like.

  In step S <b> 501, the server measurement unit 105 responds to an operation input when information indicating an operation input made is newly received in consideration of processing currently performed in the server 100 under the control of the server control unit 101. The time required to generate the game screen reflecting the processing result to be performed (reflection screen generation time) is acquired. The time may be, for example, an estimated value calculated by a predetermined function or the like, or may be an actually measured value that is actually measured and measured.

  In step S <b> 502, the server measurement unit 105 acquires a delay time caused by communication with the client device corresponding to the information indicating the operation input. The delay time caused by communication is obtained, for example, by calculating and adding the time required to receive information indicating the operation input made and to transmit the game screen generated based on the operation input indicated by the information. It may be. The acquisition of delay time information is not limited to this, and is necessary for communication from the client device 200, such as referring to the time stamp included in the information indicating the operation input and ping transmission as described above. It may be acquired by feedback of the actual measurement time.

  In step S503, the server measurement unit 105 adds the reflection screen generation time acquired in step S501 and the delay time acquired in step S502, and stores the addition time in the server memory 103.

  In step S504, the server control unit 101 reads the reflection time information stored in the server memory 103, transmits the information to the server communication unit 106, and transmits the information to the corresponding client device 200, thereby completing the reflection time acquisition process.

  As described above, the reflection time information obtained by the reflection time acquisition process is one that can be diverted, for example, the same client device type, the same communication environment, or the same game content for service use. It may also be provided to the client device 200 of the part.

  Further, in the reflection time acquisition process of the present embodiment, it has been described that the reflection time is measured on the server 100 side. However, information indicating a dummy operation input is transmitted, for example, ping transmission, and the information is transmitted to the information. A response protocol may be provided in the game system so that the time until the dummy screen reflecting the corresponding processing result is received can be measured. In this case, the client device 200 measures the reflection time using the protocol and stores the information in the memory 203 at the acquisition timing as described above, such as during the initial communication between the client device 200 and the server 100. Also good.

<< Output screen generation processing >>
Next, specific processing of the output screen generation processing executed in the client device 200 of the present embodiment will be described using the flowchart of FIG. The processing corresponding to the flowchart can be realized by the control unit 201 reading, for example, a corresponding processing program stored in the storage medium 202, developing it in the memory 203, and executing it. Note that the output screen generation process is started at the timing of executing the process for each frame based on the refresh rate of the screen related to the display on the display unit 205.

  In step S <b> 601, the control unit 201 includes information indicating an operation input made within a period corresponding to the output image of the current frame, information on the time when the operation input was made (may be an elapsed time in processing), and To get. In the present embodiment, for the sake of simplicity of explanation, even when the sampling rate of the operation input unit 206 is higher than the display refresh rate, the operation input made from the client device 200 to the server 100 within a predetermined period is received. A description will be given assuming that information is transmitted collectively.

  In step S <b> 602, the control unit 201 associates the information indicating the operation input acquired in step S <b> 601 with information on the time at which the control input is performed, and stores the information in the operation input history table in the memory 203. For example, as shown in FIG. 7, the operation input history table is a table for managing a list of operation inputs for which the processing results corresponding to the operation inputs are not yet reflected on the game screen. It may be information managed in the order of time (detection time) when one record is generated and an operation input is made. In the present embodiment, it is assumed that the operation input history table includes the time when the operation input as shown in FIG. 7 is made so that the delay based on the actual measurement value is reflected in the notification of the operation content as much as possible. Needless to say, for example, a frame number or a time code of a game screen displayed at the same time may be used.

  In step S <b> 603, the control unit 201 determines whether the game screen of the current frame from the server 100 has been received within a predetermined time. It is assumed that the game screen generated in the server 100 is received by the communication unit 207 and stored in the memory 203. In order to complete the generation of the output screen related to one frame within the frame time, in this step, the control unit 201 determines whether the game screen is received within a predetermined time. If the control unit 201 determines that the game screen of the current frame has been received within a predetermined time, the control unit 201 selects the game screen newly stored in the memory 203 in S604 as the game screen for the output screen, and performs processing. Move to S606. If the control unit 201 determines that the game screen of the current frame has not been received within a predetermined time, the control unit 201 selects the game screen stored most recently in the memory 203 in S605 as the game screen for the output screen. The process proceeds to S606.

In step S <b> 606, under the control of the control unit 201, the drawing unit 204 generates an output screen by superimposing a GUI image for notifying operation details of each operation input stored in the operation input history table on the game screen. To do. The GUI image for notifying the operation content may be controlled so that the display mode varies depending on the elapsed time after the operation input is made as described above. For example, when the GUI image for notifying the operation content is generated as a circular image (401, 402, 403, 404) as shown in FIGS. 4A to 4E, the radius r (i) (i is the value on the operation input history table). Record ID) uses elapsed time lapsed and reflection time treflect received from server 100,
(1) When elapsedd ≦ treflect r (i) = rdefault * (1-(tlapsed-treflect) / treflect)
(2) When elapsed> treflect r (i) = rdefault
May be calculated as In the present embodiment, the GUI image is described as being superimposed on the game screen, but the configuration of the output screen is not limited to this. For example, the area for displaying the game screen and the GUI image is separated in the area of the output screen, and the drawing unit 204 may display the GUI image in an area that does not overlap with the game screen in this step.

  In step S <b> 607, the control unit 201 transmits the output screen generated in step S <b> 606 to the display unit 205 for display.

  In step S <b> 608, the control unit 201 refers to the time at which each operation input is stored, which is stored in the operation input history table, deletes the record exceeding the reflection time received from the server 100, and re-operates the operation input history. The table is updated in chronological order to complete the output screen generation process.

  In the present embodiment, the server 100 acquires the reflection time information, and the client device 200 has been described as performing the process of generating the output image by superimposing the GUI image notifying the operation content on the game screen. Implementation of the invention is not limited to this. As described above, the reflection time may be measured and determined by the client device 200. In addition to the notification of the operation content corresponding to the operation input made at the current determination time, it is also possible in the server 100. For example, an output screen including the notification of the operation content considering the reflection time is generated in the server 100. And may be transmitted to the client device 200.

  In addition, it will be easily understood that the present invention need not be limited to a game system that provides a cloud-type game providing service as shown in FIG. In other words, any entity that generates a game screen or an output screen may be used in the implementation of the present invention, and a notification device such as a display device is made to notify that a simple operation input is reflected with a delay. The present invention can be applied to any apparatus that can be used.

  As described above, in the program according to the present embodiment, user operability can be improved in consideration of a response to an operation input. Specifically, the program executed in the computer includes a process of acquiring information indicating the operation input made, and a process of notifying the operation content corresponding to the operation input indicated by the acquired information after a predetermined time delay. , Execute.

[Embodiment 2]
Incidentally, in recent years, electronic devices and the like having a touch input detection interface on a display area of a display device have also become widespread, and such a display mode in which a GUI image indicating an operation input interface is superimposed on a game screen or the like is used. It is becoming common. However, when the GUI image indicating the operation input interface is arranged and displayed on the screen related to the content to be executed, a part of the screen is blocked by the fingering related to the operation during the touch input. Therefore, the visibility of the screen can be reduced, and the user operability can be reduced.

  On the other hand, as described above in the first embodiment, when an operation content corresponding to an operation input made is notified, the area of the GUI image related to the notification superimposed on the game screen on the output screen is reduced. Thus, the visibility of the game screen can be ensured.

  However, since many electronic devices having a touch input detection interface are provided with a small display device, when the visibility of the game screen is ensured, an area for displaying an image related to the operation input interface is limited. Become. In other words, for example, an operation input using a continuous touch input corresponding to a so-called analog stick requires that the user does not perform fingering related to the touch input within a detection area narrower than before on or off the game screen. Don't be. In this case, the desired operation becomes difficult, or when the focus is on the game play because the detection area is narrow, the finger unconsciously moves to the non-detection area, and the operation becomes impossible in the first place. Problems can occur.

  Therefore, in this embodiment, even if the image related to the operation input interface is arranged in a limited touch input detection area in the display area as described above, it is possible to ensure user operability. explain. Hereinafter, this aspect will be described by taking a client device 200 having the same functional configuration as that of the first embodiment as an example. In the present embodiment, a sensor for detecting where a touch input is made on the display area is arranged on the display unit 205 of the client device 200, and the operation input unit 206 acquires a detection result by the sensor. It shall be.

《Touch input judgment processing》
Hereinafter, specific processing of touch input determination processing executed in the client device 200 of the present embodiment will be described with reference to the flowchart of FIG. The processing corresponding to the flowchart can be realized by the control unit 201 reading, for example, a corresponding processing program stored in the storage medium 202, developing it in the memory 203, and executing it. The touch input determination process will be described as being started when a touch input is made in a detection area (target detection area) related to a predetermined operation input provided in the display area of the display unit 205.

  In the following description, for the sake of simplicity, it is assumed that the detection area set for the operation input interface is only the target detection area. Further, the description will be made assuming that the touch input made in the target detection area is determined as an operation input related to an analog stick whose input direction is determined according to the positional relationship between the center of the area and the touch input position. However, the embodiment of the present invention is not limited to touch input related to an analog stick, and can be similarly applied to a detection region provided for an image related to a specific operation input interface where continuous touch input is performed. That will be easily understood.

  In step S <b> 801, the control unit 201 determines whether a touch input is detected by the operation input unit 206. If the control unit 201 determines that a touch input has been detected, the process proceeds to S802. If the control unit 201 determines that a touch input has not been detected, the control unit 201 proceeds to S806.

  In step S <b> 802, the control unit 201 determines whether the detected touch input is an input due to the continued touch input in the target detection area made before that time. If the control unit 201 determines that the touch input in the target detection area is a touch input due to continuing, the control unit 201 moves the process to S803, and if the control unit 201 determines that it is not a touch input due to continuing, the process Is moved to S808.

  In step S803, the control unit 201 determines whether the detection position corresponding to the continued touch input is within the target detection area. The information on the target detection area may be predetermined in the storage medium 202, for example. In addition, when processing for moving the target detection area is performed as will be described later, for example, information on the target detection area after movement is stored in the memory 203, so information on the target detection area after movement is stored in the memory 203. In this step, the control unit 201 may determine whether or not there is a touch input with reference to the information in this step. This determination of the target detection area is the same in the subsequent steps. When it is necessary to refer to the information of the target detection area before the movement, it is clearly indicated as “predetermined target detection area”. To do. If the control unit 201 determines that the detection position is within the target detection region, the process proceeds to S805. If the control unit 201 determines that the detection position is outside the target detection region, the control unit 201 proceeds to S804.

  In step S <b> 804, the control unit 201 responds to the detection position corresponding to the continued touch input so that the continued touch input is determined in the same manner as the previous touch input to the target detection area. To move the position of the target detection area. That is, when the target detection area 901 is arranged at the position shown in FIG. 9A in the output screen, in this step, the control unit 201 can determine that a touch input related to the same type of operation input is made. As shown in FIG. 9B, the position of the target detection area 901 is moved according to the touch input detection position 902. Note that the movement of the position of the target detection area is, for example, when the target detection area is a rectangular area as shown in FIGS. 9A and 9B, with the coordinates of the diagonal vertices for defining the target detection area after moving in the memory 203. This may be done by temporarily storing or updating information. By doing in this way, even if the user unintentionally performs fingering outside the target detection area during continuous touch input, the input content described later is determined. It can be determined that the operation input continues in the process. Further, the position of the target detection area after the movement is moved according to the direction and size of a vector defined by the center position of the target detection area determined in advance and the detection position of the touch input, for example. It may be determined so as to be included in a later target detection area.

  In step S805, the control unit 201 determines the input direction related to the analog stick operation input and the size thereof as necessary according to the predetermined center position of the target detection region and the detection position of the touch input, Output as judgment result. Thereafter, the control unit 201 waits until the next sampling time based on the sampling rate of the touch input, and then returns the process to S801.

  On the other hand, if it is determined in S801 that no touch input has been made to the target detection area, the control unit 201 determines in S806 whether the target detection area has been moved from a predetermined position. If the control unit 201 determines that the target detection area has moved from a predetermined position, the control unit 201 moves the process to S807. If the control unit 201 determines that the target detection area has not moved, the control unit 201 waits until the next sampling time, and then performs the process. Return to S801.

  In step S807, the control unit 201 sets a movement function for sequentially returning the target detection area to a predetermined position, and updates the position of the target detection area stored in the memory 203 based on the movement function. Execute. Alternatively, if a movement function has already been determined, the control unit 201 similarly executes a process of updating the position of the target detection area stored in the memory 203 based on the movement function. For example, the movement function may be determined so as to move exponentially on a straight line connecting the center position of the target detection area and the center position of the predetermined target detection area. In addition, the movement function does not move to a predetermined position for a predetermined period from the time of interruption so that it is possible to detect a touch input near the position of the interruption again when the fingering is interrupted by mistake. It may be configured as follows. If it is determined in this step that the position of the target detection area has returned to a predetermined position, the control unit 201 may delete the information on the position of the target detection area from the memory 203. Thereafter, the control unit 201 waits until the next sampling time, and then returns the process to S801.

  On the other hand, when it is determined that the touch input detected in S802 is not an input due to the continued touch input in the target detection area, the control unit 201 continues the touch in S808. It is determined whether or not the detection position corresponding to the input is within the target detection area. If the control unit 201 determines that the detection position is within the target detection region, the process proceeds to S805. If the control unit 201 determines that the detection position is outside the target detection region, the control unit 201 proceeds to S806.

  In the touch input determination process according to the present embodiment, when the target detection area is moved, unless the touch input is performed on the moved area, it is determined that the corresponding operation input is not performed. Although configured, even when the target detection area is being moved, when a touch input is made to a predetermined target detection area, the control unit 201 detects the target after movement stored in the memory 203. The area information may be deleted, and the determination process may be performed based on information on a predetermined target detection area.

  For the operation input related to the touch input determined as described above, by performing the output screen generation process in the same manner as in the first embodiment, the user operability can be improved in consideration of the response to the operation input. . In this case, disposing the GUI image for notifying the operation content of the operation input around the target detection area after the movement can also reduce the visibility of the game image. Therefore, the GUI image for notifying the operation content is: What is necessary is just to make it superimpose on the periphery of a predetermined object detection area | region. Thus, since the display position of the GUI image for notifying the operation content is fixed, the visibility of the screen is ensured and the operability for the user can be improved. Further, even if the display position of the GUI image is fixed, the corresponding touch input target detection area moves according to fingering and enables detection, so that the operability for the user can be similarly improved. it can.

  Further, in the present embodiment, the description will be made on the basis of the center position of a predetermined target detection region as a reference, and it is described as determining which operation input has been made by touch input. However, the present invention is not limited to this. It is not a thing. For example, when a predetermined target detection area is arranged at the lower left of the output screen as shown in FIG. 9A, the target detection area is moved in order to perform a left or downward input related to an analog stick operation input. In some cases, the user may have to perform a fingering that significantly changes the position where touch input is performed. In this case, since the user may be forced to carry out complicated operations such as having to change the client device 200, for example, the movement component of the touch input detection position in the leftward or downward direction between successive sampling points is generated. If it is larger, the control unit 201 may perform control so that the operation input is determined based on the center of the target detection area after movement.

[Modification 1]
In the second embodiment described above, the example in which the target detection area is moved according to the position where the touch input is made has been described. However, the embodiment of the present invention is not limited to this, for example, according to the position where the touch input is made. When the touch input is made continuously, the size of the target detection area may be temporarily expanded so as to include the position.

[Modification 2]
In the second embodiment described above, for the sake of simplicity, the detection area set for the operation input interface is described as being only the target detection area. However, the embodiment of the present invention is not limited to this. When GUI images related to a plurality of types of operation input interfaces are arranged on the output screen, the detection areas are usually set so as not to overlap each other.

  However, in the second embodiment, when it is determined that the detected touch input is an input due to the continued touch input into the target detection area, the detection position is outside the target detection area. Even if there is, the input detection is performed by moving the target detection area. When the target detection area is moved in this way, the target detection area after movement may overlap with the detection area of the GUI image related to another type of operation input interface. That is, when the touch input is interrupted once after the movement of the target detection area and the touch input is performed again, it may be impossible to determine which of the two detection areas is the touch input.

  In this case, for example, the control unit 201 determines which operation area the user desires to operate according to whether or not the time during which the detected touch input is continuously performed exceeds a predetermined threshold time. You may make it discriminate | determine. That is, when the time that the touch input is continuously performed does not exceed the threshold time, it is considered that the user desires an operation of simply touching the GUI image related to the predetermined operation input interface once. The control unit 201 may determine that the touch input is a detection area that is not a target detection area, that is, a touch input related to another type of operation input. In addition, when the time for which touch input is continued exceeds the threshold time, the touch input that has been continued is interrupted against the user's intention, and the operation input that the user has continued is desired again Therefore, the control unit 201 may determine that the touch input is a touch input for the target detection area.

[Modification 3]
In the second embodiment described above, in an electronic apparatus having a display device provided with a touch input detection interface, the visibility of the game screen is reduced when the GUI image related to the operation input interface is superimposed on the game image in the output image. In addition, operability can be reduced.

  On the other hand, if it is determined that the user has mastered the operation input using the touch input detection interface, such as performing appropriate touch input to take game play time or a desired action, the operation input interface The control unit 201 controls the drawing unit 204 to change the display mode of the GUI image in order to improve the visibility of the game screen, such as switching the GUI image to a simple display with a small area or increasing the transparency. Also good. Alternatively, when an operation that seems to be an erroneous input of the operation input is frequently performed and it is determined that the operation input is not familiar, the visibility of the GUI image of the specific operation input interface is improved instead of the game screen. As described above, the control unit 201 may control the drawing unit 204.

[Modification 4]
In modification 3, although it demonstrated as what changes the display mode of a GUI image according to the skill level which concerns on a user's operation input, implementation of this invention is not limited to this.

  For example, the operation input provided for the game content has a predetermined importance and frequency of use, and there may be a GUI image that is less necessary to be displayed on the output screen in a specific scene. Such a GUI image may give the user an impression that it simply reduces visibility. For example, the visibility of the game screen can be reduced as the area of the arranged GUI image is larger.

  Accordingly, the control unit 201 further includes at least one of a predetermined importance level for the operation content corresponding to the GUI image, a use frequency of the touch input for the operation content, and an image size indicating the detection area for the touch input for the operation content. Accordingly, the drawing unit 204 may be controlled to change the display mode of the GUI image as in the second modification. Further, these changes may be configured so that they can be changed in stages according to the mode set in the content, user settings, and the like.

[Other Embodiments]
The present invention is not limited to the above-described embodiment, and various changes and modifications can be made without departing from the spirit and scope of the present invention. The information processing apparatus according to the present invention can also be realized by a program that causes one or more computers to function as the information processing apparatus. The program can be provided / distributed by being recorded on a computer-readable recording medium or through a telecommunication line. Therefore, in order to make the scope of the present invention public, the following claims are attached.

  This application claims priority based on Japanese Patent Application No. 2014-184621 filed on Sep. 10, 2014, the entire contents of which are incorporated herein by reference.

Claims (23)

A computer having notification means for notifying the operation content corresponding to the operation input made;
Processing to obtain information indicating the operation input made;
Processing for notifying the notification means of the operation content corresponding to the operation input indicated by the acquired information with a predetermined time delay;
A program that executes   The program according to claim 1, wherein the notifying process further notifies the notifying unit that a processing result corresponding to an operation input indicated by the acquired information is reflected after the predetermined time has elapsed.   The notifying process is configured to notify the notifying unit while sequentially changing a notification mode of an operation content corresponding to the operation input until a processing result corresponding to the operation input indicated by the acquired information is reflected. Item 3. The program according to item 1 or 2.   The notification means includes the notification content of an operation content corresponding to an operation input made at a first time point and an operation content corresponding to an operation input made at a second time point after the first time point. The program according to any one of claims 1 to 3, wherein the program is notified.   The program according to claim 4, wherein the operation input made at the second time point includes an operation input made at the current determination time point.   6. The program according to claim 4, wherein the operation input made at the first time point includes an operation input made before the predetermined time.   The program according to any one of claims 4 to 6, wherein the operation input made at the first time includes an operation input in which a corresponding processing result is reflected at a current determination time. The notification by the notification means is performed by displaying an operation content corresponding to the operation input made in the display area of the display device,
8. The notification unit according to claim 1, wherein the notifying process notifies the notifying unit so that the object is displayed at a position in the display area corresponding to an operation input performed during the predetermined time. The program described in the section.   The program according to any one of claims 1 to 8, wherein the predetermined time is a time required until a processing result corresponding to an operation input indicated by the acquired information is reflected. The computer further includes detection means for detecting a touch input made in a display area of a connected display device,
The process to obtain is
Obtain information indicating the touch input made within a given detection area,
While the touch input that is determined to be continued by the detection means is being made, when the position corresponding to the touch input moves out of the predetermined detection area, the touch input that was made before the movement is performed The program according to any one of claims 1 to 9, wherein information indicating the touch input is acquired by determining that the operation is performed.   The computer according to claim 10, further causing the computer to execute a process of changing the predetermined detection area according to a position corresponding to the touch input when a position corresponding to the touch input moves outside the predetermined detection area. The program described.   After the predetermined detection area is changed according to the position corresponding to the touch input, when the touch input that is determined to be continued is no longer detected by the detection means, the predetermined detection whose position has been changed The program according to claim 11, further causing the computer to execute a process of returning the area to the position before the change.   The program according to claim 12, wherein the process of returning the predetermined detection area to the position before the change includes sequentially changing the position of the predetermined detection area to the position before the change.   In the acquisition process, after the predetermined detection area is changed according to the position corresponding to the touch input, the touch input that is determined to be continued is not detected by the detection means, and the position is changed. When the touch input to a predetermined detection area is further detected by the detection means, it is determined that the touch input of the same type as the touch input determined to be continued is made, and the touch input The program according to any one of claims 11 to 13, which acquires information indicating   The acquisition process includes: a detection area related to a touch input of another operation content at a position corresponding to the touch input when a touch input to the predetermined detection area whose position has been changed is further detected by the detection unit; The program according to claim 14, wherein information indicating a touch input acquired according to a type of the touch input is made different.   The acquisition process includes: a detection area related to a touch input of another operation content at a position corresponding to the touch input when a touch input to the predetermined detection area whose position has been changed is further detected by the detection unit; 16. The program according to claim 14, wherein information indicating the touch input to be acquired is made different according to a length of time when it is determined that the touch input is continued. The notification process is as follows:
Displaying an image indicating that a touch input corresponding to the detection area is made in the predetermined detection area of the display device;
17. When the predetermined detection area is changed according to a position corresponding to a touch input, an image indicating that the touch input is made is displayed at a position before the change. The program according to item 1. The program is
A process of determining a user's proficiency level related to touch input;
A process of displaying an image indicating a touch input detection area of the target operation content or an image indicating that the touch input of the operation content is made in the display area of the display device;
Further executing on the computer,
In the processing to be displayed, for the operation content whose user proficiency satisfies a predetermined standard in the determination processing, an image indicating a touch input detection area of the operation content or touch input of the operation content is performed. The program of any one of Claims 10 thru | or 17 which changes the display mode of the image which shows this. The program further causes the computer to execute a process of displaying an image indicating a touch input detection area of a target operation content in a display area of the display device,
The display process is performed according to at least one of a predetermined importance level for the operation content, a use frequency of the touch input for the operation content, and a size of an image indicating a detection area of the touch input for the operation content. The program according to any one of claims 10 to 18, wherein a display mode of an image indicating a detection area of touch input of content is changed.   The program according to claim 18 or 19, wherein the image transparency change is controlled to increase or decrease according to an elapsed time or the number of times a predetermined operation input is made.   A computer-readable recording medium on which the program according to any one of claims 1 to 20 is recorded. Obtaining means for obtaining information indicating the operation input made;
An information processing apparatus having notification means for notifying the operation content corresponding to the operation input made,
The information processing apparatus that notifies the operation content corresponding to the operation input indicated by the information acquired by the acquisition unit with a predetermined time delay. Obtain information indicating the operation input made,
A notification method for notifying the operation content corresponding to the operation input made,
A notification method for notifying the operation content corresponding to the operation input indicated by the acquired information with a predetermined time delay.