JP2009301092A - Item-selecting device, item selection method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an item-selecting device which is suitable in rapidly selecting an item from an item list by operating a touch screen, and to provide an item-selecting method, and a program. <P>SOLUTION: A storage part 201 stores the list with the items to be selected as elements, and the position of a window for covering a part of the list. A display part 202 displays the elements of the list existing in an window area. hen a user contacts the display part 202 and performs a shake-off operation, a movement part 205 updates the storage part 201, to move the position of the window, based on the change of a contact position immediately before the user releases the contact among the changes of the contact position detected by a detecting part 203. Thus, the element of the list to be displayed by the display parts 202 is changed. When the user starts contact and substantially does not move the contact position, until the release of the contact, an item output part 204 outputs the item of the element displayed in coordinate value as a selection result. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

The present invention relates to an item selection device, an item selection method, and a program suitable for quickly selecting an item from an item list by operating a touch screen.

2. Description of the Related Art Conventionally, techniques for improving the operability of game characters have been proposed in games and the like in which an input operation is performed by touching a touch screen (or touch panel). Such a technique is disclosed in the following documents, for example.
Japanese Patent No. 3924579

  In the technique disclosed in Patent Document 1, when a contact member such as a touch pen is brought into contact with the touch screen, based on a position where the touch pen is first contacted and a position where the touch pen is moved in contact (that is, moved while being in contact), The moving direction and moving distance of the touch pen are calculated. Character rotation processing is performed to rotate the character so that the character is directed in a predetermined direction according to the moving direction and moving distance of the touch pen, and character propulsion processing is performed to propel the character 70 in the predetermined direction.

  On the other hand, when selecting an item from an item list, there is a strong demand for a simpler method using a touch screen.

  The present invention is intended to solve the above problems, and provides an item selection device, an item selection method, and a program suitable for quickly selecting an item from an item list by operating a touch screen. Objective.

  In order to achieve the above object, an item selection device according to a first aspect of the present invention includes a storage unit, a display unit, a detection unit, an item output unit, and a moving unit.

  The storage unit stores a table whose elements are items to be selected and a position of an area covering a part of the table. Each element of the table is arranged in at least one or more rows and columns. The area covering a part of the table designates the area of the table displayed by the display unit described later. That is, the displayed table item is determined according to the position where the area is arranged.

  A display part displays the element contained in the area | region where a position is memorize | stored in a memory | storage part among the said tables. Here, the display unit is a so-called touch screen on which a touch sensor is superimposed. Note that the position of the area covering a part of the table changes according to an instruction given by the user touching the touch screen, and the item displayed on the display unit also changes according to the change in the position.

  The detection unit detects the position when the user is in contact with the surface of the display unit, and detects the position when the user releases the surface. That is, when the user touches the touch screen, the detection unit detects a coordinate value indicating the position. The detection unit detects that there is no contact when there is no contact with the touch screen. The detection unit detects the detection state at predetermined time intervals, for example.

  The item output unit displays the item of the element displayed at the detected position when the position detected until the user releases the surface after the user touches the surface is within a predetermined range. Output as selection result. That is, when the user releases the touch screen without moving the touch position while touching the touch screen, the item output unit assumes that the item displayed at the touched position is selected. Output.

  When the position detected until the user releases the surface after the user touches the surface is not within a predetermined range, the moving unit detects the surface of the speed representing the change in the position that contacts the surface. The speed immediately before releasing is acquired, and the position of the area stored in the storage unit is moved based on the speed.

  That is, the moving unit calculates the moving speed and moving direction of the area according to the contact moving speed immediately before the user releases the touch screen, and moves the position of the area covering a part of the table. Therefore, when scrolling and displaying a displayed table item in order to select a desired item, the user performs an operation of sweeping the touch screen (that is, touching the touch screen and changing the contact position). The operation of releasing the touch screen may be performed while keeping the change in the contact position at 0 or more. On the other hand, if the touch position is not moved immediately before releasing the touch screen, the table is not scrolled and displayed.

  According to such an item selection device, an item to be displayed is determined based on a change speed of a position where the user touches the touch screen. Therefore, in order to increase the scroll speed when the items in the table are displayed, the touch screen may be swept at a high speed. Compared with a typical method in which a key indicating a direction to be scrolled is pressed for a predetermined time or more in order to increase the scroll speed, the waiting time can be eliminated, and the operability is improved. Further, the moving unit moves the position of the region covering a part of the table based on the direction in which the sweep operation is performed, so that the target can be quickly selected from the elements of the table arranged two-dimensionally. The item can be found out.

  Moreover, you may make it further provide the contact member for the said user to pinch and contact the said surface. At this time, the contact member may have a pick shape or a shape in which a protrusion is arranged at the tip of the pick shape. That is, the contact member is a so-called touch pen, and the handle portion has a guitar pick shape so that the user can easily perform the sweeping operation, and the tip has a protrusion so that the contact position can be easily detected. You may make it prepare.

  By using such a contact member, it is possible to perform an operation of sweeping the touch screen more easily, and the operability of the touch screen can be further improved.

  Further, the moving unit may move the position of the region along either one of the row or the column of the table. At this time, the direction in which the position of the area is moved is the direction closest to the direction of the acquired speed, and the speed of moving the position of the area moves so as to increase as the acquired speed increases. You may let them.

  That is, the moving unit moves the position of the region covering a part of the table in the vertical direction or the horizontal direction. At this time, the moving unit calculates the vertical direction component and the horizontal direction component for the speed direction of the contact movement immediately before the user releases the touch screen, and moves the region in the direction having the larger component. On the other hand, the movement speed of the area is determined based on the speed immediately before the user releases the touch screen. If the speed of the contact movement immediately before the release is slow, the movement speed of the position of the area is also slowed down. If the speed is high, the moving speed of the position of the area is also high.

  By determining the moving direction of the area covering a part of the table in the vertical direction or the horizontal direction in this way, the user can easily grasp the part of the table where the currently displayed item is located. , You can quickly find the item you want to select.

  Further, the moving unit may cyclically move the position of the area when the position of the area reaches the end of the table. For example, a case will be described in which each element of the table is arranged in M rows and N columns (M, N: any positive integer). At this time, the moving unit is arranged with the first row, the second row, the third row,... Following the Mth row, and the first column, the second column, the third column,. You may move the position of the said area so that it may be arranged. Or, before the first row, the Mth row, the M−1th row, the M-2th row,... Are arranged, and before the first row, the Nth column, the N−1th column, and the N−2 The position of the area may be moved so that the columns are arranged. Thereby, the items in the table are displayed cyclically.

  In addition, when the position of the area reaches the end of the table, the moving unit may reverse the direction in which the position of the area is moved. That is, instead of displaying the items cyclically as described above, when the end of the table is reached, the elements of the table are displayed as if the position of the region bounced back and moved in the opposite direction.

  Thus, even if the area covering a part of the table reaches the end of the table, the user can search for the selection item without operating the touch screen again by not stopping the scrolling.

  In addition, the moving unit is configured so that the element displayed at the position where the user starts contact with the surface is displayed at the contact position while the user is in contact with the surface. You may make it move the position of the said area | region.

  In other words, while the user is in contact with the touch screen, the area displayed on the display unit (that is, the area covering a part of the table) so that the item displayed at the contact position moves together with the contact position. Move the position. Thereby, the user can move the item of the table | surface currently displayed little by little. Also, for example, when the user sweeps the surface of the touch screen and starts to move the position of the area (that is, when the scroll display of the table is started), the user touches the touch screen again to change the touch position. If it does not move, since the position of the area is linked to the contact position as described above, the scroll display can be stopped.

  In addition, the item output unit has a predetermined position within a predetermined range after the user touches the surface and releases the surface, and further, a time from the contact to the release is predetermined. When the time is equal to or shorter than the threshold time, the item of the element displayed at the detected position may be output as the selection result.

  Here, as described above, when the user sweeps the surface of the touch screen and starts scroll display, the user can stop the scroll display by touching the touch screen again. At this time, if there is almost no change in the position at the time of contact again, by adding a condition of a threshold time, whether the contact is simply for stopping movement, or an item displayed at the contact position It is possible to determine whether the selection is made. That is, when selecting the touched item, the position of the touch screen on which the item is displayed is quickly touched (below the threshold time). On the other hand, when the user simply wants to stop the scroll display, the user may touch the same position on the touch screen for a predetermined threshold time or longer.

  An item selection method according to another aspect of the present invention is an item selection method by an item selection device including a storage unit, a display unit, a detection unit, an item output unit, and a moving unit, and includes a display step, a detection step, and an output A process and a moving process.

  Here, the storage unit stores a table whose elements are items to be selected and a position of an area covering a part of the table.

In the display step, the display unit displays elements included in the area of the table where the position is stored in the storage unit.
In the detection step, the detection unit detects the position if the user is in contact with the surface of the display unit, and detects that if the surface is released.
In the output step, the item output unit is displayed at the detected position when the position detected until the user releases the surface after the user touches the surface is within a predetermined range. The element item is output as the selection result.

  In the moving step, the moving unit represents a change in the position in contact with the surface when the position detected until the user releases the surface after the user contacts the surface is not within a predetermined range. Among the speeds, the speed immediately before releasing the surface is acquired, and the position of the area stored in the storage unit is moved based on the speed.

  A program according to another aspect of the present invention is configured to cause a computer to function as the item selection device. A program according to another aspect of the present invention is configured to cause a computer to execute the item selection method.

  The program of the present invention can be recorded on a computer-readable information recording medium such as a compact disk, flexible disk, hard disk, magneto-optical disk, digital video disk, magnetic tape, and semiconductor memory. The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed. The information recording medium can be distributed and sold independently of the computer.

  According to the present invention, it is possible to provide an item selection device, an item selection method, and a program suitable for quickly selecting an item from an item list by operating a touch screen.

  As will be described later, the game device according to the present embodiment broadly functions as an item selection device and a sound processing device. That is, first, the user selects a music piece for which a guitar performance simulation is to be performed from a music list by using a game device as an item selection device. Next, a guitar performance simulation is performed using the selected music piece in the game device as the sound processing device.

  FIG. 1 is a schematic diagram showing a schematic configuration of a typical portable game device in which an item selection device and a sound processing device according to an embodiment of the present invention are realized. FIG. 2 is an external view of the portable game device. Hereinafter, a description will be given with reference to FIG.

  The game apparatus 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an interface 104, an input unit 105, a memory cassette 106, and an image processing unit 107. A touch screen 108, a NIC (Network Interface Card) 109, an audio processing unit 110, a microphone 111, and a speaker 112.

  A memory cassette 106 (details will be described later) storing a game program and data is loaded into a slot (not shown) connected to the interface 104, and the game apparatus 100 is turned on to execute the program. Thus, the item selection device and the sound processing device of the present embodiment are realized.

  The CPU 101 controls the overall operation of the game apparatus 100 and is connected to each component to exchange control signals and data. The CPU 101 includes a clock (not shown), and peripheral devices operate in synchronization with a signal generated by the clock.

The ROM 102 stores an IPL (Initial Program Loader) that is executed immediately after the power is turned on. When the CPU 101 executes this IPL, the program recorded in the memory cassette 106 or the like is read out to the RAM 103, and execution by the CPU 101 is started.
The ROM 102 stores an operating system program and various data necessary for operation control of the entire game apparatus 100.

  The RAM 103 is for temporarily storing data and programs, and holds programs and data read from the memory cassette 106 and other data necessary for the progress of the game.

  The memory cassette 106 detachably connected via the interface 104 has a read-only ROM area for storing a program for realizing the game and image data and sound data accompanying the game, as described above, and a play area. And an SRAM area for saving data such as results. The CPU 101 performs a reading process on the memory cassette 106, reads a necessary program and data, and temporarily stores the read data in the RAM 103 or the like.

  The input unit 105 is a control button or the like shown in FIG. 2, and receives an instruction input from the user.

  The image processing unit 107 processes the data read from the memory cassette 106 by the CPU 101 or an image arithmetic processor (not shown) included in the image processing unit 107, and then processes the processed data in a frame memory ( (Not shown). The image information recorded in the frame memory is converted into a video signal at a predetermined synchronization timing and output to a touch sensor type display (touch screen 108). Thereby, various image displays are possible.

  The image calculation processor can execute a two-dimensional image overlay calculation, a transmission calculation such as α blending, and various saturation calculations at high speed.

  In addition, the polygon information arranged in the three-dimensional virtual space and added with various kinds of texture information is rendered by the Z buffer method, and a rendering image obtained by overlooking the polygon arranged in the three-dimensional virtual space from a predetermined viewpoint position is obtained. High speed execution of the obtained operation is also possible.

  Further, the CPU 101 and the image arithmetic processor operate in a coordinated manner, so that a character string can be drawn as a two-dimensional image in a frame memory or drawn on the surface of each polygon according to font information that defines the character shape. is there. The font information is recorded in the ROM 102, but it is also possible to use dedicated font information recorded in the memory cassette 106.

  The touch screen 108 is a liquid crystal panel configured by overlapping touch sensors. The touch screen 108 detects position information corresponding to the position pressed by the user with a finger or an input pen, and inputs the detected position information to the CPU 101.

  Note that data temporarily stored in the RAM can be appropriately stored in the memory cassette 106 in accordance with an instruction input by the user via the input unit 105 or the touch screen 108.

  The NIC 109 is for connecting the game apparatus 100 to a computer communication network (not shown) such as the Internet. For example, when the game device is wirelessly connected to a LAN (Local Area Network), the NIC 109 is configured by an interface (not shown) compliant with a standard such as IEEE 802.11. In addition, when connecting to a LAN by wire, one that conforms to the 10BASE-T / 100BASE-T standard, an analog modem for connecting to the Internet using a telephone line, an ISDN (Integrated Services Digital Network) modem, an ADSL ( Asymmetric Digital Subscriber Line) modem, a cable modem for connecting to the Internet using a cable television line, etc., and an interface (not shown) that mediates between these and the CPU 101.

  It is also possible to obtain current date and time information by connecting to an SNTP server in the Internet via the NIC 109 and acquiring information therefrom. In addition, various network game server devices may be configured and configured to perform the same functions as the SNTP server.

  The sound processing unit 110 converts the sound data read from the memory cassette 106 into an analog sound signal, and outputs the analog sound signal from the speaker 112 connected to the sound processing unit 110. Further, under the control of the CPU 101, sound effects and sound data to be generated during the progress of the game are generated, and sound corresponding to the sound effects and sound data are output from the speaker 112.

  When the audio data recorded in the memory cassette 106 is MIDI data, the audio processing unit 110 refers to the sound source data included in the audio data and converts the MIDI data into PCM data. If the compressed audio data is in ADPCM format or Ogg Vorbis format, it is expanded and converted to PCM data. The PCM data is subjected to D / A (Digital / Analog) conversion at a timing corresponding to the sampling frequency, and output to the speaker 112 or the like, thereby enabling voice output.

  The audio processing unit 110 performs A / D conversion on the analog signal input from the microphone 111 at an appropriate sampling frequency, and generates a PCM format digital signal.

  In addition, the game apparatus 100 is configured to include a DVD-ROM drive that reads programs and data from the DVD-ROM instead of the memory cassette 106, and the DVD-ROM has the same function as the memory cassette 106. You may do it. The interface 104 may be configured to read data from an external memory medium other than the memory cassette 106.

  Alternatively, the game apparatus 100 may be configured to perform the same function as the ROM 102, the RAM 103, the memory cassette 106, and the like using a large-capacity external storage device such as a hard disk.

  The item selection device and the sound processing device according to the present embodiment are realized on a portable game device, but may be realized on a general computer. Similar to the game apparatus 100, a general computer includes a CPU, RAM, ROM, NIC, and the like, an image processing unit having a simpler function than the game apparatus 100, and a hard disk as an external storage device. In addition, flexible disks, magneto-optical disks, magnetic tapes, etc. can be used. In addition, a keyboard and a mouse are used as an input device instead of the input unit. Then, after the program is installed, when the program is executed, it can function as an item selection device and a voice processing device.

  Hereinafter, the item selection device will be described, and then the voice processing device will be described. Unless otherwise noted, the item selection device and the sound processing device will be described using the game device 100 shown in FIG. The item selection device and the sound processing device can be appropriately replaced with general computer elements as necessary, and these embodiments are also included in the scope of the present invention.

(Item selection device)
FIG. 3 is a block diagram showing a schematic configuration of the item selection device 200 according to the present embodiment. As shown in FIG. 3, the item selection device 200 includes a storage unit 201, a display unit 202, a detection unit 203, an item output unit 204, a moving unit 205, and the like. As will be described later, the item selection device 200 may include a contact member 206 as shown in FIG. Below, each component of the item selection apparatus 200 is demonstrated with reference to this figure.

  The storage unit 201 stores a table whose elements are items to be selected. The table is in a two-dimensional array with at least one row and column. For example, when a plurality of songs are selected and reproduced using the game apparatus 100, the table may be configured with each of the songs as an element. In the case of a one-dimensional table having N elements, the table is divided into groups of A, and a two-dimensional table with A rows and N / A columns (or N / A rows and A columns). You may make it comprise. The memory cassette 106, the RAM 103, and the like function as the storage unit 201 in cooperation.

  The display unit 202 acquires table configuration information from the storage unit 201, and generates table image data (see 300) as illustrated in FIG. In the figure, the table includes elements of 5 rows and 4 columns, but the size of the table is not limited to this. In the present embodiment, in consideration of the case where the size of the table is larger than the size of the touch screen plane, a window (see 310) having an area of a predetermined size that covers a part of the image data of the table. Prepare. The size and position of the window are stored in the storage unit 201. The position of the window is updated to move based on a user operation instruction. The display unit 202 acquires the position of the window stored in the storage unit 201, and displays the elements of the table included in the area covered by the window as shown in FIG. 4B, for example.

  Note that the list of items displayed in FIG. 4B does not match the boundary of the element and the boundary of the display area, but may be adjusted so that they always match.

  Thus, since the area covered by the window is the area displayed by the display unit 202, hereinafter, the window and the area are used as the same meaning unless otherwise noted. The CPU 101, the RAM 103, the image processing unit 107, the touch screen 108, and the like work together to function as the display unit 202.

  The position of the window is, for example, the coordinate value (for example, the number of pixels in the X direction and the Y direction from O to O ′) of the origin O ′ of the window from the origin O of the table (for example, upper left of the table). To express. If the size of the displayed table in the X direction is W, the size w of the cell in which each element is displayed (see 301 in FIG. 4A) is W / N (N: column). If the size in the Y direction of the table is L, the size l of the cell in the Y direction is L / M (M: the number of rows).

  The detection unit 203 detects whether there is a touch on the touch screen at a predetermined time interval. The position of the touch screen plane touched by the user is represented, for example, as a coordinate value with the upper left corner of the touch screen as the origin. In addition, when the touch screen is not touched, the detection unit 203 detects that the touch screen is not touched. The touch screen 108, the CPU 101, and the like cooperate to function as the detection unit 203.

  When the item output unit 204 determines that the user starts touching the touch screen and releases the touch screen without moving the contact position based on the detection result of the detection unit 203, the item output unit 204 is in contact with the touch screen. The items displayed in are output as selection results. Here, “without moving substantially” means that all the positions detected after the contact is started and released are within a predetermined range. The CPU 101 or the like functions as the item output unit 204.

  The moving unit 205 acquires the speed of the contact movement immediately before releasing the touch screen when it is determined from the detection result of the detection unit 203 that the user has moved in contact with the touch screen. And based on the said speed, it updates so that the position of the window memorize | stored in the memory | storage part 201 may be moved. When the display unit 202 displays the area of the table covered by the moving window, the table is scrolled and displayed.

  Further, while the touch screen is being touched by the user, the moving unit 205 is configured such that the same items displayed at the touch position when the touch screen is started are displayed at the touch position. Move the window position. That is, the item that is in contact when the contact is started is fixed at the contact position. Therefore, when the table is scrolling, if the touch screen is touched again, the content displayed at the contact position is fixed at the contact position, and the scroll can be stopped. The moving unit 205 functions as the moving unit 205 in cooperation with the CPU 101, the RAM 103, the memory cassette 106, and the like.

(Operation processing)
The processing operation of the item selection device 200 having the above configuration will be described with reference to FIG.

  When the item selection device 200 is turned on, the CPU 101 executes an IPL, whereby an initialization process such as reading a program recorded in the memory cassette 106 into the RAM 103 is performed. When the item selection process is started as the program progresses, first, the display unit 202 displays a selection screen showing a part of the items to be selected as a list (step S400). In the present embodiment, the item to be selected is information (song number, etc.) for specifying the music for which the guitar simulation is performed.

  At this time, as described above, the display unit 202 acquires table configuration information from the storage unit 201 and generates table image data. Since the position of the window is arranged at the origin of the table in the initial state, the display unit 202 is covered with the window width W in the X direction and the window length L in the Y direction from the origin of the table. Display area.

  Next, when the detection unit 203 detects the coordinate value, the CPU 101 accumulates it in the storage unit 201 (step S401). The accumulated coordinate values are used later to calculate the speed of change of the contact position.

  Subsequently, the CPU 101 determines whether or not the state detected by the detection unit 203 has changed (step S402). That is, when the coordinate value is detected last time, the state is changed when the current release state (that is, the state where the touch screen is not touched) is detected or when a coordinate value different from the previous value is detected. It is determined. Alternatively, if any coordinate value is detected this time when the previous detection is in the released state, it is determined that the state has changed. While the state does not change (step S402; N), the CPU 101 returns to step S402 again and waits for the state to change.

  If the CPU 101 determines that the detection state has changed (step S402; Y), it then determines whether the current detection is in the released state or a coordinate value (step S403).

  If it is the coordinate value detected this time (step S403; N), the CPU 101 then determines whether the previously detected state is a released state or a different coordinate value (step S410). If the last detected state is the released state, it is determined that the contact has been started by the user (step S410; Y), and the CPU 101 determines the coordinate value on the touch screen and the position of the window when the contact is started. Are temporarily stored in the RAM 103 (step S411). Then, the process returns to step S400.

  On the other hand, if the coordinate value detected this time is the coordinate value (step S403; N) and the previously detected state is not the released state (step S410; N), the coordinate value is different from the previously detected coordinate value. Means that it has been detected this time. That is, the contact position is moved in the contacted state. At this time, the moving unit 205 moves the window so that the element displayed at the previously touched position is dragged to the currently touched position (step S412).

  That is, as shown in FIG. 6A, when the previously detected state is the coordinate value (p1, q1) and the current detected state is the coordinate value (p, q), the contact position is p- It moves in the X direction by p1 and in the Y direction by q-q1. Therefore, as shown in FIG. 6B, the moving unit 205 moves the position (x1, y1) of the window 310 in the reverse direction (ie, (x1- (p-p1), y1-). 6B, the moved window is represented as 310 ′, and the position of the window 310 ′ is represented by (x, y) = (x1− (p−p1), y1−. (q-q1)).

  For example, in FIG. 6C, the upper left part of the element GG is in contact. When the contact position is moved in the direction of the arrow shown in FIG. 6C in the contacted state, the window position is moved by the same amount of change in the opposite direction to the direction of change of the contact position. As a result, as shown in FIG. 6D, the upper left portion of the element GG is shown at the contact position as in FIG. 6C.

  If the window position changes due to the drag operation and the window area extends beyond the table area, the window position (x, y) is always rearranged to indicate the coordinates in the table area. . For example, when the position of the window reaches the end of the table, the position of the window is moved to a position opposite to the table. That is, when the table is represented in the area surrounded by the origin (0, 0), (W, 0), (0, L), (W, L), the boundary line of the table 300 indicated by X = W Is treated as a boundary line with X = 0, and a boundary line indicated by Y = L is treated as a boundary line with Y = 0.

  Therefore, if the coordinate value indicating the window position is larger than W in the X direction, it is added to 0. Further, the portion smaller than 0 in the X direction is subtracted from W. On the other hand, the portion larger than L in the Y direction is added to 0. Also, the portion smaller than 0 in the Y direction is subtracted from L. In this way, the position of the window is moved around.

  For example, in FIG. 7A, the position of the window 310 is at a position (-cx, -dy) from the origin of the table 300 (c and d are arbitrary constants), and (-cx, -dy) is a table 300. In the case of being outside the area, the window position is rearranged to (W-cx, L-dy) within the table area. The rearranged window is denoted by 310 '.

  Thereby, the process returns to step S400, and when the display unit 202 displays the area of the table currently covered by the window, the element displayed at the position of the touch screen touched by the user is moved by the user. It is displayed as if it was dragged to the destination position. Note that the size of the window is stored in the storage unit 201 in advance.

  However, in the case where a part of the window area is arranged so as to protrude from the table in accordance with the movement of the window position in step S412, the display unit 202 displays the table row for the window area protruding from the table, And it displays cyclically so that the first and last elements of each column are adjacent.

  This is calculated as follows, for example. For example, let W and L be the sizes in the X direction and Y direction of the table 300, respectively, and let W ′ and L ′ be the sizes in the X direction and Y direction of the window 310, respectively. If the coordinate value of the origin O ′ of the window 310 is (x, y), the area of the table to be displayed is (x, y), (x + W ′, y), ( x, y + L ′) and (x + W ′, y + L ′). If the coordinate value of an arbitrary point in the area of the table to be displayed is (s, t), the coordinate value ((s ', t') = (s mod W, t mod L) is calculated. s ′, t ′) circulates and gives the coordinate value in the table area even when the window area is arranged beyond the table area.

  Thus, for example, as shown in FIG. 7B, when the window 310 is located in the table 300, the displayed table elements are as shown in FIG. 7C.

  On the other hand, if the detected state is the released state (step S403; Y), the item output unit 204 determines whether or not the coordinate values accumulated in the storage unit 201 in step S400 are within a predetermined range. Determination is made (step S404).

  For example, when all the accumulated detection positions are included in an area having a predetermined radius, it is determined that the contact position has not moved (step S404; Y), and the item output unit 204, for example, The table item currently displayed in the average coordinate value of the detection position is output as a selection result (step S405).

  When the selection result is obtained, the item selection process ends, and the CPU 101 performs a predetermined process based on the obtained selection result.

  The accumulated coordinate values may be discarded after step S405 (step S420).

  On the other hand, when all the accumulated detection positions are not within the predetermined range (step S404; N), it is determined that the contact position is moving, and the CPU 101 moves the contact position immediately before the contact is released. Is calculated, and it is determined whether or not the calculated moving speed is equal to or higher than a predetermined threshold speed (step S406).

For example, the detected coordinates immediately before the contact is released are (p1, q1), and the immediately preceding detected coordinates are (p2, q2) (these are the latest coordinate values accumulated in the storage unit 201, When the time interval detected by the detection unit 203 is T1 seconds, the velocity vector indicating the change in the contact position immediately before the contact is released is obtained by the following equation. :
((P1-p2) / T1, (q1-q2) / T1)

  If the larger component of the x component and the y component is equal to or higher than the predetermined threshold speed (step S406; Y), it is determined that the user has performed a sweeping operation on the touch screen, and the moving unit 205 Moves the window position in the direction of the larger component at a speed corresponding to the user's sweeping speed (step S407).

  That is, when the x component is larger than the y component, it means that the direction of the moving speed of the contact position immediately before the contact is released is close to the x direction. Therefore, the position of the window is moved in the row direction (left-right direction) at a speed of (p1-p2) / T1. On the other hand, when the y component is larger than the x component, it means that the direction of the moving speed is close to the y direction. Therefore, the position of the window is moved in the row direction (vertical direction) at a speed of (q1-q2) / T1. The calculated moving speed of the contact position in the x direction and y direction may be multiplied by a predetermined coefficient as the moving speed of the window. If the magnitudes of the x component and the y component are the same, the component is moved in the predetermined direction of either the row or the column at the speed of the component in that direction.

  Next, the display unit 202 performs the same processing as step S400, and displays the area covered by the window in the table including the selection items as elements (step S408). Then, the CPU 101 determines whether contact has been detected (step S409). If it is determined that contact has been detected (step S409; Y), the CPU 101 proceeds to step S411 assuming that contact has started. On the other hand, while no contact is detected (S409; N), the process returns to step S407. As a result, until the next contact is detected, the table is scroll-displayed by the display unit 202 in the row direction or the column direction based on the speed of the contact movement immediately before sweeping.

  Further, as described above with respect to the drag operation, when the window reaches the boundary of the front image, the moving unit cyclically moves the position of the window.

  On the other hand, when the CPU 101 determines that the moving speed of the contact position is slower than the predetermined speed (step S406; N), the process returns to step S400. Thus, the item selection process ends.

(Speech processor)
Next, a description will be given of the audio processing apparatus 1000 that realizes a guitar performance simulation with the music specified by the music selected as described above.

  FIG. 9 is a schematic diagram showing a schematic configuration of the speech processing apparatus 1000 according to the present embodiment. As shown in FIG. 9, the audio processing apparatus 1000 includes a detection unit 1001, an audio output unit 1002, and the like. Note that the voice processing apparatus 1000 may include a contact member 206 (see FIG. 8), as will be described later. Hereinafter, each component of the speech processing apparatus 1000 according to the present embodiment will be described with reference to this drawing.

  The detection unit 1001 is the same as the detection unit 203 of the item selection device, and detects whether there is a touch on the touch screen at a predetermined time interval. The position of the touch screen plane touched by the user is represented, for example, as a coordinate value with the upper left corner of the touch screen as the origin. When the touch screen is not touched, it is detected that the touch screen is not touched. The touch screen 108, the CPU 101, and the like cooperate to function as the detection unit 1001.

  The audio output unit 1002 determines whether an operation performed on the touch screen by the user satisfies a predetermined operation condition based on the detected result, and starts output of the output audio if the operation is satisfied. Control to stop or stop. The audio processing unit 110 or the like functions as the audio output unit 1002.

(Operation processing)
The operation processing of the speech processing apparatus according to the present embodiment having the above configuration will be described below.

  The memory cassette 106 stores accompaniment sound, performance sound, timing at which the performance sound should be output, and the like corresponding to the attribute information of the music, such as the music title.

  When a song is selected by a user's instruction and a predetermined control button is pressed to give an instruction to start a game, the CPU 101 expands accompaniment sound corresponding to the song from the memory cassette 106 to the RAM 103. Then, the data is output to the speaker 112 or the like via the audio processing unit 110. The accompaniment sound includes a guide performance sound like a karaoke guide melody, for example, and indicates to the user the timing at which the performance sound should be output. The user operates the touch screen in accordance with the guide performance voice so that a predetermined operation condition is satisfied (that is, the voice processing device 1000 determines that the stroke operation is effective).

  Or you may make it notify a user visually the timing which outputs the present performance sound. For example, a marker that advances in a predetermined direction at a predetermined interval with time is displayed, and a timing marker that indicates the timing at which the performance sound is output is displayed in the direction in which the marker advances. The user may perform an operation on the touch screen so that a predetermined operation condition is satisfied when the moving marker reaches the timing marker. The timing for outputting each performance sound is expressed as a relative time from the start time when the start time of the accompaniment sound is set to 0, for example, and stored in correspondence with each performance sound. Is done.

  Hereinafter, with reference to FIG. 10, a flow of processing in which the voice processing apparatus 1000 according to the present embodiment outputs or stops voice according to the operation of the touch screen by the user will be described.

  First, in step S500, the detection unit 1001 detects the state of the touch screen. That is, if there is a contact, a coordinate value indicating the position where the contact has occurred, and if there is no contact, it is detected that there is no contact. If the previous detection by the detection unit 1001 is a coordinate value, the CPU 101 stores the coordinate value prepared in the RAM 103 or the like in an accumulation area. Since there is no state detected before in the initial state, the coordinate value is not accumulated and the process proceeds to step S501.

  As is clear from the subsequent processing, the accumulated coordinate values are the trajectories of all the coordinate values detected continuously or a part thereof. After the release state is detected or an effective stroke operation is specified, the accumulated coordinate value is discarded, and accumulation of the detected coordinate is started again from that point. The coordinate values stored in this way are used later when determining the output volume and the like.

  Next, the CPU 101 determines that all of the detection coordinates accumulated for a predetermined number of cases are within a predetermined range (for example, from the midpoint of the detection coordinates accumulated for the predetermined number of cases or an average value, Whether or not all detection coordinates are included in the range is specified (step S501). If all the detected coordinates are within a predetermined range (step S501; Y), it means that the change of the contact position is stopped for a predetermined time. If there is an object outside the range (step S501; N), it means that a predetermined number of detected coordinates have been changed. In the case of Step S501; N, the processing continues to Step S502.

  The CPU 101 determines whether or not the state detected by the detection unit 1001 has changed from the state detected last time (step S502). That is, when the previous coordinate value is detected, either the current release state (that is, the state in which the touch screen is not touched) is detected, or the coordinate value different from the previous one is detected. When satisfied, it is determined that the state has changed. If the release state is detected last time, if any coordinate value is detected this time, it is determined that the state has changed. While the state does not change (step S502; N), the CPU 101 returns to step S500 again and waits for the state to change. The state detected last time is temporarily stored in the RAM 103, for example.

  If the CPU 101 determines that the detection state has changed (step S502; Y), the CPU 101 next determines whether the current detection is a release state or a coordinate value (step S503).

  If the detected value is not the released state but the coordinate value (step S503; N), the previously detected state is the released state or another coordinate value. First, if the previous detection is in the released state (step S521; Y), the CPU 101 returns the process to step S500. In step S500, when the previously detected state is a coordinate value, the previously detected coordinate value is accumulated. Therefore, the coordinate value specified as the position where the contact was started in step S521 is Stored when step S500 is executed.

  On the other hand, when the coordinate value detected this time is a different coordinate value from the previously detected coordinate value (step S521; N), it means that the position of the contact detected continuously has changed. At this time, the CPU 101 calculates a movement vector (movement direction) of the contact position (step S531). The movement vector is obtained by subtracting the coordinate value detected this time from the coordinate value accumulated in step S501 and the previous coordinate value (that is, the latest accumulated coordinate value). Then, the movement vector is compared with the movement vector of the contact position obtained by executing the previous step S531 (the result of executing the step S531 is temporarily stored in the RAM 103), and is almost opposite. It is determined whether or not (step S532).

  That is, the CPU 101 obtains the inner product of the movement vector obtained this time and the movement vector of the contact position obtained by executing step S531 last time. If the inner product is smaller than the negative predetermined value, it is determined that the two vectors are substantially opposite (step S532; Y). On the other hand, if the inner product is larger than the predetermined value, it is determined that the two vectors are not in opposite directions (step S532; N).

  Note that when the contact position detected continuously after the start of contact has changed for the first time, there is no “previous movement direction”. Therefore, in this case, the moving direction is treated as not changing in the reverse direction (ie, the process proceeds as step S532; N).

  As described above, when it is determined that the direction of the stroke has changed in the opposite direction (that is, when it is determined as S532; Y), in this embodiment, it is determined that an effective reciprocating stroke has been performed. To do. If it is determined that a valid reciprocating stroke has been made at a time within a predetermined range before and after the timing at which the performance sound is to be output, the sound output unit 1002 stores the performance sound stored in association with the timing. Is obtained from the RAM 103, the volume is specified by a predetermined method (step S533), and output is started (step S534). On the other hand, even if an effective reciprocating stroke is performed, if it is not performed at a time within a predetermined range before and after the performance sound is to be output, the sound output unit 1002 fails in step S534. Outputs a voice indicating. Note that the time during which the performance sound is continuously output after the output of the performance sound is started is determined in advance.

  A method of determining the volume of the performance sound output by the sound output unit 1002 when an effective reciprocating stroke operation is performed will be described with reference to FIG. FIG. 11 shows a case where contact is started from point A, folded back at point B to perform a reverse stroke, and then folded back at point C to perform a stroke.

  In the example of FIG. 11, the first time that the stroke has changed in the reverse direction is identified when the contact position immediately after point B (ie, point B ′) is detected. Therefore, it is determined that the effective reciprocating stroke operation is performed only when the point B ′ is detected. In this case, the volume is determined according to the distance from the point A where the contact is started to the point B just before the movement direction changes, and a performance sound is output. Similarly, when a point C 'is detected, it is determined that an effective reciprocating stroke operation has been performed again, the volume is determined according to the distance from the point B' to the point C, and a performance sound is output.

  The distance from the point A to the point B or the point B ′ to the point C may be a linear distance or the length of the locus. Here, the length of the trajectory is, for example, the sum of the linear distances between the contact coordinates detected continuously from the point A to the point B or from the point B ′ to the point C. In the present embodiment, regardless of which distance is used, the larger the obtained distance, the larger the sound volume that is output. For example, even if a volume is obtained by multiplying the obtained distance by a predetermined constant, or a table showing the volume according to the distance is prepared, the corresponding volume is calculated from the calculated volume by referring to the table. May be obtained.

  Note that after the accumulated detection coordinates are discarded in step S535, the contact position detected this time is accumulated in the RAM 103 when the processing returns to step S500. Therefore, the position where the contact is started immediately after the effective stroke operation is performed is always stored as the oldest coordinate value of the accumulated detected coordinates. Thereafter, the coordinate values detected continuously are continuously accumulated. Thus, the value immediately before it is determined that an effective stroke operation has been performed is stored as the newest coordinate value among the accumulated detected coordinate values. Therefore, the audio output unit 1002 can obtain a coordinate value necessary for calculating the distance by referring to the accumulated detected coordinate value.

  Finally, for use in later-described processing, the fact that the reciprocating stroke operation has been performed is stored in the RAM 103 or the like (for example, a reciprocating flag indicating whether or not the reciprocating stroke operation has been performed may be prepared in the RAM 103). (Step S536).

  In this embodiment, as will be described later, it is determined that an effective stroke operation has been performed even when the user has swung the touch screen in one direction. However, the performance sound is output even when the user performs a reciprocating stroke operation and starts a reverse stroke. Therefore, after the reciprocating stroke operation, it is unnatural that the user performs a swinging operation and the performance sound is output again.

  Therefore, in the present embodiment, when the release state is detected, it is specified with reference to the reciprocating flag whether or not the reciprocating stroke operation has been performed immediately before (step S504). If the reciprocating stroke operation is stored in the reciprocating flag (step S504; Y), the information on the reciprocating flag is discarded (step S505). Further, the accumulated detected coordinates are discarded (step S506), and the process returns to step S500. That is, when the reciprocating stroke operation is performed immediately before the release state is detected, the performance returns to step S500 without outputting the performance sound.

  On the other hand, when the reciprocating stroke operation has not been performed immediately before the release state is detected (step S504; N), the CPU 101 calculates the change speed of the contact position immediately before the release state is detected (step S504). S507). If the speed of the change is equal to or higher than the threshold speed (step S507; Y), the CPU 101 determines that the operation of shaking in one direction has been performed effectively (that is, an effective one-way stroke operation has been performed). To do.

  If it is determined in step S507 that an effective one-way stroke operation has been performed within a predetermined range before and after the timing at which the performance sound is to be output, the sound output unit 1002 is stored in association with the timing. The performance sound is acquired from the memory cassette 106. Then, the volume of the performance sound is specified by a predetermined method (step S508), and the performance sound is output at the volume (step S509). However, when the time at which the stroke operation is determined to be valid is not included in a predetermined range before and after the timing at which the performance sound is to be output, the sound output unit 1002 outputs a sound indicating failure.

  The sound volume is specified based on the distance from the position where the contact detection is started to the contact position immediately before the released state is detected. Similar to step S533, the distance between the two points may be a linear distance or the length of a trajectory, and the distance is obtained by acquiring accumulated detection coordinate values. It is done.

  In step S501, detection positions for a predetermined number of cases are accumulated, and if all the detection positions are within a predetermined range (step S501; Y), the CPU 101 stops changing the contact position for a predetermined time. It is determined that If there is a sound output when it is determined that the change in the contact position is stopped for a predetermined time, the sound output unit 1002 stops the output (step S541). At this time, a special mute sound may be output. On the other hand, when the change of the contact position stops for a predetermined time and no sound is output, the sound output unit 1002 advances the process to step S542 without doing anything. In step S542, the CPU 101 discards all the accumulated detection coordinates and returns to step S500.

  As described above, the voice processing device outputs and stops the voice.

(Other embodiments)
In the first embodiment, it is assumed that the voice processing device has performed an effective stroke operation when it is determined that it has been swept away or when the direction of the stroke with respect to the touch screen changes in the reverse direction. did. This makes it possible to determine an effective stroke operation regardless of the direction in which the user holds the game device, the direction in which the user performs a stroke, or the like.

  In the present embodiment, a determination line corresponding to a guitar string is introduced to more faithfully reproduce a mechanism for producing a guitar sound. Then, similarly to the above-described embodiment, a voice processing device that absorbs the direction in which the user holds the game device, the direction in which the stroke is performed, and the like and enables simulation of guitar performance will be described. This determination line may or may not be displayed on the touch screen.

  FIG. 12 shows a functional block diagram of the speech processing apparatus 1000 according to the present embodiment. In this embodiment, in addition to the detection unit 1001 and the audio output unit 1002 provided in the above embodiment, an adjustment unit 1003 is further provided.

  However, instead of the determination condition described in the above embodiment, the voice output unit 1002 performs an effective stroke operation when the locus of the contact position continuously detected crosses a predetermined determination line. (That is, a predetermined operation condition is satisfied).

  Further, the adjustment unit 1003 adjusts the direction and position of the determination line so that the angle at which the direction of the determination line intersects the trajectory of the contact position that is continuously detected approaches a right angle. Here, the determination line is for simulating a guitar string arranged on the touch screen plane. That is, in the present embodiment, the speech processing apparatus 1000 considers that an effective stroke operation has been performed when the user straddles the determination line while touching the touch screen.

  The direction and position of the determination line are stored in the memory cassette 106 based on, for example, the global coordinate system, and are read into the RAM 103 when a game start is instructed by the user. As described above, the memory cassette 106, the RAM 103, the CPU 101, and the like cooperate to function as the adjustment unit 1003.

  Hereinafter, the operation processing of the sound processing apparatus shown in FIG. 12 having the above-described configuration will be described with reference to FIG.

  First, step S601 is the same as step S500 shown in FIG. 10, and the speech processing apparatus 1000 accumulates the coordinate value when the coordinate value is detected. Also in the present embodiment, as is clear from the subsequent processing, the coordinate values accumulated in step S601 are the locus of coordinate values detected continuously or a part thereof. After the release state is detected or an effective stroke operation is specified, the accumulated coordinate value is discarded, and accumulation of the detected coordinate is started again from that point.

  Next, if all of the accumulated detection positions for the predetermined number are within the predetermined range (step S602; Y), it means that the change of the contact position has stopped for a predetermined time. Accordingly, the same processing as in steps S541 and S542 is performed, and the audio output unit 1002 stops the output if there is an audio output at that time (steps S610 and 611).

  If all the detection positions corresponding to the predetermined number in step S602 are not within the predetermined range (step S602; N), the CPU 101 next determines whether or not the release state is detected (step S603). When the release state is detected (step S603; Y), the CPU 101 discards all the accumulated detection positions (step S604), and returns the process to step S601.

  On the other hand, when the detected value is not a released state but a coordinate value (step S603; N), the CPU 101 subsequently determines whether or not the locus of the contact position straddles the determination line ( Step S620). That is, it is determined whether or not the line segment connecting the coordinate value detected this time and the previously accumulated coordinate value intersects the determination line.

  In the present embodiment, when the locus of the contact position crosses the determination line (step S620; Y), it is determined that an effective stroke operation has been performed. Therefore, as in the first embodiment, when it is determined that an effective stroke operation has been performed within a predetermined range before and after the timing at which the performance sound is to be output, the sound output unit 1002 performs the timing. The performance sound stored in association with is acquired from the memory cassette 106. Then, the volume of the acquired performance sound is specified by a predetermined method (step S621), and output of the performance sound is started (step S622). However, if it is determined that the locus of the contact position has crossed the determination line at a time that is not included in the predetermined range before and after the timing at which the performance sound is to be output, the sound output unit 1002 outputs a sound indicating failure. . As in the first embodiment, the performance sound is output with a predetermined length.

  In the present embodiment, the volume of the performance sound is determined from the coordinate value detected immediately after the time point when it was determined that the previous determination line was straddled among the locus of the contact position continuously detected. It specifies based on the distance to the coordinate value detected immediately before it was determined that the line was crossed. Here, as in the first embodiment, the distance between the two points may be a linear distance or the length of a trajectory. Moreover, what is necessary is just to make it sound volume increase, so that the length of the obtained distance is large.

  With reference to FIG. 14 (A), the distance specified in order to calculate a sound volume is demonstrated. FIG. 14A shows an example of a locus of coordinate values continuously detected on the touch screen plane 1081. First, the stroke operation is started at the point P, and the determination line L is straddled while the point Q-1 is detected from the point Q-1. Further, the stroke operation is continued, it is turned back at the point R, and the determination line is straddled while the point S-1 to the point S are detected again.

  In the example of FIG. 14A, when a stroke is made from point P to R, it is determined that point Q has been detected and determination line L has been straddled for the first time. However, since the locus of the detected coordinates has not crossed the determination line L before that, the point P that is the contact start position is defined as “the coordinate value detected immediately after it is determined that the previous determination line has been crossed” The sound volume is specified based on the distance from P to the coordinate value Q-1 detected immediately before crossing the determination line. The distance may be a linear distance or a moving distance (Michinori).

  Subsequently, when a stroke is performed by turning back at point R, when point S is detected, it is specified that determination line L has been straddled again. In this case, since “the coordinate value detected immediately after it was determined that the determination line was crossed last time” is the point Q, from the point Q to the coordinate value S-1 detected immediately before the determination line was crossed this time. The volume is specified based on the distance.

  As is clear from the flowchart shown in FIG. 13, in the present embodiment, accumulation is performed from the coordinate values at the time when the stroke is started. If it is determined that the stroke of the contact position has crossed the determination line and an effective stroke operation has been performed, the detected coordinates accumulated so far are discarded in step S624, which will be described later, and first after the determination line has been straddled. The coordinate values detected continuously from the detected coordinate values are accumulated. That is, for example, when the stroke operation is further continued from the point Q as in the example of FIG. 14A, the detected coordinates are accumulated again from the point Q.

  Therefore, refer to the stored coordinate values even when the determination line is straddled for the first time after the contact is started, or when the contact is continued after straddling the determination line and the determination line is straddled again. Thus, information necessary for the above-described distance calculation can be acquired.

  If the line segment connecting the contact position detected this time and the contact position detected last time does not straddle the determination line (step S620; N), the coordinate value detected this time is processed, and the process subsequently executes step S601. When this is done, it is accumulated as a locus of the contact position detected continuously.

  Next, the adjustment unit 1003 adjusts the position of the determination line (step S623). For example, a case where the user performs a stroke operation from point P to point R in FIG. 14A will be described as an example. As described above, when the point Q is detected, it is determined that the determination line has been straddled. Therefore, the adjustment unit 1003 makes the determination line L perpendicular to the line segment connecting the point Q detected at the time when it is determined that the determination line has been straddled, and the point Q-1 detected immediately before that. The positions and directions of the determination lines are updated so that the determination lines L are rotated by an angle θ as shown in FIG. The center for rotating the determination line L may be a point where the determination line and the locus of the detection coordinates intersect, or a predetermined position (for example, the center of the touch screen).

  When the power of the game apparatus is turned off, the position and direction of the determination line at the time when the power is turned off are written back to the memory cassette 106. Next time, the rewritten value is used as the position and direction of the determination line. Alternatively, the position of the determination line may be updated from the initial state every time the power is turned on.

  In this way, by adjusting the determination line so that the direction of the stroke and the determination line intersect perpendicularly, the direction in which the user holds the game device, the direction in which the stroke is performed, and the like are absorbed, and the user can easily operate. Thus, it becomes possible to customize the voice processing apparatus.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above, A various deformation | transformation and application are possible. Moreover, it is also possible to freely combine the constituent elements of the above-described embodiments.

  For example, the item selection device and the sound processing device may further include a contact member, and the user may use the contact member when contacting the touch screen. As shown in FIG. 8A, the contact member 206 is a so-called touch pen deformation, and may have a guitar pick shape so that an operation of sweeping the touch screen can be easily performed. In addition, a protrusion may be provided at the tip so that contact can be easily detected by the detection unit 203 or the detection unit 1003. The user pinches the guitar pick-shaped portion of the contact member 206 as shown in FIG. 8B and brings the protruding portion into contact with the touch screen.

  FIG. 8C shows a state in which the user performs a simulation of playing the guitar by using the contact member 206 to bring the contact member 206 into contact with the touch screen plane 1081. The dotted line indicates the locus of the change in contact position (ie, stroke). At this time, the determination line L is adjusted by the adjustment unit so as to intersect the direction of the stroke substantially perpendicularly.

  In addition, in the item selection device according to the above embodiment, if the touch screen is touched while the table is scrolling, the content displayed at the contact position is fixed at the contact position, and the scrolling is stopped. it can. However, if the detected coordinates are all within a predetermined range from the start of contact until it is released, the item output unit outputs the item displayed at that coordinate as the selection result. When the button is released, not only the scrolling is stopped, but also the item displayed at the coordinate value touched is selected.

  Thus, for example, all the detected coordinates are within a predetermined range from when contact is started until it is released, and the time from when contact is started until it is released is a predetermined threshold value. Only when it is within the time, the item output unit may output an item displayed at the coordinates as a selection result. As a result, when the same position is touched for a predetermined threshold time or longer until it is released, no selection is made and the position of the window when the user touches continues to be displayed.

  Further, in the above embodiment, the moving unit of the item selection device moves the window position by limiting the vertical or horizontal direction according to the direction of the sweeping operation performed by the user on the touch screen. did. Instead, the window may be moved in the direction opposite to the speed of change of the contact position immediately before releasing the contact. Thereby, the table is scrolled and displayed in directions other than the vertical direction and the horizontal direction.

  Moreover, in the said embodiment, the moving part of the item selection apparatus cyclically moved the position of the said area | region, when the position of a window reaches the edge of a table | surface. Instead, it may be moved in the opposite direction.

  For example, when the table is represented in the area surrounded by the origin (0,0), (W, 0), (0, L), (W, L), the window position (x, y) If it is not included in the region, the value subtracted from W for the portion larger than W in the X direction may be used as the coordinate value in the X direction. Alternatively, for the portion smaller than 0 in the X direction, the value added to 0 may be used as the coordinate value in the X direction. On the other hand, a value larger than L in the Y direction is subtracted from L, and a value smaller than 0 in the Y direction may be set to a coordinate value in the Y direction.

  In the above embodiment, the moving unit of the item selection device moves the window position in step S407 using the speed of change of the contact position immediately before the released state is detected. Instead, in step S407, the moving speed of the window position may be gradually reduced by multiplying the calculated speed of the contact position immediately before release by a predetermined coefficient.

  In another embodiment, the adjustment unit of the voice processing device may adjust the determination line based on past stroke operations. For example, a direction vector (hereinafter referred to as an intersection vector) obtained by subtracting the contact position detected immediately before it from the contact position at the time point when it is specified that the determination line intersects at the time of stroke operation is obtained. Then, the addition vector newly obtained by normalizing the intersection vector by adding it to the addition vector is temporarily stored. In the initial state, since the addition vector has no value, the calculated intersection vector becomes the addition vector. Then, the position and orientation of the stored determination line are updated so as to intersect perpendicularly with the addition vector.

  For example, when the stroke shown in FIG. 14 (A) is performed, as shown in FIG. 14 (C), the crossing vector is a vector extending from point Q-1 to Q, and from point S-1 to point S. The vector is extended, and the addition vector is vector A.

  Thereafter, similarly, when intersecting with the determination line, an intersection vector is obtained and added to the addition vector to normalize. However, since it is necessary to align the direction of the intersection vector and the addition vector when adding, the inner product of the two vectors is obtained. As a result of the inner product, when a value smaller than the negative predetermined value is obtained, it is considered that the two direction vectors are substantially opposite to each other. Therefore, the intersection vector obtained this time is multiplied by minus to align the directions and added to the addition vector. On the other hand, when the inner product is larger than the predetermined value, the intersection vector may be added to the addition vector as it is. Then, the position and orientation of the determination line are updated so as to intersect perpendicularly with the addition vector.

  In this way, by adding the intersection vector in the stroke operation to the addition vector that is the sum of the past intersection vectors, it becomes possible to extract the “癖” of the user's stroke more accurately.

  Alternatively, a direction vector from the start position to the end point of the stroke that intersects the determination line may be used instead of the intersection vector. Here, the end point of the stroke is the position immediately before releasing the contact when swung. On the other hand, when a reciprocating stroke operation is performed, it is the position immediately before the direction of the stroke is reversed.

  Further, in the audio processing device according to the above embodiment, the audio output unit determines the volume based on the distance from when contact is started until a predetermined operation condition is satisfied. Instead, the volume is determined based on a representative value (for example, average speed) of the change speeds of any two continuously detected contact positions out of the locus of contact positions detected continuously. Also good. That is, the higher the speed, the larger the volume.

  In the sound processing apparatus according to the above embodiment, the time for which the sound output unit continues to output the performance sound is determined in advance. Instead, it is continuously output based on a representative value (for example, average speed) of the change speeds of any two continuously detected contact positions among the locus of the contact positions continuously detected. The length of the performance sound to be played may be determined. That is, the performance sound may be output for a longer time as the speed is higher.

  Further, the audio output unit may start outputting audio after a predetermined time has elapsed after the operation condition is satisfied. For example, when a performance is performed in a wide place, a person who is far from the performer receives a sound after some delay time has elapsed since the operation was performed. Therefore, by inserting the delay time in this way, it is possible to provide the effect of playing in a wide place even in a portable game machine.

  In this case, the sound output unit may return the delay time to the default value when release is detected, and shorten the delay time every time the operation condition is satisfied. Usually, it is considered that the delay is less likely to be felt when the stroke is continuously performed than when the stroke is performed only once. Therefore, in order to emphasize the initial delay, if the operation condition is continuously satisfied, the delay time may be shortened gradually by reducing the delay time compared to the case where the operation condition was previously satisfied. Good.

  In addition, in the item selection device and the sound processing device according to the above-described embodiment, the detection unit is hardware that detects the presence / absence of contact and the contact position, such as a touchpad, a trackpad, and a tablet. May be.

  In addition to the game device, the item selection device and the sound processing device according to the above embodiments may be realized in other terminal devices including a touch screen.

It is a mimetic diagram showing an outline composition of a typical game device by which an item selection device concerning one embodiment is realized. It is a figure which shows the external appearance of the typical game device with which the item selection apparatus which concerns on one Embodiment is implement | achieved. It is a functional block diagram of the item selection device concerning one embodiment. (A) is a figure which shows the table | surface and window in the item selection apparatus which concern on one Embodiment, and those relationship, (B) is a mode that the element of the table | surface covered with the window is displayed on a touch screen. FIG. It is a flowchart explaining the processing operation of the item selection apparatus which concerns on one Embodiment. (A) And (B) is a figure explaining the moving direction of the window with respect to the movement of the touch position of a touch screen, (C) and (D) are the table | surfaces displayed with respect to the movement of a touch position. It is a figure which shows the mode of a change of an area | region. (A) shows how the windows are rearranged when the position of the window extends beyond the area of the table, and (B) and (C) show the table when the window reaches the edge of the table. It is a figure which shows a mode that an element circulates and is displayed. (A) is a figure which shows the example of a pick-shaped touch pen, (B) is a figure which shows a mode that the user has the pick-shaped touch pen, (C) uses such a touch pen, It is a figure which shows a mode that the user is simulating a guitar performance on a touch screen. It is a functional block diagram of the speech processing unit concerning one embodiment. It is a flowchart explaining the processing operation of the audio | voice processing apparatus which concerns on one Embodiment. It is a figure which shows the example of the locus | trajectory of a contact position. It is a functional block diagram of the audio processing apparatus which concerns on other embodiment. It is a flowchart explaining the processing operation of the audio processing apparatus which concerns on other embodiment. (A) shows an example of the locus of the contact position, (B) shows how the position and orientation of the judgment line are adjusted, and (C) shows a method for obtaining the stroke direction when adjusting the judgment line. FIG.

Explanation of symbols

100 game machine 101 CPU
102 ROM
103 RAM
104 Interface 105 Input Unit 106 Memory Cassette 107 Image Processing Unit 108 Touch Screen 109 NIC
DESCRIPTION OF SYMBOLS 110 Audio | voice processing part 111 Microphone 112 Speaker 200 Item selection apparatus 201 Storage part 202 Display part 203 Detection part 204 Item output part 205 Moving part 206 Contact member 1000 Audio | voice processing apparatus 1001 Detection part 1002 Audio | voice output part 1003 Adjustment part

Claims (9)

A storage unit for storing a table including the item to be selected as an element and a position of an area covering a part of the table;
Of the table, a display unit that displays elements included in an area whose position is stored in the storage unit,
If the user is in contact with the surface of the display unit, the position is detected; if the user is releasing the surface, a detection unit that detects the fact;
When the position detected by the user touching the surface and releasing the surface is within a predetermined range, the item of the element displayed at the detected position is output as a selection result. Item output section,
If the position detected by the user touching the surface until the surface is released is not within a predetermined range, immediately before releasing the surface among the speeds indicating the change in the position of contacting the surface. And a moving unit that moves the position of the area stored in the storage unit based on the speed,
An item selection device comprising: The item selection device according to claim 1,
A contact member for the user to pinch and contact the surface;
The contact member has a pick shape or a shape in which a protrusion is arranged at a tip of the pick shape. The item selection device according to claim 1 or 2,
The moving unit moves the position of the area along one of the row or column of the table, and the direction in which the position of the area is moved is the direction closest to the direction of the acquired speed. , The speed of moving the position of the region is moved to increase as the acquired speed increases,
An item selection device. The item selection device according to claim 3,
When the position of the area reaches the end of the table, the moving unit cyclically moves the position of the area.
An item selection device. The item selection device according to claim 3,
When the position of the area reaches the end of the table, the moving unit reverses the direction of moving the position of the area.
An item selection device. The item selection device according to any one of claims 1 to 5,
The moving unit is configured so that an element displayed at a position where the user starts contact with the surface is displayed at a position where the user is in contact with the surface while the user is in contact with the surface. An item selection device characterized by moving the position of an area. The item selection device according to claim 6,
In the item output unit, the position detected from when the user touches the surface until the user releases the surface is within a predetermined range, and the time from the contact to the release is a predetermined threshold. An item selection device that outputs an item of an element displayed at the detected position as a selection result when the time is less than or equal to the time. An item selection method for selecting an item by an item selection device including a storage unit, a display unit, a detection unit, an item output unit, and a moving unit,
The storage unit stores a table whose elements are items to be selected, and a position of an area covering a part of the table,
A display step in which the display unit displays elements included in an area of the table in which the position is stored in the storage unit;
If the detection unit is in contact with the surface of the display unit, the position of the detection unit, if the user has released the surface, a detection step of detecting that,
When the position detected by the item output unit after the user touches the surface until the user releases the surface is within a predetermined range, the item of the element displayed at the detected position Output process to output as a selection result,
If the position detected until the moving unit releases the surface after the user touches the surface is not within a predetermined range, the speed representing the change in the position contacting the surface A moving step of acquiring a speed immediately before releasing the surface and moving a position of an area stored in the storage unit based on the speed;
An item selection method comprising: Computer
A storage unit for storing a table including the item to be selected as an element and a position of an area covering a part of the table;
Of the table, a display unit that displays elements included in an area whose position is stored in the storage unit,
If the user is in contact with the surface of the display unit, the position is detected; if the user is releasing the surface, a detection unit that detects the fact;
When the position detected by the user touching the surface and releasing the surface is within a predetermined range, the item of the element displayed at the detected position is output as a selection result. Item output section,
If the position detected by the user touching the surface until the surface is released is not within a predetermined range, immediately before releasing the surface among the speeds indicating the change in the position of contacting the surface. And a moving unit that moves the position of the area stored in the storage unit based on the speed,
A program characterized by functioning as

Images