JP6490288B1 - Electronic device, system, method and program - Google Patents

Electronic device, system, method and program Download PDF

Info

Publication number
JP6490288B1
JP6490288B1 JP2018163277A JP2018163277A JP6490288B1 JP 6490288 B1 JP6490288 B1 JP 6490288B1 JP 2018163277 A JP2018163277 A JP 2018163277A JP 2018163277 A JP2018163277 A JP 2018163277A JP 6490288 B1 JP6490288 B1 JP 6490288B1
Authority
JP
Japan
Prior art keywords
tensor data
user operation
touch panel
conductive portion
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018163277A
Other languages
Japanese (ja)
Inventor
洋輝 花岡
洋輝 花岡
Original Assignee
株式会社Cygames
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社Cygames filed Critical 株式会社Cygames
Priority to JP2018163277A priority Critical patent/JP6490288B1/en
Application granted granted Critical
Publication of JP6490288B1 publication Critical patent/JP6490288B1/en
Application status is Active legal-status Critical

Links

Images

Abstract

The present invention provides an electronic device capable of identifying a type of user operation from indirect multi-touch in a system using an existing capacitive touch panel as a board. The present invention provides an electronic device in a board game system 1 including a capacitive touch panel, an object used by being placed on the touch panel, and an object at least a part of which is a conductive portion. 10, wherein the conductive portion causes the conductive portion on the bottom surface to cause a change in capacitance of the predetermined amount or more at a position corresponding to each of the conductive portions on the bottom surface when the conductive portion is touched by the user The electronic device 10 is based on tensor data created by arranging a matrix representing touch event occurrence positions at regular intervals on a time axis and reference tensor data stored in advance in a pattern database for each type of user operation. To determine the type of user operation. [Selected figure] Figure 1

Description

  The present invention relates to an electronic device or the like including a capacitive touch panel, and more particularly to an electronic device or the like in a system using the capacitive touch panel as a board.

  In recent years, smart devices provided with a touch panel such as a smartphone and a tablet computer are widely and widely used, and the touch panel is increasing in size. Although there are various types of touch detection methods for touch panels, among them, capacitive touch panels capable of multi-touch detection are adopted in many smart devices. However, generally, there are about 10 touch positions at which multi-touch can be detected.

  Under these circumstances, attempts have been made to use smart devices as boards for board games. If a large smart device touch panel can be used as a board game board such as chess or Dragon Quest (registered trademark), effects when moving pieces, automatic application of rules such as HP and MP automatic calculation, attacks and It can dramatically improve board game performance such as recovery performance.

  Under such circumstances, the present applicant has proposed a board game system in which the existing capacitive touch panel can be used as a board of a board game in Japanese Patent No. 6152211.

Patent No. 6152211

  According to Patent Document 1, when a single person grips a piece molded using a material containing a conductor such as metal in an amount that does not react with the touch panel by itself, energization with the human body is performed. A technology is disclosed that makes it possible, for the first time, to utilize the number of pieces exceeding the multi-touch recognition upper limit by utilizing the phenomenon that the capacitance on the touch panel is sufficiently changed.

  In the technology disclosed in Patent Document 1, a user generates a multi-touch event indirectly to a touch panel via a piece, and at this time, generates a multi-touch event of a combination of positions different for each piece. In addition, the technology disclosed in Patent Document 1 stores the multi-touch event generated for each frame, associates the state of the frame with the touch event, and manages the state, so that the indirect multi-touch by the user via the frame ( Indirect multi-touch) identifies the type of user operation. As described above, a touch event that occurs when a piece is installed for the same piece and a touch event that occurs when a piece is released have similar signals, so the placement or removal of a piece from this generated touch event It is difficult to identify the type of user operation such as.

  That is, the touch event generated by the user operation is a stateless signal derived from an electrical change or the like that occurs instantaneously between the piece and the touch panel. In such a case, it is difficult to identify a user operation from indirect multi-touch without using a system that manages the state of a piece in association with a touch event, that is, without using a stateful recognition technology.

  In order to realize a system combining the above pieces and the existing capacitive touch panel with a simpler implementation, a technology for identifying the type of user operation from a stateless signal caused by indirect multi-touch is required It is done. The present invention has been made to solve such a problem, and in a system using an existing capacitive touch panel as a board, it is possible to identify the type of user operation from indirect multi-touch. Main purpose is to provide various electronic devices and the like.

  In order to achieve the above object, an electronic device according to an aspect of the present invention includes an electronic device including a capacitive touch panel capable of detecting a multi-touch by detecting a change in capacitance, and the electronic device An electronic device for identifying a type of user's operation on the touch panel through the object, The parts are arranged at the bottom surface which contacts the mounting surface of the touch panel when the object is mounted on the touch panel, and the parts are separated via a non-conductive part or a gap, and the object is mounted on the touch panel When the conductive portion is not touched by the user, the conductive portion on the bottom surface When the conductive portion is touched by the user, the conductive portion on the bottom surface changes the capacitance of the predetermined amount or more by a position corresponding to each of the conductive portions on the bottom surface. The electronic device creates tensor data in which a matrix representing touch event occurrence positions at constant time intervals is arranged on a time axis, based on touch events generated due to the user operation. And extracting the tensor data of a predetermined part from the created tensor data, and based on the extracted tensor data and reference tensor data stored in advance in a pattern database for each type of the user operation, the type of the user operation To determine.

  In the present invention, preferably, the type of the user operation includes an operation of placing the object on the touch panel and an operation of lifting the object from the touch panel.

  Further, preferably, in the present invention, the electronic device determines the type of the user operation by using the extracted tensor data and reference tensor data associated with the type of the user operation stored in the pattern database. The degree of similarity is calculated, and the type of user operation is determined by using the type of user operation associated with the reference tensor data with the highest degree of similarity.

  In the present invention, preferably, the tensor data of the predetermined portion includes tensor data of a portion corresponding to a start time of the user operation and tensor data of a portion corresponding to an end time of the user operation. The tensor data corresponding to the start time and the end time, the degree of similarity includes a degree of temporal similarity, and the electronic device stores the extracted tensor data and the user operation stored in the pattern database. The temporal similarity is calculated based on the change time of the number of touch events in each of the start time and the end time in reference tensor data associated with a type.

  Further, in the present invention, preferably, the conductive portion is disposed on the bottom surface via a non-conductive portion or an air gap so as to be different in position according to the type of the object, and the electronic device is the user In determining the type of the operation, the type of the object and the type of the object are determined based on the extracted tensor data and reference tensor data stored in the pattern database in advance for each type of the object and each type of the user operation. Determine the type of user operation.

  In the present invention, preferably, the similarity includes a spatial similarity, and the electronic device determines the extracted tensor data and reference tensor data associated with the type of the user operation stored in the pattern database. The degree of spatial similarity is calculated based on the distance of each touch event occurrence position in the matrix at a point in time.

  In the present invention, preferably, the system is a board game system using the touch panel as a board, and the object is a game piece.

  Further, in order to achieve the above object, a system according to one aspect of the present invention includes an electronic device including a capacitive touch panel capable of detecting a multi-touch by detecting a change in capacitance, and the touch panel A system comprising: an object placed and used on an upper surface and at least a part of which is a conductive portion, and identifying a type of user operation on the touch panel through the object, wherein the conductive portion is A bottom surface contacting the mounting surface of the touch panel when the object is mounted on the touch panel is spaced apart via a non-conductive portion or a gap, and the object is mounted on the touch panel In this case, when the conductive portion is not touched by the user, the conductive portion on the bottom surface generates a change in the capacitance by a predetermined amount or more. When the conductive portion is not touched by the user, the conductive portion on the bottom surface causes a change in the capacitance of the predetermined amount or more at a position corresponding to each of the conductive portions on the bottom surface And creating tensor data in which a matrix representing touch event occurrence positions at constant time intervals is arranged on a time axis based on touch events generated due to the user operation, and a predetermined portion is generated from the created tensor data. And determining the type of the user operation based on the extracted tensor data and reference tensor data stored in advance in the pattern database for each type of the user operation. .

  Further, in order to achieve the above object, a system according to one aspect of the present invention includes an electronic device including a capacitive touch panel capable of detecting a multi-touch by detecting a change in capacitance, and the touch panel In a system comprising an object mounted on and used at least partially comprising a conductive part, by means of the electronic device for identifying the type of user operation on the touch panel via the object The conductive portion is spaced apart via a non-conductive portion or an air gap on the bottom surface that contacts the mounting surface of the touch panel when the object is mounted on the touch panel, When the object is placed on the touch panel, when the conductive portion is not touched by the user, the bottom surface When the conductive portion does not cause a change in the capacitance by a predetermined amount or more by the electric part, and the conductive portion is touched by the user, the conductive portion in the bottom surface changes the capacitance by a predetermined amount or more. A matrix is generated on a time axis that represents touch event occurrence positions at constant time intervals based on touch events that occur at positions corresponding to the conductive portions on the bottom surface and that are generated due to the user operation. Creating tensor data, extracting tensor data of a predetermined portion from the created tensor data, the extracted tensor data, and reference tensor data stored in advance in the pattern database for each type of the user operation Determining the type of the user operation based on

  In addition, in order to achieve the above object, a program as one aspect of the present invention is characterized by causing an electronic device to execute each step of the method described above.

  According to the present invention, in a system using an existing capacitive touch panel as a board, it is possible to identify the type of user operation from indirect multi-touch.

FIG. 1 is a schematic view of a board game system according to an embodiment of the present invention. It is a block diagram which shows the hardware constitutions of the electronic device of one Embodiment of this invention. It is a functional block diagram of the electronic device of one embodiment of the present invention. It is a figure which shows the coordinate axis of the touch panel of the electronic apparatus of one Embodiment of this invention. It is a figure showing an outline figure of a piece of one embodiment of the present invention. It is the top view which looked at the piece of FIG. 5 from the direction in which several protrusion part protrudes. It is a figure showing an outline figure of a piece of one embodiment of the present invention. It is a schematic diagram showing a tensor data creation part storing a matrix in a memory buffer. It is a figure which shows the three-dimensional array data which a tensor data creation part produces. It is a flowchart which shows an example of the information processing of a control part. It is a figure which shows the touch event recorded during installation operation in preliminary | backup experiment. It is a figure which shows the touch event recorded during detachment | leave operation in preliminary | backup experiment. It is a figure which shows the touch event recorded during installation operation in preliminary | backup experiment. It is a figure which shows the touch event recorded during detachment | leave operation in preliminary | backup experiment. The outline figure of the piece of a modification is shown. It is a bottom view of the piece of FIG.

  Hereinafter, a board game system 1 according to an embodiment of the present invention will be described with reference to the drawings. For convenience of explanation, the same reference numerals in the drawings indicate the same or corresponding portions unless otherwise noted, and vertical and horizontal scales of the drawings may be expressed differently from actual ones. In addition, detailed description more than necessary may be omitted.

  In the board game system 1 according to the present embodiment, a touch panel is used as a board for a board game, for example, as a board for shogi or chess, and physical pieces are placed thereon. Thus, the board game system 1 of the present embodiment provides the user with a board game. However, the board game system 1 according to the present embodiment can be used for other applications other than games as long as the board game system 1 includes a touch panel and a piece used by being placed on the touch panel, and services other than the board game Can be provided.

  The pieces 20 included in the board game system 1 of the present embodiment are molded using a material containing a conductor such as metal in an amount that does not react with the touch panel by itself, and when a person grasps with bare hands, It is not until the current on the human body is changed that a sufficient change occurs in the capacitance on the touch panel. Thus, the number of pieces exceeding the multi-touch recognition upper limit is made available.

  One of the technical features of the embodiment of the present invention is that the upper limit of multi-touch recognition on the touch panel has been exceeded by identifying an operation of placing the piece 20 on the touch panel or an operation of lifting the piece 20 from the touch panel. It is to realize a system using a number of pieces with a simpler implementation and to realize wider application. In particular, one of the technical features of the embodiment of the present invention is user operation from a stateless signal caused by indirect multi-touch in a system combining the above-described piece 20 and the existing capacitive touch panel. To identify the type of Here, the indirect multi-touch represents a multi-touch on the touch panel via the piece 20 by the user.

  Although the piece 20 of this embodiment means a game piece, it is not limited to this. The pieces 20 can be objects with similar configurations and characteristics.

  FIG. 1 is a schematic view of a board game system 1 according to an embodiment of the present invention. As shown in FIG. 1, the board game system 1 includes an electronic device 10 and one or more pieces 20.

  FIG. 2 is a block diagram showing the hardware configuration of the electronic device 10 according to the embodiment of the present invention. The electronic device 10 includes a processor 11, an input device 12, a display device 13, a storage device 14, and a communication device 15. Each of these components is connected by a bus 16. An interface is interposed between the bus 16 and each component device as necessary. The electronic device 10 is a tablet computer provided with the touch panel 17, and also includes a smartphone and the like.

  The processor 11 controls the overall operation of the electronic device 10. For example, the processor 11 is a CPU. The processor 11 executes various processes by reading and executing programs and data stored in the storage device 14. In one example, processor 11 is comprised of a plurality of processors. In another example, the processor 11 uses an electronic circuit such as an MPU. In the present embodiment, various functions of the electronic device 10 are realized by the program being executed by the processor 11.

  The input device 12 is a user interface that receives an input from the user on the electronic device 10. The display device (display) 13 displays an application screen or the like to the user of the electronic device 10 according to the control of the processor 11. In the present embodiment, the electronic device 10 as a smartphone includes the touch panel 17 as the input device 12, the touch panel 17 also functions as the display device 13, and the input device 12 and the display device 13 are integrated. The touch panel 17 of the present embodiment is a projected capacitive touch panel, but if there is a device having the same function, it may be used.

  The storage device 14 includes a main storage device and an auxiliary storage device. The main storage device is, for example, a semiconductor memory such as a RAM. The RAM is a volatile storage medium capable of high-speed reading and writing of information, and is used as a storage area and a work area when the processor 11 processes information. The main storage device may include a ROM, which is a read only non-volatile storage medium. In this case, the ROM stores a program such as firmware. The auxiliary storage device stores various programs and data used by the processor 11 when executing each program. The auxiliary storage device is, for example, a hard disk device, but may be any non-volatile storage or non-volatile memory as long as it can store information, or may be removable. The auxiliary storage device stores, for example, an operating system (OS), middleware, an application program, various data that can be referred to with the execution of these programs, and the like.

  In one example, the electronic device 10 comprises a database server function. In this case, the storage device 14 stores data (for example, a table) for the database and a program, and the database is realized by executing the program.

  The communication device 15 exchanges data with another computer such as a server via a network. For example, the communication device 15 performs wireless communication such as mobile communication and wireless LAN to connect to a network. In one example, the electronic device 10 downloads the program from the server by the communication device 15 and stores the program in the storage device 14. However, the communication device 15 may perform known wired communication. The electronic device 10 may not include the communication device 15 when data is not transmitted to or received from another computer.

  FIG. 3 is a functional block diagram of the electronic device 10 according to an embodiment of the present invention. The electronic device 10 includes an input unit 31, a display unit 32, and a control unit 33. The control unit 33 includes a tensor data creation unit 34, a tensor data extraction unit 35, a user operation determination unit 36, and a pattern database 37. In the present embodiment, these functions are realized by the program being executed by the processor 11. For example, the program to be executed is a program that the storage device 14 temporarily or non-temporarily stores. As described above, since various functions are realized by program reading, some or all of one part (function) may be included in another part. However, these functions may also be realized by hardware by configuring an electronic circuit or the like for realizing a part or all of the functions.

  The input unit 31 is configured using the input device 12, and receives an input from the user on the electronic device 10. In the present embodiment, when the input unit 31 receives a user operation on the touch panel 17 via the piece 20, the input unit 31 generates a touch event or detects it as a touch event. The input unit 31 can have a touch detection function that a smartphone provided with the touch panel 17 generally has.

  The display unit 32 displays the output of the electronic device 10 on the touch panel 17. For example, the display unit 32 displays an application screen corresponding to a user operation on the display device 13.

  The touch panel 17 is a projected capacitive type that detects a change in capacitance generated between a fingertip and a conductive film in the touch panel when the user touches the finger or the like, thereby performing position detection. The touch panel is capable of detecting multi-touch.

  In one example, an X direction electrode having a plurality of ITO transparent electrodes for performing X direction coordinate detection is provided on the front side of the transparent insulating film in the touch panel 17, and Y direction coordinate detection is performed on the back side. A Y-direction electrode is provided having a plurality of ITO transparent electrodes for the purpose. One of the X direction electrode and the Y direction electrode is configured as a receiving electrode, and the other is configured as a driving electrode.

  The capacitance between both electrodes is usually constant, but when a human finger approaches or touches the touch panel 17, the number of electric lines of force between both electrodes decreases, and the capacitance changes. Alternatively, when a human finger approaches or touches the touch panel 17, capacitive coupling occurs between the finger and the electrodes in the touch panel 17, and the capacitance between both electrodes changes. This is because the human body has the property of conducting electricity and generally has a capacitance of several hundred picofarads.

  The input unit 31 detects a change in capacitance when touched by a user's finger or the like. Even when the user does not touch the touch panel 17 directly or does not approach it, when the touch panel 17 is touched via a substance such as a metal (a substance having a lower electrical resistivity than an insulating substance), The metal or the like and the human body are in a conductive state, and the input unit 31 detects a change in capacitance. The detection of the coordinate position in the X direction and the Y direction based on the change in capacitance is performed by sequentially scanning the X direction and the Y direction by exchanging the roles of the receiving electrode and the driving electrode.

  The input unit 31 detects a change in the electrostatic capacitance as a touch event when a change in the electrostatic capacitance by a predetermined amount (more than the predetermined amount) is detected. The control unit 33 acquires the detected touch event, and acquires the touch event occurrence position (x, y) corresponding to the position on the touch panel 17 in which the capacitance is changed, which is included in the touch event. The touch event occurrence position is represented by two variables of the value of the first axis and the value of the second axis. When acquiring the touch event occurrence position (x, y), the control unit 33 acquires the acquired time t. In one example, t is an integer value that can be obtained from the OS, called so-called UNIX (registered trademark) time, or a character string such as “2017/07/14 15: 48: 43.444”.

  FIG. 4 is a diagram showing coordinate axes of the touch panel 17 including the first axis and the second axis of the present embodiment. The first axis is an axis that indicates the short side direction in the direction substantially parallel to the direction in which the sensors of the touch panel 17 are arrayed, and the horizontal axis (x axis substantially parallel to the short side of the touch panel 17 ). The second axis is an axis that is orthogonal to the first axis and indicates the longitudinal direction of the directions substantially parallel to the direction in which the sensors of the touch panel 17 are arrayed, and is substantially parallel to the long side of the touch panel 17 It is a parallel vertical axis (y axis). Thus, the first axis and the second axis are substantially parallel to the direction in which the sensors of the touch panel 17 are arranged, and the position on the touch panel 17 is represented by coordinates (x, y) by two axes. expressed. In the present embodiment, the touch event occurrence position (x, y) corresponds to the position on the touch panel 17. The coordinate setting shown in FIG. 4 is an example, and can be set to be different from the above illustration by a sensor array of the touch panel 17 or a program mounted by the electronic device 10. The sensor is, for example, an electrode.

  For example, when the detection accuracy of the touch panel 17 is 640 dots × 1,136 dots, the resolution is 640 dots in the horizontal axis direction and 1,136 dots in the vertical axis direction. The dot in this case may be a single point or may be a fixed area (cell). However, the distance between dots is usually different for each touch panel 17 (electronic device 10).

  Before describing each part included in the control unit 33, the piece 20 will be described. The piece 20 is a piece used in a board game provided by the board game system 1 and is mounted on the touch panel 17 and used. At least a part of the piece 20 is configured of the conductive portion 21.

  The conductive portion 21 is a portion made of a substance that conducts electricity, such as a metal. In the case where all of the pieces 20 are the conductive portions 21, the pieces 20 are made of a material that conducts electricity as a whole. On the other hand, when part of the piece 20 is the conductive portion 21, the piece 20 includes the non-conductive portion 22 which is a portion which does not conduct electricity, that is, an insulating material.

  FIG. 5 shows an overview of a piece 20 according to an embodiment of the invention. In the piece 20, all the pieces 20 are composed of the conductive portion 21. The piece 20 includes a main body 21a and a plurality of protrusions 21b, and two parts are integrally formed.

  When the piece 20 is placed on the touch panel 17, the piece 20 is placed such that the end faces of the plurality of protrusions 21 b are in contact with (the placement surface of) the touch panel 17. Therefore, preferably, the end faces of the plurality of protrusions 21 b are substantially on the same plane. The piece 20 is configured such that, on the contact surface with the touch panel 17, the end faces of the plurality of protrusions 21b, that is, the conductive portions 21 are spaced apart via a gap. FIG. 6 is a plan view (bottom view) in which the piece 20 of the present embodiment is viewed from the direction in which the plurality of protrusions 21 b protrude.

  When the piece 20 is placed on the touch panel 17, the conductive portion 21 causes the capacitance of the touch panel 17 to change on the contact surface with which the end faces of the plurality of protrusions 21 b are in contact. However, the conductive portion 21 does not cause a change in electrostatic capacitance of a predetermined amount or more. That is, the conductive portion 21 causes a change in capacitance less than a predetermined amount. Therefore, the contact of the end faces of the plurality of protrusions 21 b of the piece 20 placed on the touch panel 17 is not detected as a touch event by the input unit 31.

  Here, when the user touches the conductive portion 21 (piece 20), the conductive portion 21 and the human body are in a conductive state, and the conductive portion 21 touched by the user is a contact surface where the end faces of the plurality of protrusions 21b contact. Cause a change in capacitance more than a predetermined amount. Therefore, when touched by the user, the contact of the end faces of the plurality of protrusions 21 b of the piece 20 placed on the touch panel 17 is detected by the input unit 31 as a touch event.

Since the conductive portion 21 of the present embodiment, that is, the piece 20 has the above-described characteristics, it needs to be realized by a conductor of relatively small mass. In one preferred example, the pieces 20 are made using a 3D printer with conductive filaments having an electrical resistivity of 10 3 -5 Ω. In one example, the capacitance of the piece 20 is on the order of a few picofarads. In one example, the piece 20 shown in FIG. 6 is formed of a hollow body 21 a. In one example, the piece 20 is made of several tens of grams of 316L stainless steel. However, the threshold value of the change amount of the capacitance (the change of the above-mentioned predetermined amount of capacitance) where the input unit 31 determines the presence or absence of the touch event occurrence depends on the hardware characteristics or setting of the touch panel 17 (electronic device 10) It is understood that the type, mass, and shape of the conductors constituting the conductive portion 21 are determined according to the threshold value, as it can be changed.

  Since the piece 20 is configured as described above, when the piece 20 is placed on the touch panel 17 and touched by the user, the input unit 31 is an end face (conductive portion 21) of the plurality of protruding portions 21b of the piece 20. Each of the touched positions is detected as a touch event occurrence position.

  Each end face of the plurality of protrusions 21 b that is a contact surface with the touch panel 17 has a size that can be detected by the input unit 31. As long as it is detected by the input unit 31, the size of the end face of the plurality of protrusions 21b can be reduced. For example, when the size of the end face corresponds to the size of one dot resolution of the touch point of the touch panel 17, the end face of the plurality of protrusions 21b can be called an end point. Further, the end faces of the plurality of protrusions 21 b are spaced apart via an air gap to such an extent that the contact position where the end faces come in contact can be detected as different touch positions.

  The piece 20 is configured such that the arrangement of the end faces of the plurality of protrusions 21 b differs according to the type of the piece 20. However, the pieces 20 may be configured such that the arrangement of the end faces of the plurality of protrusions 21 b is different for each of all the pieces 20.

  In one example, the piece 20 includes a plurality of protrusions 21 b on a plurality of surfaces. For example, FIG. 7 shows a piece 20 provided with a plurality of protrusions 21b on both sides. The respective end faces of the plurality of protrusions 21 b are substantially on the same plane, and the respective end faces can be brought into contact with the touch panel 17 to place the piece 20 on the touch panel 17. In this case, the piece 20 is configured such that the arrangement of the end faces of the plurality of protrusions 21b is different on both sides.

  In the present embodiment, the user places the piece 20 on the touch panel 17 or detaches the piece 20 from the touch panel 17. Therefore, unless otherwise stated, such user operation on the touch panel 17 via the piece 20 is simply referred to as user operation. The type of user operation includes an operation (placement) of placing the piece 20 on the touch panel 17 and an operation (release) of lifting the piece 20 from the touch panel 17. The operation of installing the piece 20 on the touch panel 17 is an operation in which the user holds the piece 20 by hand and makes the touch on the touch panel 17. The operation for removing the piece 20 from the touch panel 17 is an operation in which the user holds the piece 20 placed on the touch panel 17 by hand, lifts the piece 20, and removes it from the touch panel 17. The user's operation is an indirect multi-touch, causing a change in capacitance of a predetermined amount or more, and a sensor in the touch panel 17 detects a touch event.

  Next, each unit included in the control unit 33 will be described.

  The tensor data creation unit 34 creates tensor data in which a matrix 41 representing touch event occurrence positions at constant time intervals is arranged on a time axis based on a touch event that occurs due to a user operation. The tensor data is represented by a three-dimensional tensor of X axis and Y axis, which are two axes representing a touch event occurrence position on the touch panel 17, and a time axis.

In one example, the tensor data creation unit 34 stores a matrix 41 representing a touch event occurrence position in a memory buffer included in the storage device 14 at fixed time intervals. FIG. 8 is a schematic diagram showing how the tensor data creation unit 34 stores the matrix 41 in the memory buffer. The tensor data creation unit 34 stores each matrix 41 at time t = T n , T n + 1 , T n + 2 ,..., T n + k in time series. The time difference Δt = T n + k −T n + (k−1) is constant, and preferably, the minimum time unit in which the input unit 31 detects a touch event, for example, the minimum time in which the OS of the smartphone detects a touch event It is a unit. The tensor data creation unit 34 associates the time t with the matrix 41 and stores the time t in the memory buffer.

  The tensor data creation unit 34 creates tensor data by storing touch events (matrix 41) detected in a predetermined period, including a matrix 41 representing the latest touch event occurrence position. The tensor data creation unit 34 may delete, for example, the matrix 41 for which a predetermined time has elapsed since storage.

  The matrix 41 has a two-dimensional element indicating a two-dimensional area on the touch panel 17, “1” is stored in the element corresponding to the touch event occurrence position, and “0” is stored in the other elements. In one example, the matrix 41 has row elements for the number of sensors arranged in the X axis and column elements for the number of sensors arranged in the Y axis. The tensor data creation unit 34 creates three-dimensional array data as shown in FIG. 9 by arranging a matrix 41 representing the touch event occurrence position on the time axis.

  For example, the matrix 41 at the specific time t represents the coordinates of the touch event occurrence position at the specific time t because the matrix element in which “1” is stored indicates the touch event occurrence position. Thus, the coordinates of the multi-touch event at a particular time t can be represented by the matrix elements of the matrix 41 at a particular time t. For example, when a touch event is not detected, all the elements of the matrix 41 store "0". Although the tensor data creation unit 34 creates tensor data based on the generated touch event, it creates tensor data even when no touch event has occurred as described above. Further, in the matrix 41, since "1" is stored in the matrix element corresponding to the touch event occurrence position, for example, the touch event number at the specific time t is "1" stored in the matrix element of the matrix 41 at the specific time t. It is specified by the number of "."

  The tensor data extraction unit 35 extracts tensor data of a predetermined portion from the tensor data generated by the tensor data generation unit 34. The tensor data extraction unit 35 extracts a matrix 41 continuous in time series corresponding to a certain time (time range) on the time axis shown in FIG. 9 as tensor data of a predetermined part. The tensor data of the predetermined part includes tensor data of a part corresponding to the time from the start to the end of the user operation. That is, the tensor data of the predetermined part includes the start time of the user operation, the end time of the user operation, and the tensor data of the part corresponding to the time in between.

  Here, in one preferable example, it is assumed that the number of touch events caused by the user operation starts to increase when starting the user operation and then becomes constant, and becomes constant after starting to decrease when the user operation ends. Do. In this case, for example, among tensor data created by the tensor data creation unit 34, tensor data from the time series when the number of touch events starts to increase until it becomes constant is tensor data corresponding to the user operation start time It is estimated to be. Further, for example, it is assumed that among the tensor data created by the tensor data creation unit 34, the tensor data from when the number of touch events starts to decrease until it becomes constant after looking at time series is tensor data corresponding to the end time of the user operation. Presumed. Therefore, in this case, the tensor data of the predetermined part includes the start time of the user operation from when the number of touch events starts to increase until it becomes constant, the end time of the user operations from when the number of touch events starts to decrease until it becomes constant, and It contains tensor data of the part corresponding to time. However, the tensor data corresponding to the start time of the user operation and the estimation method of the tensor data corresponding to the end time of the user operation are one example, and the present invention is not limited thereto.

  The pattern database 37 stores reference tensor data for each type of piece 20 and for each type of user operation. The reference tensor data includes tensor data corresponding to the time from the start to the end of the user operation. In one example, the tensor data creation unit 34 creates tensor data in advance for each type of piece 20 and each type of user operation, and the tensor data extraction unit 35 extracts tensor data of a predetermined portion. The reference tensor data is data extracted in this manner, and is stored in the pattern database 37 in association with an ID indicating the type of the piece 20 and an ID indicating the type of user operation. When storing reference tensor data in the pattern database 37, normalization of the data is performed in consideration of rotation, parallel movement, enlargement, and reduction, and then the pattern database 37 is associated with the type of the piece 20 and the type of user operation. You may memorize. Also, the pattern database 37 may store a plurality of reference tensor data per one user operation in the type of one piece 20.

  The user operation determination unit 36 determines the type of the piece 20 and the type of user operation based on the tensor data extracted by the tensor data extraction unit 35 and the reference tensor data stored in the pattern database 37.

  The user operation determination unit 36 collates the tensor data extracted by the tensor data extraction unit 35 with the reference tensor data stored in the pattern database 37, and selects the most among the type of the piece 20 stored in the pattern database 37 and the type of user operation This is determined by predicting what is likely. In one example, the user operation determination unit 36 calculates the degree of similarity between each of the tensor data extracted by the tensor data extraction unit 35 and each of the reference tensor data stored in the pattern database 37 in the determination. The user operation determination unit 36 determines the type of the piece 20 and the type of the user operation by using the type of the piece 20 and the type of the user operation associated with the reference tensor data having the highest calculated similarity.

  Since the tensor data extracted by the tensor data extraction unit 35 is derived from the user operation, the user operation determination unit 36 can determine the type of the user operation as described above. For example, the user operation determination unit 36 determines whether the user operation to be determined is installation or withdrawal.

  In one example, the similarity calculated by the user operation determination unit 36 includes temporal similarity. The user operation determination unit 36 is based on the tensor data extracted by the tensor data extraction unit 35 and the change degree of the number of touch events in each of the start time and the end time in each of the reference tensor data stored in the pattern database 37. Calculate the degree of temporal similarity.

  In one example, the degree of similarity calculated by the user operation determination unit 36 includes the degree of spatial similarity. The user operation determination unit 36 determines the spatial similarity based on the distance of each touch event occurrence position in the matrix 41 at a predetermined point of time of the tensor data extracted by the tensor data extraction unit 35 and the reference tensor data stored in the pattern database 37. Calculate

In one example, the determination of the type of the piece 20 and the type of user operation performed by the user operation determination unit 36 is realized using a function ctxrel (E, mi , x ) shown in equation (1). The function ctxrel (E, mi , x ) compares the tensor data extracted by the tensor data extraction unit 35, which is a tensor representing the multi-touch event input at the time of execution, with the reference tensor data stored in the pattern database 37. , Calculate the height of relevance.
(1)
Here, E is tensor data representing a multi-touch event input at the time of execution, and is tensor data extracted by the tensor data extraction unit 35. m i, x is tensor data representing a multi-touch event corresponding to the type x of the user operation through the i-th type piece 20 stored in the pattern database 37. The function ctxrel (E, mi , x ) outputs a value closer to 1 when the relationship between the two tensors to be compared is higher, and closer to 0 when the relationship is lower. The user operation determination unit 36 selects a combination of i and x at which the value of the function ctxrel (E, mi , x ) is closest to 1 among all the tensor data stored in the pattern database 37, and the user It outputs as the type of the piece 20 operated and the type of the user operation.

The function ctxrel (E, m i, x ) is expressed by equation (2).
(2)
Here, the function spatial_similarity (E, m i, x ) is a function that receives two tensors of E and m i, x and outputs the similarity for the type of piece 20 as a real number in the range of 0 to 1 is there. The function temporal_similarity (E, m i, x ) receives two tensors of E and m i, x and outputs the similarity for the type of user operation via the piece 20 as a real number in the range of 0 to 1 It is a function.

The function temporal_similarity (E, m i, x ) has two time intervals [ss, se] and [es, ee] in which the capacitance changes at the beginning and the end of the user operation. It is a function modeled based on the idea that multi-touch events show unique patterns of user manipulation. Specifically, the number of multi-touch events starts to increase when the user's operation starts, then becomes a constant value and no change, and starts to decrease when the user's operation is finished, and then becomes a constant value and no change. The number of multi-touch events at a particular time corresponds to the number of "1" s stored in the matrix 41 at a particular time. The sections [ss, se] and [es, ee] are calculated as in the expression (3) from the third-order tensor E as a condition on the number of multi-touch events.
However
(3)
Here, the function count (E, t) represents the number of multi-touch events detected at time t of the tensor E. τ represents a threshold of a preset time width, and d corresponds to a time width Δt in which the tensor data creation unit 34 stores the matrix 41, that is, a time width in which a touch event is stored in a memory buffer.
For example, when τ is 1 second and d is 33 ms, it indicates the value of the function count in all time widths of 33 ms, 66 ms,. Therefore, in this case, b and c contain 30 values, and the time satisfying the inequality in all these values is ss, se, es, and ee, respectively. If there is no time that satisfies the inequality, the user operation determination unit 36 may determine that there is no user operation, or the times of ss, se, es, and ee when the values of more functions count satisfy the inequality. It may be

In one example, the function temporal_similarity (E, m i, x ) calculates the similarity in the rate of change of the capacitance of two time intervals [ss, se], [es, ee] and Formula (4). In equation (4), the rate of change of capacitance is represented by the rate of change of the number of multi-touch events.
However
(4)
here,
Represents the difference in the rate of change of the number of multi-touch events in the interval of the beginning of the user operation,
Represents the difference in the rate of change of the number of multi-touch events in the end of the user operation. The smaller the value of these terms, the closer the rate of change of the capacitance of the multi-touch event represented by the tensor E and the multi-touch event represented by the tensor mi, x in each section.

In one example, the function spatial_similarity (E, mi , x ) stores the set of distances between the coordinates of the multi-touch event at a specific time t among the multi-touch events represented by the tensor E, and the pattern database 37 stores It calculates the similarity with the set of distances between the coordinates of the multi-touch event at the corresponding time of the multi-touch event represented by the reference tensor data, and is expressed by equation (5).
(5)
Here, when the set of coordinates of the multi-touch event at a specific time t is represented as T (E, t) for the third rank tensor E, the SRD function is a relative distance between each of all the coordinates. Is a function for obtaining a set of and is expressed by equation (6). Also,
Represents the squared error between the elements of the set.
(6)
Here, t is a specific time, for example, the time when the multi-touch event occurrence position is most frequent. (X1, y1) and (x2, y2) represent the coordinates of the multi-touch event at a specific time t included in the third-order tensor. Although equation (4) shows two coordinates for convenience of explanation, it is not limited to this. For example, if there are n coordinates of a multi-touch event at a specific time t included in the third-order tensor, SRD (E) is a set having n C 2 elements. However, t can also be a specific time zone, and in this case, a value with a smaller error in the specific time zone can be the output of the function spatial_similarity (E, mi , x ).

As described above, the function spatial_similarity (E, m i, x ) has a minimum spatial error between the multi-touch event input at the time of execution and the multi-touch event represented by the reference tensor data stored in the pattern database 37. Function to select the following data. Therefore, in Equations (5) and (6), although the square sum of the error of the distance is used by the SRD function, using RMSE (root mean square error) or MAE (mean absolute error) instead of the SRD function You can also. In addition, the function spatial_similarity (E, m i, x ) may be calculated by limiting to a plurality of specific coordinates, or may exclude one or more specific coordinates.

  In one preferred example, the system architecture of software implemented by the electronic device 10 has a three-layer structure. The first layer is a layer responsible for existing event processing that the OS of the electronic device 10 has as a function, and the input unit 31 corresponds thereto. The third layer corresponds to a specific application that implements, for example, an operation in a board game. The second layer determines the type of user operation from a touch event generated due to a user operation acquired from the first layer, and sends it to the third layer or stores it in a memory area to which the third layer can refer It is a layer in charge of processing, and the control unit 33 corresponds. In one example, the tensor data creation unit 34, the tensor data extraction unit 35, the user operation determination unit 36, and the pattern database 37 that constitute the control unit 33 are each configured of one software module.

  FIG. 10 is a flowchart showing an example of the information processing of the control unit 33. In step 101, the control unit 33 creates tensor data in which a matrix 41 representing touch event occurrence positions at constant time intervals is arranged on a time axis based on a touch event generated due to a user operation. At step 102, the control unit 33 extracts tensor data of a predetermined part from the created tensor data. In step 103, the control unit 33 determines the type of user operation based on the extracted tensor data and the reference tensor data stored in the pattern database 37.

  Although the flowchart shown in FIG. 10 is described to include step 101 for convenience of explanation, the flowchart may not include step 101. In this case, the control unit 33 keeps creating the tensor data by storing the matrix 41 in the memory buffer every predetermined time Δt, separately from the flowchart. This flowchart repeatedly executes step 102 and step 103 at predetermined time intervals, and in step 102, the control unit 33 extracts tensor data of a predetermined portion from tensor data which is continuing to be generated in other information processing. .

  Next, a method of manufacturing the piece 20 will be described. In one example, the pieces 20 are made using a 3D printer using a metal powder sintering technique (e.g., laser sintering). By preparing in this manner, for example, the contents of the main body portion 21a shown in FIG. 5 can be hollow, and the mass can be reduced while maintaining the size. Further, by using a 3D printer, since it is not necessary to make a mold for each arrangement pattern of the plurality of protrusions 21 b, it becomes possible to make the piece 20 relatively easily and inexpensively. Thereby, even if many kinds of pieces 20 are required, for example, pieces 20 having conductive portions 21 of various arrangement patterns on the contact surface with the touch panel 17 are produced relatively easily and inexpensively. It becomes possible.

  Next, a preliminary experiment in which a touch event detected by the touch panel 17 (input unit 31) when a user operation is performed using the piece 20 illustrated in FIG. 5 will be described. In the preliminary experiment, using the iPad Pro (registered trademark) as the electronic device 10, the setting operation which is an operation of placing the piece 20 on the touch panel 17 and the detaching operation which is an operation of detaching from the touch panel 17 are repeated. The electronic device 10 is installed with an application capable of recording the coordinates at which the touch event occurred and the time, and records the coordinates and the time of the touch event detected by the touch panel 17 during the user operation.

  11 and 13 show touch events recorded during the installation operation, and FIGS. 12 and 14 show touch events recorded during the release operation. 11 and 12, the horizontal axis represents the x-axis of the touch panel 17, and the vertical axis represents a relative time (millisecond) relative to the time of the touch event initially detected when the user operation is started. Represents. Trials 1 to 4 in FIGS. 11 and 12 correspond to the results of each of which the installation operation and the detachment operation are tried four times and recorded. In FIGS. 13 and 14, the horizontal axis represents the x-axis of the touch panel 17, and the vertical axis represents the y-axis of the touch panel 17.

  11 and 12 show that there is temporal dispersion at the beginning and end of a series of touch events, relatively large temporal dispersion is observed in the installation operation, and relatively small temporality in the detachment operation. Dispersion is confirmed. It is confirmed that the time of a series of touch events is about 250 ms in the installation operation and about 150 ms in the disconnection operation. Each of the touch event occurrence positions corresponds to the position of the protrusion 21 b of the piece 20. In the setting operation, the time of the series of touch events differs for each protrusion 21b in the same trial, and in the separation operation, the time of the series of touch events is the same for each protrusion 21b in the same trial Similarity is confirmed.

  13 and 14 show the coordinates on the touch panel 17 neglecting the time axis for the recorded touch event. It is confirmed that FIGS. 13 and 14 both show similar coordinates corresponding to the protrusion 21 b of the piece 20. Thus, the coordinates of the protrusion 21b can be identified from the touch event occurrence position, and it can be confirmed that the type of the piece 20 can be identified.

  Next, main operational effects of the board game system 1 (electronic device 10) according to the embodiment of the present invention will be described. In this embodiment, a single element is molded using a material containing a conductive material in an amount that does not react the touch panel 17, and generates a change in capacitance sufficient for touch event detection only while the user is touching The piece 20 to be used is used. The control unit 33 extracts tensor data of a predetermined portion from tensor data created based on a touch event generated due to a user operation. The control unit 33 calculates the degree of similarity between the extracted tensor data and the reference tensor data stored in advance in the pattern database 37, and the type of the piece 20 associated with the reference tensor data having the highest degree of similarity and the user operation By using the type, the type of the piece 20 and the type of user operation are determined. As described above, the control unit 33 compares the pattern of the touch event generated due to the user operation with the pattern learned in advance stored in the pattern database 37, and calculates the degree of similarity by calculating the degree of similarity. Determine the 20 types and the type of user operation. The control unit 33 sends, for example, an event corresponding to the determination result to the upper application, and the application executes a process corresponding to the event.

  With this configuration, in the present embodiment, it is possible to identify the type of user operation from the stateless signal caused by the indirect multi-touch. This makes it possible to implement a simpler implementation as compared to a stateful technology that must implement a system for managing the transition of the state of the piece 20 that is conventionally used, and to realize wider application. It becomes possible. Furthermore, since the determination content of the control unit 33 can be changed by changing the content stored in the pattern database 37, it is not necessary to perform additional coding even in the process of performing tuning.

  Further, in the present embodiment, since the piece 20 can be constituted by, for example, a lump of conductive filaments having a certain size, a relatively low cost can be achieved by a laminated 3D printer that handles a single material. It is possible to manufacture. Therefore, the board game system 1 can be realized at a relatively low price. Further, in the present embodiment, the electronic device 10 can be a commercially available touch screen device provided with the touch panel 17 and does not require special hardware. Therefore, it is easier to implement than technology that relies on dedicated hardware. For example, in the case of a vision based system using a camera, it is necessary to install the camera on the outside of the smartphone, so the available location is limited and it is difficult to implement easily. With the configuration as in this embodiment, the board game system 1 can be mounted relatively easily.

  The above-described effects are the same in the other embodiments and the other examples unless otherwise stated.

  In another embodiment of the present invention, a program for realizing the information processing shown in the functions and flowcharts of the embodiments of the present invention described above and a computer readable storage medium storing the program can also be used. Another embodiment can be a method for realizing the information processing shown in the function or the flowchart of the embodiment of the present invention described above. In another embodiment, a server that can supply a computer with a program that implements the information processing shown in the functions and flowcharts of the embodiments of the present invention described above can also be used. In another embodiment, a virtual machine can be realized that implements the information processing shown in the functions and flowcharts of the embodiments of the present invention described above.

  Hereinafter, modified examples of the embodiment of the present invention will be described. The modifications described below can be appropriately combined and applied to any embodiment of the present invention as long as no contradiction arises.

  In one variation, the tensor data of the predetermined portion includes tensor data of a portion corresponding to the start time of the user operation and tensor data of a portion corresponding to the end time of the user operation. That is, in this modification, the tensor data of the predetermined part does not include the tensor data of the part corresponding to the time between the start time and the end time of the user operation. In this case, the reference tensor data stored in the pattern database 37 includes tensor data corresponding to each of the start time and the end time.

  In one variation, the piece 20 is of one type, and the pattern database 37 stores reference tensor data for each type of user operation. In this case, the user operation determination unit 36 determines the type of user operation based on the tensor data extracted by the tensor data extraction unit 35 and the reference tensor data stored by the pattern database 37 for each type of user operation.

  In one variation, a learning model is generated in advance by performing machine learning using reference tensor data stored in the pattern database 37 for each type of user operation as learning data. In this case, when determining the type of user operation, the user operation determination unit 36 inputs the type of user operation by using tensor data extracted by the tensor data extraction unit 35 using the generated learning model. Output (judge).

  In one modification, the piece 20 is composed of the conductive portion 21 and the nonconductive portion 22. In this case, the conductive portion 21 is configured as one mass as a part of the piece 20. Therefore, the conductive portion 21 is not covered by the nonconductive portion 22 at its entire periphery. Alternatively, it is assumed that the conductive portion 21 does not include a conductive portion which is covered by the nonconductive portion 22 and can not be conducted to the outside.

  FIG. 15 shows a schematic view of the piece 20 of this modification. When the piece 20 is placed, the bottom surface is substantially flat, assuming that the surface in contact with the placement surface is the bottom surface. When the piece 20 is placed on the touch panel 17, the bottom surface contacts (the placement surface of) the touch panel 17. FIG. 16 is a bottom view of the piece 20 of this modification. As understood from FIG. 16, on the bottom surface which is a contact surface with touch panel 17, conductive portions 21 are spaced apart via non-conductive portions 22.

  When the piece 20 is placed on the touch panel 17, the conductive portion 21 causes a change in the capacitance of the touch panel 17 on a plurality of contact surfaces which are disposed apart via the nonconductive portion 22. However, the conductive portion 21 does not cause a change in electrostatic capacitance of a predetermined amount or more. Therefore, the contact of the conductive portion 21 of the piece 20 placed on the touch panel 17 is not detected as a touch event by the input unit 31.

  Here, when the user touches the conductive portion 21, the conductive portion 21 and the human body are in a conductive state, and thus the conductive portion 21 touched by the user is separated by the nonconductive portion 22 into a plurality of contact surfaces Cause a change in capacitance more than a predetermined amount. Therefore, when touched by the user, the contact of the conductive portion 21 of the piece 20 placed on the touch panel 17 is detected by the input unit 31 as a touch event. In this case, in the piece 20, at least a predetermined portion which can be touched by the user is constituted by the conductive portion 21, and the conductive portion 21 of the predetermined portion is electrically connected to the conductive portion 21 arranged at the bottom via the nonconductive portion 22 Configured to be possible. Preferably, the piece 20 includes a grip (not shown) for the user to grip, and the grip is configured by the conductive portion 21.

  As described above, since the conductive portion 21 of the present modification has the same characteristics as the conductive portion 21 of the piece 20 not including the non-conductive portion 22 of the present embodiment as described above, the details regarding the characteristics of the conductive portion 21 are described. The description is omitted.

  In the processing or operation described above, in a step, processing or operation is free as long as no processing or operation contradiction occurs such as using data which should not be available in the step. It can be changed. The embodiments described above are merely examples for explaining the present invention, and the present invention is not limited to these embodiments. The present invention can be practiced in various forms without departing from the scope of the invention.

REFERENCE SIGNS LIST 1 board game system 10 electronic device 11 processor 12 input device 13 display device 14 storage device 15 communication device 16 bus 17 touch panel 20 frame 21 conductive portion 21 a main body portion 21 b protrusion portion 22 non-conductive portion 31 input portion 32 display portion 33 control portion 34 Tensor data creation unit 35 Tensor data extraction unit 36 User operation determination unit 37 Pattern database 41 Matrix

Claims (10)

  1. An electronic device comprising a capacitive touch panel capable of detecting a multi-touch by detecting a change in capacitance, and an object configured to be mounted on the touch panel and at least a part of which is a conductive portion An electronic device for identifying the type of user operation on the touch panel via the object,
    The conductive portion is disposed on a bottom surface which contacts the placement surface of the touch panel when the object is placed on the touch panel, and the conductive portion is separated via a non-conductive portion or a gap, and the object is disposed on the touch panel In the case where the conductive portion is not touched by the user when placed, the conductive portion on the bottom does not cause a change in the electrostatic capacitance by a predetermined amount or more, and the conductive portion is touched by the user In the case where the conductive portion on the bottom surface causes a change in the capacitance of the predetermined amount or more at the position corresponding to each of the conductive portions on the bottom surface,
    The electronic device is
    Based on a touch event generated due to the user operation, tensor data is created in which a matrix representing a touch event occurrence position every constant time is arranged on a time axis,
    Extract tensor data of a predetermined part from the created tensor data,
    The type of the user operation is determined based on the extracted tensor data and reference tensor data stored in advance in a pattern database for each type of the user operation.
    Electronic device.
  2.   The electronic device according to claim 1, wherein the type of the user operation includes an operation of placing the object on the touch panel and an operation of lifting the object from the touch panel.
  3.   In determining the type of the user operation, the electronic device calculates the degree of similarity between the extracted tensor data and reference tensor data associated with the type of the user operation stored in the pattern database, and the similarity is calculated. The electronic device according to claim 1, wherein the type of the user operation is determined by using the type of the user operation associated with the highest degree of reference tensor data.
  4. The tensor data of the predetermined portion includes tensor data of a portion corresponding to the start time of the user operation and tensor data of a portion corresponding to the end time of the user operation, and the reference tensor data includes the start time and the end time Contains tensor data corresponding to each of
    The similarity includes temporal similarity,
    The electronic device is configured to change the number of touch events in each of the start time and the end time in the extracted tensor data and reference tensor data associated with the type of the user operation stored in the pattern database. The electronic device according to claim 3, wherein the temporal similarity is calculated based on the time.
  5. The conductive parts are spaced apart via non-conductive parts or an air gap on the bottom surface so that the arrangement position varies depending on the type of the object.
    The electronic device determines the type of the user operation based on the extracted tensor data and reference tensor data stored in the pattern database in advance for each type of the object and for each type of the user operation. The electronic device according to claim 3, wherein the type of the object and the type of the user operation are determined.
  6. The degree of similarity includes the degree of spatial similarity,
    The electronic device may perform the spatial processing based on distances of touch event occurrence positions in the matrix at predetermined time points of the extracted tensor data and reference tensor data associated with the type of the user operation stored in the pattern database. The electronic device according to claim 5, wherein the degree of similarity is calculated.
  7. The system is a board game system using the touch panel as a board,
    The electronic device according to any one of claims 1 to 6, wherein the object is a game piece.
  8. An electronic device comprising a capacitive touch panel capable of detecting a multi-touch by detecting a change in capacitance, and an object configured to be mounted on the touch panel and at least a part of which is a conductive portion A system for identifying the type of user operation on the touch panel via the object,
    The conductive portion is disposed on a bottom surface which contacts the placement surface of the touch panel when the object is placed on the touch panel, and the conductive portion is separated via a non-conductive portion or a gap, and the object is disposed on the touch panel In the case where the conductive portion is not touched by the user when placed, the conductive portion on the bottom does not cause a change in the electrostatic capacitance by a predetermined amount or more, and the conductive portion is touched by the user In the case where the conductive portion on the bottom surface causes a change in the capacitance of the predetermined amount or more at the position corresponding to each of the conductive portions on the bottom surface,
    Based on a touch event generated due to the user operation, tensor data is created in which a matrix representing a touch event occurrence position every constant time is arranged on a time axis,
    Extract tensor data of a predetermined part from the created tensor data,
    The type of the user operation is determined based on the extracted tensor data and reference tensor data stored in advance in a pattern database for each type of the user operation.
    system.
  9. An electronic device comprising a capacitive touch panel capable of detecting a multi-touch by detecting a change in capacitance, and an object configured to be mounted on the touch panel and at least a part of which is a conductive portion A method performed by the electronic device to identify the type of user operation on the touch panel through the object,
    The conductive portion is disposed on a bottom surface which contacts the placement surface of the touch panel when the object is placed on the touch panel, and the conductive portion is separated via a non-conductive portion or a gap, and the object is disposed on the touch panel In the case where the conductive portion is not touched by the user when placed, the conductive portion on the bottom does not cause a change in the electrostatic capacitance by a predetermined amount or more, and the conductive portion is touched by the user In the case where the conductive portion on the bottom surface causes a change in the capacitance of the predetermined amount or more at the position corresponding to each of the conductive portions on the bottom surface,
    Creating tensor data in which a matrix representing touch event occurrence positions at regular time intervals is arranged on a time axis based on touch events generated due to the user operation;
    Extracting tensor data of a predetermined part from the created tensor data;
    Determining the type of the user operation based on the extracted tensor data and reference tensor data stored in advance in a pattern database for each type of the user operation;
    Method, including.
  10.   A program causing the electronic device to execute the steps of the method according to claim 9.
JP2018163277A 2018-08-31 2018-08-31 Electronic device, system, method and program Active JP6490288B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018163277A JP6490288B1 (en) 2018-08-31 2018-08-31 Electronic device, system, method and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2018163277A JP6490288B1 (en) 2018-08-31 2018-08-31 Electronic device, system, method and program

Publications (1)

Publication Number Publication Date
JP6490288B1 true JP6490288B1 (en) 2019-03-27

Family

ID=65895312

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018163277A Active JP6490288B1 (en) 2018-08-31 2018-08-31 Electronic device, system, method and program

Country Status (1)

Country Link
JP (1) JP6490288B1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004344483A (en) * 2003-05-23 2004-12-09 Namco Ltd Game information, information storage medium, and game machine
JP2008528226A (en) * 2005-02-02 2008-07-31 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Piece with startable sub-parts
JP2009505209A (en) * 2005-08-11 2009-02-05 エヌ−トリグ リミテッド Apparatus for detecting object information and method of using the same
JP2016004341A (en) * 2014-06-16 2016-01-12 淳一 榎本 Information transmission system and information transmission method for transmitting information on the basis of arrangement of touch imparting portions
JP2016066153A (en) * 2014-09-24 2016-04-28 任天堂株式会社 Information processing system, information processing device, information processing program, and information processing method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004344483A (en) * 2003-05-23 2004-12-09 Namco Ltd Game information, information storage medium, and game machine
JP2008528226A (en) * 2005-02-02 2008-07-31 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Piece with startable sub-parts
JP2009505209A (en) * 2005-08-11 2009-02-05 エヌ−トリグ リミテッド Apparatus for detecting object information and method of using the same
JP2016004341A (en) * 2014-06-16 2016-01-12 淳一 榎本 Information transmission system and information transmission method for transmitting information on the basis of arrangement of touch imparting portions
JP2016066153A (en) * 2014-09-24 2016-04-28 任天堂株式会社 Information processing system, information processing device, information processing program, and information processing method

Similar Documents

Publication Publication Date Title
US8704787B2 (en) Information processing apparatus, information processing method, and computer program
CN102007465B (en) Method and apparatus for providing input to a processor, and a sensor pad
KR101534903B1 (en) Systems and methods for pressure-based authentication of a signature on a touch screen
US10409418B2 (en) Electronic device operating according to pressure state of touch input and method thereof
JP6161078B2 (en) Detection of user input at the edge of the display area
CN102693035B (en) Modal touch input
US20130162603A1 (en) Electronic device and touch input control method thereof
US9218121B2 (en) Apparatus and method recognizing touch gesture
US20130207920A1 (en) Hand and finger registration for control applications
JP5991041B2 (en) Virtual touch screen system and bidirectional mode automatic switching method
CN105518596B (en) Device and method for local force and short distance sensing
KR101953165B1 (en) Gesture recognition devices and methods
TWI291161B (en) Automatic switching for a dual mode digitizer
US20100020036A1 (en) Portable electronic device and method of controlling same
US8692795B1 (en) Contact identification and tracking on a capacitance sensing array
JP5554517B2 (en) Touch panel position detection method and touch panel device
KR20150014083A (en) Method For Sensing Inputs of Electrical Device And Electrical Device Thereof
US20090303175A1 (en) Haptic user interface
CN102906671B (en) Gesture input device and gesture input method
KR20100129424A (en) Method and apparatus to provide user interface using touch screen based on location and intensity
CN107066158A (en) Touch-sensitive button with two gears
US8098879B2 (en) Information processing device, image movement instructing method, and information storage medium
CN104794105A (en) Touch event processing for web pages
CN105122197A (en) Device and method for localized force sensing
TWI450148B (en) Touch screen touch track detection method and detection device

Legal Events

Date Code Title Description
A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20181024

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20181024

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20181207

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20190128

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20190226

R150 Certificate of patent or registration of utility model

Ref document number: 6490288

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150