WO2022054382A1 - Electronic apparatus and method for controlling electronic apparatus - Google Patents

Electronic apparatus and method for controlling electronic apparatus Download PDF

Info

Publication number
WO2022054382A1
WO2022054382A1 PCT/JP2021/025030 JP2021025030W WO2022054382A1 WO 2022054382 A1 WO2022054382 A1 WO 2022054382A1 JP 2021025030 W JP2021025030 W JP 2021025030W WO 2022054382 A1 WO2022054382 A1 WO 2022054382A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
display
touch
effect pattern
tactile effect
Prior art date
Application number
PCT/JP2021/025030
Other languages
French (fr)
Japanese (ja)
Inventor
修平 飯塚
尚彦 小関
誠 平原
Original Assignee
菱洋エレクトロ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 菱洋エレクトロ株式会社 filed Critical 菱洋エレクトロ株式会社
Publication of WO2022054382A1 publication Critical patent/WO2022054382A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present invention relates to an electronic device and a control method for the electronic device, and more particularly to the electronic device and the control method for the electronic device, which can be suitably used for the electronic device device using the tactile touch panel.
  • Electronic devices such as tablet terminals, smartphones, mobile phones and computers that the user touches the housing or touch screen during use should be equipped with an actuator (haptic actuator) that gives tactile feedback (haptic feedback) to the human body.
  • haptic actuator When a part of the user's body (eg, a finger) or an object such as a stylus operated by the user touches the input of an electronic device, or when the system generates a specific event, the haptic actuator is an electronic device. Generates motion in components such as the housing and touch screen. The user can intuitively and easily operate the electronic device or receive information by perceiving the vibration at the part of the body that comes into contact with the electronic device or perceiving it as a sound.
  • Patent Document 1 Japanese Unexamined Patent Publication No. 2013-235614. is configured in a sheet shape in which a plurality of detection positions are set and the electrical state changes in response to pressing to a position corresponding to an arbitrary detection position. It is equipped with a detection unit, a control unit that determines the pressing force for each detection position based on the change in the electrical state of the pressed detection position, and a vibration unit that generates vibration according to the determined pressing force.
  • the unit discloses an input device that generates vibrations of different vibration patterns in multiple steps in response to pressing. With such an input device, it is possible to change the tactile sensation according to a user's input operation such as a finger pressing force, and to realize multi-step input according to the pressing force.
  • the touch panel equipped with an actuator that gives tactile feedback allows trigger input to the device simply by touching it with a finger or the like.
  • an actuator that gives tactile feedback allows trigger input to the device simply by touching it with a finger or the like.
  • An input device as disclosed in Patent Document 1 can change the tactile sensation according to a user's input operation such as a finger pressing force, but cannot change the tactile sensation according to the content of the displayed content. ..
  • the present invention has been completed in view of the above problems, and is an electronic device and a control method for an electronic device capable of giving various tactile effect patterns according to the content of display contents of a display means such as a touch panel display.
  • the challenge is to provide.
  • the present invention is specified as follows.
  • a touch detecting means for detecting the touch of an object to the touch input means, and a touch detecting means.
  • a tactile sensation generating means that gives a tactile effect to an object touched by the touch input means,
  • An electronic device including a control means for controlling the tactile sensation generating means so as to give a tactile effect pattern corresponding to the content of the content displayed on the display means.
  • the electronic device according to (1) further including a storage means for storing a tactile effect pattern corresponding to the content of the content.
  • the content is a plurality of screens displayed on the display means.
  • the content is an image or an icon of application software.
  • a touch detection process that detects the touch of an object to the touch input means
  • a display detection process that acquires the state of the content displayed on the display means
  • a control process for determining a tactile effect pattern corresponding to the content displayed on the display means
  • the method for controlling an electronic device according to (6), wherein the control step includes acquiring the tactile effect pattern from a storage means that stores the tactile effect pattern corresponding to the content of the content.
  • the touch detection step includes detecting at least one of a position, a time, and an intensity to which the object touches.
  • a touch detection process that detects the touch of an object to the touch input means
  • a display detection process that acquires the state of the content displayed on the display means
  • a control process for determining a tactile effect pattern corresponding to the content displayed on the display means and
  • a computer-readable storage medium that stores a program that causes a computer to execute a tactile sensation generation step that gives a determined tactile effect pattern to an object touched by the touch input means.
  • the touch detection step includes detecting at least one of a position, a time, and an intensity to which the object touches.
  • the content is an image or an icon of application software.
  • an electronic device and a control method for the electronic device which can give various tactile effect patterns according to the content of the displayed content.
  • the user can easily know the touched position and the event inspired by the touch, and the user convenience is improved. In addition, a good entertainment effect may be obtained depending on the content. Further, with the change of the content displayed on the display means, even if the user touches the same place on the touch panel, the corresponding tactile effect pattern can be changed, and the content of the displayed content and the tactile effect pattern are linked. Sex is obtained.
  • FIG. 5 is a flowchart in which a touch detecting means in an embodiment of the present invention detects and determines a touch input. It is a flowchart which determines and generates a tactile effect pattern in one Embodiment of this invention.
  • FIG. 1 is a block diagram showing a schematic configuration of an embodiment of the electronic device of the present invention.
  • the electronic device 100 includes a drive pattern storage unit 101, a memory control unit 102, a tactile control unit 103, a tactile sensation generation unit 104, a tactile operation unit 105, and a display unit 106 (also serving as an input unit for receiving a touch input in this embodiment). It includes a display control unit 107 and an input position detection unit 108.
  • the drive pattern storage unit 101 is composed of, for example, a hard disk (HD), a ROM, a RAM, or the like, and stores information corresponding to a predetermined tactile effect pattern (strength, duration, vibration waveform, etc.).
  • a predetermined tactile effect pattern can be arbitrarily set or changed by the user through a setting screen or the like displayed on the display unit 106.
  • the memory control unit 102 is a block that controls the drive pattern storage unit 101, and when the input unit is touched, the attributes related to the touch input (touched position, touch time and strength, and touched). Occasionally, the tactile effect pattern to be generated is associated according to the content of the content displayed on the display unit 106, etc.).
  • the tactile control unit 103 controls the tactile sensation generation unit 104 to generate a predetermined tactile effect pattern based on the notified information.
  • the tactile effect pattern may not be pre-stored, but the attributes associated with the touch input may be used to determine the tactile effect pattern on a case-by-case basis based on a particular algorithm. Is.
  • the tactile sensation generation unit 104 can be provided with an arbitrary actuator that actually generates various tactile effect patterns. Both a shock-driven actuator and a vibration-driven actuator can be used for the present invention.
  • Typical examples of the impact drive type include SIA (Shape memory alloy Impact Actuator) using a shape memory alloy and a piezoelectric actuator using a piezo element.
  • the impact-driven actuator includes a moving component capable of shocking movement, and gives a transient impact to the touch screen or housing of an electronic device by hitting or interlocking the moving component.
  • Typical examples of the vibration drive type actuator are an ERM (Eccentric Rotating Mass) type actuator that uses an eccentric motor, and a linear resonance type actuator (LRA: Linear Resonant Actuator) that vibrates a mover by passing an alternating current through a coil in a magnetic field.
  • ERM Electronic Rotating Mass
  • LRA Linear Resonant Actuator
  • the vibration-driven type gives a vibration of a constant amplitude to the vibrating body for the required time.
  • a plurality of actuators can be used to generate various tactile effect patterns, and one or more shock-driven and vibration-driven types can be used in combination.
  • the actuator of the tactile sensation generating unit 104 in one embodiment of the present invention is made of a coil, an operating component (for example, a metal core material), and a spring.
  • the coil is wound around the metal (where both the coil and the metal component may be referred to as "solenoids") and when the coil creates a magnetic field (eg, when a current flows between the coil terminals). )
  • the metal moves.
  • the movement of the metal can have an impact on the electronic device.
  • the spring may then be used to return the moving metal or other core material to a stationary position when the current is removed from the coil.
  • the impact-driven actuator in another embodiment has a wire-shaped shape memory alloy that contracts when energized and heated, and a disk-shaped insulating property that comes into contact with the wire-shaped shape memory alloy and releases heat generated by the wire-shaped shape memory alloy. It is configured to include a thermal conductor (moving component).
  • a thermal conductor moving component
  • the heat generated by the wire-shaped shape memory alloy is rapidly dissipated by the heat conduction action of the disk-shaped insulating heat conductor, and as a result, the wire-shaped shape memory alloy immediately returns to the original length state (extended state). .. In this way, the wire-shaped shape memory alloy can be momentarily shrunk at relatively short time intervals. Details of such actuators are disclosed in Japanese Patent Publication No. 2012-023655.
  • the tactile effect pattern generated by the tactile sensation generation unit 104 is transmitted to the tactile sensation movement unit 105.
  • the tactile motion unit 105 may be, for example, a resistance film touch panel or a monitor surface.
  • the tactile motion unit 105 is preferably close to the input unit in order to transmit the tactile effect pattern to the user.
  • the tactile motion unit 105 is formed integrally with the display unit 106 (input unit).
  • the display unit 106 is a display such as a liquid crystal panel, and displays an image or a GUI screen constituting a GUI (Graphical User Interface) based on the control of the display control unit 107.
  • the display control unit 107 generates a display control signal according to a program, or receives a display control signal, generates a video signal for display on the display unit 106, and outputs the video signal to the display unit 106.
  • the display unit 106 displays an image based on the input video signal.
  • the input unit may be integrated with the display unit. It is typically a monitor with a touch panel. Alternatively, the input unit may be a component separate from the display unit. Typically, it is a physical switch such as a mouse or a trackpad of a notebook computer.
  • the object that touches the input unit is typically a user's finger or a stylus pen operated by the user.
  • the display control unit 107 can display the content on the display unit 106 or change the content.
  • the display control unit 107 can be configured by using a personal computer or the like.
  • the displayed contents include a plurality of GUI screens, images, application icons, and the like.
  • the display control unit 107 can acquire the state of the currently displayed content (that is, what kind of content is currently displayed) and output it to the memory control unit 102.
  • the input position detection unit 108 is, for example, a touch panel of a monitor with a resistance film touch panel, and can acquire the touched input unit and the touched coordinates and output the touch panel to the memory control unit 102. In some embodiments, the input position detection unit 108 can also detect at least one of the touch time and the strength (pushing pressure).
  • the present invention can give various tactile effect patterns according to the content of the displayed content.
  • the content is a plurality of screens
  • the tactile control unit 103 can control the tactile sensation generation unit 104 so as to generate a tactile effect pattern associated with each screen.
  • the content is an image or an icon of application software
  • the tactile control unit 103 controls the tactile sensation generation unit 104 so as to generate a tactile effect pattern associated with each image or icon. Can be done. By making it possible to generate a tactile effect pattern for each image or icon, the place touched by the user can be more intuitively transmitted to the user, and the tactile effect pattern optimal for the content of the image or icon can be realized.
  • the images or icons may be displayed on the same screen, or may be displayed on different screens by switching screens.
  • the content is a plurality of screens each including a plurality of images or icons
  • the tactile control unit 103 has a tactile effect associated with the images or icons included in the screens for each screen.
  • the tactile sensation generation unit 104 can be controlled so as to generate a pattern. That is, even in the same screen, an independent tactile effect pattern is associated with the image or icon corresponding to the touched position, and it is possible to feed back different tactile effect patterns to the user in the same display screen. Is. Thereby, the place touched by the user can be more intuitively transmitted to the user, and the tactile effect pattern most suitable for the content of the image or the icon can be realized.
  • a plurality of tactile effect patterns may be prepared for user convenience or entertainment effect even if there is no event corresponding to the position, time length or strength of the touch.
  • the tactile effect pattern with a strong impact can be fed back, and when the touch is relatively weak, the tactile effect pattern with a weak impact can be fed back.
  • the tactile effect pattern with a weak impact can be fed back, and when the touch is relatively weak, the tactile effect pattern with a strong impact can be fed back.
  • each of the above embodiments is not independent, and each embodiment can be combined to assemble a unique and diverse combination of tactile effect patterns.
  • the tactile effect pattern corresponding to the specific touch input attribute may be predetermined, or may be set by the user from among several tactile effect pattern candidates.
  • FIG. 2 is a diagram showing an embodiment of the present invention in which an electronic device provides a plurality of tactile effect patterns.
  • display A, display B, and display C which are a plurality of screens to be displayed on a display means (display or the like) of an electronic device, are included, and displays A to C each occupy the entire display means. It is possible to switch between each display by the display control means according to the user's selection or based on the command in the program.
  • the tactile effect pattern is set to be weak as a whole while the display A is displayed, and the tactile effect pattern is set to be strong as a whole while the display B is displayed. ing.
  • different tactile effect patterns can be obtained even if the touch input means is touched at the same position. Furthermore, touching icons at different positions, even within the same display, gives different tactile effect patterns.
  • the method for controlling an electronic device of the present invention is as follows.
  • a touch detection process that detects the touch of an object to the touch input means
  • a display detection process that acquires the state of the content displayed on the display means
  • a control process for determining a tactile effect pattern corresponding to the content displayed on the display means and
  • the tactile sensation generation step of giving the determined tactile effect pattern to the object touched by the touch input means is included.
  • FIGS. 3 to 5 are flowcharts illustrating a control procedure for an electronic device according to an embodiment of the present invention.
  • FIG. 3 shows a flowchart in which the display control means controls the display state of the display means
  • FIG. 4 shows a flowchart in which the touch detection means detects and determines the touch input
  • FIG. 5 shows a flowchart in which the tactile effect pattern is determined and generated. The flow chart is shown.
  • the display control means has a function of displaying the content on the display means or changing the displayed content. With reference to FIG. 3, it is determined from the current display state whether or not there is an event for which the display should be updated (or changed).
  • the display state means the content of the currently displayed content. As an event for updating or changing the display state, it is conceivable that a command from the user or a specific condition is satisfied.
  • the display control means updates the display content and changes the display state. If there is no event (N), the current display state is maintained.
  • the touch detecting means is in the input standby state so that the touch input can always be detected, and when there is a touch input (Y), the touch detecting means has an attribute (touch) related to the touch input.
  • the touched position, touch time and strength, display state when touched, etc.) are fixed, the touch input position is detected or fixed, and the input judgment is updated.
  • the screen for initial setting of each part is displayed, and the user can use the tactile effect pattern for each screen, the tactile effect pattern for each image or icon, and the touch for each content. It is possible to select a tactile effect pattern or the like corresponding to the time or strength of the operation.
  • the initial setting screen is not essential, and it is possible that the setting function is not provided to the user. Even when the initial setting screen is provided, the initial setting screen may not be displayed unless the user calls it after setting once.
  • the display control means acquires the current display state. Then, when the input determination is updated and a touch input occurs, the touch detecting means captures the attributes related to the touch input and simultaneously acquires the input position. Based on the determined input attribute and input position, and the determined display state, the control means determines the tactile effect pattern associated in advance, or determines the optimum tactile effect pattern, and the tactile sensation generating means such as an actuator. Judgment or determination of the drive pattern of. Based on the drive pattern, the tactile sensation generating means operates to provide a predetermined tactile feedback to the user.
  • the above-mentioned electronic device according to the present invention can be used. Further, in carrying out the above method, the operating mode of the electronic device is the same as described above, and is omitted here.
  • the present invention further relates to a computer-readable storage medium that stores a program.
  • a touch detection process that detects the touch of an object to the touch input means
  • a display detection process that acquires the state of the content displayed on the display means
  • a control process for determining a tactile effect pattern corresponding to the content displayed on the display means
  • a program for causing a computer to execute a tactile sensation generation step of giving a determined tactile effect pattern to an object touched by the touch input means is stored.
  • the above program aims to realize the method according to the present invention, and its operating mode is the same as described above, and is omitted here.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The purpose of the present invention is to provide an electronic apparatus capable of providing various tactile effect patterns in accordance with details of display content, and a method for controlling the electronic apparatus. An electronic apparatus including a display means, a touch input means, a display control means for displaying or changing content on the display means, a touch detection means for detecting touching of an object on the touch input means, a tactile sense generation means for providing tactile effects to the object that touched the touch input means, and a control means for controlling the tactile sense generation means so as to provide a tactile effect pattern that corresponds to details of content displayed on the display means.

Description

電子機器及び電子機器の制御方法Electronic devices and control methods for electronic devices
　本発明は電子機器及び電子機器の制御方法に関し、特に、触感タッチパネルを用いた電子機器装置に好適に用いることができる、電子機器及び電子機器の制御方法に関するものである。 The present invention relates to an electronic device and a control method for the electronic device, and more particularly to the electronic device and the control method for the electronic device, which can be suitably used for the electronic device device using the tactile touch panel.
　タブレット端末、スマートフォン、携帯電話及びコンピュータのような、使用時にユーザが筐体やタッチスクリーンに触れる電子機器は、人体に触覚フィードバック（ハプティク・フィードバック）を付与するアクチュエータ（ハプティク・アクチュエータ）を搭載することがある。ユーザの身体の部位（例えば、手指）や、ユーザが操作するスタイラスペンなどの物体が電子機器の入力部に触れたとき、あるいはシステムが特定のイベントを生成したとき、ハプティク・アクチュエータは、電子機器の筐体やタッチスクリーンなどの構成部品に運動を発生させる。ユーザは、電子機器に接触した身体の部位で振動を知覚したり、音として知覚したりすることで、直感的かつ容易に電子機器を操作し、又は情報を受け取ることができる。 Electronic devices such as tablet terminals, smartphones, mobile phones and computers that the user touches the housing or touch screen during use should be equipped with an actuator (haptic actuator) that gives tactile feedback (haptic feedback) to the human body. There is. When a part of the user's body (eg, a finger) or an object such as a stylus operated by the user touches the input of an electronic device, or when the system generates a specific event, the haptic actuator is an electronic device. Generates motion in components such as the housing and touch screen. The user can intuitively and easily operate the electronic device or receive information by perceiving the vibration at the part of the body that comes into contact with the electronic device or perceiving it as a sound.
　特許文献１（特開２０１３－２３５６１４号公報）には、複数の検出位置が設定され、任意の検出位置と対応する位置への押圧に応じて電気的状態が変化する、シート状に構成された検出部と、押圧された検出位置の電気的状態の変化に基づき、検出位置毎の押圧力を判定する制御部と、判定された押圧力に応じて振動を発生させる振動部とを備え、振動部は、押圧に対応して多段階的に異なる振動パターンの振動を発生させる入力装置が開示されている。このような入力装置により、指の押圧力などユーザの入力動作に応じて触覚を変化させ、押圧力に応じた多段階の入力を実現することができる。 Patent Document 1 (Japanese Unexamined Patent Publication No. 2013-235614) is configured in a sheet shape in which a plurality of detection positions are set and the electrical state changes in response to pressing to a position corresponding to an arbitrary detection position. It is equipped with a detection unit, a control unit that determines the pressing force for each detection position based on the change in the electrical state of the pressed detection position, and a vibration unit that generates vibration according to the determined pressing force. The unit discloses an input device that generates vibrations of different vibration patterns in multiple steps in response to pressing. With such an input device, it is possible to change the tactile sensation according to a user's input operation such as a finger pressing force, and to realize multi-step input according to the pressing force.
特開２０１３－２３５６１４号公報Japanese Unexamined Patent Publication No. 2013-235614
　触覚フィードバックを付与するアクチュエータを搭載したタッチパネルは、指などで触れるだけで機器へのトリガ入力が可能なものである。タッチパネルの操作に応じて、触覚効果を与える場合、コンテンツをタッチした時に感じた触感が何を意味するのかをユーザが認識できることが望ましい。そのため、単一の触覚効果パターンだけでなく、強さ、持続時間、振動波形などが異なる様々な触覚効果パターンを、触感発生手段を通じてユーザにフィードバックすることが必要となる。特許文献１に開示されるような入力装置は、指の押圧力などユーザの入力動作に応じて触覚を変化させることは可能であるが、表示コンテンツの内容に応じて触覚を変化させることはできない。 The touch panel equipped with an actuator that gives tactile feedback allows trigger input to the device simply by touching it with a finger or the like. When giving a tactile effect according to the operation of the touch panel, it is desirable that the user can recognize what the tactile sensation felt when touching the content means. Therefore, it is necessary to feed back not only a single tactile effect pattern but also various tactile effect patterns having different strengths, durations, vibration waveforms, etc. to the user through the tactile sensation generating means. An input device as disclosed in Patent Document 1 can change the tactile sensation according to a user's input operation such as a finger pressing force, but cannot change the tactile sensation according to the content of the displayed content. ..
　本発明は上記課題に鑑みて完成されたものであり、タッチパネルのディスプレイなどの表示手段の表示コンテンツの内容に応じて、様々な触覚効果パターンを与えることが可能な電子機器及び電子機器の制御方法を提供することを課題とする。 The present invention has been completed in view of the above problems, and is an electronic device and a control method for an electronic device capable of giving various tactile effect patterns according to the content of display contents of a display means such as a touch panel display. The challenge is to provide.
　本発明は、以下のように特定される。
（１）
　表示手段と、
　タッチ入力手段と、
　前記表示手段において、コンテンツを表示又は変更する表示制御手段と、
　前記タッチ入力手段に対する物体のタッチを検出するタッチ検出手段と、
　前記タッチ入力手段にタッチした物体に触覚効果を与える触感発生手段と、
　前記表示手段に表示されるコンテンツの内容に対応した触覚効果パターンを与えるように、前記触感発生手段を制御する制御手段と
を含む電子機器。
（２）
　前記コンテンツの内容に対応した触覚効果パターンを記憶する記憶手段をさらに含む、（１）に記載の電子機器。
（３）
　前記タッチ検出手段は、前記物体がタッチする位置、時間及び強さのうち少なくとも一つを検出可能である、（１）又は（２）に記載の電子機器。
（４）
　前記コンテンツは、前記表示手段に表示される複数の画面である、（１）～（３）のいずれか一項に記載の電子機器。
（５）
　前記コンテンツは、画像又はアプリケーションソフトのアイコンである、（１）～（３）のいずれか一項に記載の電子機器。
（６）
　タッチ入力手段に対する物体のタッチを検出するタッチ検出工程と、
　表示手段に表示されるコンテンツの状態を取得する表示検出工程と、
　前記表示手段に表示されるコンテンツの内容に対応した触覚効果パターンを決定する制御工程と、
　前記タッチ入力手段にタッチした物体に対し、決定された前記触覚効果パターンを与える触感発生工程
を含む電子機器の制御方法。
（７）
　前記制御工程は、前記コンテンツの内容に対応した触覚効果パターンを記憶した記憶手段から前記触覚効果パターンを取得することを含む、（６）に記載の電子機器の制御方法。
（８）
　前記タッチ検出工程は、前記物体がタッチする位置、時間及び強さのうち少なくとも一つを検出することを含む、（６）又は（７）に記載の電子機器の制御方法。
（９）
　前記コンテンツは、前記表示手段に表示される複数の画面である、（６）～（８）のいずれか一項に記載の電子機器の制御方法。
（１０）
　前記コンテンツは、画像又はアプリケーションソフトのアイコンである、（６）～（８）のいずれか一項に記載の電子機器の制御方法。
（１１）
　タッチ入力手段に対する物体のタッチを検出するタッチ検出工程と、
　表示手段に表示されるコンテンツの状態を取得する表示検出工程と、
　前記表示手段に表示されるコンテンツの内容に対応した触覚効果パターンを決定する制御工程と、
　前記タッチ入力手段にタッチした物体に対し、決定された前記触覚効果パターンを与える触感発生工程
をコンピュータに実行させるプログラムを記憶したコンピュータ読み取り可能な記憶媒体。
（１２）
　前記制御工程は、前記コンテンツの内容に対応した触覚効果パターンを記憶した記憶手段から前記触覚効果パターンを取得することを含む、（１１）に記載の記憶媒体。
（１３）
　前記タッチ検出工程は、前記物体がタッチする位置、時間及び強さのうち少なくとも一つを検出することを含む、（１１）又は（１２）に記載の記憶媒体。
（１４）
　前記コンテンツは、前記表示手段に表示される複数の画面である、（１１）～（１３）のいずれか一項に記載の記憶媒体。
（１５）
　前記コンテンツは、画像又はアプリケーションソフトのアイコンである、（１１）～（１３）のいずれか一項に記載の記憶媒体。 The present invention is specified as follows.
(1)
Display means and
Touch input means and
In the display means, the display control means for displaying or changing the content and the display control means.
A touch detecting means for detecting the touch of an object to the touch input means, and a touch detecting means.
A tactile sensation generating means that gives a tactile effect to an object touched by the touch input means,
An electronic device including a control means for controlling the tactile sensation generating means so as to give a tactile effect pattern corresponding to the content of the content displayed on the display means.
(2)
The electronic device according to (1), further including a storage means for storing a tactile effect pattern corresponding to the content of the content.
(3)
The electronic device according to (1) or (2), wherein the touch detecting means can detect at least one of a position, a time, and a strength at which the object touches.
(4)
The electronic device according to any one of (1) to (3), wherein the content is a plurality of screens displayed on the display means.
(5)
The electronic device according to any one of (1) to (3), wherein the content is an image or an icon of application software.
(6)
A touch detection process that detects the touch of an object to the touch input means,
A display detection process that acquires the state of the content displayed on the display means,
A control process for determining a tactile effect pattern corresponding to the content displayed on the display means, and
A method for controlling an electronic device including a tactile sensation generation step of giving a determined tactile effect pattern to an object touched by the touch input means.
(7)
The method for controlling an electronic device according to (6), wherein the control step includes acquiring the tactile effect pattern from a storage means that stores the tactile effect pattern corresponding to the content of the content.
(8)
The method for controlling an electronic device according to (6) or (7), wherein the touch detection step includes detecting at least one of a position, a time, and an intensity to which the object touches.
(9)
The method for controlling an electronic device according to any one of (6) to (8), wherein the content is a plurality of screens displayed on the display means.
(10)
The method for controlling an electronic device according to any one of (6) to (8), wherein the content is an image or an icon of application software.
(11)
A touch detection process that detects the touch of an object to the touch input means,
A display detection process that acquires the state of the content displayed on the display means,
A control process for determining a tactile effect pattern corresponding to the content displayed on the display means, and
A computer-readable storage medium that stores a program that causes a computer to execute a tactile sensation generation step that gives a determined tactile effect pattern to an object touched by the touch input means.
(12)
The storage medium according to (11), wherein the control step includes acquiring the tactile effect pattern from a storage means that stores the tactile effect pattern corresponding to the content of the content.
(13)
The storage medium according to (11) or (12), wherein the touch detection step includes detecting at least one of a position, a time, and an intensity to which the object touches.
(14)
The storage medium according to any one of (11) to (13), wherein the content is a plurality of screens displayed on the display means.
(15)
The storage medium according to any one of (11) to (13), wherein the content is an image or an icon of application software.
　本発明によれば、表示コンテンツの内容に応じて、様々な触覚効果パターンを与えることが可能な電子機器及び電子機器の制御方法を提供することができる。 According to the present invention, it is possible to provide an electronic device and a control method for the electronic device, which can give various tactile effect patterns according to the content of the displayed content.
　表示コンテンツの内容に応じて、様々な触覚効果パターンを与えることにより、ユーザは、タッチした位置や、タッチにより触発されるイベントを容易に知ることができ、ユーザ利便性が向上する。また、コンテンツの内容によっては良好なエンターテイメント効果が得られる場合がある。更に、表示手段に表示されるコンテンツの変更に伴い、ユーザがタッチパネルの同じ場所をタッチしても、対応する触覚効果パターンを変更することが可能であり、表示コンテンツの内容と触覚効果パターンの連動性が得られる。 By giving various tactile effect patterns according to the content of the displayed content, the user can easily know the touched position and the event inspired by the touch, and the user convenience is improved. In addition, a good entertainment effect may be obtained depending on the content. Further, with the change of the content displayed on the display means, even if the user touches the same place on the touch panel, the corresponding tactile effect pattern can be changed, and the content of the displayed content and the tactile effect pattern are linked. Sex is obtained.
本発明の電子機器の一実施形態の概略構成を示すブロック図である。It is a block diagram which shows the schematic structure of one Embodiment of the electronic device of this invention. 本発明の一実施形態において、電子機器が複数の触覚効果パターンを提供する態様を示す図である。It is a figure which shows the aspect which the electronic device provides a plurality of tactile effect patterns in one Embodiment of this invention. 本発明の一実施形態における、表示制御部が表示手段の表示状態を制御するフローチャートである。It is a flowchart in which the display control unit controls the display state of a display means in one embodiment of the present invention. 本発明の一実施形態における、タッチ検出手段がタッチ入力を検出及び決定するフローチャートである。FIG. 5 is a flowchart in which a touch detecting means in an embodiment of the present invention detects and determines a touch input. 本発明の一実施形態における、触覚効果パターンを決定及び生成するフローチャートである。It is a flowchart which determines and generates a tactile effect pattern in one Embodiment of this invention.
　次に本発明の実施形態を図面を参照しながら詳細に説明する。本発明は以下の実施形態に限定されるものではなく、本発明の趣旨を逸脱しない範囲で、当業者の通常の知識に基づいて、適宜設計の変更、改良等が加えられることが理解されるべきである。 Next, an embodiment of the present invention will be described in detail with reference to the drawings. It is understood that the present invention is not limited to the following embodiments, and design changes, improvements, etc. may be appropriately made based on ordinary knowledge of those skilled in the art without departing from the spirit of the present invention. Should be.
（１．電子機器）
　図１は、本発明の電子機器の一実施形態の概略構成を示すブロック図である。電子機器１００は、駆動パターン記憶部１０１、メモリ制御部１０２、触感制御部１０３、触感生成部１０４、触感動作部１０５、表示部１０６（本実施形態においてはタッチ入力を受け取る入力部を兼ねる）、表示制御部１０７、入力位置検出部１０８を備える。 (1. Electronic equipment)
FIG. 1 is a block diagram showing a schematic configuration of an embodiment of the electronic device of the present invention. The electronic device 100 includes a drive pattern storage unit 101, a memory control unit 102, a tactile control unit 103, a tactile sensation generation unit 104, a tactile operation unit 105, and a display unit 106 (also serving as an input unit for receiving a touch input in this embodiment). It includes a display control unit 107 and an input position detection unit 108.
　駆動パターン記憶部１０１は例えばハードディスク（ＨＤ）やＲＯＭ、ＲＡＭなどで構成され、予め定義した触覚効果パターン（強さ、持続時間、振動波形など）に対応する情報が記憶されている。一部の実施形態においては、触覚効果パターンは、表示部１０６に表示される設定画面などを通じて、ユーザが任意に設定又は変更することができる。 The drive pattern storage unit 101 is composed of, for example, a hard disk (HD), a ROM, a RAM, or the like, and stores information corresponding to a predetermined tactile effect pattern (strength, duration, vibration waveform, etc.). In some embodiments, the tactile effect pattern can be arbitrarily set or changed by the user through a setting screen or the like displayed on the display unit 106.
　メモリ制御部１０２は、駆動パターン記憶部１０１を制御するブロックであり、入力部がタッチされた際に、タッチ入力に関連する属性（タッチされた位置、タッチする時間や強さ、及びタッチされたときに表示部１０６に表示されているコンテンツの内容など）に応じて、発生させるべき触覚効果パターンを関連付ける。 The memory control unit 102 is a block that controls the drive pattern storage unit 101, and when the input unit is touched, the attributes related to the touch input (touched position, touch time and strength, and touched). Occasionally, the tactile effect pattern to be generated is associated according to the content of the content displayed on the display unit 106, etc.).
　関連付けられた触覚効果パターンに関する情報は、触感制御部１０３に通知され、触感制御部１０３は通知された情報に基づいて、触感生成部１０４を制御して所定の触覚効果パターンを発生させる。一部の実施形態においては、触覚効果パターンは予め記憶されたものでなくても、タッチ入力に関連する属性を用いて、特定のアルゴリズムに基づいて、その都度触覚効果パターンを決定することも可能である。 Information on the associated tactile effect pattern is notified to the tactile control unit 103, and the tactile control unit 103 controls the tactile sensation generation unit 104 to generate a predetermined tactile effect pattern based on the notified information. In some embodiments, the tactile effect pattern may not be pre-stored, but the attributes associated with the touch input may be used to determine the tactile effect pattern on a case-by-case basis based on a particular algorithm. Is.
　触感生成部１０４は、さまざまな触覚効果パターンを実際に生成する、任意のアクチュエータを備えることができる。衝撃駆動型のアクチュエータや、振動駆動型のアクチュエータのいずれも、本発明のために用いることができる。衝撃駆動型は代表例として、形状記憶合金を利用するＳＩＡ（Ｓｈａｐｅ　ｍｅｍｏｒｙ　ａｌｌｏｙ　Ｉｍｐａｃｔ　Ａｃｔｕａｔｏｒ）やピエゾ素子を利用した圧電アクチュエータを挙げることができる。衝撃駆動型アクチュエータは、衝撃的な動きが可能な動作部品を含み、電子機器のタッチスクリーンや筐体に対し、動作部品が打撃し、又は連動させることで一過性の衝撃を与える。振動駆動型アクチュエータは代表例として偏心モータを利用するＥＲＭ（Ｅｃｃｅｎｔｒｉｃ　Ｒｏｔａｔｉｎｇ　Ｍａｓｓ）型アクチュエータ、磁界中のコイルに交流電流を流して可動子を振動させるリニア共振型アクチュエータ（ＬＲＡ：Ｌｉｎｅａｒ　Ｒｅｓｏｎａｎｔ　Ａｃｔｕａｔｏｒ）などを挙げることができる。振動駆動型は振動体に必要な時間だけ一定の振幅の振動を与える。一実施形態においては、さまざまな触覚効果パターンを生成するために、複数のアクチュエータを用いることができ、衝撃駆動型及び振動駆動型をそれぞれ１つ以上併用することもできる。 The tactile sensation generation unit 104 can be provided with an arbitrary actuator that actually generates various tactile effect patterns. Both a shock-driven actuator and a vibration-driven actuator can be used for the present invention. Typical examples of the impact drive type include SIA (Shape memory alloy Impact Actuator) using a shape memory alloy and a piezoelectric actuator using a piezo element. The impact-driven actuator includes a moving component capable of shocking movement, and gives a transient impact to the touch screen or housing of an electronic device by hitting or interlocking the moving component. Typical examples of the vibration drive type actuator are an ERM (Eccentric Rotating Mass) type actuator that uses an eccentric motor, and a linear resonance type actuator (LRA: Linear Resonant Actuator) that vibrates a mover by passing an alternating current through a coil in a magnetic field. Can be mentioned. The vibration-driven type gives a vibration of a constant amplitude to the vibrating body for the required time. In one embodiment, a plurality of actuators can be used to generate various tactile effect patterns, and one or more shock-driven and vibration-driven types can be used in combination.
　例えば、本発明の一実施形態における触感生成部１０４のアクチュエータは、コイル、動作部品（例えば金属芯材）及びバネから作られている。コイルは金属の回りに巻きつけられ、（ここで、コイルと金属の部品の両者は「ソレノイド」と称してよい）かつ、コイルが磁界を生成するとき（例えば、電流がコイル端子間を流れる時）金属は移動する。当該金属の移動は電子機器に衝撃をもたらし得る。バネは次いで、電流がコイルから除去されるとき移動金属又は他の芯材を静止位置に戻すように用いてよい。 For example, the actuator of the tactile sensation generating unit 104 in one embodiment of the present invention is made of a coil, an operating component (for example, a metal core material), and a spring. The coil is wound around the metal (where both the coil and the metal component may be referred to as "solenoids") and when the coil creates a magnetic field (eg, when a current flows between the coil terminals). ) The metal moves. The movement of the metal can have an impact on the electronic device. The spring may then be used to return the moving metal or other core material to a stationary position when the current is removed from the coil.
　あるいは、別の実施形態における衝撃駆動型アクチュエータは、通電加熱で収縮するワイヤー状形状記憶合金と、このワイヤー状形状記憶合金に接触し当該ワイヤー状形状記憶合金で生じた熱を逃がす円盤状絶縁性熱伝導体（動作部品）と、を備えるように構成される。駆動回路により、当該ワイヤー状形状記憶合金に対して瞬間的に通電を行い、ワイヤー状形状記憶合金を瞬間的に収縮させると、それに接触する円盤状絶縁性熱伝導体が瞬間的に押圧されて変位する。当該円盤状絶縁性熱伝導体の変位は電子機器に衝撃をもたらし得る。そして、円盤状絶縁性熱伝導体による熱伝導作用によってワイヤー状形状記憶合金で生じた熱が急速に放熱され、その結果、ワイヤー状形状記憶合金は直ぐに元の長さ状態（伸長状態）に戻る。こうして、ワイヤー状形状記憶合金において、相対的に短い時間間隔での瞬間的な収縮を行うことが可能となる。このようなアクチュエータの詳細は再表２０１２－０２３６０５号公報に開示されている。 Alternatively, the impact-driven actuator in another embodiment has a wire-shaped shape memory alloy that contracts when energized and heated, and a disk-shaped insulating property that comes into contact with the wire-shaped shape memory alloy and releases heat generated by the wire-shaped shape memory alloy. It is configured to include a thermal conductor (moving component). When the wire-shaped shape memory alloy is momentarily energized by the drive circuit and the wire-shaped shape memory alloy is momentarily shrunk, the disk-shaped insulating thermal conductor in contact with the wire-shaped shape memory alloy is momentarily pressed. Displace. The displacement of the disk-shaped insulating thermal conductor can cause an impact on the electronic device. Then, the heat generated by the wire-shaped shape memory alloy is rapidly dissipated by the heat conduction action of the disk-shaped insulating heat conductor, and as a result, the wire-shaped shape memory alloy immediately returns to the original length state (extended state). .. In this way, the wire-shaped shape memory alloy can be momentarily shrunk at relatively short time intervals. Details of such actuators are disclosed in Japanese Patent Publication No. 2012-023655.
　触感生成部１０４が生成した触覚効果パターンは、触感動作部１０５に伝達される。触感動作部１０５は、例えば抵抗膜タッチパネル、モニタ表面であり得る。触感動作部１０５は、触覚効果パターンをユーザに伝達するために、入力部に近接していることが好ましい。一部の実施形態においては、触感動作部１０５は、表示部１０６（入力部）と一体に形成される。 The tactile effect pattern generated by the tactile sensation generation unit 104 is transmitted to the tactile sensation movement unit 105. The tactile motion unit 105 may be, for example, a resistance film touch panel or a monitor surface. The tactile motion unit 105 is preferably close to the input unit in order to transmit the tactile effect pattern to the user. In some embodiments, the tactile motion unit 105 is formed integrally with the display unit 106 (input unit).
　表示部１０６は、例えば液晶パネルなどのディスプレイであり、表示制御部１０７の制御に基づいて、画像やＧＵＩ（Ｇｒａｐｈｉｃａｌ　Ｕｓｅｒ　Ｉｎｔｅｒｆａｃｅ）を構成するＧＵＩ画面などを表示する。表示制御部１０７は、プログラムに従い表示制御信号を生成し、あるいは表示制御信号を受け取り、表示部１０６に表示するための映像信号を生成して、表示部１０６に出力する。表示部１０６は、入力された映像信号に基づいて映像を表示する。 The display unit 106 is a display such as a liquid crystal panel, and displays an image or a GUI screen constituting a GUI (Graphical User Interface) based on the control of the display control unit 107. The display control unit 107 generates a display control signal according to a program, or receives a display control signal, generates a video signal for display on the display unit 106, and outputs the video signal to the display unit 106. The display unit 106 displays an image based on the input video signal.
　直感的な操作を実現するために、入力部は表示部と一体であってもよい。典型的にはタッチパネル付きモニタである。あるいは、入力部は、表示部とは別個の構成部品であってもよい。典型的にはマウスなどの物理スイッチや、ノートパソコンのトラックパッドなどである。入力部にタッチする物体は、典型的にはユーザの手指、又はユーザが操作するスタイラスペンである。 In order to realize intuitive operation, the input unit may be integrated with the display unit. It is typically a monitor with a touch panel. Alternatively, the input unit may be a component separate from the display unit. Typically, it is a physical switch such as a mouse or a trackpad of a notebook computer. The object that touches the input unit is typically a user's finger or a stylus pen operated by the user.
　表示制御部１０７は、表示部１０６にコンテンツを表示し、又はコンテンツを変更することができる。表示制御部１０７は、パーソナルコンピュータなどを用いて構成可能なものである。表示されるコンテンツとしては、ＧＵＩの複数の画面、画像、アプリケーションのアイコンなどがある。表示制御部１０７は、現在表示されているコンテンツの状態（すなわち、現在どのようなコンテンツが表示されているか）を取得し、メモリ制御部１０２に出力することができる。 The display control unit 107 can display the content on the display unit 106 or change the content. The display control unit 107 can be configured by using a personal computer or the like. The displayed contents include a plurality of GUI screens, images, application icons, and the like. The display control unit 107 can acquire the state of the currently displayed content (that is, what kind of content is currently displayed) and output it to the memory control unit 102.
　入力位置検出部１０８は、例えば抵抗膜タッチパネル付きモニタのタッチパネルであり、入力部がタッチされたこと、及びタッチされた座標を取得し、メモリ制御部１０２に出力することができる。一部の実施形態においては、入力位置検出部１０８は、更にタッチする時間及び強さ（押圧力）の少なくとも一方をも検出することができる。 The input position detection unit 108 is, for example, a touch panel of a monitor with a resistance film touch panel, and can acquire the touched input unit and the touched coordinates and output the touch panel to the memory control unit 102. In some embodiments, the input position detection unit 108 can also detect at least one of the touch time and the strength (pushing pressure).
　本発明は、表示コンテンツの内容に応じて、様々な触覚効果パターンを与えることが可能である。例えば、一実施形態において、コンテンツが複数の画面であり、触感制御部１０３は、それぞれの画面に関連付けられる触覚効果パターンを発生するように、触感生成部１０４を制御することができる。画面毎の触覚効果パターンを発生可能とすることにより、画面が切り替わったことをさらに直感的にユーザに伝達でき、また、画面の内容に最適な触覚効果パターンを実現可能である。 The present invention can give various tactile effect patterns according to the content of the displayed content. For example, in one embodiment, the content is a plurality of screens, and the tactile control unit 103 can control the tactile sensation generation unit 104 so as to generate a tactile effect pattern associated with each screen. By making it possible to generate a tactile effect pattern for each screen, it is possible to more intuitively convey to the user that the screen has been switched, and it is possible to realize a tactile effect pattern that is optimal for the contents of the screen.
　本発明の一実施形態において、コンテンツが画像又はアプリケーションソフトのアイコンであり、触感制御部１０３は、それぞれの画像又はアイコンに関連付けられる触覚効果パターンを発生するように、触感生成部１０４を制御することができる。画像又はアイコン毎の触覚効果パターンを発生可能とすることにより、ユーザがタッチした場所を更に直感的にユーザに伝達でき、また、画像又はアイコンの内容に最適な触覚効果パターンを実現可能である。画像又はアイコンは、同一の画面に表示されるものであってもよく、画面の切り替えによって別々の画面に表示されるものであってもよい。 In one embodiment of the present invention, the content is an image or an icon of application software, and the tactile control unit 103 controls the tactile sensation generation unit 104 so as to generate a tactile effect pattern associated with each image or icon. Can be done. By making it possible to generate a tactile effect pattern for each image or icon, the place touched by the user can be more intuitively transmitted to the user, and the tactile effect pattern optimal for the content of the image or icon can be realized. The images or icons may be displayed on the same screen, or may be displayed on different screens by switching screens.
　本発明の一実施形態において、コンテンツは、各々複数の画像又はアイコンを含む、複数の画面であり、触感制御部１０３は、それぞれの画面につき、当該画面に含まれる画像又はアイコンに関連付けられる触覚効果パターンを発生するように、触感生成部１０４を制御することができる。すなわち、同一画面内においても、タッチした位置に対応する画像又はアイコンには、独立した触覚効果パターンが関連付けられており、同一の表示画面内において、異なる触覚効果パターンをユーザにフィードバックすることが可能である。これにより、ユーザがタッチした場所を更に直感的にユーザに伝達でき、また、画像又はアイコンの内容に最適な触覚効果パターンを実現可能である。 In one embodiment of the present invention, the content is a plurality of screens each including a plurality of images or icons, and the tactile control unit 103 has a tactile effect associated with the images or icons included in the screens for each screen. The tactile sensation generation unit 104 can be controlled so as to generate a pattern. That is, even in the same screen, an independent tactile effect pattern is associated with the image or icon corresponding to the touched position, and it is possible to feed back different tactile effect patterns to the user in the same display screen. Is. Thereby, the place touched by the user can be more intuitively transmitted to the user, and the tactile effect pattern most suitable for the content of the image or the icon can be realized.
　本発明の一実施形態において、入力位置検出部１０８が検出したタッチの位置、時間又は強さに応じて、異なる触覚効果パターンを発生することが可能である。すなわち、ユーザがタッチした位置に応じて、あるいは、タッチした位置が同一であっても、ユーザがタッチする時間の長さ又は強さに応じて、異なる触覚効果パターンをフィードバックすることで、当該タッチの時間の長さ又は強さに対応したイベントが触発されたことをユーザに知らせることができる。もちろん、当該タッチの位置、時間の長さ又は強さに対応したイベントがなくても、ユーザ利便性又はエンターテイメント効果のために、複数の触覚効果パターンを用意してもよい。例えば、タッチが比較的に強いときに、衝撃の強い触覚効果パターンをフィードバックし、タッチが比較的に弱いときに、衝撃の弱い触覚効果パターンをフィードバックすることができる。逆に、タッチが比較的に強いときに、衝撃の弱い触覚効果パターンをフィードバックし、タッチが比較的に弱いときに、衝撃の強い触覚効果パターンをフィードバックすることができる。 In one embodiment of the present invention, it is possible to generate different tactile effect patterns depending on the position, time or intensity of the touch detected by the input position detecting unit 108. That is, by feeding back different tactile effect patterns according to the position touched by the user, or even if the touched position is the same, depending on the length or strength of the time touched by the user, the touch is performed. It is possible to inform the user that an event corresponding to the length or strength of the time has been triggered. Of course, a plurality of tactile effect patterns may be prepared for user convenience or entertainment effect even if there is no event corresponding to the position, time length or strength of the touch. For example, when the touch is relatively strong, the tactile effect pattern with a strong impact can be fed back, and when the touch is relatively weak, the tactile effect pattern with a weak impact can be fed back. On the contrary, when the touch is relatively strong, the tactile effect pattern with a weak impact can be fed back, and when the touch is relatively weak, the tactile effect pattern with a strong impact can be fed back.
　上記各実施形態の利点はそれぞれ独立するものではなく、それぞれの実施形態を組み合わせて独特で多彩な触覚効果パターンの組み合わせを組み立てることができる。また、いずれの実施形態においては、特定のタッチ入力属性に対応する触覚効果パターンは予め決定されていてもよく、いくつかの触覚効果パターン候補の中から、ユーザによって設定されてもよい。 The advantages of each of the above embodiments are not independent, and each embodiment can be combined to assemble a unique and diverse combination of tactile effect patterns. Further, in any of the embodiments, the tactile effect pattern corresponding to the specific touch input attribute may be predetermined, or may be set by the user from among several tactile effect pattern candidates.
　図２は、本発明の一実施形態において、電子機器が複数の触覚効果パターンを提供する態様を示す図である。この実施形態では、電子機器の表示手段（ディスプレイなど）に表示する複数の画面である表示Ａ、表示Ｂ、及び表示Ｃが含まれ、表示Ａ～Ｃは、それぞれ表示手段の全体を占めるが、ユーザの選択に応じて、又はプログラムに指令に基づいて、表示制御手段により、各表示間で切り替えることができる。画面毎の触覚効果パターンの違いとして、表示Ａが表示されている間、触覚効果パターンが全体的に弱く、表示Ｂが表示されている間、触覚効果パターンが全体的に強くなるように設定されている。また、表示が切り替わると、タッチ入力手段の同じ位置にタッチしても、異なる触覚効果パターンが得られる。更に、同一の表示内であっても、異なる位置にあるアイコンにタッチすると、異なる触覚効果パターンが得られる。 FIG. 2 is a diagram showing an embodiment of the present invention in which an electronic device provides a plurality of tactile effect patterns. In this embodiment, display A, display B, and display C, which are a plurality of screens to be displayed on a display means (display or the like) of an electronic device, are included, and displays A to C each occupy the entire display means. It is possible to switch between each display by the display control means according to the user's selection or based on the command in the program. As a difference in the tactile effect pattern for each screen, the tactile effect pattern is set to be weak as a whole while the display A is displayed, and the tactile effect pattern is set to be strong as a whole while the display B is displayed. ing. Further, when the display is switched, different tactile effect patterns can be obtained even if the touch input means is touched at the same position. Furthermore, touching icons at different positions, even within the same display, gives different tactile effect patterns.
（２．電子機器の制御方法及びプログラムの記憶媒体）
　本発明の電子機器の制御方法は、
　タッチ入力手段に対する物体のタッチを検出するタッチ検出工程と、
　表示手段に表示されるコンテンツの状態を取得する表示検出工程と、
　前記表示手段に表示されるコンテンツの内容に対応した触覚効果パターンを決定する制御工程と、
　前記タッチ入力手段にタッチした物体に対し、決定された前記触覚効果パターンを与える触感発生工程
を含む。 (2. Control method of electronic devices and storage medium of programs)
The method for controlling an electronic device of the present invention is as follows.
A touch detection process that detects the touch of an object to the touch input means,
A display detection process that acquires the state of the content displayed on the display means,
A control process for determining a tactile effect pattern corresponding to the content displayed on the display means, and
The tactile sensation generation step of giving the determined tactile effect pattern to the object touched by the touch input means is included.
　図３～５は、本発明の一実施形態における、電子機器の制御手順を説明するフローチャートである。図３は、表示制御手段が表示手段の表示状態を制御するフローチャートを示し、図４は、タッチ検出手段がタッチ入力検出及び決定するフローチャートを示し、図５は、触覚効果パターンを決定及び生成するフローチャートを示す。 FIGS. 3 to 5 are flowcharts illustrating a control procedure for an electronic device according to an embodiment of the present invention. FIG. 3 shows a flowchart in which the display control means controls the display state of the display means, FIG. 4 shows a flowchart in which the touch detection means detects and determines the touch input, and FIG. 5 shows a flowchart in which the tactile effect pattern is determined and generated. The flow chart is shown.
　表示制御手段は、表示手段にコンテンツを表示させ、又は表示中のコンテンツを変更する機能を備えている。図３を参照すると、現在の表示状態から、表示を更新（又は変更）すべきイベントの有無を判定する。表示状態とは、現在表示されているコンテンツの内容を意味する。表示状態を更新又は変更するイベントとしては、ユーザによる指令や、特定の条件が満たされたことなどが考えられる。イベントがあった場合（Ｙ）、表示制御手段は、表示内容を更新して、表示状態を変更する。イベントがない場合（Ｎ）、現在の表示状態を維持する。 The display control means has a function of displaying the content on the display means or changing the displayed content. With reference to FIG. 3, it is determined from the current display state whether or not there is an event for which the display should be updated (or changed). The display state means the content of the currently displayed content. As an event for updating or changing the display state, it is conceivable that a command from the user or a specific condition is satisfied. When there is an event (Y), the display control means updates the display content and changes the display state. If there is no event (N), the current display state is maintained.
　次に、図４を参照すると、タッチ検出手段は、常にタッチ入力を検出できるように、入力待機状態にあり、タッチ入力がある場合（Ｙ）、タッチ検出手段がタッチ入力に関連する属性（タッチされた位置、タッチする時間や強さ、及びタッチされたときの表示状態など）を確定し、タッチ入力の位置を検出又は確定し、入力判定を更新する。 Next, referring to FIG. 4, the touch detecting means is in the input standby state so that the touch input can always be detected, and when there is a touch input (Y), the touch detecting means has an attribute (touch) related to the touch input. The touched position, touch time and strength, display state when touched, etc.) are fixed, the touch input position is detected or fixed, and the input judgment is updated.
　次に、図５を参照すると、電子機器の電源を投入すると、各部初期設定の画面が表示され、ユーザが各コンテンツにつき、例えば画面毎の触覚効果パターン、画像又はアイコン毎の触覚効果パターン、タッチする時間又は強さに対応した触覚効果パターンなどを選択することが可能である。当該初期設定画面は必須ではなく、ユーザに設定機能を提供しないこともあり得る。初期設定画面を提供する場合であっても、一度設定した後に、ユーザによる呼出しがない限り当該初期設定画面を表示しないこともあり得る。 Next, referring to FIG. 5, when the power of the electronic device is turned on, the screen for initial setting of each part is displayed, and the user can use the tactile effect pattern for each screen, the tactile effect pattern for each image or icon, and the touch for each content. It is possible to select a tactile effect pattern or the like corresponding to the time or strength of the operation. The initial setting screen is not essential, and it is possible that the setting function is not provided to the user. Even when the initial setting screen is provided, the initial setting screen may not be displayed unless the user calls it after setting once.
　表示手段にコンテンツが表示されている状態で、表示制御手段は、現在の表示状態を取得する。そして、入力判定が更新され、タッチ入力が発生すると、タッチ検出手段がタッチ入力に関連する属性を取り込み、同時に入力位置を取得する。判定された入力属性及び入力位置、並びに判定された表示状態に基づいて、制御手段は、予め関連付けられた触覚効果パターンを判定し、又は最適な触覚効果パターンを決定し、アクチュエータなどの触感発生手段の駆動パターンを判定又は決定する。当該駆動パターンに基づいて、触感発生手段が動作し、ユーザに所定の触覚フィードバックを提供する。 While the content is displayed on the display means, the display control means acquires the current display state. Then, when the input determination is updated and a touch input occurs, the touch detecting means captures the attributes related to the touch input and simultaneously acquires the input position. Based on the determined input attribute and input position, and the determined display state, the control means determines the tactile effect pattern associated in advance, or determines the optimum tactile effect pattern, and the tactile sensation generating means such as an actuator. Judgment or determination of the drive pattern of. Based on the drive pattern, the tactile sensation generating means operates to provide a predetermined tactile feedback to the user.
　上記方法を実現するためには、前述の本発明に係る電子機器を用いることができる。また、上記方法を実施するにあたり、電子機器の作動態様は、前述と同様であり、ここでは割愛する。 In order to realize the above method, the above-mentioned electronic device according to the present invention can be used. Further, in carrying out the above method, the operating mode of the electronic device is the same as described above, and is omitted here.
　本発明は、更にプログラムを記憶したコンピュータ読み取り可能な記憶媒体に関し、
　タッチ入力手段に対する物体のタッチを検出するタッチ検出工程と、
　表示手段に表示されるコンテンツの状態を取得する表示検出工程と、
　前記表示手段に表示されるコンテンツの内容に対応した触覚効果パターンを決定する制御工程と、
　前記タッチ入力手段にタッチした物体に対し、決定された前記触覚効果パターンを与える触感発生工程
をコンピュータに実行させるプログラムを記憶する。 The present invention further relates to a computer-readable storage medium that stores a program.
A touch detection process that detects the touch of an object to the touch input means,
A display detection process that acquires the state of the content displayed on the display means,
A control process for determining a tactile effect pattern corresponding to the content displayed on the display means, and
A program for causing a computer to execute a tactile sensation generation step of giving a determined tactile effect pattern to an object touched by the touch input means is stored.
　上記プログラムは、本発明に係る方法を実現することが目的であり、その作動態様は、前述と同様であり、ここでは割愛する。 The above program aims to realize the method according to the present invention, and its operating mode is the same as described above, and is omitted here.
　以上、本発明の好ましい実施形態を説明したが、本明細書において開示される各実施形態の各具体的な特徴は互いに独立するものではなく、本発明の趣旨を逸脱しない範囲で、当業者の通常の知識に基づいて、適宜組み合わせることができることが理解されるべきである。 Although the preferred embodiments of the present invention have been described above, the specific features of the respective embodiments disclosed in the present specification are not independent of each other, and those skilled in the art will not deviate from the gist of the present invention. It should be understood that it can be combined appropriately based on ordinary knowledge.
１００　電子機器
１０１　駆動パターン記憶部
１０２　メモリ制御部
１０３　触感制御部
１０４　触感生成部
１０５　触感動作部
１０６　表示部（入力部）
１０７　表示制御部
１０８　入力位置検出部 100 Electronic device 101 Drive pattern storage unit 102 Memory control unit 103 Tactile control unit 104 Tactile sensation generation unit 105 Tactile operation unit 106 Display unit (input unit)
107 Display control unit 108 Input position detection unit

Claims (15)

  1. 　表示手段と、
    　タッチ入力手段と、
    　前記表示手段において、コンテンツを表示又は変更する表示制御手段と、
    　前記タッチ入力手段に対する物体のタッチを検出するタッチ検出手段と、
    　前記タッチ入力手段にタッチした物体に触覚効果を与える触感発生手段と、
    　前記表示手段に表示されるコンテンツの内容に対応した触覚効果パターンを与えるように、前記触感発生手段を制御する制御手段と
    を含む電子機器。     Display means and
    Touch input means and
    In the display means, the display control means for displaying or changing the content and the display control means.
    A touch detecting means for detecting the touch of an object to the touch input means, and a touch detecting means.
    A tactile sensation generating means that gives a tactile effect to an object touched by the touch input means,
    An electronic device including a control means for controlling the tactile sensation generating means so as to give a tactile effect pattern corresponding to the content of the content displayed on the display means.
  2. 　前記コンテンツの内容に対応した触覚効果パターンを記憶する記憶手段をさらに含む、請求項１に記載の電子機器。 The electronic device according to claim 1, further comprising a storage means for storing a tactile effect pattern corresponding to the content of the content.
  3. 　前記タッチ検出手段は、前記物体がタッチする位置、時間及び強さのうち少なくとも一つを検出可能である、請求項１又は２に記載の電子機器。 The electronic device according to claim 1 or 2, wherein the touch detecting means can detect at least one of a position, a time, and a strength at which the object touches.
  4. 　前記コンテンツは、前記表示手段に表示される複数の画面である、請求項１～３のいずれか一項に記載の電子機器。 The electronic device according to any one of claims 1 to 3, wherein the content is a plurality of screens displayed on the display means.
  5. 　前記コンテンツは、画像又はアプリケーションソフトのアイコンである、請求項１～３のいずれか一項に記載の電子機器。 The electronic device according to any one of claims 1 to 3, wherein the content is an image or an icon of application software.
  6. 　タッチ入力手段に対する物体のタッチを検出するタッチ検出工程と、
    　表示手段に表示されるコンテンツの状態を取得する表示検出工程と、
    　前記表示手段に表示されるコンテンツの内容に対応した触覚効果パターンを決定する制御工程と、
    　前記タッチ入力手段にタッチした物体に対し、決定された前記触覚効果パターンを与える触感発生工程
    を含む電子機器の制御方法。     A touch detection process that detects the touch of an object to the touch input means,
    A display detection process that acquires the state of the content displayed on the display means,
    A control process for determining a tactile effect pattern corresponding to the content displayed on the display means, and
    A method for controlling an electronic device including a tactile sensation generation step of giving a determined tactile effect pattern to an object touched by the touch input means.
  7. 　前記制御工程は、前記コンテンツの内容に対応した触覚効果パターンを記憶した記憶手段から前記触覚効果パターンを取得することを含む、請求項６に記載の電子機器の制御方法。 The control method for an electronic device according to claim 6, wherein the control step includes acquiring the tactile effect pattern from a storage means that stores the tactile effect pattern corresponding to the content of the content.
  8. 　前記タッチ検出工程は、前記物体がタッチする位置、時間及び強さのうち少なくとも一つを検出することを含む、請求項６又は７に記載の電子機器の制御方法。 The method for controlling an electronic device according to claim 6 or 7, wherein the touch detection step includes detecting at least one of a position, a time, and a strength at which the object touches.
  9. 　前記コンテンツは、前記表示手段に表示される複数の画面である、請求項６～８のいずれか一項に記載の電子機器の制御方法。 The method for controlling an electronic device according to any one of claims 6 to 8, wherein the content is a plurality of screens displayed on the display means.
  10. 　前記コンテンツは、画像又はアプリケーションソフトのアイコンである、請求項６～８のいずれか一項に記載の電子機器の制御方法。 The electronic device control method according to any one of claims 6 to 8, wherein the content is an image or an icon of application software.
  11. 　タッチ入力手段に対する物体のタッチを検出するタッチ検出工程と、
    　表示手段に表示されるコンテンツの状態を取得する表示検出工程と、
    　前記表示手段に表示されるコンテンツの内容に対応した触覚効果パターンを決定する制御工程と、
    　前記タッチ入力手段にタッチした物体に対し、決定された前記触覚効果パターンを与える触感発生工程
    をコンピュータに実行させるプログラムを記憶したコンピュータ読み取り可能な記憶媒体。     A touch detection process that detects the touch of an object to the touch input means,
    A display detection process that acquires the state of the content displayed on the display means,
    A control process for determining a tactile effect pattern corresponding to the content displayed on the display means, and
    A computer-readable storage medium that stores a program that causes a computer to execute a tactile sensation generation step that gives a determined tactile effect pattern to an object touched by the touch input means.
  12. 　前記制御工程は、前記コンテンツの内容に対応した触覚効果パターンを記憶した記憶手段から前記触覚効果パターンを取得することを含む、請求項１１に記載の記憶媒体。 The storage medium according to claim 11, wherein the control step includes acquiring the tactile effect pattern from a storage means that stores the tactile effect pattern corresponding to the content of the content.
  13. 　前記タッチ検出工程は、前記物体がタッチする位置、時間及び強さのうち少なくとも一つを検出することを含む、請求項１１又は１２に記載の記憶媒体。 The storage medium according to claim 11 or 12, wherein the touch detection step includes detecting at least one of a position, a time, and a strength at which the object touches.
  14. 　前記コンテンツは、前記表示手段に表示される複数の画面である、請求項１１～１３のいずれか一項に記載の記憶媒体。 The storage medium according to any one of claims 11 to 13, wherein the content is a plurality of screens displayed on the display means.
  15. 　前記コンテンツは、画像又はアプリケーションソフトのアイコンである、請求項１１～１３のいずれか一項に記載の記憶媒体。 The storage medium according to any one of claims 11 to 13, wherein the content is an image or an icon of application software.
PCT/JP2021/025030 2020-09-11 2021-07-01 Electronic apparatus and method for controlling electronic apparatus WO2022054382A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-153328 2020-09-11
JP2020153328 2020-09-11

Publications (1)

Publication Number Publication Date
WO2022054382A1 true WO2022054382A1 (en) 2022-03-17

Family

ID=80632209

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/025030 WO2022054382A1 (en) 2020-09-11 2021-07-01 Electronic apparatus and method for controlling electronic apparatus

Country Status (1)

Country Link
WO (1) WO2022054382A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005267080A (en) * 2004-03-17 2005-09-29 Sony Corp Input device with tactile function, information input method and electronic equipment
JP2006198473A (en) * 2005-01-18 2006-08-03 Sony Corp Vibration transmission structure and input/output device having tactile function, and electronic equipment
JP2014241080A (en) * 2013-06-12 2014-12-25 本田技研工業株式会社 Program and application control method
WO2016038677A1 (en) * 2014-09-09 2016-03-17 三菱電機株式会社 Tactile sensation control system and tactile sensation control method
WO2016038676A1 (en) * 2014-09-09 2016-03-17 三菱電機株式会社 Tactile sensation control system and tactile sensation control method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005267080A (en) * 2004-03-17 2005-09-29 Sony Corp Input device with tactile function, information input method and electronic equipment
JP2006198473A (en) * 2005-01-18 2006-08-03 Sony Corp Vibration transmission structure and input/output device having tactile function, and electronic equipment
JP2014241080A (en) * 2013-06-12 2014-12-25 本田技研工業株式会社 Program and application control method
WO2016038677A1 (en) * 2014-09-09 2016-03-17 三菱電機株式会社 Tactile sensation control system and tactile sensation control method
WO2016038676A1 (en) * 2014-09-09 2016-03-17 三菱電機株式会社 Tactile sensation control system and tactile sensation control method

Similar Documents

Publication Publication Date Title
JP6546301B2 (en) Multi-touch device with dynamic haptic effect
US10338798B2 (en) Haptically enabled user interface
US9652041B2 (en) Haptic device with linear resonant actuator
JP5529663B2 (en) Input device
JP5654114B2 (en) Electronic device with touch sensor
JP6226574B2 (en) Haptic feedback control system
JP5660580B2 (en) Electronics
JP2008033739A (en) Touch screen interaction method and apparatus based on tactile force feedback and pressure measurement
CN104679233A (en) Systems and methods for generating friction and vibrotactile effects
KR20140064645A (en) System and method for feedforward and feedback with haptic effects
US20090167715A1 (en) User interface of portable device and operating method thereof
WO2022054382A1 (en) Electronic apparatus and method for controlling electronic apparatus
KR20130010865A (en) Method and apparatus for providing vibrotactile
JP2013156682A (en) User interface device for notifying event activation with inaudible oscillation, event activation notifying method, and program
JP5292244B2 (en) Input device
KR20090122571A (en) Feedback method for touchscreen and apparatus using the same
JP2016162061A (en) Haptic feedback device
JP2022109145A (en) Tactile feedback system
JP2011095925A (en) Input device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21866343

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21866343

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP