JP2022063332A - コントローラ装置、及びその制御方法 - Google Patents
コントローラ装置、及びその制御方法 Download PDFInfo
- Publication number
- JP2022063332A JP2022063332A JP2022023086A JP2022023086A JP2022063332A JP 2022063332 A JP2022063332 A JP 2022063332A JP 2022023086 A JP2022023086 A JP 2022023086A JP 2022023086 A JP2022023086 A JP 2022023086A JP 2022063332 A JP2022063332 A JP 2022063332A
- Authority
- JP
- Japan
- Prior art keywords
- control unit
- user
- controller device
- voice
- tactile presentation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 10
- 230000035807 sensation Effects 0.000 claims abstract description 20
- 230000010365 information processing Effects 0.000 description 33
- 230000005236 sound signal Effects 0.000 description 19
- 210000004247 hand Anatomy 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 210000003811 finger Anatomy 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 1
- 210000003813 thumb Anatomy 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/211—Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/215—Input arrangements for video game devices characterised by their sensors, purposes or types comprising means for detecting acoustic signals, e.g. using a microphone
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
- A63F13/285—Generating tactile feedback signals via the game input device, e.g. force feedback
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/54—Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B6/00—Tactile signalling systems, e.g. personal calling systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/02—Casings; Cabinets ; Supports therefor; Mountings therein
- H04R1/028—Casings; Cabinets ; Supports therefor; Mountings therein associated with devices performing functions other than acoustics, e.g. electric candles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R9/00—Transducers of moving-coil, moving-strip, or moving-wire type
- H04R9/02—Details
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1037—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1043—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being characterized by constructional details
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1081—Input via voice recognition
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/6063—Methods for processing data by generating or executing the game program for sound processing
- A63F2300/6081—Methods for processing data by generating or executing the game program for sound processing generating an output signal, e.g. under timing constraints, for spatialization
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05G—CONTROL DEVICES OR SYSTEMS INSOFAR AS CHARACTERISED BY MECHANICAL FEATURES ONLY
- G05G5/00—Means for preventing, limiting or returning the movements of parts of a control mechanism, e.g. locking controlling member
- G05G5/03—Means for enhancing the operator's awareness of arrival of the controlling member at a command or datum position; Providing feel, e.g. means for creating a counterforce
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
- Mechanical Control Devices (AREA)
Abstract
Description
次に本実施の形態のコントローラ装置1における制御の例について説明する。以下では、
(1)音声をマイクから入力する際の処理例
(2)入力された音声を利用した処理
(3)スピーカーと触覚提示制御とを同時的に行う制御
(4)操作入力としての音声入力
(5)音声入力による設定
の各処理について順次、説明する。
本実施の形態のこの例では、ユーザが、音声をマイク22Mから入力する場合について説明する。コントローラ装置1の制御部21は、例えばユーザが音声入力を行う旨を表す予め定められた操作を行うと、当該操作が行われている間、マイク入力部22から入力される信号を受け入れて、当該信号をメモリに記録する。
また本実施の形態の制御部21は、マイク入力部22から入力される音声信号を利用して次のような処理を行ってもよい。
また本実施の形態のコントローラ装置1は、情報処理装置2から入力される指示に従って音声を鳴動する等の処理を行っているが、このとき、音声鳴動指示を受けた制御部21は、データ制御部34の動作として、当該受信した音声鳴動指示に係る音声信号を表す波形情報を、音声出力制御部36に出力するとともに、触覚提示制御部37へも出力してもよい。
また本実施の形態のコントローラ装置1の制御部21は、マイク入力部22から入力される音声信号をメモリに保持するほか、次のように利用することとしてもよい。
P=αA・βf、
攻撃範囲のパラメータTを、
T=γ/f
などとして求める。ここでα,β,γは予め実験的に定めた定数である。この例によると、ユーザが入力した音声の周波数が低いほど、攻撃力は小さくなり、攻撃範囲は広くなる。またユーザが入力した音声の周波数が高くなると、攻撃力は大きくなり、攻撃範囲は狭くなるという制御が行われる。
さらにコントローラ装置1の制御部21は、マイク入力部22から入力され、メモリに保持した音声信号の波形情報を、そのまま情報処理装置2に送信してもよい。
また本実施の形態では、触覚提示デバイス24は例えばボイスコイルモータとしたが、本実施の形態はこの例に限られず、ユーザに振動を提示できるものであれば、バイブレータによる振動提示を行うデバイス等であってもよい。
Claims (4)
- ユーザの手に把持されるコントローラ装置であって、
マイクと、
ユーザの手に触覚を提示する触覚提示デバイスと、
スピーカーとを含み、
前記マイクからユーザが音声を入力している間は、前記スピーカーの鳴動を抑制し、前記触覚提示デバイスによる触覚提示制御を行うコントローラ装置。 - 請求項1に記載のコントローラ装置であって、
前記マイクからユーザが音声を入力している間は、前記触覚提示デバイスが提示する触覚を表す振動波形に対し、ローパスフィルタを適用して、当該ローパスフィルタを適用した後の振動波形に基づいて前記触覚提示デバイスを制御するコントローラ装置。 - 請求項1または2に記載のコントローラ装置であって、
前記触覚提示デバイスは、ボイスコイルモータを含むコントローラ装置。 - ユーザの手に把持されるコントローラ装置の制御方法であって、
前記コントローラ装置が、
マイクと、ユーザの手に触覚を提示する触覚提示デバイスと、スピーカーとを含み、
前記コントローラ装置がマイクからユーザが音声を入力している間は、前記スピーカーの鳴動を抑制させ、前記触覚提示デバイスによる触覚提示制御を行うよう前記コントローラ装置を制御する、コントローラ装置の制御方法。
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018130924 | 2018-07-10 | ||
JP2018130924 | 2018-07-10 | ||
JP2020530130A JP7028976B2 (ja) | 2018-07-10 | 2019-07-02 | コントローラ装置、及びその制御方法 |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2020530130A Division JP7028976B2 (ja) | 2018-07-10 | 2019-07-02 | コントローラ装置、及びその制御方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2022063332A true JP2022063332A (ja) | 2022-04-21 |
JP7300028B2 JP7300028B2 (ja) | 2023-06-28 |
Family
ID=69142567
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2020530130A Active JP7028976B2 (ja) | 2018-07-10 | 2019-07-02 | コントローラ装置、及びその制御方法 |
JP2022023086A Active JP7300028B2 (ja) | 2018-07-10 | 2022-02-17 | コントローラ装置、及びその制御方法 |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2020530130A Active JP7028976B2 (ja) | 2018-07-10 | 2019-07-02 | コントローラ装置、及びその制御方法 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20210275905A1 (ja) |
JP (2) | JP7028976B2 (ja) |
CN (1) | CN112368056A (ja) |
WO (1) | WO2020013038A1 (ja) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20230130381A1 (en) * | 2020-03-31 | 2023-04-27 | Sony Interactive Entertainment Inc. | Input device |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003248498A (ja) * | 2002-02-25 | 2003-09-05 | Nippon Telegr & Teleph Corp <Ntt> | 音声出入力装置、音声出入力方法、及び音声出入力プログラム |
JP2005506613A (ja) * | 2001-10-09 | 2005-03-03 | イマージョン コーポレイション | コンピュータ装置からのオーディオ出力に基づく触覚フィードバック感覚 |
JP2015231098A (ja) * | 2014-06-04 | 2015-12-21 | ソニー株式会社 | 振動装置、および振動方法 |
JP2017049698A (ja) * | 2015-08-31 | 2017-03-09 | 富士通テン株式会社 | 入力装置、表示装置、入力装置の制御方法およびプログラム |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08314492A (ja) * | 1995-05-22 | 1996-11-29 | Sony Corp | 音声入力翻訳装置 |
US6881147B2 (en) * | 2003-06-06 | 2005-04-19 | Nyko Technologies, Inc. | Video game controller with integrated microphone and speaker |
JP2010015551A (ja) * | 2008-06-03 | 2010-01-21 | Univ Of Electro-Communications | 触覚情報提示装置及び触覚情報提示システム |
US8902050B2 (en) * | 2009-10-29 | 2014-12-02 | Immersion Corporation | Systems and methods for haptic augmentation of voice-to-text conversion |
US9508344B2 (en) * | 2014-10-15 | 2016-11-29 | Delphi Technologies, Inc. | Automatic volume control based on speech recognition |
JP6670224B2 (ja) * | 2016-11-14 | 2020-03-18 | 株式会社日立製作所 | 音声信号処理システム |
JP6748565B2 (ja) * | 2016-11-30 | 2020-09-02 | 綜合警備保障株式会社 | 音声対話システム及び音声対話方法 |
US10455320B2 (en) * | 2017-08-02 | 2019-10-22 | Body Beats, Llc | System, method and apparatus for translating, converting and/or transforming audio energy into haptic and/or visual representation |
US10877562B2 (en) * | 2018-03-02 | 2020-12-29 | Htc Corporation | Motion detection system, motion detection method and computer-readable recording medium thereof |
-
2019
- 2019-07-02 CN CN201980044683.1A patent/CN112368056A/zh active Pending
- 2019-07-02 US US17/258,768 patent/US20210275905A1/en active Pending
- 2019-07-02 JP JP2020530130A patent/JP7028976B2/ja active Active
- 2019-07-02 WO PCT/JP2019/026347 patent/WO2020013038A1/ja active Application Filing
-
2022
- 2022-02-17 JP JP2022023086A patent/JP7300028B2/ja active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005506613A (ja) * | 2001-10-09 | 2005-03-03 | イマージョン コーポレイション | コンピュータ装置からのオーディオ出力に基づく触覚フィードバック感覚 |
JP2003248498A (ja) * | 2002-02-25 | 2003-09-05 | Nippon Telegr & Teleph Corp <Ntt> | 音声出入力装置、音声出入力方法、及び音声出入力プログラム |
JP2015231098A (ja) * | 2014-06-04 | 2015-12-21 | ソニー株式会社 | 振動装置、および振動方法 |
JP2017049698A (ja) * | 2015-08-31 | 2017-03-09 | 富士通テン株式会社 | 入力装置、表示装置、入力装置の制御方法およびプログラム |
Also Published As
Publication number | Publication date |
---|---|
JP7300028B2 (ja) | 2023-06-28 |
US20210275905A1 (en) | 2021-09-09 |
JPWO2020013038A1 (ja) | 2021-06-24 |
JP7028976B2 (ja) | 2022-03-02 |
CN112368056A (zh) | 2021-02-12 |
WO2020013038A1 (ja) | 2020-01-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10416770B2 (en) | Haptic trigger control system | |
EP1225565A2 (en) | Sound controller that generates sound responsive to a situation | |
JP2012055340A (ja) | ゲーム機用コントローラ | |
WO2018179180A1 (ja) | ゲーム機用コントローラ | |
JPWO2019064518A1 (ja) | 操作デバイス、及びその制御装置 | |
JP7300028B2 (ja) | コントローラ装置、及びその制御方法 | |
CN113856199A (zh) | 游戏数据处理方法、装置及游戏控制系统 | |
JP6990769B2 (ja) | 情報処理装置及びコントローラ装置の制御方法 | |
TWI469814B (zh) | Voice - based and brain waves, supplemented by the role of video game control system Methods and methods | |
EP4105928A1 (en) | Audio cancellation system and method | |
US20240221714A1 (en) | Transfer function generation system and method | |
US20220405047A1 (en) | Audio cancellation system and method | |
JP3080103U (ja) | ボイスコントローラー | |
KR20140112131A (ko) | 햅틱 게임 구현 방법 및 이를 위한 컴퓨터로 판독가능한 기록매체 | |
JP2021094086A (ja) | ゲームシステム及びプログラム | |
JP7170851B2 (ja) | 情報処理システム、情報処理装置、情報処理装置の制御方法、及びプログラム | |
US12100380B2 (en) | Audio cancellation system and method | |
JP7189334B2 (ja) | 情報処理システム、情報処理装置、情報処理装置の制御方法、及びプログラム | |
JP7220780B2 (ja) | 情報処理システム、コントローラ、情報処理装置、情報処理装置の制御方法、及びプログラム | |
JP3560817B2 (ja) | ゲーム機器用入力装置 | |
JP2014171687A (ja) | ゲーム機用の入力装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220217 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20220217 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20221221 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20230207 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20230407 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20230530 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20230616 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7300028 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |