JP7378354B2 - ライブ動画ストリームからの指の押下の検出 - Google Patents

ライブ動画ストリームからの指の押下の検出 Download PDF

Info

Publication number
JP7378354B2
JP7378354B2 JP2020099009A JP2020099009A JP7378354B2 JP 7378354 B2 JP7378354 B2 JP 7378354B2 JP 2020099009 A JP2020099009 A JP 2020099009A JP 2020099009 A JP2020099009 A JP 2020099009A JP 7378354 B2 JP7378354 B2 JP 7378354B2
Authority
JP
Japan
Prior art keywords
finger
hand
candidate
image
candidates
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020099009A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021012684A (ja
JP2021012684A5 (cg-RX-API-DMAC7.html
Inventor
ジエ クルビダ，
Original Assignee
コニカ ミノルタ ビジネス ソリューションズ ユー．エス．エー．， インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by コニカ ミノルタ ビジネス ソリューションズ ユー．エス．エー．， インコーポレイテッド filed Critical コニカ ミノルタ ビジネス ソリューションズ ユー．エス．エー．， インコーポレイテッド
Publication of JP2021012684A publication Critical patent/JP2021012684A/ja
Publication of JP2021012684A5 publication Critical patent/JP2021012684A5/ja
Application granted granted Critical
Publication of JP7378354B2 publication Critical patent/JP7378354B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107—Static hand or arm
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)
JP2020099009A 2019-06-28 2020-06-08 ライブ動画ストリームからの指の押下の検出 Active JP7378354B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/457,449 2019-06-28
US16/457,449 US10747371B1 (en) 2019-06-28 2019-06-28 Detection of finger press from live video stream

Publications (3)

Publication Number Publication Date
JP2021012684A JP2021012684A (ja) 2021-02-04
JP2021012684A5 JP2021012684A5 (cg-RX-API-DMAC7.html) 2022-07-28
JP7378354B2 true JP7378354B2 (ja) 2023-11-13

Family

ID=72046020

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020099009A Active JP7378354B2 (ja) 2019-06-28 2020-06-08 ライブ動画ストリームからの指の押下の検出

Country Status (2)

Country Link
US (1) US10747371B1 (cg-RX-API-DMAC7.html)
JP (1) JP7378354B2 (cg-RX-API-DMAC7.html)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112084957B (zh) * 2020-09-11 2021-12-17 广东联通通信建设有限公司 一种移动目标滞留检测方法及系统
CN112200040B (zh) * 2020-09-28 2025-02-25 北京小米松果电子有限公司 遮挡图像检测方法、装置及介质
CN112462937B (zh) * 2020-11-23 2022-11-08 青岛小鸟看看科技有限公司 虚拟现实设备的局部透视方法、装置及虚拟现实设备
US11947728B2 (en) 2021-04-30 2024-04-02 Samsung Electronics Co., Ltd. Electronic device for executing function based on hand gesture and method for operating thereof
US20230196765A1 (en) * 2021-12-21 2023-06-22 Meta Platforms Technologies, Llc Software-based user interface element analogues for physical device elements
CN114596582B (zh) * 2022-02-28 2023-03-17 北京伊园未来科技有限公司 一种带视觉和力反馈的增强现实交互方法及系统
JP2025059651A (ja) * 2023-09-29 2025-04-10 Ｊｏｈｎａｎ株式会社 学習データベース構築システム、および、該システムに利用される制御装置、並びに、学習データベース構築方法
CN119205765B (zh) * 2024-11-27 2025-02-28 齐鲁空天信息研究院 托盘孔高度测量方法、装置、设备、存储介质及程序产品

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101470800A (zh) 2007-12-30 2009-07-01 沈阳工业大学 手形识别方法
JP2011022927A (ja) 2009-07-17 2011-02-03 Oki Joho Systems:Kk 手画像認識装置
US20160259423A1 (en) 2011-09-19 2016-09-08 Eyesight Mobile Technologies, LTD. Touch fee interface for augmented reality systems
CN108369630A (zh) 2015-05-28 2018-08-03 视觉移动科技有限公司 用于智能家居的手势控制系统和方法
JP2018195053A (ja) 2017-05-17 2018-12-06 株式会社東海理化電機製作所 画像処理装置、画像処理プログラム及びジェスチャ認識システム

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0837418A3 (en) * 1996-10-18 2006-03-29 Kabushiki Kaisha Toshiba Method and apparatus for generating information input using reflected light image of target object
CN103076949B (zh) 2008-03-19 2016-04-20 株式会社电装 车辆操作输入设备
JP5347673B2 (ja) 2009-04-14 2013-11-20 ソニー株式会社 情報処理装置、情報処理方法及びプログラム
US20110254939A1 (en) 2010-04-16 2011-10-20 Tatiana Pavlovna Kadantseva Detecting User Input Provided To A Projected User Interface
US9135503B2 (en) * 2010-11-09 2015-09-15 Qualcomm Incorporated Fingertip tracking for touchless user interface
US9030425B2 (en) 2011-04-19 2015-05-12 Sony Computer Entertainment Inc. Detection of interaction with virtual object from finger color change
EP2889733A1 (en) * 2012-08-27 2015-07-01 Citizen Holdings Co., Ltd. Information input device
US9524028B2 (en) * 2013-03-08 2016-12-20 Fastvdo Llc Visual language for human computer interfaces
JP6146094B2 (ja) 2013-04-02 2017-06-14 富士通株式会社 情報操作表示システム、表示プログラム、および、表示方法
US10310675B2 (en) * 2014-08-25 2019-06-04 Canon Kabushiki Kaisha User interface apparatus and control method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101470800A (zh) 2007-12-30 2009-07-01 沈阳工业大学 手形识别方法
JP2011022927A (ja) 2009-07-17 2011-02-03 Oki Joho Systems:Kk 手画像認識装置
US20160259423A1 (en) 2011-09-19 2016-09-08 Eyesight Mobile Technologies, LTD. Touch fee interface for augmented reality systems
CN108369630A (zh) 2015-05-28 2018-08-03 视觉移动科技有限公司 用于智能家居的手势控制系统和方法
JP2018195053A (ja) 2017-05-17 2018-12-06 株式会社東海理化電機製作所 画像処理装置、画像処理プログラム及びジェスチャ認識システム

Also Published As

Publication number Publication date
US10747371B1 (en) 2020-08-18
JP2021012684A (ja) 2021-02-04

Similar Documents

Publication Publication Date Title
JP7378354B2 (ja) ライブ動画ストリームからの指の押下の検出
JP5201096B2 (ja) 対話操作装置
JP6089722B2 (ja) 画像処理装置、画像処理方法および画像処理プログラム
CN104380338B (zh) 信息处理器以及信息处理方法
JP5916880B2 (ja) ジェスチャを認識するための方法およびジェスチャ検出器
WO2019095979A1 (zh) 视频图像处理方法、装置及终端
JP7028513B2 (ja) イベントデータストリームの処理方法及びコンピューティング機器
WO2019007258A1 (zh) 相机姿态信息的确定方法、装置、设备及存储介质
JP6723814B2 (ja) 情報処理装置、その制御方法、プログラム、及び記憶媒体
JP6028589B2 (ja) 入力プログラム、入力装置および入力方法
JP5510907B2 (ja) タッチ位置入力装置及びタッチ位置入力方法
WO2015026569A1 (en) System and method for creating an interacting with a surface display
CN110308817B (zh) 一种触控动作识别方法及触控投影系统
CN106774846B (zh) 交互投影方法及装置
JP6229554B2 (ja) 検出装置および検出方法
US20130342441A1 (en) Character input method and information processing apparatus
Chu et al. Hand gesture for taking self portrait
GB2530150A (en) Information processing apparatus for detecting object from image, method for controlling the apparatus, and storage medium
CN107209556A (zh) 用于对捕获对象相对于交互平面的交互的深度图像进行处理的系统及方法
JP2016099643A (ja) 画像処理装置、画像処理方法および画像処理プログラム
CN113703577B (zh) 一种绘图方法、装置、计算机设备及存储介质
KR20120082319A (ko) 윈도우 형태의 증강현실을 제공하는 장치 및 방법
US20250093990A1 (en) Speed Adapted Touch Detection
JP2022524787A (ja) 物体検出範囲推定のための、方法、システム、及びプログラム
CN119472976A (zh) 手环设备、虚拟现实系统及其控制方法、设备与存储介质

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220720

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220720

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230627

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230906

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20231017

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20231031

R150 Certificate of patent or registration of utility model

Ref document number: 7378354

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150