SG11202100364SA - Neural network training method and apparatus, gaze tracking method and apparatus, and electronic device - Google Patents

Neural network training method and apparatus, gaze tracking method and apparatus, and electronic device

Info

Publication number
SG11202100364SA
SG11202100364SA SG11202100364SA SG11202100364SA SG11202100364SA SG 11202100364S A SG11202100364S A SG 11202100364SA SG 11202100364S A SG11202100364S A SG 11202100364SA SG 11202100364S A SG11202100364S A SG 11202100364SA SG 11202100364S A SG11202100364S A SG 11202100364SA
Authority
SG
Singapore
Prior art keywords
electronic device
neural network
network training
gaze tracking
training method
Prior art date
Application number
SG11202100364SA
Inventor
Fei Wang
Shiyao Huang
Chen Qian
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Publication of SG11202100364SA publication Critical patent/SG11202100364SA/en

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/255—Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/197—Matching; Classification
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18—Status alarms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217—Validation; Performance evaluation; Active pattern learning techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20092—Interactive image processing based on input by user
    • G06T2207/20104—Interactive definition of region of interest [ROI]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Ophthalmology & Optometry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Image Analysis (AREA)
  • Traffic Control Systems (AREA)
  • Image Processing (AREA)
SG11202100364SA 2018-09-29 2019-06-20 Neural network training method and apparatus, gaze tracking method and apparatus, and electronic device SG11202100364SA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811155578.9A CN110969060A (en) 2018-09-29 2018-09-29 Neural network training method, neural network training device, neural network tracking method, neural network training device, visual line tracking device and electronic equipment
PCT/CN2019/092131 WO2020062960A1 (en) 2018-09-29 2019-06-20 Neural network training method and apparatus, gaze tracking method and apparatus, and electronic device

Publications (1)

Publication Number Publication Date
SG11202100364SA true SG11202100364SA (en) 2021-02-25

Family

ID=69950236

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202100364SA SG11202100364SA (en) 2018-09-29 2019-06-20 Neural network training method and apparatus, gaze tracking method and apparatus, and electronic device

Country Status (5)

Country Link
US (1) US20210133469A1 (en)
JP (1) JP7146087B2 (en)
CN (1) CN110969060A (en)
SG (1) SG11202100364SA (en)
WO (1) WO2020062960A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113807119B (en) * 2020-05-29 2024-04-02 魔门塔(苏州)科技有限公司 Personnel gazing position detection method and device
CN111860292B (en) * 2020-07-16 2024-06-07 科大讯飞股份有限公司 Monocular camera-based human eye positioning method, device and equipment
CN112380935B (en) * 2020-11-03 2023-05-26 深圳技术大学 Man-machine collaborative sensing method and system for automatic driving
CN112749655A (en) * 2021-01-05 2021-05-04 风变科技（深圳）有限公司 Sight tracking method, sight tracking device, computer equipment and storage medium
US11574484B1 (en) * 2021-01-13 2023-02-07 Ambarella International Lp High resolution infrared image generation using image data from an RGB-IR sensor and visible light interpolation
CN113052064B (en) * 2021-03-23 2024-04-02 北京思图场景数据科技服务有限公司 Attention detection method based on face orientation, facial expression and pupil tracking

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2685976C (en) * 2007-05-23 2013-02-19 The University Of British Columbia Methods and apparatus for estimating point-of-gaze in three dimensions
JP5719223B2 (en) * 2011-04-25 2015-05-13 オリンパスイメージング株式会社 Image recording apparatus, recording method, and program
CN104978548B (en) * 2014-04-02 2018-09-25 汉王科技股份有限公司 A kind of gaze estimation method and device based on three-dimensional active shape model
CN104951808B (en) * 2015-07-10 2018-04-27 电子科技大学 A kind of 3D direction of visual lines methods of estimation for robot interactive object detection
CN104951084B (en) * 2015-07-30 2017-12-29 京东方科技集团股份有限公司 Eye-controlling focus method and device
JP2019519859A (en) * 2016-06-29 2019-07-11 シーイング マシーンズ リミテッド System and method for performing gaze tracking
US10467488B2 (en) * 2016-11-21 2019-11-05 TeleLingo Method to analyze attention margin and to prevent inattentive and unsafe driving
US11132543B2 (en) * 2016-12-28 2021-09-28 Nvidia Corporation Unconstrained appearance-based gaze estimation
CN108229276B (en) * 2017-03-31 2020-08-11 北京市商汤科技开发有限公司 Neural network training and image processing method and device and electronic equipment
CN108229284B (en) * 2017-05-26 2021-04-09 北京市商汤科技开发有限公司 Sight tracking and training method and device, system, electronic equipment and storage medium
CN107832699A (en) * 2017-11-02 2018-03-23 北方工业大学 Method and device for testing interest point attention degree based on array lens
CN108171152A (en) * 2017-12-26 2018-06-15 深圳大学 Deep learning human eye sight estimation method, equipment, system and readable storage medium storing program for executing
CN108171218A (en) * 2018-01-29 2018-06-15 深圳市唯特视科技有限公司 A kind of gaze estimation method for watching network attentively based on appearance of depth

Also Published As

Publication number Publication date
JP7146087B2 (en) 2022-10-03
US20210133469A1 (en) 2021-05-06
JP2021530823A (en) 2021-11-11
WO2020062960A1 (en) 2020-04-02
CN110969060A (en) 2020-04-07

Similar Documents

Publication Publication Date Title
EP3633549A4 (en) Facial detection training method, apparatus and electronic device
EP3678059A4 (en) Image processing method, image processing apparatus, and a neural network training method
EP3757905A4 (en) Deep neural network training method and apparatus
SG11202106979WA (en) Neural network training method and apparatus, and image processing method and apparatus
SG11202100364SA (en) Neural network training method and apparatus, gaze tracking method and apparatus, and electronic device
SG11202010772QA (en) Blockchain-based asset transfer method and apparatus, and electronic device
SG11202005054TA (en) Blockchain-based transaction processing method and apparatus, and electronic device
SG11202100711RA (en) Event processing method, apparatus and electronic device based on blockchain technology
SG11202100621QA (en) Method, apparatus and electronic device for blockchain transactions
SG10202101220QA (en) Blockchain Transaction Reconciliation Method And Apparatus, And Electronic Device
SG11202010849XA (en) Method, apparatus and electronic device for blockchain transactions
SG11202004735YA (en) Fund flow method and apparatus, and electronic device
SG11202010811VA (en) Method, apparatus and electronic device for blockchain transactions
EP3627401A4 (en) Method and device for training neural network
SG11202106062WA (en) Neural network training method and image matching method and device
SG11202005058YA (en) Fund flow method and apparatus, and electronic device
SG11202010816YA (en) Method, apparatus and electronic device for blockchain transactions
SG10202006966WA (en) Asset transfer method and apparatus, and electronic device
SG11202101606YA (en) Blockchain-based transaction processing method, apparatus, and electronic device
EP3816922A4 (en) Blockchain-based transaction processing method and apparatus, and electronic device
EP3968179A4 (en) Place recognition method and apparatus, model training method and apparatus for place recognition, and electronic device
SG11202103656SA (en) Task processing method based on neural network, and related device
SG11202100309PA (en) Blockchain-based transaction processing method and apparatus, and electronic device
SG11201905274XA (en) Asset transfer method and apparatus, and electronic device
GB202100221D0 (en) Multiple face tracking method for facial special effect, apparatus and electronic device