JP5440840B2 - 情報処理装置、情報処理方法、及び、プログラム - Google Patents

情報処理装置、情報処理方法、及び、プログラム Download PDF

Info

Publication number
JP5440840B2
JP5440840B2 JP2009140064A JP2009140064A JP5440840B2 JP 5440840 B2 JP5440840 B2 JP 5440840B2 JP 2009140064 A JP2009140064 A JP 2009140064A JP 2009140064 A JP2009140064 A JP 2009140064A JP 5440840 B2 JP5440840 B2 JP 5440840B2
Authority
JP
Japan
Prior art keywords
state
action
probability
state transition
observation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2009140064A
Other languages
English (en)
Japanese (ja)
Other versions
JP2010287027A5 (enExample
JP2010287027A (ja
Inventor
邦昭 野田
浩太郎 佐部
由紀子 吉池
献太 河本
健一 日台
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Priority to JP2009140064A priority Critical patent/JP5440840B2/ja
Priority to US12/791,275 priority patent/US8527434B2/en
Priority to CN201010199038.8A priority patent/CN101923663B/zh
Publication of JP2010287027A publication Critical patent/JP2010287027A/ja
Publication of JP2010287027A5 publication Critical patent/JP2010287027A5/ja
Application granted granted Critical
Publication of JP5440840B2 publication Critical patent/JP5440840B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/004—Artificial life, i.e. computing arrangements simulating life
    • G06N3/006—Artificial life, i.e. computing arrangements simulating life based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/29—Graphical models, e.g. Bayesian networks
    • G06F18/295—Markov models or related models, e.g. semi-Markov models; Markov random fields; Networks embedding Markov models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Software Systems (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Image Analysis (AREA)
  • Feedback Control In General (AREA)
JP2009140064A 2009-06-11 2009-06-11 情報処理装置、情報処理方法、及び、プログラム Active JP5440840B2 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2009140064A JP5440840B2 (ja) 2009-06-11 2009-06-11 情報処理装置、情報処理方法、及び、プログラム
US12/791,275 US8527434B2 (en) 2009-06-11 2010-06-01 Information processing device, information processing method, and program
CN201010199038.8A CN101923663B (zh) 2009-06-11 2010-06-04 信息处理设备、信息处理方法和程序

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2009140064A JP5440840B2 (ja) 2009-06-11 2009-06-11 情報処理装置、情報処理方法、及び、プログラム

Publications (3)

Publication Number Publication Date
JP2010287027A JP2010287027A (ja) 2010-12-24
JP2010287027A5 JP2010287027A5 (enExample) 2012-05-10
JP5440840B2 true JP5440840B2 (ja) 2014-03-12

Family

ID=43307219

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2009140064A Active JP5440840B2 (ja) 2009-06-11 2009-06-11 情報処理装置、情報処理方法、及び、プログラム

Country Status (3)

Country Link
US (1) US8527434B2 (enExample)
JP (1) JP5440840B2 (enExample)
CN (1) CN101923663B (enExample)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110320228A1 (en) * 2010-06-24 2011-12-29 Bmc Software, Inc. Automated Generation of Markov Chains for Use in Information Technology
JP2013058059A (ja) * 2011-09-08 2013-03-28 Sony Corp 情報処理装置、情報処理方法、及び、プログラム
JP5879899B2 (ja) * 2011-10-12 2016-03-08 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
US9283678B2 (en) * 2014-07-16 2016-03-15 Google Inc. Virtual safety cages for robotic devices
CN104777433B (zh) * 2015-05-04 2018-04-27 中颖电子股份有限公司 基于隐马尔可夫模型的锂离子电池剩余容量估计方法
US11062225B2 (en) * 2016-12-09 2021-07-13 Adobe Inc. Techniques for providing sequential recommendations to users
DE102017200196B3 (de) * 2017-01-09 2018-04-05 Ford Global Technologies, Llc Steuern von Parkraum für Fahrzeuge
CN109425351B (zh) * 2017-08-24 2022-02-15 北京嘀嘀无限科技发展有限公司 出行处理方法及装置
US20190184561A1 (en) * 2017-12-15 2019-06-20 The Regents Of The University Of California Machine Learning based Fixed-Time Optimal Path Generation
US10676022B2 (en) 2017-12-27 2020-06-09 X Development Llc Visually indicating vehicle caution regions
EP3753684B1 (en) * 2019-06-21 2022-08-10 Robert Bosch GmbH Method and system for robot manipulation planning
CN112989278B (zh) * 2019-12-12 2025-02-21 北京沃东天骏信息技术有限公司 确定状态数据的方法和装置
CN115496124B (zh) * 2022-08-10 2025-07-08 浙江大学 一种基于极小极大熵协同训练的高炉故障诊断方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06161551A (ja) * 1992-11-19 1994-06-07 Mitsubishi Heavy Ind Ltd 自律移動物体の障害物回避システム
CN100377168C (zh) * 2004-06-29 2008-03-26 索尼株式会社 用光学信息进行情形识别的方法及装置
JP4525477B2 (ja) 2005-02-23 2010-08-18 ソニー株式会社 学習制御装置および学習制御方法、並びに、プログラム
WO2006119122A2 (en) * 2005-05-02 2006-11-09 Graham Shapiro Statistical machine learning system and methods
JP4970531B2 (ja) * 2006-03-28 2012-07-11 ザ・ユニバーシティ・コート・オブ・ザ・ユニバーシティ・オブ・エディンバラ １つ以上のオブジェクトの行動を自動的に特徴付けるための方法。
JP4406436B2 (ja) 2006-04-26 2010-01-27 日本電信電話株式会社 自律移動ロボットの動作計画方法、自律移動ロボットの動作計画方法を利用した自律移動ロボットの制御方法、自律移動ロボットの動作計画装置、自律移動ロボットの動作計画プログラム及びその記録媒体、自律移動ロボットの制御プログラム
US7788205B2 (en) * 2006-05-12 2010-08-31 International Business Machines Corporation Using stochastic models to diagnose and predict complex system problems
JP5070860B2 (ja) 2007-01-31 2012-11-14 ソニー株式会社 情報処理装置、および情報処理方法、並びにコンピュータ・プログラム
JP2013058059A (ja) * 2011-09-08 2013-03-28 Sony Corp 情報処理装置、情報処理方法、及び、プログラム

Also Published As

Publication number Publication date
US20100318479A1 (en) 2010-12-16
CN101923663A (zh) 2010-12-22
US8527434B2 (en) 2013-09-03
CN101923663B (zh) 2015-08-12
JP2010287027A (ja) 2010-12-24

Similar Documents

Publication Publication Date Title
JP5440840B2 (ja) 情報処理装置、情報処理方法、及び、プログラム
JP2010287028A (ja) 情報処理装置、情報処理方法、及び、プログラム
Chaplot et al. Learning to explore using active neural slam
US8738555B2 (en) Data processing device, data processing method, and program
CN115552430B (zh) 用于支持策略学习的方法和系统
JP4803212B2 (ja) データ処理装置、データ処理方法、及びプログラム
US8290885B2 (en) Information processing apparatus, information processing method, and computer program
US8924317B2 (en) Information processing apparatus, information processing method and program
Xu et al. Learning to explore with meta-policy gradient
WO2023063020A1 (ja) 経路計画システム、経路計画方法、ロードマップ構築装置、モデル生成装置、及びモデル生成方法
JP2010287027A5 (enExample)
EP2788924A2 (en) Particle methods for nonlinear control
Akrour et al. Local Bayesian optimization of motor skills
JP2024522051A (ja) 重み付けされたポリシー投影を使用した多目的強化学習
JP2007280053A (ja) データ処理装置、データ処理方法、およびプログラム
Zhang et al. A meta reinforcement learning-based approach for self-adaptive system
CN118752492A (zh) 基于深度强化学习的多任务多机器人的运动控制方法
JP4169038B2 (ja) 情報処理装置および情報処理方法、並びにプログラム
US20250029348A1 (en) Systems and Methods for Language-Based Three-Dimensional Interactive Environment Construction and Interaction
CN115143967B (zh) 机器人定点导航方法及装置
CN117824622A (zh) 基于分层关系及状态正则化的目标驱动导航方法及系统
Maia On-policy Object Goal Navigation with Exploration Bonuses
Sener et al. Partitioning sensorimotor space by predictability principle in intrinsic motivation systems
Hussein Deep learning based approaches for imitation learning
Li et al. Optimizing interactive systems with data-driven objectives

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20120321

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20120321

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20130613

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20130730

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20131121

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20131204

R151 Written notification of patent or utility model registration

Ref document number: 5440840

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250