JP7473005B2 - 情報処理システム、情報処理装置、情報処理方法、及び、プログラム - Google Patents

情報処理システム、情報処理装置、情報処理方法、及び、プログラム Download PDF

Info

Publication number
JP7473005B2
JP7473005B2 JP2022558769A JP2022558769A JP7473005B2 JP 7473005 B2 JP7473005 B2 JP 7473005B2 JP 2022558769 A JP2022558769 A JP 2022558769A JP 2022558769 A JP2022558769 A JP 2022558769A JP 7473005 B2 JP7473005 B2 JP 7473005B2
Authority
JP
Japan
Prior art keywords
virtual
information
environment
observation
target device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022558769A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2022091366A5 (ja
JPWO2022091366A1 (https=
Inventor
峰斗 佐藤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Publication of JPWO2022091366A1 publication Critical patent/JPWO2022091366A1/ja
Publication of JPWO2022091366A5 publication Critical patent/JPWO2022091366A5/ja
Application granted granted Critical
Publication of JP7473005B2 publication Critical patent/JP7473005B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1656—Program controls characterised by programming, planning systems for manipulators
    • B25J9/1671—Program controls characterised by programming, planning systems for manipulators characterised by simulation, either to verify existing program or to create and verify new program, CAD/CAM oriented, graphic oriented programming systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1674—Program controls characterised by safety, monitoring, diagnostic
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84—Systems specially adapted for particular applications
    • G01N21/88—Investigating the presence of flaws or contamination
    • G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/004—Artificial life, i.e. computing arrangements simulating life
    • G06N3/006—Artificial life, i.e. computing arrangements simulating life based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/092—Reinforcement learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/24—Aligning, centring, orientation detection or correction of the image
    • G06V10/245—Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40323—Modeling robot environment for sensor based robot system
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40607—Fixed camera to observe workspace, object, workpiece, global
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Mechanical Engineering (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Mathematical Physics (AREA)
  • Robotics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Biochemistry (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Signal Processing (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Quality & Reliability (AREA)
  • Manipulator (AREA)
  • Debugging And Monitoring (AREA)
JP2022558769A 2020-10-30 2020-10-30 情報処理システム、情報処理装置、情報処理方法、及び、プログラム Active JP7473005B2 (ja)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/040897 WO2022091366A1 (ja) 2020-10-30 2020-10-30 情報処理システム、情報処理装置、情報処理方法、及び、記録媒体

Publications (3)

Publication Number Publication Date
JPWO2022091366A1 JPWO2022091366A1 (https=) 2022-05-05
JPWO2022091366A5 JPWO2022091366A5 (ja) 2023-07-11
JP7473005B2 true JP7473005B2 (ja) 2024-04-23

Family

ID=81383852

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022558769A Active JP7473005B2 (ja) 2020-10-30 2020-10-30 情報処理システム、情報処理装置、情報処理方法、及び、プログラム

Country Status (3)

Country Link
US (1) US20240013542A1 (https=)
JP (1) JP7473005B2 (https=)
WO (1) WO2022091366A1 (https=)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2024014496A (ja) * 2022-07-22 2024-02-01 日本電気株式会社 異常検出装置、異常検出方法、及びプログラム
JP2024100554A (ja) * 2023-01-16 2024-07-26 富士通株式会社 設定プログラム、設定方法および情報処理装置
JP2024100552A (ja) * 2023-01-16 2024-07-26 富士通株式会社 デジタルツイン管理プログラム、デジタルツイン管理方法およびデジタルツイン管理装置
US20250065492A1 (en) * 2023-08-22 2025-02-27 Honda Motor Co., Ltd. Method and system for dexterous manipulation by a robot
US12560946B2 (en) * 2024-04-19 2026-02-24 Nvidia Corporation Using simulated environments to improve autonomous robot operation in real environments
CN119339186A (zh) * 2024-12-23 2025-01-21 光轮智能(北京)科技有限公司 合成数据场景真实性评测方法、电子设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002287816A (ja) 2001-03-27 2002-10-04 Yaskawa Electric Corp 遠隔調整及び診断装置
JP2017094406A (ja) 2015-11-18 2017-06-01 オムロン株式会社 シミュレーション装置、シミュレーション方法、およびシミュレーションプログラム
JP2018092511A (ja) 2016-12-07 2018-06-14 三菱重工業株式会社 運用支援装置、機器運用システム、運用方法、制御方法及びプログラム
WO2018180143A1 (ja) 2017-03-31 2018-10-04 ソニー株式会社 情報処理装置及び情報処理方法、コンピュータ・プログラム、並びにプログラム製造方法
JP6754883B1 (ja) 2019-11-27 2020-09-16 株式会社安川電機 制御システム、ローカルコントローラ及び制御方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002287816A (ja) 2001-03-27 2002-10-04 Yaskawa Electric Corp 遠隔調整及び診断装置
JP2017094406A (ja) 2015-11-18 2017-06-01 オムロン株式会社 シミュレーション装置、シミュレーション方法、およびシミュレーションプログラム
JP2018092511A (ja) 2016-12-07 2018-06-14 三菱重工業株式会社 運用支援装置、機器運用システム、運用方法、制御方法及びプログラム
WO2018180143A1 (ja) 2017-03-31 2018-10-04 ソニー株式会社 情報処理装置及び情報処理方法、コンピュータ・プログラム、並びにプログラム製造方法
JP6754883B1 (ja) 2019-11-27 2020-09-16 株式会社安川電機 制御システム、ローカルコントローラ及び制御方法

Also Published As

Publication number Publication date
US20240013542A1 (en) 2024-01-11
WO2022091366A1 (ja) 2022-05-05
JPWO2022091366A1 (https=) 2022-05-05

Similar Documents

Publication Publication Date Title
JP7473005B2 (ja) 情報処理システム、情報処理装置、情報処理方法、及び、プログラム
CN112297013B (zh) 一种基于数字孪生和深度神经网络的机器人智能抓取方法
CN114599488B (zh) 机器学习数据生成装置、机器学习装置、作业系统、计算机程序、机器学习数据生成方法及作业机的制造方法
JP7458741B2 (ja) ロボット制御装置及びその制御方法及びプログラム
US12456287B2 (en) Synthetic dataset creation for object detection and classification with deep learning
CN118752495A (zh) 基于多模态驱动的机械臂控制方法、系统及存储介质
JP2022519194A (ja) 奥行き推定
JP7323057B2 (ja) 制御装置、制御方法、および、制御プログラム
CN120697040B (zh) 一种基于视觉反馈的工件抓取方法及系统
CN119540731B (zh) 食用菌菇蕾检测采集系统、方法、介质及装置
CN112743537B (zh) 注释装置
CN116079723B (zh) 基于视觉的机器人抓取和装配技能深度强化学习方法
JP2022077228A (ja) 動作制御プログラム、動作制御方法、および動作制御装置
CN115870971A (zh) 通过机器人设备拾取对象的方法
CN110942083A (zh) 拍摄装置以及拍摄系统
CN114102575A (zh) 图像标记、轨迹规划方法、标记模型、装置及系统
JP2022142773A (ja) オブジェクトのカメラ画像からオブジェクトの場所を位置特定するための装置及び方法
CN118322214B (zh) 基于单次示教的机械臂模仿学习方法及装置
JP2020052032A (ja) 撮像装置及び撮像システム
CN114187312A (zh) 目标物的抓取方法、装置、系统、存储介质及设备
JP7567381B2 (ja) 動作制御プログラム、動作制御方法、および動作制御装置
CN120422248B (zh) 一种基于3d相机的机器人手眼定位方法、设备及介质
CN116197911B (zh) 一种机械臂随机抓取方法
CN120688003A (zh) 一种用于接触网的洗剪吹抓异物清除方法及系统
CN116543038A (zh) 用于借助于图像数据来确定对象信息的方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230410

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230410

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240130

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240227

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240312

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240325

R150 Certificate of patent or registration of utility model

Ref document number: 7473005

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150