WO2023124055A1 - Digital-twin-based artificial enhancement method and apparatus, and medium - Google Patents

Digital-twin-based artificial enhancement method and apparatus, and medium Download PDF

Info

Publication number
WO2023124055A1
WO2023124055A1 PCT/CN2022/108917 CN2022108917W WO2023124055A1 WO 2023124055 A1 WO2023124055 A1 WO 2023124055A1 CN 2022108917 W CN2022108917 W CN 2022108917W WO 2023124055 A1 WO2023124055 A1 WO 2023124055A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
digital twin
model
space model
access terminal
Prior art date
Application number
PCT/CN2022/108917
Other languages
French (fr)
Chinese (zh)
Inventor
黄晓庆
王勇
马世奎
陈原
Original Assignee
达闼机器人股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 达闼机器人股份有限公司 filed Critical 达闼机器人股份有限公司
Publication of WO2023124055A1 publication Critical patent/WO2023124055A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/10Numerical modelling

Definitions

  • the embodiment of the present application also provides a processing device, including a processor and a memory, and a computer program is stored in the memory.
  • a processing device including a processor and a memory
  • a computer program is stored in the memory.
  • the processor invokes the computer program in the memory, it executes any digital-based Steps in a siamese artificial augmentation method.
  • Fig. 2 is a schematic structural diagram of a smart device in this application.
  • Fig. 3 is a schematic structural diagram of the processing equipment of the present application.
  • the prompt data is text prompt data or voice prompt data.
  • the prompt data is text prompt data or voice prompt data.
  • a digital twin-based artificial enhancement method, device, and storage medium provided by this application have been introduced in detail above.
  • specific examples have been applied to illustrate the principles and implementation methods of this application.
  • the description of the above embodiments It is only used to help understand the method of the present application and its core idea; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation and application scope. In summary, this The content of the description should not be understood as limiting the application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A digital-twin-based artificial enhancement method and apparatus, and a medium, the method comprising: acquiring optimized device data obtained by converting real device data, and mapping the optimized device data to an initial digital twin spatial model by means of digital twin modeling, thus updating and obtaining a digital twin spatial model (101); obtaining set scenario artificial enhancement task data, and merging the scenario artificial enhancement task data with the digital twin spatial model so as to update the digital twin spatial model (102); when detecting a user access instruction sent by an access terminal, sending the digital twin spatial model to the access terminal (103); acquiring operation data sent by the access terminal and corresponding to the digital twin spatial model (104); and when it is determined that the operation data satisfies a trigger condition corresponding to the scenario artificial enhancement task data, sending to the access terminal feedback data corresponding to the operation data (105). The present method allows a target scenario of a cloud robot to be converted to an optimized virtual scenario, thus enhancing data processing efficiency.

Description

基于数字孪生的人工增强方法、装置及介质Artificial enhancement method, device and medium based on digital twin
交叉引用cross reference
本申请引用于2021年12月29日递交的名称为“基于数字孪生的人工增强方法、装置及介质”的第202111644024.7号中国专利申请,其通过引用被全部并入本申请。This application refers to the Chinese patent application No. 202111644024.7 entitled "Artificial Enhancement Method, Device and Medium Based on Digital Twin" submitted on December 29, 2021, which is incorporated by reference into this application in its entirety.
技术领域technical field
本申请实施例涉及数字孪生技术领域,具体涉及一种基于数字孪生的人工增强方法、装置及存储介质。The embodiments of the present application relate to the technical field of digital twins, and in particular to a digital twin-based artificial enhancement method, device, and storage medium.
背景技术Background technique
云端机器人的应用越来越广泛,例如由人工增强智能、多模态融合人工智能、数字孪生、持续闭环学习与智能进化组成,通过5G安全网络控制机器人完成各种任务(例如远程操控云端机器人完成拾取物体等任务)。其中人工在环是云端机器人控制中的重要一环,分为在线实时或准实时人工增强和离线示教训练。The application of cloud robots is becoming more and more extensive. For example, it consists of artificial enhanced intelligence, multi-modal fusion artificial intelligence, digital twins, continuous closed-loop learning and intelligent evolution. Robots are controlled through 5G secure networks to complete various tasks (such as remote control of cloud robots to complete tasks such as picking up objects). Among them, artificial in-the-loop is an important part of cloud robot control, which is divided into online real-time or quasi-real-time artificial enhancement and offline teaching training.
但是,若机器人训练师是正在进行在线实时人工增强、准实时人工增强、或离线示教训练时,若是在机器人训练师这一侧的显示器上直接显示被操作对象的虚拟模型或真实影像(但被操作对象是不宜以还原度较高的虚拟模型或真实影像进行直接显示的对象),因需高度还原操作场景会降低数据处理效率。However, if the robot trainer is performing online real-time artificial enhancement, quasi-real-time artificial enhancement, or offline teaching training, if the virtual model or real image of the operated object is directly displayed on the display on the side of the robot trainer (but The object to be operated is an object that is not suitable for direct display with a virtual model or a real image with a high degree of restoration), because the operation scene needs to be highly restored and the data processing efficiency will be reduced.
发明内容Contents of the invention
本申请实施例提供一种基于数字孪生的人工增强方法、装置及介质,能够将云端机器人的目标场景转换为优化虚拟场景,提高了数据处理效率。Embodiments of the present application provide a digital twin-based artificial enhancement method, device, and medium, which can convert the target scene of a cloud robot into an optimized virtual scene, and improve data processing efficiency.
第一方面,本申请实施例从服务器角度提供了一种基于数字孪生的人工增强方法,所述方法包括:In the first aspect, the embodiment of the present application provides a digital twin-based artificial enhancement method from a server perspective, the method comprising:
获取优化设备数据,将所述优化设备数据通过数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型;Obtain optimized equipment data, and map the optimized equipment data to the initial digital twin space model through digital twin modeling, so as to update the digital twin space model;
获取所设置的场景人工增强任务数据,将所述场景人工增强任务数据与所述数字孪生空间模型进行融合,以更新数字孪生空间模型;Obtain the set scene artificial enhancement task data, and fuse the scene artificial enhancement task data with the digital twin space model to update the digital twin space model;
当检测到接入端发送的用户接入指令时,将所述数字孪生空间模型发送至接入端;When the user access instruction sent by the access terminal is detected, the digital twin space model is sent to the access terminal;
获取接入端发送的与所述数字孪生空间模型对应的操作数据;Obtaining the operation data corresponding to the digital twin space model sent by the access terminal;
当确定所述操作数据满足场景人工增强任务数据对应的触发条件时,将与所述操作数据对应的反馈数据发送至接入端。When it is determined that the operation data satisfies the trigger condition corresponding to the scene artificial enhancement task data, the feedback data corresponding to the operation data is sent to the access terminal.
第二方面,本申请实施例还提供一种智能装置,所述智能装置包括:发送单元、接收单元和处理单元;In the second aspect, the embodiment of the present application further provides a smart device, the smart device includes: a sending unit, a receiving unit, and a processing unit;
所述处理单元,用于获取优化设备数据,将所述优化设备数据通过数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型;The processing unit is configured to obtain optimized equipment data, and map the optimized equipment data to the initial digital twin space model through digital twin modeling, so as to update and obtain the digital twin space model;
所述处理单元,还用于获取所设置的场景人工增强任务数据,将所述场景人工增强任务数据与所述数字孪生空间模型进行融合,以更新数字孪生空间模型;The processing unit is also used to obtain the set scene artificial enhancement task data, and fuse the scene artificial enhancement task data with the digital twin space model to update the digital twin space model;
所述发送单元,用于当检测到接入端发送的用户接入指令时,将所述数字孪生空间模型发送至接入端;The sending unit is configured to send the digital twin space model to the access terminal when a user access instruction sent by the access terminal is detected;
所述接收单元,用于获取接入端发送的与所述数字孪生空间模型对应的操作数据;The receiving unit is configured to obtain the operation data corresponding to the digital twin space model sent by the access terminal;
所述发送单元,还用于当确定所述操作数据满足场景人工增强任务数据对应的触发条件时,将与所述操作数据对应的反馈数据发送至接入端。The sending unit is further configured to send feedback data corresponding to the operation data to the access terminal when it is determined that the operation data satisfies a trigger condition corresponding to the scenario artificial enhancement task data.
第三方面,本申请实施例还提供了一种处理设备,包括处理器和存储器,存储器中存储有计算机程序,处理器调用存储器中的计算机程序时执行本申请实施例提供的任一种基于数字孪生的人工增强方法中的步骤。In a third aspect, the embodiment of the present application also provides a processing device, including a processor and a memory, and a computer program is stored in the memory. When the processor invokes the computer program in the memory, it executes any digital-based Steps in a siamese artificial augmentation method.
第四方面,本申请实施例还提供了一种计算机可读存储介质,计算机可读存储介质存储有多条指令,指令适于处理器进行加载,以执行本申请实施例提供的任一种基于数字孪生的人工增强方法中的步骤。In the fourth aspect, the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by the processor, so as to execute any one based on the method provided by the embodiment of the present application. Steps in a human-augmented approach to digital twins.
从以上内容可得出,本申请将优化设备数据和场景人工增强任务数据均融合至初始数字孪生空间模型,以更新得到数字孪生空间模型,然后当检测到接入端发送的用户接入指令时,将所述数字孪生空间模型发送至接入端;之后获取接入端发送的与所述数字孪生空间模型对应的操作数据;最后当确定所述操作数据满足场景人工增强任务数据对应的触发条件时,将与所述操 作数据对应的反馈数据发送至接入端。能够将云端机器人的目标场景转换为优化虚拟场景,提高了数据处理效率。From the above content, it can be concluded that this application integrates the optimized equipment data and scene artificial enhancement task data into the initial digital twin space model to update the digital twin space model, and then when the user access instruction sent by the access terminal is detected , sending the digital twin space model to the access terminal; then obtaining the operation data corresponding to the digital twin space model sent by the access terminal; finally, when it is determined that the operation data satisfies the trigger condition corresponding to the scene artificial enhancement task data , sending the feedback data corresponding to the operation data to the access terminal. It can convert the target scene of the cloud robot into an optimized virtual scene, which improves the data processing efficiency.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.
图1是本申请中基于数字孪生的人工增强方法的一种流程示意图;Figure 1 is a schematic flow diagram of the artificial enhancement method based on digital twins in this application;
图2本申请中智能装置的一种结构示意图;Fig. 2 is a schematic structural diagram of a smart device in this application;
图3是本申请处理设备的一种结构示意图。Fig. 3 is a schematic structural diagram of the processing equipment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts belong to the scope of protection of this application.
在以下的说明中,本申请的具体实施例将参考由一部或多部计算机所执行的步骤及符号来说明,除非另有述明。因此,这些步骤及操作将有数次提到由计算机执行,本申请实施例所指的计算机执行包括了由代表了以一结构化型式中的数据的电子信号的计算机处理单元的操作。此操作转换该数据或将其维持在该计算机的内存系统中的位置处,其可重新配置或另外以本领域测试人员所熟知的方式来改变该计算机的运作。该数据所维持的数据结构为该内存的实体位置,其具有由该数据格式所定义的特定特性。但是,本申请原理以上述文字来说明,其并不代表为一种限制,本领域测试人员将可了解到以下所述的多种步骤及操作亦可实施在硬件当中。In the following description, specific embodiments of the present application will be described with reference to steps and symbols executed by one or more computers, unless otherwise stated. Therefore, these steps and operations will be mentioned several times to be executed by a computer, and the computer execution referred to in the embodiment of the present application includes the operation of a computer processing unit by an electronic signal representing data in a structured form. This operation transforms the data or maintains it at a location in the computer's memory system that can reconfigure or otherwise alter the operation of the computer in a manner well known to testers in the art. The data structures maintained by the data are physical locations in the memory that have certain characteristics defined by the data format. However, the principle of the present application is described in the above text, which is not meant to be a limitation, and testers in the field will understand that the various steps and operations described below can also be implemented in hardware.
本申请的原理使用许多其它泛用性或特定目的运算、通信环境或组态来进行操作。所熟知的适合用于本申请的运算系统、环境与组态的范例可包括(但不限于)手持电话、个人计算机、服务器、多处理器系统、微电脑为主的系统、主架构型计算机、及分布式运算环境,其中包括了任何的上述系统或装置。The principles of the present application operate with numerous other general purpose or special purpose computing, communication environments or configurations. Examples of well-known computing systems, environments, and configurations suitable for use in this application may include, but are not limited to, handheld phones, personal computers, servers, multiprocessor systems, microcomputer-based systems, mainframe computers, and A distributed computing environment, including any of the above systems or devices.
本申请中的术语“第一”、“第二”和“第三”等是用于区别不同对象, 而不是用于描述特定顺序。此外,术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。The terms "first", "second" and "third" in this application are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-exclusive inclusion.
首先,在介绍本申请实施例之前,先介绍下本申请关于应用背景的相关内容。First of all, before introducing the embodiments of the present application, first introduce the relevant content of the present application about the application background.
本申请提供的基于数字孪生的人工增强方法的执行主体可以为本申请提供的装置,或者集成了该装置的服务器设备、物理主机、或者用户设备(User Equipment,UE)等处理设备,其中,装置可以采用硬件或者软件的方式实现,UE具体可以为智能手机、平板电脑、笔记本电脑、掌上电脑、台式电脑或者个人数字助理(Personal Digital Assitant,PDA)等终端设备。The executor of the digital twin-based artificial enhancement method provided by this application may be the device provided by this application, or a processing device such as a server device, a physical host, or a user equipment (User Equipment, UE) that integrates the device, wherein the device It can be realized by means of hardware or software, and the UE can specifically be a terminal device such as a smart phone, a tablet computer, a notebook computer, a palmtop computer, a desktop computer, or a personal digital assistant (Personal Digital Assistant, PDA).
下面,开始介绍本申请提供的基于数字孪生的人工增强方法。Next, start to introduce the digital twin-based artificial enhancement method provided by this application.
参阅图1,图1示出了本申请基于数字孪生的人工增强方法的一种流程示意图,所述方法应用于服务器。本申请提供的方法,具体可包括如下步骤:Referring to FIG. 1 , FIG. 1 shows a schematic flowchart of a digital twin-based artificial enhancement method of the present application, and the method is applied to a server. The method provided in this application may specifically include the following steps:
101、获取优化设备数据,将所述优化设备数据通过数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型。101. Acquire optimized equipment data, and map the optimized equipment data to the initial digital twin space model through digital twin modeling, so as to update the digital twin space model.
本申请实施例中,在服务器中预先存储了初始数字孪生空间模型,初始数字孪生空间模型中的各子模型均是基于数字孪生建模映射至始数字孪生空间模型中,从而实现对真实世界的完全还原或部分还原。更具体的,初始数字孪生空间模型中主要是将真实世界中的建筑进行了还原,但未对其他对象进行还原(如道路上的垃圾桶、真实的人、汽车等)。In the embodiment of this application, the initial digital twin space model is pre-stored in the server, and each sub-model in the initial digital twin space model is mapped to the original digital twin space model based on digital twin modeling, so as to realize the real world Fully restored or partially restored. More specifically, the initial digital twin space model mainly restores buildings in the real world, but does not restore other objects (such as trash cans on the road, real people, cars, etc.).
此时,当需要将待操控的云端机器人的目标操作对象通过数字孪生技术添加至初始数字孪生空间模型时,需先基于目标操作对象的真实设备数据转换得到的的优化设备数据(一般包括尺寸数据、运行参数数据等,尺寸数据就是目标操作对象的长、宽、高等参数、运行参数数据就是目标操作对象的平均运动速度等参数),然后将所述优化设备数据通过数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型。At this time, when it is necessary to add the target operation object of the cloud robot to be controlled to the initial digital twin space model through digital twin technology, it is necessary to first convert the optimized device data (generally including size data) obtained based on the real device data of the target operation object , operating parameter data, etc., the size data is the length, width, height and other parameters of the target operating object, and the operating parameter data is the average moving speed of the target operating object, etc.), and then the optimized equipment data is mapped to the initial The digital twin spatial model is updated to obtain the digital twin spatial model.
其中,在将所述优化设备数据通过数字孪生建模映射至初始数字孪生空间模型的过程中,可采用所述优化设备数据在物理空间中的坐标对应映射至1:1还原的初始数字孪生空间中相应的空间位置,从而实现建模后的精准映射。Wherein, in the process of mapping the optimized equipment data to the initial digital twin space model through digital twin modeling, the coordinates of the optimized equipment data in the physical space can be used to map to the initial digital twin space restored at 1:1 The corresponding spatial position in the model, so as to realize the accurate mapping after modeling.
一种实施例中,所述步骤101包括:In one embodiment, the step 101 includes:
获取真实设备数据,将所述真实设备数据根据预设的设备转化策略对应转换为优化设备数据。Acquire real device data, and correspondingly convert the real device data into optimized device data according to a preset device conversion strategy.
本申请实施例中,例如目标操作对象的真实设备数据是对应废弃物,而目标操作对象的优化设备数据是花朵,这样将废弃物转换为花朵在数字孪生空间模型中显示,不仅可以避免对目标操作对象的真实显示,而且还可以降低建模难度以提高数据处理效率。本申请的方案中还可以适用于以下场景,例如真实世界下云端机器人分拣各种垃圾的任务在数字孪生空间模型下可以转化为在美丽后花园中进行各种花卉的插花任务。此方案同样适用于离线训练数据采集,比如将机器人路径规划训练数据的采集转化为赛车游戏,人类玩家在各种各样的场景下进行赛车比赛,比赛数据将转化为机器人进行路径规划学习的训练数据。In the embodiment of the present application, for example, the real equipment data of the target operation object is the corresponding waste, while the optimized equipment data of the target operation object is flowers. In this way, converting waste into flowers and displaying them in the digital twin space model can not only avoid The real display of the operation object, but also can reduce the difficulty of modeling to improve the efficiency of data processing. The solution of this application can also be applied to the following scenarios. For example, the task of sorting various garbage by cloud robots in the real world can be transformed into the task of arranging various flowers in the beautiful back garden under the digital twin space model. This solution is also applicable to offline training data collection, such as converting the collection of robot path planning training data into a racing game, where human players compete in various scenarios, and the game data will be converted into training for robots to learn path planning data.
一种实施例中,所述步骤101包括:In one embodiment, the step 101 includes:
获取所述优化设备数据中包括的尺寸数据,将所述尺寸数据通过1:1的数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型;其中,更新得到数字孪生空间模型中包括与所述优化设备数据对应的优化设备孪生模型;Obtaining the dimensional data included in the optimized equipment data, and mapping the dimensional data to the initial digital twin space model through 1:1 digital twin modeling, so as to update the digital twin space model; wherein, the update obtains the digital twin space model includes an optimized equipment twin model corresponding to the optimized equipment data;
获取所述优化设备数据中包括的运行参数数据,将所述运行参数数据与所述数字孪生空间模型中优化设备孪生模型进行融合,以更新数字孪生空间模型。The operating parameter data included in the optimized equipment data is obtained, and the operating parameter data is fused with the optimized equipment twin model in the digital twin space model to update the digital twin space model.
本申请实施例中,将所述尺寸数据通过1:1的数字孪生建模映射至初始数字孪生空间模型,可以将待操作的云端机器人的1:1还原的数字孪生模型映射至初始数字孪生空间模型中,无需进行放大或缩小尺寸的操作,而且是采用所述优化设备数据在物理空间中的坐标对应映射至1:1还原的初始数字孪生空间中相应的空间位置。可见,通过过1:1的数字孪生建模技术可以快速将真实设备映射至数字孪生空间模型中。In the embodiment of this application, the size data is mapped to the initial digital twin space model through 1:1 digital twin modeling, and the 1:1 restored digital twin model of the cloud robot to be operated can be mapped to the initial digital twin space In the model, there is no need to enlarge or reduce the size, and the coordinates of the optimized equipment data in the physical space are mapped to the corresponding spatial positions in the original digital twin space restored at 1:1. It can be seen that through the 1:1 digital twin modeling technology, real equipment can be quickly mapped to the digital twin space model.
102、获取所设置的场景人工增强任务数据,将所述场景人工增强任务数据与所述数字孪生空间模型进行融合,以更新数字孪生空间模型。102. Acquire the set scene artificial enhancement task data, and fuse the scene artificial enhancement task data with the digital twin space model to update the digital twin space model.
本申请实施例中,当基于优化设备数据完成了数字孪生建模之后,还可以获取所设置的场景人工增强任务数据,将所述场景人工增强任务数据与所述数字孪生空间模型进行融合,以更新数字孪生空间模型。上述操作相当于在数字孪生空间模型中选定任意一个数字孪生模型,并对其具体设置场景人 工增强任务数据,其中场景人工增强任务数据可以理解为选中数字孪生空间模型中任意一个或多个数字孪生模型后对所选中的数字孪生模型分别相应增加一个新的属性数据即任务数据(可参考网络游戏中玩家操控游戏角色点击某一物体或游戏人物并进行相关操作可触发任务提示的场景)。当对所选定的某一个或多个数字孪生模型的完成场景人工增强任务数据的设置后,可以将所述场景人工增强任务数据与所述数字孪生空间模型进行融合,以更新数字孪生空间模型。可见,通过对数字孪生模型增加场景人工增强任务数据,可以增加数字孪生空间模型在任务属性这一维度的数据。In the embodiment of the present application, after the digital twin modeling is completed based on the optimized equipment data, the set scene artificial enhancement task data can also be obtained, and the scene artificial enhancement task data can be fused with the digital twin space model to obtain Update the digital twin spatial model. The above operation is equivalent to selecting any digital twin model in the digital twin space model, and setting the scene artificial enhancement task data for it, where the scene artificial enhancement task data can be understood as any one or more numbers in the digital twin space model selected After the twin model, a new attribute data, that is, task data, is added to the selected digital twin model (refer to the scene in the online game where the player manipulates the game character to click on an object or game character and perform related operations to trigger the task reminder). After setting the scene artificial enhancement task data for one or more selected digital twin models, the scene artificial enhancement task data can be fused with the digital twin space model to update the digital twin space model . It can be seen that by adding scene artificially enhanced task data to the digital twin model, the data of the digital twin spatial model in the dimension of task attributes can be increased.
一种实施例中,所述步骤102包括:In one embodiment, the step 102 includes:
获取所述场景人工增强任务数据在所述数字孪生空间模型中对应的目标孪生模型,将所述场景人工增强任务数据与所述目标孪生模型进行融合,以更新数字孪生空间模型。Acquiring the target twin model corresponding to the scene artificial enhancement task data in the digital twin space model, and fusing the scene artificial enhancement task data with the target twin model to update the digital twin space model.
本申请实施例中,具体是先获取所述场景人工增强任务数据在所述数字孪生空间模型中对应的目标孪生模型,该目标孪生模型可能是一个数字孪生模型(如对应优化设备数据对应的数字孪生模型),也可能是多个数字孪生模型(如除了对应优化设备数据对应的数字孪生模型,还包括多个其他所选定的数字孪生模型),然后将所述场景人工增强任务数据增加至目标孪生模型上,以作为目标孪生模型具有的属性数据,且该属性数据可被后续的操作触发以显示或提示用户。In the embodiment of the present application, the target twin model corresponding to the scene artificial enhancement task data in the digital twin space model is obtained first, and the target twin model may be a digital twin model (such as the digital twin model corresponding to the optimized equipment data). Twin model), may also be a plurality of digital twin models (for example, in addition to the digital twin model corresponding to the optimized equipment data, it also includes multiple other selected digital twin models), and then the artificial enhancement task data of the scene is added to On the target twin model, as the attribute data of the target twin model, and the attribute data can be triggered by subsequent operations to display or prompt the user.
103、当检测到接入端发送的用户接入指令时,将所述数字孪生空间模型发送至接入端。103. Send the digital twin space model to the access terminal when detecting the user access instruction sent by the access terminal.
本申请实施例中,当服务器检测到接入端(如VR设备等)的登录请求并对其登录信息验证成功时,获取之后接入端发送的用户接入指令(可理解为机器人训练师操作接入端产生的用户接入指令)以请求接入数字孪生空间模型,此时可以获取与用户接入指令相应的数字孪生空间模型并发送至接入端。之后,在接入端上基于VR技术可以查看所述数字孪生空间模型对应的虚拟模型。可见,通过检测到接入端的接入请求,能够快速的将完成建模的数字孪生空间模型发送至接入端进行显示。In the embodiment of this application, when the server detects the login request of the access terminal (such as a VR device, etc.) and successfully verifies its login information, it acquires the user access instruction sent by the access terminal (which can be understood as the robot trainer operation The user access instruction generated by the access terminal) to request access to the digital twin spatial model, at this time, the digital twin spatial model corresponding to the user access instruction can be obtained and sent to the access terminal. Afterwards, the virtual model corresponding to the digital twin space model can be viewed on the access terminal based on VR technology. It can be seen that by detecting the access request of the access terminal, the completed digital twin spatial model can be quickly sent to the access terminal for display.
一种实施例中,所述步骤103之后还包括:In one embodiment, after the step 103, it also includes:
将所述场景人工增强任务数据对应的提示数据发送至接入端;所述提示数据为文本式提示数据或语音式提示数据。Sending the prompt data corresponding to the scene manual enhancement task data to the access terminal; the prompt data is text prompt data or voice prompt data.
本申请实施例中,当接入端接收了所述数字孪生空间模型并在本地显示后,若接入端对应的操作对象为目标孪生模型时,将所述场景人工增强任务数据对应的提示数据发送至接入端,以通过文本式提示数据或语音式提示数据提示用户对目标孪生模型进行相应的操作。In the embodiment of the present application, after the access terminal receives the digital twin space model and displays it locally, if the operation object corresponding to the access terminal is the target twin model, the prompt data corresponding to the task data of the scene will be artificially enhanced Send it to the access terminal to prompt the user to perform corresponding operations on the target twin model through text prompt data or voice prompt data.
例如场景人工增强任务数据为操作目标孪生模型拾取另一目标孪生模型,并将另一目标孪生模型移动至数字孪生空间模型中的指定空间位置时,更形象可以理解为用户操作数字孪生空间模型中的云端机器人模型拾取物体A的模型,并将物体A的模型运输至数字孪生空间模型中物体B的模型所在的空间位置,最后将物体A的模型放置于物体B的模型内。为了直观的提示用户完成上述操作,需要将所述场景人工增强任务数据对应的提示数据发送至接入端。可以,通过发送文本式提示数据或语音式提示数据对应的场景人工增强任务数据,能够更加直观的提示用户进行相应操作。For example, when the scene artificially enhances the task data to pick up another target twin model for the operation target twin model, and moves the other target twin model to the specified spatial position in the digital twin space model, it can be more vividly understood as the user operating the digital twin space model The cloud robot model of the cloud picks up the model of object A, and transports the model of object A to the spatial position of the model of object B in the digital twin space model, and finally places the model of object A in the model of object B. In order to intuitively prompt the user to complete the above operations, it is necessary to send the prompt data corresponding to the scene manual enhancement task data to the access terminal. Yes, by sending text prompt data or voice prompt data corresponding to the scene artificially enhanced task data, the user can be more intuitively prompted to perform corresponding operations.
104、获取接入端发送的与所述数字孪生空间模型对应的操作数据。104. Acquire the operation data sent by the access terminal and corresponding to the digital twin spatial model.
本申请实施例中,当接入端接收了所述数字孪生空间模型,并获取了其中包括的场景人工增强任务数据,可依据场景人工增强任务数据选定目标孪生模型,然后对目标孪生模型进行对应的操作从而产生相应的操作数据,所产生的操作数据则由接入端发送至服务器。可见,通过接收接入端发送的操作数据,能够对数字孪生空间模型中的目标孪生模型进行相应的操作。In the embodiment of the present application, when the access terminal receives the digital twin space model and obtains the scene artificial enhancement task data included in it, the target twin model can be selected according to the scene artificial enhancement task data, and then the target twin model can be Corresponding operations generate corresponding operation data, and the generated operation data is sent from the access terminal to the server. It can be seen that by receiving the operation data sent by the access terminal, corresponding operations can be performed on the target twin model in the digital twin space model.
一种实施例中,所述步骤104之后还包括:In one embodiment, after the step 104, it also includes:
获取所述操作数据对应的空间起点数据和空间终点数据;Acquiring the spatial start data and spatial end data corresponding to the operation data;
获取所述空间起点数据对应的空间起点对象,及获取所述空间终点数据对应的空间终点对象;Acquiring a space start point object corresponding to the space start point data, and obtaining a space end point object corresponding to the space end point data;
获取所述空间起点对象和所述空间终点对象组成的当前操作对象集合,若所述当前操作对象集合与所述场景人工增强任务数据对应的任务对象集合相同时,判定所述操作数据满足场景人工增强任务数据对应的触发条件。Obtain the current operation object set composed of the space start object and the space end object, and if the current operation object set is the same as the task object set corresponding to the scene artificial enhancement task data, determine that the operation data meets the scene artificial enhancement task data. Enhance the trigger conditions corresponding to task data.
本申请实施例中,当服务器获取了接入端上传的操作数据后,可以先获取所述操作数据对应的空间起点数据和空间终点数据,这是因为操作数据对应一段具体的运动轨迹,且该运动轨迹的起点处会选定空间起点对象(参考上述举例的物体A的模型及数字孪生空间模型中的云端机器人模型),该运动轨迹的终点处会选定空间终点对象(参考上述举例的物体B的模型),这样在获取了所述空间起点数据对应的空间起点对象和空间终点对象后,即可判断 所述空间起点对象和所述空间终点对象与所述场景人工增强任务数据对应的任务对象集合是否相同。若所述空间起点对象和所述空间终点对象与所述场景人工增强任务数据对应的任务对象集合相同时,则表示用户是依据场景人工增强任务数据完成了相应的操作,此时判定所述操作数据满足场景人工增强任务数据对应的触发条件。可见,通过对操作数据的判断,能够判断进一步是否发送反馈数据。In the embodiment of this application, after the server obtains the operation data uploaded by the access terminal, it can first obtain the spatial start data and spatial end data corresponding to the operation data, because the operation data corresponds to a specific movement track, and the At the starting point of the motion trajectory, the space starting point object will be selected (refer to the model of object A in the above example and the cloud robot model in the digital twin space model), and the space end object will be selected at the end point of the motion trajectory (refer to the object in the above example The model of B), after obtaining the space start object and the space end object corresponding to the space start data, you can judge the task corresponding to the space start object and the space end object and the scene artificial enhancement task data Whether the collection of objects is the same. If the space starting point object and the space end point object are the same as the set of task objects corresponding to the scene artificial enhancement task data, it means that the user has completed the corresponding operation according to the scene artificial enhancement task data, and the operation is determined at this time The data meets the trigger conditions corresponding to the scene artificial enhancement task data. It can be seen that by judging the operation data, it can be judged whether to send feedback data.
105、当确定所述操作数据满足场景人工增强任务数据对应的触发条件时,将与所述操作数据对应的反馈数据发送至接入端。105. Send feedback data corresponding to the operation data to the access terminal when it is determined that the operation data satisfies the trigger condition corresponding to the scene artificial enhancement task data.
本申请实施例中,当确定所述操作数据满足场景人工增强任务数据对应的触发条件时,则表示用户完成的场景人工增强任务数据对应的操作,此时可触发相应的奖励提示数据及反馈数据并发送至接入端。可见,通过发送反馈数据,能够及时提示用户已根据场景人工增强任务数据成功完成了相应操作In this embodiment of the application, when it is determined that the operation data satisfies the trigger condition corresponding to the scene artificial enhancement task data, it means that the user has completed the operation corresponding to the scene artificial enhancement task data, and at this time, the corresponding reward prompt data and feedback data can be triggered and sent to the access terminal. It can be seen that by sending feedback data, the user can be reminded in time that the corresponding operation has been successfully completed according to the artificial enhancement task data of the scene
一种实施例中,所述步骤105包括:In one embodiment, the step 105 includes:
根据所述空间起点数据和所述空间终点数据获取运动轨迹数据;Acquiring motion track data according to the space start data and the space end data;
根据所述空间起点对象、所述空间终点对象和所述运动轨迹数据生成运动动画数据;generating motion animation data according to the space start point object, the space end point object and the motion track data;
获取与所述场景人工增强任务数据对应的任务完成提示数据;Acquiring task completion prompt data corresponding to the artificially enhanced task data of the scene;
将所述运动动画数据和所述任务完成提示数据组成反馈数据并发送至接入端。Composing the motion animation data and the task completion prompt data into feedback data and sending it to the access terminal.
本申请实施例中,为了展示更加丰富数据维度的反馈数据,可以将之前基于场景人工增强任务数据产生的操作数据获取空间起点数据和空间终点数据,由所述空间起点数据和所述空间终点数据获取运动轨迹数据;然后再基于操作数据针对的所述空间起点对象、所述空间终点对象和操作数据相应的所述运动轨迹数据生成运动动画数据;之后再获取预先存储的任务完成提示数据,最后将所述运动动画数据和所述任务完成提示数据组成反馈数据并发送至接入端。可见,基于融合了多维度数据的反馈数据发送至接入端进行展示,可以增加互动性,且增加用户获取完成任务的信息量。In the embodiment of the present application, in order to display feedback data with richer data dimensions, the operation data generated based on the scene artificial enhancement task data can be obtained to obtain the spatial starting point data and the spatial end point data, and the spatial starting point data and the spatial end point data can be obtained. Obtain motion trajectory data; then generate motion animation data based on the motion trajectory data corresponding to the space starting point object, the space end point object and the operation data for the operation data; then obtain the pre-stored task completion prompt data, and finally Composing the motion animation data and the task completion prompt data into feedback data and sending it to the access terminal. It can be seen that the feedback data based on the fusion of multi-dimensional data is sent to the access terminal for display, which can increase interactivity and increase the amount of information that users can obtain to complete tasks.
为便于更好的实施本申请方法,本申请实施例还提供智能装置20。智能装置20可以理解为服务器,后续方案中出现的接入端则为VR设备或PC设备。In order to better implement the method of the present application, the embodiment of the present application further provides a smart device 20 . The smart device 20 can be understood as a server, and the access terminal in subsequent solutions is a VR device or a PC device.
请参阅图2,图2为本申请智能装置20的一种结构示意图,其中该智能装置20具体可包括如下结构:发送单元201、接收单元202和处理单元203。Please refer to FIG. 2 . FIG. 2 is a schematic structural diagram of a smart device 20 of the present application, wherein the smart device 20 may specifically include the following structures: a sending unit 201 , a receiving unit 202 and a processing unit 203 .
其中,所述处理单元203,用于获取优化设备数据,将所述优化设备数据通过数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型。Wherein, the processing unit 203 is configured to obtain optimized equipment data, and map the optimized equipment data to the initial digital twin space model through digital twin modeling, so as to update and obtain the digital twin space model.
本申请实施例中,在服务器中预先存储了初始数字孪生空间模型,初始数字孪生空间模型中的各子模型均是基于数字孪生建模映射至始数字孪生空间模型中,从而实现对真实世界的完全还原或部分还原。更具体的,初始数字孪生空间模型中主要是将真实世界中的建筑进行了还原,但未对其他对象进行还原(如道路上的垃圾桶、真实的人、汽车等)。In the embodiment of this application, the initial digital twin space model is pre-stored in the server, and each sub-model in the initial digital twin space model is mapped to the original digital twin space model based on digital twin modeling, so as to realize the real world Fully restored or partially restored. More specifically, the initial digital twin space model mainly restores buildings in the real world, but does not restore other objects (such as trash cans on the road, real people, cars, etc.).
此时,当需要将待操控的云端机器人的目标操作对象通过数字孪生技术添加至初始数字孪生空间模型时,需先基于目标操作对象的真实设备数据转换得到的的优化设备数据(一般包括尺寸数据、运行参数数据等,尺寸数据就是目标操作对象的长、宽、高等参数、运行参数数据就是目标操作对象的平均运动速度等参数),然后将所述优化设备数据通过数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型。At this time, when it is necessary to add the target operation object of the cloud robot to be controlled to the initial digital twin space model through digital twin technology, it is necessary to first convert the optimized device data (generally including size data) obtained based on the real device data of the target operation object , operating parameter data, etc., the size data is the length, width, height and other parameters of the target operating object, and the operating parameter data is the average moving speed of the target operating object, etc.), and then the optimized equipment data is mapped to the initial The digital twin spatial model is updated to obtain the digital twin spatial model.
其中,在将所述优化设备数据通过数字孪生建模映射至初始数字孪生空间模型的过程中,可采用所述优化设备数据在物理空间中的坐标对应映射至1:1还原的初始数字孪生空间中相应的空间位置,从而实现建模后的精准映射。Wherein, in the process of mapping the optimized equipment data to the initial digital twin space model through digital twin modeling, the coordinates of the optimized equipment data in the physical space can be used to map to the initial digital twin space restored at 1:1 The corresponding spatial position in the model, so as to realize the accurate mapping after modeling.
一种实施例中,所述处理单元203,具体用于:In one embodiment, the processing unit 203 is specifically configured to:
获取真实设备数据,将所述真实设备数据根据预设的设备转化策略对应转换为优化设备数据。Acquire real device data, and correspondingly convert the real device data into optimized device data according to a preset device conversion strategy.
本申请实施例中,例如目标操作对象的真实设备数据是对应废弃物,而目标操作对象的优化设备数据是花朵,这样将废弃物转换为花朵在数字孪生空间模型中显示,不仅可以避免对目标操作对象的真实显示,而且还可以降低建模难度以提高数据处理效率。本申请的方案中还可以适用于以下场景,例如真实世界下云端机器人分拣各种垃圾的任务在数字孪生空间模型下可以转化为在美丽后花园中进行各种花卉的插花任务。此方案同样适用于离线训练数据采集,比如将机器人路径规划训练数据的采集转化为赛车游戏,人类玩家在各种各样的场景下进行赛车比赛,比赛数据将转化为机器人进行路径 规划学习的训练数据。In the embodiment of the present application, for example, the real equipment data of the target operation object is the corresponding waste, while the optimized equipment data of the target operation object is flowers. In this way, converting waste into flowers and displaying them in the digital twin space model can not only avoid The real display of the operation object, but also can reduce the difficulty of modeling to improve the efficiency of data processing. The solution of this application can also be applied to the following scenarios. For example, the task of sorting various garbage by cloud robots in the real world can be transformed into the task of arranging various flowers in the beautiful back garden under the digital twin space model. This solution is also applicable to offline training data collection, such as converting the collection of robot path planning training data into a racing game, where human players compete in various scenarios, and the game data will be converted into training for robots to learn path planning data.
一种实施例中,所述处理单元203,具体用于:In one embodiment, the processing unit 203 is specifically configured to:
获取所述优化设备数据中包括的尺寸数据,将所述尺寸数据通过1:1的数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型;其中,更新得到数字孪生空间模型中包括与所述优化设备数据对应的优化设备孪生模型;Obtaining the dimensional data included in the optimized equipment data, and mapping the dimensional data to the initial digital twin space model through 1:1 digital twin modeling, so as to update the digital twin space model; wherein, the update obtains the digital twin space model includes an optimized equipment twin model corresponding to the optimized equipment data;
获取所述优化设备数据中包括的运行参数数据,将所述运行参数数据与所述数字孪生空间模型中优化设备孪生模型进行融合,以更新数字孪生空间模型。The operating parameter data included in the optimized equipment data is obtained, and the operating parameter data is fused with the optimized equipment twin model in the digital twin space model to update the digital twin space model.
本申请实施例中,将所述尺寸数据通过1:1的数字孪生建模映射至初始数字孪生空间模型,可以将待操作的云端机器人的1:1还原的数字孪生模型映射至初始数字孪生空间模型中,无需进行放大或缩小尺寸的操作,而且是采用所述优化设备数据在物理空间中的坐标对应映射至1:1还原的初始数字孪生空间中相应的空间位置。可见,通过过1:1的数字孪生建模技术可以快速将真实设备映射至数字孪生空间模型中。In the embodiment of this application, the size data is mapped to the initial digital twin space model through 1:1 digital twin modeling, and the 1:1 restored digital twin model of the cloud robot to be operated can be mapped to the initial digital twin space In the model, there is no need to enlarge or reduce the size, and the coordinates of the optimized equipment data in the physical space are mapped to the corresponding spatial positions in the original digital twin space restored at 1:1. It can be seen that through the 1:1 digital twin modeling technology, real equipment can be quickly mapped to the digital twin space model.
所述处理单元203,还用于获取所设置的场景人工增强任务数据,将所述场景人工增强任务数据与所述数字孪生空间模型进行融合,以更新数字孪生空间模型。The processing unit 203 is further configured to obtain the set scene artificial enhancement task data, and fuse the scene artificial enhancement task data with the digital twin space model to update the digital twin space model.
本申请实施例中,当基于优化设备数据完成了数字孪生建模之后,还可以获取所设置的场景人工增强任务数据,将所述场景人工增强任务数据与所述数字孪生空间模型进行融合,以更新数字孪生空间模型。上述操作相当于在数字孪生空间模型中选定任意一个数字孪生模型,并对其具体设置场景人工增强任务数据,其中场景人工增强任务数据可以理解为选中数字孪生空间模型中任意一个或多个数字孪生模型后对所选中的数字孪生模型分别相应增加一个新的属性数据即任务数据(可参考网络游戏中玩家操控游戏角色点击某一物体或游戏人物并进行相关操作可触发任务提示的场景)。当对所选定的某一个或多个数字孪生模型的完成场景人工增强任务数据的设置后,可以将所述场景人工增强任务数据与所述数字孪生空间模型进行融合,以更新数字孪生空间模型。可见,通过对数字孪生模型增加场景人工增强任务数据,可以增加数字孪生空间模型在任务属性这一维度的数据。In the embodiment of the present application, after the digital twin modeling is completed based on the optimized equipment data, the set scene artificial enhancement task data can also be obtained, and the scene artificial enhancement task data can be fused with the digital twin space model to obtain Update the digital twin spatial model. The above operation is equivalent to selecting any digital twin model in the digital twin space model, and setting the scene artificial enhancement task data for it, where the scene artificial enhancement task data can be understood as any one or more numbers in the digital twin space model selected After the twin model, a new attribute data, that is, task data, is added to the selected digital twin model (refer to the scene in the online game where the player manipulates the game character to click on an object or game character and perform related operations to trigger the task reminder). After setting the scene artificial enhancement task data for one or more selected digital twin models, the scene artificial enhancement task data can be fused with the digital twin space model to update the digital twin space model . It can be seen that by adding scene artificially enhanced task data to the digital twin model, the data of the digital twin spatial model in the dimension of task attributes can be increased.
一种实施例中,所述处理单元203,还具体用于:In one embodiment, the processing unit 203 is further specifically configured to:
获取所述场景人工增强任务数据在所述数字孪生空间模型中对应的目标孪生模型,将所述场景人工增强任务数据与所述目标孪生模型进行融合,以更新数字孪生空间模型。Acquiring the target twin model corresponding to the scene artificial enhancement task data in the digital twin space model, and fusing the scene artificial enhancement task data with the target twin model to update the digital twin space model.
本申请实施例中,具体是先获取所述场景人工增强任务数据在所述数字孪生空间模型中对应的目标孪生模型,该目标孪生模型可能是一个数字孪生模型(如对应优化设备数据对应的数字孪生模型),也可能是多个数字孪生模型(如除了对应优化设备数据对应的数字孪生模型,还包括多个其他所选定的数字孪生模型),然后将所述场景人工增强任务数据增加至目标孪生模型上,以作为目标孪生模型具有的属性数据,且该属性数据可被后续的操作触发以显示或提示用户。In the embodiment of the present application, the target twin model corresponding to the scene artificial enhancement task data in the digital twin space model is obtained first, and the target twin model may be a digital twin model (such as the digital twin model corresponding to the optimized equipment data). Twin model), may also be a plurality of digital twin models (for example, in addition to the digital twin model corresponding to the optimized equipment data, it also includes multiple other selected digital twin models), and then the artificial enhancement task data of the scene is added to On the target twin model, as the attribute data of the target twin model, and the attribute data can be triggered by subsequent operations to display or prompt the user.
所述发送单元201,用于当检测到接入端发送的用户接入指令时,将所述数字孪生空间模型发送至接入端。The sending unit 201 is configured to send the digital twin space model to the access terminal when a user access instruction sent by the access terminal is detected.
本申请实施例中,当服务器检测到接入端(如VR设备等)的登录请求并对其登录信息验证成功时,获取之后接入端发送的用户接入指令(可理解为机器人训练师操作接入端产生的用户接入指令)以请求接入数字孪生空间模型,此时可以获取与用户接入指令相应的数字孪生空间模型并发送至接入端。之后,在接入端上基于VR技术可以查看所述数字孪生空间模型对应的虚拟模型。可见,通过检测到接入端的接入请求,能够快速的将完成建模的数字孪生空间模型发送至接入端进行显示。In the embodiment of this application, when the server detects the login request of the access terminal (such as a VR device, etc.) and successfully verifies its login information, it acquires the user access instruction sent by the access terminal (which can be understood as the robot trainer operation The user access instruction generated by the access terminal) to request access to the digital twin spatial model, at this time, the digital twin spatial model corresponding to the user access instruction can be obtained and sent to the access terminal. Afterwards, the virtual model corresponding to the digital twin space model can be viewed on the access terminal based on VR technology. It can be seen that by detecting the access request of the access terminal, the completed digital twin spatial model can be quickly sent to the access terminal for display.
一种实施例中,所述发送单元201还用于:In an embodiment, the sending unit 201 is further configured to:
将所述场景人工增强任务数据对应的提示数据发送至接入端;所述提示数据为文本式提示数据或语音式提示数据。Sending the prompt data corresponding to the scene manual enhancement task data to the access terminal; the prompt data is text prompt data or voice prompt data.
本申请实施例中,当接入端接收了所述数字孪生空间模型并在本地显示后,若接入端对应的操作对象为目标孪生模型时,将所述场景人工增强任务数据对应的提示数据发送至接入端,以通过文本式提示数据或语音式提示数据提示用户对目标孪生模型进行相应的操作。In the embodiment of the present application, after the access terminal receives the digital twin space model and displays it locally, if the operation object corresponding to the access terminal is the target twin model, the prompt data corresponding to the task data of the scene will be artificially enhanced Send it to the access terminal to prompt the user to perform corresponding operations on the target twin model through text prompt data or voice prompt data.
例如场景人工增强任务数据为操作目标孪生模型拾取另一目标孪生模型,并将另一目标孪生模型移动至数字孪生空间模型中的指定空间位置时,更形象可以理解为用户操作数字孪生空间模型中的云端机器人模型拾取物体A的模型,并将物体A的模型运输至数字孪生空间模型中物体B的模型所在的空间位置,最后将物体A的模型放置于物体B的模型内。为了直观的提示 用户完成上述操作,需要将所述场景人工增强任务数据对应的提示数据发送至接入端。可以,通过发送文本式提示数据或语音式提示数据对应的场景人工增强任务数据,能够更加直观的提示用户进行相应操作。For example, when the scene artificially enhances the task data to pick up another target twin model for the operation target twin model, and moves the other target twin model to the specified spatial position in the digital twin space model, it can be more vividly understood as the user operating the digital twin space model The cloud robot model of the cloud picks up the model of object A, and transports the model of object A to the spatial position of the model of object B in the digital twin space model, and finally places the model of object A in the model of object B. In order to intuitively prompt the user to complete the above operations, it is necessary to send the prompt data corresponding to the scene manual enhancement task data to the access terminal. Yes, by sending text prompt data or voice prompt data corresponding to the scene artificially enhanced task data, the user can be more intuitively prompted to perform corresponding operations.
所述接收单元202,用于获取接入端发送的与所述数字孪生空间模型对应的操作数据。The receiving unit 202 is configured to acquire the operation data sent by the access terminal and corresponding to the digital twin space model.
本申请实施例中,当接入端接收了所述数字孪生空间模型,并获取了其中包括的场景人工增强任务数据,可依据场景人工增强任务数据选定目标孪生模型,然后对目标孪生模型进行对应的操作从而产生相应的操作数据,所产生的操作数据则由接入端发送至服务器。可见,通过接收接入端发送的操作数据,能够对数字孪生空间模型中的目标孪生模型进行相应的操作。In the embodiment of the present application, when the access terminal receives the digital twin space model and obtains the scene artificial enhancement task data included in it, the target twin model can be selected according to the scene artificial enhancement task data, and then the target twin model can be Corresponding operations generate corresponding operation data, and the generated operation data is sent from the access terminal to the server. It can be seen that by receiving the operation data sent by the access terminal, corresponding operations can be performed on the target twin model in the digital twin space model.
一种实施例中,所述步处理单元203还具体用于:In one embodiment, the step processing unit 203 is further specifically configured to:
获取所述操作数据对应的空间起点数据和空间终点数据;Acquiring the spatial start data and spatial end data corresponding to the operation data;
获取所述空间起点数据对应的空间起点对象,及获取所述空间终点数据对应的空间终点对象;Acquiring a space start point object corresponding to the space start point data, and obtaining a space end point object corresponding to the space end point data;
获取所述空间起点对象和所述空间终点对象组成的当前操作对象集合,若所述当前操作对象集合与所述场景人工增强任务数据对应的任务对象集合相同时,判定所述操作数据满足场景人工增强任务数据对应的触发条件。Obtain the current operation object set composed of the space start object and the space end object, and if the current operation object set is the same as the task object set corresponding to the scene artificial enhancement task data, determine that the operation data meets the scene artificial enhancement task data. Enhance the trigger conditions corresponding to task data.
本申请实施例中,当服务器获取了接入端上传的操作数据后,可以先获取所述操作数据对应的空间起点数据和空间终点数据,这是因为操作数据对应一段具体的运动轨迹,且该运动轨迹的起点处会选定空间起点对象(参考上述举例的物体A的模型及数字孪生空间模型中的云端机器人模型),该运动轨迹的终点处会选定空间终点对象(参考上述举例的物体B的模型),这样在获取了所述空间起点数据对应的空间起点对象和空间终点对象后,即可判断所述空间起点对象和所述空间终点对象与所述场景人工增强任务数据对应的任务对象集合是否相同。若所述空间起点对象和所述空间终点对象与所述场景人工增强任务数据对应的任务对象集合相同时,则表示用户是依据场景人工增强任务数据完成了相应的操作,此时判定所述操作数据满足场景人工增强任务数据对应的触发条件。可见,通过对操作数据的判断,能够判断进一步是否发送反馈数据。In the embodiment of this application, after the server obtains the operation data uploaded by the access terminal, it can first obtain the spatial start data and spatial end data corresponding to the operation data, because the operation data corresponds to a specific movement track, and the At the starting point of the motion trajectory, the space starting point object will be selected (refer to the model of object A in the above example and the cloud robot model in the digital twin space model), and the space end object will be selected at the end point of the motion trajectory (refer to the object in the above example The model of B), after obtaining the space start object and the space end object corresponding to the space start data, you can judge the task corresponding to the space start object and the space end object and the scene artificial enhancement task data Whether the collection of objects is the same. If the space starting point object and the space end point object are the same as the set of task objects corresponding to the scene artificial enhancement task data, it means that the user has completed the corresponding operation according to the scene artificial enhancement task data, and the operation is determined at this time The data meets the trigger conditions corresponding to the scene artificial enhancement task data. It can be seen that by judging the operation data, it can be judged whether to send feedback data.
所述发送单元201,还用于当确定所述操作数据满足场景人工增强任务数据对应的触发条件时,将与所述操作数据对应的反馈数据发送至接入端。The sending unit 201 is further configured to send feedback data corresponding to the operation data to the access terminal when it is determined that the operation data satisfies the trigger condition corresponding to the scenario artificial enhancement task data.
本申请实施例中,当确定所述操作数据满足场景人工增强任务数据对应的触发条件时,则表示用户完成的场景人工增强任务数据对应的操作,此时可触发相应的奖励提示数据及反馈数据并发送至接入端。可见,通过发送反馈数据,能够及时提示用户已根据场景人工增强任务数据成功完成了相应操作In this embodiment of the application, when it is determined that the operation data satisfies the trigger condition corresponding to the scene artificial enhancement task data, it means that the user has completed the operation corresponding to the scene artificial enhancement task data, and at this time, the corresponding reward prompt data and feedback data can be triggered and sent to the access terminal. It can be seen that by sending feedback data, the user can be reminded in time that the corresponding operation has been successfully completed according to the artificial enhancement task data of the scene
一种实施例中,所述发送单元201,还具体用于:In one embodiment, the sending unit 201 is further specifically configured to:
根据所述空间起点数据和所述空间终点数据获取运动轨迹数据;Acquiring motion track data according to the space start data and the space end data;
根据所述空间起点对象、所述空间终点对象和所述运动轨迹数据生成运动动画数据;generating motion animation data according to the space start point object, the space end point object and the motion track data;
获取与所述场景人工增强任务数据对应的任务完成提示数据;Acquiring task completion prompt data corresponding to the artificially enhanced task data of the scene;
将所述运动动画数据和所述任务完成提示数据组成反馈数据并发送至接入端。Composing the motion animation data and the task completion prompt data into feedback data and sending it to the access terminal.
本申请实施例中,为了展示更加丰富数据维度的反馈数据,可以将之前基于场景人工增强任务数据产生的操作数据获取空间起点数据和空间终点数据,由所述空间起点数据和所述空间终点数据获取运动轨迹数据;然后再基于操作数据针对的所述空间起点对象、所述空间终点对象和操作数据相应的所述运动轨迹数据生成运动动画数据;之后再获取预先存储的任务完成提示数据,最后将所述运动动画数据和所述任务完成提示数据组成反馈数据并发送至接入端。可见,基于融合了多维度数据的反馈数据发送至接入端进行展示,可以增加互动性,且增加用户获取完成任务的信息量。In the embodiment of the present application, in order to display feedback data with richer data dimensions, the operation data generated based on the scene artificial enhancement task data can be obtained to obtain the spatial starting point data and the spatial end point data, and the spatial starting point data and the spatial end point data can be obtained. Obtain motion trajectory data; then generate motion animation data based on the motion trajectory data corresponding to the space starting point object, the space end point object and the operation data for the operation data; then obtain the pre-stored task completion prompt data, and finally Composing the motion animation data and the task completion prompt data into feedback data and sending it to the access terminal. It can be seen that the feedback data based on the fusion of multi-dimensional data is sent to the access terminal for display, which can increase interactivity and increase the amount of information that users can obtain to complete tasks.
本申请还提供了处理设备,参阅图3,图3示出了本申请处理设备的一种结构示意图,具体的,本申请提供的处理设备包括处理器,处理器用于执行存储器中存储的计算机程序时实现如图1对应的实施例中的各步骤;或者,处理器用于执行存储器中存储的计算机程序时实现如图2对应实施例中各模块的功能。The present application also provides a processing device. Referring to FIG. 3, FIG. 3 shows a schematic structural diagram of the processing device of the present application. Specifically, the processing device provided in the present application includes a processor, and the processor is used to execute the computer program stored in the memory. When implementing the steps in the embodiment corresponding to Figure 1; or, when the processor is used to execute the computer program stored in the memory, implement the functions of the modules in the embodiment corresponding to Figure 2.
示例性的,计算机程序可以被分割成一个或多个模块/单元,一个或者多个模块/单元被存储在存储器中,并由处理器执行,以完成本申请。一个或多个模块/单元可以是能够完成特定功能的一系列计算机程序指令段,该指令段用于描述计算机程序在计算机装置中的执行过程。Exemplarily, a computer program can be divided into one or more modules/units, and one or more modules/units are stored in a memory and executed by a processor to complete the present application. One or more modules/units may be a series of computer program instruction segments capable of accomplishing specific functions, and the instruction segments are used to describe the execution process of the computer program in the computer device.
处理设备可包括,但不仅限于处理器、存储器。本领域技术人员可以理解,示意仅仅是处理设备的示例,并不构成对处理设备的限定,可以包括比 图示更多或更少的部件,或者组合某些部件,或者不同的部件,例如处理设备还可以包括输入输出设备、网络接入设备、总线等,处理器、存储器、输入输出设备以及网络接入设备等通过总线相连。A processing device may include, but is not limited to, a processor, memory. Those skilled in the art can understand that the illustration is only an example of a processing device, and does not constitute a limitation to the processing device, and may include more or less components than those shown in the illustration, or combine some components, or different components, such as processing The device may also include an input and output device, a network access device, a bus, etc., and a processor, a memory, an input and output device, and a network access device are connected through the bus.
处理器可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等,处理器是处理设备的控制中心,利用各种接口和线路连接整个处理设备的各个部分。The processor can be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the processing device, and uses various interfaces and lines to connect various parts of the entire processing device.
存储器可用于存储计算机程序和/或模块,处理器通过运行或执行存储在存储器内的计算机程序和/或模块,以及调用存储在存储器内的数据,实现计算机装置的各种功能。存储器可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据处理设备的使用所创建的数据(比如音频数据、视频数据等)等。此外,存储器可以包括高速随机存取存储器,还可以包括非易失性存储器,例如硬盘、内存、插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)、至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory can be used to store computer programs and/or modules, and the processor implements various functions of the computer device by running or executing the computer programs and/or modules stored in the memory and calling data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of the device (such as audio data, video data, etc.), etc. In addition, the memory can include high-speed random access memory, and can also include non-volatile memory, such as hard disk, internal memory, plug-in hard disk, smart memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card , flash card (Flash Card), at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
显示屏用于显示输入输出单元输出的至少一种字符类型的字符。The display screen is used for displaying characters of at least one character type output by the input and output unit.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的装置、处理设备及其对应模块的具体工作过程,可以参考如图1对应的实施例中的说明,具体在此不再赘述。Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described device, processing device and corresponding modules can refer to the description in the corresponding embodiment shown in Figure 1, specifically here No longer.
本领域普通技术人员可以理解,上述实施例的各种方法中的全部或部分步骤可以通过指令来完成,或通过指令控制相关的硬件来完成,该指令可以存储于一计算机可读存储介质中,并由处理器进行加载和执行。Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or by instructions controlling related hardware, and the instructions can be stored in a computer-readable storage medium, and is loaded and executed by the processor.
为此,本申请实施例提供一种计算机可读存储介质,其中存储有多条指令,该指令能够被处理器进行加载,以执行本申请如图1对应的实施例中的的步骤,具体操作可参考如图1对应的实施例中的的说明,在此不再赘述。To this end, the embodiment of the present application provides a computer-readable storage medium, which stores a plurality of instructions that can be loaded by the processor to perform the steps in the embodiment of the present application as shown in Figure 1. The specific operations Reference may be made to the description in the embodiment corresponding to FIG. 1 , and details are not repeated here.
其中,该计算机可读存储介质可以包括:只读存储器(ROM,Read Only  Memory)、随机存取记忆体(RAM,Random Access Memory)、磁盘或光盘等。Wherein, the computer-readable storage medium may include: a read-only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and the like.
由于该计算机可读存储介质中所存储的指令,可以执行本申请如图1对应的实施例中的的步骤,因此,可以实现本申请如图1对应的实施例中的所能实现的有益效果,详见前面的说明,在此不再赘述。Because the instructions stored in the computer-readable storage medium can execute the steps in the embodiment corresponding to Figure 1 of this application, therefore, the beneficial effects that can be realized in the embodiment corresponding to Figure 1 of this application can be realized , see the previous description for details, and will not repeat them here.
以上对本申请提供的一种基于数字孪生的人工增强方法、装置及存储介质进行了详细介绍,本申请实施例中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。A digital twin-based artificial enhancement method, device, and storage medium provided by this application have been introduced in detail above. In the embodiments of this application, specific examples have been applied to illustrate the principles and implementation methods of this application. The description of the above embodiments It is only used to help understand the method of the present application and its core idea; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation and application scope. In summary, this The content of the description should not be understood as limiting the application.

Claims (10)

  1. 一种基于数字孪生的人工增强方法,其特征在于,所述方法包括:A digital twin-based artificial enhancement method, characterized in that the method comprises:
    获取基于真实设备数据转换得到的优化设备数据,将所述优化设备数据通过数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型;Obtain optimized equipment data converted based on real equipment data, and map the optimized equipment data to the initial digital twin space model through digital twin modeling to update the digital twin space model;
    获取所设置的场景人工增强任务数据,将所述场景人工增强任务数据与所述数字孪生空间模型进行融合,以更新数字孪生空间模型;Obtain the set scene artificial enhancement task data, and fuse the scene artificial enhancement task data with the digital twin space model to update the digital twin space model;
    当检测到接入端发送的用户接入指令时,将所述数字孪生空间模型发送至接入端;When the user access instruction sent by the access terminal is detected, the digital twin space model is sent to the access terminal;
    获取接入端发送的与所述数字孪生空间模型对应的操作数据;Obtaining the operation data corresponding to the digital twin space model sent by the access terminal;
    当确定所述操作数据满足场景人工增强任务数据对应的触发条件时,将与所述操作数据对应的反馈数据发送至接入端。When it is determined that the operation data satisfies the trigger condition corresponding to the scene artificial enhancement task data, the feedback data corresponding to the operation data is sent to the access terminal.
  2. 根据权利要求1所述的方法,其特征在于,所述获获取基于真实设备数据转换得到的优化设备数据,包括:The method according to claim 1, wherein said obtaining optimized device data converted based on real device data comprises:
    获取真实设备数据,将所述真实设备数据根据预设的设备转化策略对应转换为优化设备数据。Acquire real device data, and correspondingly convert the real device data into optimized device data according to a preset device conversion strategy.
  3. 根据权利要求1所述的方法,其特征在于,所述获取优化设备数据,将所述优化设备数据通过数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型,包括:The method according to claim 1, wherein said obtaining optimized equipment data, mapping said optimized equipment data to an initial digital twin space model through digital twin modeling, to update and obtain a digital twin space model, comprises:
    获取所述优化设备数据中包括的尺寸数据,将所述尺寸数据通过1:1的数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型;其中,更新得到数字孪生空间模型中包括与所述优化设备数据对应的优化设备孪生模型;Obtaining the dimensional data included in the optimized equipment data, and mapping the dimensional data to the initial digital twin space model through 1:1 digital twin modeling, so as to update the digital twin space model; wherein, the update obtains the digital twin space model includes an optimized equipment twin model corresponding to the optimized equipment data;
    获取所述优化设备数据中包括的运行参数数据,将所述运行参数数据与所述数字孪生空间模型中优化设备孪生模型进行融合,以更新数字孪生空间模型。The operating parameter data included in the optimized equipment data is obtained, and the operating parameter data is fused with the optimized equipment twin model in the digital twin space model to update the digital twin space model.
  4. 根据权利要求3述的方法,其特征在于,所述获取所设置的场景人工增强任务数据,将所述场景人工增强任务数据与所述数字孪生空间模型进行融合,以更新数字孪生空间模型,包括:The method according to claim 3, wherein the acquisition of the artificially enhanced task data of the scene is performed, and the artificially enhanced task data of the scene is fused with the digital twin space model to update the digital twin space model, including :
    获取所述场景人工增强任务数据在所述数字孪生空间模型中对应的目标孪生模型,将所述场景人工增强任务数据与所述目标孪生模型进行融合,以 更新数字孪生空间模型。Obtain the target twin model corresponding to the scene artificial enhancement task data in the digital twin space model, and fuse the scene artificial enhancement task data with the target twin model to update the digital twin space model.
  5. 根据权利要求1所述的方法,其特征在于,所述当检测到接入端发送的用户接入指令时,将所述数字孪生空间模型发送至接入端之后,还包括:The method according to claim 1, wherein when the user access instruction sent by the access terminal is detected, after sending the digital twin spatial model to the access terminal, further comprising:
    将所述场景人工增强任务数据对应的提示数据发送至接入端;所述提示数据为文本式提示数据或语音式提示数据。Sending the prompt data corresponding to the scene manual enhancement task data to the access terminal; the prompt data is text prompt data or voice prompt data.
  6. 根据权利要求1所述的方法,其特征在于,所述获取接入端发送的与所述数字孪生空间模型对应的操作数据之后,还包括:The method according to claim 1, wherein after acquiring the operation data corresponding to the digital twin space model sent by the access terminal, further comprising:
    获取所述操作数据对应的空间起点数据和空间终点数据;Obtaining the spatial start data and spatial end data corresponding to the operation data;
    获取所述空间起点数据对应的空间起点对象,及获取所述空间终点数据对应的空间终点对象;Acquiring a space start point object corresponding to the space start point data, and obtaining a space end point object corresponding to the space end point data;
    获取所述空间起点对象和所述空间终点对象组成的当前操作对象集合,若所述当前操作对象集合与所述场景人工增强任务数据对应的任务对象集合相同时,判定所述操作数据满足场景人工增强任务数据对应的触发条件。Obtain the current operation object set composed of the space start object and the space end object, and if the current operation object set is the same as the task object set corresponding to the scene artificial enhancement task data, determine that the operation data meets the scene artificial enhancement task data. Enhance the trigger conditions corresponding to task data.
  7. 根据权利要求6所述的方法,其特征在于,所述将与所述操作数据对应的反馈数据发送至接入端,包括:The method according to claim 6, wherein the sending the feedback data corresponding to the operation data to the access terminal comprises:
    根据所述空间起点数据和所述空间终点数据获取运动轨迹数据;Acquiring motion track data according to the space start data and the space end data;
    根据所述空间起点对象、所述空间终点对象和所述运动轨迹数据生成运动动画数据;generating motion animation data according to the space start point object, the space end point object and the motion track data;
    获取与所述场景人工增强任务数据对应的任务完成提示数据;Acquiring task completion prompt data corresponding to the artificially enhanced task data of the scene;
    将所述运动动画数据和所述任务完成提示数据组成反馈数据并发送至接入端。Composing the motion animation data and the task completion prompt data into feedback data and sending it to the access terminal.
  8. 一种智能装置,其特征在于,所述智能装置包括:发送单元、接收单元和处理单元;An intelligent device, characterized in that the intelligent device comprises: a sending unit, a receiving unit and a processing unit;
    所述处理单元,用于获取优化设备数据,将所述优化设备数据通过数字孪生建模映射至初始数字孪生空间模型,以更新得到数字孪生空间模型;The processing unit is configured to obtain optimized equipment data, and map the optimized equipment data to the initial digital twin space model through digital twin modeling, so as to update and obtain the digital twin space model;
    所述处理单元,还用于获取所设置的场景人工增强任务数据,将所述场景人工增强任务数据与所述数字孪生空间模型进行融合,以更新数字孪生空间模型;The processing unit is also used to obtain the set scene artificial enhancement task data, and fuse the scene artificial enhancement task data with the digital twin space model to update the digital twin space model;
    所述发送单元,用于当检测到接入端发送的用户接入指令时,将所述数字孪生空间模型发送至接入端;The sending unit is configured to send the digital twin space model to the access terminal when a user access instruction sent by the access terminal is detected;
    所述接收单元,用于获取接入端发送的与所述数字孪生空间模型对应的 操作数据;The receiving unit is configured to obtain the operation data corresponding to the digital twin space model sent by the access terminal;
    所述发送单元,还用于当确定所述操作数据满足场景人工增强任务数据对应的触发条件时,将与所述操作数据对应的反馈数据发送至接入端。The sending unit is further configured to send feedback data corresponding to the operation data to the access terminal when it is determined that the operation data satisfies a trigger condition corresponding to the scenario artificial enhancement task data.
  9. 一种处理设备,其特征在于,包括处理器和存储器,所述存储器中存储有计算机程序,所述处理器调用所述存储器中的计算机程序时执行如权利要求1至7任一项所述的方法。A processing device, characterized in that it includes a processor and a memory, and a computer program is stored in the memory, and when the processor invokes the computer program in the memory, it executes the method according to any one of claims 1 to 7 method.
  10. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有多条指令,所述指令适于处理器进行加载,以执行权利要求1至7任一项所述的方法。A computer-readable storage medium, characterized in that the computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the method according to any one of claims 1 to 7.
PCT/CN2022/108917 2021-12-29 2022-07-29 Digital-twin-based artificial enhancement method and apparatus, and medium WO2023124055A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111644024.7 2021-12-29
CN202111644024.7A CN114372356B (en) 2021-12-29 2021-12-29 Artificial enhancement method, device and medium based on digital twins

Publications (1)

Publication Number Publication Date
WO2023124055A1 true WO2023124055A1 (en) 2023-07-06

Family

ID=81142993

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/108917 WO2023124055A1 (en) 2021-12-29 2022-07-29 Digital-twin-based artificial enhancement method and apparatus, and medium

Country Status (2)

Country Link
CN (1) CN114372356B (en)
WO (1) WO2023124055A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117291583A (en) * 2023-11-27 2023-12-26 贵州联广科技股份有限公司 Internet of things data management method and system
CN117475041A (en) * 2023-12-28 2024-01-30 湖南视觉伟业智能科技有限公司 Digital twin shore bridge simulation method based on RCMS
CN117781896A (en) * 2024-02-23 2024-03-29 天生桥二级水力发电有限公司 Infrared detection processing method and device suitable for carbon brush of unit and storage medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114372356B (en) * 2021-12-29 2023-02-28 达闼机器人股份有限公司 Artificial enhancement method, device and medium based on digital twins
CN115278110B (en) * 2022-07-12 2023-08-25 时空穿越(深圳)科技有限公司 Information processing method, device and system based on digital twin cabin and readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111432989A (en) * 2018-12-04 2020-07-17 深圳前海达闼云端智能科技有限公司 Artificially enhanced cloud-based robot intelligence framework and related methods
CN112428272A (en) * 2020-11-16 2021-03-02 同济大学 Robot-environment dynamic interactive rendering system and method for digital twin
EP3798747A1 (en) * 2019-09-26 2021-03-31 Siemens Aktiengesellschaft Controlling a machine based on an online digital twin
CN112668687A (en) * 2020-12-01 2021-04-16 达闼机器人有限公司 Cloud robot system, cloud server, robot control module and robot
CN113344505A (en) * 2021-05-11 2021-09-03 广东省科学院智能制造研究所 Sanitary ware product assembly production management system and method based on digital twinning
CN114372356A (en) * 2021-12-29 2022-04-19 达闼机器人有限公司 Artificial enhancement method, device and medium based on digital twins

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110047148B (en) * 2019-04-10 2024-01-26 珠海惠中智能技术有限公司 Simulation interaction visualization system of virtual robot workstation and implementation method
CN111161410B (en) * 2019-12-30 2021-10-12 中国矿业大学(北京) Mine digital twinning model and construction method thereof
CN113246122A (en) * 2021-04-26 2021-08-13 广东工贸职业技术学院 Digital twin practical training method and system of industrial robot

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111432989A (en) * 2018-12-04 2020-07-17 深圳前海达闼云端智能科技有限公司 Artificially enhanced cloud-based robot intelligence framework and related methods
EP3798747A1 (en) * 2019-09-26 2021-03-31 Siemens Aktiengesellschaft Controlling a machine based on an online digital twin
CN112428272A (en) * 2020-11-16 2021-03-02 同济大学 Robot-environment dynamic interactive rendering system and method for digital twin
CN112668687A (en) * 2020-12-01 2021-04-16 达闼机器人有限公司 Cloud robot system, cloud server, robot control module and robot
CN113344505A (en) * 2021-05-11 2021-09-03 广东省科学院智能制造研究所 Sanitary ware product assembly production management system and method based on digital twinning
CN114372356A (en) * 2021-12-29 2022-04-19 达闼机器人有限公司 Artificial enhancement method, device and medium based on digital twins

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117291583A (en) * 2023-11-27 2023-12-26 贵州联广科技股份有限公司 Internet of things data management method and system
CN117291583B (en) * 2023-11-27 2024-02-23 贵州联广科技股份有限公司 Internet of things data management method and system
CN117475041A (en) * 2023-12-28 2024-01-30 湖南视觉伟业智能科技有限公司 Digital twin shore bridge simulation method based on RCMS
CN117475041B (en) * 2023-12-28 2024-03-29 湖南视觉伟业智能科技有限公司 Digital twin shore bridge simulation method based on RCMS
CN117781896A (en) * 2024-02-23 2024-03-29 天生桥二级水力发电有限公司 Infrared detection processing method and device suitable for carbon brush of unit and storage medium
CN117781896B (en) * 2024-02-23 2024-05-10 天生桥二级水力发电有限公司 Infrared detection processing method and device suitable for carbon brush of unit and storage medium

Also Published As

Publication number Publication date
CN114372356B (en) 2023-02-28
CN114372356A (en) 2022-04-19

Similar Documents

Publication Publication Date Title
WO2023124055A1 (en) Digital-twin-based artificial enhancement method and apparatus, and medium
WO2021155686A1 (en) Animation production method and apparatus, computing device, and storage medium
CN110026987A (en) Generation method, device, equipment and the storage medium of a kind of mechanical arm crawl track
WO2021143278A1 (en) Image processing method and apparatus, and electronic device and storage medium
CN112836064A (en) Knowledge graph complementing method and device, storage medium and electronic equipment
TW201915665A (en) Robot interaction method and device
CN113359994B (en) Teaching content configuration and interaction scheme implementation method suitable for AR education application
KR101323148B1 (en) Ucr contents editor device
CN113518256A (en) Video processing method and device, electronic equipment and computer readable storage medium
US20230405452A1 (en) Method for controlling game display, non-transitory computer-readable storage medium and electronic device
CN115564642B (en) Image conversion method, image conversion device, electronic apparatus, storage medium, and program product
CN116543082A (en) Digital person generation method and device and digital person generation system
CN109815557B (en) Robot model display method and device and intelligent terminal
CN113935868A (en) Multi-courseware teaching demonstration system based on Unity3D engine
CN109725792B (en) Question-answer interaction-based drawing method
CN111167119A (en) Game development display method, device, equipment and storage medium
KR102026857B1 (en) 3D printing system using 3D modeling authoring tool based on VR technology
CN112435316B (en) Method and device for preventing mold penetration in game, electronic equipment and storage medium
US11928762B2 (en) Asynchronous multi-user real-time streaming of web-based image edits using generative adversarial network(s)
CN115797517A (en) Data processing method, device, equipment and medium of virtual model
CN113628324A (en) Wisdom highway VR interactive teaching system
JPH1166351A (en) Method and device for controlling object operation inside three-dimensional virtual space and recording medium recording object operation control program
US20240062497A1 (en) Method and system for generating virtual content
WO2023173833A1 (en) Virtual scene parameter processing methods and apparatuses, electronic device, computer readable storage medium, and computer program product
CN115202624A (en) Full-real scene construction system, method, electronic equipment and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22913342

Country of ref document: EP

Kind code of ref document: A1