WO2018149042A1 - 虚拟操作界面的控制方法、装置及存储介质 - Google Patents

虚拟操作界面的控制方法、装置及存储介质 Download PDF

Info

Publication number
WO2018149042A1
WO2018149042A1 PCT/CN2017/085224 CN2017085224W WO2018149042A1 WO 2018149042 A1 WO2018149042 A1 WO 2018149042A1 CN 2017085224 W CN2017085224 W CN 2017085224W WO 2018149042 A1 WO2018149042 A1 WO 2018149042A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
operation interface
power device
virtual operation
real time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/085224
Other languages
English (en)
French (fr)
Inventor
徐敏
彭林
李尼格
韩海韵
于海
侯战胜
何志敏
王刚
鲍兴川
王鹤
朱亮
张泽浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Global Energy Interconnection Research Institute Co Ltd
State Grid Corp of China SGCC
Original Assignee
Global Energy Interconnection Research Institute Co Ltd
State Grid Corp of China SGCC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Global Energy Interconnection Research Institute Co Ltd, State Grid Corp of China SGCC filed Critical Global Energy Interconnection Research Institute Co Ltd
Publication of WO2018149042A1 publication Critical patent/WO2018149042A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items

Definitions

  • the present invention relates to the field of power device interaction technologies, and in particular, to a method, an apparatus, and a storage medium for controlling a virtual operation interface.
  • PDAs Personal Digital Assistant
  • the hands of the field workers can be liberated, and the operators can provide intuitive and convenient operation guidance and collaborative support, improve the quality, efficiency and safe operation level of the grid on-site work, and help improve the health of the grid equipment.
  • the technical problem to be solved by the present invention is how to reduce the cost of a wearable device applied to the operation of a power device.
  • an embodiment of the present invention provides a method for controlling a virtual operation interface, where the virtual operation interface is a virtual operation interface corresponding to a power device, and the method includes: acquiring an image of the power device in real time; Obtaining a movement trajectory of the preset positioning point of the power device in an image of the power device acquired in real time; and selecting an operation button in the virtual operation interface according to the movement trajectory.
  • a selected cursor that moves in synchronization with the preset positioning point is included in the virtual operation interface
  • the selecting an operation button in the virtual operation interface according to the movement trajectory includes:
  • the selecting the operation button in the virtual operation interface according to the movement trajectory further includes: returning to the real-time acquiring image of the power device when the movement does not stop for a predetermined period of time A step of.
  • the acquiring the image of the power device in real time comprises acquiring an image of the power device in real time through an image capturing device (such as a camera) linked with an action of a target object (such as a user).
  • an image capturing device such as a camera
  • the embodiment of the present invention further provides a control device for a virtual operation interface, the device includes: an image acquisition unit configured to acquire an image of the power device in real time;
  • a trajectory obtaining unit configured to acquire the image in an image of the power device acquired in real time a movement trajectory of the preset positioning point of the power device
  • the button selection unit is configured to select an operation button in the virtual operation interface according to the movement trajectory.
  • the virtual operation interface includes a selected cursor that moves in synchronization with the preset positioning point
  • the operation button selection unit includes:
  • a cursor stop determination subunit configured to determine whether the movement of the selected cursor has stopped for a predetermined length of time
  • a cursor position determining subunit configured to determine whether the selected cursor is located on an operation button in the virtual operation interface when the movement has stopped for a predetermined period of time
  • the button selection subunit is configured to select the operation button when the selected cursor is located on an operation button in the virtual operation interface.
  • the cursor position determining subunit is further configured to trigger the image acquiring unit to perform the operation of acquiring the image of the power device in real time when the moving does not stop for a predetermined period of time.
  • the button selection subunit is further configured to trigger the image acquisition unit to perform the real-time acquisition of the power device when the selected cursor is not located on an operation button in the virtual operation interface. The operation of the image.
  • the image acquisition unit is further configured to acquire an image of the power device in real time by an image capture device linked to the action of the target object.
  • the embodiment of the invention further provides a control device for a virtual operation interface, comprising: a processor and a memory configured to store a computer program capable of running on the processor,
  • the processor is configured to execute the control method of the virtual operation interface when the computer program is run.
  • the embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores a computer program configured to execute the control method of the virtual operation interface.
  • the method, device and storage medium for controlling a virtual operation interface acquires a movement trajectory of a preset positioning point in an image of the power device by using an image recognition technology, and according to the movement trajectory, the virtual operation Select the operation button in the interface, which can omit the sensor and reduce the product cost.
  • FIG. 1 is a schematic flowchart of a method for controlling a virtual operation interface corresponding to a power device according to Embodiment 1 of the present invention
  • FIG. 2 is a schematic flowchart of a method for controlling a virtual operation interface corresponding to a power device according to Embodiment 2 of the present invention
  • FIG. 3 is a schematic structural diagram of a control apparatus of a virtual operation interface corresponding to a power device according to Embodiment 3 of the present invention.
  • FIG. 4 is a schematic structural diagram of a structure of a button selection unit in a device according to Embodiment 3 of the present invention.
  • a method for controlling a virtual operation interface corresponding to a power device includes:
  • an image of the power device may be acquired by an image capture device (eg, a camera-camera) that is linked to the action of a target object (eg, a user).
  • the image capturing device linked to the action of the target object is, for example, an augmented reality (AR) helmet or glasses.
  • AR augmented reality
  • the power device can be identified by a remote image recognition system and a preset location of the power device can be obtained.
  • an image template of the power device may be stored in advance, and the image of the power device acquired in real time is compared with the template to obtain a template with the highest matching degree, thereby identifying the power device.
  • the preset positioning point of the power device is a reference point for acquiring an image movement trajectory, which should be easily recognized by the image recognition system and easy to track. Obtaining a movement trajectory of the preset positioning point, for example, by using the coordinates of the preset positioning point in each frame image acquired in sequence, and connecting the coordinates according to the acquired time sequence, the movement trajectory of the image, that is, the user's Movement track.
  • a selected cursor that moves in synchronization with the preset positioning point may be set in the virtual operation interface, and the selected operation button is implemented by using the selected cursor.
  • the virtual operation interface may include a plurality of operation buttons, and there is no limitation on the layout of the operation buttons.
  • One of the operation buttons may be the default button of the device, that is, the position where the cursor is originally located.
  • the control method of the virtual operation interface corresponding to the power device of the embodiment obtains the movement track of the preset positioning point in the image of the power device by using the image recognition technology, and selects the virtual operation interface according to the movement track. By operating the buttons, the sensor can be omitted and the cost of the product is reduced.
  • step S13 is further refined to obtain an embodiment as shown in FIG. 2, including:
  • each frame of the image is time-dependent, it is determined whether the movement stops for a predetermined period of time, and it is only necessary to determine whether the anchor point has not changed in a continuous predetermined number of images.
  • the acquisition of the image may be taken at a certain frequency, for example 2 frames/second; the predetermined duration may be set to 1 second or more, preferably 3 seconds.
  • the operation button is a collection of pixels, each pixel has its specific coordinates, and the selected cursor is also a collection of pixels, each pixel also having its specific coordinates. It may be arranged that when the selected cursor coincides with the coordinates of a predetermined number of pixel points of the operation button, the selected cursor may be considered to be located on the operation button.
  • a technical means for selecting a virtual button is provided by sequentially determining the stop time and the location of the selected cursor.
  • the process returns to step S21.
  • the process when the movement has not stopped for a predetermined period of time, the process returns to step S21.
  • control device of the virtual operation interface corresponding to the power device provided by the embodiment of the present invention includes:
  • the image acquisition unit 1 is configured to acquire an image of the power device in real time; in an embodiment, the image acquisition unit acquires an image of the power device in real time through an image acquisition device that is linked with the action of the target object.
  • the image acquisition device is for example an AR helmet or glasses.
  • the trajectory obtaining unit 2 is configured to acquire a movement trajectory of the preset positioning point of the power device in an image of the power device acquired in real time;
  • the button selection unit 3 is configured to select an operation button in the virtual operation interface according to the movement trajectory.
  • the trajectory acquiring unit 2 acquires the movement trajectory of the preset positioning point of the power device by using the image recognition technology, and selects an operation button in the virtual operation interface according to the movement trajectory by using the button selection unit, thereby not
  • the selection of an operation button in the virtual operation interface is realized by requiring a specific sensor.
  • the button selection unit 3 includes:
  • the cursor stop determination sub-unit 31 is configured to determine whether the movement of the selected cursor has stopped for a predetermined period of time
  • the cursor position determining sub-unit 32 is configured to determine whether the selected cursor is located on an operation button in the virtual operation interface when the movement has stopped for a predetermined period of time;
  • the button selection sub-unit 33 is configured to select the operation button when the selected cursor is located on the operation button in the virtual operation interface.
  • the cursor position determining sub-unit 32 is further configured to trigger the image acquiring unit to perform the operation of acquiring the image of the power device in real time when the moving does not stop for a predetermined period of time.
  • the button selection sub-unit 33 is further configured to trigger the image acquisition unit to perform the real-time acquisition when the selected cursor is not located on an operation button in the virtual operation interface. The operation of the image of the power device.
  • each unit in the control device of the virtual operation interface may be processed by a central processing unit (CPU), a microprocessor (Micro Processor Unit (MPU), and a digital signal processing located in a terminal or a server. (Digital Signal Processor, DSP), or Field Programmable Gate Array (FPGA) implementation.
  • CPU central processing unit
  • MPU Micro Processor Unit
  • DSP Digital Signal Processor
  • FPGA Field Programmable Gate Array
  • the embodiment of the invention further provides a control device for a virtual operation interface, the virtual operation
  • the interface corresponds to a power device, the device comprising: a processor and a memory configured to store a computer program executable on the processor,
  • processor is configured to execute the computer program, executing:
  • an operation button is selected in the virtual operation interface.
  • the processor is further configured to: when the computer program is executed, execute:
  • the operation button is selected when the selected cursor is located on an operation button in the virtual operation interface.
  • the processor is further configured to execute when the computer program is executed:
  • the operation of acquiring an image of the power device in real time is performed when the selected cursor is not located on an operation button in the virtual operation interface.
  • the processor is further configured to execute when the computer program is executed:
  • the operation of acquiring an image of the power device in real time is performed when the movement is not stopped for a predetermined period of time.
  • the processor is further configured to execute when the computer program is executed:
  • the image of the power device is acquired in real time by an image capture device linked to the action of the target object.
  • control method of the virtual operation interface is implemented in the form of a software function module, and is sold or used as an independent product, it may also be stored in one computer. Readable in storage media.
  • the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions.
  • a computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read only memory (ROM), a magnetic disk, or an optical disk.
  • program codes such as a USB flash drive, a mobile hard disk, a read only memory (ROM), a magnetic disk, or an optical disk.
  • an embodiment of the present invention further provides a computer storage medium storing a computer program configured to execute the control method of the virtual operation interface.
  • the embodiment of the present invention acquires an image of the power device corresponding to the virtual operation interface in real time; acquires a movement trajectory of the preset positioning point of the power device in the image of the power device acquired in real time; according to the movement trajectory, The operation button is selected in the virtual operation interface. In this way, it is possible to omit the sensor and reduce the product cost.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

本发明公开了一种虚拟操作界面的控制方法、装置及存储介质，其中，所述方法包括：实时获取所述电力设备的图像；在实时获取的所述电力设备的图像中获取所述电力设备的预设定位点的移动轨迹；根据所述移动轨迹，在所述虚拟操作界面中选择操作按键。由此，通过图像识别技术，在电力设备的图像中获取预设定位点的移动轨迹，并根据所述移动轨迹，在所述虚拟操作界面中选择操作按键，从而可以省略传感器，降低了产品成本。

Description

虚拟操作界面的控制方法、装置及存储介质
相关申请的交叉引用
本申请基于申请号为201710084260.5、申请日为2017年02月16日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本发明涉及电力设备交互技术领域，尤其涉及虚拟操作界面的控制方法、装置及存储介质。
背景技术
在电网设备制造安装现场作业方面，新型设备、大型设备不断涌现，制造安装作业的执行环节更加复杂，步骤流程及精确度要求更高，复杂度大大提高，作为设备全生命周期的重要环节，传统的制造安装作业方法难以适应现场作业要求，作业效率低、质量难以保证；在电网设备的运维检修作业方面，现场人员难以快速全面掌握设备信息及运行趋势，标准化作业指导卡与实际操作没有实现无缝衔接，工作模式有待改进。通过基建和运检移动应用，虽然可以应用手机、掌上电脑(PDA，Personal Digital Assistant)实现部分现场信息的实时采集、同步及分析，但在交互上占用双手，现场作业指导协作能力较弱。
通过可穿戴设备的应用，可以解放现场作业人员的双手，为作业人员提供直观便捷的作业指导和协作支持，提升电网现场作业工作质量、效率及安全作业水平，辅助提升电网设备健康水平。
然而，现有的可穿戴设备，往往需要通过特有的传感器以检测用户的动作，增加了产品成本。
发明内容
有鉴于此，本发明要解决的技术问题在于，如何降低应用于电力设备操作的可穿戴设备的成本。
为了解决上述问题，本发明实施例提供一种虚拟操作界面的控制方法，所述虚拟操作界面为与电力设备相对应的虚拟操作界面，所述方法包括：实时获取所述电力设备的图像；在实时获取的所述电力设备的图像中获取所述电力设备的预设定位点的移动轨迹；根据所述移动轨迹，在所述虚拟操作界面中选择操作按键。
上述方案中，在所述虚拟操作界面中包括与所述预设定位点同步移动的选定光标；
所述根据所述移动轨迹，在所述虚拟操作界面中选择操作按键包括：
判断所述移动是否已停止预定时长；当所述移动已停止预定时长时，判断所述选定光标是否位于所述虚拟操作界面中的操作按键上；当所述选定光标位于所述虚拟操作界面中的操作按键上时，选择所述操作按键。
上述方案中，当所述选定光标未位于所述虚拟操作界面中的操作按键上时，返回至所述实时获取所述电力设备的图像的步骤。
上述方案中，所述根据所述移动轨迹，在所述虚拟操作界面中选择所述操作按键，还包括：当所述移动未停止预定时长时，返回至所述实时获取所述电力设备的图像的步骤。
上述方案中，所述实时获取所述电力设备的图像包括：通过与目标对象(如用户)的动作联动的图像采集装置(如摄像头)，实时获取所述电力设备的图像。
本发明实施例还提供了一种虚拟操作界面的控制装置，该装置包括：图像获取单元，配置为实时获取所述电力设备的图像；
轨迹获取单元，配置为在实时获取的所述电力设备的图像中获取所述 电力设备的所述预设定位点的移动轨迹；
按键选择单元，配置为根据所述移动轨迹，在所述虚拟操作界面中选择操作按键。
上述方案中，在所述虚拟操作界面中包括与所述预设定位点同步移动的选定光标，所述操作按键选择单元包括：
光标停止判断子单元，配置为判断所述选定光标的移动是否已停止预定时长；
光标位置判断子单元，配置为当所述移动已停止预定时长时，判断所述选定光标是否位于所述虚拟操作界面中的操作按键上；
按键选择子单元，配置为当所述选定光标位于所述虚拟操作界面中的操作按键上时，选择所述操作按键。
上述方案中，所述光标位置判断子单元，还配置为当所述移动未停止预定时长时，触发所述图像获取单元执行所述实时获取所述电力设备的图像的操作。
上述方案中，所述按键选择子单元，还配置为当所述选定光标未位于所述虚拟操作界面中的操作按键上时，触发所述图像获取单元执行所述实时获取所述电力设备的图像的操作。
上述方案中，所述图像获取单元，还配置为通过与目标对象的动作联动的图像采集装置，实时获取所述电力设备的图像。
本发明实施例还提供了一种虚拟操作界面的控制装置，包括：处理器和配置为存储能够在处理器上运行的计算机程序的存储器，
其中，所述处理器配置为运行所述计算机程序时，执行上述虚拟操作界面的控制方法。
本发明实施例还提供了一种计算机存储介质，所述计算机存储介质存储有计算机程序，该计算机程序配置为执行上述虚拟操作界面的控制方法。
本发明实施例提供的虚拟操作界面的控制方法、装置及存储介质，通过图像识别技术，在电力设备的图像中获取预设定位点的移动轨迹，并根据所述移动轨迹，在所述虚拟操作界面中选择操作按键，从而可以省略传感器，降低了产品成本。
附图说明
图1为本发明实施例1的与电力设备相对应的虚拟操作界面的控制方法的流程示意图；
图2为本发明实施例2的与电力设备相对应的虚拟操作界面的控制方法的流程示意图；
图3为本发明实施例3的与电力设备相对应的虚拟操作界面的控制装置的结构示意图；
图4为本发明实施例3的装置中按键选择单元的组成结构示意图。
具体实施方式
下面结合附图对本发明的具体实施方式进行详细说明。应当理解的是，此处所描述的具体实施方式仅用于说明和解释本发明，并不用于限制本发明。
实施例1
如图1所示，本发明实施例的与电力设备相对应的虚拟操作界面的控制方法，包括：
S11：实时获取电力设备的图像；
在一实施例中，可以通过与目标对象(如用户)的动作联动的图像采集装置(如摄像装置-摄像头)，获取电力设备的图像。该与目标对象的动作联动的图像采集装置例如是增强现实(AR，Augmented Reality)头盔或眼镜。
S12：在实时获取的该电力设备的图像中获取该电力设备的预设定位点 的移动轨迹；
在一实施例中，可以通过远程图像识别系统来识别该电力设备并获取该电力设备的预设定位点。例如，可以预先存储电力设备的图像模版，通过将实时获取的电力设备的图像与模版进行相似度比较，获取匹配度最高的模版，从而识别出电力设备。电力设备的预设定位点是用于获取图像移动轨迹的参考点，应当容易被图像识别系统所识别并易于追踪。获取该预设定位点的移动轨迹，例如可以通过依次获取的每一帧图像中的预设定位点的坐标，将这些坐标按照获取的时间顺序连接，就可以得到图像的移动轨迹，即用户的运动轨迹。
S13：根据该移动轨迹，在该虚拟操作界面中选择操作按键。
在一实施例中，可以在虚拟操作界面中设置与该预设定位点同步移动的选定光标，利用该选定光标来实现选择操作按键。该虚拟操作界面中可以包括多个操作按键，对操作按键的布局没有限制，其中一个操作按键可以被设备为默认按键，即定位光标最初所在的位置。
本实施例的与电力设备相对应的虚拟操作界面的控制方法，通过图像识别技术，在电力设备的图像中获取预设定位点的移动轨迹，并根据该移动轨迹，在该虚拟操作界面中选择操作按键，从而可以省略传感器，降低了产品成本。
实施例2
在实施例1的基础上，对步骤S13进一步的细化，获得如图2所示的实施例，包括：
S21：实时获取电力设备的图像；
S22：在实时获取的该电力设备的图像中获取该电力设备的预设定位点的移动轨迹；
S23：判断该移动是否已停止预定时长；
在一实施例中，由于每一帧图像是时间相关的，判断移动是否停止预定时长，只需要判断定位点是否在连续的预定数量的图像中没有变化即可。图像的获取可以以一定频率拍摄，例如2帧/秒；该预定时长可以设置为1秒以上，优选为3秒。
S24：当该移动已停止预定时长时，判断该选定光标是否位于该虚拟操作界面中的操作按键上；
在一实施例中，操作按键为一个像素点的集合，每个像素点有其特定的坐标，选定光标也是一个像素点的集合，每个像素点也有其特定的坐标。可以设置为，当选定光标与操作按键的预定数量的像素点的坐标重合时，可以认为选定光标位于该操作按键上。
S25：当该选定光标位于该虚拟操作界面中的操作按键上时，选择该操作按键。
本实施例通过依次判断选定光标的停止时间和所在位置，提供了一种选定虚拟按键的技术手段。
在一实施例中，当该选定光标未位于该虚拟操作界面中的操作按键上时，返回至步骤S21。
在一实施例中，当该移动未停止预定时长时，返回至步骤S21。
实施例3
如图3所示，本发明实施例提供的与电力设备相对应的虚拟操作界面的控制装置，包括：
图像获取单元1，配置为实时获取电力设备的图像；在一实施例中，该图像获取单元通过与目标对象的动作联动的图像采集装置，实时获取该电力设备的图像。所述图像采集装置例如是AR头盔或眼镜。
轨迹获取单元2，配置为在实时获取的该电力设备的图像中获取该电力设备的该预设定位点的移动轨迹；
按键选择单元3，配置为根据该移动轨迹，在该虚拟操作界面中选择操作按键。
本实施例通过利用图像识别技术，通过该轨迹获取单元2获取电力设备的预设定位点的移动轨迹，并通过按键选择单元来根据该移动轨迹，在该虚拟操作界面中选择操作按键，从而不需要特定的传感器就实现了在虚拟操作界面中选择操作按键。
在一实施例中，如图4所示，该按键选择单元3包括：
光标停止判断子单元31，配置为判断该选定光标的移动是否已停止预定时长；
光标位置判断子单元32，配置为当该移动已停止预定时长时，判断该选定光标是否位于该虚拟操作界面中的操作按键上；
按键选择子单元33，配置为当该选定光标位于该虚拟操作界面中的操作按键上时，选择该操作按键。
在一实施例中，所述光标位置判断子单元32，还配置为当所述移动未停止预定时长时，触发所述图像获取单元执行所述实时获取所述电力设备的图像的操作。
在一实施例中，所述按键选择子单元33，还配置为当所述选定光标未位于所述虚拟操作界面中的操作按键上时，触发所述图像获取单元执行所述实时获取所述电力设备的图像的操作。
在实际应用中，所述虚拟操作界面的控制装置中的各个单元均可由位于终端或服务器中的中央处理器(Central Processing Unit，CPU)、微处理器(Micro Processor Unit，MPU)、数字信号处理器(Digital Signal Processor，DSP)、或现场可编程门阵列(Field Programmable Gate Array，FPGA)等实现。
本发明实施例还提供了一种虚拟操作界面的控制装置，所述虚拟操作 界面与电力设备相对应，所述装置包括：处理器和配置为存储能够在处理器上运行的计算机程序的存储器，
其中，所述处理器配置为运行所述计算机程序时，执行：
实时获取所述电力设备的图像；
在实时获取的所述电力设备的图像中获取所述电力设备的预设定位点的移动轨迹；
根据所述移动轨迹，在所述虚拟操作界面中选择操作按键。
在所述虚拟操作界面中包括与所述预设定位点同步移动的选定光标；所述处理器还配置为运行所述计算机程序时，执行：
判断所述移动是否已停止预定时长；
当所述移动已停止预定时长时，判断所述选定光标是否位于所述虚拟操作界面中的操作按键上；
当所述选定光标位于所述虚拟操作界面中的操作按键上时，选择所述操作按键。
所述处理器还配置为运行所述计算机程序时，执行：
当所述选定光标未位于所述虚拟操作界面中的操作按键上时，执行所述实时获取所述电力设备的图像的操作。
所述处理器还配置为运行所述计算机程序时，执行：
当所述移动未停止预定时长时，执行所述实时获取所述电力设备的图像的操作。
所述处理器还配置为运行所述计算机程序时，执行：
通过与目标对象的动作联动的图像采集装置，实时获取所述电力设备的图像。
本发明实施例中，如果以软件功能模块的形式实现上述虚拟操作界面的控制方法，并作为独立的产品销售或使用时，也可以存储在一个计算机 可读取存储介质中。基于这样的理解，本发明实施例的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机、服务器、或者网络设备等)执行本发明各个实施例所述方法的全部或部分。而前述的存储介质包括：U盘、移动硬盘、只读存储器(Read Only Memory，ROM)、磁碟或者光盘等各种可以存储程序代码的介质。这样，本发明实施例不限制于任何特定的硬件和软件结合。
相应地，本发明实施例还提供了一种计算机存储介质，所述计算机存储介质存储有计算机程序，该计算机程序配置为执行上述虚拟操作界面的控制方法。
显然，上述实施例仅仅是为清楚地说明所作的举例，而并非对实施方式的限定。对于所属领域的普通技术人员来说，在上述说明的基础上还可以做出其它不同形式的变化或变动。这里无需也无法对所有的实施方式予以穷举。而由此所引伸出的显而易见的变化或变动仍处于本发明创造的保护范围之中。
工业实用性
本发明实施例实时获取与虚拟操作界面相对应的电力设备的图像；在实时获取的所述电力设备的图像中获取所述电力设备的预设定位点的移动轨迹；根据所述移动轨迹，在所述虚拟操作界面中选择操作按键。如此，能够可以省略传感器，降低产品成本。

Claims (12)

  1. 一种虚拟操作界面的控制方法，所述虚拟操作界面与电力设备相对应，所述方法包括：
    实时获取所述电力设备的图像；
    在实时获取的所述电力设备的图像中获取所述电力设备的预设定位点的移动轨迹；
    根据所述移动轨迹，在所述虚拟操作界面中选择操作按键。
  2. 根据权利要求1所述的方法，其中，在所述虚拟操作界面中包括与所述预设定位点同步移动的选定光标；
    所述根据所述移动轨迹，在所述虚拟操作界面中选择操作按键包括：
    判断所述移动是否已停止预定时长；
    当所述移动已停止预定时长时，判断所述选定光标是否位于所述虚拟操作界面中的操作按键上；
    当所述选定光标位于所述虚拟操作界面中的操作按键上时，选择所述操作按键。
  3. 根据权利要求2所述的方法，其中，当所述选定光标未位于所述虚拟操作界面中的操作按键上时，执行所述实时获取所述电力设备的图像的操作。
  4. 根据权利要求2所述的方法，其中，所述根据所述移动轨迹，在所述虚拟操作界面中选择操作按键，还包括：
    当所述移动未停止预定时长时，执行所述实时获取所述电力设备的图像的操作。
  5. 根据权利要求1至4任一项所述的方法，其中，所述实时获取所述电力设备的图像，包括：
    通过与目标对象的动作联动的图像采集装置，实时获取所述电力设备 的图像。
  6. 一种虚拟操作界面的控制装置，所述虚拟操作界面与电力设备相对应，所述装置包括：
    图像获取单元，配置为实时获取所述电力设备的图像；
    轨迹获取单元，配置为在实时获取的所述电力设备的图像中获取所述电力设备的所述预设定位点的移动轨迹；
    按键选择单元，配置为根据所述移动轨迹，在所述虚拟操作界面中选择操作按键。
  7. 根据权利要求6所述的装置，其中，在所述虚拟操作界面中包括与所述预设定位点同步移动的选定光标；所述按键选择单元包括：
    光标停止判断子单元，配置为判断所述选定光标的移动是否已停止预定时长；
    光标位置判断子单元，配置为当所述移动已停止预定时长时，判断所述选定光标是否位于所述虚拟操作界面中的操作按键上；
    按键选择子单元，配置为当所述选定光标位于所述虚拟操作界面中的操作按键上时，选择所述操作按键。
  8. 根据权利要求7所述的装置，其中，
    所述光标位置判断子单元，还配置为当所述移动未停止预定时长时，触发所述图像获取单元执行所述实时获取所述电力设备的图像的操作。
  9. 根据权利要求7所述的装置，其中，
    所述按键选择子单元，还配置为当所述选定光标未位于所述虚拟操作界面中的操作按键上时，触发所述图像获取单元执行所述实时获取所述电力设备的图像的操作。
  10. 根据权利要求6至9任一项所述的装置，其中，所述图像获取单元还配置为，通过与目标对象的动作联动的图像采集装置，实时获取所述 电力设备的图像。
  11. 一种虚拟操作界面的控制装置，所述虚拟操作界面与电力设备相对应，所述装置包括：处理器和用于存储能够在处理器上运行的计算机程序的存储器；其中，所述处理器用于运行所述计算机程序时，执行权利要求1至5任一项所述的虚拟操作界面的控制方法。
  12. 一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，该计算机可执行指令用于执行权利要求1至5任一项所述的虚拟操作界面的控制方法。
PCT/CN2017/085224 2017-02-16 2017-05-19 虚拟操作界面的控制方法、装置及存储介质 Ceased WO2018149042A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710084260.5 2017-02-16
CN201710084260.5A CN106970738A (zh) 2017-02-16 2017-02-16 一种与电力设备相对应的虚拟操作界面的交互方法和装置

Publications (1)

Publication Number Publication Date
WO2018149042A1 true WO2018149042A1 (zh) 2018-08-23

Family

ID=59335199

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/085224 Ceased WO2018149042A1 (zh) 2017-02-16 2017-05-19 虚拟操作界面的控制方法、装置及存储介质

Country Status (2)

Country Link
CN (1) CN106970738A (zh)
WO (1) WO2018149042A1 (zh)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105955470A (zh) * 2016-04-26 2016-09-21 乐视控股（北京）有限公司 一种头盔显示器的控制方法及装置
CN106200927A (zh) * 2016-06-30 2016-12-07 乐视控股（北京）有限公司 一种信息处理方法及头戴式设备
CN106325505A (zh) * 2016-08-17 2017-01-11 传线网络科技（上海）有限公司 基于视点跟踪的控制方法和装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104238729A (zh) * 2013-06-20 2014-12-24 深圳富泰宏精密工业有限公司 体感控制实现方法及系统
CN105702098B (zh) * 2016-04-22 2019-11-29 广东小天才科技有限公司 一种基于虚拟现实的化学实验方法、装置及系统
CN106095235B (zh) * 2016-06-07 2018-05-08 腾讯科技（深圳）有限公司 基于虚拟现实的控制方法和装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105955470A (zh) * 2016-04-26 2016-09-21 乐视控股（北京）有限公司 一种头盔显示器的控制方法及装置
CN106200927A (zh) * 2016-06-30 2016-12-07 乐视控股（北京）有限公司 一种信息处理方法及头戴式设备
CN106325505A (zh) * 2016-08-17 2017-01-11 传线网络科技（上海）有限公司 基于视点跟踪的控制方法和装置

Also Published As

Publication number Publication date
CN106970738A (zh) 2017-07-21

Similar Documents

Publication Publication Date Title
US12301650B2 (en) Content collection navigation and autoforwarding
CN109635621B (zh) 用于第一人称视角中基于深度学习识别手势的系统和方法
US9881094B2 (en) Systems and methods for automated local story generation and curation
US12482023B2 (en) Media collection navigation with opt-out interstitial
US20160171773A1 (en) Display control method, information processing apparatus, and storage medium
JPWO2014021004A1 (ja) 画像処理システム、画像処理方法、及びプログラム
CN108876934A (zh) 关键点标注方法、装置和系统及存储介质
JP5266416B1 (ja) テストシステム及びテストプログラム
CN115100689A (zh) 一种对象检测方法、装置、电子设备和存储介质
JP2017118319A (ja) 映像検索システム
US10541006B2 (en) Information processor, information processing method, and program
US9727778B2 (en) System and method for guided continuous body tracking for complex interaction
WO2018149042A1 (zh) 虚拟操作界面的控制方法、装置及存储介质
CN119045655A (zh) 一种智能戒指的人机交互方法、装置、设备及存储介质
US20150092046A1 (en) Information processing method, system and electronic device
TW201621651A (zh) 滑鼠模擬系統及方法
JP2014170367A (ja) 物体検出装置、物体検出方法、物体検出システム及びプログラム
JP7766886B1 (ja) 情報処理システム、情報処理方法、学習モデルの生成方法、及びコンピュータプログラム
JP7825241B1 (ja) コンピュータプログラム、情報処理方法、及び情報処理システム
CN105487655B (zh) 信息处理方法及相关电子设备
CN111782457A (zh) 机械运动模块的控制方法及装置、存储介质
CN108134901A (zh) 一种用于搜题的拍照方法及移动终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17896895

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17896895

Country of ref document: EP

Kind code of ref document: A1