WO2020238267A1 - 一种用于动作模仿的方法、存储介质及系统 - Google Patents

一种用于动作模仿的方法、存储介质及系统 Download PDF

Info

Publication number
WO2020238267A1
WO2020238267A1 PCT/CN2020/073080 CN2020073080W WO2020238267A1 WO 2020238267 A1 WO2020238267 A1 WO 2020238267A1 CN 2020073080 W CN2020073080 W CN 2020073080W WO 2020238267 A1 WO2020238267 A1 WO 2020238267A1
Authority
WO
WIPO (PCT)
Prior art keywords
magic mirror
display device
imitator
mirror interface
action
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2020/073080
Other languages
English (en)
French (fr)
Inventor
王佳敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Skyworth RGB Electronics Co Ltd
Original Assignee
Shenzhen Skyworth RGB Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Skyworth RGB Electronics Co Ltd filed Critical Shenzhen Skyworth RGB Electronics Co Ltd
Publication of WO2020238267A1 publication Critical patent/WO2020238267A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42201—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4221—Dedicated function buttons, e.g. for the control of an EPG, subtitles, aspect ratio, picture-in-picture or teletext
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42224—Touch pad or touch panel provided on the remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Definitions

  • the present disclosure relates to the field of mixed reality technology, and in particular to a method, storage medium, and system for motion simulation.
  • the technical problem to be solved by the present disclosure is to provide a method, storage medium and system for action imitation in view of the above-mentioned defects of the prior art, aiming to solve the problem of checking individual imitation when performing action imitation and learning in the prior art. It is difficult to compare the effects of learning.
  • a method for action imitation which includes the steps:
  • the actions of the imitator are displayed in the magic mirror interface according to the action data.
  • the step of acquiring the motion data of the imitator located in front of the display device through a camera associated with the magic mirror interface specifically includes:
  • the camera associated with the magic mirror interface is detected, and when the camera is detected, the motion data of the imitator located in front of the display device is acquired, and the motion data is returned to the display device.
  • the magic mirror interface is suspended on the interface of the display device.
  • the method for motion imitation wherein, when the camera does not obtain the motion data of the imitator within a predetermined time, the magic mirror interface is on standby or closed.
  • the method for motion simulation wherein the camera associated with the magic mirror interface is detected, and an error prompt is issued when the camera is not detected.
  • the error prompt is a text prompt and/or a voice prompt.
  • the area of the magic mirror interface is smaller than the interface area of the display device.
  • the imitation object of the imitator is an object displayed in the display device.
  • the display device is any one of a TV, a computer, or a PAD.
  • the camera is an upper camera fixedly arranged on the display device or an external mobile camera.
  • the imitation object of the imitator is an object in the head of the imitator.
  • the magic mirror interface has an action scoring function.
  • a storage medium having a plurality of instructions stored thereon, wherein the instructions are suitable for one or more processors to load and execute the method described above.
  • a system for action simulation which includes:
  • the camera associated with the magic mirror interface is used to obtain the motion data of the imitator located in front of the display device;
  • the actions of the imitator are displayed in the magic mirror interface according to the action data.
  • Beneficial effects by capturing the motion of the imitator in real time with the help of a camera, the obtained motion data is transmitted back to the display device, and finally the motion of the imitator is displayed in the mirror interface in a mirror manner.
  • users can imitate and learn actions while facing the object to be imitated played in the interface of the display device.
  • they can also detect and compare the effects of imitation and learning through the magic mirror interface, realizing the imitator and the display Synchronization of behavior and action imitation and learning in the imitated object in the device. It solves the problem of difficulty in checking individual imitation and learning contrast when performing imitation and learning of actions such as makeup, sports and fitness, entertainment, education, games, etc. played in the reference display device.
  • Fig. 1 is a flowchart of a preferred embodiment of a method for action imitation provided by an embodiment of the present disclosure.
  • Fig. 2 is a view of a specific application scenario of a method for action imitation provided by an embodiment of the present disclosure.
  • Fig. 3 is a block diagram of a preferred embodiment of a motion simulation system provided by an embodiment of the present disclosure.
  • FIGS. 1-2 Please also refer to FIGS. 1-2.
  • the present disclosure provides some embodiments of a method for motion simulation.
  • the method for action imitation of the present disclosure includes the following steps:
  • the display device may be an electronic device such as a television, a desktop computer, a notebook computer, or a PAD.
  • a television is used as a display device to explain the present disclosure, and is not used to limit the present disclosure.
  • the magic mirror interface refers to a window used to display pictures captured by a camera, and the window is independently displayed on the interface of the display device (that is, suspended), and the magic mirror is a small application that is installed In the display device, the application can be loaded and called through the display device.
  • the display device may be turned on by means of physical buttons, such as a remote control or a physical button on the display device, or may be turned on by a mobile terminal such as a voice mode or a mobile terminal previously bound with the display device.
  • the opening mode of the magic mirror interface may be by voice or by pressing a physical button set on the remote control. In the present disclosure, it is preferable to open the Magic Mirror application through a voice command and enter the Magic Mirror interface, which is convenient for the user to use.
  • the magic mirror interface is associated with a camera
  • the camera may be an original display device, such as a TV with a camera.
  • the camera can also be an external mobile camera.
  • the camera is a camera with an infrared function, which can provide the action of the imitator in various periods of time.
  • the step S200 specifically includes: detecting a camera associated with the magic mirror interface, and when the camera is detected, acquiring the imitator's image in front of the display device Action data. That is, after the magic mirror is turned on through the voice command, the display device needs to detect the camera associated with the magic mirror interface. Only when the camera can be found, can it enter the magic mirror interface, and obtain the front of the display device through the camera in real time (the magic mirror). The motion data of the imitator in front of the mirror interface). That is to use the camera's camera function to track and record the movement of the imitator, and record the actions of the imitator completely.
  • the magic mirror interface is suspended on the interface of the television by using the layer overlay technology.
  • the magic mirror interface can be displayed on the four corners of the TV interface, or in the middle of the TV interface or close to the four sides of the TV.
  • the specific location can be adjusted according to the specific situation.
  • the area of the magic mirror interface is much smaller than the screen area of the TV, because the magic mirror interface is suspended on the TV interface, the magic mirror interface is opaque, and the magic mirror interface will block the TV interface where it is . Therefore, by setting the area of the magic mirror interface to be smaller than the area of the TV screen, it is more convenient for the user to perform imitation learning based on the video played in the TV interface.
  • the objects imitated by the imitator can also be in other forms, such as those in the mind, the ones shown by the users nearby, and so on.
  • TV plays can be local media, TV applications or client mirroring, and there is no restriction here.
  • the camera associated with the magic mirror interface uses the streaming media protocol to transmit the data back, and the television system reduces the received return data.
  • Noise processing is used to eliminate noise interference to obtain a more stable and clear action, and then the actions of the imitator are displayed in the magic mirror interface according to the processed return data.
  • an encryption algorithm can also be used to encrypt the data.
  • the involved streaming media protocol technology and encryption algorithm are all existing common technologies. To be applied, the specific technical details of the streaming media protocol technology and the encryption algorithm will not be repeated here.
  • each magic mirror interface has an associated camera.
  • the magic mirror interface when the magic mirror interface is set to two, they are recorded as the first magic mirror interface, the second magic mirror interface, the first magic mirror interface and the second magic mirror interface, which are located on the display device respectively.
  • the first magic mirror interface is at the lower right corner of the TV display screen
  • the second magic mirror interface is at the upper left corner, upper right corner, or lower left corner of the TV.
  • the actions of the imitator displayed on the first magic mirror interface and the second magic mirror interface at the same time are under different viewing angles. For example, the actions of the imitator at a frontal angle are displayed on the first magic mirror interface.
  • What is displayed in the second magic mirror interface is the action of the imitator from the side view angle.
  • the number of magic mirror interfaces when the number of magic mirror interfaces is set to two (corresponding to each magic mirror interface is respectively associated with a camera), they are respectively recorded as the first magic mirror interface, the second magic mirror interface,
  • the first magic mirror interface and the second magic mirror interface are located in different positions of the display device.
  • the first magic mirror interface may be in the lower right corner of the TV display screen
  • the second magic mirror interface may be located on the TV.
  • the actions of the imitators displayed on the first magic mirror interface and the second magic mirror interface are actions made by different imitators, that is, the first magic mirror interface and the second magic mirror interface work independently, It can satisfy two imitators to do imitation at the same time.
  • the magic mirror interface can also be set to more than two, as long as each camera independently obtains the imitation data of the target (imitator), and displays the imitation data on the magic mirror interface associated with the camera. OK.
  • the magic mirror interface may also include an action scoring function.
  • the display device obtains the motion data of the imitated in the display interface as standard data, and at the same time obtains the motion data returned by the camera, that is, the motion data of the imitator in the magic mirror interface as the comparison data, and compares the data with For differences in standard data, give corresponding scores, such as dividing the scores into pass, good, and excellent.
  • the scoring function By setting the scoring function, the imitation comparison of the imitator is made more scientific and reasonable, and the imitator can make the action imitation more targeted according to the rating level given by the magic mirror interface.
  • the system cannot detect the camera or the camera is detected at this time, but the camera is not associated with the magic mirror interface, then An abnormal prompt dialog window pops up on the TV screen, such as prompting the user to detect whether the camera has loose sockets, the TV itself does not have a camera, and the magic mirror interface is not associated with a camera. That is, the camera is faulty, and the task is ended.
  • an abnormal prompt dialog window pops up on the TV screen, such as prompting the user to detect whether the camera has loose sockets, the TV itself does not have a camera, and the magic mirror interface is not associated with a camera. That is, the camera is faulty, and the task is ended.
  • prompting the abnormality in the form of text it can also be broadcast by voice.
  • the magic mirror interface when the camera does not acquire the motion data of the imitator within a predetermined time or the acquired motion data is less, the magic mirror interface is on standby or closed. Putting the magic mirror interface on standby or off can save system resources and save the power consumption of the TV. Monitor the data obtained by the camera. If within the specified time (such as 3 minutes), no impersonator is detected in the data returned by the camera, then the magic mirror interface will enter the standby state or close it directly Magic mirror interface. Among them, the monitoring of the data obtained by the camera is an existing technology, which will not be repeated here.
  • the TV screen is playing fitness videos
  • the magic mirror interface is suspended in the lower right corner of the TV screen.
  • the magic mirror interface displays the mimic actions taken by the camera and the mimic actions.
  • Synchronous display with the video action played on the TV screen that is, the real imitation situation at this moment and the content in the video playback are integrated, which facilitates the comparison and detection of the imitator. Because the screen of the TV is relatively large, the user can more clearly observe whether the imitated movement is in place and whether the movement is deformed. This facilitates the practice of imitators.
  • the magic mirror interface is opened and the magic mirror interface is suspended on the TV.
  • the motion data of the imitator is acquired through the camera, and the motion data is returned, and the motion of the imitator is displayed in the magic mirror interface according to the motion data.
  • the imitation and learning synchronization of behaviors and actions between the imitator and the imitation object in the display device is realized.
  • the present disclosure also provides a storage medium with a plurality of instructions stored on the storage medium, wherein the instructions are suitable for one or more processors to load and execute the above-mentioned action simulation method.
  • the processor may be a central processing unit, microprocessor or other data processing chip.
  • the present disclosure also provides a system for action simulation, as shown in FIG. 3, including: a display device 100;
  • the camera 300 associated with the magic mirror interface 200 is used to obtain the motion data of the imitator located in front of the magic mirror interface;
  • the actions of the imitator are displayed in the magic mirror interface according to the action data.
  • the method loads a magic mirror interface on a display device, and the magic mirror interface is suspended on the display device interface.
  • the camera associated with the magic mirror interface acquires the motion data of the imitator in front of the (display device) magic mirror interface in real time; then the acquired motion data is sent back to the display device, and the display device will follow the
  • the action data displays the actions of the imitator on the magic mirror interface. Therefore, the user can imitate and learn actions against the object to be imitated in the display device interface.
  • the user can check and contrast the imitation effect through the magic mirror interface, which realizes the behavior and actions of the imitator and the imitated object in the display device. Synchronization of imitation and learning. It solves the problem of difficulty in checking individual imitation and learning contrast when performing imitation and learning of actions such as makeup, sports and fitness, entertainment, education, games, etc. played in the reference display device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Closed-Circuit Television Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开公开了一种用于动作模仿的方法、存储介质及系统，其中，所述方法包括步骤：开启显示设备以及魔镜界面；通过与所述魔镜界面相关联的摄像头，实时获取位于所述显示设备前方的模仿者的动作数据；根据所述动作数据将所述模仿者的动作显示在所述魔镜界面中。本公开解决了现有技术中在进行诸如参考显示设备中所播放的化妆、运动健身、娱乐、教育、游戏等动作模仿和学习时，检查个体模仿和学习对比困难的问题。

Description

一种用于动作模仿的方法、存储介质及系统 技术领域
本公开涉及混合现实技术领域，尤其涉及的是一种用于动作模仿的方法、存储介质及系统。
背景技术
目前，随着网络的日益普及，越来越多的用户开始通过网络获取学习资料。用户在进行诸如学习化妆、跟着视频播放的健身视频进行体育锻炼、模仿娱乐节目中演员的声音或动作时，为了检验模仿者的模仿和学习效果需要和标准动作进行比对，通常采用照镜子的方式，即用户对着玻璃镜子进行动作模仿，通过观察玻璃镜子中的镜像来观察所模仿和学习的动作是否到位。通常为了更好的进行对比动作，往往需要将多面玻璃镜子拼接成镜子房，而将多面镜子拼接成镜子房一方面增加了拼接难度，导致造价较高，同时玻璃镜子也容易被碰碎存在安全隐患，另一方面由于模仿者所模仿的动作与视频中所播放的动作不能同步，不便于动作的对比。
因此，现有技术还有待于改进和进一步地发展。
公开内容
本公开所要解决的技术问题在于，针对现有技术的上述缺陷，提供一种用于动作模仿的方法、存储介质及系统，旨在解决现有技术中在进行动作模仿和学习时，检查个体模仿和学习的效果时对比困难的问题。
本公开为解决上述技术问题所采用的技术方案如下：
一种用于动作模仿的方法，其中，包括步骤：
开启显示设备以及魔镜界面；
通过与所述魔镜界面相关联的摄像头，实时获取位于所述显示设备前方的模仿者的 动作数据；
根据所述动作数据将所述模仿者的动作显示在所述魔镜界面中。
所述用于动作模仿的方法，其中，所述步骤通过与魔镜界面相关联的摄像头，获取位于所述显示设备前方的模仿者的动作数据，具体包括：
对与所述魔镜界面相关联的摄像头进行检测，当检测到所述摄像头时，获取位于所述显示设备前方的模仿者的动作数据，并将所述动作数据回传至显示设备。
所述用于动作模仿的方法，其中，所述魔镜界面悬浮于所述显示设备的界面上。
所述用于动作模仿的方法，其中，当所述摄像头在预定的时间内没有获取到模仿者的动作数据时，所述魔镜界面待机或关闭。
所述用于动作模仿的方法，其中，对与所述魔镜界面相关联的摄像头进行检测，当未检测到所述摄像头时，发出错误提示。
所述用于动作模仿的方法，其中，所述错误提示为文字提示和/或语音提示。
所述用于动作模仿的方法，其中，所述魔镜界面的面积小于所述显示设备的界面面积。
所述用于动作模仿的方法，其中，模仿者的模仿对象为所述显示设备中所显示的对象。
所述用于动作模仿的方法，其中，所述显示设备为电视、电脑或PAD中的任一种。
所述用于动作模仿的方法，其中，所述摄像头为固定设置在所述显示设备的上摄像头或者是外接移动摄像头。
所述用于动作模仿的方法，其中，所述魔镜界面设置有多个。
所述用于动作模仿的方法，其中，模仿者的模仿对象为模仿者头脑中的对象。
所述用于动作模仿的方法，其中，所述魔镜界面具有动作评分功能。
一种存储介质，其上存储有多条指令，其中，所述指令适于一个或多个处理器加载并执行如上所述的方法。
一种用于动作模仿的系统，其中，其包括：
显示设备；
与魔镜界面相关联的摄像头，用于获取位于所述显示设备前方的模仿者的动作数据；
根据所述动作数据将所述模仿者的动作显示在所述魔镜界面中。
有益效果：通过借助于摄像头实时捕获模仿者的动作，将所获得的动作数据回传至显示设备，最终将模仿者的动作以照镜子的方式显示在魔镜界面中。采用本公开所提供的方法用户可以一边对着显示设备界面中播放的所要模仿的对象做动作模仿和学习，同时还可以通过魔镜界面来检测对比模仿和学习的效果，实现了模仿者与显示设备中模仿对象中行为动作模仿和学习的同步。解决了现有技术中在进行诸如参考显示设备中所播放的化妆、运动健身、娱乐、教育、游戏等动作模仿和学习时，检查个体模仿和学习对比困难的问题。
附图说明
图1是本公开实施例提供的一种用于动作模仿的方法较佳实施例的流程图。
图2是本公开实施例提供的一种用于动作模仿的方法一具体应用场景视图。
图3是本公开实施例提供的一种用于动作模仿系统较佳实施例的框图。
具体实施方式
为使本公开的目的、技术方案及优点更加清楚、明确，以下参照附图并举实施例对本公开进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本公开，并不用于限定本公开。
请同时参阅图1-2，本公开提供了一种用于动作模仿的方法的一些实施例。
如图1所示，本公开的用于动作模仿的方法，其包括以下步骤：
S100、开启显示设备以及魔镜界面。
具体地，所述显示设备可以是电视机、台式电脑、笔记本电脑或PAD等电子设备，作为举例本公开中以电视机作为显示设备来对本公开进行解释，并不用于限定本公开。
所述魔镜界面，是指用于显示摄像头所拍摄到的画面的窗口，所述窗口独立的显示在所述显示设备的界面上(即悬浮)，所述魔镜是个小的应用，其安装在显示设备中， 通过显示设备可以加载调用该应用。
开启所述显示设备可以是通过物理按键的方式，如遥控器或者显示设备上的物理按键，也可以是通过诸如语音模式或者是事先与显示设备绑定的移动终端来开启显示设备。所述魔镜界面的开启方式可以是通过语音的方式也可以通过按遥控器上所设置的物理按键的方式。本公开中优选通过语音指令打开魔镜应用，进入到魔镜界面，可以方便用户的使用。
S200、通过与所述魔镜界面相关联的摄像头，实时获取位于所述显示设备前方的模仿者的动作数据。
具体来说，所述魔镜界面关联有摄像头，所述摄像头可以是显示设备上原装的，比如带摄像头的电视机。当然也可以是外接的移动式摄像头。所述摄像头是带红外功能的摄像头，其可以提供各时段的拍摄模仿者的动作。
在一个或多个具体实施方式中，所述步骤S200具体包括：对与所述魔镜界面相关联的摄像头进行检测，当检测到所述摄像头时，获取位于所述显示设备前方的模仿者的动作数据。即通过语音指令开启魔镜后，显示设备要对与魔镜界面关联的摄像头进行检测，只有在能找到摄像头的情况下，才进入到魔镜界面，通过摄像头实时获取所述显示设备前方(魔镜界面前方)的模仿者的动作数据。即利用摄像头的摄像功能，对模仿者的运动进行跟踪记录，完整的记录下模仿者所做的动作。
进一步，当所述魔镜界面正常启动后，利用图层叠加技术将所述魔镜界面悬浮在电视机的界面上。所述魔镜界面可以显示在电视机界面的四个角上，也可以是在电视机界面的中部或者靠近电视机的四条侧边。具体的位置可以根据具体情况进行调整。所述魔镜界面的面积远小于电视机的屏幕面积，因为魔镜界面是悬浮在电视机的界面上的，魔镜界面是不透明的，魔镜界面会对其所在的电视机界面有所遮挡。因此，通过将魔镜界面的面积设置为小于电视机屏幕面积，可以更加方便用户根据电视机界面中所播放的视频进行模仿学习。当然，模仿者所模仿的对象也可以是其他形式的，比如存在头脑中的，旁边用户所展示的等等。
进一步，电视机所播放的可以是本地媒体，电视应用又或者是客户端镜像，在此不 做限制。
S300、根据所述动作数据将所述模仿者的动作显示在所述魔镜界面中。
具体来说，与所述魔镜界面相关联的摄像头，在获得了模仿者的动作数据后，采用流媒体协议将所述数据进行回传，电视机系统将所接收到的回传数据进行降噪处理，以排除噪音干扰，以获得更加稳定清晰的动作，再根据处理后的回传数据将所述模仿者的动作显示在所述魔镜界面中。为了保证回传数据的安全性，还可以采用加密算法对所述数据进行加密计算，其中，所涉及的流媒体协议技术以及加密算法均为现有的常用技术，此处仅是对现有技术加以应用，所述流媒体协议技术以及所述加密算法具体的技术细节此处不做赘述。
在一些实施方式中，所述魔镜界面可以设置为多个，相应的每个魔镜界面都有一个相关联的摄像头。例如当所述魔镜界面设置为两个时，分别记为第一魔镜界面、第二魔镜界面、所述第一魔镜界面与所述第二魔镜界面，分别位于所述显示设备的不同位置，例如可以是第一魔镜界面在电视机显示屏的右下角，第二魔镜界面位于电视机的左上角、右上角或左下角。所述第一魔镜界面与所述第二魔镜界面所同时显示的模仿者的动作是不同视角下的，例如所述第一魔镜界面所显示的是正视角度的模仿者的动作，此刻第二魔镜界面中所显示的是侧视角度的模仿者的动作，通过同时展示正视角度和侧视角度模仿者的动作，可以更加全面的展示模仿者所模仿的动作是否到位。
在一种或多种实施方式中，当所述魔镜界面设置为两个时(相应的每个魔镜界面分别关联一个摄像头)，分别记为第一魔镜界面、第二魔镜界面、所述第一魔镜界面与所述第二魔镜界面，分别位于所述显示设备的不同位置，例如可以是第一魔镜界面在电视机显示屏的右下角，第二魔镜界面位于电视机的左上角。所述第一魔镜界面与所述第二魔镜界面所显示的模仿者的动作是不同模仿者所做的动作，即所述第一魔镜界面和所述第二魔镜界面独立工作，可以同时满足两个模仿者做模仿动作。即可以邀请家人、朋友一起参与其中，同时满足两人进行动作模仿。当然所述魔镜界面也可以设置为多于两个，只要将每个摄像头独立的获取目标(模仿者)的模仿数据，并将所述模仿数据显示在与所述摄像头相关联的魔镜界面即可。
在一种或多种实施方式中，所述魔镜界面中还可以包含有动作评分功能。具体来说，所述显示设备获取显示界面中被模仿者的动作数据，作为标准数据，同时获取摄像头所回传的动作数据即魔镜界面中模仿者的动作数据作为比较数据，通过比较数据同标准数据的差异，给出相应的评分，比如将评分等级分为及格、良好、优秀等。通过设置评分功能，使得对模仿者的模仿对比更加科学合理，所述模仿者可以根据所述魔镜界面所给出的评分等级使动作模仿更加有针对性。
在一个或多个具体实施方式中，若电视开机后，通过语音指令打开魔镜，此时系统检测不到摄像头又或者说检测到了摄像头，但是所述摄像头并没有与魔镜界面相关联，则在电视机屏幕上弹出异常提示对话窗口，如提示用户检测摄像头是否存在诸如插口松动、电视机本身不具有摄像头、魔镜界面没有关联的摄像头等。即摄像头存在故障，结束此次任务。当然除了以文字的形式提示出现异常，还可以通过语音播报的方式。
在一个或多个具体实施方式中，当所述摄像头在预定的时间内没有获取到模仿者的动作数据或者所获取到的动作数据较少时，所述魔镜界面待机或关闭。将魔镜界面进行待机或者关闭，可以节省系统资源以及节省电视的耗电量。对摄像头所获取的数据进行监测，如果在规定的时间内(如3分钟)，摄像头所回传的数据中没有监测出有模仿者在运动，则将所述魔镜界面进入待机状态或者直接关闭魔镜界面。其中，对摄像头所获取的数据的监测为现有技术，在此不做赘述。
下面通过一个具体的应用场景来对本公开所提供的用于动作模仿的方法，进行解释。
例如如图2所示，即电视机屏幕中播放的是健身视频，在电视屏幕的右下角悬浮有魔镜界面，魔镜界面中所显示的是通过摄像头拍摄的模仿者的模仿动作，模仿动作与电视画面中所播放的视频动作进行同步展示，即将此时此刻的真实模仿情况与视频播放中的内容融为一体，方便了模仿者的对比检测。由于电视机的屏幕比较大，使得使用者可以更清晰的观察所模仿的动作是否到位，所做的动作有没有发生变形。从而方便了模仿者的练习。
通过上述步骤则可方便地检查个体模仿和学习对比情况。
可以看出，本公开所述的用于动作模仿的方法中，需要先检查摄像头显示设备上是不是安装有摄像头，若发现有摄像头，则将魔镜界面打开，并将魔镜界面悬浮于电视右下角，通过所述摄像头获取模仿者的动作数据，并将所述动作数据回传，根据所述动作数据将所述模仿者的动作显示在所述魔镜界面中。实现了模仿者与显示设备中模仿对象中行为动作模仿和学习的同步。
基于上述方法，本公开还提供了一种存储介质，所述存储介质上存储有多条指令，其中，所述指令适于一个或多个处理器加载并执行如上所述的用于动作模仿的方法。
在一些实施例中，所述处理器可以是一中央处理器，微处理器或其他数据处理芯片。
基于上述方法，本公开还提供了一种用于动作模仿的系统，如图3所示，包括：显示设备100；
与魔镜界面200相关联的摄像头300，用于获取位于所述魔镜界面前方的模仿者的动作数据；
根据所述动作数据将所述模仿者的动作显示在所述魔镜界面中。
关于上述系统的技术细节和好处已在上述方法中进行了详细阐述，此处不再赘述。
综上所述，本公开提供的用于动作模仿的方法、存储介质及系统，所述方法通过在显示设备上加载魔镜界面，所述魔镜界面悬浮在所述显示设备界面上，通过与所述魔镜界面相关联的摄像头，实时获取位于所述(显示设备)魔镜界面前方的模仿者的动作数据；比将所获取到的动作数据回传至显示设备，显示设备将根据所述动作数据，将所述模仿者的动作显示在所述魔镜界面中。因此，用户可以一边对着显示设备界面中播放的所要模仿的对象做动作模仿和学习，另一方面可以通过魔镜界面来检测对比模仿效果，实现了模仿者与显示设备中模仿对象中行为动作模仿和学习的同步。解决了现有技术中在进行诸如参考显示设备中所播放的化妆、运动健身、娱乐、教育、游戏等动作模仿和学习时，检查个体模仿和学习对比困难的问题。
应当理解的是，本公开的应用不限于上述的举例，对本领域普通技术人员来说，可以根据上述说明加以改进或变换，所有这些改进和变换都应属于本公开所附权利要求的保护范围。

Claims (15)

  1. 一种用于动作模仿的方法，其特征在于，包括步骤：
    开启显示设备以及魔镜界面；
    通过与所述魔镜界面相关联的摄像头，实时获取位于所述显示设备前方的模仿者的动作数据；
    根据所述动作数据将所述模仿者的动作显示在所述魔镜界面中。
  2. 根据权利要求1所述用于动作模仿的方法，其特征在于，所述步骤通过与魔镜界面相关联的摄像头，获取位于所述显示设备前方的模仿者的动作数据，具体包括：
    对与所述魔镜界面相关联的摄像头进行检测，当检测到所述摄像头时，获取位于所述显示设备前方的模仿者的动作数据，并将所述动作数据回传至显示设备。
  3. 根据权利要求1所述用于动作模仿的方法，其特征在于，所述魔镜界面悬浮于所述显示设备的界面上。
  4. 根据权利要求1-3任一所述用于动作模仿的方法，其特征在于，当所述摄像头在预定的时间内没有获取到模仿者的动作数据时，则所述魔镜界面待机或关闭。
  5. 根据权利要求2所述用于动作模仿的方法，其特征在于，对与所述魔镜界面相关联的摄像头进行检测，当未检测到所述摄像头时，发出错误提示。
  6. 根据权利要求5所述用于动作模仿的方法，其特征在于，所述错误提示为文字提示和/或语音提示。
  7. 根据权利要求3所述用于动作模仿的方法，其特征在于，所述魔镜界面的面积小于所述显示设备的界面面积。
  8. 根据权利要求1所述用于动作模仿的方法，其特征在于，模仿者的模仿对象为所述显示设备中所显示的对象。
  9. 根据权利要求1所述用于动作模仿的方法，其特征在于，所述显示设备为电视、电脑或PAD中的任一种。
  10. 根据权利要求1所述用于动作模仿的方法，其特征在于，所述摄像头为固定设置在所述显示设备的上摄像头或者是外接移动摄像头。
  11. 根据权利要求1所述用于动作模仿的方法，其特征在于，所述魔镜界面设置有 多个。
  12. 根据权利要求1所述用于动作模仿的方法，其特征在于，模仿者的模仿对象为模仿者头脑中的对象。
  13. 根据权利要求1所述用于动作模仿的方法，其特征在于，所述魔镜界面具有动作评分功能。
  14. 一种存储介质，其上存储有多条指令，其特征在于，所述指令适于一个或多个处理器加载并执行如权利要求1-13任一所述的方法。
  15. 一种用于动作模仿的系统，其特征在于，其包括：
    显示设备；
    与魔镜界面相关联的摄像头，用于获取位于所述显示设备前方的模仿者的动作数据；
    根据所述动作数据将所述模仿者的动作显示在所述魔镜界面中。
PCT/CN2020/073080 2019-05-30 2020-01-20 一种用于动作模仿的方法、存储介质及系统 Ceased WO2020238267A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910465301.4A CN110191365A (zh) 2019-05-30 2019-05-30 一种用于动作模仿的方法、存储介质及系统
CN201910465301.4 2019-05-30

Publications (1)

Publication Number Publication Date
WO2020238267A1 true WO2020238267A1 (zh) 2020-12-03

Family

ID=67719132

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/073080 Ceased WO2020238267A1 (zh) 2019-05-30 2020-01-20 一种用于动作模仿的方法、存储介质及系统

Country Status (2)

Country Link
CN (1) CN110191365A (zh)
WO (1) WO2020238267A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110191365A (zh) * 2019-05-30 2019-08-30 深圳创维－Rgb电子有限公司 一种用于动作模仿的方法、存储介质及系统
CN114679614B (zh) * 2020-12-25 2024-02-06 深圳Tcl新技术有限公司 一种语音查询方法、智能电视及计算机可读存储介质
WO2023221233A1 (zh) * 2022-05-16 2023-11-23 成都拟合未来科技有限公司 交互式镜面装置、系统及方法

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1154661A (zh) * 1994-07-01 1997-07-16 麻省理工学院 人体动作轨迹学习系统
US20070105629A1 (en) * 2005-11-04 2007-05-10 Konami Sports & Life Co., Ltd. Movement-information processing system, terminal unit for use in the system, and battery recharging unit for use with the terminal unit
CN103959805A (zh) * 2013-10-24 2014-07-30 华为终端有限公司 一种显示图像的方法和装置
CN107038455A (zh) * 2017-03-22 2017-08-11 腾讯科技（深圳）有限公司 一种图像处理方法及装置
CN108198601A (zh) * 2017-12-27 2018-06-22 广东欧珀移动通信有限公司 运动评分方法、装置、设备及存储介质
CN108780228A (zh) * 2016-01-19 2018-11-09 奇跃公司 利用映像的增强现实系统和方法
CN110191365A (zh) * 2019-05-30 2019-08-30 深圳创维－Rgb电子有限公司 一种用于动作模仿的方法、存储介质及系统

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8848048B2 (en) * 2011-03-07 2014-09-30 NON-GRID inc. Electronic mirroring system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1154661A (zh) * 1994-07-01 1997-07-16 麻省理工学院 人体动作轨迹学习系统
US20070105629A1 (en) * 2005-11-04 2007-05-10 Konami Sports & Life Co., Ltd. Movement-information processing system, terminal unit for use in the system, and battery recharging unit for use with the terminal unit
CN103959805A (zh) * 2013-10-24 2014-07-30 华为终端有限公司 一种显示图像的方法和装置
CN108780228A (zh) * 2016-01-19 2018-11-09 奇跃公司 利用映像的增强现实系统和方法
CN107038455A (zh) * 2017-03-22 2017-08-11 腾讯科技（深圳）有限公司 一种图像处理方法及装置
CN108198601A (zh) * 2017-12-27 2018-06-22 广东欧珀移动通信有限公司 运动评分方法、装置、设备及存储介质
CN110191365A (zh) * 2019-05-30 2019-08-30 深圳创维－Rgb电子有限公司 一种用于动作模仿的方法、存储介质及系统

Also Published As

Publication number Publication date
CN110191365A (zh) 2019-08-30

Similar Documents

Publication Publication Date Title
CN102656542B (zh) 用于演示的相机导航
CN103502969B (zh) 用于分别录制场景的顺序并置的系统
WO2018098720A1 (zh) 一种基于虚拟现实的数据处理方法及系统
WO2020238267A1 (zh) 一种用于动作模仿的方法、存储介质及系统
US20130265448A1 (en) Analyzing Human Gestural Commands
US12333662B2 (en) Presentations in multi-user communication sessions
CN114082197A (zh) 线下游戏的互动直播方法、装置、计算机设备及存储介质
Marshall et al. Deception and magic in collaborative interaction
CN112333415A (zh) 一种远程视频会议演示的方法和装置
TWI726233B (zh) 智慧型錄播互動教學教室系統及其操作方法
TWI883503B (zh) 用於在視訊紀錄會話期間提供自動化輔助之方法、系統及媒體
US11381793B2 (en) Room capture and projection
KR102733052B1 (ko) 확장 현실 기반 비대면 강의 컨텐츠 생성 장치, 컨텐츠 재생 장치, 그리고 이를 이용한 강의 컨텐츠 제공 방법
TWI885996B (zh) 互動平台系統及其教育元宇宙互動平台系統
CN108335243A (zh) 在线学习考试系统
AU2020102908A4 (en) IOTM- Class Monitoring System: IoT and AI based Monitoring System for Faculty and their Course Materials Availability
Wierzbicki et al. EDIS-emotion-driven interactive systems
CN103870122B (zh) 基于情景的动态“中断‑反馈”方法及系统
TW202605779A (zh) 互動平台系統及其教育元宇宙互動平台系統
TWM581261U (zh) Cognitive learning system
Kato et al. Projection Mahjong: augmenting real-world Mahjong experience
TWI777239B (zh) 肢體復健系統
TWI682354B (zh) 認知學習系統及其系統思考學習方法
CN109461351A (zh) 三屏交互的增强现实游戏训练系统
TWI715079B (zh) 網路教學系統及其網路教學方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20812681

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 21.04.2022).