WO2017206372A1 - Multimedia processing method, apparatus, and system - Google Patents

Multimedia processing method, apparatus, and system Download PDF

Info

Publication number
WO2017206372A1
WO2017206372A1 PCT/CN2016/096293 CN2016096293W WO2017206372A1 WO 2017206372 A1 WO2017206372 A1 WO 2017206372A1 CN 2016096293 W CN2016096293 W CN 2016096293W WO 2017206372 A1 WO2017206372 A1 WO 2017206372A1
Authority
WO
WIPO (PCT)
Prior art keywords
multimedia
trigger
area
virtual reality
play
Prior art date
Application number
PCT/CN2016/096293
Other languages
French (fr)
Chinese (zh)
Inventor
党宇航
Original Assignee
北京光子互动科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京光子互动科技有限公司 filed Critical 北京光子互动科技有限公司
Publication of WO2017206372A1 publication Critical patent/WO2017206372A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand

Definitions

  • the embodiments of the present invention relate to the field of multimedia, and in particular, to a multimedia processing method, apparatus, and system.
  • Virtual Reality is a kind of computer field that integrates computer graphics technology, multimedia technology, sensor technology, human-computer interaction technology, network technology, stereo display technology and simulation technology. new technology. At this stage, virtual reality technology is developing rapidly, and virtual reality technology can be seen in the fields of medical, entertainment, aerospace, real estate, education, tourism, and military.
  • the invention provides a multimedia processing method, device and system, which solves the problem that the user has inconvenience to display control in the virtual world caused by the need for the external device to operate when the multimedia device is used in the prior art.
  • the present invention provides a multimedia processing method, including:
  • Receiving a play request where the play request includes: a multimedia to be played;
  • the present invention provides a multimedia processing apparatus, including:
  • a first transceiver module configured to receive a play request, where the play request includes: a multimedia to be played;
  • a playing module configured to play the multimedia according to the playing request
  • An identification module configured to identify, in a process of playing the multimedia, whether a range of operations of the virtual reality device is within a trigger region preset in the multimedia
  • an obtaining module configured to: if the identifier of the operation of the virtual reality device is in the triggering area of the multimedia, query the multimedia, and obtain a preset trigger condition corresponding to the trigger area;
  • a determining module configured to determine whether the operation of the virtual reality device meets the trigger condition
  • the obtaining module is further configured to: if the determining module determines that the operation of the virtual reality device meets the trigger condition, query the multimedia, and obtain a preset trigger action corresponding to the trigger area;
  • a processing module configured to perform corresponding processing on the multimedia according to the triggering action.
  • the present invention provides a multimedia processing system, including the terminal device and the multimedia processing device according to any one of the second aspects, wherein
  • the terminal device includes:
  • a second transceiver module configured to receive a request to be edited, where the to-be-edited request includes: a multimedia to be edited, a trigger area to be edited, and trigger information corresponding to the trigger area to be edited, where the trigger information Including: trigger condition and trigger action, or trigger condition, trigger action and associated content;
  • An editing module configured to acquire, according to the to-be-edited request, a processing area corresponding to the triggering area to be edited in the multimedia to be edited; and add a triggering area corresponding to the to-be-edited area in the processing area Triggering information to generate the multimedia to be played;
  • the second transceiver module is further configured to send the generated multimedia to be played to the multimedia processing device.
  • the multimedia processing method, device and system provided by the present invention determine whether the operation of the virtual reality device satisfies the preset relationship by identifying the range of the operation of the virtual reality device in the trigger region preset in the multimedia during the process of playing the multimedia.
  • the trigger condition corresponding to the trigger area if the condition is met
  • the triggering condition corresponding to the triggering area is performed according to a preset triggering action corresponding to the triggering area, and corresponding processing is performed on the multimedia according to the triggering action.
  • the invention solves the problem that the user is inconvenient to display control in the virtual world due to the operation of the external device when the multimedia device is used in the prior art; furthermore, the multimedia processing method, device and system provided by the present invention, On the basis of the traditional input methods such as mouse, handle and data glove, a new input mode is provided, which enriches the input mode and is easy and quick to operate.
  • Embodiment 1 is a flowchart of Embodiment 1 of a multimedia processing method according to the present invention
  • Embodiment 2 is a flowchart of Embodiment 2 of a multimedia processing method according to the present invention
  • Embodiment 1 of a multimedia processing apparatus is a schematic structural diagram of Embodiment 1 of a multimedia processing apparatus according to the present invention.
  • FIG. 4 is a schematic structural diagram of an embodiment of a multimedia processing system according to the present invention.
  • FIG. 5 is a schematic structural diagram of a terminal device in an embodiment of a multimedia processing system according to the present invention.
  • FIG. 1 is a flowchart of a first embodiment of a multimedia processing method according to the present invention.
  • the execution subject of the embodiment is a virtual reality device, and the method in this embodiment includes:
  • S101 Receive a play request, where the play request includes: a multimedia to be played.
  • the user may select a multimedia to be played in the virtual reality device, and issue a play request to the virtual reality device, and the virtual reality device receives the broadcast of the user. Put the request.
  • the multimedia may be a panoramic video, a panoramic photo, or the like.
  • S102 Play multimedia according to the play request.
  • S103 In the process of playing the multimedia, if the range of the operation of the virtual reality device is determined to be within the trigger area preset in the multimedia, the multimedia is queried, the preset trigger condition corresponding to the trigger area is acquired, and the operation of the virtual reality device is determined. Whether the trigger condition is met.
  • the range of the operation of the virtual reality device is determined in the trigger area preset in the multimedia, specifically, the detection of the visible range of the virtual reality device follows the rotation of the user's head, and the movement of the central area of the visible range is tracked.
  • the central area of the visible range may be a visible range center point or a visible range center selection box, etc., identifying whether the visible range central area is within a preset trigger area in the multimedia, and determining the visual range center of the virtual reality device Whether the movement action of the zone satisfies the trigger condition.
  • the range of operations for identifying the virtual reality device is within the trigger region preset in the multimedia, and may also be a range for detecting the operation of the user by the external device through the external device. And identifying the range of the operation in a trigger area preset in the multimedia, and determining whether the operation of the virtual reality device satisfies the trigger condition.
  • the preset trigger area in this embodiment may be any geometric shape (rectangular, circular, circular, diamond, and custom irregular shape) or use two longitude lines (or latitude lines) to draw the trigger area.
  • S104 If it is determined that the operation of the virtual reality device meets the trigger condition corresponding to the trigger area, query the multimedia, obtain a preset trigger action corresponding to the trigger area, and perform corresponding processing on the multimedia according to the trigger action.
  • the multimedia is queried to obtain a preset trigger action corresponding to the trigger area, and corresponding processing is performed on the multimedia according to the trigger action.
  • the multimedia is further expanded, enriching the content of the multimedia, and satisfying the user's more demand for the multimedia content.
  • the multimedia processing method provided in this embodiment determines whether the operation of the virtual reality device satisfies the preset and the trigger region by identifying the range of the operation of the virtual reality device in the trigger region preset in the multimedia during the process of playing the multimedia. Corresponding trigger condition; if the trigger condition corresponding to the trigger area is met, the corresponding action is performed on the multimedia according to the trigger action corresponding to the trigger area according to the preset trigger action. Solving the use of virtual reality device to play multimedia in the prior art In the case of the user, the user is inconvenient to control the display in the virtual world due to the operation of the external device; in addition, the multimedia processing method, device and system provided by the embodiment are in the existing mouse, the handle, and the data glove. On the basis of the traditional input method, a new input method is provided, which enriches the types of input methods, and the operation is relatively simple and quick.
  • Embodiment 2 is a flowchart of Embodiment 2 of a multimedia processing method according to the present invention. As shown in FIG. 2, the specific steps are as follows:
  • S201 Receive a play request, where the play request includes: a multimedia to be played.
  • S202 Play multimedia according to the play request.
  • S203 In the process of playing the multimedia, if the range of the operation of the virtual reality device is determined to be within the trigger area preset in the multimedia, the multimedia is queried, the preset trigger condition corresponding to the trigger area is acquired, and the operation of the virtual reality device is determined. Whether the trigger condition is met.
  • the determining whether the operation of the virtual reality device meets the triggering condition of the triggering area may specifically include:
  • the trigger condition may be one or more of the foregoing multiple manners, and may be set according to the habit of the user.
  • the trigger condition may be that the range of operation of the virtual reality device stays in the trigger area for 2 seconds, enters the trigger area 2 times within a certain time, enters the trigger area with a specific trajectory, leaves the trigger area with a specific trajectory, or the like, or the above trigger condition. random combination.
  • the trigger condition can be set according to the user's habits, which improves the convenience of the user operation, thereby improving the convenience of human-computer interaction.
  • the triggering action includes the following: pause, fast forward, fast reverse, play, and switch play.
  • the multimedia when the operation of the virtual reality device meets the trigger condition corresponding to the trigger area, the multimedia is queried to obtain a preset trigger action corresponding to the trigger area, and the corresponding processing is performed on the multimedia, and the trigger action may be paused or fast.
  • the trigger action One of advance, rewind, play, and switch play, and correspondingly, the action is performed on the multimedia according to the trigger action.
  • the triggering action is not limited to the above, and of course, it is also possible to select, adjust the playing speed, adjust the volume/brightness, and the like.
  • S205 Acquire a save address of the associated content corresponding to the trigger area, if the preset trigger action corresponding to the trigger area is a switch play action;
  • S206 Acquire the related content according to the save address, and switch the related content from the multimedia according to the switching play action.
  • the save address of the associated content corresponding to the trigger area is acquired, and after the related content is searched and acquired, Switch to play the associated content.
  • the associated content may be panoramic video, audio, panoramic picture, text content, and the like.
  • the switching time point information of the switching play is acquired, and after the related content is played, according to the switching time point information, Switching to play the multimedia, so that the multimedia playback continues, to ensure the continuity of multimedia playback.
  • the multimedia processing method provided in this embodiment determines whether the operation of the virtual reality device satisfies the preset and the trigger region by identifying the range of the operation of the virtual reality device in the trigger region preset in the multimedia during the process of playing the multimedia.
  • Corresponding triggering conditions wherein the triggering conditions have multiple modes, which can be set according to the user's habits, thereby improving the convenience of the user's operation; if the triggering condition corresponding to the triggering region is satisfied, according to the preset and the triggering region Correct The triggering action should be performed, and the corresponding processing is performed on the multimedia according to the triggering action, wherein the triggering action may be pause, fast forward, fast reverse, play, and switch play, etc., when the trigger action is a switch play action, the play is switched and the play
  • the associated content corresponding to the trigger area can make the multimedia content richer and have more interactive content with the user.
  • the multimedia processing method provided in this embodiment solves the problem that the user inconveniences the display control in the virtual world caused by the
  • the multimedia processing method can be applied to various fields such as entertainment, medical, aerospace, real estate, education, tourism, military, and the like.
  • the multimedia processing method provided in this embodiment is applied in the field of tourism, and the multimedia may be a panoramic video captured in a tourist scenic spot, and each scenic spot in the panoramic video of the tourist scenic spot is pre-set with a triggering region, and is also pre-configured.
  • the triggering condition corresponding to the triggering area for example, “the virtual reality device visible range center point is triggered when the triggering area staying time is 3 seconds”, and the triggering action performed after the triggering is “switching and playing the historical introduction video related to the attraction point. ".
  • the user can request to play the panoramic video of the tourist attraction in the virtual reality device, and the virtual reality device receives the play request and plays the same.
  • the center point is in the preset trigger region. Then, the panoramic video of the tourist scenic spot is queried, the preset triggering condition corresponding to the triggering area is obtained, and it is determined whether the operation of the virtual reality device satisfies the triggering condition, that is, “the virtual reality device visible range center point stays in the triggering area.
  • Trigger when 3 seconds If it is determined that the trigger condition corresponding to the trigger area is met, the panoramic video of the tourist attraction is queried, and a preset trigger action corresponding to the trigger area is obtained, that is, “switching the history introduction video related to the attraction”, and acquiring a storage address of the associated content (the historical introduction video related to the attraction) corresponding to the trigger area; acquiring the related content according to the saved address, and switching playback from the multimedia according to the switching play action Relevant historical introduction video of the scenic spot; obtaining switching time point information; after the completion of the historical introduction video related to the scenic spot, switching the panoramic video of the tourist scenic spot according to the switching time point information to ensure the continuity of the playing .
  • the line of sight stops triggering the corresponding plot, which makes the user more convenient to operate when viewing the panoramic video of the scenic spot, improving the convenience of human-computer interaction, and providing more extended content for the panoramic video to meet the needs of different users. , to improve the user experience.
  • the processing method of the multimedia provided by the embodiment may further include reading and activating all the trigger regions preset in the multimedia before the range of the operation of the virtual reality device is recognized in the trigger region preset in the multimedia.
  • the trigger area can also be selected to be partially activated or deactivated. When all are activated, the trigger conditions corresponding to all the trigger regions are all enabled. At this time, the triggering condition of any trigger region is satisfied, and the corresponding execution action is performed; and when the partial activation is performed, the trigger region can only be satisfied in the activated trigger region.
  • the trigger condition corresponding to the area is to execute the corresponding action; when it is not activated, the trigger conditions corresponding to all the trigger areas are all off, and no action is performed. Users can exclude content that is not of interest according to their needs, meet the needs of different users, and improve the human-computer interaction experience.
  • FIG. 3 is a schematic structural diagram of Embodiment 1 of a multimedia processing apparatus according to the present invention.
  • the device specifically includes: a first transceiver module 31, configured to receive a play request, the play request includes: a multimedia to be played, and a play module 32, configured to play the multimedia according to the play request
  • An identification module configured to identify, in the process of playing the multimedia, whether a range of operations of the virtual reality device is within a trigger region preset in the multimedia
  • an obtaining module 33 configured to: if the identification module identifies the The operation of the virtual reality device is performed in the triggering area of the multimedia, and the multimedia is queried to obtain a preset trigger condition corresponding to the trigger area.
  • the determining module 34 is configured to determine the operation of the virtual reality device. Whether the triggering condition is met; the obtaining module 33 is further configured to: if the determining module 34 determines that the operation of the virtual reality device meets the triggering condition, query the multimedia, and obtain a preset corresponding to the triggering area. Triggering an action; the processing module 35 is configured to perform corresponding processing on the multimedia according to the triggering action.
  • the multimedia processing device in this embodiment is implemented by: the first transceiver module 31 receives the play request, and the play module 32 plays the multimedia according to the play request; in the process of playing the multimedia, the recognition module identifies whether the scope of the operation of the virtual reality device is in the multimedia If the recognition module recognizes that the range of the operation of the virtual reality device is within the trigger region of the multimedia, the module 33 queries the multimedia to obtain a preset trigger condition corresponding to the trigger region; the determining module 34 determines Whether the operation of the virtual reality device meets the trigger condition; the obtaining module 33 is further configured to: if the determining module 34 determines that the operation of the virtual reality device meets the trigger condition, query the multimedia, and obtain a preset trigger action corresponding to the trigger region; and finally, the processing module 35 performs corresponding processing on the multimedia according to the triggering action.
  • the device in this embodiment solves the problem that when the multimedia device is used to play multimedia in the prior art, the external device is required to operate. The user has an inconvenient control over the
  • the acquiring module 33 is specifically configured to acquire a corresponding to the trigger area. a saved address of the associated content; and obtaining the associated content according to the saved address;
  • the processing module 35 is specifically configured to switch to play the related content from the multimedia according to the switching play action.
  • the obtaining module 33 is further configured to acquire switching time point information
  • the processing module 35 is further configured to switch to play the multimedia according to the switching time point information after the related content is played.
  • the trigger action includes the following: pause, fast forward, rewind, play, and switch play.
  • the determining module 34 is specifically configured to determine whether the duration of the operation of the virtual reality device staying in the trigger area meets a preset time condition; and/or,
  • the determining module 34 is further configured to determine whether the number of operations of the virtual reality device in the trigger area meets a preset number of times; and/or,
  • the determining module 34 is further configured to determine whether an operation trajectory of the virtual reality device in the trigger area satisfies a preset trajectory.
  • the first transceiver module 31 receives the play request, and the play module 32 plays the multimedia according to the play request.
  • the recognition module identifies whether the scope of the operation of the virtual reality device is pre-recorded in the multimedia. If the identification module recognizes that the range of operation of the virtual reality device is within the trigger region of the multimedia, the query module 33 queries the multimedia to obtain a preset trigger condition corresponding to the trigger region; the determining module 34 determines the virtual reality.
  • the determining module 34 may specifically determine whether the triggering condition satisfies any one of the foregoing multiple modes; the obtaining module 33
  • the method further includes: if the determining module 34 determines that the operation of the virtual reality device meets the triggering condition, queries the multimedia, and acquires a preset triggering action corresponding to the triggering region; finally, the processing module 35 performs corresponding processing on the multimedia according to the triggering action.
  • the triggering action may be pause, fast forward, fast reverse, play, and switch play. When the trigger action is a switch play action, the processing module 35 switches the play and the play.
  • the associated content corresponding to the trigger area can make the multimedia content richer and have more interactive content with the user.
  • the multimedia processing method provided in this embodiment solves the problem that the user inconveniences the display control in the virtual world caused by the operation of the external device when the multimedia device is used in the prior art, thereby effectively improving the problem. Human-computer interaction convenience.
  • the multimedia processing system of this embodiment includes a terminal device 101 and a multimedia processing device 102 as shown in FIG.
  • the multimedia processing device 102 is configured to execute the method of Embodiment 1 or Embodiment 2 of the multimedia processing method.
  • the terminal device 101 includes:
  • the second transceiver module 51 is configured to receive a request to be edited, where the to-be-edited request includes: a multimedia to be edited, a trigger area to be edited, and trigger information corresponding to the trigger area to be edited, where the trigger The information includes: a trigger condition and a trigger action, or a trigger condition, a trigger action, and an associated content;
  • the editing module 52 is configured to acquire, according to the to-be-edited request, a processing area corresponding to the triggering area to be edited in the multimedia to be edited, and add a triggering area to be edited in the processing area Corresponding trigger information to generate the multimedia to be played;
  • the second transceiver module 51 is further configured to send the generated multimedia to be played to the multimedia processing device.
  • the terminal device performs editing processing on the received multimedia according to the editing request, and sends the generated multimedia to be played to the multimedia processing device.
  • the terminal device may be an external processing device such as a computer, a smart phone, or a tablet computer.
  • the terminal device may be disposed on the virtual reality device, so that the virtual reality device has both a multimedia editing function and a media playback.
  • the second transceiver module 51 can directly send the multimedia to be played to the multimedia processing device, or can be distributed to the entertainment platform for the multimedia processing device to download.
  • each block of the flowchart or block diagram can represent a module, a program segment, or a portion of code that includes one or more of the Executable instructions.
  • the functions noted in the blocks may also occur in a different order than that illustrated in the drawings. For example, two consecutive blocks may be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts can be implemented in a dedicated hardware-based system that performs the specified function or function. Or it can be implemented by a combination of dedicated hardware and computer instructions.
  • the aforementioned program can be stored in a computer readable storage medium.
  • the program when executed, performs the steps including the foregoing method embodiments; and the foregoing storage medium includes various media that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

Abstract

Provided in the present invention are a multimedia processing method, apparatus, and system. The method comprises: receiving a playback request, the playback request comprising multimedia content to be played; playing the multimedia content according to the playback request; during playback, if it is identified that a range of an operation of a virtual reality device falls within a preset trigger region in the multimedia content, querying the multimedia content so as to obtain a preset trigger condition corresponding to the trigger region, and determining whether the operation of the virtual reality device meets the trigger condition; if it is determined that the trigger condition corresponding to the trigger region is met, querying the multimedia content so as to obtain a preset trigger action corresponding to the trigger region, and performing corresponding processing on the multimedia content according to the trigger action. The multimedia processing method, apparatus, and system provided in embodiments of the present invention solve a problem in the prior art in which, in order for a virtual reality device to play multimedia content, it is necessary to operate an external device, causing user inconvenience in the control of a display in a virtual world.

Description

多媒体的处理方法、装置和系统Multimedia processing method, device and system 技术领域Technical field
本发明实施例涉及多媒体领域,尤其涉及一种多媒体的处理方法、装置和系统。The embodiments of the present invention relate to the field of multimedia, and in particular, to a multimedia processing method, apparatus, and system.
背景技术Background technique
虚拟现实(Virtual Reality,简称VR),是一种综合计算机图形技术、多媒体技术、传感器技术、人机交互技术、网络技术、立体显示技术以及仿真技术等多种科学及时而发展起来的计算机领域的新技术。现阶段,虚拟现实技术正在飞速发展,在医疗、娱乐、航天、房地产、教育、旅游、军事等领域都能看到虚拟现实技术的身影。Virtual Reality (VR) is a kind of computer field that integrates computer graphics technology, multimedia technology, sensor technology, human-computer interaction technology, network technology, stereo display technology and simulation technology. new technology. At this stage, virtual reality technology is developing rapidly, and virtual reality technology can be seen in the fields of medical, entertainment, aerospace, real estate, education, tourism, and military.
在传统的采用虚拟现实设备播放多媒体时,用户通常需要通过键盘、鼠标、手柄等方式来控制虚拟世界中的显示,这带给用户很多不便,特别是虚拟现实眼镜、虚拟现实头盔,用户佩戴后会完全看不到真实世界中的键盘、鼠标、手柄等外设人机交互载体,造成了人机交互的不方便,从而降低了人机交互便捷性。In the traditional use of virtual reality devices to play multimedia, users usually need to control the display in the virtual world through keyboard, mouse, handle, etc., which brings a lot of inconvenience to users, especially virtual reality glasses, virtual reality helmets, after the user wears The peripheral human-computer interaction carrier such as keyboard, mouse, and handle in the real world will not be seen at all, resulting in inconvenient human-computer interaction, thereby reducing the convenience of human-computer interaction.
发明内容Summary of the invention
本发明提供一种多媒体的处理方法、装置和系统,解决了现有技术中采用虚拟现实设备播放多媒体时,由于需要外部设备进行操作而造成的用户对于虚拟世界中的显示控制不便的问题。The invention provides a multimedia processing method, device and system, which solves the problem that the user has inconvenience to display control in the virtual world caused by the need for the external device to operate when the multimedia device is used in the prior art.
第一方面,本发明提供一种多媒体的处理方法,包括:In a first aspect, the present invention provides a multimedia processing method, including:
接收播放请求,所述播放请求包括:待播放的多媒体;Receiving a play request, where the play request includes: a multimedia to be played;
根据所述播放请求,播放所述多媒体;Playing the multimedia according to the play request;
在播放所述多媒体过程中,若识别虚拟现实设备的操作的范围在所述多媒体中预设的触发区域内,则查询所述多媒体,获取预设的与所述触发区域对应的触发条件,并判断所述虚拟现实设备的操作是否满足所述触发条件;In the process of playing the multimedia, if the range of the operation of the virtual reality device is within the preset triggering area of the multimedia, querying the multimedia, acquiring a preset trigger condition corresponding to the trigger area, and Determining whether the operation of the virtual reality device meets the trigger condition;
若判断出所述虚拟现实设备的操作满足所述触发区域对应的触发条件, 则查询所述多媒体,获取预设的与所述触发区域对应的触发动作,并根据所述触发动作对所述多媒体执行相应的处理。If it is determined that the operation of the virtual reality device meets the trigger condition corresponding to the trigger area, And querying the multimedia, acquiring a preset trigger action corresponding to the trigger area, and performing corresponding processing on the multimedia according to the trigger action.
第二方面,本发明提供一种多媒体的处理装置,包括:In a second aspect, the present invention provides a multimedia processing apparatus, including:
第一收发模块,用于接收播放请求,所述播放请求包括:待播放的多媒体;a first transceiver module, configured to receive a play request, where the play request includes: a multimedia to be played;
播放模块,用于根据所述播放请求,播放所述多媒体;a playing module, configured to play the multimedia according to the playing request;
识别模块,用于在播放所述多媒体过程中,识别虚拟现实设备的操作的范围是否在所述多媒体中预设的触发区域内;An identification module, configured to identify, in a process of playing the multimedia, whether a range of operations of the virtual reality device is within a trigger region preset in the multimedia;
获取模块,用于若所述识别模块识别出所述虚拟现实设备的操作的范围在所述多媒体的触发区域内,则查询所述多媒体,获取预设的与所述触发区域对应的触发条件;And an obtaining module, configured to: if the identifier of the operation of the virtual reality device is in the triggering area of the multimedia, query the multimedia, and obtain a preset trigger condition corresponding to the trigger area;
判断模块,用于判断所述虚拟现实设备的操作是否满足所述触发条件;a determining module, configured to determine whether the operation of the virtual reality device meets the trigger condition;
所述获取模块还用于若判断模块判断出所述虚拟现实设备的操作满足所述触发条件,查询所述多媒体,获取预设的与所述触发区域对应的触发动作;The obtaining module is further configured to: if the determining module determines that the operation of the virtual reality device meets the trigger condition, query the multimedia, and obtain a preset trigger action corresponding to the trigger area;
处理模块,用于根据所述触发动作对所述多媒体执行相应得处理。And a processing module, configured to perform corresponding processing on the multimedia according to the triggering action.
第三方面,本发明提供一种多媒体的处理系统,包括终端设备和第二方面中任一所述的多媒体的处理装置,其中,In a third aspect, the present invention provides a multimedia processing system, including the terminal device and the multimedia processing device according to any one of the second aspects, wherein
所述终端设备包括:The terminal device includes:
第二收发模块,用于接收待编辑请求,所述待编辑请求包括:待编辑的多媒体,待编辑的触发区域,以及与所述待编辑的触发区域对应的触发信息,其中,所述触发信息包括:触发条件和触发动作,或者触发条件、触发动作以及关联内容;a second transceiver module, configured to receive a request to be edited, where the to-be-edited request includes: a multimedia to be edited, a trigger area to be edited, and trigger information corresponding to the trigger area to be edited, where the trigger information Including: trigger condition and trigger action, or trigger condition, trigger action and associated content;
编辑模块,用于根据所述待编辑请求,在所述待编辑的多媒体中获取与所述待编辑的触发区域对应的处理区域;在所述处理区域中添加与所述待编辑的触发区域对应的触发信息,以生成所述待播放的多媒体;An editing module, configured to acquire, according to the to-be-edited request, a processing area corresponding to the triggering area to be edited in the multimedia to be edited; and add a triggering area corresponding to the to-be-edited area in the processing area Triggering information to generate the multimedia to be played;
所述第二收发模块还用于将生成的所述待播放的多媒体发送给所述多媒体的处理装置。The second transceiver module is further configured to send the generated multimedia to be played to the multimedia processing device.
本发明提供的多媒体的处理方法、装置和系统,在播放多媒体过程中,通过识别虚拟现实设备的操作的范围在多媒体中预设的触发区域内,判断虚拟现实设备的操作是否满足预设的与该触发区域对应的触发条件;若满足该 触发区域对应的触发条件,则根据预设的与该触发区域对应的触发动作,并根据触发动作对所述多媒体执行相应的处理。解决了现有技术中采用虚拟现实设备播放多媒体时,由于需要外部设备进行操作而造成的用户对于虚拟世界中的显示控制不便的问题;此外,本发明提供的多媒体的处理方法、装置和系统,在已有的鼠标、手柄、数据手套等传统输入方式的基础上,提供了新的输入方式,丰富了输入方式种类,且操作较为简便快捷。The multimedia processing method, device and system provided by the present invention determine whether the operation of the virtual reality device satisfies the preset relationship by identifying the range of the operation of the virtual reality device in the trigger region preset in the multimedia during the process of playing the multimedia. The trigger condition corresponding to the trigger area; if the condition is met The triggering condition corresponding to the triggering area is performed according to a preset triggering action corresponding to the triggering area, and corresponding processing is performed on the multimedia according to the triggering action. The invention solves the problem that the user is inconvenient to display control in the virtual world due to the operation of the external device when the multimedia device is used in the prior art; furthermore, the multimedia processing method, device and system provided by the present invention, On the basis of the traditional input methods such as mouse, handle and data glove, a new input mode is provided, which enriches the input mode and is easy and quick to operate.
附图说明DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any inventive labor.
图1为本发明多媒体的处理方法实施例一的流程图;1 is a flowchart of Embodiment 1 of a multimedia processing method according to the present invention;
图2为本发明多媒体的处理方法实施例二的流程图;2 is a flowchart of Embodiment 2 of a multimedia processing method according to the present invention;
图3为本发明多媒体的处理装置实施例一的结构示意图;3 is a schematic structural diagram of Embodiment 1 of a multimedia processing apparatus according to the present invention;
图4为本发明多媒体的处理系统实施例的结构示意图;4 is a schematic structural diagram of an embodiment of a multimedia processing system according to the present invention;
图5为本发明多媒体的处理系统实施例中终端设备的结构示意图。FIG. 5 is a schematic structural diagram of a terminal device in an embodiment of a multimedia processing system according to the present invention.
具体实施方式detailed description
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
图1为本发明多媒体的处理方法实施例一的流程图,如图1所示,本实施例的执行主体为虚拟现实设备,本实施例的方法包括:FIG. 1 is a flowchart of a first embodiment of a multimedia processing method according to the present invention. As shown in FIG. 1 , the execution subject of the embodiment is a virtual reality device, and the method in this embodiment includes:
S101:接收播放请求,播放请求包括:待播放的多媒体。S101: Receive a play request, where the play request includes: a multimedia to be played.
在本实施例中,用户可以在虚拟现实设备中对待播放的多媒体进行选择,并对虚拟现实设备发出播放请求,而虚拟现实设备则接收用户的播 放请求。本实施例中,多媒体可以为全景视频、全景照片等。In this embodiment, the user may select a multimedia to be played in the virtual reality device, and issue a play request to the virtual reality device, and the virtual reality device receives the broadcast of the user. Put the request. In this embodiment, the multimedia may be a panoramic video, a panoramic photo, or the like.
S102:根据播放请求,播放多媒体。S102: Play multimedia according to the play request.
S103:在播放多媒体过程中,若识别虚拟现实设备的操作的范围在多媒体中预设的触发区域内,则查询多媒体,获取预设的与触发区域对应的触发条件,并判断虚拟现实设备的操作是否满足触发条件。S103: In the process of playing the multimedia, if the range of the operation of the virtual reality device is determined to be within the trigger area preset in the multimedia, the multimedia is queried, the preset trigger condition corresponding to the trigger area is acquired, and the operation of the virtual reality device is determined. Whether the trigger condition is met.
在本实施例中,识别虚拟现实设备的操作的范围在多媒体中预设的触发区域内,具体可以为检测虚拟现实设备可视范围跟随用户头部的转动,跟踪可视范围中心区的移动动作,其中可视范围中心区可以为可视范围中心点或可视范围中心选择框等,识别可视范围中心区是否在多媒体中预设的触发区域内,并判断虚拟现实设备的可视范围中心区的移动动作是否满足触发条件。当然,当存在外部设备时,例如鼠标、手柄、数据手套等,识别虚拟现实设备的操作的范围在多媒体中预设的触发区域内,也可以为检测用户通过外部设备对现实设备的操作的范围,识别该操作的范围在多媒体中预设的触发区域内,并判断虚拟现实设备的操作是否满足触发条件。本实施例中的预设的触发区域可以为任何几何形状(矩形、圆形、圆环、菱形以及自定义不规则形状)或者使用两条经度线(或纬度线)绘制出触发区域。In this embodiment, the range of the operation of the virtual reality device is determined in the trigger area preset in the multimedia, specifically, the detection of the visible range of the virtual reality device follows the rotation of the user's head, and the movement of the central area of the visible range is tracked. The central area of the visible range may be a visible range center point or a visible range center selection box, etc., identifying whether the visible range central area is within a preset trigger area in the multimedia, and determining the visual range center of the virtual reality device Whether the movement action of the zone satisfies the trigger condition. Of course, when there is an external device, such as a mouse, a handle, a data glove, etc., the range of operations for identifying the virtual reality device is within the trigger region preset in the multimedia, and may also be a range for detecting the operation of the user by the external device through the external device. And identifying the range of the operation in a trigger area preset in the multimedia, and determining whether the operation of the virtual reality device satisfies the trigger condition. The preset trigger area in this embodiment may be any geometric shape (rectangular, circular, circular, diamond, and custom irregular shape) or use two longitude lines (or latitude lines) to draw the trigger area.
S104:若判断出虚拟现实设备的操作满足触发区域对应的触发条件,则查询多媒体,获取预设的与触发区域对应的触发动作,并根据触发动作对多媒体执行相应的处理。S104: If it is determined that the operation of the virtual reality device meets the trigger condition corresponding to the trigger area, query the multimedia, obtain a preset trigger action corresponding to the trigger area, and perform corresponding processing on the multimedia according to the trigger action.
在本实施例中,若判断出虚拟现实设备的操作满足触发区域对应的触发条件时,查询多媒体以获取预设的与触发区域对应的触发动作,并根据该触发动作对多媒体执行相应的处理,通过该触发动作,对多媒体进行更多的扩展,丰富了多媒体的内容,满足用户对多媒体内容更多的需求。In this embodiment, if it is determined that the operation of the virtual reality device meets the trigger condition corresponding to the trigger area, the multimedia is queried to obtain a preset trigger action corresponding to the trigger area, and corresponding processing is performed on the multimedia according to the trigger action. Through the triggering action, the multimedia is further expanded, enriching the content of the multimedia, and satisfying the user's more demand for the multimedia content.
本实施例提供的多媒体的处理方法,在播放多媒体过程中,通过识别虚拟现实设备的操作的范围在多媒体中预设的触发区域内,判断虚拟现实设备的操作是否满足预设的与该触发区域对应的触发条件;若满足该触发区域对应的触发条件,则根据预设的与该触发区域对应的触发动作,并根据触发动作对多媒体执行相应的处理。解决了现有技术中采用虚拟现实设备播放多媒 体时,由于需要外部设备进行操作而造成的用户对于虚拟世界中的显示控制不便的问题;此外,本实施例提供的多媒体的处理方法、装置和系统,在已有的鼠标、手柄、数据手套等传统输入方式的基础上,提供了新的输入方式,丰富了输入方式种类,且操作较为简便快捷。The multimedia processing method provided in this embodiment determines whether the operation of the virtual reality device satisfies the preset and the trigger region by identifying the range of the operation of the virtual reality device in the trigger region preset in the multimedia during the process of playing the multimedia. Corresponding trigger condition; if the trigger condition corresponding to the trigger area is met, the corresponding action is performed on the multimedia according to the trigger action corresponding to the trigger area according to the preset trigger action. Solving the use of virtual reality device to play multimedia in the prior art In the case of the user, the user is inconvenient to control the display in the virtual world due to the operation of the external device; in addition, the multimedia processing method, device and system provided by the embodiment are in the existing mouse, the handle, and the data glove. On the basis of the traditional input method, a new input method is provided, which enriches the types of input methods, and the operation is relatively simple and quick.
图2为本发明多媒体的处理方法实施例二的流程图,如图2所示,具体的步骤如下:2 is a flowchart of Embodiment 2 of a multimedia processing method according to the present invention. As shown in FIG. 2, the specific steps are as follows:
S201:接收播放请求,播放请求包括:待播放的多媒体。S201: Receive a play request, where the play request includes: a multimedia to be played.
S202:根据播放请求,播放多媒体。S202: Play multimedia according to the play request.
S203:在播放多媒体过程中,若识别虚拟现实设备的操作的范围在多媒体中预设的触发区域内,则查询多媒体,获取预设的与触发区域对应的触发条件,并判断虚拟现实设备的操作是否满足触发条件。S203: In the process of playing the multimedia, if the range of the operation of the virtual reality device is determined to be within the trigger area preset in the multimedia, the multimedia is queried, the preset trigger condition corresponding to the trigger area is acquired, and the operation of the virtual reality device is determined. Whether the trigger condition is met.
其中,所述判断所述虚拟现实设备的操作是否满足所述触发区域对应的触发条件,具体可包括:The determining whether the operation of the virtual reality device meets the triggering condition of the triggering area may specifically include:
判断所述虚拟现实设备的操作停留在所述触发区域的时长是否满足预设时间条件;和/或,Determining whether the duration of the operation of the virtual reality device stays in the trigger area meets a preset time condition; and/or,
判断所述虚拟现实设备在所述触发区域中的操作次数是否满足预设次数;和/或,Determining whether the number of operations of the virtual reality device in the trigger area meets a preset number of times; and/or,
判断所述虚拟现实设备在所述触发区域中的操作轨迹是否满足预设轨迹。Determining whether the operation trajectory of the virtual reality device in the trigger area satisfies a preset trajectory.
在本实施例中,触发条件可以为上述多种方式中的一种或几种,可以根据用户的习惯进行设定。例如触发条件可以为虚拟现实设备的操作的范围在触发区域中停留2秒、一定时间内进入触发区域2次、以特定轨迹进入触发区域、以特定轨迹离开触发区域等等,或者上述触发条件的任意组合。触发条件可根据用户的习惯进行设定,提高了用户操作的便捷性,从而提升人机交互的便捷性。In this embodiment, the trigger condition may be one or more of the foregoing multiple manners, and may be set according to the habit of the user. For example, the trigger condition may be that the range of operation of the virtual reality device stays in the trigger area for 2 seconds, enters the trigger area 2 times within a certain time, enters the trigger area with a specific trajectory, leaves the trigger area with a specific trajectory, or the like, or the above trigger condition. random combination. The trigger condition can be set according to the user's habits, which improves the convenience of the user operation, thereby improving the convenience of human-computer interaction.
S204:若判断出虚拟现实设备的操作满足触发区域对应的触发条件,则查询多媒体,获取预设的与触发区域对应的触发动作,并根据触发动作对多媒体执行相应的处理。S204: If it is determined that the operation of the virtual reality device meets the trigger condition corresponding to the trigger area, query the multimedia, obtain a preset trigger action corresponding to the trigger area, and perform corresponding processing on the multimedia according to the trigger action.
其中,所述触发动作包括如下一种:暂停、快进、快退、播放和切换播放。 The triggering action includes the following: pause, fast forward, fast reverse, play, and switch play.
在本实施例中,当虚拟现实设备的操作满足触发区域对应的触发条件时,查询多媒体以获取预设的与触发区域对应的触发动作,对多媒体执行相应的处理,触发动作可以为暂停、快进、快退、播放和切换播放中一种,相应的,则根据该触发动作对多媒体执行该动作。例如,当虚拟现实设备的操作满足触发区域对应的触发条件时,查询多媒体以获取预设的与触发区域对应的触发动作为暂停时,则对正在播放的多媒体执行暂停操作。当然触发动作也并不限于上述情况,当然也可进行选择、调节播放速度、调节音量/亮度等等。In this embodiment, when the operation of the virtual reality device meets the trigger condition corresponding to the trigger area, the multimedia is queried to obtain a preset trigger action corresponding to the trigger area, and the corresponding processing is performed on the multimedia, and the trigger action may be paused or fast. One of advance, rewind, play, and switch play, and correspondingly, the action is performed on the multimedia according to the trigger action. For example, when the operation of the virtual reality device meets the trigger condition corresponding to the trigger area, when the multimedia is queried to obtain the preset trigger action corresponding to the trigger area, the pause operation is performed on the multimedia being played. Of course, the triggering action is not limited to the above, and of course, it is also possible to select, adjust the playing speed, adjust the volume/brightness, and the like.
S205:若获取预设的与所述触发区域对应的触发动作为切换播放动作,则获取与所述触发区域对应的关联内容的保存地址;S205: Acquire a save address of the associated content corresponding to the trigger area, if the preset trigger action corresponding to the trigger area is a switch play action;
S206:根据所述保存地址,获取所述关联内容,并根据所述切换播放动作,从所述多媒体切换播放所述关联内容。S206: Acquire the related content according to the save address, and switch the related content from the multimedia according to the switching play action.
在本实施例中,当获取预设的与所述触发区域对应的触发动作为切换播放动作时,获取与所述触发区域对应的关联内容的保存地址,并根据经过查找并获取该关联内容后切换播放该关联内容。所述的关联内容可以为全景视频、音频、全景图片、文本内容等等。通过切换播放该关联内容,可以使多媒体内容更加丰富,与用户有更多的交互内容,满足不同用户的需求,提升用户的体验。In this embodiment, when the triggering action corresponding to the triggering area is obtained as a switching play action, the save address of the associated content corresponding to the trigger area is acquired, and after the related content is searched and acquired, Switch to play the associated content. The associated content may be panoramic video, audio, panoramic picture, text content, and the like. By switching the related content, the multimedia content can be richer, and the user has more interactive content to meet the needs of different users and enhance the user experience.
S207:获取切换时间点信息;S207: Acquire switching time point information;
S208:在所述关联内容播放完成之后,根据所述切换时间点信息,切换播放所述多媒体。S208: After the related content is played, the multimedia is switched and played according to the switching time point information.
在本实施例中,当获取预设的与所述触发区域对应的触发动作为切换播放动作时,获取切换播放的切换时间点信息,当关联内容播放完成之后,根据所述切换时间点信息,切换播放所述多媒体,使多媒体的播放继续进行,以保证多媒体播放的连续性。In this embodiment, when the triggering action corresponding to the triggering area is obtained as a switching play action, the switching time point information of the switching play is acquired, and after the related content is played, according to the switching time point information, Switching to play the multimedia, so that the multimedia playback continues, to ensure the continuity of multimedia playback.
本实施例提供的多媒体的处理方法,在播放多媒体过程中,通过识别虚拟现实设备的操作的范围在多媒体中预设的触发区域内,判断虚拟现实设备的操作是否满足预设的与该触发区域对应的触发条件,其中,触发条件有多种方式,可根据用户的习惯进行设定,提高了用户操作的便捷性;若满足该触发区域对应的触发条件,则根据预设的与该触发区域对 应的触发动作,并根据触发动作对多媒体执行相应的处理,其中,触发动作可为暂停、快进、快退、播放和切换播放等,当触发动作为切换播放动作时,切换播放与所述触发区域对应的关联内容,可以使多媒体内容更加丰富,与用户有更多的交互内容。本实施例提供的多媒体的处理方法,解决了现有技术中采用虚拟现实设备播放多媒体时,由于需要外部设备进行操作而造成的用户对于虚拟世界中的显示控制不便的问题,从而有效地提高了人机交互的便捷性。The multimedia processing method provided in this embodiment determines whether the operation of the virtual reality device satisfies the preset and the trigger region by identifying the range of the operation of the virtual reality device in the trigger region preset in the multimedia during the process of playing the multimedia. Corresponding triggering conditions, wherein the triggering conditions have multiple modes, which can be set according to the user's habits, thereby improving the convenience of the user's operation; if the triggering condition corresponding to the triggering region is satisfied, according to the preset and the triggering region Correct The triggering action should be performed, and the corresponding processing is performed on the multimedia according to the triggering action, wherein the triggering action may be pause, fast forward, fast reverse, play, and switch play, etc., when the trigger action is a switch play action, the play is switched and the play The associated content corresponding to the trigger area can make the multimedia content richer and have more interactive content with the user. The multimedia processing method provided in this embodiment solves the problem that the user inconveniences the display control in the virtual world caused by the operation of the external device when the multimedia device is used in the prior art, thereby effectively improving the problem. The convenience of human-computer interaction.
具体的,该多媒体的处理方法可应用于娱乐、医疗、航天、房地产、教育、旅游、军事等多个领域中。Specifically, the multimedia processing method can be applied to various fields such as entertainment, medical, aerospace, real estate, education, tourism, military, and the like.
例如,本实施例提供的多媒体的处理方法应用在旅游领域中,多媒体可以为在旅游景区拍摄的全景视频,该旅游景区的全景视频中的各个景点出预设有触发区域,同时也预设有与触发区域对应的触发条件,例如“虚拟现实设备可视范围中心点在该触发区域停留时间为3秒时触发”,触发后执行的触发动作为“切换播放与该景点的相关的历史介绍视频”。用户可以在虚拟现实设备中请求播放该旅游景区的全景视频,则虚拟现实设备接收播放请求并进行播放,在播放多媒体过程中,若识别虚拟现实设备可视范围中心点在中预设的触发区域内,则查询旅游景区的全景视频,获取预设的与触发区域对应的触发条件,并判断虚拟现实设备的操作是否满足触发条件,即“虚拟现实设备可视范围中心点在该触发区域停留时间为3秒时触发”。若判断出满足触发区域对应的触发条件,则查询旅游景区的全景视频,获取预设的与触发区域对应的触发动作,即“切换播放与该景点的相关的历史介绍视频”,则获取与所述触发区域对应的关联内容(与该景点的相关的历史介绍视频)的保存地址;根据所述保存地址,获取所述关联内容,并根据所述切换播放动作,从所述多媒体切换播放与该景点的相关的历史介绍视频;获取切换时间点信息;在与该景点的相关的历史介绍视频播放完成之后,根据所述切换时间点信息,切换播放旅游景区的全景视频,以保证播放的连续性。通过视线停留触发相应的情节,使得用户在观看旅游景区的全景视频时,更方便的进行操作,提升人机交互的便捷性,同时对全景视频提供了更多的扩展内容,满足不同用户的需求,提高了用户的体验。 For example, the multimedia processing method provided in this embodiment is applied in the field of tourism, and the multimedia may be a panoramic video captured in a tourist scenic spot, and each scenic spot in the panoramic video of the tourist scenic spot is pre-set with a triggering region, and is also pre-configured. The triggering condition corresponding to the triggering area, for example, “the virtual reality device visible range center point is triggered when the triggering area staying time is 3 seconds”, and the triggering action performed after the triggering is “switching and playing the historical introduction video related to the attraction point. ". The user can request to play the panoramic video of the tourist attraction in the virtual reality device, and the virtual reality device receives the play request and plays the same. In the process of playing the multimedia, if the virtual reality device is in the visible range, the center point is in the preset trigger region. Then, the panoramic video of the tourist scenic spot is queried, the preset triggering condition corresponding to the triggering area is obtained, and it is determined whether the operation of the virtual reality device satisfies the triggering condition, that is, “the virtual reality device visible range center point stays in the triggering area. Trigger when 3 seconds." If it is determined that the trigger condition corresponding to the trigger area is met, the panoramic video of the tourist attraction is queried, and a preset trigger action corresponding to the trigger area is obtained, that is, “switching the history introduction video related to the attraction”, and acquiring a storage address of the associated content (the historical introduction video related to the attraction) corresponding to the trigger area; acquiring the related content according to the saved address, and switching playback from the multimedia according to the switching play action Relevant historical introduction video of the scenic spot; obtaining switching time point information; after the completion of the historical introduction video related to the scenic spot, switching the panoramic video of the tourist scenic spot according to the switching time point information to ensure the continuity of the playing . The line of sight stops triggering the corresponding plot, which makes the user more convenient to operate when viewing the panoramic video of the scenic spot, improving the convenience of human-computer interaction, and providing more extended content for the panoramic video to meet the needs of different users. , to improve the user experience.
此外,本实施例提供的多媒体的处理方法在识别虚拟现实设备的操作的范围在多媒体中预设的触发区域内前,还可包括读取并激活多媒体中预设的全部触发区域。当然,触发区域也可以选择部分激活或不激活。当全部激活时,全部触发区域对应的触发条件均为开启,此时满足任一触发区域的触发条件则执行对应的执行动作;而当部分激活时,只能在已经激活的触发区域中满足该区域对应的触发条件是才执行对应的动作;而不激活时,全部触发区域对应的触发条件均为关闭,则不执行任何动作。用户可以根据需要对不感兴趣的内容进行排除,满足不同用户需求,提升了人机交互体验。In addition, the processing method of the multimedia provided by the embodiment may further include reading and activating all the trigger regions preset in the multimedia before the range of the operation of the virtual reality device is recognized in the trigger region preset in the multimedia. Of course, the trigger area can also be selected to be partially activated or deactivated. When all are activated, the trigger conditions corresponding to all the trigger regions are all enabled. At this time, the triggering condition of any trigger region is satisfied, and the corresponding execution action is performed; and when the partial activation is performed, the trigger region can only be satisfied in the activated trigger region. The trigger condition corresponding to the area is to execute the corresponding action; when it is not activated, the trigger conditions corresponding to all the trigger areas are all off, and no action is performed. Users can exclude content that is not of interest according to their needs, meet the needs of different users, and improve the human-computer interaction experience.
图3为本发明多媒体的处理装置实施例一的结构示意图。如图3所示,该装置具体包括:第一收发模块31,用于接收播放请求,所述播放请求包括:待播放的多媒体;播放模块32,用于根据所述播放请求,播放所述多媒体;识别模块,用于在播放所述多媒体过程中,识别虚拟现实设备的操作的范围是否在所述多媒体中预设的触发区域内;获取模块33,用于若所述识别模块识别出所述虚拟现实设备的操作的范围在所述多媒体的触发区域内,则查询所述多媒体,获取预设的与所述触发区域对应的触发条件;判断模块34,用于判断所述虚拟现实设备的操作是否满足所述触发条件;所述获取模块33还用于若判断模块34判断出所述虚拟现实设备的操作满足所述触发条件,查询所述多媒体,获取预设的与所述触发区域对应的触发动作;处理模块35,用于根据所述触发动作对所述多媒体执行相应得处理。FIG. 3 is a schematic structural diagram of Embodiment 1 of a multimedia processing apparatus according to the present invention. As shown in FIG. 3, the device specifically includes: a first transceiver module 31, configured to receive a play request, the play request includes: a multimedia to be played, and a play module 32, configured to play the multimedia according to the play request An identification module, configured to identify, in the process of playing the multimedia, whether a range of operations of the virtual reality device is within a trigger region preset in the multimedia; an obtaining module 33, configured to: if the identification module identifies the The operation of the virtual reality device is performed in the triggering area of the multimedia, and the multimedia is queried to obtain a preset trigger condition corresponding to the trigger area. The determining module 34 is configured to determine the operation of the virtual reality device. Whether the triggering condition is met; the obtaining module 33 is further configured to: if the determining module 34 determines that the operation of the virtual reality device meets the triggering condition, query the multimedia, and obtain a preset corresponding to the triggering area. Triggering an action; the processing module 35 is configured to perform corresponding processing on the multimedia according to the triggering action.
本实施例多媒体的处理装置具体实现过程为,第一收发模块31接收播放请求,播放模块32根据播放请求,播放多媒体;在播放多媒体过程中,识别模块识别虚拟现实设备的操作的范围是否在多媒体中预设的触发区域内;获取模块33若识别模块识别出虚拟现实设备的操作的范围在多媒体的触发区域内,则查询多媒体,获取预设的与触发区域对应的触发条件;判断模块34判断虚拟现实设备的操作是否满足触发条件;获取模块33还用于若判断模块34判断出虚拟现实设备的操作满足触发条件,查询多媒体,获取预设的与触发区域对应的触发动作;最后,处理模块35根据触发动作对多媒体执行相应得处理。本实施例的装置解决了现有技术中采用虚拟现实设备播放多媒体时,由于需要外部设备进行操作而造 成的用户对于虚拟世界中的显示控制不便的问题,从而有效地提高了人机交互便捷性。The multimedia processing device in this embodiment is implemented by: the first transceiver module 31 receives the play request, and the play module 32 plays the multimedia according to the play request; in the process of playing the multimedia, the recognition module identifies whether the scope of the operation of the virtual reality device is in the multimedia If the recognition module recognizes that the range of the operation of the virtual reality device is within the trigger region of the multimedia, the module 33 queries the multimedia to obtain a preset trigger condition corresponding to the trigger region; the determining module 34 determines Whether the operation of the virtual reality device meets the trigger condition; the obtaining module 33 is further configured to: if the determining module 34 determines that the operation of the virtual reality device meets the trigger condition, query the multimedia, and obtain a preset trigger action corresponding to the trigger region; and finally, the processing module 35 performs corresponding processing on the multimedia according to the triggering action. The device in this embodiment solves the problem that when the multimedia device is used to play multimedia in the prior art, the external device is required to operate. The user has an inconvenient control over the display in the virtual world, thereby effectively improving the convenience of human-computer interaction.
进一步的,在本发明装置的实施例二中,在上述图3所示实例的基础上,若所述触发动作为切换播放动作,所述获取模块33具体用于获取与所述触发区域对应的关联内容的保存地址;并根据所述保存地址,获取所述关联内容;Further, in the second embodiment of the apparatus of the present invention, on the basis of the example shown in FIG. 3, if the triggering action is a switching play action, the acquiring module 33 is specifically configured to acquire a corresponding to the trigger area. a saved address of the associated content; and obtaining the associated content according to the saved address;
则所述处理模块35具体用于根据所述切换播放动作,从所述多媒体切换播放所述关联内容。The processing module 35 is specifically configured to switch to play the related content from the multimedia according to the switching play action.
进一步的,所述获取模块33还用于获取切换时间点信息;Further, the obtaining module 33 is further configured to acquire switching time point information;
则所述处理模块35还用于在所述关联内容播放完成之后,根据所述切换时间点信息,切换播放所述多媒体。The processing module 35 is further configured to switch to play the multimedia according to the switching time point information after the related content is played.
可选的,触发动作包括如下一种:暂停、快进、快退、播放和切换播放。Optionally, the trigger action includes the following: pause, fast forward, rewind, play, and switch play.
可选的,所述判断模块34具体用于判断所述虚拟现实设备的操作停留在所述触发区域的时长是否满足预设时间条件;和/或,Optionally, the determining module 34 is specifically configured to determine whether the duration of the operation of the virtual reality device staying in the trigger area meets a preset time condition; and/or,
所述判断模块34还用于判断所述虚拟现实设备在所述触发区域中的操作次数是否满足预设次数;和/或,The determining module 34 is further configured to determine whether the number of operations of the virtual reality device in the trigger area meets a preset number of times; and/or,
所述判断模块34还用于判断所述虚拟现实设备在所述触发区域中的操作轨迹是否满足预设轨迹。The determining module 34 is further configured to determine whether an operation trajectory of the virtual reality device in the trigger area satisfies a preset trajectory.
本实施例提供的多媒体的处理装置,第一收发模块31接收播放请求,播放模块32根据播放请求,播放多媒体;在播放多媒体过程中,识别模块识别虚拟现实设备的操作的范围是否在多媒体中预设的触发区域内;获取模块33若识别模块识别出虚拟现实设备的操作的范围在多媒体的触发区域内,则查询多媒体,获取预设的与触发区域对应的触发条件;判断模块34判断虚拟现实设备的操作是否满足触发条件,其中,而触发条件有多种方式,可根据用户的习惯进行设定,判断模块34具体可以判断触发条件是否满足上述多种方式中的任意一种;获取模块33还用于若判断模块34判断出虚拟现实设备的操作满足触发条件,查询多媒体,获取预设的与触发区域对应的触发动作;最后,处理模块35根据触发动作对多媒体执行相应得处理。其中,触发动作可为暂停、快进、快退、播放和切换播放等,当触发动作为切换播放动作时,处理模块35切换播放与所 述触发区域对应的关联内容,可以使多媒体内容更加丰富,与用户有更多的交互内容。本实施例提供的多媒体的处理方法,解决了现有技术中采用虚拟现实设备播放多媒体时,由于需要外部设备进行操作而造成的用户对于虚拟世界中的显示控制不便的问题,从而有效地提高了人机交互便捷性。In the multimedia processing device provided by the embodiment, the first transceiver module 31 receives the play request, and the play module 32 plays the multimedia according to the play request. In the process of playing the multimedia, the recognition module identifies whether the scope of the operation of the virtual reality device is pre-recorded in the multimedia. If the identification module recognizes that the range of operation of the virtual reality device is within the trigger region of the multimedia, the query module 33 queries the multimedia to obtain a preset trigger condition corresponding to the trigger region; the determining module 34 determines the virtual reality. Whether the operation of the device meets the triggering condition, wherein the triggering condition has multiple modes, and the setting may be performed according to the user's habits, and the determining module 34 may specifically determine whether the triggering condition satisfies any one of the foregoing multiple modes; the obtaining module 33 The method further includes: if the determining module 34 determines that the operation of the virtual reality device meets the triggering condition, queries the multimedia, and acquires a preset triggering action corresponding to the triggering region; finally, the processing module 35 performs corresponding processing on the multimedia according to the triggering action. The triggering action may be pause, fast forward, fast reverse, play, and switch play. When the trigger action is a switch play action, the processing module 35 switches the play and the play. The associated content corresponding to the trigger area can make the multimedia content richer and have more interactive content with the user. The multimedia processing method provided in this embodiment solves the problem that the user inconveniences the display control in the virtual world caused by the operation of the external device when the multimedia device is used in the prior art, thereby effectively improving the problem. Human-computer interaction convenience.
图4为本发明多媒体的处理系统实施例的结构示意图。如图4所示,本实施例的多媒体的处理系统,包括终端设备101和如3图所示的多媒体的处理装置102。其中,所述多媒体的处理装置102用于执行多媒体的处理方法实施例一或实施例二的方法。4 is a schematic structural diagram of an embodiment of a multimedia processing system according to the present invention. As shown in FIG. 4, the multimedia processing system of this embodiment includes a terminal device 101 and a multimedia processing device 102 as shown in FIG. The multimedia processing device 102 is configured to execute the method of Embodiment 1 or Embodiment 2 of the multimedia processing method.
其中,如图5所示,所述终端设备101包括:As shown in FIG. 5, the terminal device 101 includes:
第二收发模块51,用于接收待编辑请求,所述待编辑请求包括:待编辑的多媒体,待编辑的触发区域,以及与所述待编辑的触发区域对应的触发信息,其中,所述触发信息包括:触发条件和触发动作,或者触发条件、触发动作以及关联内容;The second transceiver module 51 is configured to receive a request to be edited, where the to-be-edited request includes: a multimedia to be edited, a trigger area to be edited, and trigger information corresponding to the trigger area to be edited, where the trigger The information includes: a trigger condition and a trigger action, or a trigger condition, a trigger action, and an associated content;
编辑模块52,用于根据所述待编辑请求,在所述待编辑的多媒体中获取与所述待编辑的触发区域对应的处理区域;在所述处理区域中添加与所述待编辑的触发区域对应的触发信息,以生成所述待播放的多媒体;The editing module 52 is configured to acquire, according to the to-be-edited request, a processing area corresponding to the triggering area to be edited in the multimedia to be edited, and add a triggering area to be edited in the processing area Corresponding trigger information to generate the multimedia to be played;
所述第二收发模块51还用于将生成的所述待播放的多媒体发送给所述多媒体的处理装置。The second transceiver module 51 is further configured to send the generated multimedia to be played to the multimedia processing device.
本实施例中,终端设备对接受到的多媒体依据编辑请求进行编辑处理,并将生成的所述待播放的多媒体发送给所述多媒体的处理装置。其中,终端设备可以是计算机、智能手机、平板电脑等外部处理装置,当然也可与设置在虚拟现实设备上,使得虚拟现实设备既具备多媒体编辑功能,同时也能对过媒体进行播放。第二收发模块51可以将待播放的多媒体直接发送给多媒体的处理装置,也可以发布到娱乐平台上,供多媒体的处理装置下载。In this embodiment, the terminal device performs editing processing on the received multimedia according to the editing request, and sends the generated multimedia to be played to the multimedia processing device. The terminal device may be an external processing device such as a computer, a smart phone, or a tablet computer. Of course, the terminal device may be disposed on the virtual reality device, so that the virtual reality device has both a multimedia editing function and a media playback. The second transceiver module 51 can directly send the multimedia to be played to the multimedia processing device, or can be distributed to the entertainment platform for the multimedia processing device to download.
本发明实施例所提供的装置和系统,其实现原理及产生的技术效果和前述方法实施例相同,为简要描述,装置和系统实施例部分未提及之处,可参考前述方法实施例中相应内容。The implementation principle and the technical effects of the device and the system provided by the embodiments of the present invention are the same as those of the foregoing method embodiments. For a brief description, where the device and system embodiments are not mentioned, reference may be made to the foregoing method embodiments. content.
附图中的流程图和框图显示了根据本发明的多个实施例的系统、方 法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分,所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或动作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowchart and block diagrams in the Figures illustrate systems, parties in accordance with various embodiments of the present invention. Architecture, functionality, and operation of possible implementations of methods and computer program products. In this regard, each block of the flowchart or block diagram can represent a module, a program segment, or a portion of code that includes one or more of the Executable instructions. It should also be noted that in some alternative implementations, the functions noted in the blocks may also occur in a different order than that illustrated in the drawings. For example, two consecutive blocks may be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts, can be implemented in a dedicated hardware-based system that performs the specified function or function. Or it can be implemented by a combination of dedicated hardware and computer instructions.
本领域普通技术人员可以理解:实现上述各方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成。前述的程序可以存储于一计算机可读取存储介质中。该程序在执行时,执行包括上述各方法实施例的步骤;而前述的存储介质包括:ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。One of ordinary skill in the art will appreciate that all or part of the steps to implement the various method embodiments described above may be accomplished by hardware associated with the program instructions. The aforementioned program can be stored in a computer readable storage medium. The program, when executed, performs the steps including the foregoing method embodiments; and the foregoing storage medium includes various media that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.
最后应说明的是:以上各实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述各实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。 Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that The technical solutions described in the foregoing embodiments may be modified, or some or all of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present invention. range.

Claims (11)

  1. 一种多媒体的处理方法,其特征在于,包括:A multimedia processing method, comprising:
    接收播放请求,所述播放请求包括:待播放的多媒体;Receiving a play request, where the play request includes: a multimedia to be played;
    根据所述播放请求,播放所述多媒体;Playing the multimedia according to the play request;
    在播放所述多媒体过程中,若识别虚拟现实设备的操作的范围在所述多媒体中预设的触发区域内,则查询所述多媒体,获取预设的与所述触发区域对应的触发条件,并判断所述虚拟现实设备的操作是否满足所述触发条件;In the process of playing the multimedia, if the range of the operation of the virtual reality device is within the preset triggering area of the multimedia, querying the multimedia, acquiring a preset trigger condition corresponding to the trigger area, and Determining whether the operation of the virtual reality device meets the trigger condition;
    若判断出所述虚拟现实设备的操作满足所述触发区域对应的触发条件,则查询所述多媒体,获取预设的与所述触发区域对应的触发动作,并根据所述触发动作对所述多媒体执行相应的处理。If it is determined that the operation of the virtual reality device meets the trigger condition corresponding to the trigger area, querying the multimedia, acquiring a preset trigger action corresponding to the trigger area, and performing the multimedia according to the trigger action Perform the appropriate processing.
  2. 根据权利要求1所述的方法,其特征在于,所述获取预设的与所述触发区域对应的触发动作,并根据所述触发动作对所述多媒体执行相应的处理,包括:The method according to claim 1, wherein the acquiring a preset trigger action corresponding to the trigger area, and performing corresponding processing on the multimedia according to the trigger action comprises:
    若获取预设的与所述触发区域对应的触发动作为切换播放动作,则获取与所述触发区域对应的关联内容的保存地址;Obtaining, by the preset triggering action corresponding to the triggering area, a switching play action, acquiring a save address of the associated content corresponding to the trigger area;
    根据所述保存地址,获取所述关联内容,并根据所述切换播放动作,从所述多媒体切换播放所述关联内容。Obtaining the associated content according to the save address, and switching the related content from the multimedia according to the switching play action.
  3. 根据权利要求2所述的方法,其特征在于,还包括:The method of claim 2, further comprising:
    获取切换时间点信息;Obtain switching time point information;
    在所述关联内容播放完成之后,根据所述切换时间点信息,切换播放所述多媒体。After the related content is played, the multimedia is switched and played according to the switching time point information.
  4. 根据权利要求1所述的方法,其特征在于,所述触发动作包括如下一种:暂停、快进、快退、播放和切换播放。The method according to claim 1, wherein the triggering action comprises the following: pause, fast forward, rewind, play, and switch play.
  5. 根据权利要求1-4中任意一项所述的方法,其特征在于,所述判断所述虚拟现实设备的操作是否满足所述触发区域对应的触发条件,包括:The method according to any one of claims 1 to 4, wherein the determining whether the operation of the virtual reality device meets a trigger condition corresponding to the trigger area comprises:
    判断所述虚拟现实设备的操作停留在所述触发区域的时长是否满足预设时间条件;和/或,Determining whether the duration of the operation of the virtual reality device stays in the trigger area meets a preset time condition; and/or,
    判断所述虚拟现实设备在所述触发区域中的操作次数是否满足预设次数;和/或,Determining whether the number of operations of the virtual reality device in the trigger area meets a preset number of times; and/or,
    判断所述虚拟现实设备在所述触发区域中的操作轨迹是否满足预设轨 迹。Determining whether the operation track of the virtual reality device in the trigger area meets a preset track trace.
  6. 一种多媒体的处理装置,其特征在于,包括:A multimedia processing device, comprising:
    第一收发模块,用于接收播放请求,所述播放请求包括:待播放的多媒体;a first transceiver module, configured to receive a play request, where the play request includes: a multimedia to be played;
    播放模块,用于根据所述播放请求,播放所述多媒体;a playing module, configured to play the multimedia according to the playing request;
    识别模块,用于在播放所述多媒体过程中,识别虚拟现实设备的操作的范围是否在所述多媒体中预设的触发区域内;An identification module, configured to identify, in a process of playing the multimedia, whether a range of operations of the virtual reality device is within a trigger region preset in the multimedia;
    获取模块,用于若所述识别模块识别出所述虚拟现实设备的操作的范围在所述多媒体的触发区域内,则查询所述多媒体,获取预设的与所述触发区域对应的触发条件;And an obtaining module, configured to: if the identifier of the operation of the virtual reality device is in the triggering area of the multimedia, query the multimedia, and obtain a preset trigger condition corresponding to the trigger area;
    判断模块,用于判断所述虚拟现实设备的操作是否满足所述触发条件;a determining module, configured to determine whether the operation of the virtual reality device meets the trigger condition;
    所述获取模块还用于若判断模块判断出所述虚拟现实设备的操作满足所述触发条件,查询所述多媒体,获取预设的与所述触发区域对应的触发动作;The obtaining module is further configured to: if the determining module determines that the operation of the virtual reality device meets the trigger condition, query the multimedia, and obtain a preset trigger action corresponding to the trigger area;
    处理模块,用于根据所述触发动作对所述多媒体执行相应得处理。And a processing module, configured to perform corresponding processing on the multimedia according to the triggering action.
  7. 根据权利要求6所述的装置,其特征在于,若所述触发动作为切换播放动作,所述获取模块具体用于获取与所述触发区域对应的关联内容的保存地址;并根据所述保存地址,获取所述关联内容;The device according to claim 6, wherein the acquiring module is specifically configured to acquire a save address of the associated content corresponding to the trigger region, and according to the save address, if the triggering action is a switch play action Obtaining the associated content;
    则所述处理模块具体用于根据所述切换播放动作,从所述多媒体切换播放所述关联内容。The processing module is specifically configured to switch to play the related content from the multimedia according to the switching play action.
  8. 根据权利要求7所述的装置,其特征在于,所述获取模块还用于获取切换时间点信息;The device according to claim 7, wherein the obtaining module is further configured to acquire switching time point information;
    则所述处理模块还用于在所述关联内容播放完成之后,根据所述切换时间点信息,切换播放所述多媒体。And the processing module is further configured to switch to play the multimedia according to the switching time point information after the related content is played.
  9. 根据权利要求6所述的装置,其特征在于,触发动作包括如下一种:The apparatus according to claim 6, wherein the triggering action comprises the following:
    暂停、快进、快退、播放和切换播放。Pause, fast forward, rewind, play, and switch playback.
  10. 根据权利要求6-9中任意一项所述的装置,其特征在于,所述判断模块具体用于判断所述虚拟现实设备的操作停留在所述触发区域的时长是否满足预设时间条件;和/或,The device according to any one of claims 6-9, wherein the determining module is specifically configured to determine whether the duration of the operation of the virtual reality device staying in the triggering region meets a preset time condition; /or,
    所述判断模块还用于判断所述虚拟现实设备在所述触发区域中的操作次数是否满足预设次数;和/或, The determining module is further configured to determine whether the number of operations of the virtual reality device in the trigger area meets a preset number of times; and/or,
    所述判断模块还用于判断所述虚拟现实设备在所述触发区域中的操作轨迹是否满足预设轨迹。The determining module is further configured to determine whether the operation trajectory of the virtual reality device in the trigger area satisfies a preset trajectory.
  11. 一种多媒体的处理系统,包括终端设备和如权利要求6-10任意一项所述的多媒体的处理装置,其中,A multimedia processing system, comprising: a terminal device and a multimedia processing device according to any one of claims 6-10, wherein
    所述终端设备包括:The terminal device includes:
    第二收发模块,用于接收待编辑请求,所述待编辑请求包括:待编辑的多媒体,待编辑的触发区域,以及与所述待编辑的触发区域对应的触发信息,其中,所述触发信息包括:触发条件和触发动作,或者触发条件、触发动作以及关联内容;a second transceiver module, configured to receive a request to be edited, where the to-be-edited request includes: a multimedia to be edited, a trigger area to be edited, and trigger information corresponding to the trigger area to be edited, where the trigger information Including: trigger condition and trigger action, or trigger condition, trigger action and associated content;
    编辑模块,用于根据所述待编辑请求,在所述待编辑的多媒体中获取与所述待编辑的触发区域对应的处理区域;在所述处理区域中添加与所述待编辑的触发区域对应的触发信息,以生成所述待播放的多媒体;An editing module, configured to acquire, according to the to-be-edited request, a processing area corresponding to the triggering area to be edited in the multimedia to be edited; and add a triggering area corresponding to the to-be-edited area in the processing area Triggering information to generate the multimedia to be played;
    所述第二收发模块还用于将生成的所述待播放的多媒体发送给所述多媒体的处理装置。 The second transceiver module is further configured to send the generated multimedia to be played to the multimedia processing device.
PCT/CN2016/096293 2016-06-02 2016-08-22 Multimedia processing method, apparatus, and system WO2017206372A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610389143.5 2016-06-02
CN201610389143.5A CN106060670A (en) 2016-06-02 2016-06-02 Multimedia processing method, device and system

Publications (1)

Publication Number Publication Date
WO2017206372A1 true WO2017206372A1 (en) 2017-12-07

Family

ID=57169716

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/096293 WO2017206372A1 (en) 2016-06-02 2016-08-22 Multimedia processing method, apparatus, and system

Country Status (2)

Country Link
CN (1) CN106060670A (en)
WO (1) WO2017206372A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103561239A (en) * 2013-11-07 2014-02-05 国家电网公司 On-spot work video monitoring method
US20140347263A1 (en) * 2013-05-23 2014-11-27 Fastvdo Llc Motion-Assisted Visual Language For Human Computer Interfaces
CN204666958U (en) * 2015-06-09 2015-09-23 李周胜 Virtual reality glasses
CN105159522A (en) * 2015-07-22 2015-12-16 深圳多新哆技术有限责任公司 Method for response of virtual reality display device to operation of peripheral device
CN105302294A (en) * 2015-09-07 2016-02-03 哈尔滨市一舍科技有限公司 Interactive virtual reality presentation device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140247263A1 (en) * 2013-03-04 2014-09-04 Microsoft Corporation Steerable display system
CN204031355U (en) * 2014-07-09 2014-12-17 青岛歌尔声学科技有限公司 A kind of wear-type visual device and video system
CN105511632B (en) * 2016-01-25 2020-04-28 京东方科技集团股份有限公司 Signal acquisition device, virtual reality equipment and control method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140347263A1 (en) * 2013-05-23 2014-11-27 Fastvdo Llc Motion-Assisted Visual Language For Human Computer Interfaces
CN103561239A (en) * 2013-11-07 2014-02-05 国家电网公司 On-spot work video monitoring method
CN204666958U (en) * 2015-06-09 2015-09-23 李周胜 Virtual reality glasses
CN105159522A (en) * 2015-07-22 2015-12-16 深圳多新哆技术有限责任公司 Method for response of virtual reality display device to operation of peripheral device
CN105302294A (en) * 2015-09-07 2016-02-03 哈尔滨市一舍科技有限公司 Interactive virtual reality presentation device

Also Published As

Publication number Publication date
CN106060670A (en) 2016-10-26

Similar Documents

Publication Publication Date Title
US11625157B2 (en) Continuation of playback of media content by different output devices
WO2020010815A1 (en) Method for selecting background music and capturing video, device, terminal apparatus, and medium
WO2017166622A1 (en) Video playing method, playing terminal and media server
CN101490762B (en) A device and a method for playing audio-video content
WO2017181598A1 (en) Method and device for playing video
KR101944456B1 (en) Information processing program, and information processing method
WO2018000661A1 (en) Barrage display method and apparatus
CN109660817B (en) Video live broadcast method, device and system
CN109257611A (en) A kind of video broadcasting method, device, terminal device and server
CN109640129B (en) Video recommendation method and device, client device, server and storage medium
US20110246560A1 (en) Social context for inter-media objects
US9723366B2 (en) System and method to provide supplemental content to a video player
EP3748973A1 (en) Method and system for programmable loop recording
WO2017181597A1 (en) Method and device for video playback
WO2020134560A1 (en) Live broadcast room switching method and apparatus, and terminal, server and storage medium
WO2017096961A1 (en) Video playing processing method, player, and terminal device
GB2553912A (en) Methods, systems, and media for synchronizing media content using audio timecodes
WO2017185782A1 (en) Method and device for customizing alarm clock reminder
KR20150046619A (en) image outputting device
CN109618229A (en) Association playback method, device, server and the storage medium of audio-video
CN113177134A (en) Music playing method and device, electronic equipment and storage medium
US9525854B2 (en) Information processing method and electronic device
US20170264962A1 (en) Method, system and computer program product
US20230054388A1 (en) Method and apparatus for presenting audiovisual work, device, and medium
WO2017206372A1 (en) Multimedia processing method, apparatus, and system

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16903754

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 11.03.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16903754

Country of ref document: EP

Kind code of ref document: A1