CN107197339B - Display control method and device of film bullet screen and head-mounted display equipment - Google Patents
Display control method and device of film bullet screen and head-mounted display equipment Download PDFInfo
- Publication number
- CN107197339B CN107197339B CN201710229700.1A CN201710229700A CN107197339B CN 107197339 B CN107197339 B CN 107197339B CN 201710229700 A CN201710229700 A CN 201710229700A CN 107197339 B CN107197339 B CN 107197339B
- Authority
- CN
- China
- Prior art keywords
- bullet screen
- data
- current
- display control
- head
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8543—Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a display control method and a display control device for a film bullet screen and head-mounted display equipment, wherein the method comprises the following steps: receiving motion data which is acquired by a sensor device and represents the motion posture of the head-mounted display equipment; determining a current viewing orientation for viewing the film through the head-mounted display device according to the motion data; acquiring bullet screen data, wherein the bullet screen data comprises bullet screen content and a viewing direction corresponding to the bullet screen content; extracting bullet screen content corresponding to the current viewing position from the bullet screen data to serve as a current bullet screen; and executing the operation of displaying the current bullet screen.
Description
Technical Field
The invention relates to the technical field of virtual reality film bullet screen output, in particular to a display control method of a film bullet screen, a display control device of the film bullet screen and a head-mounted display device.
Background
With the gradual maturity of Virtual Reality (VR) technology, VR videos are becoming more popular, and many people have an opportunity to contact VR helmets and watch VR movies on various platforms on line by wearing the helmets. VR sees the shadow and have very obvious advantage than the tradition, can provide an immersive experience, but VR sees the shadow and does not support traditional video playback platform's bullet screen function at present, and this makes VR see the shadow and can't build virtual scene of enclosing in real time through the bullet screen, and then makes the viewer can't experience interest and the sense of participation that the bullet screen brought when watching the VR film.
Disclosure of Invention
An object of an embodiment of the present invention is to provide a technical solution for performing display control on a VR film bullet screen.
According to a first aspect of the present invention, there is provided a display control method of a movie screen, comprising:
receiving motion data which is acquired by a sensor device of the head-mounted display equipment and represents the motion posture of the head-mounted display equipment;
determining a current viewing orientation for viewing the film through the head-mounted display device according to the motion data;
acquiring bullet screen data, wherein the bullet screen data comprises bullet screen content and a viewing direction corresponding to the bullet screen content;
extracting the bullet screen content corresponding to the current viewing position from the bullet screen data to serve as a current bullet screen;
and executing the operation of displaying the current bullet screen.
Optionally, the barrage data further includes viewing time corresponding to the barrage content;
the extracting of the bullet screen content corresponding to the current viewing position from the bullet screen data as the current bullet screen comprises:
and extracting the bullet screen content corresponding to the current viewing position and the current viewing time from the bullet screen data to be used as the current bullet screen.
Optionally, the acquiring the bullet screen data includes:
acquiring bullet screen content input through an input device of the head-mounted display equipment;
determining a viewing direction when the input bullet screen content is received according to the motion data;
and determining that the viewing direction corresponding to the input barrage content at least comprises the viewing direction when the input barrage content is received.
Optionally, the input device comprises at least one of a voice input device, a handle input device and a virtual keyboard input device.
Optionally, the display control method further includes:
forming incremental bullet screen data comprising the input bullet screen content and a viewing position corresponding to the input bullet screen content;
and sending the incremental bullet screen data to a background server.
Optionally, the acquiring the bullet screen data includes:
and acquiring bullet screen data of which the viewing position comprises the current viewing position from a background server.
Optionally, the display control method further includes, before the acquiring the bullet screen data:
and detecting whether the bullet screen function is started, and if so, acquiring bullet screen data.
According to a second aspect of the present invention, there is also provided a display control apparatus of a movie screen, comprising:
the device comprises a motion data receiving module, a motion data processing module and a motion data processing module, wherein the motion data receiving module is used for receiving motion data which are acquired by a sensor device of the head-mounted display equipment and represent the motion posture of the head-mounted display equipment;
the viewing orientation determining module is used for determining the current viewing orientation of the film viewed through the head-mounted display equipment according to the motion data;
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring bullet screen data, and the bullet screen data comprises bullet screen content and a viewing position corresponding to the bullet screen content;
the current bullet screen extraction module is used for extracting bullet screen content corresponding to the current viewing position from the bullet screen data to serve as a current bullet screen; and the number of the first and second groups,
and the execution module is used for executing the operation of displaying the current bullet screen.
According to a third aspect of the present invention, there is also provided a display control apparatus for a movie screen, comprising a memory for storing instructions for controlling the processor to operate to execute the display control method according to the first aspect of the present invention, and a processor.
According to a fourth aspect of the present invention, there is also provided a head mounted display device comprising a display apparatus and a sensor apparatus for collecting motion data representing a motion posture of the head mounted display device, the head mounted display device further comprising the display control apparatus according to the second or third aspect of the present invention.
One beneficial effect of the present invention is that, in the display control method, apparatus and head-mounted display device of the present invention, the barrage data includes the barrage content and the viewing time corresponding to the barrage content, and also includes the viewing position corresponding to the barrage content, so as to further perform control of displaying the corresponding barrage content according to the current viewing position of the viewer in the VR movie viewing, for example, 360 degrees, to ensure that the displayed barrage content matches the movie content viewed in the current viewing position, thereby implementing the barrage function of VR movie viewing.
Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a definition of coordinate axes and motion gestures of a head-mounted display device according to the present invention.
Fig. 2 is a flowchart illustrating a display control method for a movie screen according to an embodiment of the present invention;
FIG. 3 is a schematic flow chart diagram illustrating one embodiment of obtaining incremental barrage data;
fig. 4 is a block schematic diagram of an embodiment of a display control apparatus for a film bullet according to the present invention;
FIG. 5 is a block schematic diagram of one embodiment of the acquisition module of FIG. 4;
fig. 6 is a block schematic diagram of another embodiment of a display control apparatus for a film bullet according to the present invention;
fig. 7 is a block schematic diagram of a hardware configuration of a display control apparatus for a film bullet according to the present invention.
FIG. 8 is a block schematic diagram of one embodiment of a head mounted display device according to the present invention.
Detailed Description
Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
Fig. 2 is a flowchart illustrating a bullet screen display control performed by the display control method according to an embodiment of the present invention.
As shown in fig. 2, the display control method of the present invention includes the steps of:
step S210, receiving motion data representing the motion posture of the head-mounted display device collected by the sensor device.
To represent the motion pose of the head mounted display device, the motion data may include, for example, pitch, roll, and yaw motion data.
The sensor arrangement is an integral part of the head mounted display device, which may comprise at least one of an orientation sensor and a gyroscope sensor.
The orientation sensor, also known as an O-sensor, is used to collect head mounted display angle data, azimuth, pitch, and roll, respectively. azimuth represents the orientation, the angle between the magnetic north pole and the y-axis when returning to the horizontal, pitch represents the angle between the x-axis and the horizontal, and roll represents the angle between the y-axis and the horizontal, wherein the x-axis, the y-axis, the z-axis, pitch, roll, and yaw of the head-mounted display device are defined as shown in FIG. 1.
The gyro sensor may be a three-axis gyro sensor, a six-axis gyro sensor, or a nine-axis gyro sensor.
The triaxial gyroscope sensor is used for sensing all-directional dynamic information of roll, pitch and yaw.
A six-axis gyroscope sensor refers to a structure that combines a three-axis accelerometer and a three-axis gyroscope. Wherein the three-axis accelerometer is used for sensing acceleration information along the directions of an x axis, a y axis and a z axis.
A nine-axis gyroscope sensor, also known as a nine-axis inertial sensor, is composed of a three-axis gyroscope, a three-axis accelerometer, and a three-axis magnetometer. The magnetometer can be used for testing the intensity and direction of magnetic field, and the orientation of the positioning equipment can be used for measuring the included angles between the current equipment and four directions of south, east, west and north.
Here, the sensor device to be configured may be determined according to the above-described method of representing the viewing orientation, so as to facilitate determination of the viewing orientation from the motion data.
And step S220, determining the current viewing orientation of the film viewed through the head-mounted display equipment according to the motion data.
Step S230, acquiring bullet screen data, where the bullet screen data includes bullet screen content and a viewing position corresponding to the bullet screen content.
The bullet screen data can further comprise viewing time corresponding to bullet screen content, so that the viewing time can be matched. The bullet screen data generally includes a plurality of pieces of bullet screen content, each having a respective viewing time and viewing orientation.
The bullet screen data may include bullet screen data that is present before the movie is currently played, and is referred to as original bullet screen data.
The bullet screen data may also include bullet screen data generated during the current play of the movie, referred to as incremental bullet screen data.
The incremental bullet screen data can come from the head-mounted display device and/or a background server which is in communication connection with the head-mounted display device.
The original bullet screen data may further include bullet screen data configured for the movie itself, and may also include incremental bullet screen data generated during the playing process of the completed playing, that is, the original bullet screen data may be the result of the playing accumulation.
The file in which the bullet screen data is recorded may have the same file name as the corresponding movie.
The file for recording the bullet screen data can be stored under the same path as the corresponding film.
The file for recording the bullet screen data can be an XML format file.
In the embodiment where the bullet screen data includes the original bullet screen data, the display control method of the present invention may acquire all the original bullet screen data in step S230.
In the embodiment where the bullet screen data includes the original bullet screen data, the display control method of the present invention may also acquire the original bullet screen data corresponding to (including) the current viewing position in step S230. Further, in step S230, the original bullet screen data of which the viewing position corresponds to the current viewing position and the viewing time corresponds to the current viewing time may also be acquired.
In the embodiment where the bullet screen data includes the incremental bullet screen data, the display control method of the present invention may acquire the incremental bullet screen data corresponding to (including) the current viewing position in step S230. Further, in step S230, incremental bullet screen data in which the viewing position corresponds to the current viewing position and the viewing time corresponds to the current viewing time may be acquired.
This original bullet screen data and increment bullet screen data can acquire through different interfaces to can reduce network transmission's data bulk when acquireing increment bullet screen data, ensure the ageing of increment bullet screen data.
The viewing direction can adopt a longitude and latitude representation method, and the method can be suitable for barrage display control of 360-degree (panoramic) viewing.
The bullet screen data may further include configuration information corresponding to the bullet screen content, where the configuration information includes, for example, font, size, whether to scroll and play, and the like.
The configuration information may have a default value. The method of the present invention may support modifying the configuration information based on viewer input. Fig. 3 is a flow chart illustrating a method for acquiring the incremental bullet screen data.
As shown in fig. 3, the acquiring of the bullet screen data in step S210 may further include the following steps:
step S211, acquiring the bullet screen content input by the viewer through the input device of the head-mounted display device, where the input bullet screen content is the bullet screen content belonging to the incremental bullet screen data.
The input device may be at least one of a voice input device, a grip input device, and a virtual keyboard input device.
The voice input means comprise, for example, a microphone provided for a head-mounted display device.
Step S212, the viewing direction when the inputted bullet screen content is received is determined according to the motion data.
Step S213, determining the viewing time corresponding to the input bullet screen content as the receiving time of the input bullet screen content.
Step S214, determining that the viewing position corresponding to the input bullet screen content at least includes the viewing position when the input bullet screen content is received.
Taking playing a panoramic (360-degree) video as an example, the player specifically fetches pictures from a video source frame by frame, pastes the fetched pictures on the surface of a sphere, and determines the current viewing orientation of a viewer according to motion data, so as to display the picture corresponding to the current viewing orientation on the spherical surface on the display screen.
Therefore, the viewing direction corresponding to the input bullet screen content has a mapping relation with the viewing direction when the input bullet screen content is received, so that the viewing direction when the input bullet screen content is received can be determined according to the motion data, the viewing direction corresponding to the input bullet screen content is further determined, and incremental bullet screen data is formed.
The viewing position corresponding to the input barrage content can be directly the viewing position when the input barrage content is received.
The viewing direction corresponding to the input barrage content can also increase the margin on the basis of the viewing direction when the input barrage content is received, so that viewers with the viewing direction within the range of the margin can see the input barrage content.
Taking the latitude and longitude as an example to represent the viewing orientation, the margin may be a set degree added in both directions of the latitude and the longitude on the basis of the viewing orientation when receiving the input bullet screen content, and the set degree may be such that the display screen still contains most of the screen content when receiving the input bullet screen content within the margin range.
In order to implement the sharing of the incremental barrage data, the display control method of the present invention may further include, after the steps S211 to S214:
step S310, forming incremental bullet screen data including the input bullet screen content, the viewing direction corresponding to the input bullet screen content and the viewing time corresponding to the input bullet screen content.
And step S320, sending the incremental barrage data formed in the step S310 to a background server.
The incremental barrage data can be shared through the step S320, so that the viewer can view not only the barrage content input by the viewer, but also the barrage content input by other viewers, and further create a virtual real-time viewing scene.
In one embodiment of the present invention, the incremental bullet screen data can be acquired at fixed time intervals.
In order to ensure timeliness of the incremental bullet screen data, the set time can be set to be short, for example, 0.5s to 2s, and in one embodiment of the invention, the set time is set to be 1 s.
Therefore, the acquiring of the bullet screen data in the above step S230 may include: and acquiring bullet screen data of which the viewing position comprises the current viewing position from the background server.
The acquiring of the bullet screen data in step S230 may further include: and acquiring bullet screen data of which the watching directions comprise the current watching directions and the watching time corresponds to the current watching time from the background server.
Step S240, extracting the bullet screen content corresponding to the current viewing position from the acquired bullet screen data as the current bullet screen.
The step S240 may further be: and extracting the bullet screen content corresponding to the current viewing position and the current viewing time from the acquired bullet screen data to be used as the current bullet screen.
And step S250, executing the operation of displaying the current bullet screen.
According to this step S250, the display screen displays the current bullet screen on the screen content corresponding to the current viewing position.
Specifically, the picture corresponding to the current bullet screen can be determined according to the viewing time and the viewing direction corresponding to the current bullet screen, so that the picture is rendered according to the configuration information of the current bullet screen.
After step S250, the method may return to step S230 to continue acquiring bullet screen data.
The above steps S210 to S220 and step S230 may be executed by two threads simultaneously or may be executed sequentially in the same thread.
In another embodiment of the present invention, the method of the present invention may further support a setting for turning on or off the barrage function according to the selection of the viewer, and therefore, the method of the present invention may further include: whether the barrage function is started is detected, if so, the step S210 is executed to obtain barrage data.
According to the method, when the head-mounted display equipment plays the VR video, even if the panoramic video is played, the matched barrage content can be displayed on the corresponding display picture, so that the interesting and the taste of VR film watching are increased.
FIG. 4 is a block schematic diagram of one embodiment of a display control apparatus according to the present invention.
As shown in fig. 4, the apparatus for controlling display of a movie screen includes an obtaining module 410, a motion data receiving module 420, a viewing orientation determining module 430, a current screen extracting module 440, and an executing module 450.
The obtaining module 410 is configured to obtain bullet screen data, where the bullet screen data includes bullet screen content and a viewing position corresponding to the bullet screen content.
The bullet screen data may further include a viewing time corresponding to the bullet screen content.
The motion data receiving module 420 is configured to receive motion data representing a motion gesture of the head-mounted display device collected by the sensor device.
The viewing orientation determination module 430 is configured to determine a current viewing orientation for viewing through the head-mounted display device according to the motion data.
The current barrage extracting module 440 is configured to extract the barrage content corresponding to the current viewing position from the barrage data as the current barrage.
The current bullet screen extracting module 440 may be further configured to extract bullet screen content corresponding to the current viewing position and the current viewing time from the bullet screen data as the current bullet screen.
The execution module 450 is configured to execute an operation of displaying the current bullet screen.
In order to achieve the acquisition of the incremental bullet screen data in the movie playing process, the above-mentioned acquisition module 410 may include a portion for acquiring the incremental bullet screen data, and fig. 5 is a block schematic diagram of an embodiment of the above-mentioned acquisition module 410, so as to achieve the acquisition of the incremental bullet screen data.
As shown in fig. 5, the acquiring module 410 may further include an increment bullet screen acquiring unit 411, a viewing time determining unit 412, and a viewing orientation determining unit 413.
The incremental barrage acquiring unit 411 is used for acquiring barrage content input by a viewer through a voice input device.
The incremental bullet screen acquiring unit 411 may be specifically configured to acquire bullet screen contents input by a viewer through a voice input device at set time intervals.
The viewing time determining unit 412 is configured to determine that the viewing time corresponding to the input bullet screen content is the receiving time of the input bullet screen content.
The viewing direction determining unit 413 is configured to determine a viewing direction when the input bullet screen content is received according to the motion data, and determine that the viewing direction corresponding to the input bullet screen content at least includes the viewing direction when the input bullet screen content is received.
The display control device of the invention may further comprise an incremental bullet screen forming module and a sending module (not shown in the figure).
The incremental bullet screen forming module is used for forming incremental bullet screen data which comprise input bullet screen contents and viewing directions corresponding to the input bullet screen contents.
The incremental bullet screen forming module is further used for forming incremental bullet screen data which comprise the input bullet screen content, the viewing direction corresponding to the input bullet screen content and the viewing time corresponding to the input bullet screen content.
The sending module is used for sending the incremental bullet screen data provided by the incremental bullet screen forming module to the background server so as to realize the sharing of the incremental bullet screen data.
Fig. 6 is a block schematic diagram of another embodiment of a display control apparatus according to the present invention.
As shown in fig. 6, the main difference between this embodiment and the embodiment shown in fig. 4 is that the display control apparatus further includes an opening detection module 610. The opening detection module 610 is configured to detect whether to open the bullet screen function, and if so, notify the acquisition module 610 to acquire bullet screen data.
Fig. 7 is a schematic diagram of a hardware configuration of the display control apparatus according to the present invention.
As shown in fig. 7, in this embodiment, the display control apparatus may include a memory 720 and a processor 710, where the memory 720 is used for storing instructions for controlling the processor 710 to operate to execute the display control method of the movie screen according to the present invention.
The memory 720 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.
Fig. 8 is a block schematic diagram of one structure of a head mounted display device according to the present invention.
As shown in fig. 8, the head mounted display device may include any of the display control means described above, and is labeled 810 in fig. 8.
The head-mounted display apparatus may further include an input device 820, a sensor device 830, an interface device 840, a communication device 850, an audio input-output device 860, a display device 870, a camera device 880, and the like, among others.
The input device 820 may include a touch screen, a key, and the like.
The sensor device 830 includes, for example, an acceleration sensor, a gyroscope, a GPS tracker, a pressure sensor, a magnetometer, and the like.
The interface device 840 includes, for example, a USB interface, a network port, and the like.
The communication device 850 can perform wired or wireless communication (WIFI and bluetooth), for example.
The audio input/output device 860 includes a speaker and a microphone.
The display device 870 includes a display screen and related components.
The camera 880 includes at least one camera module, and can be used to collect external real scenes and perform positioning and tracking.
The head-mounted display equipment can be an all-in-one machine with a display device, and can also be equipment for providing the display device by plugging a mobile phone.
The embodiments in the present disclosure are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments, but it should be clear to those skilled in the art that the embodiments described above can be used alone or in combination with each other as needed. In addition, for the device embodiment, since it corresponds to the method embodiment, the description is relatively simple, and for relevant points, refer to the description of the corresponding parts of the method embodiment. The above-described apparatus embodiments are merely illustrative, in that modules illustrated as separate components may or may not be physically separate.
The present invention may be an apparatus, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therewith for causing a processor to implement various aspects of the present invention.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present invention may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing an electronic circuit, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA), with state information of computer-readable program instructions, which can execute the computer-readable program instructions.
Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.
Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein were chosen in order to best explain the principles of the embodiments, the practical application, or technical improvements to the techniques in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.
Claims (10)
1. A display control method of a film bullet screen is characterized by comprising the following steps:
receiving motion data which is acquired by a sensor device of the head-mounted display equipment and represents the motion posture of the head-mounted display equipment;
determining a current viewing position for viewing the shadow through the head-mounted display equipment according to the motion data, wherein the viewing position adopts a longitude and latitude representation method;
acquiring bullet screen data, wherein the bullet screen data comprises bullet screen content and a viewing direction corresponding to the bullet screen content;
extracting the bullet screen content corresponding to the current viewing position from the bullet screen data to serve as a current bullet screen;
and executing the operation of displaying the current bullet screen.
2. The display control method according to claim 1, wherein the bullet screen data further includes a viewing time corresponding to the bullet screen content;
the extracting of the bullet screen content corresponding to the current viewing position from the bullet screen data as the current bullet screen comprises:
and extracting the bullet screen content corresponding to the current viewing direction and the current viewing time from the bullet screen data to be used as the current bullet screen.
3. The display control method according to claim 1, wherein the acquiring of the bullet screen data comprises:
acquiring bullet screen content input through an input device of the head-mounted display equipment;
determining a viewing direction when the input bullet screen content is received according to the motion data;
and determining that the viewing direction corresponding to the input barrage content at least comprises the viewing direction when the input barrage content is received.
4. The display control method according to claim 3, wherein the input device includes at least one of a voice input device, a handle input device, and a virtual keyboard input device.
5. The display control method according to claim 3, characterized in that the display control method further comprises:
forming incremental bullet screen data comprising the input bullet screen content and a viewing position corresponding to the input bullet screen content;
and sending the incremental bullet screen data to a background server.
6. The display control method according to claim 1, wherein the acquiring of the bullet screen data comprises:
and acquiring bullet screen data of which the viewing position comprises the current viewing position from a background server.
7. The display control method according to any one of claims 1 to 6, characterized by further comprising, before the acquiring bullet screen data:
and detecting whether the bullet screen function is started, and if so, acquiring bullet screen data.
8. A display control apparatus for a movie screen, comprising:
the device comprises a motion data receiving module, a motion data processing module and a motion data processing module, wherein the motion data receiving module is used for receiving motion data which are acquired by a sensor device of the head-mounted display equipment and represent the motion posture of the head-mounted display equipment;
the viewing direction determining module is used for determining the current viewing direction of the film viewed through the head-mounted display equipment according to the motion data, and the viewing direction adopts a longitude and latitude representation method;
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring bullet screen data, and the bullet screen data comprises bullet screen content and a viewing position corresponding to the bullet screen content;
the current bullet screen extraction module is used for extracting bullet screen content corresponding to the current viewing position from the bullet screen data to serve as a current bullet screen; and the number of the first and second groups,
and the execution module is used for executing the operation of displaying the current bullet screen.
9. A display control apparatus of a movie screen, comprising a memory for storing instructions for controlling the processor to operate to execute the display control method according to any one of claims 1 to 7, and a processor.
10. A head-mounted display device comprising display means and sensor means for collecting motion data representing a motion gesture of the head-mounted display device, characterized in that the head-mounted display device further comprises display control means according to claim 8 or 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710229700.1A CN107197339B (en) | 2017-04-10 | 2017-04-10 | Display control method and device of film bullet screen and head-mounted display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710229700.1A CN107197339B (en) | 2017-04-10 | 2017-04-10 | Display control method and device of film bullet screen and head-mounted display equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107197339A CN107197339A (en) | 2017-09-22 |
| CN107197339B true CN107197339B (en) | 2019-12-31 |
Family
ID=59871281
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710229700.1A Active CN107197339B (en) | 2017-04-10 | 2017-04-10 | Display control method and device of film bullet screen and head-mounted display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107197339B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108260020B (en) * | 2018-01-24 | 2021-07-06 | 阿里巴巴（中国）有限公司 | Method and device for displaying interactive information in panoramic video |
| CN109302640B (en) * | 2018-10-22 | 2020-09-25 | 北京掌中飞天科技股份有限公司 | Method and device for displaying barrage in virtual reality video |
| CN110231867A (en) * | 2019-05-31 | 2019-09-13 | 重庆爱奇艺智能科技有限公司 | The method and apparatus of the display properties of barrage are adjusted in virtual reality device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013127633A1 (en) * | 2012-02-29 | 2013-09-06 | Novabase Digital Tv Technologies Gmbh | Graphical user interface for television applications |
| CN105916001A (en) * | 2016-05-12 | 2016-08-31 | 乐视控股（北京）有限公司 | Video barrage display method and device |
| CN106155311A (en) * | 2016-06-28 | 2016-11-23 | 努比亚技术有限公司 | AR helmet, AR interactive system and the exchange method of AR scene |
| CN106210861A (en) * | 2016-08-23 | 2016-12-07 | 上海幻电信息科技有限公司 | The method and system of display barrage |
| CN106200956A (en) * | 2016-07-07 | 2016-12-07 | 北京时代拓灵科技有限公司 | A kind of field of virtual reality multimedia presents and mutual method |
| CN106331879A (en) * | 2016-08-26 | 2017-01-11 | 传线网络科技（上海）有限公司 | Screen comment display method and device based on panoramic video |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10019962B2 (en) * | 2011-08-17 | 2018-07-10 | Microsoft Technology Licensing, Llc | Context adaptive user interface for augmented reality display |
-
2017
- 2017-04-10 CN CN201710229700.1A patent/CN107197339B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013127633A1 (en) * | 2012-02-29 | 2013-09-06 | Novabase Digital Tv Technologies Gmbh | Graphical user interface for television applications |
| CN105916001A (en) * | 2016-05-12 | 2016-08-31 | 乐视控股（北京）有限公司 | Video barrage display method and device |
| CN106155311A (en) * | 2016-06-28 | 2016-11-23 | 努比亚技术有限公司 | AR helmet, AR interactive system and the exchange method of AR scene |
| CN106200956A (en) * | 2016-07-07 | 2016-12-07 | 北京时代拓灵科技有限公司 | A kind of field of virtual reality multimedia presents and mutual method |
| CN106210861A (en) * | 2016-08-23 | 2016-12-07 | 上海幻电信息科技有限公司 | The method and system of display barrage |
| CN106331879A (en) * | 2016-08-26 | 2017-01-11 | 传线网络科技（上海）有限公司 | Screen comment display method and device based on panoramic video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107197339A (en) | 2017-09-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109313812B (en) | Shared experience with contextual enhancements | |
| US11037601B2 (en) | Spherical video editing | |
| US9992429B2 (en) | Video pinning | |
| US10567630B2 (en) | Image capture using a hinged device with multiple cameras | |
| CN105939497B (en) | Media streaming system and media streaming method | |
| US20230328197A1 (en) | Display method and apparatus based on augmented reality, device, and storage medium | |
| CN107197339B (en) | Display control method and device of film bullet screen and head-mounted display equipment | |
| US10015442B1 (en) | Three-way video calling on hinged multi-screen device | |
| CN112291590A (en) | Video processing method and device | |
| CN109992111B (en) | Augmented reality extension method and electronic device | |
| US20160371885A1 (en) | Sharing of markup to image data | |
| US20220159197A1 (en) | Image special effect processing method and apparatus, and electronic device and computer readable storage medium | |
| CN111970571A (en) | Video production method, device, equipment and storage medium | |
| CN115002359A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN107168521B (en) | Film viewing guide method and device and head-mounted display equipment | |
| CN113163135A (en) | Animation adding method, device, equipment and medium for video | |
| CN113032590A (en) | Special effect display method and device, computer equipment and computer readable storage medium | |
| CN111897437A (en) | Cross-terminal interaction method and device, electronic equipment and storage medium | |
| CN111710046A (en) | Interaction method and device and electronic equipment | |
| US11721027B2 (en) | Transforming sports implement motion sensor data to two-dimensional image for analysis | |
| JP2020502955A (en) | Video streaming based on picture-in-picture for mobile devices | |
| US11948257B2 (en) | Systems and methods for augmented reality video generation | |
| CN114501041B (en) | Special effect display method, device, equipment and storage medium | |
| CN117519456A (en) | Information interaction method, device, electronic equipment and storage medium | |
| CN116149469A (en) | AR (augmented reality) -based user behavior recording method and AR |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |