WO2023165362A1 - 信息展示方法、装置、头戴式显示设备及存储介质 - Google Patents

信息展示方法、装置、头戴式显示设备及存储介质 Download PDF

Info

Publication number
WO2023165362A1
WO2023165362A1 PCT/CN2023/077210 CN2023077210W WO2023165362A1 WO 2023165362 A1 WO2023165362 A1 WO 2023165362A1 CN 2023077210 W CN2023077210 W CN 2023077210W WO 2023165362 A1 WO2023165362 A1 WO 2023165362A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
control
control area
multimedia file
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2023/077210
Other languages
English (en)
French (fr)
Inventor
方迟
杨毅平
庞娜
李笑林
王璨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Priority to US18/842,292 priority Critical patent/US20250181216A1/en
Publication of WO2023165362A1 publication Critical patent/WO2023165362A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/363—Image reproducers using image projection screens
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]

Definitions

  • the present disclosure relates to the technical field of virtual reality, and in particular to an information display method, device, head-mounted display device, and storage medium.
  • Virtual reality technology (Virtual Reality, VR) is a computer simulation system that can create and experience a virtual world. Behavioral simulation systems, and simulation systems that exploit the behavior of entities.
  • the present disclosure provides an information display method, an apparatus, a head-mounted display device, and a storage medium.
  • the present disclosure provides an information presentation method, the method is applied to an extended reality XR terminal device, and the method includes:
  • the broadcast control panel includes a control area and a non-control area
  • the present disclosure also provides an information display device, the device is applied to an extended reality XR terminal device, and the device includes:
  • the entry module is used to enter the virtual reality space
  • the first display module is configured to receive a media playback instruction triggered by the user, and display the target in the virtual reality space Play page of multimedia files;
  • the second display module is used to display the broadcast control panel in the virtual reality space, and the broadcast control panel includes a control area and a non-control area;
  • a third display module configured to display information related to the multimedia file in the non-control area.
  • the present disclosure also provides a head-mounted display device, and the head-mounted display device includes:
  • processors one or more processors
  • the one or more processors are made to implement the above information display method.
  • the present disclosure further provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the above-mentioned information display method is implemented.
  • the technical solution provided by the embodiment of the present disclosure displays the playback page of the target multimedia file in the virtual reality space by setting the media playback instruction triggered by the user; displays the broadcast control panel in the virtual reality space, and the broadcast control panel includes a control area and a non-control area ;Display information related to multimedia files in the non-control area.
  • the essence is to use the playback page to play the target multimedia file, and use the playback control panel to control the playback of the target multimedia file and display related information.
  • This setting can realize multimedia information. Full display.
  • FIG. 1 is a flowchart of an information display method provided by an embodiment of the present disclosure
  • FIG. 2 is a flow chart of another information display method provided by an embodiment of the present disclosure.
  • FIG. 3 is a schematic diagram of a broadcast control panel provided by an embodiment of the present disclosure.
  • FIG. 4 is a schematic diagram of another broadcast control panel provided by an embodiment of the present disclosure.
  • FIG. 5 is a schematic diagram of a control rendering provided by an embodiment of the present disclosure.
  • FIG. 6 is a flowchart of another information display method provided by an embodiment of the present disclosure.
  • FIG. 7 and 8 are schematic diagrams of another broadcast control panel provided by an embodiment of the present disclosure.
  • FIGS. 9 and 10 are schematic diagrams of another broadcast control panel provided by an embodiment of the present disclosure.
  • FIG. 11 is a schematic diagram of another broadcast control panel provided by an embodiment of the present disclosure.
  • FIG. 12 is a schematic diagram of a Cube model provided by an embodiment of the present disclosure.
  • FIG. 13 is a schematic structural diagram of an information display device in an embodiment of the present disclosure.
  • FIG. 14 is a schematic structural diagram of a head-mounted display device in an embodiment of the present disclosure.
  • Fig. 1 is a flow chart of an information presentation method provided by an embodiment of the present disclosure. This method is applied to extended reality XR terminal equipment. The method includes:
  • a media play instruction triggered by the user is received, and a play page of the target multimedia file is displayed in the virtual reality space.
  • the playing page is used to play the target multimedia file.
  • the broadcast control panel is displayed in the virtual reality space, and the broadcast control panel includes a control area and a non-control area.
  • control area is used for arranging controls, and the arranged controls may be at least one of the following: play/pause control, volume adjustment control, fast forward control, fast rewind control, and movie viewing mode selection control.
  • the non-control area is used to display relevant information of the target multimedia file.
  • the relevant information of the multimedia file includes playback progress information, content introduction information, associated content recommendation information, comment information, advertisement information, and anthology information.
  • control area includes at least two sub-control areas; any two sub-control areas are not connected; each sub-control area is provided with at least one control.
  • control area and the control area are arranged up and down or left and right.
  • the non-control area can also be set to include at least one of the following areas: a time progress control area of the target multimedia file, a content introduction area, an associated content recommendation area, a comment area, an advertisement area, and an anthology menu area.
  • the time progress control area is used to display the playback progress of the current target multimedia file.
  • the playing progress of the target multimedia file can be adjusted by operating the time progress control area. The essence of such setting is to divide the non-control area according to the type of information related to the multimedia file to form multiple sub-non-control areas. Each sub-non-control area is used to display only one type of information. The types of information displayed by different sub-non-control areas are different.
  • the playback page of the target multimedia file and the playback control panel may be displayed simultaneously. It is also possible to display the broadcast control panel in the virtual reality space after receiving the display instruction of the broadcast control panel.
  • the playback page and the playback control panel are located on different spatial planes in the virtual reality space, or the playback page and the playback control panel are located in different locations on the same plane in the virtual reality space, which is not too limited in the embodiments of the present disclosure
  • the position and orientation of the playback page and the playback control panel in the virtual reality space can be set based on the viewing distance of the user. For example, the playback page of the target multimedia file is farther away from the user than the playback control panel. .
  • the above technical solution displays the playback page of the target multimedia file in the virtual reality space by setting the media playback instruction triggered by the user; the playback control panel is displayed in the virtual reality space, and the playback control panel includes a control area and a non-control area; in the non-control area
  • the display of information related to multimedia files is essentially to use the playback page to play the target multimedia file, and use the playback control panel to control the playback of the target multimedia file and display related information. This setting can achieve a comprehensive display of multimedia information.
  • prohibiting the feedback of a certain area of the broadcast control panel means that when the ray focus stays or passes through the area, the area does not respond to the action of staying or passing.
  • a preset operation such as a click operation, a hovering operation, or a drag operation, etc.
  • the target area is the time progress control area, and all controls in the control area are disabled.
  • feedback in the content introduction area, related content recommendation area, comment area, advertisement area, and anthology menu area is prohibited, so that the settings can fully avoid accidental touches.
  • the area of the time progress control area is also adjusted to increase the operation of the time progress control area
  • the degree of freedom makes it easy to adjust the playback progress.
  • the playback control panel is switched to a control area including only a single function.
  • a broadcast control panel includes a control area and a non-control area
  • the non-control area includes a time progress control area of the target multimedia file, a content introduction area, an associated content recommendation area, a comment area, an advertisement area, and a collection menu area.
  • a preset operation such as a click operation, a hovering operation, or a drag operation, etc.
  • the broadcast control panel is switched to a play control panel including only the time progress control area. This setting can fully avoid false touches.
  • FIG. 2 is a flowchart of another information display method provided by an embodiment of the present disclosure, and FIG. 2 is a specific example in FIG. 1 .
  • the scheme in FIG. 2 is applicable to the situation of adjusting the playback progress of the target multimedia file by using the playback control panel.
  • the non-control area of the broadcast control panel only includes the time progress control area of the target multimedia. as shown in the picture 2, the method may specifically include:
  • the broadcast control panel includes a control area and a non-control area, and the non-control area includes a time progress control area of the target multimedia file.
  • control area is used for arranging controls, and the arranged controls may be at least one of the following: play/pause control, volume adjustment control, fast forward control, fast rewind control, and movie viewing mode selection control.
  • the time progress control area is used as a hot area for adjusting the playback progress, and is used to receive user's operation actions. Subsequently, based on the operation action input by the user, a playback progress adjustment instruction can be formed, and the playback progress can be adjusted.
  • the time progress control area can also be used to display relevant information of the multimedia file, such as the name of the multimedia file, the total duration of the multimedia file, the played duration of the multimedia file, and the subtitle of the multimedia file.
  • the control area includes at least two sub-control areas; any two sub-control areas are not connected; each sub-control area is provided with at least one control.
  • Fig. 3 is a schematic diagram of a playback control panel provided by an embodiment of the present disclosure.
  • the playback control panel includes a control area S1 and a non-control area S2 .
  • the control area S1 includes four sub-control areas, namely S1-1, S1-2, S1-3 and S1-4. Only one control is set in each sub-control area.
  • the four sub-control areas are arranged at intervals and scattered in the non-control area S2.
  • the sum of the area of the control area S1 and the area of the non-control area S2 is equal to the total area of the playback control panel.
  • the non-control area and the control area are arranged up and down or left and right; at least one control is set in the control area.
  • Fig. 4 is a schematic diagram of another playback control panel provided by an embodiment of the present disclosure. Referring to FIG. 4 , the control area S1 is located below the non-control area S2 , and multiple controls are set in the control area. The sum of the area of the control area S1 and the area of the non-control area S2 is equal to the total area of the playback control panel.
  • FIG. 4 multiple controls are arranged side by side in the control area, which is only a specific example of the present application, rather than limiting the present application. In practice, multiple controls can be arranged in any way in the control area.
  • the shape of at least one control may be set as a polygon with rounded corners; and the edge of the control has a color gradient effect.
  • the ratio of the rounded corners is set in advance to determine whether the pixel is in the rounded corners; if a pixel is in the rounded corners, keep the pixel; otherwise, throw it away the pixel.
  • the border of the control can be set to present a luminous effect.
  • it may be realized by overlapping multiple rendering layers.
  • FIG. 5 is a schematic diagram of a control rendering provided by an embodiment of the present disclosure. See Figure 5, set three rendering layers for the control, the first rendering layer and the second rendering layer are used to render the background, the second rendering layer is used to render the border, the three rendering Layers overlap to get a glowing border Fruit controls.
  • the implementation method of this step includes: responding to the pressing operation in the time progress control area of the target multimedia file, obtaining the pressed position; determining the target playback position corresponding to the pressed position ;Play the multimedia file starting from the target playback position.
  • the press operation may be a click operation or a drag operation. Specifically, if the duration of the press operation is short and the operation distance is short, the press operation is a click operation; if the duration of the press operation is long and the operation distance is long, the press operation is a drag operate. Therefore, in practice, based on the duration of the pressing operation and/or the operating distance (that is, the dragging distance), it may be determined what kind of operation the pressing operation is.
  • the specific implementation method of this step may be: in response to the press operation in the time progress control area of the target multimedia file, determine the operation distance of the press operation; if the operation distance of the press operation is less than the distance threshold, obtain the press operation
  • the pressed position information at the initial moment of the down operation determines the target playback position corresponding to the pressed position at the initial moment of the pressed operation; if the operation distance of the pressed operation is greater than or equal to the distance threshold, obtain the pressed position information at the end of the pressed operation , determine the target playback position corresponding to the pressed position at the end of the press operation; use the target playback position as the starting point to play the multimedia file.
  • the operation distance of the press operation refers to the projected length of the moving track of the ray focus in the X-axis direction during the time period from the start moment to the end moment of the press operation.
  • the X axis is parallel to the length direction of the play control panel.
  • the press operation is judged as a click operation. Since the operation distance of the click operation is very short, it can be considered that the ray focus has not moved during the entire operation process.
  • the pressing position of the moment represents the user's will, and the progress is adjusted.
  • the press operation is determined as a drag operation. During the drag operation, the position at the end time of the drag operation (that is, the end time of the press operation) is used to represent the user's will, and the progress is adjusted.
  • the X axis is set to be parallel to the length direction of the play control panel
  • the coordinate value of the left line of the play control panel on the X axis is m
  • the coordinate value of the right line of the play control panel on the X axis is n
  • the interval (m, The corresponding relationship between any point in n) and the playback moment of the multimedia file currently displayed according to the coordinate value of the pressed position at the initial moment of the press operation on the X axis and the corresponding relationship, determine the target playback moment (i.e. the target playback position setting).
  • the method for realizing "determining the target playback position corresponding to the pressed position at the end of the press operation" is similar to the method of "determining the target playback position corresponding to the pressed position at the initial moment of the press operation", and will not be repeated here.
  • the step of "determining the operating distance of the pressing operation” may be performed when the pressing operation ends, or may be performed during the pressing operation. If it is performed during the operation of the press operation, optionally, the step of "determining the operation distance of the press operation” is performed periodically until the operation distance of the press operation is greater than or equal to the distance threshold (the press operation is a dragging operation). drag operation), or press the end of the operation (the press operation is a click operation).
  • the drag operation can be regarded as an extension of the click operation. Therefore, the implementation of this step can also be: in response to the press operation in the time progress control area, determine the operation distance of the press operation, obtain the press position information at the initial moment of the press operation, and determine the initial moment of the press operation The first target playback position corresponding to the pressed position; take the first target playback position as a starting point, play the multimedia file; determine whether the operation distance of the press operation is greater than or equal to the distance threshold; if so, obtain the press at the end of the press operation The position information determines the second target playback position corresponding to the pressed position at the end of the press operation; the multimedia file is played starting from the second target playback position.
  • the step of "determining the operation distance of the press operation” is periodically executed until the operation distance of the press operation is greater than or equal to the distance threshold (the press operation is a dragging operation). operation), or press the end of the operation (the press operation is a click operation).
  • the essence of this setting is that if the operation distance of the press operation is less than the distance threshold, the "obtain the press position information at the end of the press operation and determine the second target playback position corresponding to the press position at the end of the press operation is not executed; Starting from the second target playback position, play the multimedia file", that is, after the multimedia file is played from the first target playback position, the playback progress is no longer adjusted.
  • the operation distance of the press operation is greater than or equal to the distance threshold, execute "acquire the press position information at the end of the press operation, determine the second target playback position corresponding to the press position at the end of the press operation; play with the second target Position as the starting point, play the multimedia file", that is, after the multimedia file is played from the first target playback position, the playback progress will be adjusted again according to the second target playback position.
  • the press operation is a click operation, for one press operation, the playback progress of the multimedia file is adjusted once.
  • the press operation is a drag operation, for one press operation, the playback progress of the multimedia file is adjusted twice.
  • the step of "determining the operating distance of the pressing operation” may be performed when the pressing operation ends, or may be performed during the pressing operation. If it is performed during the operation of the press operation, optionally, the step of "determining the operation distance of the press operation” is performed periodically until the operation distance of the press operation is greater than or equal to the distance threshold (the press operation is a dragging operation). drag operation), or press the end of the operation (the press operation is a click operation).
  • the above technical solution adjusts the playback progress of the multimedia file by setting the operation in response to the time progress control area of the target multimedia.
  • the progress bar is not set in the playback control panel, but the non-control area in the playback control panel
  • the time progress control area is used as a hot area for adjusting the playback progress of multimedia files, and is used to receive user-to-play Adjust the progress of the operation. Since the time progress control area of the target multimedia is large in size, the degree of freedom of clicking and dragging can be increased, making it easy to realize the adjustment of the playback progress.
  • the interaction between the user and the head-mounted display device is realized by colliding the ray with the collision box.
  • the collision between the ray and the collision box will generate a 3D coordinate, which is the position rendered by the cursor.
  • the playback control panel is displayed on a plane, so there is no need to generate a three-dimensional collision box for the controls in the playback control panel.
  • a two-dimensional collision box can be generated for the controls in the play control panel. That is, build a two-dimensional coordinate system on the plane where the playback control panel is located, and only pay attention to the coordinate values in the two-dimensional coordinate system of the ray focus when processing the press operation.
  • FIG. 6 is a flow chart of another information display method provided by an embodiment of the present disclosure.
  • FIG. 6 is a specific example in FIG. 2 .
  • the technical solution shown in FIG. 6 is suitable for adjusting the playback progress by dragging.
  • the method includes:
  • the broadcast control panel includes a control area and a non-control area, and the non-control area includes a time progress control area of the target multimedia file.
  • the operating distance of the pressing operation is periodically determined.
  • the broadcast control panel is located in an area capable of receiving press operations.
  • FIG. 7 and FIG. 8 are schematic diagrams of another broadcast control panel provided by an embodiment of the present disclosure.
  • the user uses the handle to position the ray focus at position A in Figure 7 and presses the selected button in the handle, since position A is within the time progress control area, it is confirmed that the user's operation belongs to the press in the time progress control area Operation, periodically determine the operation distance of the press operation, if at time t, the operation distance of the press operation is greater than or equal to the distance threshold, judge that the press operation is a drag operation, and increase the number of acceptable press operations
  • the area of the area that is, to increase the hot area that can be dragged.
  • the area filled with dots represents the enlarged hot area that can be dragged. This setting can increase the degree of freedom of the dragging control, and effectively improve the controllability and efficiency of the dragging operation. It should be emphasized that at time t, the pressing operation does not end.
  • the X-axis is set to be parallel to the length direction of the playback control panel
  • the coordinate value of the left line of the area that can receive the press operation on the X-axis is p
  • the coordinate value of the right line of the area that can receive the press operation is on the X-axis
  • the coordinate value is q, which determines the corresponding relationship between any point in the interval (p, q) and the playback time of the multimedia file currently displayed, according to the pressed position at the end time of the press operation (that is, the end time of the drag operation)
  • the coordinate value on the X-axis and the corresponding relationship determine the target playback time (ie, the target playback position).
  • the area that can receive the press operation is divided into three areas, that is, the first sub-hot area S2-1, the second sub-hot area S2- 2 and the third sub-hot area S2-3, the boundary line between the first sub-hot area S2-1 and the second sub-hot area S2-2 passes through the left line of the broadcast control panel, the second sub-hot area S2-2 and the third sub-hot area
  • the boundary line of the sub-hot area S2-3 passes through the right line of the broadcast control panel;
  • the specific implementation method of this step includes: if the pressed position at the end of the operation is pressed (for example, the pressed position is point C, Point H or point E) in the second sub-hot area, based on the coordinate value of the pressed position in the X-axis direction at the end of the press operation, determine the target playback position corresponding to the press position; if the press at the end of the press operation Position (for example, the pressing position is B point or F point among Fig.
  • the pressed position (for example, the pressed position is point D or G in FIG. 8 ) is within the third sub-hot area, and the end moment of the multimedia file is determined to be the target playback position corresponding to the pressed position.
  • the pressing position at the end of the pressing operation is in the second sub-hot area, based on the coordinate value of the pressing position in the X-axis direction at the end of the pressing operation, determine the target playback position corresponding to the pressing position, and its specific implementation
  • the method is similar to the method of "determining the target playback position corresponding to the pressing position at the initial moment of the pressing operation" in the foregoing, and will not be repeated here.
  • the essence of the above technical solution is to increase the area of the area that can receive the press operation if the press operation is a drag operation, so as to increase the freedom of drag control and effectively improve the controllability and efficiency of the drag operation.
  • the controls located in the control area are disabled until the pressing operation ends.
  • the purpose of this setting is to prohibit the controls in the control area from responding to hovering, clicking and dragging operations during the dragging operation, so as to avoid accidental touches.
  • FIG. 9 and FIG. 10 are schematic diagrams of another playback control panel provided by an embodiment of the present disclosure.
  • the method further includes: displaying the current progress mark on the broadcast control panel.
  • the vertical line marked J and perpendicular to the X axis is the current progress mark.
  • the press operation is a click operation
  • the coordinate value of the current progress indicator on the X-axis is the same as the coordinate value of the pressed position on the X-axis at the beginning of the press operation
  • the press operation is a drag operation
  • the coordinate value on the X-axis is the same as the coordinate value on the X-axis of the pressed position at the end of the pressing operation.
  • the background color of the area between the current progress logo J and the left line of the play control panel and the area between the current progress logo J and the right line of the play control panel is different.
  • Such setting is beneficial to highlight the playback progress information of the multimedia file at the current moment.
  • the method further includes: obtaining hovering position information in response to a hovering operation in the time progress control area of the target multimedia; determining the video image corresponding to the hovering position and the time information of the video image; The video image and the time information of the video image are displayed on the plane.
  • Fig. 11 is a schematic diagram of another playback control panel provided by an embodiment of the present disclosure. Referring to Figure 11, assuming that the ray focus hovers over point K, the video image corresponding to point K will be displayed in the preview image pop-up window. The preview image pop-up window is located in the plane where the playback control panel is located.
  • the projection mode of the video source to be played is full-screen mode (that is, Plane in 2D mode)
  • the aspect ratio of the video image in the video source is the same as that of the head-mounted display
  • the aspect ratio of the video display area in the display device is different, align the center of the video image with the center of the video display area, keep the aspect ratio of the video image unchanged, and enlarge the video image until the width of the video image is the same as that of the video display
  • the width of the area is the same, and the length of the video image is less than the length of the video display area; or, align the center of the video image with the center of the video display area, keep the aspect ratio of the video image unchanged, and enlarge the video image until the video
  • the length of the image is consistent with the length of the video display area, and the width of the video image is smaller than the width of the video display area.
  • the method also includes: determining the projection mode and the storage mode of the video source data; based on the projection mode and the storage mode, determining a video playback model corresponding to the video source; the video playback model includes video images to be pasted area; paste each frame of video image in the video source data to the area to be pasted to form the video data to be played.
  • the projection mode includes Plane (flat surface), Sphere (spherical surface), Cube (cube), 360° panorama, 180° panorama, etc.
  • the storage mode includes common (2D video), top-bottom (3D video), left-right (3D video) and other storage formats.
  • FIG. 12 is a schematic diagram of a Cube model provided by an embodiment of the present disclosure.
  • the Cube model includes six video image areas to be pasted, namely 1 left, 2 front, 3 right, 4 bottom, 5 rear and 6 top.
  • the above only takes the non-control area including the time progress control area of the target multimedia file as an example for interactive description and technical description.
  • the non-control area includes the time progress control area of the target multimedia file, content introduction area, associated content recommendation area, comment area,
  • the implementation and interaction methods are similar to the above, except that when the combined function is included, the non-control area can be divided into corresponding functional areas. Expand.
  • Fig. 13 is a schematic structural diagram of an information display device in an embodiment of the present disclosure.
  • the device is applied to an extended reality XR terminal device.
  • the information display device specifically includes:
  • Enter module 310 for entering the virtual reality space
  • the first display module 320 is configured to receive a media play instruction triggered by the user, and display a play page of the target multimedia file in the virtual reality space;
  • the second display module 330 is used to display the broadcast control panel in the virtual reality space, and the broadcast control panel includes a control area and a non-control area;
  • the third display module 340 is configured to display information related to the multimedia file in the non-control area.
  • control area includes at least two sub-control areas; any two sub-control areas are not connected; each sub-control area is provided with at least one control.
  • non-control area and the control area are arranged vertically or horizontally.
  • non-control area includes at least one of the following areas:
  • the time progress control area, content introduction area, associated content recommendation area, comment area, advertisement area and selection menu area of the target multimedia file is a predefined time progress control area, content introduction area, associated content recommendation area, comment area, advertisement area and selection menu area of the target multimedia file.
  • the device further includes a control module, the control module is used to prohibit feedback from other areas of the broadcast control panel and expand the target area when a preset operation on the target area in the non-control area is detected.
  • a response area is used to respond to user operations on the target area.
  • the device further includes a control module, which is used for switching the play control panel to a control area including only a single function when a preset operation is detected.
  • the projection mode of the video source is full screen mode, and the aspect ratio of the video image in the video source is different from the aspect ratio of the video display area in the playing page of the target multimedia file ;
  • the device also includes a control module for:
  • Align the center of the video image with the center of the video display area keep the aspect ratio of the video image unchanged, and enlarge the video image until the length of the video image is the same as that of the video display area The same length, and the width of the video image is smaller than the width of the video display area.
  • the playback progress adjustment device provided by the embodiments of the present disclosure can execute the steps of the information display method provided by the method embodiments of the present disclosure, and has execution steps and beneficial effects, which will not be repeated here.
  • FIG. 14 is a schematic structural diagram of a head-mounted display device in an embodiment of the present disclosure. Referring specifically to FIG. 14 , it shows a schematic structural diagram of a head-mounted display device 1000 suitable for implementing an embodiment of the present disclosure.
  • the head-mounted display device 1000 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 1001, which may be stored in a read-only memory (ROM) 1002 or loaded from a storage device 1008 Various appropriate actions and processes are executed to the program in the random access memory (RAM) 1003 to realize the information presentation method of the embodiment as described in the present disclosure.
  • ROM read-only memory
  • RAM random access memory
  • various programs and information necessary for the operation of the head-mounted display device 1000 are also stored.
  • the processing device 1001, ROM 1002, and RAM 1003 are connected to each other through a bus 1004.
  • An input/output (I/O) interface 1005 is also connected to the bus 1004 .
  • the following devices can be connected to the I/O interface 1005: input devices 1006 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speaker, vibration an output device 1007 such as a computer; a storage device 1008 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009.
  • the communication means 1009 may allow the head-mounted display device 1000 to perform wireless or wired communication with other devices to exchange information. While FIG. 13 shows head-mounted display device 1000 having various means, it should be understood that implementing or having all of the means shown is not a requirement. More or fewer means may alternatively be implemented or provided.
  • the processes described above with reference to the flowcharts can be implemented as computer software programs.
  • the embodiments of the present disclosure include a computer program product, which includes a computer program carried on a non-transitory computer readable medium, and the computer program includes program code for executing the method shown in the flow chart, thereby realizing the above The information display method described above.
  • the computer program may be downloaded and installed from a network via the communication means 1009, or from the storage means 1008, or from the ROM 1002.
  • the processing device 1001 the above-mentioned functions defined in the methods of the embodiments of the present disclosure are performed.
  • the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the two.
  • a computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include an information signal propagated in baseband or as part of a carrier wave carrying computer-readable program code therein. Such propagated information signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • a computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable signal medium can To send, propagate or transmit a program for use by or in connection with an instruction execution system, apparatus or device.
  • Program code embodied on a computer readable medium may be transmitted by any appropriate medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
  • the client and the server can communicate using any known or future-developed network protocols such as HTTP (HyperText Transfer Protocol, Hypertext Transfer Protocol), and can communicate with digital information in any form or medium (eg, communication network) interconnections.
  • HTTP HyperText Transfer Protocol
  • Examples of communication networks include local area networks ("LANs”), wide area networks ("WANs”), internetworks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any known or future developed network.
  • the above-mentioned computer-readable medium may be contained in the above-mentioned head-mounted display device; or it may exist independently without being assembled into the head-mounted display device.
  • the above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the head-mounted display device, the head-mounted display device:
  • the broadcast control panel includes a control area and a non-control area
  • the play control panel When the multimedia file is displayed in the head-mounted display device, display the play control panel, the play control panel includes a control area and a time progress control area of the target multimedia;
  • the playback progress of the multimedia file is adjusted.
  • the head-mounted display device may also perform other steps described in the above-mentioned embodiments.
  • Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, or combinations thereof, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages - such as the "C" language or similar programming languages.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider). Internet connection).
  • LAN local area network
  • WAN wide area network
  • Internet service provider such as AT&T, MCI, Sprint, EarthLink, MSN, GTE, etc.
  • each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions.
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.
  • the units involved in the embodiments described in the present disclosure may be implemented by software or by hardware. Wherein, the name of a unit does not constitute a limitation of the unit itself under certain circumstances.
  • FPGAs Field Programmable Gate Arrays
  • ASICs Application Specific Integrated Circuits
  • ASSPs Application Specific Standard Products
  • SOCs System on Chips
  • CPLD Complex Programmable Logical device
  • a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device.
  • a machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • a machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing.
  • machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read only memory
  • EPROM or flash memory erasable programmable read only memory
  • CD-ROM compact disk read only memory
  • magnetic storage or any suitable combination of the foregoing.
  • the present disclosure provides a head-mounted display device, including:
  • processors one or more processors
  • memory for storing one or more programs
  • the one or more processors are made to implement any one of the information display methods provided in the present disclosure.
  • the present disclosure provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the information display as described in any one provided by the present disclosure is realized. method.
  • An embodiment of the present disclosure also provides a computer program product, where the computer program product includes a computer program or an instruction, and when the computer program or instruction is executed by a processor, the information display method as described above is implemented.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开涉及一种信息展示方法、装置、头戴式显示设备及存储介质，所述方法包括：进入虚拟现实空间；接收到用户触发的媒体播放指令，在所述虚拟现实空间显示目标多媒体文件的播放页面；在所述虚拟现实空间展示播控面板，所述播控面板包括控件区域和非控件区域；在所述非控件区域中展示与所述多媒体文件相关的信息。本公开实施例提供的技术方案借助播放页面进行目标多媒体文件的播放，利用播控面板进行目标多媒体文件的播放控制以及相关信息展示，这样设置可以实现对多媒体信息的全面展示。

Description

信息展示方法、装置、头戴式显示设备及存储介质
优先权信息
本申请要求于2022年03月04日提交的，申请名称为“信息展示方法、装置、头戴式显示设备及存储介质”的、中国专利申请号“202210207263.4”的优先权，该申请的全部内容通过引用结合在本申请中。
技术领域
本公开涉及虚拟现实技术领域，尤其涉及一种信息展示方法、装置、头戴式显示设备及存储介质。
背景技术
虚拟现实技术(Virtual Reality，VR)是一种可以创建和体验虚拟世界的计算机仿真系统，是利用计算机生成的一种模拟环境，也是一种多源信息融合的交互式的三维动态视景和实体行为的仿真系统，以及利用实体行为的仿真系统。
随着科技不断进步，利用虚拟现实技术进行多媒体信息展示的需求逐渐增大，但是如何利用虚拟现实技术进行多媒体信息的全面展示仍是目前亟待解决的问题。
发明内容
为了解决上述技术问题或者，本公开提供了一种信息展示方法、装置、头戴式显示设备及存储介质。
第一方面，本公开提供了一种信息展示方法，所述方法应用于扩展现实XR终端设备，所述方法包括：
进入虚拟现实空间；
接收到用户触发的媒体播放指令，在所述虚拟现实空间显示目标多媒体文件的播放页面；
在所述虚拟现实空间展示播控面板，所述播控面板包括控件区域和非控件区域；
在所述非控件区域中展示与所述多媒体文件相关的信息。
第二方面，本公开还提供了一种信息展示装置，所述装置应用于扩展现实XR终端设备，所述装置包括：
进入模块，用于进入虚拟现实空间；
第一展示模块，用于接收到用户触发的媒体播放指令，在所述虚拟现实空间显示目标 多媒体文件的播放页面；
第二展示模块，用于在所述虚拟现实空间展示播控面板，所述播控面板包括控件区域和非控件区域；
第三展示模块，用于在所述非控件区域中展示与所述多媒体文件相关的信息。
第三方面，本公开还提供了一种头戴式显示设备，所述头戴式显示设备包括：
一个或多个处理器；
存储装置，用于存储一个或多个程序；
当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如上所述的信息展示方法。
第四方面，本公开还提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如上所述的信息展示方法。
本公开实施例提供的技术方案与现有技术相比具有如下优点：
本公开实施例提供的技术方案通过设置接收到用户触发的媒体播放指令，在虚拟现实空间显示目标多媒体文件的播放页面；在虚拟现实空间展示播控面板，播控面板包括控件区域和非控件区域；在非控件区域中展示与多媒体文件相关的信息，实质是借助播放页面进行目标多媒体文件的播放，利用播控面板进行目标多媒体文件的播放控制以及相关信息展示，这样设置可以实现对多媒体信息的全面展示。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本公开的实施例，并与说明书一起用于解释本公开的原理。
为了更清楚地说明本公开实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，对于本领域普通技术人员而言，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本公开实施例提供的一种信息展示方法的流程图；
图2为本公开实施例提供的另一种信息展示方法的流程图；
图3为本公开实施例提供的一种播控面板的示意图；
图4为本公开实施例提供的另一种播控面板的示意图；
图5为本公开实施例提供的一种控件渲染的示意图；
图6为本公开实施例提供的另一种信息展示方法的流程图；
图7和图8为本公开实施例提供的另一种播控面板的示意图；
图9和图10为本公开实施例提供的另一种播控面板的示意图；
图11为本公开实施例提供的另一种播控面板的示意图；
图12为本公开实施例提供的一种Cube模型的示意图；
图13为本公开实施例中的一种信息展示装置的结构示意图；
图14为本公开实施例中的一种头戴式显示设备的结构示意图。
具体实施方式
为了能够更清楚地理解本公开的上述目的、特征和优点，下面将对本公开的方案进行进一步描述。需要说明的是，在不冲突的情况下，本公开的实施例及实施例中的特征可以相互组合。
在下面的描述中阐述了很多具体细节以便于充分理解本公开，但本公开还可以采用其他不同于在此描述的方式来实施；显然，说明书中的实施例只是本公开的一部分实施例，而不是全部的实施例。
图1为本公开实施例提供的一种信息展示方法的流程图。该方法应用于扩展现实XR终端设备。该方法包括：
S1、进入虚拟现实空间。
S2、接收到用户触发的媒体播放指令，在虚拟现实空间显示目标多媒体文件的播放页面。
其中，播放页面用于对目标多媒体文件进行播放。
S3、在虚拟现实空间展示播控面板，播控面板包括控件区域和非控件区域。
其中，控件区域用于布设控件，所布设的控件可以为下述中的至少一个：播放/暂停控件、音量调节控件、快进控件、快退控件以及观影模式选择控件。
非控件区域用于对目标多媒体文件的相关信息进行展示。多媒体文件的相关信息包括播放进度信息、内容介绍信息、关联内容推荐信息、评论信息、广告信息以及选集信息等。
在实际中，控件区域和非控件区域的布局方式有多种，本申请对此不做限制。可选地，控件区域包括至少两个子控件区域；任意两个子控件区域不连通；各子控件区域中设置有至少一个控件。或者，非控件区域与控件区域上下排列或者左右排列。
进一步地，还可以设置非控件区域包括下述至少一个区域：目标多媒体文件的时间进度控制区域、内容介绍区域、关联内容推荐区域、评论区域、广告区域以及选集菜单区域。其中，时间进度控制区域用于对当前目标多媒体文件的播放进度展示。此外，通过对时间进度控制区域进行操作，可以对目标多媒体文件的播放进度进行调整。这样设置的实质是根据多媒体文件相关信息的类型，对非控件区域进行划分，形成多个子非控件区域。各子非控件区域仅用于展示一个类型的信息。不同子非控件区域所展示的信息的类型不同。
可选地，在实际中，可以在接收到用户触发的媒体播放指令后，同时显示目标多媒体文件的播放页面以及播控面板。也可以在接收到播控面板展示指令后，在虚拟现实空间展示播控面板。可选地，播放页面与播控面板位于虚拟现实空间的不同空间平面，或者播放页面与播控面板位于虚拟现实空间中同一平面的不同位置区域，本公开实施例对此并不做过多限制，例如，可以基于用户的观影距离来设定播放页面与播控面板在虚拟现实空间中的位置以及方位，例如，目标多媒体文件的播放页面距用户的距离比播控面板距用户的距离远。
S4、在非控件区域中展示与多媒体文件相关的信息。
上述技术方案通过设置接收到用户触发的媒体播放指令，在虚拟现实空间显示目标多媒体文件的播放页面；在虚拟现实空间展示播控面板，播控面板包括控件区域和非控件区域；在非控件区域中展示与多媒体文件相关的信息，实质是借助播放页面进行目标多媒体文件的播放，利用播控面板进行目标多媒体文件的播放控制以及相关信息展示，这样设置可以实现对多媒体信息的全面展示。
在上述技术方案的基础上，可选地，当检测到针对非控件区域中目标区域的预设操作时，禁止播控面板的其他各区域反馈，扩大目标区域的响应区域，以响应针对目标区域的用户操作。
其中，禁止播控面板的某个区域反馈，是指当射线焦点停留或经过该区域时，该区域对该停留或经过的动作不作响应。示例性地，当检测到针对时间进度控制区域的预设操作(如点击操作、悬停操作或拖拽操作等)时，目标区域为时间进度控制区域，禁用控件区域的所有控件。同时禁止内容介绍区域、关联内容推荐区域、评论区域、广告区域以及选集菜单区域反馈，这样设置可以充分避免误触。此外，当检测到针对时间进度控制区域的预设操作(如点击操作、悬停操作或拖拽操作等)时，还调整时间进度控制区域的面积，以增大对该时间进度控制区域进行操作的自由度，使得播放进度调整易于实现。
在另一个实施例中，可选地，当检测到预设操作时，将播控面板切换为仅包括单一功能的控制区域。示例性地，假设某播控面板包括控件区域和非控件区域，非控件区域又包括目标多媒体文件的时间进度控制区域、内容介绍区域、关联内容推荐区域、评论区域、广告区域以及选集菜单区域。当检测到针对时间进度控制区域的预设操作(如点击操作、悬停操作或拖拽操作等)时，将该控播面板切换为仅包括时间进度控制区域的控播面板。这样设置可以充分避免误触。
图2为本公开实施例提供的另一种信息展示方法的流程图，图2为图1中的一个具体示例。图2中方案适用于利用播控面板对目标多媒体文件的播放进度进行调整的情况。并且在图2技术方案中，播控面板非控件区域仅包括目标多媒体的时间进度控制区域。如图 2所示，该方法具体可以包括：
S110、在虚拟现实空间展示播控面板，播控面板包括控件区域和非控件区域，非控件区域包括目标多媒体文件的时间进度控制区域。
其中，控件区域用于布设控件，所布设的控件可以为下述中的至少一个：播放/暂停控件、音量调节控件、快进控件、快退控件以及观影模式选择控件。
时间进度控制区域用于充当调整播放进度的热区域，用于接收用户的操作动作。后续可以基于用户输入的操作动作，形成播放进度调节指令，并进行播放进度调整。此外，时间进度控制区域还可用于展示多媒体文件的相关信息，如多媒体文件名称、多媒体文件总时长、多媒体文件已播放时长以及多媒体文件字幕等。
在实际中，控件区域和非控件区域的布局方式有多种，本申请对此不作限制。可选地，控件区域包括至少两个子控件区域；任意两个子控件区域不连通；各子控件区域中设置有至少一个控件。图3为本公开实施例提供的一种播控面板的示意图。参见图3，该播控面板中包括控件区域S1和非控件区域S2。控件区域S1包括四个子控件区域，分别为S1-1、S1-2、S1-3以及S1-4。各子控件区域中均仅设置有一个控件。四个子控件区域间隔地、分散地布置于非控件区域S2中。控件区域S1的面积和非控件区域S2的面积之和等于播控面板的总面积。
或者，可选地，非控件区域与控件区域上下排列或左右排列；控件区域中设置有至少一个控件。图4为本公开实施例提供的另一种播控面板的示意图。参见图4，控件区域S1位于非控件区域S2的下方，在控件区域中设置有多个控件。控件区域S1的面积和非控件区域S2的面积之和等于播控面板的总面积。
需要说明的是，在图4中，多个控件被并排设置在控件区域中，这仅是本申请的一个具体示例，而非对本申请的限制。在实际中可以设置多个控件以任意方式布局在控件区域中。
可选地，在实际中，可以设置至少一个控件的形状为圆角多边形；且控件的边缘呈颜色渐变效果。在具体实现时，可以利于Unity3D shader工具形成控件的圆角，具体而言，预先设置圆角的比例，判断像素是否在圆角内；若某像素在圆角内，保留该像素；否则，丢掉该像素。通过设置控件的边缘呈颜色渐变效果，可以消除圆角的锯齿感，提升控件的美感。
可选地，为了进一步突出控件，可以设置控件边框呈现发光效果。在具体实现时可以采用多个渲染图层重叠的方式实现。图5为本公开实施例提供的一种控件渲染的示意图。参见图5，为控件设置三个渲染图层，第一个渲染图层和第二个渲染图层用于对背景进行渲染，第二渲染图层用于对边框进行渲染，将这三个渲染图层重叠，得到边框呈现发光效 果的控件。
S120、响应于对时间进度控制区域的操作，对多媒体文件的播放进度进行调整。
本步骤的实现方法有多种，示例性地，本步骤的实现方法包括：响应于在目标多媒体文件的时间进度控制区域的按下操作，获取按下位置；确定按下位置对应的目标播放位置；以目标播放位置为起点，播放多媒体文件。
在实际中，按下操作可能为点击操作，也可能为拖拽操作。具体地，若按下操作的持续时间较短，且操作距离较短，该按下操作为点击操作；若按下操作的持续时间较长，且操作距离较长，该按下操作为拖拽操作。因此，在实际中，可以基于按下操作的持续时间和/或操作距离(即拖拽距离)，判断该按下操作具体为何种操作。
可选地，本步骤的具体实现方法可以为：响应于在目标多媒体文件的时间进度控制区域的按下操作，确定按下操作的操作距离；若按下操作的操作距离小于距离阈值，获取按下操作初始时刻的按下位置信息，确定按下操作初始时刻的按下位置对应的目标播放位置；若按下操作的操作距离大于或等于距离阈值，获取按下操作结束时刻的按下位置信息，确定按下操作结束时刻的按下位置对应的目标播放位置；以目标播放位置为起点，播放多媒体文件。
可选地，按下操作的操作距离是指从按下操作的开始时刻至结束时刻的时间段内射线焦点的移动轨迹在X轴方向的投影长度。X轴与播控面板长度方向平行。
若按下操作的操作距离小于距离阈值，将该按下操作判定为点击操作，由于点击操作的操作距离非常短，可以视为在整个操作过程中射线焦点未移动，因此，用按下操作初始时刻的按下位置代表用户意愿，进行进度调整。若按下操作的操作距离大于或等于距离阈值，将该按下操作判定为拖拽操作。拖拽操作中，用拖拽操作结束时刻(即按下操作结束时刻)的位置代表用户意愿，进行进度调整。
采用这种方式，无论按下操作是点击操作还是拖拽操作，对于一次按下操作，多媒体文件的播放进度仅调节一次。
用于实现“确定按下操作初始时刻的按下位置对应的目标播放位置”的方法有多种，本申请对此不作限制。示例性地，设定播控面板左边线对应多媒体文件播放时刻为开始时刻，播控面板右边线对应多媒体文件播放时刻为结束时刻，确定按下操作初始时刻的按下位置距播控面板左边线所在直线的第一距离，基于第一距离，播控面板的总长度，当前展示的多媒体文件的总时长，确定目标播放位置。或者，设置X轴与播控面板长度方向平行，播控面板的左边线在X轴上的坐标值为m，播控面板的右边线在X轴上的坐标值为n，确定区间(m，n)中任意一点与当前展示多媒体文件的播放时刻的对应关系，根据按下操作初始时刻的按下位置在X轴的坐标值以及该对应关系，确定目标播放时刻(即目标播放位 置)。
用于实现“确定按下操作结束时刻的按下位置对应的目标播放位置”的方法与“确定按下操作初始时刻的按下位置对应的目标播放位置”的方法类似，此处不再赘述。
可选地，在实际中，“确定按下操作的操作距离”的步骤，可以在按下操作结束时执行，也可以在按下操作的操作过程中执行。若在按下操作的操作过程中执行，可选地，周期性地执行“确定按下操作的操作距离”的步骤，直至按下操作的操作距离大于或等于距离阈值(该按下操作为拖拽操作)，或按下操作结束(该按下操作为点击操作)。
在实际中，可以将拖拽操作视作为点击操作的延长。因此，本步骤的实现方式还可以为：响应于在时间进度控制区域的按下操作，确定按下操作的操作距离，并获取按下操作初始时刻的按下位置信息，确定按下操作初始时刻的按下位置对应的第一目标播放位置；以第一目标播放位置为起点，播放多媒体文件；判定按下操作的操作距离是否大于或等于距离阈值；若是，获取按下操作结束时刻的按下位置信息，确定按下操作结束时刻的按下位置对应的第二目标播放位置；以第二目标播放位置为起点，播放多媒体文件。此种情况下，在按下操作的操作过程中，周期性地执行“确定按下操作的操作距离”的步骤，直至按下操作的操作距离大于或等于距离阈值(该按下操作为拖拽操作)，或按下操作结束(该按下操作为点击操作)。
这样设置的实质是，若按下操作的操作距离小于距离阈值，不执行“获取按下操作结束时刻的按下位置信息，确定按下操作结束时刻的按下位置对应的第二目标播放位置；以第二目标播放位置为起点，播放多媒体文件”，即多媒体文件从第一目标播放位置开始播放后，不再进行播放进度的调节。若按下操作的操作距离大于或等于距离阈值，执行“获取按下操作结束时刻的按下位置信息，确定按下操作结束时刻的按下位置对应的第二目标播放位置；以第二目标播放位置为起点，播放多媒体文件”，即多媒体文件从第一目标播放位置开始播放后，会根据第二目标播放位置再次进行播放进度的调节。采用这种方式。若按下操作是点击操作，对于一次按下操作，多媒体文件的播放进度调节一次。若按下操作是拖拽操作，对于一次按下操作，多媒体文件的播放进度调节两次。
可选地，在实际中，“确定按下操作的操作距离”的步骤，可以在按下操作结束时执行，也可以在按下操作的操作过程中执行。若在按下操作的操作过程中执行，可选地，周期性地执行“确定按下操作的操作距离”的步骤，直至按下操作的操作距离大于或等于距离阈值(该按下操作为拖拽操作)，或按下操作结束(该按下操作为点击操作)。
上述技术方案通过设置响应于对目标多媒体的时间进度控制区域的操作，对多媒体文件的播放进度进行调整，实质是，在播控面板中不设置进度条，而是将播控面板中非控件区域的时间进度控制区域作为进行多媒体文件播放进度调整的热区域，用来接收用户对播 放进度进行调整的操作。由于目标多媒体的时间进度控制区域尺寸较大，可以增大点击以及拖拽的自由度，使得播放进度调整易于实现。
需要说明的是，通常情况下，用户与头戴式显示设备进行交互是通过射线与碰撞盒碰撞来实现的。在三维场景下，射线与碰撞盒的碰撞会产生一个三维坐标，这个三维坐标就是光标所渲染的位置。但是在多媒体文件播放的场景下，播控面板被展示在一个平面上，因此并不需要为播控面板中的控件生成一个三维的碰撞盒。可以为播控面板中的控件生成一个二维的碰撞盒。即在播控面板所在平面构建二维坐标系，在处理按下操作时，仅关注射线焦点的该二维坐标系中的坐标值即可。
图6为本公开实施例提供的另一种信息展示方法的流程图。图6为图2中的一个具体示例。图6中所给出的技术方案适用于通过拖拽的方式对播放进度进行调整的情况。参见图6，该方法包括：
S210、在虚拟现实空间展示播控面板，播控面板包括控件区域和非控件区域，非控件区域包括目标多媒体文件的时间进度控制区域。
S220、响应于在时间进度控制区域的按下操作，确定按下操作的操作距离。
具体地，响应于在目标多媒体的时间进度控制区域的按下操作，在按下操作的操作过程中，周期性地确定按下操作的操作距离。
S230、若按下操作的操作距离大于或等于距离阈值，增大可接收按下操作的区域的面积，以使可接收按下操作的区域的面积大于时间进度控制区域的面积。
可选地，控播面板位于可接收按下操作的区域中。
图7和图8为本公开实施例提供的另一种播控面板的示意图。示例性地，用户通过手柄使得射线焦点位于图7中A位置，并按压手柄中的选定按键时，由于A位置在时间进度控制区域内，确认用户的操作属于在时间进度控制区域的按下操作，周期性地确定该按下操作的操作距离，若在时刻t，该按下操作的操作距离大于或等于距离阈值，判断该按下操作为拖拽操作，增大可接收按下操作的区域的面积，即增大可进行拖拽的热区域。在图8中，以点填充的区域表示增大后可进行拖拽的热区域。这样设置可以增加拖拽控制的自由度，有效提升拖拽操作的可控性和效率。需要强调的是，在时刻t，按下操作并未结束。
S240、获取按下操作结束时刻的按下位置。
S250、确定按下操作结束时刻的按下位置对应的目标播放位置。
本步骤的实现方法有多种，本申请对此不作限制。示例性地，设置X轴与播控面板长度方向平行，可接收按下操作的区域的左边线在X轴上的坐标值为p，可接收按下操作的区域的右边线在X轴上的坐标值为q，确定区间(p，q)中任意一点与当前展示多媒体文件的播放时刻的对应关系，根据按下操作结束时刻(即拖拽操作的结束时刻)的按下位置 在X轴的坐标值以及该对应关系，确定目标播放时刻(即目标播放位置)。
或者，可选地，继续参见图8，将可接收按下操作的区域划分为三个区域，即从左到右顺次排列的第一子热区域S2-1、第二子热区域S2-2以及第三子热区域S2-3，第一子热区域S2-1与第二子热区域S2-2的交界线经过播控面板的左边线，第二子热区域S2-2与第三子热区域S2-3的交界线经过播控面板的右边线；本步骤的具体实现方法包括：若按下操作结束时刻的按下位置(示例性地，按下位置为图8中C点、H点或E点)在第二子热区域内，基于按下操作结束时刻按下位置在X轴方向的坐标值，确定按下位置对应的目标播放位置；若按下操作结束时刻的按下位置(示例性地，按下位置为图8中B点或F点)在第一子热区域内，确定多媒体文件的开始时刻为按下位置对应的目标播放位置；若按下操作结束时刻的按下位置(示例性地，按下位置为图8中D点或G点)在第三子热区域内，确定多媒体文件的结束时刻为按下位置对应的目标播放位置。
其中，若按下操作结束时刻的按下位置在第二子热区域内，基于按下操作结束时刻按下位置在X轴方向的坐标值，确定按下位置对应的目标播放位置，其具体实现方法与前文中的“确定按下操作初始时刻的按下位置对应的目标播放位置”的方法类似，此处不再赘述。
S260、以目标播放位置为起点，播放多媒体文件。
上述技术方案的实质，若按下操作为拖拽操作时，增大可接收按下操作的区域的面积，以增加拖拽控制的自由度，有效提升拖拽操作的可控性和效率。
在上述各技术方案的基础上，可选地，若按下操作的操作距离大于或等于距离阈值，禁用位于控件区域中的控件，直至按下操作结束。这样设置的目的是，在进行拖拽操作的过程中，禁止控件区域中的控件响应悬停、点击以及拖拽操作，避免误触。
图9和图10为本公开实施例提供的另一种播控面板的示意图。在上述各技术方案的基础上，可选地，该方法还包括：在播控面板中展示当前进度标识。在图9和图10，标注J且垂直于X轴的竖线为当前进度标识。
进一步地，若按下操作为点击操作，当前进度标识在X轴的坐标值与该按下操作开始时刻按下位置在X轴的坐标值相同；若按下操作为拖拽操作，当前进度标识在X轴的坐标值与按下操作结束时刻的按下位置在X轴的坐标值相同。
可选地，继续参见图9和图10，在播控面板中，当前进度标识J与播控面板的左边线之间的区域的背景色与当前进度标识J与播控面板的右边线之间的区域的背景色不同。这样设置有利于凸显当前时刻多媒体文件播放进度信息。
进一步地，该方法还包括：响应于在目标多媒体的时间进度控制区域的悬停操作，获取悬停位置信息；确定悬停位置对应的视频图像以及该视频图像的时间信息；在播控面板 所在平面中展示视频图像以及该视频图像的时间信息。
图11为本公开实施例提供的另一种播控面板的示意图。参见图11，假设射线焦点悬停于K点，在预览图像弹窗中展示K点对应的视频图像。预览图像弹窗位于播控面板所在平面中。
可选地，在利用头戴式显示设备进行视频播放时，若待播放的视频源的投影模式为全屏模式(即2D模式下的Plane)，且视频源中视频图像的长宽比与头戴式显示设备中视频显示区的长宽比不同，将视频图像的中心与视频显示区的中心对齐，保持视频图像的长宽比不变，对视频图像进行放大，直至视频图像的宽度与视频显示区的宽度一致，且视频图像的长度小于视频显示区的长度；或者，将视频图像的中心与视频显示区的中心对齐，保持视频图像的长宽比不变，对视频图像进行放大，直至视频图像的长度与视频显示区的长度一致，且视频图像的宽度小于视频显示区的宽度。这样设置可以解决因拉伸导致视频图像中的事物变形的问题。
进一步地，若多媒体文件为视频，该方法还包括：确定视频源数据的投影模式和存储模式；基于投影模式和存储模式，确定与视频源对应的视频播放模型；视频播放模型包括视频图像待粘贴区；将视频源数据中每一帧视频图像粘贴于视频图像待粘贴区，形成待播放视频数据。其中，投影模式包括Plane(平面)，Sphere(球面)，Cube(立方体)，360°全景，180°全景等。存储模式包括普通(2D视频)，上下(3D视频)，左右(3D视频)等存储格式。
示例性地，图12为本公开实施例提供的一种Cube模型的示意图。该Cube模型包括六个视频图像待粘贴区，分别为1左、2前、3右、4下、5后以及6上。通过Surface共享的方式从浏览器播放内核里获取视频源数据，对视频源数据进行分析，得到视频源数据的投影模式和存储模式。若基于视频投影模式和存储模式，确定该视频源对应图11中的视频播放模型，将视频源数据中每一帧视频图像粘贴于图11中视频图像待粘贴区，形成待播放视频数据。
以上仅以非控件区域包含目标多媒体文件的时间进度控制区域为例进行交互说明以及技术说明，当非控件区域包含目标多媒体文件的时间进度控制区域、内容介绍区域、关联内容推荐区域、评论区域、广告区域以及选集菜单区域中之一功能或者组合功能时，实现方式和交互方式与上述类似，只是包含组合功能时将非控件区域划分为相应的功能区域即可，本公开实施例就不再逐一展开。
需要说明的是，对于前述的各方法实施例，为了简单描述，故将其都表述为一系列的动作组合，但是本领域技术人员应该知悉，本发明并不受所描述的动作顺序的限制，因为依据本发明，某些步骤可以采用其他顺序或者同时进行。其次，本领域技术人员也应该知 悉，说明书中所描述的实施例均属于优选实施例，所涉及的动作和模块并不一定是本发明所必须的。
图13为本公开实施例中的一种信息展示装置的结构示意图。所述装置应用于扩展现实XR终端设备。参见图13，该信息展示装置具体包括：
进入模块310，用于进入虚拟现实空间；
第一展示模块320，用于接收到用户触发的媒体播放指令，在所述虚拟现实空间显示目标多媒体文件的播放页面；
第二展示模块330，用于在所述虚拟现实空间展示播控面板，所述播控面板包括控件区域和非控件区域；
第三展示模块340，用于在所述非控件区域中展示与所述多媒体文件相关的信息。
进一步地，所述控件区域包括至少两个子控件区域；任意两个所述子控件区域不连通；各所述子控件区域中设置有至少一个控件。
进一步地，所述非控件区域与所述控件区域上下排列或者左右排列。
进一步地，所述非控件区域至少包括如下区域之一：
所述目标多媒体文件的时间进度控制区域、内容介绍区域、关联内容推荐区域、评论区域、广告区域以及选集菜单区域。
进一步地，该装置还包括控制模块，控制模块用于当检测到针对所述非控件区域中目标区域的预设操作时，禁止所述播控面板的其他各区域反馈，扩大所述目标区域的响应区域，以响应针对所述目标区域的用户操作。
进一步地，该装置还包括控制模块，控制模块用于当检测到预设操作时，将所述播控面板切换为仅包括单一功能的控制区域。
进一步地，若所述多媒体文件为视频，视频源的投影模式为全屏模式，且所述视频源中视频图像的长宽比与所述目标多媒体文件的播放页面中视频显示区的长宽比不同；
该装置还包括控制模块，控制模块用于：
将所述视频图像的中心与所述视频显示区的中心对齐，保持所述视频图像的长宽比不变，对所述视频图像进行放大，直至所述视频图像的宽度与所述视频显示区的宽度一致，且视频图像的长度小于视频显示区的长度；或者，
将所述视频图像的中心与所述视频显示区的中心对齐，保持所述视频图像的长宽比不变，对所述视频图像进行放大，直至所述视频图像的长度与所述视频显示区的长度一致，且视频图像的宽度小于视频显示区的宽度。
本公开实施例提供的播放进度调整装置，可执行本公开方法实施例所提供信息展示方法的步骤，具备执行步骤和有益效果，此处不再赘述。
图14为本公开实施例中的一种头戴式显示设备的结构示意图。下面具体参考图14，其示出了适于用来实现本公开实施例中的头戴式显示设备1000的结构示意图。
如图14所示，头戴式显示设备1000可以包括处理装置(例如中央处理器、图形处理器等)1001，其可以根据存储在只读存储器(ROM)1002中的程序或者从存储装置1008加载到随机访问存储器(RAM)1003中的程序而执行各种适当的动作和处理以实现如本公开所述的实施例的信息展示方法。在RAM 1003中，还存储有头戴式显示设备1000操作所需的各种程序和信息。处理装置1001、ROM 1002以及RAM 1003通过总线1004彼此相连。输入/输出(I/O)接口1005也连接至总线1004。
通常，以下装置可以连接至I/O接口1005：包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置1006；包括例如液晶显示器(LCD)、扬声器、振动器等的输出装置1007；包括例如磁带、硬盘等的存储装置1008；以及通信装置1009。通信装置1009可以允许头戴式显示设备1000与其他设备进行无线或有线通信以交换信息。虽然图13示出了具有各种装置的头戴式显示设备1000，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地，根据本公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在非暂态计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码，从而实现如上所述的信息展示方法。在这样的实施例中，该计算机程序可以通过通信装置1009从网络上被下载和安装，或者从存储装置1008被安装，或者从ROM 1002被安装。在该计算机程序被处理装置1001执行时，执行本公开实施例的方法中限定的上述功能。
需要说明的是，本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分传播的信息信号，其中承载了计算机可读的程序代码。这种传播的信息信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读信号介质可以 发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、RF(射频)等等，或者上述的任意合适的组合。
在一些实施方式中，客户端、服务器可以利用诸如HTTP(HyperText Transfer Protocol，超文本传输协议)之类的任何已知或未来研发的网络协议进行通信，并且可以与任意形式或介质的数字信息通信(例如，通信网络)互连。通信网络的示例包括局域网(“LAN”)，广域网(“WAN”)，网际网(例如，互联网)以及端对端网络(例如，ad hoc端对端网络)，以及任何已知或未来研发的网络。
上述计算机可读介质可以是上述头戴式显示设备中所包含的；也可以是单独存在，而未装配入该头戴式显示设备中。
上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被该头戴式显示设备执行时，使得该头戴式显示设备：
进入虚拟现实空间；
接收到用户触发的媒体播放指令，在所述虚拟现实空间显示目标多媒体文件的播放页面；
在所述虚拟现实空间展示播控面板，所述播控面板包括控件区域和非控件区域；
在所述非控件区域中展示与所述多媒体文件相关的信息。
当多媒体文件在头戴式显示设备中被展示时，展示播控面板，所述播控面板包括控件区域和目标多媒体的时间进度控制区域；
响应于对所述目标多媒体的时间进度控制区域的操作，对所述多媒体文件的播放进度进行调整。
可选的，当上述一个或者多个程序被该头戴式显示设备执行时，该头戴式显示设备还可以执行上述实施例所述的其他步骤。
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括但不限于面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
附图中的流程图和框图，图示了按照本公开各种实施例的系统、方法和计算机程序产 品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的单元可以通过软件的方式实现，也可以通过硬件的方式来实现。其中，单元的名称在某种情况下并不构成对该单元本身的限定。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
根据本公开的一个或多个实施例，本公开提供了一种头戴式显示设备，包括：
一个或多个处理器；
存储器，用于存储一个或多个程序；
当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如本公开提供的任一所述的信息展示方法。
根据本公开的一个或多个实施例，本公开提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本公开提供的任一所述的信息展示方法。
本公开实施例还提供了一种计算机程序产品，该计算机程序产品包括计算机程序或指令，该计算机程序或指令被处理器执行时实现如上所述的信息展示方法。
需要说明的是，在本文中，诸如“第一”和“第二”等之类的关系术语仅仅用来将一 个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
以上所述仅是本公开的具体实施方式，使本领域技术人员能够理解或实现本公开。对这些实施例的多种修改对本领域的技术人员来说将是显而易见的，本文中所定义的一般原理可以在不脱离本公开的精神或范围的情况下，在其它实施例中实现。因此，本公开将不会被限制于本文所述的这些实施例，而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。

Claims (10)

  1. 一种信息展示方法，其特征在于，所述方法应用于扩展现实XR终端设备，所述方法包括：
    进入虚拟现实空间；
    接收到用户触发的媒体播放指令，在所述虚拟现实空间显示目标多媒体文件的播放页面；
    在所述虚拟现实空间展示播控面板，所述播控面板包括控件区域和非控件区域；
    在所述非控件区域中展示与所述多媒体文件相关的信息。
  2. 根据权利要求1所述的方法，其特征在于，
    所述控件区域包括至少两个子控件区域；任意两个所述子控件区域不连通；各所述子控件区域中设置有至少一个控件。
  3. 根据权利要求1所述的方法，其特征在于，所述非控件区域与所述控件区域上下排列或者左右排列。
  4. 根据权利要求3所述的方法，其特征在于，所述非控件区域包括下述至少一个区域：
    所述目标多媒体文件的时间进度控制区域、内容介绍区域、关联内容推荐区域、评论区域、广告区域以及选集菜单区域。
  5. 根据权利要求4所述的方法，其特征在于，当检测到针对所述非控件区域中目标区域的预设操作时，禁止所述播控面板的其他各区域反馈，扩大所述目标区域的响应区域，以响应针对所述目标区域的用户操作。
  6. 根据权利要求1所述的方法，其特征在于，还包括：
    当检测到预设操作时，将所述播控面板切换为仅包括单一功能的控制区域。
  7. 根据权利要求1所述的方法，其特征在于，若所述多媒体文件为视频，视频源的投影模式为全屏模式，且所述视频源中视频图像的长宽比与所述目标多媒体文件的播放页面中视频显示区的长宽比不同，该方法还包括：
    将所述视频图像的中心与所述视频显示区的中心对齐，保持所述视频图像的长宽比不变，对所述视频图像进行放大，直至所述视频图像的宽度与所述视频显示区的宽度一致，且视频图像的长度小于视频显示区的长度；或者，
    将所述视频图像的中心与所述视频显示区的中心对齐，保持所述视频图像的长宽比不变，对所述视频图像进行放大，直至所述视频图像的长度与所述视频显示区的长度一致，且视频图像的宽度小于视频显示区的宽度。
  8. 一种信息展示装置，其特征在于，所述装置应用于扩展现实XR终端设备，所述装置包括：
    进入模块，用于进入虚拟现实空间；
    第一展示模块，用于接收到用户触发的媒体播放指令，在所述虚拟现实空间显示目标多媒体文件的播放页面；
    第二展示模块，用于在所述虚拟现实空间展示播控面板，所述播控面板包括控件区域和非控件区域；
    第三展示模块，用于在所述非控件区域中展示与所述多媒体文件相关的信息。
  9. 一种头戴式显示设备，其特征在于，所述头戴式显示设备包括：
    一个或多个处理器；
    存储装置，用于存储一个或多个程序；
    当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如权利要求1-7中任一项所述的方法。
  10. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现如权利要求1-7中任一项所述的方法。
PCT/CN2023/077210 2022-03-04 2023-02-20 信息展示方法、装置、头戴式显示设备及存储介质 Ceased WO2023165362A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US18/842,292 US20250181216A1 (en) 2022-03-04 2023-02-20 Information display method and apparatus, and head-mounted display device, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210207263.4A CN116744041A (zh) 2022-03-04 2022-03-04 信息展示方法、装置、头戴式显示设备及存储介质
CN202210207263.4 2022-03-04

Publications (1)

Publication Number Publication Date
WO2023165362A1 true WO2023165362A1 (zh) 2023-09-07

Family

ID=87882891

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/077210 Ceased WO2023165362A1 (zh) 2022-03-04 2023-02-20 信息展示方法、装置、头戴式显示设备及存储介质

Country Status (3)

Country Link
US (1) US20250181216A1 (zh)
CN (1) CN116744041A (zh)
WO (1) WO2023165362A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102347044A (zh) * 2011-05-20 2012-02-08 合一网络技术(北京)有限公司 一种用于嵌入式媒体播放器的同步显示、控制方法和系统及设备
CN102347045A (zh) * 2011-05-20 2012-02-08 合一网络技术(北京)有限公司 一种用于嵌入式媒体播放器的同步显示、控制的系统和设备
CN106937156A (zh) * 2015-12-31 2017-07-07 幸福在线（北京）网络技术有限公司 一种实现多资源同步播放的方法及装置和媒体播放器
US20170264936A1 (en) * 2016-03-14 2017-09-14 The Directv Group, Inc. Method and system for viewing sports content within a virtual reality environment
CN107515674A (zh) * 2017-08-08 2017-12-26 山东科技大学 一种基于虚拟现实与增强现实的采矿操作多交互实现方法
CN107957775A (zh) * 2016-10-18 2018-04-24 阿里巴巴集团控股有限公司 虚拟现实空间环境中的数据对象交互方法及装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102347044A (zh) * 2011-05-20 2012-02-08 合一网络技术(北京)有限公司 一种用于嵌入式媒体播放器的同步显示、控制方法和系统及设备
CN102347045A (zh) * 2011-05-20 2012-02-08 合一网络技术(北京)有限公司 一种用于嵌入式媒体播放器的同步显示、控制的系统和设备
CN106937156A (zh) * 2015-12-31 2017-07-07 幸福在线（北京）网络技术有限公司 一种实现多资源同步播放的方法及装置和媒体播放器
US20170264936A1 (en) * 2016-03-14 2017-09-14 The Directv Group, Inc. Method and system for viewing sports content within a virtual reality environment
CN107957775A (zh) * 2016-10-18 2018-04-24 阿里巴巴集团控股有限公司 虚拟现实空间环境中的数据对象交互方法及装置
CN107515674A (zh) * 2017-08-08 2017-12-26 山东科技大学 一种基于虚拟现实与增强现实的采矿操作多交互实现方法

Also Published As

Publication number Publication date
CN116744041A (zh) 2023-09-12
US20250181216A1 (en) 2025-06-05

Similar Documents

Publication Publication Date Title
JP7139515B2 (ja) 動画撮像方法、動画撮像装置、電子機器、およびコンピューター読取可能な記憶媒体
JP7053869B2 (ja) ビデオ生成の方法、装置、電子機器及びコンピュータ読み取り可能記憶媒体
CN114286142B (zh) 一种虚拟现实设备及vr场景截屏方法
KR102845178B1 (ko) 정보 재생 방법, 장치, 컴퓨터 판독 가능 저장 매체 및 전자기기
CN103324453B (zh) 显示器
WO2020077855A1 (zh) 视频拍摄方法、装置、电子设备及计算机可读存储介质
US9858031B2 (en) Colony desktop hive display: creating an extended desktop display from multiple mobile devices using near-field or other networking
WO2023011181A1 (zh) 横屏交互方法、装置、电子设备及存储介质
US20230405475A1 (en) Shooting method, apparatus, device and medium based on virtual reality space
CN110710203B (zh) 用于生成和渲染沉浸式视频内容的方法、系统和介质
CN114419213B (zh) 图像处理方法、装置、设备和存储介质
CN115830224A (zh) 多媒体数据的编辑方法、装置、电子设备及存储介质
WO2022183887A1 (zh) 视频编辑及播放方法、装置、设备、介质
WO2023024921A1 (zh) 视频交互方法、装置、设备及介质
WO2024037555A1 (zh) 页面显示方法、装置、设备及存储介质
CN115022696A (zh) 视频预览方法、装置、可读介质及电子设备
US20250371766A1 (en) Effect processing method and apparatus, electronic device, and storage medium
EP4676067A1 (en) Virtual gift generation method and apparatus, device, and medium
WO2024198947A1 (zh) 虚拟场景处理方法、装置、电子设备及存储介质
WO2023169305A1 (zh) 特效视频生成方法、装置、电子设备及存储介质
JP7775492B2 (ja) 方法、システム、非一時的なコンピュータ可読記憶媒体及びコンピュータプログラム
WO2023246302A9 (zh) 字幕的显示方法、装置、设备及介质
US11962743B2 (en) 3D display system and 3D display method
CN111045586B (zh) 基于三维场景的界面切换方法、车机设备及车辆
WO2023165362A1 (zh) 信息展示方法、装置、头戴式显示设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23762763

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18842292

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12.12.2024)

WWP Wipo information: published in national office

Ref document number: 18842292

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 23762763

Country of ref document: EP

Kind code of ref document: A1