CN109756727B - Information display method and related equipment - Google Patents

Information display method and related equipment Download PDF

Info

Publication number
CN109756727B
CN109756727B CN201710738877.4A CN201710738877A CN109756727B CN 109756727 B CN109756727 B CN 109756727B CN 201710738877 A CN201710738877 A CN 201710738877A CN 109756727 B CN109756727 B CN 109756727B
Authority
CN
China
Prior art keywords
display object
display
information
description information
target video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710738877.4A
Other languages
Chinese (zh)
Other versions
CN109756727A (en
Inventor
尹旭贤
张尧烨
顾迎节
高莹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201710738877.4A priority Critical patent/CN109756727B/en
Publication of CN109756727A publication Critical patent/CN109756727A/en
Application granted granted Critical
Publication of CN109756727B publication Critical patent/CN109756727B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the application discloses an information display method and related equipment. The method comprises the following steps: the terminal equipment receives a target video, description information of a display object contained in the target video and display object information of the target video from a server, wherein the display object information comprises attribute information of the display object contained in the target video and attribute information of the description information of the display object; and in the process of playing the target video, when the display object appears in the user visual angle of the target video determined according to the attribute information of the display object, the terminal equipment displays the description information of the display object in the user visual angle according to the attribute information of the display object and the attribute information of the description information of the display object. By the adoption of the method and the terminal device, the terminal device can dynamically and flexibly adjust the presentation area of the description information of the display object according to the visual angle of the user, so that information omission caused by the fact that the visual angle of the user does not reach the fixed presentation area of the description information is avoided, and user experience is improved.

Description

Information display method and related equipment
Technical Field
The present invention relates to the field of electronic technologies, and in particular, to an information display method and a related device.
Background
In order to enable a user to better know information of display objects such as buildings, objects, people and the like in videos, description information is often presented near the display objects in some videos for introducing information such as names, calendars, characteristics and the like of the display objects. In the prior art, the description information of the display object is edited and presented at a fixed position and fixed time of a video, a server packages the description information and a video data stream together and directly transmits the packaged description information and the video data stream to a terminal device, the terminal device directly analyzes and plays the video, and the description information of the display object is presented in the video according to the fixed position and the fixed time.
With the development of digital technology, a panoramic video, also called 360-degree panoramic video, is a video synthesized by synchronously acquiring 360-degree scenes around a viewing angle through multiple cameras and performing image processing (splicing, projection, fusion and the like) technology, and a user can realize 360-degree panoramic experience by adjusting the viewing angle when watching. The location area where the content currently viewed by the user is located in the panoramic video coordinate system is generally referred to as the current user perspective. When a user watches panoramic video, the visual angle of the user can be converted by sliding a screen on the terminal or wearing a Virtual Reality (VR) helmet to rotate the head, so that the video picture can be watched from different angles.
Then, there is a problem when the user watches the panoramic video: when the user perspective does not reach the area where the description information of the display object appears or the user perspective is converted to another area, the user may miss the opportunity to see the description information.
Disclosure of Invention
The embodiment of the application provides an information display method and related equipment, terminal equipment can dynamically and flexibly adjust a presentation area of description information of a display object according to a user visual angle, information omission is avoided, and user experience is improved.
A first aspect of the present application provides an information display method. The method comprises the following steps: the terminal equipment receives a target video, description information of a display object contained in the target video and display object information of the target video from a server, wherein the display object information comprises attribute information of the display object contained in the target video and attribute information of the description information of the display object; and in the process of playing the target video, when the display object appears in the user visual angle of the target video determined according to the attribute information of the display object, the terminal equipment displays the description information of the display object in the user visual angle according to the attribute information of the display object and the attribute information of the description information of the display object.
In the technical scheme, the terminal equipment can dynamically and flexibly adjust the presentation area of the description information of the display object according to the user visual angle, so that information omission caused by the fact that the user visual angle does not reach the fixed presentation area of the description information is avoided.
In a first possible implementation manner of the first aspect, before the terminal device receives, from the server, description information of a display object included in the target video, the terminal device further receives, from the server, identification information corresponding to the description information of the display object of the target video in a plurality of different display qualities, determines target identification information from the identification information corresponding to the description information of the display object in the plurality of different display qualities, and requests, from the server, the description information corresponding to the target identification information, where the target identification information is used by the server to send, to the terminal device, the description information of the display object corresponding to the target identification information.
In the technical scheme, the terminal equipment can determine proper description information according to the network bandwidth and the screen resolution of the terminal equipment, so that the description information of the object with better quality can be dynamically and flexibly presented according to the visual angle of a user.
In a second possible implementation manner of the first aspect, the terminal device determines an appearance time period and a position area of the display object in the target video according to the attribute information of the display object; when the terminal device detects that the playing time of the target video is within the appearance time period of the display object and the coverage range of the current user view angle to the position area of the display object is larger than a preset first threshold value, the terminal device displays the description information of the display object within the user view angle according to the position area of the display object and the attribute information of the description information of the display object.
With reference to the second possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the terminal device determines, according to the attribute information of the description information of the display object, a size of a display area in which the description information of the display object is displayed; the terminal equipment determines a target display area for displaying the description information of the object according to the user visual angle, the position area for displaying the object and the size of the display area for displaying the description information of the object; the terminal equipment displays the description information of the display object in the target display area.
With reference to the third possible implementation manner of the first aspect, in a fourth possible implementation manner of the first aspect, the terminal device determines at least one selectable display area for displaying the description information of the object according to the position area of the display object, the user perspective, and the size of the display area for displaying the description information of the object; the terminal equipment determines a target display area for displaying the description information of the object in at least one selectable display area.
With reference to the fourth possible implementation manner of the first aspect, in a fifth possible implementation manner of the first aspect, the terminal device determines, according to the location area of the display object, at least one display anchor point corresponding to the display object; the terminal equipment determines a target display anchor point within the user visual angle in at least one display anchor point; and the terminal equipment determines at least one selectable display area of the description information of the display object according to the target display anchor point and the size of the display area of the description information of the display object.
With reference to the second possible implementation manner of the first aspect, in a sixth possible implementation manner of the first aspect, the attribute information of the display object includes at least one of an appearance start time point or a disappearance time point of the display object, and the terminal device determines an appearance time period of the display object in the target video according to the at least one of the appearance start time point or the disappearance time point of the display object.
With reference to the third possible implementation manner of the first aspect, in a seventh possible implementation manner of the first aspect, the method further includes: when the terminal equipment detects that the user visual angle is changed, the terminal equipment updates a target display area for displaying the description information of the object according to the changed user visual angle, the position area for displaying the object and the size of the display area for displaying the description information of the object; and the terminal equipment displays the description information of the display object in the updated target display area.
With reference to the first aspect or any one of the first to seventh possible implementation manners of the first aspect, in an eighth possible implementation manner of the first aspect, the attribute information of the description information of the display object includes a display duration threshold, and the terminal device displays, when it is determined that the display object appears within the user perspective of the target video, the description information of the display object in the target video according to the display duration threshold according to the attribute information of the display object and the attribute information of the description information of the display object.
A second aspect of the present application provides an information display method. The method comprises the following steps: the server sends the target video, the description information of the display object contained in the target video and the display object information of the target video to the terminal equipment, the display object information comprises the attribute information of the display object contained in the target video and the attribute information of the description information of the display object, and the display object information is used by the terminal equipment for displaying the description information of the display object in the process of playing the target video.
In the technical scheme, the server sends the description information of the display object contained in the target video and the display object information of the target video to the terminal equipment, so that the terminal equipment can dynamically and flexibly adjust the presentation area of the description information of the display object according to the visual angle of a user, and information omission caused by the fact that the visual angle of the user does not reach the fixed presentation area of the description information is avoided.
In a first possible implementation manner of the second aspect, the display object of the target video has description information of a plurality of different display qualities, and before the server sends the description information of the display object included in the target video to the terminal device, the server further determines the description information of the display object sent to the terminal device from the description information of the plurality of different display qualities of the display object of the target video.
In a second possible implementation manner of the second aspect, a display object of a target video has description information of a plurality of different display qualities, and before the server sends the description information of the display object included in the target video to the terminal device, the server also sends, to the terminal device, identification information corresponding to the description information of the display object of the target video, where the description information of the display object of the target video corresponds to each of the plurality of different display qualities; receiving target identification information from a terminal device, wherein the target identification information is determined by the terminal device in identification information respectively corresponding to a plurality of pieces of description information of different display qualities of a display object; and determining the description information corresponding to the target identification information as the description information of the display object sent to the terminal equipment.
In the technical scheme, the server can enable the terminal equipment to determine proper description information according to the network bandwidth and the screen resolution of the terminal equipment, so that the description information of the object with better quality can be dynamically and flexibly presented according to the visual angle of a user.
With reference to the second aspect or any one of the first to the second possible implementation manners of the second aspect, in a third possible implementation manner of the first aspect, the display object information of the target video is carried by a Media Presentation Description (MPD) file of the target video.
With reference to the second aspect or any one of the first to third possible implementation manners of the second aspect, in a fourth possible implementation manner of the first aspect, the attribute information of the display object includes an appearance starting time point of the display object, and the appearance starting time point is used by the terminal device to determine an appearance time period of the display object in the target video.
With reference to the second aspect or any one of the first to third possible implementation manners of the second aspect, in a fifth possible implementation manner of the first aspect, the attribute information of the display object includes a disappearance time point of the display object, and the disappearance time point is used by the terminal device to determine an appearance time period of the display object in the target video.
A third aspect of the present application provides an information display apparatus. Including a processor, a memory, and a transceiver. The processor is connected to the memory and the transceiver, for example, the processor may be connected to the memory and the transceiver through a bus. The transceiver is used for communicating with other network devices. The memory is used for storing program codes and the like. The processor is configured to perform part or all of the procedures of the first aspect.
A fourth aspect of the present application provides another information display apparatus, including a receiving module, a processing module, and optionally a sending module, where the processing module is configured to implement the processor in the third aspect, and the sending module is configured to implement the transceiver in the third aspect in combination with the receiving module. The information display device realizes part or all of the method of the first aspect through the modules.
A fifth aspect of the present application provides an information display apparatus. Including a processor, a memory, and a transceiver. The processor is connected to the memory and the transceiver, for example, the processor may be connected to the memory and the transceiver through a bus. The transceiver is used for communicating with other network devices. The memory is used for storing program codes and the like. The processor is configured to perform part or all of the process of the second aspect.
A sixth aspect of the present application provides another information display apparatus, including a sending module, and optionally further including a receiving module and a processing module, where the processing module is configured to implement the processor in the fifth aspect, and the sending module is configured to implement the transceiver in the fifth aspect in combination with the receiving module. The information display device realizes part or all of the method of the second aspect through the modules.
A seventh aspect of the present application provides a storage medium, where a program code is stored, and when the program code is executed by a computing device, the information display method provided by the first aspect or any one of the implementation manners of the first aspect is executed. The storage medium includes, but is not limited to, a flash memory (english: flash memory), a hard disk (HDD) or a Solid State Drive (SSD).
In an eighth aspect of the present application, a computer program product is provided, which when executed by a computing device, executes the information display method provided by the first aspect or any one of the implementation manners of the first aspect.
In a ninth aspect of the present application, a storage medium is provided, where a program code is stored, and when the program code is executed by a computing device, the program code executes the information display method provided by the second aspect or any one of the implementation manners of the second aspect. The storage medium includes, but is not limited to, a flash memory (english: flash memory), a hard disk (HDD) or a Solid State Drive (SSD).
In a tenth aspect of the present application, a computer program product is provided, which when executed by a computing device, performs the information display method provided by the second aspect or any one of the implementation manners of the second aspect.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments or the background art of the present invention, the drawings required to be used in the embodiments or the background art of the present invention will be described below.
Fig. 1 is a schematic diagram of a system architecture for video transmission according to an embodiment of the present application;
fig. 2 is a schematic flowchart of an information display method according to an embodiment of the present application;
FIG. 3 is a schematic flow chart diagram illustrating another information display method according to an embodiment of the present disclosure;
FIG. 4 is a schematic flow chart diagram illustrating another information display method provided by an embodiment of the present application;
FIG. 5 is a diagram illustrating an example of a location area of a display object in a target video according to an embodiment of the present application;
FIG. 6 is an exemplary diagram of a coverage of a display object from a user perspective provided by an embodiment of the application;
FIG. 7 is an exemplary diagram of an alternative display area provided by an embodiment of the present application;
FIG. 8 is an exemplary diagram of a display anchor point and a corresponding selectable display area provided by an embodiment of the present application;
FIG. 9 is a diagram illustrating an example of displaying description information of a display object provided in an embodiment of the present application;
fig. 10 is a schematic structural diagram of an information display device according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of another information display device provided in an embodiment of the present application;
fig. 12 is a schematic structural diagram of another information display device provided in an embodiment of the present application;
fig. 13 is a schematic structural diagram of another information display device according to an embodiment of the present application.
Detailed Description
The embodiments of the present application will be described below with reference to the drawings.
In the embodiment of the present application, the server may send different videos and description information of display objects and display object information of the videos included in the videos to the terminal device, and the information display methods for the display objects in each video are all consistent, so that the embodiment of the present application is described by taking one video, that is, a target video, as an example. Further, the target video in this embodiment of the present application may refer to a complete video including multiple video slices, or may refer to only one video slice, which is specifically described in different embodiments.
The technical solution of the embodiment of the present application is applicable to various networks based on video transmission, for example, a system architecture diagram of video transmission shown in fig. 1 includes a server 101 and a terminal device 102. The terminal device 102 related to the embodiment of the present application has a function of playing a panoramic video for a user, and a panoramic video client is run on the terminal device, where the client may be an application installed on the terminal device or a page on a browser. The terminal device 102 may be a wireless terminal device or a wired terminal device.
Specifically, the terminal device 102 may establish a communication connection with the server 101 through the network 103, and acquire information required to play the panoramic video from the server 101. The wireless terminal device may be a handheld device having wireless connection capability or other processing device connected to a wireless modem. Wireless terminal devices, which may be mobile terminal devices such as mobile telephones (or "cellular" telephones) and computers having mobile terminal devices, for example, portable, pocket, hand-held, computer-included, or vehicle-mounted mobile devices, may communicate with one or more core networks via a Radio Access Network (RAN). The cable terminal device may be a cable television, a cable computer, or the like. The server 101 refers to a device providing the panoramic video service, and the server 101 may be a single device or a cluster providing the panoramic video service. Specifically, the server 101 according to the embodiment of the present application may respond to a service request of a client, and has a function of providing a panoramic video for the client. The server 101 is configured similar to a general-purpose Computer architecture, and typically includes a processor, a hard disk, a memory, a system bus, and the like, and for example, the server 101 may be a Personal Computer (PC) server. The communication between the terminal device 102 and the server 101 supports a general media transmission Protocol of the panoramic video, such as a Real-Time transport Protocol (RTP), a Real-Time Streaming Protocol (RTSP), a HyperText Transfer Protocol (HTTP), a Dynamic Adaptive Streaming over HTTP (DASH) media Protocol, a Live Streaming over HTTP (HLS) media Protocol, and the like.
Referring to fig. 2, fig. 2 is a schematic flow chart of an information display method according to an embodiment of the present application, where the method includes, but is not limited to, the following steps:
s101, the server sends the target video, the description information of the display object contained in the target video and the display object information of the target video to the terminal equipment.
In the embodiment of the present application, the target video may be a complete video or a video fragment, and is not limited herein. The target video may generally include various persons, landscapes, objects, buildings, and the like, and the display object in the target object may be at least one of the persons, landscapes, objects, buildings, and the like, or one or more of the persons, landscapes, objects, buildings, and the like, and may be set by a user or a video producer. The description information of the display objects may refer to information for introducing names, histories, characteristics, and the like of the display objects. For example, if the display object is the Imperial palace, the description information of the display object may include the name of the Imperial palace, the historical story, the architectural features, and other text information, and may further include information such as the introduction of more pictures to the Imperial palace.
The display object information of the target video includes attribute information of the display object contained in the target video and attribute information of description information of the display object. The attribute information of the display object refers to information indicating a time period of appearance, a position area, and the like of the display object, and may specifically include an identifier of the display object, an appearance start time point, a disappearance time point, a height and a width of the position area, a start point coordinate of the position area, and the like. The attribute information of the description information of the display object refers to information indicating a display area size, a display duration threshold value, and the like of the description information of the display object, and may specifically include a width, a height, a display duration threshold value, and the like of the display area.
In one possible design, the server may transmit the target video, the description information of the display object included in the target video, and the display object information of the target video all to the terminal device at once.
In another possible design, the server may also send the target video, the description information of the display object included in the target video, and the display object information of the target video to the terminal device, respectively, for example, the display object information of the target video is sent first, and then the target video and the description information of the display object included in the target video are sent later. In a possible implementation scenario of the design, a plurality of pieces of description information with different display qualities exist in a display object of the target video, the server may first send, to the terminal device, identification information corresponding to each of the plurality of pieces of description information with different display qualities of the display object of the target video, and the terminal device performs adaptive selection, and the server determines, according to the target identification information determined by the terminal device and received from the terminal device, that the description information corresponding to the target identification information is the description information of the display object sent to the terminal device.
Further, in one possible implementation scenario of the two designs, if there are a plurality of pieces of description information of different display qualities of the display object of the target video, before the server sends the description information of the display object included in the target video, the server may determine, according to a history interaction record with the terminal device, the description information of the display object sent to the terminal device, from among the plurality of pieces of description information of different display qualities of the display object of the target video.
Optionally, the server may trigger the step S101 according to a preset event, for example, a preset timing time is reached. The server may also trigger execution of the step S101 according to a related request message for the target video received by the terminal device in advance.
Further, in one possible design, in an implementation scenario that supports the DASH media protocol, the display object information of the target video may be carried by a media presentation description MPD file of the target video.
S102, in the process of playing the target video, when the display object appears in the user visual angle of the target video determined according to the attribute information of the display object, the terminal device displays the description information of the display object in the user visual angle according to the attribute information of the display object and the attribute information of the description information of the display object.
The terminal equipment can play the target video after receiving the target video sent by the server, the description information of the display object contained in the target video and the display object information of the target video, and can display the description information of the display object in the user visual angle according to the attribute information of the display object when the display object appears in the user visual angle of the target video determined according to the attribute information of the display object in the process of playing the target video.
In one possible design, the terminal device may determine an appearance time period and a position area of the display object in the target video according to the attribute information of the display object; when the terminal device detects that the playing time of the target video is within the time period of the display object and the coverage of the current user view angle on the position area of the display object is greater than a preset first threshold, the terminal device may display the description information of the display object within the user view angle according to the position area of the display object and the attribute information of the description information of the display object.
Specifically, the attribute information of the display object may include an appearance start time point, a disappearance time point, a height and a width of the position area, a start point coordinate of the position area, and the like, so that the terminal device may determine the appearance time period and the position area of the display object in the target video according to the attribute information of the display object.
For example, the attribute information of the display Object is shown in table 1, and assuming that there is only one display Object in the target video, that is, the display Object with Object _ id being a, according to the attribute information of the display Object in table 1, the terminal device can determine that the position area where the display Object a is displayed in the target video is an area with (12,0) as a starting point, 27 pixels in width and 40 pixels in height, according to the four items of data of determining X0, Y0, Object _ width and Object _ height, and the hatched portion shown in fig. 5 is the position area where the display Object a is displayed in the target video. It may be determined from T0 and T1 that the appearance period of the display object is between 5s and 20s of the target video.
Identification Data of Description of the invention
Object_id A Display object identification for distinguishing display objects
X0
12 Starting point x coordinate of display object
Y0 0 Y-coordinate of starting point of display object display area
Object_width 27 Width of display object display area
Object_height
40 Height of display object display area
T0 5 Presentation start time point of display object
T1 20 Vanishing time point of display object
Table 1: table of attribute information of display object (example)
It should be noted that, in one possible implementation scenario, both the appearance start time point and the disappearance time point in the attribute information of the display object may be in a default state, and it may be considered that the display object exists from the start to the end of the target video in this case.
In another possible implementation scenario, the attribute information of the display object includes an appearance start time point or a disappearance time point of the display object. When the attribute information of the display object includes the appearance starting time point of the display object, it can be considered that the display object exists all the time from the appearance starting time point of the display object to the end of the target video; when the attribute information of the display object includes the disappearance time point of the display object, it can be considered that the display object exists from the start point of the target video to the disappearance time point of the display object. Thus, the terminal device can determine the appearance time period of the display object in the target video according to the appearance start time point or the disappearance time point of the display object.
For example, assuming that the disappearance time point of the display object is default, the appearance start time point of the display object is 15s, and the total length of the target video is 30s, the terminal device may determine that the appearance time period of the display object is 15s to 30 s; assuming that the appearance start time point of the display object is default and the disappearance time point of the display object is 10s, the terminal device may determine that the appearance time period of the display object is 0s to 10 s.
After the appearance time period and the position area of the display object in the target video are determined, when the terminal device detects that the playing time of the target video is within the appearance time period of the display object, whether the coverage range of the current user view angle to the position area of the display object is larger than a preset first threshold value or not is detected, and when the coverage range of the current user view angle to the position area of the display object is larger than the first threshold value, the description information of the display object is displayed within the user view angle according to the position area of the display object and the attribute information of the description information of the display object.
Specifically, the user view angle refers to a position area where the content currently viewed by the user is located in the panoramic video coordinate system, a coverage of the user view angle on the position area of the display object may refer to a coverage area or a coverage proportion, and the corresponding first threshold may be an area value or a proportion value.
For example, assuming that the first threshold is set to 50%, as shown in fig. 6, the coverage of the current user perspective to the position area of the display object exceeds 50%, the terminal device may display the description information of the display object within the user perspective according to the position area of the display object and the attribute information of the description information of the display object.
Further, the displaying, by the terminal device, the description information of the display object in the user view angle according to the position area of the display object and the attribute information of the description information of the display object may specifically include:
the terminal equipment determines the size of a display area of the description information of the display object according to the attribute information of the description information of the display object; the terminal equipment determines a target display area for displaying the description information of the object according to the user visual angle, the position area for displaying the object and the size of the display area for displaying the description information of the object; the terminal equipment displays the description information of the display object in the target display area.
Specifically, the attribute information of the description information may include a width, a height, a display duration threshold, and the like of the display area, and then the terminal device may determine the size of the display area of the description information of the display object according to the width and the height of the display area, and obtain the display duration threshold.
For example, still assuming that only one display Object exists in the target video, that is, the display Object whose Object _ id is a in table 1, the description information of the display Object a is set as Text information, the attribute information of the description information is shown in table 2, according to the attribute information of the description information of the display Object in the table, the terminal device may determine a rectangular region whose display region size of the description information of the display Object is 10 × 20 according to Text _ width and Text _ height, and the display duration threshold is 2 s. Optionally, when the description information is text information, the attribute information of the description information may further include information such as a text font type, a size, and a text line spacing, and the terminal device may further adjust a display mode of the description information of the display object according to the information.
Identification Data of Description of the invention
Text_id 1 Text identification corresponding to the target object identification
Text_width 10 Width of area covered by text
Text_height 20 Area height covered by text
Text_during 2 Display duration threshold for text presentation
Table 2: attribute information table (example) showing description information of object
After the size of the display area for displaying the description information of the object is determined, the terminal device may determine a target display area for displaying the description information of the object according to the currently detected user viewing angle, the determined position area for displaying the object, and the size of the display area for displaying the description information of the object.
In a possible implementation scenario, when determining a target display area, a terminal device may first determine at least one selectable display area for displaying description information of an object according to a position area of the display object, a user viewing angle, and a display area size of the description information of the display object; a target display area in which description information of the object is displayed is then determined in the at least one selectable display area. Optionally, in the process of determining the target display area from the at least one selectable display area, the terminal device may perform selection according to a preset priority of the display areas.
For example, as shown in fig. 7, according to the current user viewing angle, the position area of the display object, and the size of the display area for displaying the description information of the object, the terminal device may determine at least one selectable display area capable of displaying the description information of the target object, such as selectable display area 1 and selectable display area 2 in fig. 7. Then, the terminal device arbitrarily determines one of the selectable display area 1 and the selectable display area 2 as a target display area; alternatively, an optimal display area is selected as the target display area from the selectable display areas 1 and 2. For example, assuming that the closer the selectable display area is to the display object position area, the higher the priority, the terminal device may determine selectable display area 1 in fig. 7 as the target display area.
Optionally, in this possible implementation scenario, the determining, by the terminal device, the at least one selectable display area may specifically include: the terminal equipment determines at least one display anchor point corresponding to the display object according to the position area of the display object; determining a target display anchor point within the user's view angle from among the at least one display anchor point; and determining at least one selectable display area for displaying the description information of the object according to the target display anchor point and the size of the display area for displaying the description information of the object.
Specifically, the display anchor point may be at least one coordinate point set according to the position region of the display object, for example, the display anchor point may be a center point of each boundary of the position region of the display object, the display anchor point may also be each vertex of the position region of the display object, or may also be a point having a preset vertical distance from the boundary of the position region of the display object, which is not specifically limited herein. As shown in fig. 8, A, B, C and D of the 4 vertices of the location area of the display object in the figure can be the 4 display anchor points of the display object.
Further, the terminal device may determine, according to the user view angle, one target display anchor point within the user view angle from among the at least one display anchor point. It should be noted that, when more than one display anchor point is located in the user view, the terminal device may arbitrarily select one of the display anchor points as the target display anchor point, or may determine the display anchor point with a high priority as the target display anchor point according to the preset priority of the display anchor point. As shown in fig. 8, the display anchors within the user's view are B and D, i.e. the terminal may select B or D as the target display anchor.
And then the terminal equipment determines which display mode based on the target display anchor point can enable the description information of the display object to appear in the user visual angle according to the target display anchor point and the size of the display area of the description information of the display object, so that at least one selectable display area is determined. As shown in fig. 8, if it is determined that B is the target display anchor point, the display areas of the description information presented in the three display modes based on B are the display area a, the display area B, and the display area c in fig. 8, respectively, and it may be determined that only the display area c is the selectable display area in which the description information of the display object appears within the user viewing angle. If it is determined that C is the target display anchor point, the display areas of the description information presented in the three display modes based on C are respectively the display area d, the display area e, and the display area f in fig. 8, and it may be determined that the selectable display area in which the description information of the display object appears within the user viewing angle may include the display area d, the display area e, and the display area f.
Finally, after the terminal device determines the target display area, the terminal device may present the description information of the display object in the target display area. For example, if the description information of the display object is "great wall", as shown in fig. 9, "great wall" is displayed in the target display area. Further optionally, when the terminal device displays the description information of the display object, the description information of the display object may be displayed in the target video according to the display duration threshold, for example, if the display duration threshold in table 2 is 2s, the description information of the display object a may be displayed for 2 s.
Further optionally, in the displaying process, when the terminal device detects that the user view angle changes, the terminal device may update the target display area for displaying the description information of the object according to the changed user view angle, the position area for displaying the object, and the size of the display area for displaying the description information of the object; and the terminal equipment displays the description information of the display object in the updated target display area.
Specifically, since the target display area for displaying the description information of the object may also be changed due to the change of the user viewing angle, the terminal device needs to re-determine the target display area for displaying the description information of the object according to the changed user viewing angle, the position area for displaying the object, and the display area size for displaying the description information of the object, and then display the description information of the object in the updated target display area. The method of updating the target display area of the description information of the display object is consistent with the above method, and thus, will not be described herein again. It should be noted that, if the display duration of the description information of the current display object has reached the display duration threshold, that is, the description information of the display object does not need to be continuously displayed, when the user viewing angle is updated, the terminal device may not need to update the target display area of the description information of the display object.
In the embodiment of the application, the server sends the target video, the description information of the display object contained in the target video and the display object information of the target video to the terminal device, so that the terminal device can display the description information of the display object in a user visual angle according to the attribute information of the display object when the display object appears in the user visual angle of the target video determined according to the attribute information of the display object in the process of playing the target video. The terminal equipment can dynamically and flexibly adjust the presentation area of the description information of the display object according to the visual angle of the user, so that information omission caused by the fact that the visual angle of the user does not reach the fixed presentation area of the description information is avoided, and user experience is improved.
The embodiments of fig. 3 and fig. 4 are mainly used to explain an information display method in an implementation scenario of the DASH media protocol. In an implementation scenario of the DASH media protocol, the server may be a server supporting the DASH media protocol, and the terminal device may be a terminal device supporting the DASH media protocol or a terminal device running a video application supporting the DASH media protocol.
Referring to fig. 3, fig. 3 is a schematic flow chart of another information display method provided in an embodiment of the present application, where the embodiment is applicable to an implementation scenario in which a user requests a video, that is, an implementation scenario in which a complete target video already exists in a server. The method includes, but is not limited to, the steps of:
s201, the terminal device requests MPD of the target video from the server.
DASH is an HTTP-based streaming media protocol standard to facilitate interworking and compatibility between clients and servers of different providers. The DASH media protocol allows clients to select streaming files from different Content Delivery Networks (CDNs) to further achieve load balancing of the networks. The DASH media protocol also provides as seamless a dynamic transition as possible between different media information, e.g., a change in bitrate to adapt to different network conditions, and also allows for ad insertion at different live or on demand times.
The DASH media protocol mainly constrains the format of MPDs and media segments (segments). The MPD describes the time, URL, video resolution, and adaptive bitrate of the segment. Segment contains a multimedia stream characterized in the form of multiple files, and the basic idea of DASH is to deliver audio and video in a series of small files. The MPD is an XML document, and includes metadata information such as URLs that the client constructs for accessing the fragments.
In this embodiment of the application, when a user requests a target video at a DASH client, a terminal device may be triggered to request an MPD of the target video from a server.
For example, the request message of the MPD may be:
GET http://example.com/mpd0.xml HTTP/1.1
Connection:keep-alive
where "http:// example. com/MPD 0.xml" is the URL address of the MPD.
S202, the server sends MPD of the target video to the terminal device, wherein the MPD comprises display object information of the target video and identification information corresponding to the description information of the display object of the target video with different display qualities.
The display object information of the target video includes attribute information of the display object contained in the target video and attribute information of description information of the display object. It should be noted that, in this embodiment of the application, as the implementation scenario of the on-demand, the MPD of the target video sent by the server to the terminal device may include display object information of all video segments corresponding to the target video.
In this embodiment of the application, since the network bandwidths and the screen resolutions of the terminal devices may be different, the server may generate a plurality of pieces of description information with different display qualities for the display object of the target video, for example, the terminal device with the network bandwidth of 20Mps and the screen resolution of 640 × 480 corresponds to the description information with the first quality, the terminal device with the network bandwidth of 10Mps and the terminal device with the screen resolution of 320 × 240 corresponds to the description information with the second quality.
Therefore, the MPD further includes identification information corresponding to the description information of the display objects of the target video with the plurality of different display qualities. The identification information may be unique description information indicating a certain quality, where the identification information may be address information, such as a URL address, or may be a character string type identification.
For example, the MPD of the target video sent by the server to the terminal device may be:
Figure BDA0001388660490000101
Figure BDA0001388660490000111
wherein AdaptationSet is used to describe different media types. In this example, < adaptive set mimeType ═ video/mp4"> describes information of video content of the target video. The < SupplementalProperty schemehduri ═ urn: mpeg: dash: target:2017, "value ═ 1,100, 200,5,10"/>, < SupplementalProperty schemeelduri ═ urn: mpeg: gather: target:2017, "value ═ 2,150,200,100,200,15,20"/>, and the < SupplementalProperty schemehduri ═ urn: dageg: target:2017, "value ═ 3,100,200,300,200,30,40"/> are attribute information describing a display object included in the target video, and the attribute information is the meaning corresponding to each item of data of value as shown in table 3, where M represents a mandatory option.
As can be seen from table 3, < supplemental property scheme id uri ═ urn: mpeg: dash: target:2017, "value ═ 1,100, 200,5,10"/> indicate that the mark of the display object is 1, the starting point x coordinate is 100, the starting point y coordinate is 100, the width of the display area is 200, the height of the display area is 200, the appearance starting time point is 5s, and the disappearance time point is 10 s. Similarly, < supplemental property scheme id uri ═ urn: mpeg: dash: target:2017, "value ═ 2,150,200,100,200,15,20"/> indicates that the display object is identified as 2, the starting point x coordinate is 150, the starting point y coordinate is 200, the width of the display area is 100, the height of the display area is 200, the appearance starting time point is 15s, and the disappearance time point is 20 s; < supplemental property scheme id uri ═ urn: mpeg: dash: target:2017, "value ═ 3,100,200,300,200,30,40"/> indicates that the display object is identified as 3, the x coordinate of the starting point is 100 pixel positions, the y coordinate of the starting point is 200 pixel positions, the width of the display area is 300 pixel positions, the height of the display area is 200 pixel positions, the appearance starting time point is 30s, and the disappearance time point is 40 s.
Identification Application method Description of the invention
Object_id M Display object identification for distinguishing display objects
X0 M Of objectsStarting point x coordinate
Y0 M Y-coordinate of starting point of display object display area
Object_width M Width of display object display area
Object_height M Height of display object display area
T0 M Presentation start time point of display object
T1 M Vanishing time point of display object
Table 3: value attribute information meaning comparison table (example) of display object
In this example, < adaptive set mimeType ═ application/xml "lang ═ en" > describes attribute information of description information of a display object. In the media type, since encoding schemes of the same media content are different in bandwidth, image resolution, and the like, attribute information and identification information of description information of different display qualities need to be described by different repetition respectively, so that the terminal device can select different repetition according to requirements. For example, < registration bandwidth ═ 20000"width ═ 640" height ═ 480"> represents a bandwidth of 20000kbps and an image resolution of 640 × 480; < registration bandwidth ═ 10000 ═ width ═ 320 ═ height ═ 240"> represents a bandwidth of 10000kbps and an image resolution of 320 × 240.
Further, taking < registration basis width ═ 20000, "width ═ 640," height ═ 480"> as an example, in this kind of registration, the attribute information of the description information of the three display objects in the target video is < supplemental property scheme edge ═ urn: mpeg: dash: target:2017," value ═ 1,12,9,27,40,50,2"/>, < supplemental property scheme edge:" urn: mpeg: target:2017, "value ═ 2,12,9,27,30,15,2"/> and < supplemental property scheme edge ═ urn: aggregate: target:2017,: 2013, 12,9,27,30,15,2"/>, and < supplemental property scheme edge ═ 2013, 30, 20. When the description information of the display object is text information, as shown in table 4, the meaning corresponding to each item of data that can be value, where M denotes a mandatory item, and O denotes a selectable item.
As can be seen from table 4, the indication that < SupplementalProperty schemeelduri ═ urn: mpeg: dash: targettext:2017" value ═ 1,12,9,27,40,50,2"/> indicates that the identifier of the description information of the display object 1 is 1, the text font type is 12, the text font size is 9, the text line spacing is 27, the width of the area covered by the text is 40, the height of the area covered by the text is 50, and the display duration threshold value of the text presentation is 2 s. Similarly, the < SupplementalProperty schemeIdUri ═ urn: mpeg: dash: targettext:2017"value ═ 2,12,9,27,30,15,2"/> indicates that the description information of the display object 2 is identified as 2, the text font type is 12, the text font size is 9, the text line spacing is 27, the width of the area covered by the text is 30, the height of the area covered by the text is 15, and the display duration threshold value of the text is 2 s; the description information of the display object 3 is indicated to be 3 in < supplementalProperty schemeIdUri ═ urn: mpeg: dash: targettext:2017 of "value ═ 3,12,9,27,20,30,2"/> and the text font type is 12, the text font size is 9, the text line spacing is 27, the width of the area covered by the text is 20, the height of the area covered by the text is 30, and the display duration threshold value of the text presentation is 2 s.
@value Application method Description of the invention
Text_id M Text identification corresponding to display object identification
Font_type O Text font type
Font_size O Text font size
Line_distance O Text line spacing
Text_width M Width of area covered by text
Text_height M Area height covered by text
Text_during M Display duration threshold for text presentation
Table 4: value attribute information meaning comparison table (example) of description information of display object
In this example, the identification information of the description information may be a URL address, and in this kind of reproduction, the identification information of the description information of the three display objects included in the target video is < objectbasicpurl object URL: "object-basic-information-1.xml", < objectbasicpurl object URL ═ object-basic-information-2.xml ", and < objectbasicpururl ═ object-basic-information-3.xml", respectively, as an example of < reproduction bandwidth ═ 20000"width ═ 640" height ═ 480 ".
S203, the terminal equipment determines target identification information in the identification information respectively corresponding to the description information of the display object with different display qualities.
The MPD comprises identification information corresponding to description information of a plurality of different display qualities of the display object, the terminal device can analyze the MPD after receiving the MPD, then a proper display quality is determined according to the network bandwidth, the screen resolution and the like of the terminal device, and the identification information corresponding to the description information of the display quality is used as target identification information.
Taking the MPD example as an example, if the bandwidth of the terminal device is 20000kbps and the image size is 640 × 480, the terminal device may determine attribute information of description information of display quality (supplemental property parameter indication uri: gather: target:2017, "value indication" 1,12,9,27,40,50,2"/, < supplemental property parameter indication uri: urn: gather: target:2017," value indication "2,12,9,27,30,15,2"/> and < supplemental property indication url: 2017, "value indication"/"2, 12,9,27,30,15,2"/, "and < supplemental property indication url: 20:" url: "2, 9,27,30,15,2"/, "and < supplemental property indication information"/"20"/"the display quality indication information of the terminal device is 20000kbps, and the image size is 640 ═ 480, (" url: "attribute information"/> 2,9,27,30,15,2 "/" information of the display quality indication information is indicated as three pieces of display quality indication information (supplemental property indication information: "url:" 2,9,2, < supplemental property indication information: "description information of the terminal device indication information of display quality indication information of the terminal device indication information is indicated by the terminal device indication information of display quality indication url: < 9, 30,2, < url:" 20, < display quality indication information, 2, < url: "2, < url:, 30,2, < display quality indication information, 2, < url: (display information, 2, < supplemental property indication information, 2, < url:, 2, < display information, 30,2, < display information, 30,2, < display information, < supplemental property indication information, 2, < display information, 30, 2:, 2, < supplemental property indication information, < display information, < url:, 2, < display information, < display quality indication information, < 2:, 2, < display information, < url:, 2, < 2:, 2, < display information, < url:, 2, < url:, 2, < display information, < url:, 2, < display quality indication information, < display information, < url:, 30,2, < display information, < url:, 2, >, < display information, >, < url:, 2, >, < display information, the object basic url object url "object-basic-information-2.xml" and the object basic url object url "object-basic-information-3.xml") are object identification information corresponding to the description information of the three display objects.
And S204, the terminal equipment requests the server for the description information corresponding to the target identification information.
When the terminal equipment requests the server for the description information corresponding to the target identification information, the terminal equipment carries the target identification information, so that the server sends the description information corresponding to the target identification information to the terminal equipment. In a possible implementation scenario, the MPD may further carry identification information corresponding to a plurality of target videos with different display qualities, so that the terminal device may further determine, according to the network bandwidth and the screen resolution of the terminal device, first identification information in the identification information corresponding to the plurality of target videos with different display qualities, and send the first identification information to the server, where the first identification information is used to request the server to send the target video corresponding to the first identification information to the terminal device.
Optionally, in this embodiment of the present application, the target identification information may be carried by an HTTP request message. Illustratively, the HTTP request message may be:
GET http://panoramic.example.com/00001.mp4HTTP/1.1
Connection:keep-alive
GET http://panoramic.example.com/object-basic-information-11.xml HTTP/1.1
Connection:keep-alive
here, "http:// pantomic. example.com/00001.mp 4" is the URL address as the first identification information of the target video, and "http:// pantomic. example.com/object-basic-information-11. xml" is the URL address as the target identification information of the description information of the display object.
S205, the server sends the target video and the description information of the display object contained in the target video to the terminal equipment.
The server can obtain the target video and the description information of the display object contained in the target video according to the target identification information and the first identification information, wherein the description information of the display object is the description information corresponding to the target identification information. Then, the server transmits the target video and the description information of the display object contained in the target video to the terminal device. For example, the data stream of the transmission target video and the description information 1 of the display object 1 included in the target video: "Imperial palace", description information 2 of display object 2: description information 3 of one picture, display object 3: a link.
S206, in the process of playing the target video, when the terminal equipment determines that the display object appears in the user visual angle of the target video according to the attribute information of the display object, the terminal equipment displays the description information of the display object in the user visual angle according to the attribute information of the display object and the attribute information of the description information of the display object.
S102 may be referred to as a specific implementation method of S206, and details are not described herein again.
In the embodiment of the application, a terminal device requests an MPD of a target video from a server, the server transmits the MPD of the target video to the terminal device, the MPD includes identification information corresponding to display object information of the target video and description information of a plurality of different display qualities of a display object of the target video, the terminal device determines target identification information in the identification information corresponding to the description information of the plurality of different display qualities of the display object, the terminal device transmits the target identification information to the server, the server transmits the target video and the description information of the display object included in the target video to the terminal device, and during playing the target video, the terminal device, when it is determined that the display object appears within the user's view angle of the target video based on the attribute information of the display object, and displaying the description information of the display object in the user view angle according to the attribute information of the display object and the attribute information of the description information of the display object. The terminal equipment can determine the appropriate description information according to the network bandwidth and the screen resolution ratio of the terminal equipment, so that the description information of the object with better quality can be dynamically and flexibly presented according to the user visual angle, information omission caused by the fact that the user visual angle does not reach the fixed presentation area of the description information is avoided, and user experience is improved.
Referring to fig. 4, fig. 4 is a schematic flowchart of another information display method provided in an embodiment of the present application, where the embodiment is suitable for a user to watch a live video implementation scenario, that is, a server continuously receives a video segment of a target video and then sends the video segment to a terminal device at regular time. The method includes, but is not limited to, the steps of:
s301, the terminal device requests MPD of the target video from the server.
In this embodiment of the application, when a user live broadcasts a target video at a DASH client, a terminal device may be triggered to request an MPD of the target video from a server.
And S302, when the server detects that the display object in the target video is updated, updating an MPD of the target video, wherein the MPD comprises display object information of the target video and identification information corresponding to the description information of the display object of the target video with different display qualities.
The display object information of the target video includes attribute information of the display object contained in the target video and attribute information of description information of the display object. In the embodiment of the application, due to a live implementation scene, the server cannot directly acquire the display object information of all the video segments corresponding to the target video, and the server can receive the currently played video segment of the live target video at regular time and acquire the display object information of the video segment at the same time. As the server continuously receives new video segments of the target video, some display objects included in the target video may also start to appear and update continuously, and at this time, the server needs to update the MPD of the target video according to the display objects appearing in the currently received video segments.
In a possible implementation scenario, when the server detects that a display object appears in a video segment of a current target video, the server may update, in the MPD, identification information corresponding to the attribute information of the display object, the attribute information of the description information of the display object, and the description information of a plurality of different display qualities of the display object. In this implementation scenario, the attribute information of the display object may include the appearance start time point of the display object but not include the disappearance time point of the display object. For example, if the server detects that the display object 1 appears, the identification information corresponding to the attribute information of the display object 1, the attribute information of the description information of the display object, and the description information of a plurality of different display qualities of the display object may be added to the MPD.
In another possible implementation scenario, when the server detects that there is no display object appearing in a previous video segment in a video segment of a current target video, the server may delete identification information corresponding to the attribute information of the display object, the attribute information of the description information of the display object, and description information of a plurality of different display qualities of the display object, in the MPD. For example, the server detects that the display object 1 appears before, and adds identification information corresponding to the display object information of the display object 1 and the description information of the display object 1 with a plurality of different display qualities to the MPD. If the display object 1 is not detected in the current video slice, the attribute information of the display object 1, the attribute information of the description information of the display object, and the identification information corresponding to the description information of the display object with different display qualities may be deleted in the MPD.
In yet another possible implementation scenario, when the server detects that a display object appearing before a certain time in a video segment of the current target video disappears, the server may update a disappearing time point in the attribute information of the display object, and add, to the MPD, identification information corresponding to the updated attribute information of the display object, the updated attribute information of the description information of the display object, and the updated identification information corresponding to description information of a plurality of different display qualities of the display object. For example, the server detects that the display object 1 appears before, and adds identification information corresponding to the display object information of the display object 1 and the description information of the display object 1 with a plurality of different display qualities to the MPD. And if it is detected in the current video slice that the display object 1 disappears at the first time point, the server may use the first time point as a disappearing time point in the attribute information of the display object 1 to update the attribute information of the display object 1, and add, to the MPD, identification information corresponding to the updated attribute information of the display object, the attribute information of the description information of the display object, and the description information of the display object with a plurality of different display qualities.
It should be noted that, in this embodiment of the application, a method for detecting, by a server, a display object in a target video may be through technologies such as object recognition, or may be that a direct broadcast is marked when a live video is sent to the server, and the server detects the mark, so that the server can know the display object existing in the target video. The description information of the display object of the target video may be information intelligently matched by the server according to the detected object, or may be information sent to the server together with the live video after the director is made, which is not specifically limited herein.
For example, assuming that there is no display object in the video slice of the current target video, the MPD of the current target video may be:
Figure BDA0001388660490000161
that is, there is no identification information corresponding to the display object information and the description information of the display object with a plurality of different display qualities.
Further illustratively, assuming that the server detects that display object 1 appears in a video slice of the current target video, the MPD of the current target video may be:
Figure BDA0001388660490000162
Figure BDA0001388660490000171
wherein < supplementally property term ═ urn ═ aggregate: mpeg: date: target:2017"value ═ 1,100, 200,5,10"/> is attribute information of the newly added display object 1, < supplementally property term ═ urn: mpeg: date: targettext:2017 "value:" 1,12,0,27,40,50,2"/> and < supplementally property term:" urn: mpeg: targettext:2017"value ═ 1,10,0,17,20,30,2"/> are attribute information of description information of different display qualities, respectively, < Objectic URL ═ object-1-object-information describing different display qualities, < Objective URL: "URL-object-1-object-information describing different display qualities, respectively, and < object-1-object-information describing different display qualities.
That is, the MPD is added with identification information corresponding to the display object information of the display object 1 and the description information of the display object 1 with a plurality of different display qualities.
S202 may be referred to for the meaning of value in the above example of S302, and will not be described herein.
And S303, the server sends the MPD of the updated target video to the terminal equipment.
The server may send the MPD of the updated target video at regular time, or send the MPD of the updated target video to the terminal device after the update is completed, which is not limited herein.
S304, the terminal equipment determines target identification information in the identification information respectively corresponding to the description information of the display object with different display qualities.
S305, the terminal device requests the server for the description information corresponding to the target identification information.
S306, the server sends the target video and the description information of the display object contained in the target video to the terminal equipment.
The specific implementation methods of S304 to S306 can refer to S203 to S205, and are not described herein again in detail.
S307, in the process of playing the target video, when the display object appears in the user visual angle of the target video determined according to the attribute information of the display object, the terminal device displays the description information of the display object in the user visual angle according to the attribute information of the display object and the attribute information of the description information of the display object.
S307 may refer to S102, and details are not repeated here.
And circularly executing S302-S307 until the live video is finished or the terminal equipment does not request the MPD of the target video any more.
In the embodiment of the application, a terminal device requests an MPD of a target video from a server, when the server detects that a display object in the target video is updated, the MPD of the target video is updated, where the MPD includes identification information corresponding to display object information of the target video and description information of a plurality of different display qualities of the display object of the target video, the server sends the MPD of the updated target video to the terminal device, the MPD includes identification information corresponding to the display object information of the target video and the description information of the plurality of different display qualities of the display object of the target video, the terminal device determines target identification information in the identification information corresponding to the description information of the plurality of different display qualities of the display object, the terminal device sends the target identification information to the server, and the server sends the target video and the description information of the display object included in the target video to the terminal device, and in the process of playing the target video, when the display object appears in the user visual angle of the target video determined according to the attribute information of the display object, the terminal equipment displays the description information of the display object in the user visual angle according to the attribute information of the display object and the attribute information of the description information of the display object. In the implementation scene of live video, the terminal device can determine appropriate description information according to the network bandwidth and the screen resolution of the terminal device, so that the description information of the object with better quality can be dynamically and flexibly presented according to the user visual angle, information omission caused by the fact that the user visual angle does not reach a fixed presentation area of the description information is avoided, and user experience is improved.
The embodiment of the present application provides an information display device, which can implement the functions of the terminal device in the methods described in the above embodiments of the present application.
Optionally, please refer to fig. 10, where fig. 10 is a schematic structural diagram of an information display device according to an embodiment of the present application. As shown in fig. 10, the information display apparatus 1000 includes:
a receiving module 1001, configured to receive, from a server, a target video, description information of a display object included in the target video, and display object information of the target video, where the display object information includes attribute information of the display object included in the target video and attribute information of the description information of the display object;
the processing module 1002 is configured to, in the process of playing the target video, when it is determined that the display object appears in the user view angle of the target video according to the attribute information of the display object, display the description information of the display object in the user view angle according to the attribute information of the display object and the attribute information of the description information of the display object.
Optionally, the information display apparatus 1000 further includes:
the receiving module 1001 is further configured to: receiving identification information corresponding to description information of a plurality of different display qualities of a display object of the target video from the server;
the processing module 1001 is further configured to: determining target identification information in identification information respectively corresponding to the description information of the display object with different display qualities;
the apparatus 1000 further comprises:
a sending module 1003, configured to request, from the server, description information corresponding to the target identifier information, where the target identifier information is used by the server to send, to the terminal device, the description information of the display object corresponding to the target identifier information.
Optionally, the processing module 1002 is specifically configured to:
determining the appearance time period and the position area of the display object in the target video according to the attribute information of the display object;
when it is detected that the playing time of the target video is within the appearance time period of the display object and the coverage of the current user view angle on the position area of the display object is larger than a preset first threshold value, displaying the description information of the display object within the user view angle according to the position area of the display object and the attribute information of the description information of the display object.
Optionally, the processing module 1002 is specifically configured to:
determining the size of a display area of the description information of the display object according to the attribute information of the description information of the display object;
determining a target display area of the description information of the display object according to the user visual angle, the position area of the display object and the size of the display area of the description information of the display object;
and displaying the description information of the display object in the target display area.
Optionally, the processing module 1002 is specifically configured to:
determining at least one selectable display area of the description information of the display object according to the position area of the display object, the user view angle and the size of the display area of the description information of the display object;
and determining a target display area of the description information of the display object in the at least one selectable display area.
Optionally, the processing module 1002 is specifically configured to: the terminal equipment determines at least one display anchor point corresponding to the display object according to the position area of the display object;
determining a target display anchor within the user perspective among the at least one display anchor;
and determining at least one selectable display area of the description information of the display object according to the target display anchor point and the size of the display area of the description information of the display object.
Optionally, the attribute information of the display object includes at least one of an appearance start time point or a disappearance time point of the display object;
the processing module 1002 is specifically configured to:
determining an appearance time period of the display object in the target video according to at least one of an appearance start time point or a disappearance time point of the display object.
Optionally, the processing module 1002 is further configured to:
when the user visual angle is detected to be changed, updating a target display area of the description information of the display object according to the changed user visual angle, the position area of the display object and the size of the display area of the description information of the display object;
and displaying the description information of the display object in the updated target display area.
Optionally, the attribute information of the description information of the display object includes a display duration threshold;
the processing module 1002 is specifically configured to:
and according to the attribute information of the display object and the attribute information of the description information of the display object, when the display object appears in the user visual angle of the target video, displaying the description information of the display object in the target video according to the display duration threshold.
It should be noted that, for the functions and implementation manners of each functional module in the information display apparatus 1000 and the meanings and obtaining manners of the related parameters described in the embodiment of the present application, reference may be made to the related descriptions of the corresponding terminal devices in the embodiments shown in fig. 2 to 4, and details are not described here again.
Referring to fig. 11, fig. 11 is a schematic structural diagram of another information display device according to an embodiment of the present application. As shown in fig. 11, the information display apparatus 1100 includes a processor 111, a memory 112, and a transceiver 113. The processor 111 is connected to the memory 112 and the transceiver 113, for example, the processor 111 may be connected to the memory 112 and the transceiver 113 through a bus.
The processor 111 is configured to support the information display apparatus to perform the corresponding functions of the terminal device in the method described in fig. 2-4. The processor 111 may be a Central Processing Unit (CPU), a Network Processor (NP), a hardware chip, or any combination thereof. The hardware chip may be an application-specific integrated circuit (ASIC), a Programmable Logic Device (PLD), or a combination thereof. The PLD may be a Complex Programmable Logic Device (CPLD), a field-programmable gate array (FPGA), a General Array Logic (GAL), or any combination thereof.
The memory 112 is used to store program codes and the like. The memory 112 may include volatile memory (RAM), such as Random Access Memory (RAM); the memory 112 may also include a non-volatile memory (SSD), such as a read-only memory (ROM), a flash memory (flash memory), a hard disk (HDD) or a solid-state drive (SSD); the memory 112 may also comprise a combination of the above types of memory.
The transceiver 113 is used for communication with other network devices in the embodiments of the present application.
The processor 111 in the information display apparatus 1100 reads the program code stored in the memory 112 to perform the following operations:
receiving, by a transceiver 113, a target video, description information of a display object included in the target video, and display object information of the target video, the display object information including attribute information of the display object included in the target video and attribute information of the description information of the display object, from a server;
and in the process of playing the target video, when the display object appears in the user visual angle of the target video according to the attribute information of the display object, displaying the description information of the display object in the user visual angle according to the attribute information of the display object and the attribute information of the description information of the display object.
It should be noted that, for the functions of each functional module in the information display apparatus 1100, reference may be made to the related description of the corresponding access network device in the embodiments shown in fig. 2 to 4, and details are not repeated here. Alternatively, the processor 111 may be configured to implement the functions of the processing module 1002, and the transceiver 113 may be configured to implement the functions of one or more of the receiving module 1001 and the transmitting module 1003. In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical division, and in actual implementation, there may be other divisions, for example, multiple modules or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.
The embodiment of the present application provides another information display device, which can implement the function of the server in the method described in the above embodiment of the present application.
Optionally, please refer to fig. 12, and fig. 12 is a schematic structural diagram of another information display device according to an embodiment of the present application. As shown in fig. 12, the information display apparatus 1200 includes:
a sending module 1201, configured to send a target video, description information of a display object included in the target video, and display object information of the target video to a terminal device, where the display object information includes attribute information of the display object included in the target video and attribute information of the description information of the display object, and the display object information is used by the terminal device to display the description information of the display object in a process of playing the target video.
Optionally, the display object of the target video has description information of a plurality of different display qualities;
the apparatus 1200 further comprises:
a processing module 1202, configured to determine, in the description information of multiple different display qualities of the display object of the target video, the description information of the display object sent to the terminal device.
Optionally, the display object of the target video has description information of a plurality of different display qualities;
the sending module 1201 is further configured to:
sending identification information corresponding to the description information of the display object of the target video with different display qualities to the terminal equipment;
the apparatus 1200 further comprises:
a receiving module 1203, configured to receive target identification information from the terminal device, where the target identification information is determined in identification information corresponding to description information of multiple different display qualities of the display object, respectively, by the terminal device;
a processing module 1202, configured to determine that the description information corresponding to the target identification information is description information of the display object sent to the terminal device.
It should be noted that, for the functions and implementation manners of each functional module in the information display apparatus 1200 and the meanings and the obtaining manners of the related parameters described in the embodiments of the present application, reference may be made to the related descriptions of the corresponding server in the embodiments shown in fig. 2 to 4, and details are not described here again.
Referring to fig. 13, fig. 13 is a schematic structural diagram of another information display device according to an embodiment of the present application. As shown in fig. 13, the information display apparatus 1300 includes a processor 131, a memory 132, and a transceiver 133. The processor 131 is connected to the memory 132 and the transceiver 133, for example, the processor 131 may be connected to the memory 132 and the transceiver 133 through a bus.
The processor 131 is configured to support the information display apparatus to perform the corresponding functions of the server in the method described in fig. 2 to 4. The processor 131 may be a Central Processing Unit (CPU), a Network Processor (NP), a hardware chip, or any combination thereof. The hardware chip may be an application-specific integrated circuit (ASIC), a Programmable Logic Device (PLD), or a combination thereof. The PLD may be a Complex Programmable Logic Device (CPLD), a field-programmable gate array (FPGA), a General Array Logic (GAL), or any combination thereof.
The memory 132 is used to store program codes and the like. The memory 132 may include a volatile memory (RAM), such as a Random Access Memory (RAM); the memory 132 may also include a non-volatile memory (SSD), such as a read-only memory (ROM), a flash memory (flash memory), a hard disk (HDD) or a solid-state drive (SSD); the memory 132 may also comprise a combination of the above-mentioned types of memory.
The transceiver 133 is used for communication with other network devices in the embodiments of the present application.
The processor 131 in the information display apparatus 1300 reads the program code stored in the memory 132 to perform the following operations:
it should be noted that, for the functions of each functional module in the information display apparatus 1300, reference may be made to the related description of the corresponding access network device in the embodiments shown in fig. 2 to 4, and details are not repeated here. Alternatively, the processor 131 may be configured to implement the functions of the processing module 1202, and the transceiver 133 may be configured to implement the functions of one or more of the receiving module 1203 and the transmitting module 1201. In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical division, and in actual implementation, there may be other divisions, for example, multiple modules or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.
It should be understood by those of ordinary skill in the art that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of the processes should be determined by their functions and inherent logic, and should not limit the implementation process of the embodiments of the present application.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.

Claims (28)

1. An information display method, comprising:
the method comprises the steps that terminal equipment receives a target video, description information of a display object contained in the target video and display object information of the target video from a server, wherein the display object information comprises attribute information of the display object contained in the target video and attribute information of the description information of the display object;
when the terminal equipment determines that the display object appears in the user visual angle of the target video according to the attribute information of the display object in the process of playing the target video, the terminal equipment displays the description information of the display object in the user visual angle according to the attribute information of the display object and the attribute information of the description information of the display object;
the attribute information of the display object comprises an appearance time period and a position area for indicating the display object; the attribute information of the description information of the display object comprises information used for indicating the size of a display area and/or a display duration threshold of the description information of the display object;
when the terminal device determines that the display object appears in the user view angle of the target video according to the attribute information of the display object in the process of playing the target video, the terminal device displays the description information of the display object in the user view angle according to the attribute information of the display object and the attribute information of the description information of the display object, and the method comprises the following steps:
the terminal equipment determines the appearance time period and the position area of the display object in the target video according to the attribute information of the display object;
when the terminal device detects that the playing time of the target video is within the time period of the display object and the coverage of the current user view angle on the position area of the display object is larger than a preset first threshold value, the terminal device displays the description information of the display object within the user view angle according to the position area of the display object and the attribute information of the description information of the display object.
2. The method of claim 1, wherein before the terminal device receives description information of the display object included in the target video from a server, the method further comprises:
the terminal equipment receives identification information corresponding to the description information of the display object of the target video with different display qualities from the server;
the terminal equipment determines target identification information in identification information respectively corresponding to the description information of the display object with different display qualities;
the terminal equipment requests the server for the description information corresponding to the target identification information, and the target identification information is used by the server for sending the description information of the display object corresponding to the target identification information to the terminal equipment.
3. The method of claim 1, wherein the terminal device displays the description information of the display object within the user perspective according to the location area of the display object and the attribute information of the description information of the display object, and comprises:
the terminal equipment determines the size of a display area of the description information of the display object according to the attribute information of the description information of the display object;
the terminal equipment determines a target display area of the description information of the display object according to the user visual angle, the position area of the display object and the size of the display area of the description information of the display object;
and the terminal equipment displays the description information of the display object in the target display area.
4. The method of claim 3, wherein the terminal device determines a target display area of the description information of the display object according to the user perspective, the position area of the display object, and the display area size of the description information of the display object, and comprises:
the terminal equipment determines at least one selectable display area of the description information of the display object according to the position area of the display object, the user visual angle and the size of the display area of the description information of the display object;
and the terminal equipment determines a target display area of the description information of the display object in the at least one selectable display area.
5. The method of claim 4, wherein the terminal device determines at least one selectable display area of the description information of the display object according to the position area of the display object, the user perspective and the display area size of the description information of the display object, and comprises:
the terminal equipment determines at least one display anchor point corresponding to the display object according to the position area of the display object;
the terminal equipment determines a target display anchor point within the user visual angle from the at least one display anchor point;
and the terminal equipment determines at least one selectable display area of the description information of the display object according to the target display anchor point and the size of the display area of the description information of the display object.
6. The method of claim 1, wherein the attribute information of the display object includes at least one of an appearance start time point or a disappearance time point of the display object;
the terminal equipment determines the appearance time period of the display object in the target video according to the attribute information of the display object, and the determination comprises the following steps:
and the terminal equipment determines the appearance time period of the display object in the target video according to at least one of the appearance starting time point or the disappearance time point of the display object.
7. The method of claim 3, wherein the method further comprises:
when the terminal device detects that the user visual angle changes, the terminal device updates a target display area of the description information of the display object according to the changed user visual angle, the position area of the display object and the size of the display area of the description information of the display object;
and the terminal equipment displays the description information of the display object in the updated target display area.
8. The method according to any one of claims 1 to 7, wherein the attribute information of the description information of the display object includes a display duration threshold;
the method for displaying the description information of the display object in the user view angle by the terminal device when determining that the display object appears in the user view angle of the target video according to the attribute information of the display object and the attribute information of the description information of the display object includes:
and the terminal equipment displays the description information of the display object in the target video according to the display duration threshold when determining that the display object appears in the user visual angle of the target video according to the attribute information of the display object and the attribute information of the description information of the display object.
9. An information display method, comprising:
the method comprises the steps that a server sends a target video, description information of a display object contained in the target video and display object information of the target video to a terminal device, wherein the display object information comprises attribute information of the display object contained in the target video and attribute information of the description information of the display object, and the display object information is used by the terminal device for displaying the description information of the display object in the process of playing the target video;
the attribute information of the display object comprises an appearance time period and a position area for indicating the display object; the attribute information of the description information of the display object comprises information used for indicating the size of a display area and/or a display duration threshold of the description information of the display object;
the display object information is used by the terminal device to display the description information of the display object in the process of playing the target video, and includes:
the terminal equipment determines the appearance time period and the position area of the display object in the target video according to the attribute information of the display object;
when the terminal device detects that the playing time of the target video is within the time period of the display object and the coverage of the current user view angle on the position area of the display object is larger than a preset first threshold value, the terminal device displays the description information of the display object within the user view angle according to the position area of the display object and the attribute information of the description information of the display object.
10. The method according to claim 9, wherein there are a plurality of pieces of description information of different display qualities for the display object of the target video;
before the server sends the description information of the display object contained in the target video to the terminal device, the method further includes:
and the server determines the description information of the display object sent to the terminal equipment in the description information of a plurality of different display qualities of the display object of the target video.
11. The method according to claim 9, wherein there are a plurality of pieces of description information of different display qualities for the display object of the target video;
before the server sends the description information of the display object contained in the target video to the terminal device, the method further includes:
the server sends identification information corresponding to the description information of the display object of the target video with different display qualities to the terminal equipment;
the server receives target identification information from the terminal equipment, wherein the target identification information is determined by the terminal equipment in identification information respectively corresponding to the description information of the display object with different display qualities;
and the server determines that the description information corresponding to the target identification information is the description information of the display object sent to the terminal equipment.
12. The method of any one of claims 9-11, wherein the display object information of the target video is carried by a Media Presentation Description (MPD) file of the target video.
13. The method according to any one of claims 9 to 11, wherein the attribute information of the display object includes an appearance start time point of the display object, the appearance start time point being used by the terminal device to determine an appearance period of the display object in the target video.
14. The method according to any one of claims 9 to 11, wherein the attribute information of the display object includes a disappearance time point of the display object, the disappearance time point being used by the terminal device to determine a period of appearance of the display object in the target video.
15. An information display device characterized by comprising:
a receiving module, configured to receive, from a server, a target video, description information of a display object included in the target video, and display object information of the target video, where the display object information includes attribute information of the display object included in the target video and attribute information of the description information of the display object;
the processing module is used for displaying the description information of the display object in the user visual angle according to the attribute information of the display object and the attribute information of the description information of the display object when the display object appears in the user visual angle of the target video determined according to the attribute information of the display object in the process of playing the target video;
the attribute information of the display object comprises an appearance time period and a position area for indicating the display object; the attribute information of the description information of the display object comprises information used for indicating the size of a display area and/or a display duration threshold of the description information of the display object;
the processing module is specifically configured to:
determining the appearance time period and the position area of the display object in the target video according to the attribute information of the display object;
when it is detected that the playing time of the target video is within the appearance time period of the display object and the coverage of the current user view angle on the position area of the display object is larger than a preset first threshold value, displaying the description information of the display object within the user view angle according to the position area of the display object and the attribute information of the description information of the display object.
16. The apparatus of claim 15,
the receiving module is further configured to: receiving identification information corresponding to description information of a plurality of different display qualities of a display object of the target video from the server;
the processing module is further configured to: determining target identification information in identification information respectively corresponding to the description information of the display object with different display qualities;
the device further comprises:
a sending module, configured to request, from the server, description information corresponding to the target identification information, where the target identification information is used by the server to send, to the information display apparatus, description information of the display object corresponding to the target identification information.
17. The apparatus of claim 15, wherein the processing module is specifically configured to:
determining the size of a display area of the description information of the display object according to the attribute information of the description information of the display object;
determining a target display area of the description information of the display object according to the user visual angle, the position area of the display object and the size of the display area of the description information of the display object;
and displaying the description information of the display object in the target display area.
18. The apparatus of claim 17, wherein the processing module is specifically configured to:
determining at least one selectable display area of the description information of the display object according to the position area of the display object, the user view angle and the size of the display area of the description information of the display object;
and determining a target display area of the description information of the display object in the at least one selectable display area.
19. The apparatus of claim 18, wherein the processing module is specifically configured to: determining at least one display anchor point corresponding to the display object according to the position area of the display object;
determining a target display anchor within the user perspective among the at least one display anchor;
and determining at least one selectable display area of the description information of the display object according to the target display anchor point and the size of the display area of the description information of the display object.
20. The apparatus of claim 15, wherein the attribute information of the display object includes at least one of an appearance start time point or a disappearance time point of the display object;
the processing module is specifically configured to:
determining an appearance time period of the display object in the target video according to at least one of an appearance start time point or a disappearance time point of the display object.
21. The apparatus of claim 17, wherein the processing module is further to:
when the user visual angle is detected to be changed, updating a target display area of the description information of the display object according to the changed user visual angle, the position area of the display object and the size of the display area of the description information of the display object;
and displaying the description information of the display object in the updated target display area.
22. The apparatus according to any one of claims 15 to 21, wherein the attribute information of the description information of the display object includes a display duration threshold;
the processing module is specifically configured to:
and according to the attribute information of the display object and the attribute information of the description information of the display object, when the display object appears in the user visual angle of the target video, displaying the description information of the display object in the target video according to the display duration threshold.
23. An information display device characterized by comprising:
a sending module, configured to send a target video, description information of a display object included in the target video, and display object information of the target video to a terminal device, where the display object information includes attribute information of the display object included in the target video and attribute information of the description information of the display object, and the display object information is used by the terminal device to display the description information of the display object in a process of playing the target video;
the attribute information of the display object comprises an appearance time period and a position area for indicating the display object; the attribute information of the description information of the display object comprises information used for indicating the size of a display area and/or a display duration threshold of the description information of the display object;
the display object information is used by the terminal device to display the description information of the display object in the process of playing the target video, and includes:
the terminal equipment determines the appearance time period and the position area of the display object in the target video according to the attribute information of the display object;
when the terminal device detects that the playing time of the target video is within the time period of the display object and the coverage of the current user view angle on the position area of the display object is larger than a preset first threshold value, the terminal device displays the description information of the display object within the user view angle according to the position area of the display object and the attribute information of the description information of the display object.
24. The apparatus according to claim 23, wherein there are a plurality of pieces of description information of different display qualities for the display object of the target video;
the device further comprises:
and the processing module is used for determining the description information of the display object sent to the terminal equipment in the description information of a plurality of different display qualities of the display object of the target video.
25. The apparatus according to claim 23, wherein there are a plurality of pieces of description information of different display qualities for the display object of the target video;
the sending module is further configured to:
sending identification information corresponding to the description information of the display object of the target video with different display qualities to the terminal equipment;
the device further comprises:
a receiving module, configured to receive target identification information from the terminal device, where the target identification information is determined by the terminal device in identification information corresponding to description information of the display object with different display qualities;
and the processing module is used for determining that the description information corresponding to the target identification information is the description information of the display object sent to the terminal equipment.
26. The apparatus of any one of claims 23-25, wherein the display object information of the target video is carried by a Media Presentation Description (MPD) file of the target video.
27. The apparatus according to any one of claims 23 to 25, wherein the attribute information of the display object includes an appearance start time point of the display object, the appearance start time point being used by the terminal device to determine an appearance period of the display object in the target video.
28. The apparatus according to any one of claims 23 to 25, wherein the attribute information of the display object includes a disappearance time point of the display object, the disappearance time point being used by the terminal device to determine a period of appearance of the display object in the target video.
CN201710738877.4A 2017-08-25 2017-08-25 Information display method and related equipment Active CN109756727B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710738877.4A CN109756727B (en) 2017-08-25 2017-08-25 Information display method and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710738877.4A CN109756727B (en) 2017-08-25 2017-08-25 Information display method and related equipment

Publications (2)

Publication Number Publication Date
CN109756727A CN109756727A (en) 2019-05-14
CN109756727B true CN109756727B (en) 2021-07-20

Family

ID=66397570

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710738877.4A Active CN109756727B (en) 2017-08-25 2017-08-25 Information display method and related equipment

Country Status (1)

Country Link
CN (1) CN109756727B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111027376A (en) * 2019-10-28 2020-04-17 中国科学院上海微系统与信息技术研究所 Method and device for determining event map, electronic equipment and storage medium
CN111601063B (en) * 2020-04-29 2021-12-14 维沃移动通信有限公司 Video processing method and electronic equipment

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001018647A2 (en) * 1999-09-07 2001-03-15 Internet Pictures Corporation Method and apparatus for automatic immersive image viewer creation and distribution
CN101950578A (en) * 2010-09-21 2011-01-19 北京奇艺世纪科技有限公司 Method and device for adding video information and method and device for displaying video information
CN102985901A (en) * 2010-05-16 2013-03-20 诺基亚公司 Method and apparatus for rendering a perspective view of objects and content related thereto for location-based services on mobile device
CN103024416A (en) * 2011-12-14 2013-04-03 微软公司 Parallax compensation
CN104902263A (en) * 2015-05-26 2015-09-09 深圳市圆周率软件科技有限责任公司 System and method for showing image information
CN105183154A (en) * 2015-08-28 2015-12-23 上海永为科技有限公司 Interactive display method for virtual object and real image
CN105279795A (en) * 2014-07-09 2016-01-27 先科媒体有限公司 Augmented reality system based on 3D marker
CN105378625A (en) * 2013-06-25 2016-03-02 微软技术许可有限责任公司 Indicating out-of-view augmented reality images
CN105812941A (en) * 2016-03-31 2016-07-27 北京金山安全软件有限公司 Video playing method and device and electronic equipment
CN105828103A (en) * 2016-03-31 2016-08-03 乐视控股（北京）有限公司 Video processing method and player
CN106162204A (en) * 2016-07-06 2016-11-23 传线网络科技（上海）有限公司 Panoramic video generation, player method, Apparatus and system
CN106303538A (en) * 2016-08-16 2017-01-04 北京中星微电子有限公司 A kind of video spatial scalable coded method supporting multisource data fusion and framework

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5703604A (en) * 1995-05-22 1997-12-30 Dodeca Llc Immersive dodecaherdral video viewing system
JP6249202B2 (en) * 2013-05-10 2017-12-20 ソニー株式会社 Image display device, image display method, and program
US20160321953A1 (en) * 2013-12-26 2016-11-03 Becos Inc. Pronunciation learning support system utilizing three-dimensional multimedia and pronunciation learning support method thereof
KR102209511B1 (en) * 2014-05-12 2021-01-29 엘지전자 주식회사 Wearable glass-type device and method of controlling the device

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001018647A2 (en) * 1999-09-07 2001-03-15 Internet Pictures Corporation Method and apparatus for automatic immersive image viewer creation and distribution
CN102985901A (en) * 2010-05-16 2013-03-20 诺基亚公司 Method and apparatus for rendering a perspective view of objects and content related thereto for location-based services on mobile device
CN101950578A (en) * 2010-09-21 2011-01-19 北京奇艺世纪科技有限公司 Method and device for adding video information and method and device for displaying video information
CN103024416A (en) * 2011-12-14 2013-04-03 微软公司 Parallax compensation
CN105378625A (en) * 2013-06-25 2016-03-02 微软技术许可有限责任公司 Indicating out-of-view augmented reality images
CN105279795A (en) * 2014-07-09 2016-01-27 先科媒体有限公司 Augmented reality system based on 3D marker
CN104902263A (en) * 2015-05-26 2015-09-09 深圳市圆周率软件科技有限责任公司 System and method for showing image information
CN105183154A (en) * 2015-08-28 2015-12-23 上海永为科技有限公司 Interactive display method for virtual object and real image
CN105812941A (en) * 2016-03-31 2016-07-27 北京金山安全软件有限公司 Video playing method and device and electronic equipment
CN105828103A (en) * 2016-03-31 2016-08-03 乐视控股（北京）有限公司 Video processing method and player
CN106162204A (en) * 2016-07-06 2016-11-23 传线网络科技（上海）有限公司 Panoramic video generation, player method, Apparatus and system
CN106303538A (en) * 2016-08-16 2017-01-04 北京中星微电子有限公司 A kind of video spatial scalable coded method supporting multisource data fusion and framework

Also Published As

Publication number Publication date
CN109756727A (en) 2019-05-14

Similar Documents

Publication Publication Date Title
EP3459252B1 (en) Method and apparatus for spatial enhanced adaptive bitrate live streaming for 360 degree video playback
US11632571B2 (en) Media data processing method and apparatus
USRE48430E1 (en) Two-dimensional code processing method and terminal
US20200145736A1 (en) Media data processing method and apparatus
US20100242066A1 (en) Method of Performing Random Seek Preview for Streaming Video
WO2015090095A1 (en) Information pushing method, device, and system
US10009643B2 (en) Apparatus and method for processing media content
KR20150014722A (en) Device, system and method for providing screen shot
WO2012031143A1 (en) Method and apparatus for embedding media programs having custom user selectable thumbnails
WO2019137339A1 (en) Method and device for processing media data
US10575050B2 (en) Providing a plurality of points of view of digital environments
CN103533394A (en) Information pushing method and device and server
KR101473254B1 (en) Method and device for providing multi angle video to devices
CN108810567B (en) Audio and video visual angle matching method, client and server
WO2015060165A1 (en) Display processing device, distribution device, and metadata
WO2021174219A1 (en) Identification of elements in a group for dynamic element replacement
CN109756727B (en) Information display method and related equipment
EP3048796A1 (en) Information system, information delivery method and iptv system based on multi-screen interaction
CN108574881B (en) Projection type recommendation method, server and client
KR20150073573A (en) Method and apparatus for displaying contents related in mirroring picture
CN111903136B (en) Information processing apparatus, information processing method, and computer-readable storage medium
US20180324480A1 (en) Client and Method for Playing a Sequence of Video Streams, and Corresponding Server and Computer Program Product
US20090064257A1 (en) Compact graphics for limited resolution display devices
US20130033569A1 (en) Combining a three-dimensional message with three-dimensional video content
KR100825115B1 (en) Procedure for personal video recording service considering for the available storage of the mobile device in mobile iptv environment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant