CN108513096A - Information transferring method, proxy server, terminal device and content server - Google Patents
Information transferring method, proxy server, terminal device and content server Download PDFInfo
- Publication number
- CN108513096A CN108513096A CN201710108777.3A CN201710108777A CN108513096A CN 108513096 A CN108513096 A CN 108513096A CN 201710108777 A CN201710108777 A CN 201710108777A CN 108513096 A CN108513096 A CN 108513096A
- Authority
- CN
- China
- Prior art keywords
- view
- content
- proxy server
- file
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 120
- 230000000007 visual effect Effects 0.000 claims abstract description 205
- 230000005540 biological transmission Effects 0.000 claims description 54
- 238000004806 packaging method and process Methods 0.000 claims description 35
- 230000011664 signaling Effects 0.000 claims description 31
- 230000002452 interceptive effect Effects 0.000 claims description 18
- 238000004891 communication Methods 0.000 claims description 13
- 230000006399 behavior Effects 0.000 description 53
- 230000008569 process Effects 0.000 description 38
- 230000003993 interaction Effects 0.000 description 15
- 238000005538 encapsulation Methods 0.000 description 13
- 238000005457 optimization Methods 0.000 description 8
- 230000007704 transition Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000000977 initiatory effect Effects 0.000 description 3
- 230000007935 neutral effect Effects 0.000 description 3
- 239000000203 mixture Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/10—Architectures or entities
- H04L65/1045—Proxies, e.g. for session initiation protocol [SIP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a kind of information transferring method, proxy server, terminal device and content server, the method includes:At least one visual angle corresponding with the content requests that the terminal device is sent out and its corresponding visual angle file are got from the content server side of terminal device, at least one visual angle and its corresponding visual angle file are added to cache contents;Receive the visual angle file request information that the terminal device is sent;Based on the visual angle file request information, is chosen from the cache contents and obtain the aspect file corresponding to aspect, send the aspect file to the terminal device.
Description
Technical Field
The present invention relates to information acquisition technologies in the field of communications, and in particular, to an information transmission method, a proxy server, a terminal device, and a content server.
Background
Stereoscopy (spatiality), interactivity are an important feature of AR/VR. And the terminal equipment visual angle is transferred, and the contents of different visual angles or corresponding visual angles are obtained. Taking the VR video as an example, when the user rotates an angle, the user will obtain video files at different angles. In the AR process, when a user rotates an angle, the content server may need to identify a real background environment, and obtain a user view angle based on a sensor to be synchronous with the background environment so as to synthesize a virtual image; and performing merged rendering and content composition on the synchronized virtual image and the real environment. Or the AR content server needs to recognize the real picture and process the virtual image accordingly, so that it can be "truly" merged into the real picture.
Compared with full-view content provision, the VR/AR content provision based on the view has the advantages of reducing bandwidth consumption caused by such services, reducing the requirements of the services on bandwidth and improving the universality of applications. However, the problem is that once the server of AR/VR is at a relatively long distance, the view delivery of the user and the feedback of the content corresponding to the view are delayed, and once the content triggered by the view cannot be obtained in time, the user's experience is not good.
Disclosure of Invention
The present invention mainly aims to provide an information transmission method, a proxy server, a terminal device and a content server, and aims to solve the above problems in the prior art.
In order to achieve the above object, the present invention provides an information transmission method applied to a proxy server, including:
acquiring at least one visual angle corresponding to a content request sent by terminal equipment and a visual angle file corresponding to the visual angle from a content server side of the terminal equipment, and adding the at least one visual angle and the visual angle file corresponding to the at least one visual angle to cache content;
receiving visual angle file request information sent by the terminal equipment;
based on the view file request information, selecting a target view file corresponding to a target view from the cache contents, and sending the target view file to the terminal equipment
The invention provides an information transmission method, which is applied to terminal equipment and comprises the following steps:
sending view file request information to a proxy server;
selecting a target view file corresponding to the target view from the cache contents based on the view file request information received by the proxy server;
the cached content is at least one view angle cached by the proxy server side and corresponding to the content request sent by the terminal equipment, and a view angle file corresponding to each view angle.
The invention provides an information transmission method, which is applied to a content server and comprises the following steps:
based on a content request sent by a terminal device, at least one view corresponding to the content request sent by the terminal device and a view file corresponding to each view are sent to a proxy server of the terminal device.
The present invention provides a proxy server, comprising:
the system comprises a cache acquisition unit, a cache processing unit and a cache processing unit, wherein the cache acquisition unit is used for acquiring at least one visual angle corresponding to a content request sent by terminal equipment and a visual angle file corresponding to the visual angle from a content server side of the terminal equipment and adding the at least one visual angle and the visual angle file corresponding to the visual angle to cache content;
the terminal communication unit is used for receiving the view file request information sent by the terminal equipment; and selecting a target visual angle file corresponding to the target visual angle from the cache content based on the visual angle file request information, and sending the target visual angle file to the terminal equipment.
The present invention provides a terminal device, including:
the file request unit is used for sending the view file request information to the proxy server;
the file acquisition unit is used for receiving the target view file corresponding to the target view selected from the cache contents by the proxy server based on the view file request information;
the cached content is at least one view angle cached by the proxy server side and corresponding to the content request sent by the terminal equipment, and a view angle file corresponding to each view angle.
The present invention provides a content server, comprising:
the cache sending unit is used for sending at least one view angle corresponding to the content request sent by the terminal equipment and a view angle file corresponding to each view angle to a proxy server of the terminal equipment based on the content request sent by the terminal equipment.
According to the information transmission method, the proxy server, the terminal equipment and the content server, the proxy server can cache the view angle and the view angle file corresponding to the view angle in advance, and then the proxy server responds to the view angle file request information of the terminal equipment to feed back the target view angle file corresponding to the target view angle for the terminal equipment. Therefore, the method can quickly respond to the requirements of user services, reduce the time delay for the terminal equipment to acquire the visual angle file, and avoid the discomfort of the user in using the terminal equipment.
Drawings
Fig. 1 is a schematic flow chart of an information transmission method according to an embodiment of the present invention 1;
FIG. 2 is a flow chart of an information transmission method according to an embodiment of the present invention, schematically illustrated in FIG. 2;
FIG. 3 is a flow chart of an information transmission method according to an embodiment of the present invention, schematically illustrated in FIG. 3;
FIG. 4 is a flowchart illustrating an information transmission method according to an embodiment of the present invention;
FIG. 5 is a flowchart of an information transmission method according to an embodiment of the present invention, schematically illustrating FIG. 5;
FIG. 6 is a diagram illustrating a configuration of a proxy server according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a structure of a terminal device according to an embodiment of the present invention;
fig. 8 is a schematic diagram of a composition structure of a content server according to an embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the figures and specific examples.
The first embodiment,
An embodiment of the present invention provides an information transmission method, which is applied to a proxy server, and as shown in fig. 1, the method includes:
step 101: acquiring at least one visual angle corresponding to a content request sent by terminal equipment and a visual angle file corresponding to the visual angle from a content server side of the terminal equipment, and adding the at least one visual angle and the visual angle file corresponding to the at least one visual angle to cache content;
step 102: receiving visual angle file request information sent by the terminal equipment;
step 103: and selecting a target view file corresponding to a target view from the cache contents based on the view file request information, and sending the target view file to the terminal equipment.
In this embodiment, the terminal device may specifically be a terminal device capable of operating VR/AR, and the content server is also a content server capable of providing VR/AR.
Before the user visual angle of the terminal equipment changes, the proxy server interacts with a remote content server, and a corresponding visual angle file is cached in advance; the cached view and the view file corresponding to the view may be a view and a view file corresponding to the view near a current view where a user of the terminal device is located when initially accessing the system; or, the method may be implemented by predicting at least one commonly used view of the user and a view file corresponding to the view according to the grasped user view behavior habit by the proxy server; or, the proxy server may also be configured to provide at least one preset view and a view file corresponding to the preset view for the user of the terminal device outside the current view;
when the user visual angle of the terminal equipment changes, the terminal equipment sends new visual angle file request information to the proxy server, and the proxy server distributes users from visual angle files corresponding to the visual angles cached in advance based on the visual angle file request information.
Specifically, the acquiring the cache content from the content server side of the terminal device includes:
acquiring all views corresponding to content requests sent by the terminal equipment and view files corresponding to all views from a content server side of the terminal equipment; the content request may include content of at least one dimension, for example, at least one of information such as a current position and a current view angle of the terminal device. It can be understood that what the content to be acquired by the terminal device is can be determined according to the current position in the content request, and all the viewing angles at the position and the viewing angle file corresponding to each viewing angle are directly known according to the corresponding position.
Or,
acquiring a common visual angle of the terminal equipment and a visual angle file corresponding to the common visual angle from a content server side of the terminal equipment; it should be understood that the processing mode can be realized only on the basis that the terminal device has a common visual angle or the proxy server at least acquires at least one behavior record of the terminal device; the at least one behavior record based on the terminal device may include which of the views that the terminal device would normally acquire the N view files requested to be acquired, and the common view of the terminal device is obtained according to such analysis.
Or,
acquiring a view file corresponding to a current view of the terminal equipment from a content server side of the terminal equipment, and acquiring at least one related view of the current view and a view file corresponding to the view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value. The preset threshold may be set according to actual conditions, for example, may be within 30 degrees from the left to the right, or may also include within 30 degrees from the top to the bottom.
It should be noted that, the content that can be stored by the terminal device side is at least one view and its corresponding link information;
when the terminal device initiates the view file request information, a specific view may be included, or the connection information corresponding to the view may be determined first according to the view, and then link information corresponding to the view (or view file) is directly sent to the proxy server as the view file request information;
correspondingly, the service server can select a target view file from the self cache content based on the view in the view server;
or, the service server may directly obtain the corresponding target view file based on the view link information in the view file request information.
When the target view file corresponding to the target view is selected from the cache content based on the target view in the view file request information and the target view file is sent to the terminal device, the method further includes:
if the proxy server does not store all views corresponding to the content request sent by the terminal equipment and files corresponding to the views, acquiring at least one new view and a view file corresponding to each new view from the content server; and updating the cache content based on the new at least one view and the view file corresponding to the new at least one view.
Or
If the proxy server does not store all view files corresponding to the view file request information sent by the terminal equipment, acquiring at least one new view file from the content server; updating the cached content based on the new at least one view file.
That is, while the foregoing steps 102-103 are performed, the proxy server may continue to interact with the content server to obtain updated cached content according to the user perspective, or based on a missing perspective file.
Specifically, if the proxy server does not store all views and files corresponding to the views corresponding to the content request sent by the terminal device, acquiring at least one new view and a view file corresponding to each new view from the content server includes:
predicting at least one view angle required to be acquired by the terminal equipment based on the view angle corresponding to the received view angle file request information to obtain at least one predicted view angle;
judging whether the at least one predicted view and a view file corresponding to the predicted view are stored in the existing cache content;
and if not, acquiring at least one new visual angle and a visual angle file corresponding to each new visual angle from the content server side based on the at least one predicted visual angle.
Further, the present embodiment can also be applied to a transmission process of multidimensional content. In the process of acquiring the content by the terminal, based on the pre-acquired terminal behavior data or the predicted terminal behavior data, extracting the content with more dimensionalities of information used in the next step of the terminal, and storing the content in the proxy equipment. And once the terminal needs the content, the content is transmitted to the terminal.
The prediction method may be that if the proxy server records the historical behavior of the user; the user preferentially selects the content dimension 1 in the past request, and the track is 1- >3- >2, so that the pre-cached content dimension can be easily determined, for example, when the current user looks at the dimension 1, the content 3 is pre-cached before the user makes a further request; the predicted content may be pre-cached content 3, or pre-cached content 3 and 2. May depend on a comprehensive determination of the speed at which the user reads the content and the available transmission bandwidth for the user.
Further, the method for determining whether the proxy server obtains all views and view files thereof corresponding to the content request from the content server or obtains only part of views and view files thereof may be as follows: determining views contained in the cache content acquired from the content server and the number of view files corresponding to the views based on at least the attribute information of the terminal device;
wherein, the attribute information comprises at least one of the following information:
a view refresh rate in the terminal device;
an available transmission bandwidth of the terminal device;
a maximum transmission bandwidth of the terminal device.
The view refresh rate in the terminal device may be determined by a user reading rate, for example, a rate at which the user changes the view, and the available transmission bandwidth of the user may be determined by the attribute information of the terminal device obtained when the terminal device accesses the system, or the network attribute. The attribute information about the terminal device may be a maximum access bandwidth of the terminal device, the network attribute may be a network transmission bandwidth, and the like; further, the faster the user changes the view angle, the more view angle files may be pre-cached, and in addition, the faster the bandwidth corresponding to the terminal device is, the more view angle files may be pre-cached.
Based on the foregoing scheme, fig. 2 shows one implementation flow, which is specifically described as follows:
1. the terminal equipment initiates a content request to a content server; the content request may include a plurality of dimensions of content, such as at least one of: current angle information, current position information, etc.; or, it may be understood as request information for establishing a connection sent to the content server;
2. the content server and the proxy server communicate and synchronize url ' information of files with different visual angles at the proxy server side and the angle relationship between the url ' information and the url ' information;
specifically, the url 'information may be generated by the content server and notify the proxy server to configure, or may be generated by the proxy server, where the server initiates a request to the proxy server and obtains the url' information of the service corresponding to the proxy server side. If the request is generated by the proxy server and acquired from the content server, the proxy server may send a request for the URL information to be acquired to the content server after the notification that the terminal device has initiated the content request is sent to the proxy server through the content server.
Possibly in parallel, the content server pushes the initial content towards the proxy server, in particular if the content server has information of the user's view behaviour, then part of the view file can be selected for initial transmission according to the information it grasps; otherwise, if the content server does not have the view behavior information of the user, the content server may need to transmit the full view file to the proxy server side. Or, postponing service pushing under the condition that the bandwidth is relatively insufficient, namely after receiving the user view request information, starting to push view files and pushing services of the view adjacent to the user view;
the configuration proxy server needs to unify the user request content with the content server, and at the position of the proxy server side, the proxy server needs to be capable of replacing the user and content server request content and performing content caching; when the user really makes a content request, the content is distributed to the user, and further the content server requests the content which is possibly requested by the user or is not stored in the proxy server in the next step;
the configuration may be generated as: the server can tell the proxy server, the corresponding dimension of the multidimensional content and the position of each dimension content file, and the proxy server decides the position of each dimension content file of the multidimensional content corresponding to the proxy server;
the view behavior information can be understood as the view acquired in each view acquisition period; such as 1, view trajectory 1- >3- >2- > …, and the period, time of day, etc. of the view trajectory transition.
It should be noted that, the content request does not necessarily carry a view angle, and the conventional process is to start requesting a view angle after the content request is successful; before the formal viewing angle request, part of the content is cached based on the viewing angle behavior information.
3. The content server returns all view file url ' information corresponding to the proxy server side and the angle relation between the view file url ' information and the view file url ' information facing the terminal equipment;
4. the terminal equipment selects an initial url 'to request a content file of a corresponding view based on the received url' information of the view file; what the terminal receives is a view configuration file, such as what view corresponds to what url; based on the information, the terminal selects the corresponding url based on the own view angle to request
5. The proxy server returns the view file url' information requested by the terminal equipment;
6. the terminal equipment determines new view angle file url' information according to a new angle as the head of the user rotates, and initiates a content request;
7. and the proxy server returns the new visual angle content according to the updated visual angle of the terminal equipment.
It should be noted that during the steps 4-7, the content server may receive the view behavior information of the terminal fed back from the proxy server, such as the terminal view request information, and continuously push the view file on the proxy server side based on the acquired information or no acquired information until the content transmission is complete (i.e. the file contains the full view file, or the file contains all the users' needs based on the user behavior determination, or the content file contains a certain range of the current view of the user).
In the foregoing process, the content server and the proxy server establish a corresponding trust relationship. The content server actively pushes the service to the proxy server, and the proxy server supports the optimization of content distribution. The process is very suitable for the situation that a content service provider establishes a proxy server by itself or the content service provider and the proxy server establish a firm contract relation.
Remarking: if the corresponding content file information has already been stored on the proxy server, the dashed interaction shown in fig. 2 is no longer necessary.
Fig. 3 is another specific implementation manner of this embodiment, and is different from the scheme shown in fig. 2 in that before the obtaining of the cache content from the content server side of the terminal device, the method further includes: acquiring a content request sent to the content server by the terminal equipment; and requesting to acquire cache content from the content server side based on the content request. The concrete description is as follows:
1. the terminal equipment initiates a content request to a content server;
2. the proxy server identifies or intercepts the content request of the terminal equipment, and initiates the content request to the content server instead of the proxy server;
3. the content server feeds back all the view angle files url and the relation between the view angle files url and the corresponding view angle to the proxy server;
the difference from the process shown in fig. 2 is that the former process has a cooperative relationship between the proxy server and the server, the proxy server is suitable for being deployed by the content server or has a protocol relationship between the two; this process may be a neutral proxy server.
4. The proxy server generates a local view file url' and a relation with a corresponding view angle based on the information fed back by the content server, and distributes the information to the terminal equipment;
namely, the link information corresponding to the view angle and the view angle file is encapsulated to obtain encapsulation information, and the encapsulation information is sent to the terminal equipment;
or,
and packaging the view angle and the link information corresponding to the view angle file to obtain packaging information, and sending the packaging information to the content server.
Specifically, the processing mode of this step is that the proxy server encapsulates the data packet in a certain mode and directly feeds back the user; or, the step is further divided into two steps, firstly, the determined proxy side url' and the relation with the corresponding angle are fed back to the server by the proxy server, and then the terminal equipment is fed back by the proxy server;
5. the terminal equipment selects an initial url' based on the information fed back by the proxy server and initiates a content request;
6. the proxy server returns the view content requested by the terminal equipment;
in the execution of steps 4-6, the proxy server requests the initial content (i.e. the current view angle corresponding to the content request or the content corresponding to the current position) from the content server, and in particular, if the proxy server has the view angle behavior information of the user, then a part of the view angle file can be selected for initial transmission according to the information grasped by the proxy server. Otherwise, the proxy server may need to request the transmission of the more full-view file to the proxy server side. Or, postponing the service request under the condition that the bandwidth is relatively insufficient, namely after receiving the user view request information, starting to make a view file request and making a service request of a view adjacent to the user view; this process continues until the user ends the service, or until the proxy server obtains the complete content (i.e., contains the full view file, or contains all the user's desired files based on user behavior determination, or contains a range of content files near the user's current view).
7. When the terminal equipment rotates the head, determining new view angle file url' information according to the new angle and initiating a content request;
8. and the proxy server returns the new visual angle content according to the updated visual angle of the terminal equipment.
In the processing manner provided in fig. 3, the related flow is applicable to that the proxy server and the terminal device establish a certain trust relationship, and can obtain the request content of the terminal device, specifically, the terminal device is actively disclosed to the proxy server through the language that the proxy server can recognize, or the proxy server has the capability of analyzing the request of the user. This procedure is well suited for scenarios where a proxy server is provided by a network operator.
Further, if the proxy server is deployed by a network operator, the proxy server has more sufficient network information. The proxy server may select to cache more or less user content based on the difference in the busy/idle status of the node networks at different times. For example, when the network status is relatively idle during the initial content application, the proxy server may help the user apply for more content at one time and cache the content temporarily not needed by the user.
Remarking: if the corresponding content file information has already been stored on the proxy server, the dashed interaction shown in fig. 3 is no longer necessary.
Fig. 4 is another processing flow, which is different from fig. 2 and fig. 3 in that before the obtaining of the cached content from the content server side of the terminal device, the method further includes: negotiating with the terminal equipment to obtain a format of an interactive signaling; receiving a content request sent by the terminal equipment based on the format of the interactive signaling; requesting to acquire cache content from the content server side based on the content request; the negotiation process comprises the steps of allowing a user to send a signaling which can be identified by a network through the standardization of the network, informing the network to a proxy server deployed towards the network, and carrying out a corresponding content request;
in addition, in step 1, the negotiated request content includes: based on said signalling format, i.e. filling in the corresponding information, such as the content url, is passed to the proxy server via signalling encapsulation.
The proposal is applicable to content optimization of all involved angle interactions or content distribution similar to angle interactions.
The processing manner of the remaining steps in fig. 4 is the same as that in fig. 3, and will not be described again here.
Therefore, by adopting the scheme provided by the embodiment, the proxy server can cache the view angle and the view angle file corresponding to the view angle in advance, and then the proxy server responds to the view angle file request information of the terminal device to feed back the target view angle file corresponding to the target view angle for the terminal device. Therefore, the method can quickly respond to the requirements of user services, reduce the time delay for the terminal equipment to acquire the visual angle file, and avoid the discomfort of the user in using the terminal equipment.
Example II,
The embodiment provides an information transmission method, which is applied to a terminal device, and as shown in fig. 5, the method includes:
step 501: sending view file request information to a proxy server;
step 502: selecting a target view file corresponding to the target view from the cache contents based on the view file request information received by the proxy server;
the cached content is at least one view angle cached by the proxy server side and corresponding to the content request sent by the terminal equipment, and a view angle file corresponding to each view angle.
In this embodiment, the terminal device may specifically be a terminal device capable of operating VR/AR, and the content server is also a content server capable of providing VR/AR.
Before the user visual angle of the terminal equipment changes, the proxy server interacts with a remote content server, and a corresponding visual angle file is cached in advance; the cached view and the view file corresponding to the view may be a view and a view file corresponding to the view near a current view where a user of the terminal device is located when initially accessing the system; or, the method may be implemented by predicting at least one commonly used view of the user and a view file corresponding to the view according to the grasped user view behavior habit by the proxy server; or, the proxy server may also be configured to provide at least one preset view and a view file corresponding to the preset view for the user of the terminal device outside the current view;
when the user visual angle of the terminal equipment changes, the terminal equipment sends new visual angle file request information to the proxy server, and the proxy server distributes users from visual angle files corresponding to the visual angles cached in advance based on the visual angle file request information.
Specifically, the acquiring the cache content from the content server side of the terminal device includes:
acquiring all views corresponding to content requests sent by the terminal equipment and view files corresponding to all views from a content server side of the terminal equipment; the content request may include content of at least one dimension, for example, at least one of information such as a current position and a current view angle of the terminal device. It can be understood that what the content to be acquired by the terminal device is can be determined according to the current position in the content request, and all the viewing angles at the position and the viewing angle file corresponding to each viewing angle are directly known according to the corresponding position.
Or,
acquiring a common visual angle of the terminal equipment and a visual angle file corresponding to the common visual angle from a content server side of the terminal equipment; it should be understood that the processing mode can be realized only on the basis that the terminal device has a common visual angle or the proxy server at least acquires at least one behavior record of the terminal device; the at least one behavior record based on the terminal device may include which of the views that the terminal device would normally acquire the N view files requested to be acquired, and the common view of the terminal device is obtained according to such analysis.
Or,
acquiring a view file corresponding to a current view of the terminal equipment from a content server side of the terminal equipment, and acquiring at least one related view of the current view and a view file corresponding to the view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value. The preset threshold may be set according to actual conditions, for example, may be within 30 degrees from the left to the right, or may also include within 30 degrees from the top to the bottom.
It should be noted that, the content that can be stored by the terminal device side is at least one view and its corresponding link information;
when the terminal device initiates the view file request information, a specific view may be included, or the connection information corresponding to the view may be determined first according to the view, and then link information corresponding to the view (or view file) is directly sent to the proxy server as the view file request information;
correspondingly, the service server can select a target view file from the self cache content based on the view in the view server;
or, the service server may directly obtain the corresponding target view file based on the view link information in the view file request information.
When the target view file corresponding to the target view is selected from the cache content based on the target view in the view file request information and the target view file is sent to the terminal device, the method further includes:
if the proxy server does not store all views corresponding to the content request sent by the terminal equipment and files corresponding to the views, acquiring at least one new view and a view file corresponding to each new view from the content server;
and updating the cache content based on the new at least one view and the view file corresponding to the new at least one view.
That is, while the foregoing steps 102-103 are performed, the proxy server may continue to interact with the content server to obtain updated cached content according to the user perspective, or based on a missing perspective file.
Specifically, if the proxy server does not store all views and files corresponding to the views corresponding to the content request sent by the terminal device, acquiring at least one new view and a view file corresponding to each new view from the content server includes:
predicting at least one view angle required to be acquired by the terminal equipment based on the view angle corresponding to the received view angle file request information to obtain at least one predicted view angle;
judging whether the at least one predicted view and a view file corresponding to the predicted view are stored in the existing cache content;
and if not, acquiring at least one new visual angle and a visual angle file corresponding to each new visual angle from the content server side based on the at least one predicted visual angle.
Further, the present embodiment can also be applied to a transmission process of multidimensional content. In the process of acquiring the content by the terminal, based on the pre-acquired terminal behavior data or the predicted terminal behavior data, extracting the content with more dimensionalities of information used in the next step of the terminal, and storing the content in the proxy equipment. And once the terminal needs the content, the content is transmitted to the terminal.
The prediction method may be that if the proxy server records the historical behavior of the user; the user preferentially selects the content dimension 1 in the past request, and the track is 1- >3- >2, so that the pre-cached content dimension can be easily determined, for example, when the current user looks at the dimension 1, the content 3 is pre-cached before the user makes a further request; the predicted content may be pre-cached content 3, or pre-cached content 3 and 2. May depend on a comprehensive determination of the speed at which the user reads the content and the available transmission bandwidth for the user.
Further, the method for determining whether the proxy server obtains all views and view files thereof corresponding to the content request from the content server or obtains only part of views and view files thereof may be as follows: determining views contained in the cache content acquired from the content server and the number of view files corresponding to the views based on at least the attribute information of the terminal device;
wherein, the attribute information comprises at least one of the following information:
a view refresh rate in the terminal device;
an available transmission bandwidth of the terminal device;
a maximum transmission bandwidth of the terminal device.
The view refresh rate in the terminal device may be determined by a user reading rate, for example, a rate at which the user changes the view, and the available transmission bandwidth of the user may be determined by the attribute information of the terminal device obtained when the terminal device accesses the system, or the network attribute. The attribute information about the terminal device may be a maximum access bandwidth of the terminal device, the network attribute may be a network transmission bandwidth, and the like; further, the faster the user changes the view angle, the more view angle files may be pre-cached, and in addition, the faster the bandwidth corresponding to the terminal device is, the more view angle files may be pre-cached.
Based on the foregoing solution, before sending the view file request information to the proxy server, the method further includes: sending a content request to a content server; and receiving at least one view cached at the proxy server side fed back by the content server, or receiving at least one view cached at the proxy server side and link information thereof fed back by the content server. Fig. 2 shows one of the implementation flows, which is specifically described as follows:
1. the terminal equipment initiates a content request to a content server; the content request may include a plurality of dimensions of content, such as at least one of: current angle information, current position information, etc.; or, it may be understood as request information for establishing a connection sent to the content server;
2. the content server and the proxy server communicate and synchronize url ' information of files with different visual angles at the proxy server side and the angle relationship between the url ' information and the url ' information;
specifically, the url 'information may be generated by the content server and notify the proxy server to configure, or may be generated by the proxy server, where the server initiates a request to the proxy server and obtains the url' information of the service corresponding to the proxy server side. If the request is generated by the proxy server and acquired from the content server, the proxy server may send a request for the URL information to be acquired to the content server after the notification that the terminal device has initiated the content request is sent to the proxy server through the content server.
Possibly in parallel, the content server pushes the initial content towards the proxy server, in particular if the content server has information of the user's view behaviour, then part of the view file can be selected for initial transmission according to the information it grasps; otherwise, if the content server does not have the view behavior information of the user, the content server may need to transmit the full view file to the proxy server side. Or, postponing service pushing under the condition that the bandwidth is relatively insufficient, namely after receiving the user view request information, starting to push view files and pushing services of the view adjacent to the user view;
the configuration proxy server needs to unify the user request content with the content server, and at the position of the proxy server side, the proxy server needs to be capable of replacing the user and content server request content and performing content caching; when the user really makes a content request, the content is distributed to the user, and further the content server requests the content which is possibly requested by the user or is not stored in the proxy server in the next step;
the configuration may be generated as: the server can tell the proxy server, the corresponding dimension of the multidimensional content and the position of each dimension content file, and the proxy server decides the position of each dimension content file of the multidimensional content corresponding to the proxy server;
the view behavior information can be understood as the view acquired in each view acquisition period; such as 1, view trajectory 1- >3- >2- > …, and the period, time of day, etc. of the view trajectory transition.
It should be noted that, the content request does not necessarily carry a view angle, and the conventional process is to start requesting a view angle after the content request is successful; before the formal viewing angle request, part of the content is cached based on the viewing angle behavior information.
3. The content server returns all view file url ' information corresponding to the proxy server side and the angle relation between the view file url ' information and the view file url ' information facing the terminal equipment;
4. the terminal equipment selects an initial url 'to request a content file of a corresponding view based on the received url' information of the view file; what the terminal receives is a view configuration file, such as what view corresponds to what url; based on the information, the terminal selects the corresponding url based on the own view angle to request
5. The proxy server returns the view file url' information requested by the terminal equipment;
6. the terminal equipment determines new view angle file url' information according to a new angle as the head of the user rotates, and initiates a content request;
7. and the proxy server returns the new visual angle content according to the updated visual angle of the terminal equipment.
It should be noted that, during step 4-7, the content server may receive the view angle behavior information of the terminal fed back from the proxy server, such as terminal view angle request information, and continuously push the view angle file on the proxy server side based on the acquired information or no acquired information until the content transmission is complete (i.e. the file contains the full view angle file, or the file contains all the users' needs based on the user behavior determination, or the content file contains a certain range of the current view angle of the user).
In the foregoing process, the content server and the proxy server establish a corresponding trust relationship. The content server actively pushes the service to the proxy server, and the proxy server supports the optimization of content distribution. The process is very suitable for the situation that a content service provider establishes a proxy server by itself or the content service provider and the proxy server establish a firm contract relation.
Remarking: if the corresponding content file information has already been stored on the proxy server, the dashed interaction shown in fig. 2 is no longer necessary.
Fig. 3 is another specific implementation manner of this embodiment, and is different from the scheme shown in fig. 2 in that a content request is sent to a content server before sending view file request information to a proxy server; and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server. The concrete description is as follows:
1. the terminal equipment initiates a content request to a content server;
2. the proxy server identifies or intercepts the content request of the terminal equipment, and initiates the content request to the content server instead of the proxy server;
3. the content server feeds back all the view angle files url and the relation between the view angle files url and the corresponding view angle to the proxy server;
the difference from the process shown in fig. 2 is that the former process has a cooperative relationship between the proxy server and the server, the proxy server is suitable for being deployed by the content server or has a protocol relationship between the two; this process may be a neutral proxy server.
4. The proxy server generates a local view file url' and a relation with a corresponding view angle based on the information fed back by the content server, and distributes the information to the terminal equipment;
namely, the link information corresponding to the view angle and the view angle file is encapsulated to obtain encapsulation information, and the encapsulation information is sent to the terminal equipment;
or,
and packaging the view angle and the link information corresponding to the view angle file to obtain packaging information, and sending the packaging information to the content server.
Specifically, the processing mode of this step is that the proxy server encapsulates the data packet in a certain mode and directly feeds back the user; or, the step is further divided into two steps, firstly, the determined proxy side url' and the relation with the corresponding angle are fed back to the server by the proxy server, and then the terminal equipment is fed back by the proxy server;
5. the terminal equipment selects an initial url' based on the information fed back by the proxy server and initiates a content request;
6. the proxy server returns the view content requested by the terminal equipment;
in the execution of steps 4-6, the proxy server requests the initial content (i.e. the current view angle corresponding to the content request or the content corresponding to the current position) from the content server, and in particular, if the proxy server has the view angle behavior information of the user, then a part of the view angle file can be selected for initial transmission according to the information grasped by the proxy server. Otherwise, the proxy server may need to request the transmission of the more full-view file to the proxy server side. Or, postponing the service request under the condition that the bandwidth is relatively insufficient, namely after receiving the user view request information, starting to make a view file request and making a service request of a view adjacent to the user view; this process continues until the user ends the service, or until the proxy server obtains the complete content (i.e., contains the full view file, or contains all the user's desired files based on user behavior determination, or contains a range of content files near the user's current view).
7. When the terminal equipment rotates the head, determining new view angle file url' information according to the new angle and initiating a content request;
8. and the proxy server returns the new visual angle content according to the updated visual angle of the terminal equipment.
In the processing manner provided in fig. 3, the related flow is applicable to that the proxy server and the terminal device establish a certain trust relationship, and can obtain the request content of the terminal device, specifically, the terminal device is actively disclosed to the proxy server through the language that the proxy server can recognize, or the proxy server has the capability of analyzing the request of the user. This procedure is well suited for scenarios where a proxy server is provided by a network operator.
Further, if the proxy server is deployed by a network operator, the proxy server has more sufficient network information. The proxy server may select to cache more or less user content based on the difference in the busy/idle status of the node networks at different times. For example, when the network status is relatively idle during the initial content application, the proxy server may help the user apply for more content at one time and cache the content temporarily not needed by the user.
Remarking: if the corresponding content file information has already been stored on the proxy server, the dashed interaction shown in fig. 3 is no longer necessary.
Fig. 4 is another processing flow, which is different from fig. 2 and 3 in that before sending the view file request information to the proxy server, the method further includes: negotiating with the proxy server to obtain the format of the interactive signaling; sending a content request to the proxy server based on the format of the interactive signaling; and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server.
The negotiation process comprises the steps of allowing a user to send a signaling which can be identified by a network through the standardization of the network, informing the network to a proxy server deployed towards the network, and carrying out a corresponding content request;
in addition, in step 1, the negotiated request content includes: based on said signalling format, i.e. filling in the corresponding information, such as the content url, is passed to the proxy server via signalling encapsulation.
The proposal is applicable to content optimization of all involved angle interactions or content distribution similar to angle interactions.
The processing manner of the remaining steps in fig. 4 is the same as that in fig. 3, and will not be described again here.
Therefore, by adopting the scheme provided by the embodiment, the proxy server can cache the view angle and the view angle file corresponding to the view angle in advance, and then the proxy server responds to the view angle file request information of the terminal device to feed back the target view angle file corresponding to the target view angle for the terminal device. Therefore, the method can quickly respond to the requirements of user services, reduce the time delay for the terminal equipment to acquire the visual angle file, and avoid the discomfort of the user in using the terminal equipment.
Example III,
The embodiment of the invention provides an information transmission method, which is applied to a content server and comprises the following steps:
sending cache content to a proxy server of the terminal equipment based on a content request sent by the terminal equipment; the cache content is at least one view angle corresponding to the content request sent by the terminal equipment and a view angle file corresponding to each view angle.
In this embodiment, the terminal device may specifically be a terminal device capable of operating VR/AR, and the content server is also a content server capable of providing VR/AR.
Before the user visual angle of the terminal equipment changes, the proxy server interacts with a remote content server, and a corresponding visual angle file is cached in advance; the cached view and the view file corresponding to the view may be a view and a view file corresponding to the view near a current view where a user of the terminal device is located when initially accessing the system; or, the method may be implemented by predicting at least one commonly used view of the user and a view file corresponding to the view according to the grasped user view behavior habit by the proxy server; or, the proxy server may also be configured to provide at least one preset view and a view file corresponding to the preset view for the user of the terminal device outside the current view;
when the user visual angle of the terminal equipment changes, the terminal equipment sends new visual angle file request information to the proxy server, and the proxy server distributes users from visual angle files corresponding to the visual angles cached in advance based on the visual angle file request information.
Specifically, the sending the cache content to the proxy server of the terminal device includes:
sending all the visual angles corresponding to the content request and a visual angle file corresponding to each visual angle to the content server side; the content request may include content of at least one dimension, for example, at least one of information such as a current position and a current view angle of the terminal device. It can be understood that what the content to be acquired by the terminal device is can be determined according to the current position in the content request, and all the viewing angles at the position and the viewing angle file corresponding to each viewing angle are directly known according to the corresponding position.
Or,
sending a common visual angle of the terminal equipment and a visual angle file corresponding to the common visual angle to the content server side;
it should be understood that the processing mode can be realized only on the basis that the terminal device has a common visual angle or the proxy server at least acquires at least one behavior record of the terminal device; the at least one behavior record based on the terminal device may include which of the views that the terminal device would normally acquire the N view files requested to be acquired, and the common view of the terminal device is obtained according to such analysis.
Or,
sending a view file corresponding to the current view of the terminal equipment to the content server side, and acquiring at least one related view of the current view and a view file corresponding to the view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value. The preset threshold may be set according to actual conditions, for example, may be within 30 degrees from the left to the right, or may also include within 30 degrees from the top to the bottom.
It should be noted that, the content that can be stored by the terminal device side is at least one view and its corresponding link information;
when the terminal device initiates the view file request information, a specific view may be included, or the connection information corresponding to the view may be determined first according to the view, and then link information corresponding to the view (or view file) is directly sent to the proxy server as the view file request information;
correspondingly, the service server can select a target view file from the self cache content based on the view in the view server;
or, the service server may directly obtain the corresponding target view file based on the view link information in the view file request information.
The method further comprises the following steps: and sending a new at least one visual angle and a visual angle file corresponding to each new visual angle to the proxy server, wherein the new at least one visual angle and the visual angle file corresponding to the new visual angle are used for updating the cache content of the proxy server.
That is, the proxy server may also continuously interact with the content server to obtain updated cached content according to the user perspective or based on a missing perspective file.
Specifically, if the proxy server does not store all views and files corresponding to the views corresponding to the content request sent by the terminal device, acquiring at least one new view and a view file corresponding to each new view from the content server includes:
predicting at least one view angle required to be acquired by the terminal equipment based on the view angle corresponding to the received view angle file request information to obtain at least one predicted view angle;
judging whether the at least one predicted view and a view file corresponding to the predicted view are stored in the existing cache content;
and if not, acquiring at least one new visual angle and a visual angle file corresponding to each new visual angle from the content server side based on the at least one predicted visual angle.
Based on the foregoing scheme, fig. 2 shows one implementation flow, which is specifically described as follows:
1. the terminal equipment initiates a content request to a content server; the content request may include a plurality of dimensions of content, such as at least one of: current angle information, current position information, etc.; or, it may be understood as request information for establishing a connection sent to the content server;
2. the content server and the proxy server communicate and synchronize url ' information of files with different visual angles at the proxy server side and the angle relationship between the url ' information and the url ' information;
specifically, the url 'information may be generated by the content server and notify the proxy server to configure, or may be generated by the proxy server, where the server initiates a request to the proxy server and obtains the url' information of the service corresponding to the proxy server side. If the request is generated by the proxy server and acquired from the content server, the proxy server may send a request for the URL information to be acquired to the content server after the notification that the terminal device has initiated the content request is sent to the proxy server through the content server.
Possibly in parallel, the content server pushes the initial content towards the proxy server, in particular if the content server has information of the user's view behaviour, then part of the view file can be selected for initial transmission according to the information it grasps; otherwise, if the content server does not have the view behavior information of the user, the content server may need to transmit the full view file to the proxy server side. Or, postponing service pushing under the condition that the bandwidth is relatively insufficient, namely after receiving the user view request information, starting to push view files and pushing services of the view adjacent to the user view;
the configuration proxy server needs to unify the user request content with the content server, and at the position of the proxy server side, the proxy server needs to be capable of replacing the user and content server request content and performing content caching; when the user really makes a content request, the content is distributed to the user, and further the content server requests the content which is possibly requested by the user or is not stored in the proxy server in the next step;
the configuration may be generated as: the server can tell the proxy server, the corresponding dimension of the multidimensional content and the position of each dimension content file, and the proxy server decides the position of each dimension content file of the multidimensional content corresponding to the proxy server;
the view behavior information can be understood as the view acquired in each view acquisition period; such as 1, view trajectory 1- >3- >2- > …, and the period, time of day, etc. of the view trajectory transition.
It should be noted that, the content request does not necessarily carry a view angle, and the conventional process is to start requesting a view angle after the content request is successful; before the formal viewing angle request, part of the content is cached based on the viewing angle behavior information.
3. The content server returns all view file url ' information corresponding to the proxy server side and the angle relation between the view file url ' information and the view file url ' information facing the terminal equipment;
4. the terminal equipment selects an initial url 'to request a content file of a corresponding view based on the received url' information of the view file; what the terminal receives is a view configuration file, such as what view corresponds to what url; based on the information, the terminal selects the corresponding url based on the own view angle to request
5. The proxy server returns the view file url' information requested by the terminal equipment;
6. the terminal equipment determines new view angle file url' information according to a new angle as the head of the user rotates, and initiates a content request;
7. and the proxy server returns the new visual angle content according to the updated visual angle of the terminal equipment.
It should be noted that, during step 4-7, the content server may receive the view angle behavior information of the terminal fed back from the proxy server, such as terminal view angle request information, and continuously push the view angle file on the proxy server side based on the acquired information or no acquired information until the content transmission is complete (i.e. the file contains the full view angle file, or the file contains all the users' needs based on the user behavior determination, or the content file contains a certain range of the current view angle of the user).
In the foregoing process, the content server and the proxy server establish a corresponding trust relationship. The content server actively pushes the service to the proxy server, and the proxy server supports the optimization of content distribution. The process is very suitable for the situation that a content service provider establishes a proxy server by itself or the content service provider and the proxy server establish a firm contract relation.
Remarking: if the corresponding content file information has already been stored on the proxy server, the dashed interaction shown in fig. 2 is no longer necessary.
Fig. 3 is another specific implementation manner of this embodiment, and is different from the scheme shown in fig. 2 in that before the obtaining of the cache content from the content server side of the terminal device, the method further includes: acquiring a content request sent to the content server by the terminal equipment; and requesting to acquire cache content from the content server side based on the content request. The concrete description is as follows:
1. the terminal equipment initiates a content request to a content server;
2. the proxy server identifies or intercepts the content request of the terminal equipment, and initiates the content request to the content server instead of the proxy server;
3. the content server feeds back all the view angle files url and the relation between the view angle files url and the corresponding view angle to the proxy server;
the difference from the process shown in fig. 2 is that the former process has a cooperative relationship between the proxy server and the server, the proxy server is suitable for being deployed by the content server or has a protocol relationship between the two; this process may be a neutral proxy server.
4. The proxy server generates a local view file url' and a relation with a corresponding view angle based on the information fed back by the content server, and distributes the information to the terminal equipment;
namely, the link information corresponding to the view angle and the view angle file is encapsulated to obtain encapsulation information, and the encapsulation information is sent to the terminal equipment;
or,
and packaging the view angle and the link information corresponding to the view angle file to obtain packaging information, and sending the packaging information to the content server.
Specifically, the processing mode of this step is that the proxy server encapsulates the data packet in a certain mode and directly feeds back the user; or, the step is further divided into two steps, firstly, the determined proxy side url' and the relation with the corresponding angle are fed back to the server by the proxy server, and then the terminal equipment is fed back by the proxy server;
5. the terminal equipment selects an initial url' based on the information fed back by the proxy server and initiates a content request;
6. the proxy server returns the view content requested by the terminal equipment;
in the execution of steps 4-6, the proxy server requests the initial content (i.e. the current view angle corresponding to the content request or the content corresponding to the current position) from the content server, and in particular, if the proxy server has the view angle behavior information of the user, then a part of the view angle file can be selected for initial transmission according to the information grasped by the proxy server. Otherwise, the proxy server may need to request the transmission of the more full-view file to the proxy server side. Or, postponing the service request under the condition that the bandwidth is relatively insufficient, namely after receiving the user view request information, starting to make a view file request and making a service request of a view adjacent to the user view; this process continues until the user ends the service, or until the proxy server obtains the complete content (i.e., contains the full view file, or contains all the user's desired files based on user behavior determination, or contains a range of content files near the user's current view).
7. When the terminal equipment rotates the head, determining new view angle file url' information according to the new angle and initiating a content request;
8. and the proxy server returns the new visual angle content according to the updated visual angle of the terminal equipment.
In the processing manner provided in fig. 3, the related flow is applicable to that the proxy server and the terminal device establish a certain trust relationship, and can obtain the request content of the terminal device, specifically, the terminal device is actively disclosed to the proxy server through the language that the proxy server can recognize, or the proxy server has the capability of analyzing the request of the user. This procedure is well suited for scenarios where a proxy server is provided by a network operator.
Further, if the proxy server is deployed by a network operator, the proxy server has more sufficient network information. The proxy server may select to cache more or less user content based on the difference in the busy/idle status of the node networks at different times. For example, when the network status is relatively idle during the initial content application, the proxy server may help the user apply for more content at one time and cache the content temporarily not needed by the user.
Remarking: if the corresponding content file information has already been stored on the proxy server, the dashed interaction shown in fig. 3 is no longer necessary.
Fig. 4 is another processing flow, which is different from fig. 2 and fig. 3 in that before the obtaining of the cached content from the content server side of the terminal device, the method further includes: negotiating with the terminal equipment to obtain a format of an interactive signaling; receiving a content request sent by the terminal equipment based on the format of the interactive signaling; requesting to acquire cache content from the content server side based on the content request; the negotiation process comprises the steps of allowing a user to send a signaling which can be identified by a network through the standardization of the network, informing the network to a proxy server deployed towards the network, and carrying out a corresponding content request;
in addition, in step 1, the negotiated request content includes: based on said signalling format, i.e. filling in the corresponding information, such as the content url, is passed to the proxy server via signalling encapsulation.
The proposal is applicable to content optimization of all involved angle interactions or content distribution similar to angle interactions.
The processing manner of the remaining steps in fig. 4 is the same as that in fig. 3, and will not be described again here.
Therefore, by adopting the scheme provided by the embodiment, the proxy server can cache the view angle and the view angle file corresponding to the view angle in advance, and then the proxy server responds to the view angle file request information of the terminal device to feed back the target view angle file corresponding to the target view angle for the terminal device. Therefore, the method can quickly respond to the requirements of user services, reduce the time delay for the terminal equipment to acquire the visual angle file, and avoid the discomfort of the user in using the terminal equipment.
Example four,
An embodiment of the present invention provides a proxy server, as shown in fig. 6, including:
a cache obtaining unit 61, configured to obtain cache content from a content server side of the terminal device; the cached content is at least one view corresponding to a content request sent by the terminal equipment and a view file corresponding to each view;
a terminal communication unit 62, configured to receive view file request information sent by the terminal device; and selecting a target visual angle file corresponding to the target visual angle from the cache content based on the visual angle file request information, and sending the target visual angle file to the terminal equipment. .
In this embodiment, the terminal device may specifically be a terminal device capable of operating VR/AR, and the content server is also a content server capable of providing VR/AR.
Before the user visual angle of the terminal equipment changes, the proxy server interacts with a remote content server, and a corresponding visual angle file is cached in advance; the cached view and the view file corresponding to the view may be a view and a view file corresponding to the view near a current view where a user of the terminal device is located when initially accessing the system; or, the method may be implemented by predicting at least one commonly used view of the user and a view file corresponding to the view according to the grasped user view behavior habit by the proxy server; or, the proxy server may also be configured to provide at least one preset view and a view file corresponding to the preset view for the user of the terminal device outside the current view;
when the user visual angle of the terminal equipment changes, the terminal equipment sends new visual angle file request information to the proxy server, and the proxy server distributes users from visual angle files corresponding to the visual angles cached in advance based on the visual angle file request information.
In particular, the cache fetch unit is configured to fetch the cache data from the cache memory
Acquiring all views corresponding to content requests sent by the terminal equipment and view files corresponding to all views from a content server side of the terminal equipment; the content request may include content of at least one dimension, for example, at least one of information such as a current position and a current view angle of the terminal device. It can be understood that what the content to be acquired by the terminal device is can be determined according to the current position in the content request, and all the viewing angles at the position and the viewing angle file corresponding to each viewing angle are directly known according to the corresponding position.
Or,
acquiring a common visual angle of the terminal equipment and a visual angle file corresponding to the common visual angle from a content server side of the terminal equipment; it should be understood that the processing mode can be realized only on the basis that the terminal device has a common visual angle or the proxy server at least acquires at least one behavior record of the terminal device; the at least one behavior record based on the terminal device may include which of the views that the terminal device would normally acquire the N view files requested to be acquired, and the common view of the terminal device is obtained according to such analysis.
Or,
acquiring a view file corresponding to a current view of the terminal equipment from a content server side of the terminal equipment, and acquiring at least one related view of the current view and a view file corresponding to the view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value. The preset threshold may be set according to actual conditions, for example, may be within 30 degrees from the left to the right, or may also include within 30 degrees from the top to the bottom.
It should be noted that, the content that can be stored by the terminal device side is at least one view and its corresponding link information;
when the terminal device initiates the view file request information, a specific view may be included, or the connection information corresponding to the view may be determined first according to the view, and then link information corresponding to the view (or view file) is directly sent to the proxy server as the view file request information;
correspondingly, the service server can select a target view file from the self cache content based on the view in the view server;
or, the service server may directly obtain the corresponding target view file based on the view link information in the view file request information.
The cache obtaining unit is configured to obtain, from the content server, at least one new view and a view file corresponding to each new view if the proxy server does not store all views and files corresponding to the views corresponding to the content request sent by the terminal device;
and updating the cache content based on the new at least one view and the view file corresponding to the new at least one view.
That is, the proxy server may also continuously interact with the content server to obtain updated cached content according to the user perspective or based on a missing perspective file.
Specifically, the cache obtaining unit is configured to predict, based on a view corresponding to the received view file request information, at least one view that needs to be obtained by the terminal device, so as to obtain at least one predicted view;
judging whether the at least one predicted view and a view file corresponding to the predicted view are stored in the existing cache content;
and if not, acquiring at least one new visual angle and a visual angle file corresponding to each new visual angle from the content server side based on the at least one predicted visual angle.
Further, the present embodiment can also be applied to a transmission process of multidimensional content. In the process of acquiring the content by the terminal, based on the pre-acquired terminal behavior data or the predicted terminal behavior data, extracting the content with more dimensionalities of information used in the next step of the terminal, and storing the content in the proxy equipment. And once the terminal needs the content, the content is transmitted to the terminal.
The prediction method may be that if the proxy server records the historical behavior of the user; the user preferentially selects the content dimension 1 in the past request, and the track is 1- >3- >2, so that the pre-cached content dimension can be easily determined, for example, when the current user looks at the dimension 1, the content 3 is pre-cached before the user makes a further request; the predicted content may be pre-cached content 3, or pre-cached content 3 and 2. May depend on a comprehensive determination of the speed at which the user reads the content and the available transmission bandwidth for the user.
Further, the method for determining whether the proxy server obtains all views and view files thereof corresponding to the content request from the content server or obtains only part of views and view files thereof may be as follows: the proxy server further comprises:
a processing unit 63, configured to determine, based on at least the attribute information of the terminal device, views included in the cached content acquired from the content server and the number of view files corresponding to the views;
wherein, the attribute information comprises at least one of the following information:
a view refresh rate in the terminal device;
an available transmission bandwidth of the terminal device;
a maximum transmission bandwidth of the terminal device.
The view refresh rate in the terminal device may be determined by a user reading rate, for example, a rate at which the user changes the view, and the available transmission bandwidth of the user may be determined by the attribute information of the terminal device obtained when the terminal device accesses the system, or the network attribute. The attribute information about the terminal device may be a maximum access bandwidth of the terminal device, the network attribute may be a network transmission bandwidth, and the like; further, the faster the user changes the view angle, the more view angle files may be pre-cached, and in addition, the faster the bandwidth corresponding to the terminal device is, the more view angle files may be pre-cached.
Based on the foregoing scheme, fig. 2 shows one implementation flow, which is specifically described as follows:
1. the terminal equipment initiates a content request to a content server; the content request may include a plurality of dimensions of content, such as at least one of: current angle information, current position information, etc.; or, it may be understood as request information for establishing a connection sent to the content server;
2. the content server and the proxy server communicate and synchronize url ' information of files with different visual angles at the proxy server side and the angle relationship between the url ' information and the url ' information;
specifically, the url 'information may be generated by the content server and notify the proxy server to configure, or may be generated by the proxy server, where the server initiates a request to the proxy server and obtains the url' information of the service corresponding to the proxy server side. If the request is generated by the proxy server and acquired from the content server, the proxy server may send a request for the URL information to be acquired to the content server after the notification that the terminal device has initiated the content request is sent to the proxy server through the content server.
Possibly in parallel, the content server pushes the initial content towards the proxy server, in particular if the content server has information of the user's view behaviour, then part of the view file can be selected for initial transmission according to the information it grasps; otherwise, if the content server does not have the view behavior information of the user, the content server may need to transmit the full view file to the proxy server side. Or, postponing service pushing under the condition that the bandwidth is relatively insufficient, namely after receiving the user view request information, starting to push view files and pushing services of the view adjacent to the user view;
the configuration proxy server needs to unify the user request content with the content server, and at the position of the proxy server side, the proxy server needs to be capable of replacing the user and content server request content and performing content caching; when the user really makes a content request, the content is distributed to the user, and further the content server requests the content which is possibly requested by the user or is not stored in the proxy server in the next step;
the configuration may be generated as: the server can tell the proxy server, the corresponding dimension of the multidimensional content and the position of each dimension content file, and the proxy server decides the position of each dimension content file of the multidimensional content corresponding to the proxy server;
the view behavior information can be understood as the view acquired in each view acquisition period; such as 1, view trajectory 1- >3- >2- > …, and the period, time of day, etc. of the view trajectory transition.
It should be noted that, the content request does not necessarily carry a view angle, and the conventional process is to start requesting a view angle after the content request is successful; before the formal viewing angle request, part of the content is cached based on the viewing angle behavior information.
3. The content server returns all view file url ' information corresponding to the proxy server side and the angle relation between the view file url ' information and the view file url ' information facing the terminal equipment;
4. the terminal equipment selects an initial url 'to request a content file of a corresponding view based on the received url' information of the view file; what the terminal receives is a view configuration file, such as what view corresponds to what url; based on the information, the terminal selects the corresponding url based on the own view angle to request
5. The proxy server returns the view file url' information requested by the terminal equipment;
6. the terminal equipment determines new view angle file url' information according to a new angle as the head of the user rotates, and initiates a content request;
7. and the proxy server returns the new visual angle content according to the updated visual angle of the terminal equipment.
It should be noted that, in steps 4-7, the content server may receive the view angle behavior information of the terminal fed back from the proxy server, such as the terminal view angle request information, and continuously push the view angle file at the proxy server side until the content transmission is complete (i.e. the file contains the full view angle file, or the file contains all the users' needs based on the user behavior determination, or the content file contains a certain range of the current view angle of the user).
In the foregoing process, the content server and the proxy server establish a corresponding trust relationship. The content server actively pushes the service to the proxy server, and the proxy server supports the optimization of content distribution. The process is very suitable for the situation that a content service provider establishes a proxy server by itself or the content service provider and the proxy server establish a firm contract relation.
Remarking: if the corresponding content file information has already been stored on the proxy server, the dashed interaction shown in fig. 2 is no longer necessary.
Another specific implementation manner of this embodiment is different from the scheme shown in fig. 2 in that the terminal communication unit is configured to obtain a content request sent by the terminal device to the content server; correspondingly, the cache obtaining unit is configured to request the content server side to obtain cache content based on the content request.
The terminal communication unit is used for negotiating with the terminal equipment to obtain a format of an interactive signaling; and receiving a content request sent by the terminal equipment based on the format of the interactive signaling. The negotiation process comprises the steps of allowing a user to send a signaling which can be identified by a network through the standardization of the network, informing the network to a proxy server deployed towards the network, and carrying out a corresponding content request;
in addition, the negotiated request content includes: based on said signalling format, i.e. filling in the corresponding information, such as the content url, is passed to the proxy server via signalling encapsulation.
The proposal is applicable to content optimization of all involved angle interactions or content distribution similar to angle interactions.
The processing unit is used for packaging the view angle and the link information corresponding to the view angle file to obtain packaging information and sending the packaging information to the terminal equipment;
or,
and packaging the view angle and the link information corresponding to the view angle file to obtain packaging information, and sending the packaging information to the content server.
Therefore, by adopting the scheme provided by the embodiment, the proxy server can cache the view angle and the view angle file corresponding to the view angle in advance, and then the proxy server responds to the view angle file request information of the terminal device to feed back the target view angle file corresponding to the target view angle for the terminal device. Therefore, the method can quickly respond to the requirements of user services, reduce the time delay for the terminal equipment to acquire the visual angle file, and avoid the discomfort of the user in using the terminal equipment.
Example V,
The present embodiment provides a terminal device, as shown in fig. 7, including:
a file requesting unit 71, configured to send view file request information to the proxy server;
a file obtaining unit 72, configured to receive that the proxy server selects a target view file corresponding to the target view from the cached content based on the view file request information;
the cached content is at least one view angle cached by the proxy server side and corresponding to the content request sent by the terminal equipment, and a view angle file corresponding to each view angle.
In this embodiment, the terminal device may specifically be a terminal device capable of operating VR/AR, and the content server is also a content server capable of providing VR/AR.
Before the user visual angle of the terminal equipment changes, the proxy server interacts with a remote content server, and a corresponding visual angle file is cached in advance; the cached view and the view file corresponding to the view may be a view and a view file corresponding to the view near a current view where a user of the terminal device is located when initially accessing the system; or, the method may be implemented by predicting at least one commonly used view of the user and a view file corresponding to the view according to the grasped user view behavior habit by the proxy server; or, the proxy server may also be configured to provide at least one preset view and a view file corresponding to the preset view for the user of the terminal device outside the current view;
when the user visual angle of the terminal equipment changes, the terminal equipment sends new visual angle file request information to the proxy server, and the proxy server distributes users from visual angle files corresponding to the visual angles cached in advance based on the visual angle file request information.
Specifically, the terminal device further includes:
a content request unit 73 for sending a content request to the content server; and receiving at least one view cached at the proxy server side fed back by the content server, or receiving at least one view cached at the proxy server side and link information thereof fed back by the content server.
Or,
a content request unit 73 for sending a content request to the content server; and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server.
The content request may include content of at least one dimension, for example, at least one of information such as a current position and a current view angle of the terminal device. It can be understood that what the content to be acquired by the terminal device is can be determined according to the current position in the content request, and all the viewing angles at the position and the viewing angle file corresponding to each viewing angle are directly known according to the corresponding position.
It should be noted that, the content that can be stored by the terminal device side is at least one view and its corresponding link information;
when the terminal device initiates the view file request information, a specific view may be included, or the connection information corresponding to the view may be determined first according to the view, and then link information corresponding to the view (or view file) is directly sent to the proxy server as the view file request information;
correspondingly, the service server can select a target view file from the self cache content based on the view in the view server;
or, the service server may directly obtain the corresponding target view file based on the view link information in the view file request information.
The terminal device further includes:
a negotiation unit 74, configured to negotiate with the proxy server to obtain a format of an interactive signaling;
a content request unit 73, configured to send a content request to the proxy server based on the format of the interactive signaling; and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server.
The negotiation process comprises the steps of allowing a user to send a signaling which can be identified by a network through the standardization of the network, informing the network to a proxy server deployed towards the network, and carrying out a corresponding content request;
the file acquiring unit is further configured to receive encapsulation information sent by the proxy server or the content server, where the encapsulation information is used to represent a view angle cached at the proxy server side and link information corresponding to the view angle at the proxy server side.
Therefore, by adopting the scheme provided by the embodiment, the proxy server can cache the view angle and the view angle file corresponding to the view angle in advance, and then the proxy server responds to the view angle file request information of the terminal device to feed back the target view angle file corresponding to the target view angle for the terminal device. Therefore, the method can quickly respond to the requirements of user services, reduce the time delay for the terminal equipment to acquire the visual angle file, and avoid the discomfort of the user in using the terminal equipment.
Example six,
An embodiment of the present invention provides a content server, as shown in fig. 8, including:
a cache sending unit 81, configured to send cache content to a proxy server of a terminal device based on a content request sent by the terminal device; the cache content is at least one view angle corresponding to the content request sent by the terminal equipment and a view angle file corresponding to each view angle.
In this embodiment, the terminal device may specifically be a terminal device capable of operating VR/AR, and the content server is also a content server capable of providing VR/AR.
Before the user visual angle of the terminal equipment changes, the proxy server interacts with a remote content server, and a corresponding visual angle file is cached in advance; the cached view and the view file corresponding to the view may be a view and a view file corresponding to the view near a current view where a user of the terminal device is located when initially accessing the system; or, the method may be implemented by predicting at least one commonly used view of the user and a view file corresponding to the view according to the grasped user view behavior habit by the proxy server; or, the proxy server may also be configured to provide at least one preset view and a view file corresponding to the preset view for the user of the terminal device outside the current view;
when the user visual angle of the terminal equipment changes, the terminal equipment sends new visual angle file request information to the proxy server, and the proxy server distributes users from visual angle files corresponding to the visual angles cached in advance based on the visual angle file request information.
Specifically, the cache sending unit is configured to send all views corresponding to the content request and view files corresponding to each view to the content server side;
or,
sending a common visual angle of the terminal equipment and a visual angle file corresponding to the common visual angle to the content server side;
or,
sending a view file corresponding to the current view of the terminal equipment to the content server side, and acquiring at least one related view of the current view and a view file corresponding to the view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value.
The preset threshold may be set according to actual conditions, for example, may be within 30 degrees from the left to the right, or may also include within 30 degrees from the top to the bottom.
It should be noted that, the content that can be stored by the terminal device side is at least one view and its corresponding link information;
when the terminal device initiates the view file request information, a specific view may be included, or the connection information corresponding to the view may be determined first according to the view, and then link information corresponding to the view (or view file) is directly sent to the proxy server as the view file request information;
correspondingly, the service server can select a target view file from the self cache content based on the view in the view server;
or, the service server may directly obtain the corresponding target view file based on the view link information in the view file request information.
The content server further comprises:
a cache updating unit 82, configured to send, to the proxy server, a new at least one view and a view file corresponding to each new view, where the new at least one view and the view file corresponding to the new view are used to update cache content of the proxy server.
That is, the proxy server may also continuously interact with the content server to obtain updated cached content according to the user perspective or based on a missing perspective file.
The content server further comprises:
a communication unit 83, configured to receive the terminal device or receive a content request sent by the proxy server.
The communication unit 83 is configured to receive link information sent by the proxy server and corresponding to the view and the view file, and package the link information to obtain package information;
a communication unit 83, configured to send the encapsulation information to the terminal device.
Therefore, by adopting the scheme provided by the embodiment, the proxy server can cache the view angle and the view angle file corresponding to the view angle in advance, and then the proxy server responds to the view angle file request information of the terminal device to feed back the target view angle file corresponding to the target view angle for the terminal device. Therefore, the method can quickly respond to the requirements of user services, reduce the time delay for the terminal equipment to acquire the visual angle file, and avoid the discomfort of the user in using the terminal equipment.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a device, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (36)
1. An information transmission method applied to a proxy server is characterized by comprising the following steps:
acquiring at least one visual angle corresponding to a content request sent by terminal equipment and a visual angle file corresponding to the visual angle from a content server side of the terminal equipment, and adding the at least one visual angle and the visual angle file corresponding to the at least one visual angle to cache content;
receiving visual angle file request information sent by the terminal equipment;
and selecting a target view file corresponding to a target view from the cache contents based on the view file request information, and sending the target view file to the terminal equipment.
2. The method according to claim 1, wherein the obtaining of the cache content from the content server side of the terminal device comprises:
acquiring all views corresponding to content requests sent by the terminal equipment and view files corresponding to all views from a content server side of the terminal equipment;
or,
acquiring a common visual angle of the terminal equipment and a visual angle file corresponding to the common visual angle from a content server side of the terminal equipment;
or,
acquiring a view file corresponding to a current view of the terminal equipment from a content server side of the terminal equipment, and acquiring at least one related view of the current view and a view file corresponding to the view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value.
3. The method according to claim 1, wherein when the target view file corresponding to the target view is selected from the cache contents based on the target view in the view file request information and sent to the terminal device, the method further comprises:
if the proxy server does not store all views corresponding to the content request sent by the terminal equipment and files corresponding to the views, acquiring at least one new view and a view file corresponding to each new view from the content server; updating cache content based on the new at least one view and a view file corresponding to the new at least one view;
or,
if the proxy server does not store all view files corresponding to the view file request information sent by the terminal equipment, acquiring at least one new view file from the content server; updating the cached content based on the new at least one view file.
4. The method according to claim 3, wherein if the proxy server does not store all views and files corresponding to the views corresponding to the content request sent by the terminal device, acquiring a new at least one view and a view file corresponding to each new view from the content server includes:
predicting at least one view angle required to be acquired by the terminal equipment based on the view angle corresponding to the received view angle file request information to obtain at least one predicted view angle;
judging whether the at least one predicted view and a view file corresponding to the predicted view are stored in the existing cache content;
and if not, acquiring at least one new visual angle and a visual angle file corresponding to each new visual angle from the content server side based on the at least one predicted visual angle.
5. The method according to any one of claims 1-4, further comprising:
determining views contained in the cache content acquired from the content server and the number of view files corresponding to the views based on at least the attribute information of the terminal device;
wherein, the attribute information comprises at least one of the following information:
a view refresh rate in the terminal device;
an available transmission bandwidth of the terminal device;
a maximum transmission bandwidth of the terminal device.
6. The method according to claim 1, wherein before the obtaining of the cached content from the content server side of the terminal device, the method further comprises:
acquiring a content request sent to the content server by the terminal equipment;
and requesting to acquire cache content from the content server side based on the content request.
7. The method according to claim 1, wherein before the obtaining of the cached content from the content server side of the terminal device, the method further comprises:
negotiating with the terminal equipment to obtain a format of an interactive signaling;
receiving a content request sent by the terminal equipment based on the format of the interactive signaling;
and requesting to acquire cache content from the content server side based on the content request.
8. The method of claim 1, further comprising:
packaging the view angle and the link information corresponding to the view angle file to obtain packaging information, and sending the packaging information to the terminal equipment;
or,
and packaging the view angle and the link information corresponding to the view angle file to obtain packaging information, and sending the packaging information to the content server.
9. An information transmission method is applied to terminal equipment, and is characterized in that the method comprises the following steps:
sending view file request information to a proxy server;
selecting a target view file corresponding to the target view from the cache contents based on the view file request information received by the proxy server;
the cached content is at least one view angle cached by the proxy server side and corresponding to the content request sent by the terminal equipment, and a view angle file corresponding to each view angle.
10. The method of claim 9, wherein before sending the view file request information to the proxy server, the method further comprises:
sending a content request to a content server;
and receiving at least one view cached at the proxy server side fed back by the content server, or receiving at least one view cached at the proxy server side and link information thereof fed back by the content server.
11. The method of claim 9, wherein before sending the view file request information to the proxy server, the method further comprises:
sending a content request to a content server;
and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server.
12. The method of claim 9, wherein before sending the view file request information to the proxy server, the method further comprises:
negotiating with the proxy server to obtain the format of the interactive signaling;
sending a content request to the proxy server based on the format of the interactive signaling;
and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server.
13. The method of claim 9, further comprising:
and receiving packaging information sent by the proxy server or the content server, wherein the packaging information is used for representing the view angle cached at the proxy server side and the link information corresponding to the proxy server side.
14. An information transmission method applied to a content server, the method comprising:
based on a content request sent by a terminal device, at least one view corresponding to the content request sent by the terminal device and a view file corresponding to the view are sent to a proxy server of the terminal device.
15. The method of claim 14, wherein sending the cached content to a proxy server of the terminal device comprises:
sending all the visual angles corresponding to the content request and a visual angle file corresponding to each visual angle to the content server side;
or,
sending a common visual angle of the terminal equipment and a visual angle file corresponding to the common visual angle to the content server side;
or,
sending a view file corresponding to the current view of the terminal equipment to the content server side, and acquiring at least one related view of the current view and a view file corresponding to the view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value.
16. The method of claim 14, further comprising:
and sending a new at least one visual angle and a visual angle file corresponding to each new visual angle to the proxy server, wherein the new at least one visual angle and the visual angle file corresponding to the new visual angle are used for updating the cache content of the proxy server.
17. The method according to claim 14, wherein the content request based on the terminal device further comprises:
and receiving the terminal equipment or receiving a content request sent by the proxy server.
18. The method of claim 14, further comprising:
and receiving link information which is sent by the proxy server and corresponds to the view angle and the view angle file, packaging the link information to obtain packaging information, and sending the packaging information to the terminal equipment.
19. A proxy server, comprising:
the system comprises a cache acquisition unit, a cache processing unit and a cache processing unit, wherein the cache acquisition unit is used for acquiring at least one visual angle corresponding to a content request sent by terminal equipment and a visual angle file corresponding to the visual angle from a content server side of the terminal equipment and adding the at least one visual angle and the visual angle file corresponding to the visual angle to cache content;
the terminal communication unit is used for receiving the view file request information sent by the terminal equipment; and selecting a target view file corresponding to a target view from the cache contents based on the view file request information, and sending the target view file to the terminal equipment.
20. The proxy server according to claim 19, wherein the cache obtaining unit is configured to obtain, from a content server side of the terminal device, all views corresponding to content requests sent by the terminal device and view files corresponding to each view;
or,
the cache obtaining unit is used for obtaining a common view angle of the terminal equipment and a view angle file corresponding to the common view angle from a content server side of the terminal equipment;
or,
the cache obtaining unit is configured to obtain, from a content server side of the terminal device, a view file corresponding to a current view of the terminal device, and obtain at least one relevant view of the current view and a view file corresponding to the relevant view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value.
21. The proxy server according to claim 19, wherein the cache obtaining unit is configured to obtain, from the content server, at least one new view and a view file corresponding to each new view if the proxy server does not store all views and files corresponding to all views corresponding to content requests sent by the terminal device; updating cache content based on the new at least one view and a view file corresponding to the new at least one view;
or,
the cache obtaining unit is configured to obtain at least one new view file from the content server if the proxy server does not store all view files corresponding to the view file request information sent by the terminal device; updating the cached content based on the new at least one view file.
22. The proxy server according to claim 21, wherein the cache obtaining unit is configured to predict, based on a view corresponding to the received view file request information, at least one view that needs to be obtained by the terminal device, so as to obtain at least one predicted view;
judging whether the at least one predicted view and a view file corresponding to the predicted view are stored in the existing cache content;
and if not, acquiring at least one new visual angle and a visual angle file corresponding to each new visual angle from the content server side based on the at least one predicted visual angle.
23. A proxy server as claimed in any one of claims 19 to 22, further comprising:
the processing unit is used for determining the number of the view angles and the view angle files corresponding to the view angles, which are contained in the cache content acquired from the content server, at least based on the attribute information of the terminal equipment;
wherein, the attribute information comprises at least one of the following information:
a view refresh rate in the terminal device;
an available transmission bandwidth of the terminal device;
a maximum transmission bandwidth of the terminal device.
24. The proxy server according to claim 19, wherein the terminal communication unit is configured to obtain a content request sent by the terminal device to the content server;
correspondingly, the cache obtaining unit is configured to request the content server side to obtain cache content based on the content request.
25. The proxy server according to claim 19, wherein the terminal communication unit is configured to negotiate with the terminal device to obtain a format of the interactive signaling; and receiving a content request sent by the terminal equipment based on the format of the interactive signaling.
26. The proxy server of claim 19, further comprising:
the processing unit is used for packaging the view angle and the link information corresponding to the view angle file to obtain packaging information and sending the packaging information to the terminal equipment;
or,
and packaging the view angle and the link information corresponding to the view angle file to obtain packaging information, and sending the packaging information to the content server.
27. A terminal device, comprising:
the file request unit is used for sending the view file request information to the proxy server;
the file acquisition unit is used for receiving the target view file corresponding to the target view selected from the cache contents by the proxy server based on the view file request information;
the cached content is at least one view angle cached by the proxy server side and corresponding to the content request sent by the terminal equipment, and a view angle file corresponding to each view angle.
28. The terminal device of claim 27, wherein the terminal device further comprises:
a content request unit for transmitting a content request to a content server; and receiving at least one view cached at the proxy server side fed back by the content server, or receiving at least one view cached at the proxy server side and link information thereof fed back by the content server.
29. The terminal device of claim 27, wherein the terminal device further comprises:
a content request unit for transmitting a content request to a content server; and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server.
30. The terminal device of claim 27, wherein the terminal device further comprises:
a negotiation unit, configured to negotiate with the proxy server to obtain a format of an interactive signaling;
a content request unit, configured to send a content request to the proxy server based on the format of the interactive signaling; and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server.
31. The terminal device according to claim 27, wherein the file obtaining unit is configured to receive package information sent by the proxy server or a content server, where the package information is used to characterize a view cached at the proxy server and link information corresponding to the view at the proxy server.
32. A content server, comprising:
the cache sending unit is used for sending at least one view angle corresponding to the content request sent by the terminal equipment and a view angle file corresponding to each view angle to a proxy server of the terminal equipment based on the content request sent by the terminal equipment.
33. The content server according to claim 32, wherein the cache sending unit is configured to send, to the content server side, all views corresponding to the content request and view files corresponding to each view;
or,
sending a common visual angle of the terminal equipment and a visual angle file corresponding to the common visual angle to the content server side;
or,
sending a view file corresponding to the current view of the terminal equipment to the content server side, and acquiring at least one related view of the current view and a view file corresponding to the view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value.
34. The content server according to claim 32, wherein the content server further comprises:
and the cache updating unit is used for sending a new at least one view and a view file corresponding to each new view to the proxy server, wherein the new at least one view and the view file corresponding to the new view are used for updating the cache content of the proxy server.
35. The content server according to claim 32, wherein the content server further comprises:
and the communication unit is used for receiving the terminal equipment or receiving the content request sent by the proxy server.
36. The content server according to claim 32, wherein the content server further comprises:
the communication unit is used for receiving the link information which is sent by the proxy server and corresponds to the view angle and the view angle file, and packaging the link information to obtain packaging information; and the terminal equipment is used for sending the packaging information to the terminal equipment.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710108777.3A CN108513096B (en) | 2017-02-27 | 2017-02-27 | Information transmission method, proxy server, terminal device and content server |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710108777.3A CN108513096B (en) | 2017-02-27 | 2017-02-27 | Information transmission method, proxy server, terminal device and content server |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108513096A true CN108513096A (en) | 2018-09-07 |
CN108513096B CN108513096B (en) | 2021-09-14 |
Family
ID=63373919
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710108777.3A Active CN108513096B (en) | 2017-02-27 | 2017-02-27 | Information transmission method, proxy server, terminal device and content server |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108513096B (en) |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101300840A (en) * | 2005-11-04 | 2008-11-05 | 微软公司 | Multi-view video delivery |
CN101998116A (en) * | 2009-08-31 | 2011-03-30 | 中国移动通信集团公司 | Method, system and equipment for realizing multi-view video service |
CN102056015A (en) * | 2009-11-04 | 2011-05-11 | 沈阳隆惠科技有限公司 | Streaming media application method in panoramic virtual reality roaming |
US20150113581A1 (en) * | 2011-01-10 | 2015-04-23 | Dropbox, Inc. | System and method for sharing virtual and augmented reality scenes between users and viewers |
CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子(中国)研发中心 | Playing method and system of interactive multi-view video |
CN105913478A (en) * | 2015-12-28 | 2016-08-31 | 乐视致新电子科技(天津)有限公司 | 360-degree panorama display method and display module, and mobile terminal |
CN105933343A (en) * | 2016-06-29 | 2016-09-07 | 深圳市优象计算技术有限公司 | Stream cache mechanism used for network play of 720-degree panoramic video |
CN106454401A (en) * | 2016-10-26 | 2017-02-22 | 乐视网信息技术(北京)股份有限公司 | Method and device for playing video |
-
2017
- 2017-02-27 CN CN201710108777.3A patent/CN108513096B/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101300840A (en) * | 2005-11-04 | 2008-11-05 | 微软公司 | Multi-view video delivery |
CN101998116A (en) * | 2009-08-31 | 2011-03-30 | 中国移动通信集团公司 | Method, system and equipment for realizing multi-view video service |
CN102056015A (en) * | 2009-11-04 | 2011-05-11 | 沈阳隆惠科技有限公司 | Streaming media application method in panoramic virtual reality roaming |
US20150113581A1 (en) * | 2011-01-10 | 2015-04-23 | Dropbox, Inc. | System and method for sharing virtual and augmented reality scenes between users and viewers |
CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子(中国)研发中心 | Playing method and system of interactive multi-view video |
CN105913478A (en) * | 2015-12-28 | 2016-08-31 | 乐视致新电子科技(天津)有限公司 | 360-degree panorama display method and display module, and mobile terminal |
CN105933343A (en) * | 2016-06-29 | 2016-09-07 | 深圳市优象计算技术有限公司 | Stream cache mechanism used for network play of 720-degree panoramic video |
CN106454401A (en) * | 2016-10-26 | 2017-02-22 | 乐视网信息技术(北京)股份有限公司 | Method and device for playing video |
Also Published As
Publication number | Publication date |
---|---|
CN108513096B (en) | 2021-09-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3446461B1 (en) | Just in time transcoding and packaging in ipv6 networks | |
US10728353B2 (en) | Adaptive data streaming method with push messages control | |
US9264781B2 (en) | Method and apparatus for discovering internet protocol television service (IPTV) provider and IPTV service by using session initiation protocol | |
EP3979602B1 (en) | Request-based encoding for streaming content portions | |
US20040249965A1 (en) | Node caching system for streaming media applications | |
CN110933517B (en) | Code rate switching method, client and computer readable storage medium | |
EP2976887A1 (en) | Bandwidth management for over-the-top adaptive streaming | |
CN101626385B (en) | media service method and system | |
CN108063769B (en) | Method and device for realizing content service and content distribution network node | |
JP6301331B2 (en) | Service content distribution method and service management platform in heterogeneous network | |
US9479607B2 (en) | Content caching and delivering system with traffic of repetitively requested content reduced | |
EP3391652B1 (en) | Controlling retrieval in adaptive streaming | |
WO2011088725A1 (en) | Method and apparatus for synchronization based on hypertext transfer protocol (http) | |
WO2015120766A1 (en) | Video optimisation system and method | |
GB2516116A (en) | Adaptive data streaming method with push messages control | |
CN107438051A (en) | streaming media quick start method, device and system | |
EP3231161B1 (en) | Server-side prediction of media client steady state | |
US20160308924A1 (en) | Method, apparatus, and system for delivering network video | |
CN102439946B (en) | Data transmission method and device | |
CN111355979B (en) | Online audio rapid playing method | |
CN108513096B (en) | Information transmission method, proxy server, terminal device and content server | |
EP2515535A1 (en) | Method and set top box for acquiring program content | |
CN116248644A (en) | Optimization method based on WebRTC plug flow technology | |
KR20170074873A (en) | Reception device, transmission device, and data processing method | |
CN105100147A (en) | Controlmethod and device based on separation of content provider and service provider |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |