CN110278453A - Panoramic video image display method, mobile terminal and system based on 5G network - Google Patents

Panoramic video image display method, mobile terminal and system based on 5G network Download PDF

Info

Publication number
CN110278453A
CN110278453A CN201910601866.0A CN201910601866A CN110278453A CN 110278453 A CN110278453 A CN 110278453A CN 201910601866 A CN201910601866 A CN 201910601866A CN 110278453 A CN110278453 A CN 110278453A
Authority
CN
China
Prior art keywords
image
mobile terminal
server
decoding
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910601866.0A
Other languages
Chinese (zh)
Inventor
张玉峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Kaiqi Technology Co Ltd
Original Assignee
Zhejiang Kaiqi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Kaiqi Technology Co Ltd filed Critical Zhejiang Kaiqi Technology Co Ltd
Priority to CN201910601866.0A priority Critical patent/CN110278453A/en
Publication of CN110278453A publication Critical patent/CN110278453A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234345—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H04N21/25825—Management of client data involving client display capabilities, e.g. screen resolution of a mobile phone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H04N21/25833—Management of client data involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
    • H04N21/26233—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving content or additional data duration or size, e.g. length of a movie, size of an executable file
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4516—Management of client data or end-user data involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637—Control signals issued by the client directed to the server or network components
    • H04N21/6377—Control signals issued by the client directed to the server or network components directed to server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Graphics (AREA)
  • Computer Security & Cryptography (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a kind of panoramic video image display method, mobile terminal and systems based on 5G network, the mobile terminal system includes an at least mobile terminal and a server, the display methods includes: that the server receives the idsplay order that mobile terminal issues, and the idsplay order includes panoramic video image information and observed direction information；The server obtains target panoramic video image according to panoramic video image information；The server obtains image after decoding to the target panoramic video image-decoding；The server decoded according to the observed direction information interception after on image pre-set dimension image；The mobile terminal receives image and the display of the pre-set dimension by 5G network.Display methods, terminal system and mobile terminal of the invention can rationally utilize user terminals resources, save hardware resource for user, improve clarity, fluency that user terminal image is shown.

Description

Panoramic video image display method, mobile terminal and system based on 5G network
Technical field
The present invention relates to a kind of panoramic video image display method, mobile terminal and systems based on 5G network.
Background technique
Panorama, English name (Panorama), be otherwise known as 3D outdoor scene, is a kind of emerging Rich Media's technology, and video, Sound, the maximum difference of traditional Streaming Media such as picture is " can operate, can interact ".Panorama is divided into virtual reality and 3D outdoor scene two Kind.Virtual reality is the scene for the simulation reality made using software, for example, the virtual Forbidden City, Hebei virtual tourism, It virtually swims in Mount Taishan；3D outdoor scene is using slr camera or streetscape car shooting outdoor scene photo, and by special split, processing is allowed Author stands in picturesque scene, allows most beautiful showing on one side.
With the development of science and technology, the fast development of Digital Media is just being that tourism industry brings vigor, more and more numbers Medium technique by intelligent broadcasting and control platform for being realized and being polymerize, expired to function in venue, scenic region guide guidance system design Foot breaks limited space and event horizon is realized and user interaction, guidance, be user further up into the spiritual concern to people It offers convenience.
5G network (5G Network) is the 5th third generation mobile communication network, and peak value theoretical transmission speed was up to every 8 seconds 1GB, hundreds times faster than the transmission speed of 4G network.For example, the film of a 1G can download completion within 8 seconds.With The birth of 5G technology, the epoch for sharing 3D film, game and superelevation image quality (UHD) program with intelligent terminal are positive, and we walk Come.
Existing universe number guide to visitors exists to hardware requirement height, and display effect on mobile terminals is poor, runs Caton Defect.
Summary of the invention
The technical problem to be solved by the present invention is to high to hardware requirement in order to overcome existing universe number guide to visitors to exist, Display effect on mobile terminal is poor, operation Caton defect, and user terminals resources can rationally utilize by providing one kind, for user Hardware resource is saved, the panoramic video image based on 5G network of clarity, fluency that raising user terminal image is shown is aobvious Show method, mobile terminal and system.
The present invention is to solve above-mentioned technical problem by following technical proposals:
A kind of panoramic video image display method based on 5G network, the display methods are used for mobile terminal system, institute It states mobile terminal system and includes an at least mobile terminal and a server, it is characterized in that, the display methods includes:
The server receives the idsplay order that mobile terminal issues, and the idsplay order includes panoramic video image information And operational capability information；
The server obtains target panoramic video image according to panoramic video image information；
The server obtains image after decoding to the target panoramic video image-decoding, and according to the operation energy Power obtains the unit frame number of image after decoding；
The mobile terminal is by image after the reception decoding of 5G network and with image after the unit frame number broadcasting decoding.
Preferably, the operational capability information by the hardware equipment information of mobile terminal and processor occupancy multiplied by Respective specific gravity obtains, and wherein the specific gravity of hardware equipment information is greater than the specific gravity of the processor occupancy.
Preferably, the idsplay order further includes observed direction information, the display methods includes:
The server decoded according to the observed direction information interception after on image pre-set dimension image；
The mobile terminal is received the image of the pre-set dimension by 5G network and is played with unit frame number.
Preferably, the display methods includes:
Mobile terminal acquisition is used for the control instruction in control observation direction；
Observed direction angular turn amount and control duration are obtained according to the control instruction；
The server according to angular turn amount successively intercept observed direction rotational angle by decoding after on image The image of pre-set dimension, and the frame number of the image according to the control duration acquisition pre-set dimension；
The mobile terminal receives image and the display of the corresponding pre-set dimension of the control instruction by 5G network.
Preferably, the display methods includes:
Judge observed direction rotational angle by decoding after whether have rendering region on image, if then to the wash with watercolours Dye region is rendered.
Preferably, the mobile terminal includes a Three-dimensional Display engine, a two-dimentional page module and a primary layer, it is described Display methods includes:
The two dimension page module acquires idsplay order, and sends destination request to server according to the control instruction；
The two dimension page module obtains the feedback data of the destination request from server, and by the feedback data Information is sent to the primary layer；
The primary layer transmits the information of the feedback data to the Three-dimensional Display engine；
The Three-dimensional Display engine according to the information of the feedback data from the server obtain decoding after image；
The mobile terminal shows image after the decoding by the Three-dimensional Display engine.
The present invention also provides a kind of mobile terminal based on 5G network, the display methods is used for mobile terminal system, institute Stating mobile terminal system includes at least one described mobile terminal and a server, it is characterized in that, the mobile terminal packet A communication module and a display module are included,
The communication module is used to send idsplay order to server, and the idsplay order includes panoramic video image information And operational capability information；
The server is used to obtain target panoramic video image according to panoramic video image information；
The server is also used to the target panoramic video image-decoding to obtain image after decoding, and according to described Operational capability obtains the unit frame number of image after decoding；
The communication module is used to receive image after the decoding by 5G network；
The display module is used to play image after the decoding with unit frame number.
Preferably, the operational capability information by the hardware equipment information of mobile terminal and processor occupancy multiplied by Respective specific gravity obtains, and wherein the specific gravity of hardware equipment information is greater than the specific gravity of the processor occupancy, the idsplay order It further include observed direction information,
The server is for the image according to pre-set dimension on image after observed direction information interception decoding；
The display module is used to play the image of the pre-set dimension with unit frame number.
Preferably, the mobile terminal further include an acquisition module, one obtain module,
The acquisition module is instructed for acquisition control, and the control instruction is used for control observation direction；
The acquisition module is used to obtain observed direction angular turn amount and control duration according to the control instruction；
The server be used for according to angular turn amount successively intercept observed direction rotational angle by decoding after shadow As the image of upper pre-set dimension, and the frame number of the image according to the control duration acquisition pre-set dimension；
The display module is used to play the corresponding pre-set dimension of the control instruction with unit frame number.
The present invention also provides a kind of mobile terminal systems based on 5G network, it is characterized in that, the mobile terminal system Including at least one mobile terminal as described above and a server.
On the basis of common knowledge of the art, above-mentioned each optimum condition, can any combination to get each preferable reality of the present invention Example.
The positive effect of the present invention is that:
Display methods, terminal system and mobile terminal of the invention can rationally utilize user terminals resources, save for user Hardware resource is saved, clarity, fluency that user terminal image is shown are improved.
Detailed description of the invention
Fig. 1 is the flow chart of the display methods of the embodiment of the present invention 1.
Specific embodiment
The present invention is further illustrated below by the mode of embodiment, but does not therefore limit the present invention to the reality It applies among a range.
Embodiment 1
The present embodiment provides a kind of terminal system based on 5G network, the terminal system includes a mobile terminal and one Server.
In the present embodiment, the mobile terminal is mobile phone.
The mobile terminal further includes a communication module and a display module.
The communication module is used to send idsplay order to server, and the idsplay order includes panoramic video image information And operational capability information；
The server is used to obtain target panoramic video image according to panoramic video image information；
The server is also used to the target panoramic video image-decoding to obtain image after decoding, and according to described Operational capability obtains the unit frame number of image after decoding；
Unit frame number described in the present embodiment refers to the frame number in one second.
The communication module is used to receive image after the decoding by 5G network；
The display module is used to play image after the decoding with unit frame number.
The idsplay order further includes observed direction information,
The server is for the image according to pre-set dimension on image after observed direction information interception decoding；
The display module is used to play the image of the pre-set dimension with unit frame number.
The panoramic video image can be shot by fish eye lens, and 360 degree of range level, longitudinal 180 degree.
Observed direction is the image shown in a region from observation point, the observation point i.e. panorama camera Shooting point, the target image is a part of panoramic video image, it is traditional be achieved in that shown on spherical curtain it is complete Scape video image is equivalent to the observation scope instead of the eyes of people in scenic environment.
Further, the mobile terminal further includes an acquisition module, an acquisition module.
The acquisition module is instructed for acquisition control, and the control instruction is used for control observation direction；
The acquisition module is used to obtain observed direction angular turn amount and control duration according to the control instruction；
The server be used for according to angular turn amount successively intercept observed direction rotational angle by decoding after shadow As the image of upper pre-set dimension, and the frame number of the image according to the control duration acquisition pre-set dimension；
The display module is used to play the corresponding pre-set dimension of the control instruction with unit frame number.
In the present embodiment, the mobile terminal is shown by touch screen and inputs the control instruction, and sliding is suitable to the right In observed direction moves right in panoramic video image, control instruction includes direction and duration, duration more multispan Angle, region are bigger.The quantity of the frame number should match with control duration, and duration, and the frame number needed is also more.
The mobile terminal be also used to judge observed direction rotational angle by decoding after whether have rendering on image Region, if then being rendered to the rendering region.
Since the panoramic video image size of each frame is larger, and only partial region record be scenery, therefore, book Embodiment can mark scenery using Rendering Flags, and to scenery when visual angle (observed direction) is moved to the scenery It is rendered, to reduce unnecessary operation.
The rendering of the application refers to addition display effect, including the operation such as add filter.
The mobile terminal includes a Three-dimensional Display engine, a two-dimentional page module and a primary layer.
In the present embodiment, the Three-dimensional Display engine is Unity 3D engine, and the two dimension page module includes passing through The H5 page of Vue.js exploitation.
The primary layer is Native App.
The two dimension page module sends target to server according to the control instruction and asks for acquiring idsplay order It asks；
The two dimension page module is used to obtain the feedback data of the destination request from server, and by the feedback coefficient According to information be sent to the primary layer；
The primary layer is used for transmission the information of the feedback data to the Three-dimensional Display engine；
The Three-dimensional Display engine be used for according to the information of the feedback data from the server obtain decoding after image；
The Three-dimensional Display engine is for showing image after the decoding.
Using above-mentioned mobile terminal system, the present embodiment also provides a kind of display methods, comprising:
Step 100, the server receive the idsplay order that mobile terminal issues, and the idsplay order includes panoramic video Image information and operational capability information；
Step 101, the server obtain target panoramic video image according to panoramic video image information；
Step 102, the server obtain image after decoding to the target panoramic video image-decoding, and according to institute State the unit frame number that operational capability obtains image after decoding；
Step 103, the mobile terminal by image after the reception decoding of 5G network and play the decoding with unit frame number Image afterwards.
Wherein, the operational capability information is by the hardware equipment information and processor occupancy of mobile terminal multiplied by each From specific gravity obtain, wherein the specific gravity of hardware equipment information be greater than the processor occupancy specific gravity.
Further, the idsplay order further includes observed direction information, and step 101 includes the server according to After the decoding of observed direction information interception on image pre-set dimension image；
Step 103 includes that the mobile terminal is received the image of the pre-set dimension by 5G network and broadcast with unit frame number It puts.
Step 104, mobile terminal acquisition are used for the control instruction in control observation direction；
Step 105 obtains observed direction angular turn amount and control duration according to the control instruction；
Step 106, the server successively intercept the decoding that observed direction rotational angle is passed through according to angular turn amount Afterwards on image pre-set dimension image, and according to it is described control duration obtain pre-set dimension image frame number；
Step 107, the mobile terminal receive the image of the corresponding pre-set dimension of the control instruction simultaneously by 5G network Display.
Further include between step 106 and step 107 judge observed direction rotational angle by decoding after be on image It is no to have rendering region, if then being rendered to the rendering region.
Further, the mobile terminal includes a Three-dimensional Display engine, a two-dimentional page module and a primary layer, institute Stating display methods includes:
The two dimension page module acquires idsplay order, and sends destination request to server according to the control instruction, This step can be executed before step 100.
The two dimension page module obtains the feedback data of the destination request from server, and by the feedback data Information is sent to the primary layer, this step can be executed before step 103.
The primary layer transmits the information of the feedback data to the Three-dimensional Display engine, this step can be in step It is executed before 103.
The Three-dimensional Display engine according to the information of the feedback data from the server obtain decoding after image, this Step can execute in step 103.
The mobile terminal shows image after the decoding by the Three-dimensional Display engine.This one step 103 and 107 It can use.
Although specific embodiments of the present invention have been described above, it will be appreciated by those of skill in the art that these It is merely illustrative of, protection scope of the present invention is defined by the appended claims.Those skilled in the art is not carrying on the back Under the premise of from the principle and substance of the present invention, many changes and modifications may be made, but these are changed Protection scope of the present invention is each fallen with modification.

Claims (10)

1. a kind of panoramic video image display method based on 5G network, the display methods is used for mobile terminal system, described Mobile terminal system includes an at least mobile terminal and a server, which is characterized in that the display methods includes:
The server receives the idsplay order that mobile terminal issues, the idsplay order include panoramic video image information and Operational capability information；
The server obtains target panoramic video image according to panoramic video image information；
The server obtains image after decoding to the target panoramic video image-decoding, and is obtained according to the operational capability Take the unit frame number of image after decoding；
The mobile terminal is by image after the reception decoding of 5G network and with image after the unit frame number broadcasting decoding.
2. display methods as described in claim 1, which is characterized in that the hardware that the operational capability information passes through mobile terminal Facility information and processor occupancy are obtained multiplied by respective specific gravity, and wherein the specific gravity of hardware equipment information is greater than the processing The specific gravity of device occupancy.
3. display methods as described in claim 1, which is characterized in that the idsplay order further includes observed direction information, institute Stating display methods includes:
The server decoded according to the observed direction information interception after on image pre-set dimension image；
The mobile terminal is received the image of the pre-set dimension by 5G network and is played with unit frame number.
4. display methods as claimed in claim 3, which is characterized in that the display methods includes:
Mobile terminal acquisition is used for the control instruction in control observation direction；
Observed direction angular turn amount and control duration are obtained according to the control instruction；
The server according to angular turn amount successively intercept observed direction rotational angle by decoding after preset on image The image of size, and the frame number of the image according to the control duration acquisition pre-set dimension；
The mobile terminal receives image and the display of the corresponding pre-set dimension of the control instruction by 5G network.
5. display methods as claimed in claim 4, which is characterized in that the display methods includes:
Judge observed direction rotational angle by decoding after whether have rendering region on image, if then to the rendering area Domain is rendered.
6. display methods as described in claim 1, which is characterized in that the mobile terminal includes a Three-dimensional Display engine, one Two-dimentional page module and a primary layer, the display methods include:
The two dimension page module acquires idsplay order, and sends destination request to server according to the control instruction；
The two dimension page module obtains the feedback data of the destination request from server, and by the information of the feedback data It is sent to the primary layer；
The primary layer transmits the information of the feedback data to the Three-dimensional Display engine；
The Three-dimensional Display engine according to the information of the feedback data from the server obtain decoding after image；
The mobile terminal shows image after the decoding by the Three-dimensional Display engine.
7. a kind of mobile terminal based on 5G network, the display methods is used for mobile terminal system, the mobile terminal system Including mobile terminal described at least one and a server, which is characterized in that the mobile terminal include a communication module with And a display module,
The communication module be used for server send idsplay order, the idsplay order include panoramic video image information and Operational capability information；
The server is used to obtain target panoramic video image according to panoramic video image information；
The server is also used to the target panoramic video image-decoding to obtain image after decoding, and according to the operation Ability obtains the unit frame number of image after decoding；
The communication module is used to receive image after the decoding by 5G network；
The display module is used to play image after the decoding with unit frame number.
8. mobile terminal as described in claim 1, which is characterized in that the hardware that the operational capability information passes through mobile terminal Facility information and processor occupancy are obtained multiplied by respective specific gravity, and wherein the specific gravity of hardware equipment information is greater than the processing The specific gravity of device occupancy, the idsplay order further include observed direction information,
The server is for the image according to pre-set dimension on image after observed direction information interception decoding；
The display module is used to play the image of the pre-set dimension with unit frame number.
9. mobile terminal as claimed in claim 2, which is characterized in that the mobile terminal further includes an acquisition module, one obtains Modulus block,
The acquisition module is instructed for acquisition control, and the control instruction is used for control observation direction；
The acquisition module is used to obtain observed direction angular turn amount and control duration according to the control instruction；
The server be used for according to angular turn amount successively intercept observed direction rotational angle by decoding after image The image of pre-set dimension, and the frame number of the image according to the control duration acquisition pre-set dimension；
The display module is used to play the corresponding pre-set dimension of the control instruction with unit frame number.
10. a kind of mobile terminal system based on 5G network, which is characterized in that the mobile terminal system includes at least just like power Benefit require any one of 7 to 9 described in mobile terminal and a server.
CN201910601866.0A 2019-07-05 2019-07-05 Panoramic video image display method, mobile terminal and system based on 5G network Pending CN110278453A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910601866.0A CN110278453A (en) 2019-07-05 2019-07-05 Panoramic video image display method, mobile terminal and system based on 5G network

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910601866.0A CN110278453A (en) 2019-07-05 2019-07-05 Panoramic video image display method, mobile terminal and system based on 5G network

Publications (1)

Publication Number Publication Date
CN110278453A true CN110278453A (en) 2019-09-24

Family

ID=67964033

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910601866.0A Pending CN110278453A (en) 2019-07-05 2019-07-05 Panoramic video image display method, mobile terminal and system based on 5G network

Country Status (1)

Country Link
CN (1) CN110278453A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009188780A (en) * 2008-02-07 2009-08-20 Kuu-Kan Com Inc Video direction system and video direction method
CN206650797U (en) * 2017-04-20 2017-11-17 北方华录文化科技（北京）有限公司 A kind of Panoramic Warping system
CN107896333A (en) * 2017-11-29 2018-04-10 北京未来媒体科技股份有限公司 The method and device that a kind of remote control panoramic video based on intelligent terminal plays
CN108347580A (en) * 2018-03-27 2018-07-31 聚好看科技股份有限公司 A kind of method and electronic equipment of processing video requency frame data
CN108668168A (en) * 2018-05-28 2018-10-16 烽火通信科技股份有限公司 Android VR video players and its design method based on Unity 3D

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009188780A (en) * 2008-02-07 2009-08-20 Kuu-Kan Com Inc Video direction system and video direction method
CN206650797U (en) * 2017-04-20 2017-11-17 北方华录文化科技（北京）有限公司 A kind of Panoramic Warping system
CN107896333A (en) * 2017-11-29 2018-04-10 北京未来媒体科技股份有限公司 The method and device that a kind of remote control panoramic video based on intelligent terminal plays
CN108347580A (en) * 2018-03-27 2018-07-31 聚好看科技股份有限公司 A kind of method and electronic equipment of processing video requency frame data
CN108668168A (en) * 2018-05-28 2018-10-16 烽火通信科技股份有限公司 Android VR video players and its design method based on Unity 3D

Similar Documents

Publication Publication Date Title
US10515485B2 (en) Scanning display system in head-mounted display for virtual reality
CN105610868B (en) A kind of method of information exchange, equipment and system
CN107040794A (en) Video broadcasting method, server, virtual reality device and panoramic virtual reality play system
CN106210861A (en) The method and system of display barrage
CN206650797U (en) A kind of Panoramic Warping system
CN107771395A (en) The method and apparatus for generating and sending the metadata for virtual reality
CN110381254A (en) Image treatment method, VR equipment and system based on 5G network
CN108307182A (en) A kind of network interaction sharing experience system and method based on virtual reality technology
CN110278445A (en) Image treatment method, mobile terminal and system based on 5G network
CN105657438A (en) Method and apparatus for processing panoramic live video resource
US20240161370A1 (en) Methods, apparatus, systems, devices, and computer program products for augmenting reality in connection with real world places
CN113115110B (en) Video synthesis method and device, storage medium and electronic equipment
CN110290409A (en) Data processing method, VR equipment and system
Lee et al. Realistic visual environment for immersive projection display system
CN110286837A (en) Display control method and mobile terminal for digital guide to visitors
CN110278453A (en) Panoramic video image display method, mobile terminal and system based on 5G network
KR20210084248A (en) Method and apparatus for providing a platform for transmitting vr contents
CN110290408A (en) VR equipment, system and display methods based on 5G network
CN113454980A (en) Panorama shooting method, electronic device and storage medium
CN110267026A (en) Data processing method, mobile terminal and system based on 5G network
Song et al. Towards historical sightseeing with an augmented reality interactive documentary app
JP2021510442A (en) Augmented reality image provision method and program using depth data
CN114598824A (en) Method, device and equipment for generating special effect video and storage medium
Starzyk et al. Software laboratory for camera networks research
CN110312165A (en) Display control method and terminal device based on panoramic video image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190924