CN115396741A - Panoramic video playing method and device, electronic equipment and readable storage medium - Google Patents
Panoramic video playing method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN115396741A CN115396741A CN202210910594.4A CN202210910594A CN115396741A CN 115396741 A CN115396741 A CN 115396741A CN 202210910594 A CN202210910594 A CN 202210910594A CN 115396741 A CN115396741 A CN 115396741A
- Authority
- CN
- China
- Prior art keywords
- video
- panoramic video
- panoramic
- playing
- target object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 230000004044 response Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 15
- 238000012545 processing Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 5
- 230000003993 interaction Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Abstract
The embodiment of the disclosure discloses a method and a device for playing a panoramic video, an electronic device and a readable storage medium, wherein the method comprises the following steps: determining a target object when the panoramic video is played; and under the condition that the current video frame of the panoramic video comprises the target object, adjusting a playing window of the panoramic video to a target position so as to display an image area corresponding to the target object in the current video frame.
Description
Technical Field
The present disclosure relates to the field of video processing technologies, and in particular, to a method and an apparatus for playing a panoramic video, an electronic device, and a readable storage medium.
Background
A panoramic video is a video obtained by shooting a scene in 360 degrees in all directions (only a 180-degree range or a 270-degree range may be recorded in some cases) by using a 3D camera, and each video frame in the video is a 360-degree (180-degree or 270-degree) panoramic image.
Generally, when a user watches a panoramic video, the user passively accepts the playing content of the panoramic video, and the user can only see the video content corresponding to one view angle at the same time. If the user wants to watch the panoramic video at other visual angles, the user needs to manually switch the video angle of the video content back and forth, the operation is complex, and the video watching experience of the user is influenced.
Disclosure of Invention
The embodiment of the disclosure aims to provide a method and a device for playing a panoramic video, an electronic device and a readable storage medium.
According to a first aspect of the present disclosure, there is provided a method for playing a panoramic video, the method including:
determining a target object when the panoramic video is played;
and under the condition that the target object is included in the current video frame of the panoramic video, adjusting a playing window of the panoramic video to a target position so as to display an image area corresponding to the target object in the current video frame.
Optionally, after determining the target object while playing the panoramic video, the method further includes:
and under the condition that the target object is not included in the current video frame of the panoramic video, controlling the playing window of the panoramic video to be kept at the current position, wherein the current position is the position of the playing window when the last video frame of the panoramic video is played.
Optionally, the determining a target object while playing the panoramic video includes:
displaying an object list of a panoramic video while the panoramic video is played, wherein the object list comprises at least one video object in the panoramic video;
receiving a first input of the object list from a user;
in response to the first input, the target object is determined from the at least one video object.
Optionally, before determining the target object while playing the panoramic video, the method further includes:
identifying at least one video object in each video frame of the panoramic video;
and generating and storing an object list according to the identification information of each video object in the at least one video object.
Optionally, the adjusting the playing window of the panoramic video to a target position to display an image area corresponding to the target object in the current video frame includes:
determining object information of a video object corresponding to the current timestamp according to the current timestamp of the current video frame and the incidence relation between the timestamp of the video frame where the video object is located and the object information of the video object;
determining position information of the target object in the current video frame, which is matched with the identification information of the target object, from object information of the video object corresponding to the current timestamp;
and adjusting a playing window of the panoramic video to a target position according to the position information of the target object in the current video frame so as to display an image area corresponding to the target object in the current video frame.
Optionally, before determining the target object while playing the panoramic video, the method further includes:
identifying a video object in each video frame of the panoramic video;
acquiring object information of the video object, wherein the object information comprises identification information of the video object and position information of the video object in a corresponding video frame;
and establishing an association relation between the timestamp of the video frame where the video object is located and the object information.
Optionally, after the association relationship between the timestamp of the video frame where the video object is located and the object information is established, the method further includes:
and storing the association relation between the timestamp of the video frame where the video object is positioned and the object information.
According to a second aspect of the present disclosure, there is provided a playback apparatus of a panoramic video, the apparatus including:
the determining module is used for determining a target object when the panoramic video is played;
and the adjusting module is used for adjusting the playing window of the panoramic video to a target position under the condition that the current video frame of the panoramic video comprises the target object so as to display an image area corresponding to the target object in the current video frame.
According to a third aspect of the present disclosure, there is provided an electronic device comprising:
a memory for storing executable computer instructions;
a processor for executing the method for playing panoramic video according to the first aspect of the present disclosure, according to the control of the executable computer instructions.
According to a fourth aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon computer instructions which, when executed by a processor, perform the method for playing a panoramic video according to the first aspect of the present disclosure.
According to the embodiment of the disclosure, when the panoramic video is played, the target object which is interested by the user is determined, so that under the condition that the target object is included in the current video frame of the panoramic video, the playing window of the panoramic video is adjusted to the target position, and the image area corresponding to the target object in the current video frame is displayed. Therefore, the embodiment can realize the identification of the video object in the panoramic video, and can automatically adjust the position of the playing window according to the content which is interested by the user in the process of playing the panoramic video, thereby realizing the interaction between the user and the video content. Moreover, according to the method and the device, the position of the playing window of the panoramic video can be automatically adjusted according to the target object selected by the user, manual operation of the user is not needed, and video watching experience of the user can be further improved.
Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings needed to be used in the embodiments will be briefly described below. It is appreciated that the following drawings depict only certain embodiments of the invention and are therefore not to be considered limiting of its scope. For a person skilled in the art, it is possible to derive other relevant figures from these figures without inventive effort.
Fig. 1 is a hardware configuration diagram of an electronic device that can be used to implement a playback method of a panoramic video of an embodiment;
FIG. 2 is a flow diagram illustrating a method for playing panoramic video, according to one embodiment;
fig. 3 is a flowchart illustrating a method of playing a panoramic video according to an example;
fig. 4 is a schematic hardware configuration diagram of a playing apparatus of a panoramic video according to an embodiment;
FIG. 5 is a hardware architecture diagram of an electronic device according to one embodiment.
Detailed Description
Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as exemplary only and not as limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
< hardware configuration >
Fig. 1 is a hardware configuration diagram of an electronic device that can be used to implement a playback method of a panoramic video of an embodiment.
As shown in fig. 1, the electronic device 1000 may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a microphone 1700, and a speaker 1800. The processor 1100 may include, but is not limited to, a central processing unit CPU, a microprocessor MCU, or the like. The memory 1200 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface device 1300 includes, for example, various bus interfaces such as a serial bus interface (including a USB interface), a parallel bus interface, and the like. Communication device 1400 is capable of wired or wireless communication, for example. The display device 1500 is, for example, a liquid crystal display, an LED display, a touch display, or the like. The input device 1600 includes, for example, a touch screen, a keyboard, a handle, and the like. The microphone 1700 may be used for inputting voice information. The speaker 1800 may be used to output voice information.
The electronic device 1000 may be, for example, a mobile phone, a laptop, a tablet computer, a palmtop computer, and the like, the electronic device 1000 may also be, for example, a VR (Virtual Reality) device, an AR (Augmented Reality) device, an MR (Mixed Reality) device, and the like, the electronic device 1000 may also be, for example, a server, and the embodiment of the present disclosure does not limit this.
In this embodiment, the memory 1200 of the electronic device 1000 is configured to store instructions for controlling the processor 1100 to operate so as to implement or support implementation of the playback method of panoramic video according to any of the embodiments. The skilled person can design the instructions according to the solution disclosed in the present specification. How the instructions control the operation of the processor is well known in the art and will not be described in detail herein.
It should be understood by those skilled in the art that although a plurality of devices of the electronic apparatus 1000 are illustrated in fig. 1, the electronic apparatus 1000 of the embodiment of the present specification may refer to only some of the devices, and may also include other devices, which are not limited herein.
The electronic device 1000 shown in fig. 1 is merely illustrative and is in no way intended to limit the description, its applications, or uses.
Various embodiments and examples according to the present disclosure are described below with reference to the drawings.
< method examples >
Please refer to fig. 2, which is a flowchart illustrating a method for playing a panoramic video according to an embodiment of the present disclosure. The method for playing the panoramic video is implemented by the electronic device 1000 shown in fig. 1, and as shown in fig. 2, the method for playing the panoramic video may include the following steps S2100 to S2200.
In step S2100, when the panoramic video is played, a target object is determined.
In this embodiment, the panoramic video may be a 360-degree video captured by a panoramic camera, or may be a 180-degree video captured by a panoramic camera. Alternatively, the resolution of the panoramic video may be 8K resolution, i.e., 7680 pixels in length and 3840 pixels in width.
The panoramic video can be played through an electronic device specially used for playing the panoramic video. Such as a mobile phone, a laptop, a tablet, a palmtop, a VR device, an AR device, and an MR device. The panoramic video may be played using a Field of View (FOV) mode. More specifically, the panoramic video is divided into a plurality of viewing angles, and a user can select a certain viewing angle to view, and the user can view video content of the viewing angle. Illustratively, when a panoramic video is played in a FOV manner, a user can only see the video content within a playing window (i.e., view Port), i.e., view a portion of the panoramic video. The screen content in the playback window is displayed at a high resolution, and the screen content around the playback window is displayed at a low resolution. Therefore, the transmission code rate of the panoramic video can be reduced, the bandwidth requirement for watching the VR video is greatly reduced, and the effective utilization rate of the bandwidth is improved.
The target object may be a video object of interest to a user in the panoramic video. The target object may be a person, an animal, an object, or the like. For example, for a video of a ball game, the target object may be a certain player that the user likes. For example, the target object may be a living being that the user is looking at.
In one embodiment, the step of determining the target object when playing the panoramic video may further include: step S3100 to step S3300.
Step S3100, when a panoramic video is played, displaying an object list of the panoramic video, wherein the object list comprises at least one video object in the panoramic video.
In the present embodiment, the object list may be a list of all video objects included in the panoramic video. Illustratively, the object list may be a list of identification information of all video objects included in the panoramic video. The identification information may be the name, number, etc. of the video object.
Step S3200, receiving a first input to the object list by a user.
The first input may be an input to select a target object. For example, the first input may be a click input of a user on a certain video object in the object list, or a click input on a target control, or a specific gesture input by the user, which may be determined according to actual usage requirements, and is not limited in this embodiment of the present application. The specific gesture in the embodiment of the application can be any one of a single-click gesture, a sliding gesture and a dragging gesture; the click input in the embodiment of the application can be click input, double-click input, click input of any number of times and the like, and can also be long-time press input or short-time press input.
Step S3300, in response to the first input, determining the target object from the at least one video object.
In this embodiment, the user may select the target object according to a preference, so that when the panoramic video is played, the playing window is automatically moved to the content that the user is interested in, thereby implementing the interaction between the user and the panoramic video.
In one embodiment, before determining the target object while playing the panoramic video, the method may further include: identifying at least one video object in each video frame of the panoramic video; and generating and storing an object list according to the identification information of each video object in the at least one video object.
The identification information may be the name, number, etc. of the video object. For example, for a video of a ball game, the video object may be a player and the identification information for the video object may be a player name. For example, for a product display video, the video object may be a different product and the identification information of the video object may be a product name.
In this embodiment, before the panoramic video is played, all video objects in the panoramic video can be identified, and an object list is established, so that a user can conveniently select an interested video object when watching the panoramic video, and then the panoramic video is displayed according to the interested video object of the user, and the video watching experience of the user can be improved.
In one embodiment, before determining the target object while playing the panoramic video, the method may further include: step S4100 to step S4300.
Step S4100, identifying a video object in each video frame of the panoramic video.
When the panoramic video is played, that is, when each video frame of the panoramic video is played, the playing window needs to be moved to the image area where the target object which is interested by the user is located. Based on this, for each video frame of the panoramic video, identification of the video object needs to be performed.
Step S4200, obtaining object information of the video object, where the object information includes identification information of the video object and location information of the video object in a corresponding video frame.
The identification information may be the name, number, etc. of the video object. For example, for a video of a ball game, the video object may be a player and the identification information for the video object may be a player name. For example, for a product display video, the video object may be a different product and the identification information of the video object may be a product name.
The position information of the video object in the corresponding video frame may be position information of an image area in the video frame where the video object is located. In particular implementations, a rectangular frame may be used to locate a video object of a video frame, and the location information of the video object may be coordinate information of four vertices of the rectangular frame. The object information of the video object may be expressed as, identification information of the target object: left _ Top _ Right _ Bottom. For example, target object a:201_122_300_180.
Step S4300, establish the association relation between the timestamp of the video frame where the video object is located and the object information.
When the panoramic video is played, that is, when each video frame of the panoramic video is played, the playing window needs to be moved to an image area where a target object which is interested by a user is located. Based on the above, after the video object included in each video frame of the panoramic video is identified, the object information of the video object is established to be associated with the timestamp of the video frame, so that when the video frame is played, the object information of the video object is searched according to the association between the object information of the video object and the timestamp of the video frame corresponding to the video object.
In specific implementation, a video object in each video frame of the panoramic video is identified, identification information of the video object and position information of the video object in the corresponding video frame are acquired, then, an association relationship between object information of the video object and a timestamp of the video frame corresponding to the video object is established, and the identification information of the video object in the object information corresponds to the position information of the video object in the corresponding video frame one to one. And then generating object information of all video objects in the panoramic video, wherein the object information of all the video objects is arranged according to the playing time of the panoramic video, namely the object information of all the video objects is arranged according to the time stamp of each video frame of the panoramic video.
In one embodiment, after establishing the association relationship between the timestamp of the video frame where the video object is located and the object information, the method may further include: and storing the association relation between the timestamp of the video frame where the video object is located and the object information.
In this embodiment, before the panoramic video is played, all video objects in the panoramic video may be identified, object information of each video object may be acquired, and an association relationship between a timestamp of a video frame where the video object is located and the object information may be established, so that when each video frame of the panoramic video is played, object information of a target object is determined according to the timestamp of the video frame, position information of the target object in a corresponding video frame is determined, and a playing window is moved to an image area where the target object is located. Therefore, the panoramic video can be displayed according to the video object which is interested by the user, and the video watching experience of the user can be improved.
After step S2100, step S2200 is executed to adjust a play window of the panoramic video to a target position to display an image area corresponding to the target object in the current video frame if the target object is included in the current video frame of the panoramic video.
Illustratively, the position of the play window may be initialized before the playback of the panoramic video begins. For example, the play window is controlled to move to the central area of the panoramic video. And then, adjusting the position of the playing window according to the target object selected by the user so as to enable the video picture watched by the user to be always positioned at the target object.
In one embodiment, the step of adjusting the playing window of the panoramic video to a target position to display an image area corresponding to the target object in the current video frame may further include: step S5100 to step S5300.
Step S5100, determine object information of the video object corresponding to the current timestamp according to the association between the current timestamp of the current video frame and the timestamp of the video frame where the video object is located and the object information of the video object.
Step S5200, determining, from object information of a video object corresponding to the current timestamp, position information of the target object in the current video frame, where the position information of the target object matches the identification information of the target object;
step S5300, adjusting a playing window of the panoramic video to a target position according to the position information of the target object in the current video frame, so as to display an image area corresponding to the target object in the current video frame.
In this embodiment, according to the position information of the target object in the corresponding video frame, the playing window can be quickly moved to the image area where the target object is located, and then in the process of playing the panoramic video, the video picture is quickly switched to the content which is interested by the user, so that the video watching experience of the user can be improved.
In one embodiment, after determining the target object while playing the panoramic video, the method may further include: and under the condition that the target object is not included in the current video frame of the panoramic video, controlling a playing window of the panoramic video to be kept at a current position, wherein the current position is the position of the playing window when the last video frame of the panoramic video is played.
In this embodiment, under the condition that the current video frame of the panoramic video does not include the target object, the playing window of the panoramic video is controlled to remain unchanged, so that the smoothness of playing the panoramic video can be ensured, and the video watching experience is further improved.
The following describes a method for playing a panoramic video by using a specific example. Referring to fig. 3, the method for playing the panoramic video includes the following steps.
Step S601, when the panoramic video is played in the FOV mode, displaying an object list;
step S602, responding to a first input of the user to the object list, and determining a target object in which the user is interested;
step S603, TOP information of the panoramic video is obtained, wherein the TOP information comprises object information of each video object in the panoramic video and timestamp associated data of a video frame where the video object is located;
step S604, judging whether a target object exists in the current video frame according to the TOP information and the timestamp of the current video frame, if so, executing step S605, otherwise, executing step S607;
step S605, determining the position information of the target object in the current video frame according to the TOP information and the time stamp of the current video frame;
step S606, adjusting the playing window of the panoramic video to a target position to display an image area corresponding to the target object in the current video frame;
step S607, playing the next video frame of the panoramic video;
and step S608, judging whether the playing of the panoramic video is finished, if so, finishing the process, otherwise, returning to the step S604.
According to the embodiment of the disclosure, when the panoramic video is played, the target object which is interested by the user is determined, so that under the condition that the target object is included in the current video frame of the panoramic video, the playing window of the panoramic video is adjusted to the target position, and the image area corresponding to the target object in the current video frame is displayed. Therefore, the embodiment can realize the identification of the video object in the panoramic video, and can automatically adjust the position of the playing window according to the content which is interested by the user in the process of playing the panoramic video, thereby realizing the interaction between the user and the video content. Moreover, according to the method and the device, the position of the playing window of the panoramic video can be automatically adjusted according to the target object selected by the user, manual operation of the user is not needed, and video watching experience of the user can be further improved.
< apparatus embodiment >
Referring to fig. 4, an embodiment of the present disclosure provides a device for playing a panoramic video, and as shown in fig. 4, the device 400 for playing a panoramic video may include a determining module 410 and an adjusting module 420.
The determination module 410 may be configured to determine a target object when playing a panoramic video.
The adjusting module 420 may be configured to, in a case that the target object is included in a current video frame of the panoramic video, adjust a playing window of the panoramic video to a target position, so as to display an image area corresponding to the target object in the current video frame.
In one embodiment, the apparatus 400 for playing panoramic video may further include:
and the control module is used for controlling a playing window of the panoramic video to be kept at a current position under the condition that the current video frame of the panoramic video does not comprise the target object, wherein the current position is the position of the playing window when the last video frame of the panoramic video is played.
In one embodiment, the determining module 410 may include:
the display unit is used for displaying an object list of the panoramic video when the panoramic video is played, wherein the object list comprises at least one video object in the panoramic video;
the receiving unit is used for receiving a first input of a user to the object list;
a first determination unit for determining the target object from the at least one video object in response to the first input.
In one embodiment, the apparatus 400 for playing panoramic video may further include:
a first identification module to identify at least one video object in each video frame of the panoramic video;
and the generating module is used for generating and storing an object list according to the identification information of each video object in the at least one video object.
In one embodiment, the adjustment module 420 may include:
the second determining unit is used for determining the object information of the video object corresponding to the current timestamp according to the current timestamp of the current video frame and the incidence relation between the timestamp of the video frame where the video object is located and the object information of the video object;
a third determining unit, configured to determine, from object information of a video object corresponding to the current timestamp, position information of the target object in the current video frame, where the position information of the target object matches identification information of the target object;
and the adjusting unit is used for adjusting the playing window of the panoramic video to a target position according to the position information of the target object in the current video frame so as to display an image area corresponding to the target object in the current video frame.
In one embodiment, the apparatus 400 for playing panoramic video may further include:
a second identification module for identifying a video object in each video frame of the panoramic video;
the acquisition module is used for acquiring object information of the video object, wherein the object information comprises identification information of the video object and position information of the video object in a corresponding video frame;
and the establishing module is used for establishing the association relation between the timestamp of the video frame where the video object is located and the object information.
In one embodiment, the apparatus 400 for playing panoramic video may further include:
and the storage module is used for storing the association relation between the timestamp of the video frame where the video object is located and the object information.
According to the embodiment of the disclosure, when the panoramic video is played, the target object which is interested by the user is determined, so that under the condition that the target object is included in the current video frame of the panoramic video, the playing window of the panoramic video is adjusted to the target position, and the image area corresponding to the target object in the current video frame is displayed. Therefore, the embodiment can realize the identification of the video object in the panoramic video, and can automatically adjust the position of the playing window according to the content which is interested by the user in the process of playing the panoramic video, thereby realizing the interaction between the user and the video content. Moreover, according to the method and the device, the position of the playing window of the panoramic video can be automatically adjusted according to the target object selected by the user, manual operation of the user is not needed, and video watching experience of the user can be further improved.
< apparatus embodiment >
Referring to fig. 5, an embodiment of the present disclosure further provides an electronic device. As shown in fig. 5, the electronic device 500 includes a memory 510 and a processor 520.
The memory 510 may be used to store executable computer instructions.
The processor 520 may be configured to execute the method for playing panoramic video according to the embodiment of the present disclosure, according to the control of the executable computer instructions.
The electronic device 500 may be the electronic device 1000 shown in fig. 1, or may be a device having another hardware structure, which is not limited herein. The electronic device 500 may be, for example, a mobile phone, a laptop, a tablet computer, a palmtop computer, and the like, the electronic device 500 may also be, for example, a VR device, an AR device, an MR device, and the like, the electronic device 500 may also be, for example, a server, and the embodiment of the present disclosure is not limited thereto.
In further embodiments, the electronic device 500 may include the above playback apparatus 400 for panoramic video.
In one embodiment, the modules of the above panoramic video playback device 400 may be implemented by the processor 520 executing computer instructions stored in the memory 510.
According to the embodiment of the disclosure, when the panoramic video is played, the target object which is interested by the user is determined, so that under the condition that the target object is included in the current video frame of the panoramic video, the playing window of the panoramic video is adjusted to the target position, and the image area corresponding to the target object in the current video frame is displayed. Therefore, the embodiment can realize the identification of the video object in the panoramic video, and can automatically adjust the position of the playing window according to the content which is interested by the user in the process of playing the panoramic video, thereby realizing the interaction between the user and the video content. Moreover, the position of the playing window of the panoramic video can be automatically adjusted according to the target object selected by the user, manual operation of the user is not needed, and video watching experience of the user can be further improved.
< media examples >
In this embodiment, a computer-readable storage medium is further provided, where computer instructions readable and executable by a computer are stored, and when executed by a processor, the computer instructions perform the playing method of the panoramic video according to the foregoing embodiment.
The embodiments in the present disclosure are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments, but it should be clear to those skilled in the art that the embodiments described above can be used alone or in combination with each other as needed. In addition, for the device embodiment, since it corresponds to the method embodiment, the description is relatively simple, and for relevant points, reference may be made to the description of the corresponding parts of the method embodiment. The system embodiments described above are merely illustrative, in that modules illustrated as separate components may or may not be physically separate.
The present invention may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therewith for causing a processor to implement various aspects of the present invention.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
Computer program instructions for carrying out operations of the present invention may be assembler instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "like" programming languages, or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing an electronic circuit, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA), with state information of computer-readable program instructions, which can execute the computer-readable program instructions.
Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.
Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.
Claims (10)
1. A method for playing a panoramic video, the method comprising:
determining a target object when the panoramic video is played;
and under the condition that the target object is included in the current video frame of the panoramic video, adjusting a playing window of the panoramic video to a target position so as to display an image area corresponding to the target object in the current video frame.
2. The method of claim 1, wherein after determining the target object while playing the panoramic video, the method further comprises:
and under the condition that the target object is not included in the current video frame of the panoramic video, controlling a playing window of the panoramic video to be kept at a current position, wherein the current position is the position of the playing window when the last video frame of the panoramic video is played.
3. The method of claim 1, wherein determining the target object when playing the panoramic video comprises:
displaying an object list of a panoramic video while the panoramic video is played, wherein the object list comprises at least one video object in the panoramic video;
receiving a first input of the object list from a user;
in response to the first input, the target object is determined from the at least one video object.
4. The method of claim 1, wherein before determining the target object while playing the panoramic video, the method further comprises:
identifying at least one video object in each video frame of the panoramic video;
and generating and storing an object list according to the identification information of each video object in the at least one video object.
5. The method of claim 1, wherein the adjusting the playing window of the panoramic video to a target position to display an image area corresponding to the target object in the current video frame comprises:
determining object information of a video object corresponding to the current timestamp according to the current timestamp of the current video frame and the incidence relation between the timestamp of the video frame where the video object is located and the object information of the video object;
determining position information of the target object in the current video frame, which is matched with the identification information of the target object, from object information of the video object corresponding to the current timestamp;
and adjusting a playing window of the panoramic video to a target position according to the position information of the target object in the current video frame so as to display an image area corresponding to the target object in the current video frame.
6. The method of claim 1, wherein before determining the target object while playing the panoramic video, the method further comprises:
identifying a video object in each video frame of the panoramic video;
acquiring object information of the video object, wherein the object information comprises identification information of the video object and position information of the video object in a corresponding video frame;
and establishing an association relation between the timestamp of the video frame where the video object is located and the object information.
7. The method according to claim 6, wherein after the association relationship between the timestamp of the video frame where the video object is located and the object information is established, the method further comprises:
and storing the association relation between the timestamp of the video frame where the video object is positioned and the object information.
8. An apparatus for playing a panoramic video, the apparatus comprising:
the determining module is used for determining a target object when the panoramic video is played;
and the adjusting module is used for adjusting the playing window of the panoramic video to a target position under the condition that the current video frame of the panoramic video comprises the target object so as to display an image area corresponding to the target object in the current video frame.
9. An electronic device, comprising:
a memory for storing executable computer instructions;
a processor for executing the method of playing panoramic video according to any one of claims 1 to 7, according to the control of the executable computer instructions.
10. A computer-readable storage medium, wherein the computer-readable storage medium has computer instructions stored thereon, and when executed by a processor, the computer instructions perform the method for playing panoramic video according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210910594.4A CN115396741A (en) | 2022-07-29 | 2022-07-29 | Panoramic video playing method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210910594.4A CN115396741A (en) | 2022-07-29 | 2022-07-29 | Panoramic video playing method and device, electronic equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115396741A true CN115396741A (en) | 2022-11-25 |
Family
ID=84118208
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210910594.4A Pending CN115396741A (en) | 2022-07-29 | 2022-07-29 | Panoramic video playing method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115396741A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116546239A (en) * | 2023-04-11 | 2023-08-04 | 央视国际网络有限公司 | Video processing method, apparatus and computer readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105843541A (en) * | 2016-03-22 | 2016-08-10 | 乐视网信息技术（北京）股份有限公司 | Target tracking and displaying method and device in panoramic video |
| CN106961597A (en) * | 2017-03-14 | 2017-07-18 | 深圳Tcl新技术有限公司 | The target tracking display methods and device of panoramic video |
| CN110324641A (en) * | 2019-07-12 | 2019-10-11 | 青岛一舍科技有限公司 | The method and device of targets of interest moment display is kept in panoramic video |
| CN114727022A (en) * | 2015-10-29 | 2022-07-08 | 微软技术许可有限责任公司 | Tracking objects of interest in omnidirectional video |
-
2022
- 2022-07-29 CN CN202210910594.4A patent/CN115396741A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114727022A (en) * | 2015-10-29 | 2022-07-08 | 微软技术许可有限责任公司 | Tracking objects of interest in omnidirectional video |
| CN105843541A (en) * | 2016-03-22 | 2016-08-10 | 乐视网信息技术（北京）股份有限公司 | Target tracking and displaying method and device in panoramic video |
| CN106961597A (en) * | 2017-03-14 | 2017-07-18 | 深圳Tcl新技术有限公司 | The target tracking display methods and device of panoramic video |
| CN110324641A (en) * | 2019-07-12 | 2019-10-11 | 青岛一舍科技有限公司 | The method and device of targets of interest moment display is kept in panoramic video |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116546239A (en) * | 2023-04-11 | 2023-08-04 | 央视国际网络有限公司 | Video processing method, apparatus and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110636353B (en) | Display device | |
| CN106210861B (en) | Method and system for displaying bullet screen | |
| JP6165846B2 (en) | Selective enhancement of parts of the display based on eye tracking | |
| CN108260020B (en) | Method and device for displaying interactive information in panoramic video | |
| CN107948708B (en) | Bullet screen display method and device | |
| KR20220130197A (en) | Filming method, apparatus, electronic equipment and storage medium | |
| US20190222748A1 (en) | Multi-camera navigation interface | |
| CN112243583A (en) | Multi-endpoint mixed reality conference | |
| EP3534616A1 (en) | Method, device and system for playing 360 degree panoramic video | |
| CN108986117B (en) | Video image segmentation method and device | |
| US20230283832A1 (en) | Communication exchange system for remotely communicating instructions | |
| US20180249075A1 (en) | Display method and electronic device | |
| US20240119082A1 (en) | Method, apparatus, device, readable storage medium and product for media content processing | |
| CN111078011A (en) | Gesture control method and device, computer readable storage medium and electronic equipment | |
| CN108174269B (en) | Visual audio playing method and device | |
| CN110740261A (en) | Video recording method, device, terminal and storage medium | |
| US20190286303A1 (en) | Generating display regions in a display screen for multi-directional viewing | |
| CN110673811B (en) | Panoramic picture display method and device based on sound information positioning and storage medium | |
| CN115396741A (en) | Panoramic video playing method and device, electronic equipment and readable storage medium | |
| CN107197339B (en) | Display control method and device of film bullet screen and head-mounted display equipment | |
| CN109636917B (en) | Three-dimensional model generation method, device and hardware device | |
| CN111354444A (en) | Pathological section image display method and device, electronic equipment and storage medium | |
| TWI514319B (en) | Methods and systems for editing data using virtual objects, and related computer program products | |
| CN115617166A (en) | Interaction control method and device and electronic equipment | |
| CN115599206A (en) | Display control method, display control device, head-mounted display equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |