CN115396740B - Panoramic video playing method and device, electronic equipment and readable storage medium - Google Patents
Panoramic video playing method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN115396740B CN115396740B CN202210910618.6A CN202210910618A CN115396740B CN 115396740 B CN115396740 B CN 115396740B CN 202210910618 A CN202210910618 A CN 202210910618A CN 115396740 B CN115396740 B CN 115396740B
- Authority
- CN
- China
- Prior art keywords
- panoramic video
- playing
- playing window
- window
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 230000008569 process Effects 0.000 claims abstract description 25
- 238000012545 processing Methods 0.000 claims description 11
- 238000010586 diagram Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 5
- 230000006399 behavior Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 241000023320 Luma <angiosperm> Species 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the disclosure discloses a panoramic video playing method, a device, an electronic device and a readable storage medium, wherein the method comprises the following steps: in the process of playing the panoramic video, adjusting the position of a playing window of the panoramic video according to preset movement parameters, wherein the movement parameters at least comprise a first movement direction and a movement speed; under the condition that an adjustment instruction of a playing window input by a user is received, updating the first moving direction into a second moving direction according to the adjustment instruction, and continuously playing the panoramic video according to the second moving direction and the moving speed.
Description
Technical Field
The embodiment of the disclosure relates to the technical field of video processing, and more particularly relates to a panoramic video playing method, a panoramic video playing device, electronic equipment and a readable storage medium.
Background
Panoramic video is a video obtained by shooting a scene in 360 degrees (only a range of 180 degrees or a range of 270 degrees can be recorded in some cases) in an omnibearing manner by using a 3D camera, and each video frame in the video is a panoramic image of 360 degrees (180 degrees or 270 degrees).
In general, when a user views a panoramic video, the user passively accepts the played content of the panoramic video, and the user can only see the video content corresponding to one viewing angle at the same time. If the user wants to watch the panoramic video at other viewing angles, the user is required to manually switch the video angle of the video content back and forth, the operation is complex, and the video watching experience of the user is affected.
Disclosure of Invention
An object of an embodiment of the disclosure is to provide a method, a device, an electronic device and a readable storage medium for playing panoramic video.
According to a first aspect of the present disclosure, there is provided a method for playing panoramic video, the method comprising:
in the process of playing the panoramic video, adjusting the position of a playing window of the panoramic video according to preset movement parameters, wherein the movement parameters at least comprise a first movement direction and a movement speed;
under the condition that an adjustment instruction of a playing window input by a user is received, updating the first moving direction into a second moving direction according to the adjustment instruction, and continuously playing the panoramic video according to the second moving direction and the moving speed.
Optionally, after the adjusting the position of the playing window of the panoramic video according to the preset movement parameter, the method further includes:
and under the condition that a moving object exists in the image area corresponding to the playing window, acquiring the current position corresponding to the playing window, and controlling the playing window to be kept at the current position within a set time.
Optionally, the adjusting the position of the playing window of the panoramic video according to the preset movement parameter includes:
and under the condition that no moving object exists in the image area corresponding to the playing window, adjusting the position of the playing window of the panoramic video according to a preset moving parameter.
Optionally, the method further comprises:
acquiring a first image and a second image, wherein the first image is an image area corresponding to the playing window in a current video frame of the panoramic video, and the second image is an image area corresponding to the playing window in a previous video frame of the panoramic video;
and determining whether a moving object exists in an image area corresponding to the playing window according to the first image and the second image.
Optionally, the determining, according to the first image and the second image, whether the image area corresponding to the playing window has a moving object includes:
acquiring first pixel information of the first image;
acquiring second pixel information of the second image;
determining the difference amount of the pixel information according to the first pixel information and the second pixel information;
and under the condition that the difference amount of the pixel information is larger than or equal to a preset threshold value, determining that a moving object exists in the image area corresponding to the playing window.
Optionally, under the condition that an adjustment instruction of a playing window input by a user is received, updating the first moving direction to a second moving direction according to the adjustment instruction includes:
under the condition that an adjustment instruction of a playing window input by a user is received, adjusting the position of the playing window according to the adjustment instruction, and acquiring first position information and second position information of the playing window before and after adjustment;
and determining a second moving direction according to the first position information and the second position information.
According to a second aspect of the present disclosure, there is provided a playback apparatus for panoramic video, the apparatus comprising:
the panoramic video processing device comprises a first control module, a second control module and a third control module, wherein the first control module is used for adjusting the position of a playing window of the panoramic video according to preset moving parameters in the process of playing the panoramic video, and the moving parameters at least comprise a first moving direction and a moving speed;
and the updating module is used for updating the first moving direction into a second moving direction according to the adjusting instruction under the condition that the adjusting instruction of the playing window input by the user is received, so as to continuously play the panoramic video according to the second moving direction and the moving speed.
Optionally, the apparatus further comprises:
the second control module is used for acquiring the current position corresponding to the playing window and controlling the playing window to be kept at the current position in a set time under the condition that a moving object exists in an image area corresponding to the playing window.
According to a third aspect of the present disclosure, there is provided an electronic device comprising:
a memory for storing executable computer instructions;
and the processor is used for executing the panoramic video playing method according to the first aspect of the disclosure according to the control of the executable computer instructions.
According to a fourth aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon computer instructions which, when executed by a processor, perform a method of playing panoramic video according to the first aspect of the present disclosure.
According to the embodiment of the disclosure, in the process of playing the panoramic video, the position of the playing window of the panoramic video can be adjusted according to the first moving direction and the moving speed, so that in the process of playing the panoramic video, the position of the playing window can be automatically adjusted, the panoramic video is displayed at the optimal viewing angle, and the playing effect of the panoramic video can be improved. Moreover, under the condition that an adjustment instruction of a playing window input by a user is received, the first moving direction is updated to be the second moving direction according to the adjustment instruction, so that panoramic video is continuously played according to the second moving direction and the moving speed, and therefore the moving direction of the playing window adjusted by the user can be automatically learned, and further the movement of the playing window is controlled according to the second moving direction adjusted by the user, the playing mode of the panoramic video is enabled to be more matched with the watching behavior of the user, and the watching experience of the panoramic video can be improved.
Other features of the present application and its advantages will become apparent from the following detailed description of exemplary embodiments of the application, which proceeds with reference to the accompanying drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings that are required to be used in the embodiments will be briefly described below. It is appreciated that the following drawings depict only certain embodiments of the application and are therefore not to be considered limiting of its scope. Other relevant drawings may be made by those of ordinary skill in the art without undue burden from these drawings.
Fig. 1 is a schematic diagram of a hardware configuration of an electronic device that may be used to implement a method of playing panoramic video of one embodiment;
FIG. 2 is a flow diagram of a method of playing panoramic video according to one embodiment;
FIG. 3 is a flow chart of a method of playing panoramic video according to one example;
fig. 4 is a schematic hardware configuration of a playback apparatus for panoramic video according to one embodiment;
fig. 5 is a schematic diagram of a hardware architecture of an electronic device according to one embodiment.
Detailed Description
Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present application unless it is specifically stated otherwise.
The following description of at least one exemplary embodiment is merely exemplary in nature and is in no way intended to limit the application, its application, or uses.
Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any specific values should be construed as merely illustrative, and not a limitation. Thus, other examples of exemplary embodiments may have different values.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further discussion thereof is necessary in subsequent figures.
< hardware configuration >
Fig. 1 is a schematic diagram of a hardware configuration of an electronic device that may be used to implement a method of playing panoramic video of one embodiment.
As shown in fig. 1, the electronic device 1000 may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a microphone 1700, and a speaker 1800. The processor 1100 may include, but is not limited to, a central processing unit CPU, a microprocessor MCU, etc. The memory 1200 includes, for example, ROM (read only memory), RAM (random access memory), nonvolatile memory such as a hard disk, and the like. The interface device 1300 includes, for example, various bus interfaces such as a serial bus interface (including a USB interface), a parallel bus interface, and the like. The communication device 1400 can perform wired or wireless communication, for example. The display device 1500 is, for example, a liquid crystal display, an LED display, a touch display, or the like. The input device 1600 includes, for example, a touch screen, keyboard, handle, etc. Microphone 1700 may be used to input voice information. Speaker 1800 may be used to output voice information.
The electronic device 1000 may be, for example, a mobile phone, a portable computer, a tablet computer, a palm computer, etc., and the electronic device 1000 may also be, for example, a VR (Virtual Reality) device, an AR (augmented Reality) device, an MR (Mixed Reality) device, etc., and the electronic device 1000 may also be, for example, a server, which is not limited in the embodiments of the present disclosure.
In this embodiment, the memory 1200 of the electronic device 1000 is used for storing instructions for controlling the processor 1100 to operate to implement or support implementing the method for playing panoramic video according to any of the embodiments. The skilled person can design instructions according to the solution disclosed in the present specification. How the instructions control the processor to operate is well known in the art and will not be described in detail here.
It should be understood by those skilled in the art that, although a plurality of devices of the electronic apparatus 1000 are shown in fig. 1, the electronic apparatus 1000 of the embodiment of the present disclosure may refer to only some of the devices, may further include other devices, and is not limited herein.
The electronic device 1000 shown in fig. 1 is merely illustrative and is in no way intended to limit the specification, its application, or uses.
Various embodiments and examples according to the present disclosure are described below with reference to the accompanying drawings.
< method example >
Fig. 2 is a flowchart of a panoramic video playing method according to an embodiment of the disclosure. The method for playing the panoramic video is implemented by the electronic device 1000 shown in fig. 1, and as shown in fig. 2, the method for playing the panoramic video may include the following steps S2100 to S2200.
In step S2100, during playing the panoramic video, the position of the playing window of the panoramic video is adjusted according to a preset movement parameter, where the movement parameter at least includes a first movement direction and a movement speed.
In this embodiment, the panoramic video may be 360-degree video captured by a panoramic camera, or may be 180-degree video captured by a panoramic camera. Alternatively, the resolution of the panoramic video may be 8K resolution, i.e., 7680 pixels in length and 3840 pixels in width. The panoramic video may be, for example, a landscape-type video.
The panoramic video may be played by an electronic device dedicated to playing the panoramic video. Such as cell phones, laptops, tablet computers, palm computers, VR devices, AR devices, MR devices, etc. The panoramic video may be played using a Field of View (FOV) mode. More specifically, the panoramic video is divided into a plurality of viewing angles, and a user can select a viewing angle to view, and the user can view video contents of the viewing angle. Illustratively, when playing panoramic video in FOV, the user can only see the video content within the play window (i.e., view Port), i.e., view a portion of the panoramic video. The screen contents in the playback window are displayed at a high resolution, and the screen contents around the playback window are displayed at a low resolution. Therefore, the transmission code rate of the panoramic video can be reduced, the bandwidth requirement for watching VR video is greatly reduced, and the effective utilization rate of the bandwidth is improved.
The first moving direction may be a moving direction of a play window when the panoramic video is played. It should be understood herein that the first moving direction may be set according to actual needs, for example, the first moving direction is to the right side of the playing interface, which is not limited in the embodiment of the present application.
The moving speed may be a unit moving angle of the play window when the panoramic video is played. It will be appreciated that the first moving direction may be set according to actual needs, for example, the moving speed is 1 degree/second, which is not limited in the embodiment of the present application.
In the implementation, in the panoramic video playing process, the movement of the playing window can be controlled according to the first movement direction and the movement speed, and the slow movement of the playing window can be realized in the panoramic video playing process, so that the panoramic video playing is more interesting. Alternatively, the position of the play window may be initialized before starting playing the panoramic video. For example, the control play window is moved to the center region of the panoramic video. And the position of the play window is controlled to be unchanged within the preset time. The preset time may be, for example, 5 seconds.
After step S2100, in step S2200, when receiving an adjustment instruction of a play window input by a user, the first moving direction is updated to a second moving direction according to the adjustment instruction, so as to play the panoramic video continuously according to the second moving direction and the moving speed.
In this embodiment, when the user needs to adjust the viewing angle, the adjustment instruction of the playing window may be input, so that the playing window of the panoramic video moves in the direction desired by the user. The adjustment instruction of the playing window can be the sliding input of the user to the panoramic video, can be the adjustment instruction input by the user through the handle, and can also be the input of the user to the target control.
The second movement direction may be a movement direction to be viewed by the user.
In the implementation, in the process of playing the panoramic video, the playing window can be controlled to move according to the first moving direction and the moving speed, and when an adjustment instruction of the playing window input by a user is received, the first moving direction is updated to the second moving direction according to the adjustment instruction, so that the panoramic video is continuously played according to the second moving direction and the moving speed in the subsequent playing process.
In one embodiment, the step of updating the first moving direction to the second moving direction according to the adjustment instruction when the adjustment instruction of the playing window input by the user is received may further include: under the condition that an adjustment instruction of a playing window input by a user is received, adjusting the position of the playing window according to the adjustment instruction, and acquiring first position information and second position information of the playing window before and after adjustment; and determining a second moving direction according to the first position information and the second position information.
The first position information may be position information of the pre-adjustment play window in the current video frame. The second position information may be position information of the adjusted play window in the current video frame in response to an adjustment instruction of the play window input by the user.
In this embodiment, under the condition that an adjustment instruction of a playing window input by a user is received, the position of the playing window in a current video frame is adjusted in response to the adjustment instruction of the playing window input by the user, and a second moving direction is determined according to the position information of the playing window in the current video frame before and after adjustment, so that panoramic video is played according to the second moving direction, and further panoramic video is slowly played according to a viewing angle wanted by the user.
In this embodiment, during the process of playing the panoramic video, whether a moving object exists in an image area corresponding to the playing window may be determined, and when no moving object exists in the playing window, the position of the playing window of the panoramic video is continuously adjusted according to the preset movement parameter, and when the moving object exists in the playing window, the playing window is controlled to be kept at the current position for a set time. Specific examples are described below.
In one embodiment, the step of adjusting the position of the playing window of the panoramic video according to a preset movement parameter may further include: and under the condition that no moving object exists in the image area corresponding to the playing window, adjusting the position of the playing window of the panoramic video according to a preset moving parameter.
In this embodiment, when no moving object exists in the playing window during the process of playing the panoramic video, the position of the playing window of the panoramic video is adjusted according to the preset movement parameters, so that the user can watch the panoramic video at a better viewing angle all the time, and the display effect of the panoramic video can be improved.
In one embodiment, after adjusting the position of the playing window of the panoramic video according to a preset movement parameter, the method further comprises: and under the condition that a moving object exists in the image area corresponding to the playing window, acquiring the current position corresponding to the playing window, and controlling the playing window to be kept at the current position within a set time.
In this embodiment, the current position corresponding to the play window may be the position of the play window in the current video frame.
The setting time may be a time for which the position of the play window remains unchanged, for example, the setting time is 5 seconds, which is not limited in the embodiment of the present application.
In this embodiment, the moving object in the panoramic video is usually the main object of the panoramic video, so when the moving object exists in the playing window, the playing window is controlled to keep a set time at the current position, so that the user can observe the movement process of the moving object, and the playing effect of the panoramic video is further improved.
In this embodiment, whether a moving object exists in the playing window may be determined according to pixel information of the video frames of the two frames. An example will be described below.
In one embodiment, the method may further comprise: step S3100 to step S3200.
Step S3100 is to acquire a first image and a second image, where the first image is an image area corresponding to the playing window in a current video frame of the panoramic video, and the second image is an image area corresponding to the playing window in a previous video frame of the panoramic video.
Step S3200, determining whether a moving object exists in an image area corresponding to the playing window according to the first image and the second image.
In this embodiment, according to the pixel information of the video frames of the front and rear frames, whether a moving object exists in the playing window can be accurately determined, so that when the moving object exists in the playing window, the position of the playing window is controlled to be unchanged.
In one embodiment, the step of determining whether the image area corresponding to the playing window has a moving object according to the first image and the second image may further include: step S4100 to step S4400.
Step S4100, obtaining first pixel information of the first image.
The first pixel information may be Luminance information of the first image, i.e., Y data of the first image, and "Y" represents brightness (luminence or Luma), for example.
Step S4200, acquiring second pixel information of the second image.
The second pixel information may be Luminance information of the second image, that is, Y data of the second image, and "Y" represents brightness (luminence or Luma), for example.
Step S4300, determining a difference amount of the pixel information according to the first pixel information and the second pixel information.
For example, the sum of squares of the difference between each pixel value of the first image and each pixel value of the second image may be calculated, resulting in the amount of difference in pixel information of the first image and the second image. The pixel value here may be Y data of the image.
Step S4400, determining that a moving object exists in the image area corresponding to the playing window when the difference amount of the pixel information is greater than or equal to a preset threshold value.
In this embodiment, the preset threshold may measure whether the pixel information of the two previous and subsequent frames of images is too different, that is, whether the pixel information of the first image and the second image is too different. When the difference of the pixel information of the first image and the pixel information of the second image are larger than or equal to a preset threshold value, the fact that the difference of the pixel information of the first image and the pixel information of the second image is too large is indicated, and the fact that a moving object exists in a playing window is determined. When the difference of the pixel information of the first image and the pixel information of the second image are smaller than a preset threshold value, the fact that the difference of the pixel information of the first image and the pixel information of the second image is smaller is indicated, and it is determined that no moving object exists in the playing window.
Here, the preset threshold may be set according to practical experience, which is not limited in the embodiment of the present application.
In this embodiment, whether a moving object exists in the playing window can be determined according to the brightness information of the front and rear first images and the second images, so that the operation amount can be reduced, the response speed can be improved, and the smoothness of panoramic video playing can be further ensured.
The following describes a panoramic video playing method by using a specific example. Referring to fig. 3, the method for playing the panoramic video includes the following steps.
Step S501, adjusting the position of a playing window of the panoramic video according to a first moving direction and a moving speed in the process of playing the panoramic video in an FOV mode;
step S502, judging whether a moving object exists in an image area corresponding to the playing window, if so, executing step S503, otherwise, executing step S504;
step S503, obtaining the current position corresponding to the playing window, and controlling the playing window to keep the set time at the current position;
step S504, judging whether an adjustment instruction of a playing window input by a user is received, if yes, executing step S505, otherwise, executing step S507;
step S505, the position of the play window is adjusted, and the position information of the play window after adjustment is the second position information;
step S506, determining a second moving direction according to the first position information and the second position information before adjustment, and updating the first moving direction to the second moving direction so as to continuously play the panoramic video according to the second moving direction and the moving speed in the subsequent playing process;
step S507, judging whether the panoramic video is played and ending, if yes, ending the flow, otherwise, returning to step S501.
According to the embodiment of the disclosure, in the process of playing the panoramic video, the position of the playing window of the panoramic video can be adjusted according to the first moving direction and the moving speed, so that in the process of playing the panoramic video, the position of the playing window can be automatically adjusted, the panoramic video is displayed at the optimal viewing angle, and the playing effect of the panoramic video can be improved. Moreover, under the condition that an adjustment instruction of a playing window input by a user is received, the first moving direction is updated to be the second moving direction according to the adjustment instruction, so that panoramic video is continuously played according to the second moving direction and the moving speed, and therefore the moving direction of the playing window adjusted by the user can be automatically learned, and further the movement of the playing window is controlled according to the second moving direction adjusted by the user, the playing mode of the panoramic video is enabled to be more matched with the watching behavior of the user, and the watching experience of the panoramic video can be improved.
In addition, in the playing process of the panoramic video, whether a moving object exists in the playing window can be monitored in real time, so that when the moving object exists in an image area corresponding to the playing window, the playing window is kept at the current position for a set time, the moving process of the moving object which can be observed by a user is more in line with the watching habit of the user, and further, the watching experience of the panoramic video is improved.
< device example >
Referring to fig. 4, an embodiment of the disclosure provides a playing device of panoramic video, and as shown in fig. 4, the playing device 600 of panoramic video may include a first control module 610 and an updating module 620.
The first control module 610 may be configured to adjust, during playing of the panoramic video, a position of a playing window of the panoramic video according to a preset movement parameter, where the movement parameter includes at least a first movement direction and a movement speed.
The updating module 620 may be configured to update the first moving direction to a second moving direction according to the adjustment instruction when receiving the adjustment instruction of the playing window input by the user, so as to play the panoramic video continuously according to the second moving direction and the moving speed.
In one embodiment, the playing device 600 of the panoramic video may further include:
the second control module is used for acquiring the current position corresponding to the playing window and controlling the playing window to be kept at the current position in a set time under the condition that a moving object exists in an image area corresponding to the playing window.
In an embodiment, the first control module 610 is specifically configured to adjust, when no moving object exists in the image area corresponding to the playing window, the position of the playing window of the panoramic video according to a preset movement parameter.
In one embodiment, the playing device 600 of the panoramic video may further include:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a first image and a second image, the first image is an image area corresponding to the playing window in a current video frame of the panoramic video, and the second image is an image area corresponding to the playing window in a previous video frame of the panoramic video;
and the determining module is used for determining whether a moving object exists in an image area corresponding to the playing window according to the first image and the second image.
In one embodiment, the determining module may include:
a first acquisition unit configured to acquire first pixel information of the first image;
a second acquisition unit configured to acquire second pixel information of the second image;
a first determining unit configured to determine a difference amount of pixel information according to the first pixel information and the second pixel information;
and the second determining unit is used for determining that a moving object exists in the image area corresponding to the playing window under the condition that the difference amount of the pixel information is larger than or equal to a preset threshold value.
In one embodiment, the update module 620 is specifically configured to: under the condition that an adjustment instruction of a playing window input by a user is received, adjusting the position of the playing window according to the adjustment instruction, and acquiring first position information and second position information of the playing window before and after adjustment; determining a second movement direction according to the first position information and the second position information
According to the embodiment of the disclosure, in the process of playing the panoramic video, the position of the playing window of the panoramic video can be adjusted according to the first moving direction and the moving speed, so that in the process of playing the panoramic video, the position of the playing window can be automatically adjusted, the panoramic video is displayed at the optimal viewing angle, and the playing effect of the panoramic video can be improved. Moreover, under the condition that an adjustment instruction of a playing window input by a user is received, the first moving direction is updated to be the second moving direction according to the adjustment instruction, so that panoramic video is continuously played according to the second moving direction and the moving speed, and therefore the moving direction of the playing window adjusted by the user can be automatically learned, and further the movement of the playing window is controlled according to the second moving direction adjusted by the user, the playing mode of the panoramic video is enabled to be more matched with the watching behavior of the user, and the watching experience of the panoramic video can be improved.
< device example >
Referring to fig. 5, an embodiment of the disclosure further provides an electronic device. As shown in fig. 5, the electronic device 700 includes a memory 710 and a processor 720.
The memory 710 may be used to store executable computer instructions.
The processor 720 may be configured to execute a method for playing panoramic video according to an embodiment of the method of the present disclosure according to the control of the executable computer instructions.
The electronic device 700 may be the electronic device 1000 shown in fig. 1, or may be a device having another hardware configuration, and is not limited thereto. The electronic device 700 may be, for example, a mobile phone, a portable computer, a tablet computer, a palm computer, etc., the electronic device 700 may also be, for example, a VR device, an AR device, an MR device, etc., and the electronic device 700 may also be, for example, a server, which is not limited in the embodiments of the present disclosure.
In further embodiments, the electronic device 700 may include the above panoramic video playback apparatus 600.
In one embodiment, the above modules of the panoramic video playback apparatus 600 may be implemented by the processor 620 executing computer instructions stored in the memory 710.
According to the embodiment of the disclosure, in the process of playing the panoramic video, the position of the playing window of the panoramic video can be adjusted according to the first moving direction and the moving speed, so that in the process of playing the panoramic video, the position of the playing window can be automatically adjusted, the panoramic video is displayed at the optimal viewing angle, and the playing effect of the panoramic video can be improved. Moreover, under the condition that an adjustment instruction of a playing window input by a user is received, the first moving direction is updated to be the second moving direction according to the adjustment instruction, so that panoramic video is continuously played according to the second moving direction and the moving speed, and therefore the moving direction of the playing window adjusted by the user can be automatically learned, and further the movement of the playing window is controlled according to the second moving direction adjusted by the user, the playing mode of the panoramic video is enabled to be more matched with the watching behavior of the user, and the watching experience of the panoramic video can be improved.
< example of Medium >
In this embodiment, there is also provided a computer-readable storage medium storing computer instructions readable and executable by a computer, the computer instructions when executed by a processor performing the method for playing panoramic video described in the foregoing embodiment.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are referred to each other, and each embodiment is mainly described as different from other embodiments, but it should be apparent to those skilled in the art that the above embodiments may be used alone or in combination with each other as required. In addition, for the device embodiment, since it corresponds to the method embodiment, description is relatively simple, and reference should be made to the description of the corresponding part of the method embodiment for relevant points. The system embodiments described above are merely illustrative, in that the modules illustrated as separate components may or may not be physically separate.
The present application may be a system, method, and/or computer program product. The computer program product may include a computer readable storage medium having computer readable program instructions embodied thereon for causing a processor to implement aspects of the present application.
The computer readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: portable computer disks, hard disks, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static Random Access Memory (SRAM), portable compact disk read-only memory (CD-ROM), digital Versatile Disks (DVD), memory sticks, floppy disks, mechanical coding devices, punch cards or in-groove structures such as punch cards or grooves having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media, as used herein, are not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., optical pulses through fiber optic cables), or electrical signals transmitted through wires.
The computer readable program instructions described herein may be downloaded from a computer readable storage medium to a respective computing/processing device or to an external computer or external storage device over a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, gateway computers and/or edge servers. The network interface card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in the respective computing/processing device.
Computer program instructions for carrying out operations of the present application may be assembly instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, c++ or the like and conventional procedural programming languages, such as the "e.g." language or similar programming languages. The computer readable program instructions may be executed entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present application are implemented by personalizing electronic circuitry, such as programmable logic circuitry, field Programmable Gate Arrays (FPGAs), or Programmable Logic Arrays (PLAs), with state information for computer readable program instructions, which can execute the computer readable program instructions.
Various aspects of the present application are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable medium having the instructions stored therein includes an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, implementation by software, and implementation by a combination of software and hardware are all equivalent.
The foregoing description of embodiments of the application has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the various embodiments described. The terminology used herein was chosen in order to best explain the principles of the embodiments, the practical application, or the technical improvements in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the application is defined by the appended claims.
Claims (8)
1. A method for playing panoramic video, the method comprising:
in the process of playing the panoramic video, adjusting the position of a playing window of the panoramic video according to preset movement parameters, wherein the movement parameters at least comprise a first movement direction and a movement speed;
under the condition that an adjustment instruction of a playing window input by a user is received, updating the first moving direction into a second moving direction according to the adjustment instruction, and continuously playing the panoramic video according to the second moving direction and the moving speed;
after the position of the playing window of the panoramic video is adjusted according to preset moving parameters, under the condition that a moving object exists in an image area corresponding to the playing window, the current position corresponding to the playing window is obtained, and the playing window is controlled to be kept at the current position within a set time.
2. The method of claim 1, wherein adjusting the position of the play window of the panoramic video according to the preset movement parameter comprises:
and under the condition that no moving object exists in the image area corresponding to the playing window, adjusting the position of the playing window of the panoramic video according to a preset moving parameter.
3. The method according to claim 1, wherein the method further comprises:
acquiring a first image and a second image, wherein the first image is an image area corresponding to the playing window in a current video frame of the panoramic video, and the second image is an image area corresponding to the playing window in a previous video frame of the panoramic video;
and determining whether a moving object exists in an image area corresponding to the playing window according to the first image and the second image.
4. The method according to claim 3, wherein determining whether a moving object exists in an image area corresponding to the play window according to the first image and the second image includes:
acquiring first pixel information of the first image;
acquiring second pixel information of the second image;
determining the difference amount of the pixel information according to the first pixel information and the second pixel information;
and under the condition that the difference amount of the pixel information is larger than or equal to a preset threshold value, determining that a moving object exists in the image area corresponding to the playing window.
5. The method according to claim 1, wherein, in the case of receiving an adjustment instruction of the play window input by the user, updating the first movement direction to the second movement direction according to the adjustment instruction includes:
under the condition that an adjustment instruction of a playing window input by a user is received, adjusting the position of the playing window according to the adjustment instruction, and acquiring first position information and second position information of the playing window before and after adjustment;
and determining a second moving direction according to the first position information and the second position information.
6. A device for playing panoramic video, said device comprising:
the panoramic video processing device comprises a first control module, a second control module and a third control module, wherein the first control module is used for adjusting the position of a playing window of the panoramic video according to preset moving parameters in the process of playing the panoramic video, and the moving parameters at least comprise a first moving direction and a moving speed;
the updating module is used for updating the first moving direction into a second moving direction according to the adjusting instruction under the condition that the adjusting instruction of the playing window input by a user is received, so that the panoramic video is played continuously according to the second moving direction and the moving speed;
the second control module is used for acquiring the current position corresponding to the playing window and controlling the playing window to be kept at the current position in a set time under the condition that a moving object exists in an image area corresponding to the playing window after the position of the playing window of the panoramic video is adjusted according to preset moving parameters.
7. An electronic device, comprising:
a memory for storing executable computer instructions;
a processor for executing the method for playing panoramic video according to any one of claims 1-5, under control of the executable computer instructions.
8. A computer readable storage medium having stored thereon computer instructions which, when executed by a processor, perform the method of playing panoramic video according to any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210910618.6A CN115396740B (en) | 2022-07-29 | 2022-07-29 | Panoramic video playing method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210910618.6A CN115396740B (en) | 2022-07-29 | 2022-07-29 | Panoramic video playing method and device, electronic equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115396740A CN115396740A (en) | 2022-11-25 |
| CN115396740B true CN115396740B (en) | 2023-11-21 |
Family
ID=84118416
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210910618.6A Active CN115396740B (en) | 2022-07-29 | 2022-07-29 | Panoramic video playing method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115396740B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105678693A (en) * | 2016-01-25 | 2016-06-15 | 成都易瞳科技有限公司 | Panorama video browsing-playing method |
| CN106210549A (en) * | 2016-09-07 | 2016-12-07 | 传线网络科技（上海）有限公司 | The player method of panoramic video and device |
| CN107027041A (en) * | 2017-04-18 | 2017-08-08 | 深圳市智能现实科技有限公司 | scene display method and device |
| CN107872731A (en) * | 2017-11-22 | 2018-04-03 | 三星电子（中国）研发中心 | Panoramic video player method and device |
| CN110312165A (en) * | 2019-07-05 | 2019-10-08 | 浙江开奇科技有限公司 | Display control method and terminal device based on panoramic video image |
| CN111198610A (en) * | 2018-11-16 | 2020-05-26 | 北京字节跳动网络技术有限公司 | Method, device and equipment for controlling field of view of panoramic video and storage medium |
| CN111213374A (en) * | 2017-11-29 | 2020-05-29 | 深圳市柔宇科技有限公司 | Video playing method and device |
| CN113709542A (en) * | 2020-10-09 | 2021-11-26 | 天翼智慧家庭科技有限公司 | Method and system for playing interactive panoramic video |
-
2022
- 2022-07-29 CN CN202210910618.6A patent/CN115396740B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105678693A (en) * | 2016-01-25 | 2016-06-15 | 成都易瞳科技有限公司 | Panorama video browsing-playing method |
| CN106210549A (en) * | 2016-09-07 | 2016-12-07 | 传线网络科技（上海）有限公司 | The player method of panoramic video and device |
| CN107027041A (en) * | 2017-04-18 | 2017-08-08 | 深圳市智能现实科技有限公司 | scene display method and device |
| CN107872731A (en) * | 2017-11-22 | 2018-04-03 | 三星电子（中国）研发中心 | Panoramic video player method and device |
| CN111213374A (en) * | 2017-11-29 | 2020-05-29 | 深圳市柔宇科技有限公司 | Video playing method and device |
| CN111198610A (en) * | 2018-11-16 | 2020-05-26 | 北京字节跳动网络技术有限公司 | Method, device and equipment for controlling field of view of panoramic video and storage medium |
| CN110312165A (en) * | 2019-07-05 | 2019-10-08 | 浙江开奇科技有限公司 | Display control method and terminal device based on panoramic video image |
| CN113709542A (en) * | 2020-10-09 | 2021-11-26 | 天翼智慧家庭科技有限公司 | Method and system for playing interactive panoramic video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115396740A (en) | 2022-11-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7385052B2 (en) | Photography methods, equipment, electronic equipment and storage media | |
| US10523875B2 (en) | Live updates for synthetic long exposures | |
| CN106506448B (en) | Live broadcast display method and device and terminal | |
| CN109087238B (en) | Image processing method and apparatus, electronic device, and computer-readable storage medium | |
| CN107888984B (en) | Short video playing method and device | |
| CN112785672B (en) | Image processing method and device, electronic equipment and storage medium | |
| CN108986117B (en) | Video image segmentation method and device | |
| US11636572B2 (en) | Method and apparatus for determining and varying the panning speed of an image based on saliency | |
| CN106792255B (en) | Video playing window frame body display method and device | |
| WO2021189880A1 (en) | Hair rendering method and apparatus, electronic device, and storage medium | |
| CN108174269B (en) | Visual audio playing method and device | |
| US10845971B2 (en) | Generating display regions in a display screen for multi-directional viewing | |
| CN108322673B (en) | Video generation method and video generation device | |
| EP3846488A1 (en) | Method and apparatus for controlling video | |
| CN115396740B (en) | Panoramic video playing method and device, electronic equipment and readable storage medium | |
| CN115396741A (en) | Panoramic video playing method and device, electronic equipment and readable storage medium | |
| CN112565625A (en) | Video processing method, apparatus and medium | |
| CN106598247B (en) | Response control method and device based on virtual reality | |
| CN113810755B (en) | Panoramic video preview method and device, electronic equipment and storage medium | |
| CN110896492B (en) | Image processing method, device and storage medium | |
| CN109982127B (en) | Bullet screen speed control method and device | |
| US9292906B1 (en) | Two-dimensional image processing based on third dimension data | |
| CN107783704B (en) | Picture effect adjusting method and device and terminal | |
| CN110896476B (en) | Image processing method, device and storage medium | |
| CN110955328B (en) | Control method and device of electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |