WO2023078133A1

WO2023078133A1 - Video playback method and device

Info

Publication number: WO2023078133A1
Application number: PCT/CN2022/127534
Authority: WO
Inventors: 王亚飞
Original assignee: 华为技术有限公司
Priority date: 2021-11-05
Filing date: 2022-10-26
Publication date: 2023-05-11
Also published as: CN116095405A

Abstract

The present invention provides a video playback method and device, which relate to the technical field of virtual reality, and which may improve the feeling of interaction for users when adjusting the angle of view of video playback. The method comprises: first collecting target information, and then adjusting the angle of view of video playback according to the target information. The target information comprises user face orientation information and user movement information, the user face orientation information being used for representing the direction in which the face of a user is oriented, and the user movement information being used for representing the direction in which the user moves. In the video playback method provided in the present invention, when a user adjusts the angle of view of video playback, the angle of view of video playback may be directly adjusted along with an action of the user by changing the face orientation and moving the body without operating a mouse or a touch screen, thereby increasing the feeling of interaction for the user when the angle of view of video playback is adjusted.

Description

Video playback method and device

This application claims the priority of a Chinese patent application with application number 202111303353.5 and application title "Video Playing Method and Device" filed with the China Patent Office on November 05, 2021, the entire contents of which are incorporated herein by reference.

technical field

The invention relates to the technical field of virtual reality, in particular to a video playing method and device.

Background technique

Virtual reality (VR) technology is a technology that can construct panoramic videos by collecting data from the real world. With the advancement of VR technology, the panoramic video that VR technology can build is getting closer to reality. VR technology is also widely used in daily life. Users can watch different areas of VR video by adjusting the viewing angle of VR video. . For example, in the field of real estate sales and real estate decoration, VR technology can be used to build panoramic videos of houses, so that users can view houses online through panoramic videos of houses, and users can watch different rooms of houses by adjusting the viewing angle of the panoramic videos of houses. .

However, in the existing VR technology, the way for the user to adjust the viewing angle of the video playback lacks a sense of interaction, which reduces the user's sense of immersion and poor user experience.

Contents of the invention

The present invention provides a video playing method and device, which can improve the user's sense of interaction when adjusting the viewing angle of video playing. To achieve the above object, the present invention adopts the following technical solutions:

In a first aspect, the present invention provides a method for playing a video, the method comprising: collecting target information first, and then adjusting a video playback angle of view according to the target information. Wherein, the target information includes user face orientation information and user movement information, the user face orientation information is used to indicate the direction of the user's face orientation, and the user movement information is used to indicate the user's movement direction.

In the video playing method provided by the present invention, when the user adjusts the playing angle of the video, the user does not need to manipulate the mouse or touch the screen, but can directly change the face orientation and move the body, so that the playing angle of the video can be adjusted according to the user's actions , thereby improving the sense of interaction when the user adjusts the viewing angle of the video, increasing the user's sense of immersion when watching the video, and improving the user experience.

In a possible implementation manner, the above-mentioned adjustment of the playing angle of view of the video according to the target information may include: adjusting the orientation of the playing angle of view according to the user's face orientation information; adjusting the playing angle of view according to the user's movement information s position.

In the video playing method provided by the present invention, when the user adjusts the playing angle of the video, the user can not only adjust the orientation of the playing angle of view by changing the face orientation, but also adjust the position of the playing angle of view by moving. For example, if the user wants to adjust the orientation of the viewing angle of the video to move upward, the user can adjust the orientation of the viewing angle of the video to move upward by raising the head. Users can also pass. For another example, if the user adjusts the position of the playback angle of view of the video to move forward, the user can move forward to adjust the position of the playback angle of view of the video to move forward.

In a possible implementation manner, the adjusting the orientation of the playback angle of view according to the user's face orientation information includes: determining an orientation adjustment direction of the playback angle of view according to the user's face orientation information; Direction and preset orientation adjustment adjusts the orientation of the playing angle of view.

Exemplarily, it is assumed that the user's face is facing downwards and the preset orientation adjustment amount is 30 degrees as an example. The video playback device first determines that the orientation adjustment direction of the playback angle of view is downward according to the user's face orientation information, and then adjusts the orientation of the playback angle of view downward by 30 degrees.

Optionally, the user's face orientation information can also be used to characterize the angle of the user's face orientation.

In another possible implementation manner, the adjusting the orientation of the playback viewing angle according to the user's face orientation information may include: determining adjustment information according to the user's face orientation information; adjusting the playback angle of view according to the adjustment information. The orientation of the viewing angle. Wherein, the adjustment information is used to characterize the direction of the orientation of the playback viewing angle and the angle of the orientation of the playback viewing angle after adjustment.

Optionally, the adjusted orientation of the playing angle of view may be the same as the orientation of the user's face.

Optionally, the adjusted orientation angle of the playback viewing angle and the orientation angle of the user's face may be the same.

Exemplarily, it is assumed that the user's face is facing upward at 45 degrees and the current viewing angle is facing downward at 30 degrees. The video playback device first determines that the orientation of the adjusted playback viewing angle is 45 degrees upward according to the user's face orientation information, and then adjusts the orientation of the playback viewing angle upward by 75 degrees so that the orientation of the playback viewing angle is adjusted from downward 30 degrees to upward 45 degrees . It can be seen that the orientation (direction and angle) of the adjusted playback viewing angle is the same as the orientation of the user's face.

It can be understood that when a user watches a video played by an electronic device, the user's face is usually facing directly to the screen of the electronic device. After the user changes the face orientation, the user's face orientation may no longer face the screen of the electronic device. Therefore, the situation that the user cannot continue to watch the video played by the electronic device after changing the face orientation may occur.

To this end, the user can adjust the orientation of the playback viewing angle by changing the orientation of the face and returning it to the normal position. That is, the user can first change the face orientation, and then return to the previous face orientation (hereinafter referred to as the back-to-orientation process). In the process of changing the face orientation, the video playback device may generate user face orientation information according to the user's face orientation, and then adjust the orientation of the playback viewing angle according to the information. During the back-to-centering process, the video playback device will not generate user's face orientation information according to the user's face orientation, nor will it adjust the orientation of the playback viewing angle.

In a possible implementation manner, adjusting the position of the playback angle of view according to the user movement information includes: determining the position adjustment direction of the playback angle of view according to the user movement information; adjusting the direction according to the position and a preset The position adjustment amount adjusts the position of the playing angle of view.

Exemplarily, it is assumed that the user moves forward and the preset movement adjustment amount is N as an example. The video playback device first determines that the position adjustment direction of the playback angle of view is forward according to the user movement information, and then adjusts the position of the playback angle of view forward by N.

Optionally, the user movement information is also used to characterize the distance traveled by the user.

In another possible implementation manner, the adjusting the position of the playback angle of view according to the user movement information includes: determining the position adjustment direction of the playback angle of view and the position of the playback angle of view according to the user movement information Adjusting the distance; adjusting the position of the playing angle of view according to the position adjustment direction and the position adjustment distance.

Optionally, there may be a conversion relationship between the position adjustment distance and the user movement distance, and the conversion relationship may be: position adjustment distance=user movement distance*(second distance/first distance). Among them, the first distance is the vertical distance between the user and the boundary of the first target area in the user's moving direction, and the second distance is the vertical distance between the position of the playing angle of view and the boundary of the second target area in the user's moving direction, and the second area is The two-dimensional plane area corresponding to the video, * is the multiplication sign, / is the division sign. For example, if the user's moving distance is 30, the first distance is 100, and the second distance is 200, then the position adjustment distance is 30*(200/100)=60.

Exemplarily, take the user moving M1 backward as an example. The video playback device first determines the adjustment direction of the playback angle of view according to the user's movement information as a backward adjustment distance of M2, and then adjusts the playback angle of view backward by M2.

Among them, M2=M1*(a/b), a is the first distance, that is, the vertical distance between the user and the boundary of the first area behind, and b is the second distance, that is, the distance between the position of the viewing angle of view and the boundary of the second area behind the vertical distance between them.

It can be understood that if the user adjusts the orientation of the playback viewing angle by changing the orientation of the face and returning it to the normal position, the second distance corresponding to the same movement direction of the user before and after adjusting the orientation of the playback viewing angle may change. Therefore, after moving to the boundary of the first area, the user can change the orientation of the playback viewing angle by changing the orientation of the face and returning to the normal position, so that the user can watch other positions of the video.

In a possible manner, the collecting target information may include: collecting the target information by a collection unit, where the collection unit includes at least one of an image collection unit, a sound collection unit, or an infrared collection unit.

In another possible implementation manner, the collecting target information may include: receiving collection information sent by a collection device, where the collection information includes the target information.

In a second aspect, the present invention also provides a video playback device, the device includes a processing unit, the processing unit is used to: collect target information, the target information includes user face orientation information and user movement information, the user face The orientation information is used to represent the direction of the user's face, and the user movement information is used to represent the direction of the user's movement; the playing angle of the video is adjusted according to the target information.

In a possible implementation manner, the processing unit is specifically configured to: adjust the orientation of the playback angle of view according to the user's face orientation information; adjust the position of the playback angle of view according to the user movement information.

In a possible implementation manner, the processing unit is specifically configured to: determine an orientation adjustment direction of the playback viewing angle according to the user's face orientation information; adjust the playback angle according to the orientation adjustment direction and a preset orientation adjustment amount. The orientation of the viewing angle.

In another possible implementation manner, the processing unit is specifically configured to: determine adjustment information according to the user's face orientation information, where the adjustment information is used to represent the adjusted orientation of the playing angle of view and the orientation of the user's face. The angle of the orientation of the playing angle of view; adjusting the orientation of the playing angle of view according to the adjustment information.

In a possible implementation manner, the processing unit is specifically configured to: determine a position adjustment direction of the playback viewing angle according to the user movement information; adjust the playback viewing angle according to the position adjustment direction and a preset position adjustment amount s position.

In another possible implementation manner, the processing unit is specifically configured to: determine the position adjustment direction of the playback viewing angle and the position adjustment distance of the playback viewing angle according to the user movement information; The position adjustment distance adjusts the position of the playing angle of view.

Optionally, there may be a conversion relationship between the position adjustment distance and the user movement distance, and the conversion relationship may be: position adjustment distance=user movement distance*(second distance/first distance).

In a possible implementation manner, the processing unit is specifically configured to: collect the target information through a collection unit, where the collection unit includes at least one of an image collection unit, a sound collection unit, or an infrared collection unit.

In another possible implementation manner, the processing unit is specifically configured to: receive collection information sent by a collection device, where the collection information includes the target information.

In a third aspect, the present invention also provides a video playback device, which includes: at least one processor, and when the at least one processor executes program codes or instructions, the above first aspect or any possible implementation thereof can be realized method described in .

Optionally, the video playback device may further include at least one memory, and the at least one memory is used to store the program code or instruction.

In a fourth aspect, the present invention further provides a chip, including: an input interface, an output interface, and at least one processor. Optionally, the chip also includes a memory. The at least one processor is used to execute the code in the memory, and when the at least one processor executes the code, the chip implements the method described in the above first aspect or any possible implementation thereof.

Optionally, the aforementioned chip may also be an integrated circuit.

In a fifth aspect, the present invention further provides an electronic device, the terminal comprising the above-mentioned video playing device or the above-mentioned chip.

Optionally, the electronic device may be a smart screen.

In a sixth aspect, the present invention further provides a computer-readable storage medium for storing a computer program, and the computer program includes a method for implementing the above-mentioned first aspect or any possible implementation thereof.

In a seventh aspect, the present invention also provides a computer program product containing instructions, which, when run on a computer, enable the computer to implement the method described in the above first aspect or any possible implementation thereof.

The video playing device, electronic equipment, computer storage medium, computer program product and chip provided in this embodiment are all used to execute the video playing method provided above, therefore, the beneficial effects it can achieve can refer to the above provided The beneficial effects in the video playing method will not be repeated here.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained based on these drawings without creative effort.

FIG. 1 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention;

FIG. 2 is a schematic diagram of a software structure of an electronic device provided by an embodiment of the present invention;

FIG. 3 is a schematic diagram of a user interface of an electronic device provided by an embodiment of the present invention;

FIG. 4 is a schematic diagram of a user interface of another electronic device provided by an embodiment of the present invention;

FIG. 5 is a schematic diagram of a user interface of another electronic device provided by an embodiment of the present invention;

Fig. 6 is a schematic diagram of a viewer's activity area provided by an embodiment of the present invention;

FIG. 7 is a schematic diagram of generating a second region provided by an embodiment of the present invention;

FIG. 8 is a schematic diagram of mapping between a first area and a second area provided by an embodiment of the present invention;

FIG. 9 is a schematic diagram of another mapping between a first area and a second area provided by an embodiment of the present invention;

FIG. 10 is a schematic diagram of another mapping between the first area and the second area provided by the embodiment of the present invention;

Fig. 11 is a schematic diagram of another mapping between the first area and the second area provided by the embodiment of the present invention;

FIG. 12 is a schematic flowchart of a video playback method provided by an embodiment of the present invention;

Fig. 13 is a schematic structural diagram of a device provided by an embodiment of the present invention;

Fig. 14 is a schematic structural diagram of another device provided by an embodiment of the present invention;

FIG. 15 is a schematic structural diagram of a chip provided by an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

The term "and/or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations.

The terms "first" and "second" in the description and drawings of the present invention are used to distinguish different objects, or to distinguish different processes for the same object, rather than to describe a specific sequence of objects.

In addition, the terms "including" and "having" and any variations thereof mentioned in the description of the present invention are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include other unlisted steps or units, or may optionally also include Other steps or elements inherent to the process, method, product or apparatus are included.

It should be noted that, in the description of the embodiments of the present invention, words such as "exemplarily" or "for example" are used as examples, illustrations or illustrations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present invention shall not be interpreted as being more preferred or more advantageous than other embodiments or design solutions. Rather, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a concrete manner.

In the description of the present invention, unless otherwise specified, the meaning of "plurality" refers to two or more than two.

In daily life, users can watch different areas of the VR video by adjusting the viewing angle of the VR video. For example, in the field of real estate sales and real estate decoration, VR technology can be used to build panoramic videos of houses, so that users can view houses online through panoramic videos of houses, and users can watch different rooms of houses by adjusting the viewing angle of the panoramic videos of houses. .

However, in the existing VR technology, the way for users to adjust the viewing angle of video playback is mainly by operating the mouse or touching the screen. These methods of adjusting the viewing angle of video playback lack a sense of interaction, resulting in reduced user immersion and poor user experience.

To this end, the embodiment of the present invention provides a video playback method, which can improve the user's sense of interaction when adjusting the viewing angle of the video playback.

The video playback method provided by the embodiments of the present invention can be applied to smart screens, mobile phones, tablet computers, notebook computers, ultra-mobile personal computers (ultra-mobile personal computers, UMPCs), netbooks, personal digital assistants (personal digital assistants, PDAs), etc. On an electronic device with a video (panoramic video) playback function, the embodiment of the present invention does not impose any limitation on the specific type of the electronic device.

Exemplarily, FIG. 1 is a schematic structural diagram of an electronic device 100 provided by an embodiment of the present invention. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and A subscriber identification module (subscriber identification module, SIM) card interface 195 and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.

It can be understood that, the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present invention, the electronic device 100 may include more or fewer components than shown, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

Wherein, the controller may be the nerve center and command center of the electronic device 100 . The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.

Wherein, the I2C interface is a bidirectional synchronous serial bus, and the processor 110 can couple the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 100 . The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 . MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc. In some embodiments, the processor 110 communicates with the camera 193 through the CSI interface to realize the shooting function of the electronic device 100 . The processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the electronic device 100 .

It can be understood that the interface connection relationship between the modules shown in the embodiment of the present invention is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 . In other embodiments of the present invention, the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.

The charging management module 140 is configured to receive a charging input from a charger. Wherein, the charger may be a wireless charger or a wired charger. The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives the input of the battery 142 and/or the charging management module 140, and supplies power for the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160, etc.

The electronic device 100 realizes the display function through the GPU, the display screen 194 , and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.

The electronic device 100 can realize the shooting function through the ISP, the camera 193 , the touch sensor, the video codec, the GPU, the display screen 194 and the application processor.

Wherein, the ISP is used for processing the data fed back by the camera 193 . For example, when taking a picture, open the shutter, the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be located in the camera 193 .

Camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, image signals in formats such as YUV. It should be understood that in the description of the embodiment of the present invention, the image in RGB format is used as an example for introduction, and the embodiment of the present invention does not limit the image format. . In some embodiments, the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the electronic device 100. The internal memory 121 may be used to store computer-executable program codes including instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 . The internal memory 121 may include an area for storing programs and an area for storing data.

The electronic device 100 can implement audio functions through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.

The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. The air pressure sensor 180C is used to measure air pressure. The magnetic sensor 180D includes a Hall sensor. The electronic device 100 may use the magnetic sensor 180D to detect the opening and closing of the flip leather case. The acceleration sensor 180E can detect the acceleration of the electronic device 100 in various directions (generally three axes). The distance sensor 180F is used to measure the distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may use the distance sensor 180F for distance measurement to achieve fast focusing. Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The ambient light sensor 180L is used for sensing ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access to application locks, take pictures with fingerprints, answer incoming calls with fingerprints, and the like. The temperature sensor 180J is used to detect temperature. Touch sensor 180K, also known as "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The bone conduction sensor 180M can acquire vibration signals. The audio module 170 can analyze the voice signal based on the vibration signal of the vibrating bone mass of the vocal part acquired by the bone conduction sensor 180M, so as to realize the voice function.

The keys 190 include a power key, a volume key and the like. The key 190 may be a mechanical key. It can also be a touch button. The electronic device 100 can receive key input and generate key signal input related to user settings and function control of the electronic device 100 . The motor 191 can generate a vibrating reminder. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 194 . The indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like. The SIM card interface 195 is used for connecting a SIM card.

The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, an operating system with a layered architecture is taken as an example to illustrate the software structure of the electronic device 100 .

FIG. 2 is a block diagram of the software structure of the electronic device 100 according to the embodiment of the present invention. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the operating system is divided into four layers, which are application program layer, application program framework layer, operating system runtime (runtime) and system library, and kernel layer from top to bottom.

The application layer can consist of a series of application packages. As shown in FIG. 2, the application package may include application programs such as camera, photo album, music, and settings.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 2, the application framework layer can include window managers, content providers, view systems, resource managers, notification managers, etc.

A window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.

Content providers are used to store and retrieve data and make it accessible to applications. Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. The view system can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages. The notification information displayed in the status bar can disappear automatically after a short stay, such as a message reminder to inform the user that the download is complete. The notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, or the notification manager can also emit a prompt sound, such as electronic device vibration, indicator light flashing, and the like.

Runtime includes core library and virtual machine. Runtime is responsible for the scheduling and management of the operating system. The core library consists of two parts: one part is the functions that the java language needs to call, and the other part is the core library of the operating system.

The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application program layer and the application program framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

A system library can include multiple function modules. For example: surface manager (surface manager), media library (media libraries), 3D graphics processing library (for example: open graphics library (open graphics library, OpenGL) embedded systems (embedded systems, ES)), 2D graphics engine (for example : Scene graph library (scene graph library, SGL)), etc.

The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc. The media library can support a variety of audio and video encoding formats, such as: moving pictures experts group (MPEG) 4, H.264, MP3, advanced audio coding (AAC), multi-rate adaptive (adaptibve multi rate, AMR), joint photographic experts group (joint photographic experts group, JPG), portable network graphics (portable network graphics, PNG) and so on.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc. 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. Wherein, the kernel layer may include hardware driver modules, such as display drivers, camera drivers, sensor drivers, etc., and the application framework layer may call the hardware driver modules of the kernel layer.

For ease of understanding, the following embodiments of the present invention will use the electronic device with the structure shown in FIG. 1 and FIG. 2 as an example to introduce the video playing method provided by the embodiment of the present invention.

The technical solutions involved in the following embodiments can all be implemented in the electronic device 100 having the above-mentioned hardware architecture and software architecture.

In this embodiment of the present invention, taking the electronic device 100 as an example of a smart screen, the technical solution provided by the embodiment of the present invention will be described in detail with reference to the accompanying drawings.

Fig. 3 is a schematic diagram of a graphical user interface (graphical user interface, GUI) provided by an embodiment of the present invention. Fig. 3 shows that the screen display system of the smart screen displays the currently output interface content, which is the main content of the smart screen. interface. The content of the interface displays multiple application programs (applications, Apps), for example, applications such as VR, clock, calendar, gallery, and memo. It can be understood that the interface content may also include other more application programs, which is not limited in this embodiment of the present invention.

Users can instruct the smart screen to open VR applications by touching specific controls on the screen of the smart screen, pressing specific physical buttons or button combinations, inputting voice, and gestures in the air. In response to receiving an instruction from the user to start the VR application, the smart screen starts the VR application.

For example, the user can click the "VR" application icon on the main interface by operating the remote control of the smart screen to instruct the smart screen to start the VR application.

As another example, the user can instruct the smart screen to start the VR application and display the VR application interface through a voice command (such as "open the VR application").

Users can play various videos through the VR application interface. The above-mentioned videos include but are not limited to VR videos, panoramic videos, VR panoramic videos, VR real-scene videos or other 3D panoramic videos.

Exemplarily, as shown in FIG. 4 , the VR application is a VR house viewing application, and the user can instruct the smart screen to play a 3D panoramic video of the house through the app to view the interior of the house. It can be understood that the VR application can also be other VR applications, and the user can also play other videos through the VR application. Such as videos of attractions, videos of shopping malls, or other videos.

The specific method for generating the foregoing video may be processed by any method conceivable by those skilled in the art, which is not specifically limited in this embodiment of the present application. For example, a panoramic camera is used to collect real-world images to generate a video.

As shown in Figure 5, the user can also instruct the smart screen to play a preview navigation map of the video (also called a VR panoramic video navigation map), and the user can determine the position and orientation of the current playback perspective in the entire video through the preview navigation map. Wherein, the preview navigation map is a plan view used to indicate the position and orientation of the current playing angle in the entire video.

As shown in FIG. 6 , when the user wants to adjust the viewing angle of the video, the user can indicate the viewing angle of the VR application video by moving in the viewer's active area (hereinafter referred to as the first area). Wherein, the first area may be an area defined in front of an electronic device (such as a smart screen) to limit the user to watch videos, and is usually a rectangular area where a collection device (such as a camera) can clearly capture the user's position and user's face orientation. The location of the user within the first area may be referred to as the viewer location.

Optionally, the initial position of the playback angle of view may be the center of the second area. The initial orientation of the playback perspective may be forward. Wherein, the second area is a two-dimensional plane area corresponding to the video.

Optionally, as shown in FIG. 7 , a rectangle may be formed according to the maximum length and maximum width of the graphic corresponding to the video to generate the second area. Wherein, the left side of FIG. 7 is the graphic corresponding to the video, and the right side of FIG. 7 is the second area.

For example, as shown in FIG. 8 , in the first area, the user is watching the video of the house through the smart screen in front. When the user wants to move the viewing angle position of the video forward, the user can move the Moving forward M1, the smart screen obtains the user's movement information (that is, the information used to characterize the user's moving direction and moving distance) through a collection device (such as a camera) and measures the distance between the user and the boundary of the first area in front (hereinafter referred to as the first area boundary). A distance) is a, and then the distance between the location where the smart screen obtains the current viewing angle and the boundary of the second area in front (hereinafter referred to as the second distance) is b, and then the smart screen first determines the position of the playback viewing angle and adjusts the direction according to the user's movement information To move forward, determine the position adjustment distance of the playback angle of view according to the user movement information, the first distance and the second distance as M1*(a/b)=M2, and finally move the video playback angle of view position forward by M2.

For another example, as shown in FIG. 9 , in the first area, the user is watching the video of the house through the smart screen in front. When the user wants to move the viewing angle of the video 90 degrees to the left, the user can Rotate the face orientation to the left by 90 degrees in the area, and the smart screen obtains the user’s face orientation information (that is, the information representing the direction and angle of the user’s face orientation) through the acquisition device, and then the smart screen first determines the playback angle of view based on the user’s face orientation information. The orientation adjustment direction is to the left, and then the orientation adjustment angle of the playback viewing angle is determined to be 90 degrees according to the user's face orientation information, and finally the orientation of the video playback viewing angle is adjusted to the left by 90 degrees. It can be seen from FIG. 9 that before adjustment, the orientation of the playback angle of view is directly facing the left of the second area, and after adjusting the orientation of the video playback angle of view to the left by 90 degrees, the orientation of the playback angle of view is directly facing the front of the second area.

It can be understood that the user can also move the orientation of the viewing angle of the video up or down by turning the face up or down (that is, looking up or down).

For another example, as shown in FIG. 10, the user in the first area is watching the video of the house through the smart screen in front. When the user wants to move the viewing angle position of the video backward, the user can move the After moving M3, the smart screen obtains the user's movement information through the collection device and measures the distance between the user and the boundary of the first rear area as a, and then the smart screen obtains the distance between the position of the current viewing angle and the boundary of the second rear area as b , and then the smart screen first determines the position adjustment direction of the playback angle of view according to the user's movement information to be backward, and then determines the position adjustment distance of the playback angle of view according to the user's movement information, the first distance and the second distance as M3*(a/b)=M4 , and finally move the viewing angle of the video backwards by M4.

For another example, as shown in Figure 11, the user in the first area is watching the video of the house through the smart screen in front. When the user wants to move the viewing angle of the video to the right, the user can move to the Move M5 to the right, the smart screen obtains the user's movement information through the acquisition device and measures the distance between the user and the boundary of the first area on the right as a, and then the smart screen obtains the distance between the position of the current viewing angle and the boundary of the second area on the right It is b, and then the smart screen first determines the position adjustment direction of the playback angle of view according to the user's movement information to the right, and then determines the position adjustment distance of the playback angle of view according to the user's movement information, the first distance and the second distance as M5*(a/b) = M6, and finally move the viewing angle position of the video backwards by M6.

The above specific methods of collecting the user's face orientation information, collecting the user's movement information, and measuring the distance can be processed by any method conceivable by those skilled in the art, which is not specifically limited in this embodiment of the present application. For example, user face orientation information and user movement information can be collected through infrared detection, wearable sensors, and indoor positioning.

The smart screen can also adjust the viewing angle of the video according to the user's face orientation information and user movement information to simulate events (such as touch gesture events, voice events, etc.).

Exemplarily, the VR application supports left-swipe, right-swipe, up-slide, down-slide, and double-tap touch gesture events to adjust the playing angle of the video. Among them, the left sliding touch gesture event corresponds to adjusting the orientation of the playback viewing angle to the right, the right sliding touch gesture event corresponds to adjusting the orientation of the playback viewing angle to the left, the upward sliding touch gesture event corresponds to adjusting the orientation of the playback viewing angle downward, and the sliding touch gesture event corresponds to adjusting the orientation of the playback viewing angle downward. The gesture event corresponds to adjusting the orientation of the playback angle upward, and the double-tap touch gesture event corresponds to adjusting the position of the playback angle forward. When a user watches a video through a VR application, the smart screen can collect and simulate the above-mentioned touch gesture events to adjust the viewing angle of the video according to the user's face orientation information and user movement information. For example, the user's face orientation information collected by the smart screen indicates that the direction of the user's face orientation is upward (that is, head up), and the smart screen can simulate a sliding touch gesture event based on this information, thereby adjusting the orientation of the playback viewing angle upward. For another example, if the user movement information collected by the smart screen indicates that the direction of the user's movement is forward, the smart screen can simulate a double-tap touch gesture event based on this information, thereby adjusting the position of the playback angle of view forward.

The video playing method provided by the embodiment of the present invention will be described in detail below in conjunction with the accompanying drawings.

As shown in Figure 12, the embodiment of the present invention provides a video playback method, including:

S1201. The video playback device collects target information.

Wherein, the target information includes the user's face orientation information and user movement information, the user's face orientation information is used to represent the direction of the user's face orientation, and the user movement information is used to represent the user's movement direction.

In a possible manner, the video playback device may collect target information through a collection unit, and the collection unit includes at least one of an image collection unit, a sound collection unit, or an infrared collection unit.

In another possible implementation manner, the video playback device may receive the collection information sent by the collection device. Wherein, the collected information includes target information.

S1202. The video playing device adjusts the playing angle of the video according to the target information.

In a possible implementation manner, the video playback device may first adjust the orientation of the playback angle of view according to the user's face orientation information, and then adjust the position of the playback angle of view according to the user's movement information.

In a possible implementation manner, the above-mentioned adjustment of the orientation of the playback angle of view according to the user's face orientation information includes: determining the orientation adjustment direction of the playback angle of view according to the user's face orientation information; adjusting the orientation of the playback angle of view according to the orientation adjustment direction and a preset orientation adjustment amount. towards.

In another possible implementation manner, the above-mentioned adjusting the orientation of the playback angle of view according to the user's face orientation information may include: determining adjustment information according to the user's face orientation information; and adjusting the orientation of the playback angle of view according to the adjustment information. Wherein, the adjustment information is used to represent the direction of the orientation of the adjusted playback angle of view and the angle of the orientation of the playback angle of view.

Optionally, the direction of the adjusted playback viewing angle and the direction of the user's face may be the same.

Optionally, the angle of the adjusted playing angle of view may be the same as the angle of the user's face.

In a possible implementation manner, the above-mentioned adjusting the position of the playback angle of view according to the user movement information includes: determining the position adjustment direction of the playback angle of view according to the user movement information; and adjusting the position of the playback angle of view according to the position adjustment direction and the preset position adjustment amount.

In another possible implementation manner, adjusting the position of the playback angle of view according to the user movement information includes: determining the position adjustment direction and the position adjustment distance of the playback angle of view according to the user movement information; adjusting the direction and position adjustment distance according to the position adjustment The position of the playback camera.

For example, in Figure 9, when the user's face is not rotated 90 degrees to the left, the user's face and the playback angle of view are both facing forward. If the user moves backward, the second distance used when calculating the movement distance of the playback angle of view is the playback The vertical distance between the position of the viewing angle and the border of the second area behind. After the user's face rotates 90 degrees to the left and returns to normal, the user's face is facing forward but the playback angle of view is facing right. If the user moves backward, the second distance used when calculating the movement distance of the playback angle of view is no longer The vertical distance between the position of the playback angle of view and the boundary of the second rear area, but the vertical distance between the position of the playback angle of view and the boundary of the second area on the left.

It can be seen that in the video playing method provided by the present invention, when the user adjusts the playing angle of the video, the user does not need to manipulate the mouse or touch the screen, but directly changes the face orientation and moves the body, so that the playing angle of the video can be adjusted accordingly. It can be adjusted according to the user's actions, thereby improving the sense of interaction when the user adjusts the viewing angle of the video, reducing the sense of immersion when the user is watching the video, and improving the user experience.

The embodiment of the present invention also provides a video playback device, the device includes a processing unit, the processing unit is used to: collect target information, the target information includes user facial orientation information and user movement information, and the user facial orientation information is used to represent the user's facial orientation The direction of the user's movement information is used to represent the direction of the user's movement; adjust the viewing angle of the video according to the target information.

In a possible implementation manner, the processing unit is specifically configured to: determine an orientation adjustment direction of the playback viewing angle according to the user's face orientation information; and adjust the orientation of the playback viewing angle according to the orientation adjustment direction and a preset orientation adjustment amount.

In another possible implementation manner, the processing unit is specifically configured to: determine adjustment information according to the user's face orientation information, where the adjustment information is used to characterize the orientation of the adjusted playback viewing angle and the orientation angle of the playback viewing angle; Adjust the orientation of the playback perspective.

In a possible implementation manner, the processing unit is specifically configured to: determine the position adjustment direction of the playback angle of view according to the user movement information; and adjust the position of the playback angle of view according to the position adjustment direction and the preset position adjustment amount.

In another possible implementation manner, the processing unit is specifically configured to: determine the position adjustment direction of the playback angle of view and the position adjustment distance of the playback angle of view according to the user movement information; and adjust the position of the playback angle of view according to the position adjustment direction and the position adjustment distance.

In a possible implementation manner, the processing unit is specifically configured to: collect target information through a collection unit, where the collection unit includes at least one of an image collection unit, a sound collection unit, or an infrared collection unit.

In another possible implementation manner, the processing unit is specifically configured to: receive collection information sent by the collection device, where the collection information includes target information.

An electronic device for performing the above video playing method will be introduced below with reference to FIG. 13 and FIG. 14 .

It can be understood that, in order to realize the above functions, the electronic device includes hardware and/or software modules corresponding to each function. Combining the algorithm steps of each example described in the embodiments disclosed herein, the present invention can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions in combination with the embodiments for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

In the embodiment of the present invention, the functional modules of the electronic device may be divided according to the above method examples. For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The above integrated modules may be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic, and is only a logical function division, and there may be other division methods in actual implementation.

In the case of dividing each functional module corresponding to each function, FIG. 13 shows a possible composition diagram of the electronic device involved in the above embodiment. As shown in FIG. 13 , the apparatus 1300 may include: a transceiver unit 1301 and a processing A unit 1302, the processing unit 1302 may implement the method executed by the electronic device in the foregoing method embodiments, and/or other processes used in the technologies described herein.

It should be noted that all relevant content of the steps involved in the above method embodiments can be referred to the function description of the corresponding function module, and will not be repeated here.

In case of an integrated unit, the apparatus 1300 may include a processing unit, a storage unit and a communication unit. Wherein, the processing unit may be used to control and manage the actions of the apparatus 1300, for example, may be used to support the apparatus 1300 to execute the steps performed by the above-mentioned units. The storage unit may be used to support the device 1300 to execute stored program codes, and/or data, and the like. The communication unit may be used to support communication of the apparatus 1300 with other devices.

Wherein, the processing unit may be a processor or a controller. It can implement or execute the various illustrative logical blocks, modules and circuits described in connection with the present disclosure. The processor can also be a combination of computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (digital signal processing, DSP) and a microprocessor, and the like. The storage unit may be a memory. Specifically, the communication unit may be a radio frequency circuit, a bluetooth chip, a wireless fidelity (wireless fidelity, Wi-Fi) chip, and other devices that interact with other electronic devices.

In a possible implementation manner, the electronic device involved in this embodiment of the present invention may be an apparatus 1400 having the structure shown in FIG. 14 , where the apparatus 1400 includes a processor 1401 and a transceiver 1402 . Related functions implemented by the transceiver unit 1301 and the processing unit 1302 in FIG. 13 may be implemented by the processor 1401 .

Optionally, the apparatus 1400 may further include a memory 1403, and the processor 1401 and the memory 1403 communicate with each other through an internal connection path. The relevant functions implemented by the storage unit in FIG. 13 may be implemented by the memory 1403 .

The embodiment of the present invention also provides a computer storage medium, the computer storage medium stores computer instructions, and when the computer instructions are run on the electronic device, the electronic device executes the above related method steps to realize the video playback in the above embodiment method.

An embodiment of the present invention also provides a computer program product, which, when running on a computer, causes the computer to execute the above-mentioned related steps, so as to realize the video playing method in the above-mentioned embodiment.

The embodiment of the present invention also provides an electronic device, and this device may specifically be a chip, an integrated circuit, a component or a module. Specifically, the device may include a connected processor and a memory for storing instructions, or the device may include at least one processor for fetching instructions from an external memory. When the device is running, the processor can execute instructions, so that the chip executes the video playing method in the above method embodiments.

FIG. 15 shows a schematic structural diagram of a chip 1500 . The chip 1500 includes one or more processors 1501 and an interface circuit 1502 . Optionally, the above-mentioned chip 1500 may further include a bus 1503 .

The processor 1501 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above video playing method may be completed by an integrated logic circuit of hardware in the processor 1501 or instructions in the form of software.

Optionally, the above-mentioned processor 1501 may be a general-purpose processor, a digital signal processing (digital signal processing, DSP) device, an integrated circuit (application specific integrated circuit, ASIC), a field-programmable gate array (field-programmable gate array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Various methods and steps disclosed in the embodiments of the present invention may be implemented or executed. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like.

The interface circuit 1502 can be used for sending or receiving data, instructions or information. The processor 1501 can use the data, instructions or other information received by the interface circuit 1502 to process, and can send the processing completion information through the interface circuit 1502 .

Optionally, the chip further includes a memory, which may include a read-only memory and a random access memory, and provides operation instructions and data to the processor. A portion of the memory may also include non-volatile random access memory (NVRAM).

Optionally, the memory stores executable software modules or data structures, and the processor can execute corresponding operations by calling operation instructions stored in the memory (the operation instructions can be stored in the operating system).

Optionally, the chip can be used in the electronic device or DOP involved in the embodiment of the present invention. Optionally, the interface circuit 1502 may be used to output an execution result of the processor 1501 . Regarding the video playing method provided by one or more embodiments of the present invention, reference may be made to the foregoing embodiments, and details are not repeated here.

It should be noted that the corresponding functions of the processor 1501 and the interface circuit 1502 can be realized by hardware design, software design, or a combination of software and hardware, which is not limited here.

Wherein, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is all used to execute the corresponding method provided above, therefore, the beneficial effects it can achieve can refer to the corresponding method provided above The beneficial effects in the method will not be repeated here.

An embodiment of the present invention also provides a terminal device, where the terminal device includes the above-mentioned electronic device. Optionally, the terminal device is a vehicle or an intelligent robot.

It should be understood that in various embodiments of the present invention, the sequence numbers of the above-mentioned processes do not mean the order of execution, and the execution order of each process should be determined by its functions and internal logic, rather than by the embodiment of the present invention. The implementation process constitutes any limitation.

Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the above units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or can be Integrate into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.

If the above functions are realized in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the above-mentioned methods in various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other various media that can store program codes.

The first application in the embodiment of the present invention is an application related to audio content. Of course, optionally, the first application may also be extended to an application of video content, or an application of audio and video content.

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

A video playback method, characterized in that the method comprises:

Collect target information, the target information includes user face orientation information and user movement information, the user face orientation information is used to represent the direction of the user's face orientation, and the user movement information is used to represent the user's movement direction;

The playing angle of the video is adjusted according to the target information.
The method according to claim 1, wherein the adjusting the playing angle of the video according to the target information comprises:

Adjusting the orientation of the playing angle of view according to the user's face orientation information;

Adjusting the position of the playing angle of view according to the user movement information.
The method according to claim 2, wherein the adjusting the orientation of the playback viewing angle according to the user's face orientation information comprises:

determining an orientation adjustment direction of the playing angle of view according to the user's face orientation information;

The orientation of the playback viewing angle is adjusted according to the orientation adjustment direction and a preset orientation adjustment amount.
The method according to claim 2, wherein the face orientation information is also used to characterize the angle of the user's face orientation, and the adjusting the orientation of the playback viewing angle according to the user's face orientation information includes:

Determine adjustment information according to the user's face orientation information, where the adjustment information is used to characterize the adjusted direction of the playing angle of view and the angle of the orientation of the playing angle of view;

Adjusting the orientation of the playback viewing angle according to the adjustment information.
The method according to any one of claims 2 to 4, wherein the adjusting the position of the playing angle of view according to the user movement information comprises:

determining the position adjustment direction of the playing angle of view according to the user movement information;

The position of the playing angle of view is adjusted according to the position adjustment direction and the preset position adjustment amount.
The method according to any one of claims 2 to 4, wherein the user movement information is also used to characterize the distance moved by the user, and the adjusting the position of the playing angle of view according to the user movement information includes :

determining a position adjustment direction of the playback viewing angle and a position adjustment distance of the playback viewing angle according to the user movement information;

Adjusting the position of the playing angle of view according to the position adjustment direction and the position adjustment distance.
The method according to any one of claims 1 to 6, wherein the collecting target information includes:

The target information is collected by a collection unit, and the collection unit includes at least one of an image collection unit, a sound collection unit, or an infrared collection unit.
The method according to any one of claims 1 to 6, wherein the collecting target information includes:

The collection information sent by the collection device is received, where the collection information includes the target information.
A video playback device, characterized in that it includes a processing unit, the processing unit is used for:

Collect target information, the target information includes user face orientation information and user movement information, the user face orientation information is used to represent the direction of the user's face orientation, and the user movement information is used to represent the user's movement direction;

The playing angle of the video is adjusted according to the target information.
The device according to claim 9, wherein the processing unit is specifically used for:

Adjusting the orientation of the playing angle of view according to the user's face orientation information;

Adjusting the position of the playing angle of view according to the user movement information.
The device according to claim 10, wherein the processing unit is specifically used for:

determining an orientation adjustment direction of the playing angle of view according to the user's face orientation information;

The orientation of the playback viewing angle is adjusted according to the orientation adjustment direction and a preset orientation adjustment amount.
The device according to claim 10, wherein the face orientation information is also used to characterize the angle of the user's face orientation, and the processing unit is specifically used for:

Determine adjustment information according to the user's face orientation information, where the adjustment information is used to characterize the adjusted direction of the playing angle of view and the angle of the orientation of the playing angle of view;

Adjusting the orientation of the playback viewing angle according to the adjustment information.
The device according to any one of claims 10 to 12, wherein the processing unit is specifically configured to:

determining the position adjustment direction of the playing angle of view according to the user movement information;

The position of the playing angle of view is adjusted according to the position adjustment direction and the preset position adjustment amount.
The device according to any one of claims 10 to 12, wherein the user movement information is also used to characterize the distance moved by the user, and the processing unit is specifically used for:

determining a position adjustment direction of the playback viewing angle and a position adjustment distance of the playback viewing angle according to the user movement information;

Adjusting the position of the playing angle of view according to the position adjustment direction and the position adjustment distance.
The device according to any one of claims 9 to 14, wherein the processing unit is specifically configured to:

The target information is collected by a collection unit, and the collection unit includes at least one of an image collection unit, a sound collection unit, or an infrared collection unit.
The device according to any one of claims 9 to 14, wherein the processing unit is specifically configured to:

The collection information sent by the collection device is received, where the collection information includes the target information.
A chip device, including a memory and a processor, the memory is coupled to the processor, the memory stores codes, the processor is configured to execute the codes, and when the codes are executed, the above-mentioned The method according to any one of claims 1 to 8.
A computer-readable storage medium for storing a computer program, wherein the computer program includes instructions for implementing the method according to any one of claims 1 to 8 above.
A computer program product, the computer program product contains instructions, characterized in that, when the instructions are run on a computer or a processor, the computer or the processor is made to implement any of the preceding claims 1 to 8. one of the methods described.
An electronic device, characterized by comprising the video playing device according to any one of claims 9 to 16.
The electronic device according to claim 20, wherein the electronic device is a smart screen.