WO2020206647A1 - Procédé et appareil pour commander, au moyen du suivi du mouvement d'utilisateur, la lecture d'un contenu vidéo - Google Patents

Procédé et appareil pour commander, au moyen du suivi du mouvement d'utilisateur, la lecture d'un contenu vidéo Download PDF

Info

Publication number
WO2020206647A1
WO2020206647A1 PCT/CN2019/082177 CN2019082177W WO2020206647A1 WO 2020206647 A1 WO2020206647 A1 WO 2020206647A1 CN 2019082177 W CN2019082177 W CN 2019082177W WO 2020206647 A1 WO2020206647 A1 WO 2020206647A1
Authority
WO
WIPO (PCT)
Prior art keywords
video content
angle
user
display screen
line
Prior art date
Application number
PCT/CN2019/082177
Other languages
English (en)
Chinese (zh)
Inventor
陈泽天
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN202410565748.XA priority Critical patent/CN118400584A/zh
Priority to PCT/CN2019/082177 priority patent/WO2020206647A1/fr
Priority to CN201980078423.6A priority patent/CN113170231A/zh
Publication of WO2020206647A1 publication Critical patent/WO2020206647A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content

Definitions

  • This application relates to the field of video technology, and in particular to a method and device for playing video content following user motion control.
  • the continuous development of video technology makes the video more high-definition and more three-dimensional.
  • the video screens that are played are edited by the on-site director.
  • the audience cannot watch the interesting parts according to their own choices like in the video recording site, resulting in poor user experience.
  • the embodiments of the present application provide a method and device for playing video content according to the user's motion control, which controls the played video content according to the user's position, which increases the user's sense of presence and perspective of watching the video, and improves the user experience.
  • a method for playing video content following user motion control includes:
  • the relative position is obtained by the sensor when the display device is playing the video; the target video content is determined in the video source according to the relative position, and the target video content is the visual range of the video source when the user is at the relative position Matching video content; the target video content is played on the display screen of the display device, so that the video content follows the user's movement and improves the user experience.
  • the method for controlling playback of video content obtains the relative position of the user and the display device, and determines the target video content in the video source according to the relative position.
  • the target video content is the line of sight of the video source when the user is at the relative position
  • the video content that matches the scope is played, and the target video content is played on the display screen of the display device. This realizes that the played video follows the user's movement, so that the user can choose the angle and field of view to watch the video according to the user’s personal interest.
  • the relative position of the display device presents the video content of different viewing angles to the audience, increases the presence and perspective of the video program, simulates the feeling of being on the scene, and improves the user experience.
  • determining the target video content in the video source according to the relative position includes: determining the line of sight angle of the user in the relative position according to the relative position, and the line of sight angle is used for Reflects the line of sight range, the line of sight angle is the spatial angle of the user’s line of sight, the line of sight of the user is the connection between the user’s eyes and the center point of the display screen when the user is in a relative position; the target video content is determined from the video source according to the line of sight angle, and the target video content is Video content that matches the user’s eye angle.
  • the line of sight angle includes a first angle and a second angle; the first angle is that the user's line of sight is mapped onto the xy plane
  • the xy plane is the plane formed by the x-axis and the y-axis;
  • the second angle is the included angle with the z-axis when the user’s line of sight is mapped to the yz plane, the yz plane is y
  • the plane, the x-axis, y-axis and z-axis intersect at the origin
  • determining the target video content from the video source according to the line-of-sight angle includes: Determine the target video content in the video source, the projection of the connection between the center point of the target video content and the center point of the display screen on the xy plane and the y axis is the first angle, and the center point of the target video content and the display screen The video content of the second angle between the projection of the line of the center point on the yz plane and the z axis is the target video content.
  • the relative position is the distance L1 between the user and the center point of the display screen
  • the video source includes the video shooting distance L2 and the video content Viewing angle range
  • L2 is the distance from the video content of the video source to the center point of the display screen
  • determine the target video content in the video source according to the relative position including: determining the target according to the line of sight angle, L1, L2, viewing angle range and the size of the display screen Video content.
  • the viewing angle range includes the horizontal display viewing angle and the vertical display viewing angle.
  • the horizontal display viewing angle is the video content of the video source mapped to xy
  • the display range angle on the plane, the vertical display angle of view is the display range angle of the video content of the video source mapped to the yz plane;
  • the size of the display includes the width D of the display and the height H of the display; according to the line of sight angle, L1, L2 .
  • the viewing angle range and the size of the display screen determine the target video content, including: determining the display range of the target video content on the xy plane according to the first angle, L1, L2, horizontal display viewing angle, and the width D of the display screen; according to the second angle, L1, L2, the vertical display viewing angle and the height H of the display screen determine the display range of the target video content on the yz plane.
  • determining the target video content in the video source according to the relative position includes: determining the connection between the user's eyes and the center point of the display screen when the user is in the relative position The first intersection with the video source; the video content in the video source with the first intersection as the center point and the same aspect ratio as the display screen is taken as the target video content.
  • determining the target video content in the video source according to the relative position includes: according to the relative position and user movement The speed determines the target video content.
  • the method further includes: obtaining user action information; and determining the target video according to the relative position and the action information content.
  • determining the target video content according to the relative position and motion information includes: determining the first in the video source according to the relative position Video content; the presentation rule of the pre-stored video content is determined according to the action information, and the presentation rule corresponds to the action information; the target video content is determined according to the first video content and the presentation rule.
  • the motion information includes information about telescope gestures, information about gestures for pushing both hands forward, and hands backward. Move at least one of the gestures.
  • determining the target video content according to the first video content and the presentation rule includes: The center point of the video content is the center to enlarge or reduce the first video content to determine the target video content.
  • determining the target video content in the video source according to the relative position includes: according to the relative position Determine the cropping or scaling strategy of the video source to obtain the target video content.
  • the video source includes at least one of the following: a video with a resolution greater than or equal to 4K, a field of view Video with an angle greater than or equal to 140 degrees, or long strip video.
  • the preset second video content in the initial state, is displayed on the display screen, The second video content is part of the video content of the video source.
  • a device for playing video content following user motion control includes a processor and a transmission interface; the transmission interface is used to receive the position of the user obtained by the sensor when the user watches the video; and the processor is used to Determine the target video content in the video source according to the user's location.
  • the target video content is the video content in the video source that matches the user's line of sight at the location; the transmission interface is also used to transmit the target video content to the display screen , In order to make the display screen play the target video content, realize the video content follows the user's movement, and improve the user experience.
  • both the processor and the transmission interface belong to the chip, or it can be said that the transmission interface is an interface used by the processor to send and receive data.
  • the processor is specifically configured to determine the line-of-sight angle of the user at the location according to the position of the user, the line-of-sight angle is used to reflect the line-of-sight range, and the line-of-sight angle It is the spatial angle of the user's line of sight, which is the connection between the user's eyes and the center point of the display screen when the user is at the position; the target video content is determined from the video source according to the line of sight angle, and the target video content is the line of sight angle matching the user Video content.
  • the line of sight angle includes a first angle and a second angle; the first angle is that the user's line of sight is mapped onto the xy plane
  • the xy plane is the plane formed by the x-axis and the y-axis;
  • the second angle is the included angle with the z-axis when the user’s line of sight is mapped to the yz plane, the yz plane is y
  • the plane, the x-axis, y-axis and z-axis intersect at the origin
  • the processor is specifically configured to: determine the target video content from the video source according to the first angle and the second angle,
  • the connection between the center point of the target video content and the center point of the display screen is the first angle between the projection on the xy plane and the y axis, and the line between the center point of the target video content and the center point of the display screen is at yz
  • the video content with the second angle between the projection on the plane and the z-axis is the target video content.
  • the position of the user and the display device is the distance L1 between the user and the center point of the display screen
  • the video source includes the video shooting distance L2 and the viewing angle range of the video content
  • L2 is the distance from the video content of the video source to the center point of the display screen
  • the processor is specifically used to determine the target video content according to the line of sight angle, L1, L2, viewing angle range and the size of the display screen.
  • the viewing angle range includes the horizontal display viewing angle and the vertical display viewing angle
  • the horizontal display viewing angle is the video content of the video source mapped to xy
  • the display range angle on the plane, the vertical display angle of view is the display range angle of the video content of the video source mapped to the yz plane
  • the size of the display screen includes the width D of the display screen and the height H of the display screen
  • the processor is specifically used for: The first angle, L1, L2, horizontal display angle of view and the width D of the display screen determine the display range of the target video content on the xy plane; the target video is determined according to the second angle, L1, L2, vertical display angle of view and the height H of the display screen The display range of the content on the yz plane.
  • the processor is specifically configured to: determine that the connection between the user's eyes and the center point of the display screen when the user is at the position and the first line of the video source Intersection point: The video content in the video source with the first intersection point as the center point and the same aspect ratio as the display screen is taken as the target video content.
  • the processor is specifically configured to: determine the target video according to the position of the user and the speed of the user's movement content.
  • the transmission interface is also used to receive the user's motion information obtained by the sensor; the processor; It is also used to determine the target video content according to the user's location and action information.
  • the processor is specifically configured to: determine the first video content in the video source according to the location of the user; and according to the action information Determine the presentation rule of the pre-stored video content, and the presentation rule corresponds to the action information; determine the target video content according to the first video content and the presentation rule.
  • the action information includes information about the telescope gesture, information about the gesture of pushing both hands forward, and the information about the gesture of pushing both hands backward. Move at least one of the gestures.
  • the processor is specifically configured to: zoom in or out with the center point of the first video content as the center The first video content is reduced to determine the target video content.
  • the processor is specifically configured to: determine the crop or zoom of the video source according to the user's position Strategies to obtain target video content.
  • the video source includes at least one of the following: a video with a resolution greater than or equal to 4K, a field of view A video with a degree of 140 degrees or more, or a long strip video.
  • the transmission interface is also used to transmit the preset second video content to the display screen , So that the display screen plays the second video content.
  • the device includes a display screen.
  • the device includes a camera, and the camera includes an image sensor.
  • a device for playing video content following user motion control includes:
  • the receiving unit is used to receive the location of the user acquired by the sensor when the user is watching the video; the determining unit is used to determine the target video content in the video source according to the user's location, and the target video content is the time when the user is in the video source and the user is at the location.
  • the sending unit is used to transmit the target video content to the display screen, so that the display screen can play the target video content, so that the video content follows the user's movement and improves the user experience.
  • the determining unit is specifically configured to:
  • the line-of-sight angle is used to reflect the line of sight range.
  • the line-of-sight angle is the spatial angle of the user's line of sight.
  • the line of sight of the user is the center point of the user's eyes and the display screen when the user is at the position
  • the connection; the target video content is determined from the video source according to the line of sight angle, and the target video is also the video content that matches the user’s line of sight angle.
  • the line of sight angle includes a first angle and a second angle; the first angle is that the user's line of sight is mapped onto the xy plane
  • the xy plane is the plane formed by the x-axis and the y-axis;
  • the second angle is the included angle with the z-axis when the user’s line of sight is mapped to the yz plane, the yz plane is y
  • the plane, the x-axis, y-axis and z-axis intersect at the origin
  • the determining unit determines the target video content from the video source according to the first angle and the second angle.
  • the projection of the connection between the central point and the central point of the display screen on the xy plane and the y-axis is the first angle
  • the projection of the connection between the central point of the target video content and the central point of the display screen on the yz plane is the target video content.
  • the position of the user and the display device is the distance L1 between the user and the center point of the display
  • the video source includes the video shooting distance L2 and the viewing angle range of the video content
  • L2 is the distance from the video content of the video source to the center point of the display screen
  • the determining unit is specifically used to determine the target video content according to the line of sight angle, L1, L2, the viewing angle range and the size of the display screen.
  • the viewing angle range includes the horizontal display viewing angle and the vertical display viewing angle
  • the horizontal display viewing angle is the video content of the video source mapped to xy
  • the display range angle on the plane is the display range angle of the video content of the video source mapped to the yz plane
  • the size of the display screen includes the width D of the display screen and the height H of the display screen
  • the determining unit is specifically used for: The first angle, L1, L2, horizontal display angle of view and the width D of the display screen determine the display range of the target video content on the xy plane; the target video is determined according to the second angle, L1, L2, vertical display angle of view and the height H of the display screen The display range of the content on the yz plane.
  • the determining unit is specifically configured to: determine that the connection between the user's eyes and the center point of the display screen when the user is at the position and the first line of the video source Intersection point: The video content in the video source with the first intersection point as the center point and the same aspect ratio as the display screen is taken as the target video content.
  • the determining unit is specifically configured to: determine the target video according to the position of the user and the speed of the user's movement content.
  • the receiving unit is further configured to receive the user's motion information obtained by the sensor; the determining unit , Also used to determine the target video content based on the user’s location and action information.
  • the determining unit is specifically configured to: determine the first video content in the video source according to the location of the user; and according to the action information Determine the presentation rule of the pre-stored video content, and the presentation rule corresponds to the action information; determine the target video content according to the first video content and the presentation rule.
  • the motion information includes information on the telescope gesture, information on the gesture of pushing both hands forward, and the hands backward Move at least one of the gestures.
  • the determining unit is specifically configured to: zoom in or out with the center point of the first video content as the center The first video content is reduced to determine the target video content.
  • the determining unit is specifically configured to: determine the cropping or scaling of the video source according to the user's position Strategies to obtain target video content.
  • the video source includes at least one of the following: a video with a resolution greater than or equal to 4K, a field of view A video with a degree of 140 degrees or more, or a long strip video.
  • the sending unit is further configured to transmit the preset second video content to the display screen , So that the display screen plays the second video content.
  • a computer-readable storage medium is provided, and instructions are stored in the computer-readable storage medium.
  • the instructions are executed on a computer or a processor, the computer or the processor executes the first aspect or any of the first aspects.
  • a computer program product containing instructions, which when running on a computer or processor, causes the computer or processor to execute the method in the first aspect or any possible implementation of the first aspect.
  • the relative position of the user and the display device Based on the provided method and device for following user motion control to play video content, obtain the relative position of the user and the display device, and determine the target video content in the video source according to the relative position.
  • the target video content is when the user is in the relative position of the video source
  • the target video content is played on the display screen of the display device, which realizes that the played video follows the user's movement, so that the user can choose the angle and field of view of the video according to the part of the user’s personal interest.
  • the relative position of the user and the display device presents the video content of different viewing angles to the audience, increasing the presence and perspective of the video program, simulating the feeling of being in person, and improving the user experience.
  • Fig. 1a is a schematic diagram of video content in a video source provided by an embodiment of the present application
  • FIG. 1b is a schematic diagram of video content in another video source provided by an embodiment of the present application.
  • FIG. 2 is a schematic diagram of a sight range provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a user's sight range after the user moves a position according to an embodiment of the present application
  • FIG. 4 is a schematic diagram of a viewing angle provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of determining target video content in a horizontal direction according to an embodiment of the present application.
  • FIG. 6 is a schematic diagram of determining target video content in a vertical direction according to an embodiment of the present application.
  • FIG. 7 is another schematic diagram of determining target video content in a horizontal direction according to an embodiment of the present application.
  • FIG. 8 is another schematic diagram of determining target video content in a vertical direction according to an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of a display device provided by an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of another display device provided by an embodiment of the present application.
  • FIG. 11 is a schematic diagram of a flow of controlling playing video content according to an embodiment of the present application.
  • FIG. 12 is a schematic flowchart of a method for playing video following user motion control provided by an embodiment of the present application.
  • FIG. 13 is a schematic diagram of a sight range provided by an embodiment of the present application.
  • FIG. 14 is a schematic diagram of another sight range provided by an embodiment of the present application.
  • 15 is a schematic diagram of a line of sight range provided by an embodiment of the present application.
  • FIG. 16 is a schematic diagram of a sight range provided by an embodiment of the present application.
  • FIG. 17 is a schematic diagram of a sight range provided by an embodiment of the present application.
  • FIG. 18 is a schematic flowchart of a method for playing video content following user motion control provided by an embodiment of the present application
  • FIG. 19a is a schematic diagram of a sight range provided by an embodiment of the present application.
  • FIG. 19b is a schematic diagram of another sight range provided by an embodiment of the present application.
  • 20 is a schematic structural diagram of an apparatus for playing video content following user motion control provided by an embodiment of the present application.
  • FIG. 21 is a schematic structural diagram of a device for playing video content following user motion control provided by an embodiment of the present application.
  • FIG. 22 is a schematic structural diagram of an apparatus for playing video content following user motion control provided by an embodiment of the present application.
  • the embodiments of the present application provide a method and device for playing video content according to user motion control, which can be applied to various scenarios, such as Program rebroadcast (such as sports match rebroadcast), advertising machine and other scenes.
  • Program rebroadcast such as sports match rebroadcast
  • advertising machine advertising machine
  • an ultra-wide-angle or panoramic camera is first used to record an ultra-high-definition video with a resolution greater than or equal to 4K, for example, a 4K-resolution ultra-high-definition video or an 8K-resolution ultra-high-definition video.
  • the ultra-high-definition video recorded in this solution can watch the video content in the entire scene as shown in Figure 1a, while the traditional recorded video can only watch part of the video content in the entire scene as shown in Figure 1b.
  • the device When the ultra-high-definition video starts to be played on the display, the device only presents (or displays) the video content within the conventional angle of view in the video content to the user.
  • the original video is a video in the 8K resolution range, and only the middle is displayed by default.
  • videos in the 4K resolution range, as shown in Figure 2 the wide-angle part of the edge is not displayed.
  • the field of view also known as the field of view
  • the visual field is divided into static visual field and dynamic visual field; static visual field refers to the spatial range that can be seen by the eyes when looking at the object directly in front of the person with the head and eyeballs fixed; dynamic visual field refers to what the eyes can see when turning Visible spatial extent. Static vision and dynamic vision are often expressed by angles.
  • the field of view is called the line of sight range, and the line of sight is the connection line between the user's eyes and the center point of the display screen, as shown in FIG. 2.
  • the device When the device detects the user's movement, that is, when the device detects that the user watching the video changes the viewing position, the device determines the user's view in the video source according to the relative position of the user equipment, and the user's line of sight and the line of sight of the display device And play the video content on the screen of the display device.
  • the line of sight angle is used to reflect the line of sight range, and the line of sight angle is the spatial angle of the user's line of sight.
  • the video content in the user's field of view may not be the same video content of the video source, as shown in Figure 2 and Figure 3, where Figure 2 can be considered as the user’s
  • Figure 3 is the user's line of sight after moving the location.
  • Using the method of following the user’s motion to control the playback of video content produces the effect of the line of sight moving following the user’s movement, so that the played video content moves with the user’s motion, simulating the effect of on-site viewing, and allowing the user to experience an immersive scene. Improve the user experience.
  • the device includes a sensor, for example, the device includes a camera, and the sensor is located in the camera of the device.
  • the sensor may be an image sensor, an ultrasonic sensor, or an infrared sensor in the camera, and is used to obtain the relative position of the user and the display device.
  • the camera can acquire the location of a specific user among multiple users; in one embodiment, the camera can acquire the location of multiple users at the same time.
  • the device obtains the relative position of the user through the camera, it calculates the line of sight of each user at its relative position and the line of sight angle of the display device; where the line of sight of the user is the line connecting the user's eyes and the center point of the display screen, as shown in Figure 4. Shown.
  • the center point of the display screen is called the origin
  • the axis passing through the origin and perpendicular to the plane where the display screen is located is called the y axis
  • the axis passing through the origin perpendicular to the ground and parallel to the plane where the display screen is located is called the z axis.
  • the axis passing through the origin parallel to the plane of the display screen and perpendicular to the y-axis and z-axis is called the x-axis;
  • the plane formed by the x-axis and the y-axis is called the xy plane (also called the horizontal plane, the direction pointed by the x-axis)
  • the plane formed by the y-axis and the z-axis is called the yz plane (also called the vertical plane, and the direction pointed by the z-axis is called the vertical direction), and the plane formed by the x-axis and the z-axis is called the xz plane.
  • the device calculates the line of sight angle of the user in the relative position according to the relative position of the user.
  • the line of sight angle includes angle a (also called the first angle) and angle b (also called the second angle), as shown in FIG. 4.
  • the device calculates that the user’s line of sight is mapped to the xy plane and the included angle a with the y-axis, and the user’s line of sight is mapped to the yz plane, and the included angle b with the z-axis.
  • the included angle a is also called the horizontal angle.
  • Angle, the included angle b is also called the vertical included angle.
  • the device when the user moves relative to the display device, the device obtains the relative position of the user and the display device through the sensor, and the device calculates the line of sight angle of the user at the relative position, and determines the target video content in the video source according to the line of sight angle.
  • the video is the video content that will be played on the display screen after the user moves, and the target video content is played on the display screen of the display device, as shown in Figure 3, so that the user can select the angle of viewing the video according to the part of the user’s personal interest
  • the video content of different perspectives is presented to the audience, which increases the sense of presence and perspective of the video program, and plays the video content following the user's movement, so that the user can experience the scene when watching the video.
  • Feeling which simulates the feeling of on-site viewing, improves user experience.
  • the device determines the target video content in the video source according to the line of sight angle, including: the device determines the target video content from the video source according to the first angle and the second angle, and the connection between the center point of the target video content and the center point of the display screen is at xy
  • the angle between the projection on the plane and the y axis is the first angle, as shown in Figure 5, and the angle between the projection on the yz plane and the z axis of the connection between the center point of the target video content and the center point of the display screen is
  • the video content of the second angle (as shown in FIG. 6) is the target video content.
  • Fig. 5 is a schematic diagram of determining the target video content in the horizontal direction.
  • Fig. 6 is a schematic diagram of determining the target video content in the vertical direction.
  • the axis passing through the center point of the display screen of the display device and perpendicular to the plane where the display screen is located is called the y axis;
  • the axis perpendicular to the y axis and parallel to the plane where the display screen is located is called the z axis ;
  • the axis that is perpendicular to the y-axis and z-axis and parallel to the plane of the display is called the x-axis, and the x-axis, y-axis and z-axis intersect at the center of the display;
  • the direction of the x-axis is called the horizontal direction
  • the direction pointed by the z axis is called the vertical direction;
  • the plane formed by the x axis and the y axis is called the xy plane;
  • the angle formed by the projection of the user’s line of sight on the yz plane and the z-axis is the second angle, angle b, as shown in Figure 5, the connection between the center point of the display screen and the center point of the target video content and the z-axis
  • the included angle is also the second angle, namely angle b.
  • the angle between the projection of the user’s line of sight on the xy plane and the y-axis is the first angle, namely angle a, as shown in Figure 6, the connection between the center point of the display screen and the center point of the target video content and the y-axis
  • the included angle is also the first angle, namely angle a.
  • the line connecting the user's line of sight to the center point of the video content is projected onto the xy plane, and the angle between the y-axis is the first angle of the video content, and the line of sight of the user is determined to be connected to the center point of the video content.
  • the video content whose line projected to the yz plane and the z-axis is the second angle is the target video content.
  • the relative position of the user and the display device also includes the distance L1 from the user to the center point of the display screen, and the line-of-sight angle of the user watching the target video content, including angle a and angle b ,
  • the intersection a and angle b are the same as the angle a and angle b in FIG. 5 and FIG. 6.
  • the video content in the video source includes the shooting distance of the video content when the video content is shot, that is, the distance L2 from the video content in the video source to the center point of the display screen, and the viewing angle range of the video content, also known as the viewing angle.
  • the viewing angle range includes the display range angle of the video content of the video source mapped to the xy plane, that is, the horizontal angle range A (as shown in Figure 7), also known as the horizontal display angle of view, and the display range angle mapped to the yz plane, namely
  • the vertical angle range B (as shown in Figure 8) is also called the vertical display viewing angle.
  • the size of the display screen includes the width of the display screen being D and the height of the display screen being H.
  • the device determines the target video content in the video source according to the relative position of the user and the display device, including: the device determines the target video content according to the line of sight, distance L1, distance L2, viewing angle range, and the size of the display screen .
  • the specific process is:
  • the device determines the user's line of sight range in the xy plane according to the angle b, the distance L1, and the width D of the display device, that is, the horizontal line of sight range, and then according to the horizontal line of sight range, the distance L2 and the horizontal angle range A Determine the target video content in the xy plane.
  • the device determines the user's line of sight range in the yz plane according to the angle a, the distance L1 and the width of the display device, that is, the vertical line of sight range, and then the vertical line of sight range, as well as the distance L2 and the vertical angle range B.
  • the target video content in the yz plane is the user's line of sight range in the yz plane according to the angle a, the distance L1 and the width of the display device, that is, the vertical line of sight range, and then the vertical line of sight range, as well as the distance L2 and the vertical angle range B.
  • the device determines the display range of the target video content on the xy plane according to the angle b, the distance L1, the distance L2, the horizontal display viewing angle, and the width D of the display screen; the device determines the display range of the target video content on the xy plane according to the second angle, L1, L2, and the vertical display viewing angle and the display
  • the height H determines the display range of the target video content on the yz plane.
  • the device determines that the three-dimensional video content composed of the target video content in the x-y plane and the target video content in the y-z plane is the target video content.
  • the apparatus determines the target video content in the video source according to the relative position of the user and the display device, including:
  • the aspect ratio refers to the ratio of the width to the height of the video content.
  • there may be a certain distance between the display screen and the video source and the aspect ratio of the target video content displayed on the display screen is the same as the aspect ratio of the target video content determined in the video source, that is, the display screen displays
  • the target video content of is proportional to the target video content determined in the video source.
  • the embodiment of the application also provides a method for playing video content following the user's motion control.
  • the device obtains the user's motion information through the camera, such as gesture information, such as telescope gestures, open hands outward, close hands inward, and make camera gestures with both hands , One-hand forward and other gestures; according to the specific motion information, the video field of view is changed accordingly.
  • gesture information such as telescope gestures, open hands outward, close hands inward, and make camera gestures with both hands , One-hand forward and other gestures; according to the specific motion information, the video field of view is changed accordingly.
  • the device may be a display device 100, including a camera 110, a display screen 120, a decoder 130, and a processor 140.
  • the camera 110 may be set on a display device, for example, the display device may be a mobile phone, and the camera may be set on the mobile phone.
  • the camera 110 includes an image sensor.
  • the camera 110 may also be used as a supporting device of the display device 100.
  • the camera 110 and the display device may be connected via a USB or other high-speed bus.
  • the display device 100 may be a device that supports a video with a resolution greater than or equal to 4K, such as a TV with 4K resolution and 8K resolution video decoding and playback, a smart terminal (such as a mobile phone, a tablet computer), and other devices with a display screen and a camera.
  • 4K a video with a resolution greater than or equal to 4K
  • a smart terminal such as a mobile phone, a tablet computer
  • other devices with a display screen and a camera.
  • the camera 110 is used to obtain the user's position or movement information.
  • the movement information can be gesture information, such as a telescope gesture, a gesture of opening both hands outward, a gesture of folding both hands inward, a camera gesture with both hands, single Hand forward gesture, etc.
  • the display screen 120 is used to display the video content to be displayed.
  • the display device 100 may further include a video signal source interface 150 for receiving a video stream from a video signal source.
  • the display device 100 may also include a wired network interface or a wireless network module 160 for connecting to a network via a wired or wireless connection, so that the display device 100 can obtain a video stream from the network in a wired or wireless manner.
  • the display device 100 may also include a peripheral device interface 170, which is used to connect peripheral devices, such as a USB flash drive, for the display device 100 to obtain a video stream from the peripheral device.
  • the decoder 130 is used to decode the video stream received by the display device 100 from a video signal source, network or storage device.
  • the processor 140 is configured to process the video content to be displayed according to the user's position or motion information acquired by the camera 110. For example, when the processor 140 determines that the user is moving, the processor 140 determines to control the field of view and controls the display screen 120 Display the video content within the field of view; for another example, the processor 140 controls the field of view according to the user's motion information obtained by the camera 110.
  • the motion information is a telescope gesture, and the processor 140 enlarges the video content, narrows the field of view, and controls The display screen 120 displays the enlarged video content.
  • FIG. 11 The flow of the method for the display device 100 to control the playback of video content is shown in FIG. 11.
  • the solid line is the data flow
  • the dashed line is the control flow.
  • the display device can obtain the video stream from the network, or the video signal source (devices that can receive the video signal such as radar), or the storage device, and send it to the decoder, that is, step 1: the decoder obtains the video stream; step 2: The decoder decodes the video stream to obtain the video source; Step 3: The decoder sends the video source to the memory and stores it in the memory, or can also be stored in the video buffer.
  • step 4 the camera sends the obtained user position or movement information to the processor;
  • step 5 the processor determines the video clipping or zooming scheme according to the user's position or movement information
  • step 6 Obtain the video source from the memory;
  • Step 7 The processor trims or zooms the video source according to the position information or the action information, so that the trimmed or zoomed video content is the video content to be displayed;
  • Step 8 Processing The device sends the trimmed or zoomed video content to the display screen;
  • Step 9 Displays the trimmed or zoomed video content on the display screen.
  • the display device includes a memory 180, which is used to store a video stream.
  • Fig. 12 is a schematic flowchart of a method for playing video content following user motion control provided by an embodiment of the present application. As shown in FIG. 12, the method is executed by the device, and the method may include the following steps:
  • S201 Obtain the relative position of the user and the display device, where the relative position is obtained by the sensor when the display device is playing a video.
  • the device when playing a video, the device obtains the relative position of the user and the display device through a sensor in the camera.
  • the senor may be an image sensor, an ultrasonic sensor or an infrared sensor in the camera.
  • S202 Determine the target video content in the video source according to the relative position, where the target video content is the video content in the video source that matches the realizing range of the user in the relative position.
  • the device determines the user's line of sight angle when the user is in a relative position.
  • the line of sight angle is used to reflect the line of sight range.
  • the line of sight angle is the spatial angle of the user's line of sight.
  • the connection between the eye and the center point of the display screen in the relative position; the device determines the target video content from the video source according to the line of sight angle, and the target video content is the video content that matches the line of sight angle of the user.
  • the line of sight angle includes angle a and angle b.
  • the device determines the target video content from the video source according to the line of sight angle, including: the device determines the target video content from the video source according to angle a and angle b, specifically: the device determines the connection between the center point of the video content and the center point of the display screen
  • the angle between the projection on the xy plane and the y axis is angle a
  • the connection between the center of the video content and the center point of the display screen is the angle b between the projection on the yz plane and the z axis as the target.
  • Video content For specific descriptions, please refer to the descriptions of FIG. 5 and FIG.
  • the device determines the target video content in the video source according to the relative position of the user and the display device, including: the device determines the target video content according to the line-of-sight angle, the distance L1, the distance L2, the viewing angle range, and the size of the display screen.
  • the specific process is: the device determines the display range of the target video content on the xy plane according to the angle b, the distance L1, the distance L2, the horizontal display viewing angle, and the width D of the display screen; the device determines the display range of the target video content on the xy plane according to the second angle, L1, L2, and the vertical display viewing angle And the height H of the display screen determine the display range of the target video content on the yz plane.
  • FIG. 7 and FIG. 8 For the sake of brevity, the details are not repeated here.
  • the device determines the target video content in the video source according to the relative position, including: the device determines the connection between the user's eyes and the center point of the display screen when the user is in the relative position.
  • the first intersection point of the video source, the video content in the video source centered at the first focus and with the same aspect ratio as the display screen is used as the target video content, that is, the device determines the center point of the target video content, the target video content and the display device Have the same aspect ratio.
  • the device determines the target video content from the video source according to the relative position of the user and the display device, including: the device determines the cropping strategy of the video source according to the relative position of the user and the display device, and obtains the video source from the video source according to the cropping strategy. Crop the target video content to obtain the target video content.
  • the video source may be at least one of a video with a resolution greater than or equal to 4K, a video with a viewing angle greater than or equal to 140 degrees, or a long strip video. It should be understood that the viewing angle greater than or equal to 140 degrees means that the horizontal angle range of the video source in FIG. 5 and/or the vertical angle range of the video source in FIG. 6 are both greater than or equal to 140 degrees.
  • S203 Play the target video content on the display screen of the display device.
  • the device after determining the target video content, the device sends the target video content to the display screen of the display device, and plays the target video content on the display screen.
  • the video source may be at least one of a video with a resolution of 4K or more, a video with a viewing angle of 140 degrees or more, or a long strip video.
  • the long-strip video is mainly suitable for scenes that move horizontally and do not move vertically, such as advertising videos on the wall.
  • the video source is a video with a resolution greater than or equal to 4K and a viewing angle greater than or equal to 140 degrees.
  • the video output range of the display screen displays part of the video content in the entire video source.
  • the device acquires the relative position of the user and the display device in real time or periodically, and correspondingly determines the target video content in the video source in real time or periodically.
  • the device obtains the relative position of the user and the display
  • the relative position of the user and the display device changes as shown in FIG. 13, as shown in FIG. 14, when the user moves to the left relative to the display device, the device changes according to the user and the display device after the exercise.
  • the relative position of the display device determines the target video content from the video source.
  • the method for determining the target video content by the device is shown in Fig. 5, Fig. 6 or Fig. 7 and Fig. 8, which is a concise description and will not be repeated here.
  • the target video content determined by the device is shown in Figure 14.
  • the video source is a long strip video, such as a video played on an advertising machine, as shown in Figure 15, Figure 16, and Figure 17.
  • a long strip video such as a video played on an advertising machine, as shown in Figure 15, Figure 16, and Figure 17.
  • Figure 15, Figure 16, and Figure 17 only the horizontal part of the video content is displayed .
  • the dashed box is part of the video content displayed by default.
  • the device obtains the relative position of the user and the display device in real time or periodically, and determines the target video content from the video source according to the relative position.
  • the device determines the target video content according to the relative position, including: the device determines the user's line of sight angle when the user is in the relative position, including angle a and angle b, as shown in FIG. 4, The device determines the target video content from the video source according to the intersection a and angle b, specifically: the device determines that the center point of the video content and the center point of the display screen are projected on the xy plane and the angle between the y axis is angle a , And the projection of the line connecting the center point of the video content and the center point of the display screen on the yz plane and the z-axis is the angle b.
  • the video content is the target video content, as shown in Figure 5 and Figure 6, the specific description It is the same as the description in FIG. 5 and FIG. 6, and will not be repeated here for concise description.
  • the device determines the target video content in the video source according to the relative position of the user and the display device, including: the device determines the target video content according to the line-of-sight angle, the distance L1, the distance L2, the viewing angle range, and the size of the display screen.
  • the specific process is: the device determines the display range of the target video content on the xy plane according to the angle b, the distance L1, the distance L2, the horizontal display viewing angle, and the width D of the display screen; the device determines the display range of the target video content on the xy plane according to the second angle, L1, L2, and the vertical display viewing angle And the height H of the display screen determine the display range of the target video content on the yz plane.
  • FIG. 7 and FIG. 8 For the sake of brevity, the details are not repeated here.
  • the device determines the target video content according to the relative position, including: the device determines the first intersection between the line of the user's eyes and the center point of the display screen and the video source when the user is in the relative position, and the first intersection of the video source A video content with an intersection as the center point and the same aspect ratio as the display screen is used as the target video content.
  • the device determines the target video content in the video source according to the relative position, including: the device determines the target video content according to the relative position of the user and the display device, and the speed of the user's movement.
  • the device determines that the user moves relative to the display device, such as moving from FIG. 15 to the position shown in FIG. 16, the device is based on the relative position of the user and the display device, or the device is based on the relative position of the user and the display device, and the user moves from FIG. 15
  • the moving speed to the position in FIG. 16 determines the target video content from the video source, so that the played video content is always at the closest distance to the user according to the user's movement, which improves the user experience.
  • FIG. 16 may also be used as a schematic diagram of video content playback before the user moves in FIG. 17.
  • the device determines the user's moving position, that is, from the position shown in FIG. 16 to the position shown in FIG. 17, the device is based on the relative position of the user and the display device, or the device is based on the relative position of the user and the display device, and the user moves from the position shown in FIG.
  • the moving speed to the position in FIG. 17 determines the target video content from the video source, so that the played video content is always at the closest distance to the user according to the user's movement, which improves the user experience.
  • the video source When the video source is a long strip video, it can be used for display applications, such as an advertising machine, etc.
  • the video screen moves with the user, which can attract the user's attention, extend the time for the video content (such as advertisement) to be close to the user, and increase the commercial value .
  • the method further includes: in the initial state, that is, when the display screen just plays the video content, the display screen displays the preset video content (also called the second video content), as shown in FIG. 2 As shown, the display screen displays the 4K resolution video content in the middle; or, as shown in Figure 15, the display screen displays part of the video content in the horizontal direction.
  • the display screen displays the preset video content (also called the second video content), as shown in FIG. 2
  • the display screen displays the 4K resolution video content in the middle; or, as shown in Figure 15, the display screen displays part of the video content in the horizontal direction.
  • the method may further include:
  • the sensor of the device acquires the user's action information.
  • the motion information may include gesture information, such as telescope gestures, open hands outwards, close hands inward, make camera gestures with both hands, and move forward with one hand.
  • S205 The apparatus determines the target video content according to the relative position and action information of the user and the display device.
  • the device determining the target video content according to the relative position of the user and the display device and the action information includes: the device determines the first video content in the video source according to the relative position; the device determines and stores the presentation of the video content according to the action information Rules, where the presentation rule corresponds to the action information; the device determines the target video content according to the first video content and the presentation rule.
  • the device determining the target video content according to the first video content and the presentation rule includes: the device zooms in or out of the first video content with a center point of the first video content as a center to determine the target video content.
  • the device when the motion information is a telescope gesture, the device zooms in or out of the currently viewed video content according to the telescope gesture according to a preset zoom-in or zoom-out ratio factor, and obtains the target video content through a zoom strategy.
  • the video content currently being watched by the user is shown in Fig. 19a.
  • the camera of the display device acquires the user’s telescope gesture
  • the device enlarges the video content currently being watched, and the line of sight is narrowed, as shown in Fig. 19b.
  • whether the device zooms in or out of the currently viewed video content according to the telescope gesture can be set in advance according to user requirements, which is not limited in this embodiment.
  • the device when the action information is a gesture of opening both hands outward, the device enlarges the video content, narrows the line of sight, and displays the enlarged video content on the display screen.
  • the device When the action information is a gesture of folding your hands inward, the device reduces the video content, widens the line of sight, and displays the reduced video on the display screen, as well as other video content within the line of sight after the widened line of sight.
  • the device intercepts the current video content and displays the process of intercepting the current video content on the display screen.
  • the device keeps the currently playing video content still, records a picture of the current video content, and displays the process of recording the current video content on the display screen, and so on.
  • the display device shown in FIG. 18 obtains the user's action information and controls the video content to be played according to the action information. It can be used alone or combined with the display device in FIG. 12 to obtain the relative position of the user and the display device. Control the video content played.
  • the embodiment of the present application provides a device for playing video content according to user motion control.
  • the device 300 includes a receiving unit 310, a determining unit 320, and a sending unit 330.
  • the receiving unit 310 is configured to receive the position of the user acquired by the sensor when the user watches the video.
  • the determining unit 320 is configured to determine target video content in the video source according to the location of the user, and the target video content is the video content in the video source that matches the line of sight of the user at the location.
  • the sending unit 330 is configured to transmit the target video content to the display screen, so that the display screen plays the target video content, which realizes that the video content follows the user's movement and improves the user experience.
  • the determining unit 320 is specifically configured to determine the line-of-sight angle of the user at the location according to the position of the user, the line-of-sight angle is used to reflect the line-of-sight range, the line-of-sight angle is the spatial angle of the line of sight of the user, and the line of sight of the user is the user
  • the line of sight angle includes a first angle and a second angle.
  • the first angle is the angle between the user's line of sight and the y-axis when the user's line of sight is mapped onto the xy plane.
  • the xy plane is the plane formed by the x-axis and the y-axis;
  • the included angle with the z axis, the yz plane is the plane formed by the y axis and the z axis; where the y axis is perpendicular to the plane where the display is located, and the z axis is perpendicular to the ground and parallel to where the display is located
  • the plane, the x-axis and the z-axis form the xz plane
  • the xz plane is the plane where the display screen is located, the x-axis, the y-axis, and the z-axis intersect at the origin of the coordinate axis, and the origin of the coordinate axis is the center
  • the determining unit 320 determines the target video content from the video source according to the first angle and the second angle.
  • the projection of the line between the center point of the target video content and the center point of the display screen on the xy plane and the y axis The included angle of is the first angle
  • the video content whose projection on the yz plane and the z-axis of the line connecting the center point of the target video content and the center point of the display screen is the second angle is the target video content.
  • the position of the user and the display device is the distance L1 between the user and the center point of the display screen
  • the video source includes the video shooting distance L2 and the viewing angle range of the video content
  • L2 is the distance from the video content of the video source to the center point of the display screen.
  • the distance; the determining unit 320 is specifically configured to determine the target video content according to the line of sight angle, L1, L2, the viewing angle range, and the size of the display screen.
  • the viewing angle range includes the horizontal display viewing angle and the vertical display viewing angle.
  • the horizontal display viewing angle is the display range angle where the video content of the video source is mapped to the xy plane
  • the vertical display viewing angle is the display range angle where the video content of the video source is mapped to the yz plane.
  • the size of the display screen includes the width D of the display screen and the height H of the display screen; the determining unit 320 is specifically configured to: determine the target video content in the xy plane according to the first angle, L1, L2, the horizontal display angle of view, and the width D of the display screen According to the second angle, L1, L2, the vertical display angle of view, and the height H of the display screen, determine the display range of the target video content on the yz plane.
  • the determining unit 320 is specifically configured to: determine the first intersection point between the line of the user's eyes and the center point of the display screen and the video source when the user is at the position; take the first intersection point as the video source The video content with the center point and the same aspect ratio as the display screen is taken as the target video content.
  • the determining unit 320 is specifically configured to determine the target video content according to the position of the user and the speed of the user's movement.
  • the receiving unit 310 is further configured to receive the acquired action information of the user; the determining unit 320 is further configured to determine the target video content according to the user's position and action information.
  • the determining unit 320 is specifically configured to: determine the first video content in the video source according to the location of the user; determine the presentation rule of the pre-stored video content according to the action information, and the presentation rule corresponds to the action information; Video content and presentation rules determine the target video content.
  • the motion information includes at least one of telescope gesture information, information about a gesture of pushing both hands forward, and a gesture of moving both hands backward.
  • the determining unit 320 when the camera acquires telescope gesture information, the determining unit 320 enlarges or reduces the fourth video content according to the telescope gesture information.
  • the determining unit 320 enlarges the video content, narrows the field of view, and displays the enlarged video content on the display screen.
  • the determining unit 320 reduces the video content, widens the field of view, and displays the reduced video content on the display screen.
  • the determining unit 320 captures the current video content and displays the screenshot process on the display screen.
  • the determining unit 320 keeps the video content still, records the current video content screen, and displays the current video content recording screen on the display screen, and so on.
  • the determining unit 320 is specifically configured to: zoom in or zoom out the first video content with the center point of the first video content as the center to determine the target video content.
  • the determining unit 320 is specifically configured to determine a cropping or zooming strategy of the video source according to the location of the user to obtain the target video content.
  • the video source includes at least one of the following: a video with a resolution greater than or equal to 4K, a video with a field of view greater than or equal to 140 degrees, or a long strip video.
  • the sending unit 330 is further configured to transmit the preset second video content to the display screen, so that the display screen plays the second video content.
  • each functional unit in the device can be realized by the steps performed by the device in the embodiment shown in FIG. 12 and FIG. 18, and achieve the corresponding technical effect. Therefore, the device provided by the embodiment of the present invention The specific working process of the company will not be repeated here.
  • the device 400 includes a transmission interface 410 and a processor 420.
  • the transmission interface 410 is an interface for receiving or sending data in the device.
  • the transmission interface may also be a part of the processor 420, and the transmission interface and the processor belong to the same chip.
  • the transmission interface 410 is used to receive the position of the user acquired by the sensor when the user watches the video.
  • the processor 420 is configured to determine target video content in the video source according to the location of the user, where the target video content is the video content in the video source that matches the line of sight of the user at the location.
  • the transmission interface 410 is also used to transmit the target video content to the display screen, so that the display screen plays the target video content, which realizes that the video content follows the user's movement and improves the user experience.
  • the processor 420 is specifically configured to: determine the line of sight angle of the user at the position according to the user's position, the line of sight angle is used to reflect the line of sight range, the line of sight angle is the spatial angle of the line of sight of the user, and the line of sight of the user is The connection between the user's eyes and the center point of the display screen when the user is at the position; the target video content is determined from the video source according to the line of sight angle, and the target video content is the video content matching the line of sight angle of the user.
  • the line of sight angle includes a first angle and a second angle.
  • the first angle is the angle between the user's line of sight and the y-axis when the user's line of sight is mapped onto the xy plane.
  • the xy plane is the plane formed by the x-axis and the y-axis;
  • the included angle with the z axis, the yz plane is the plane formed by the y axis and the z axis; where the y axis is perpendicular to the plane where the display is located, and the z axis is perpendicular to the ground and parallel to where the display is located
  • the plane, the x-axis and the z-axis form the xz plane
  • the xz plane is the plane where the display screen is located, the x-axis, the y-axis, and the z-axis intersect at the origin of the coordinate axis, and the origin of the coordinate axis is the center
  • the processor 420 is specifically configured to determine the target video content from the video source according to the first angle and the second angle, and the connection between the center point of the target video content and the center point of the display screen is on the xy plane.
  • the angle between the projection and the y-axis is the first angle
  • the connection between the center point of the target video content and the center point of the display screen on the yz plane is the second angle between the projection and the z-axis is the target video content.
  • the position of the user and the display device is the distance L1 between the user and the center point of the display screen
  • the video source includes the video shooting distance L2 and the viewing angle range of the video content
  • L2 is the distance from the video content of the video source to the center point of the display screen.
  • the processor 420 is specifically configured to determine the target video content according to the line-of-sight angle, L1, L2, viewing angle range, and size of the display screen.
  • the viewing angle range includes the horizontal display viewing angle and the vertical display viewing angle.
  • the horizontal display viewing angle is the display range angle where the video content of the video source is mapped to the xy plane
  • the vertical display viewing angle is the display range angle where the video content of the video source is mapped to the yz plane.
  • the size of the display screen includes the width D of the display screen and the height H of the display screen; the processor 420 is specifically configured to: determine the target video content in the xy plane according to the first angle, L1, L2, the horizontal display angle of view, and the width D of the display screen According to the second angle, L1, L2, the vertical display angle of view, and the height H of the display screen, determine the display range of the target video content on the yz plane.
  • the processor 420 is specifically configured to: determine the first intersection point between the line of the user's eyes and the center point of the display screen and the video source when the user is at the position; and take the first intersection point in the video source as The video content with the center point and the same aspect ratio as the display screen is taken as the target video content.
  • the processor 420 is specifically configured to determine the target video content according to the position of the user and the speed of the user's movement.
  • the transmission interface 410 is also used to receive the acquired user's action information; the processor 420 is also used to determine the target video content according to the user's location and action information.
  • the processor 420 is specifically configured to: determine the first video content in the video source according to the location of the user; determine the presentation rule of the pre-stored video content according to the action information, and the presentation rule corresponds to the action information; Video content and presentation rules determine the target video content.
  • the motion information includes at least one of telescope gesture information, information about a gesture of pushing both hands forward, and a gesture of moving both hands backward.
  • the processor 420 zooms in or out of the fourth video content according to the telescope gesture information.
  • the processor 420 When the camera acquires the gesture information of the open hands, the processor 420 enlarges the video content, narrows the field of view, and displays the enlarged video content on the display screen.
  • the processor 420 reduces the video content, widens the field of view, and displays the reduced video content on the display screen.
  • the processor 420 captures the current video content and displays the screenshot process on the display screen.
  • the processor 420 keeps the video content still, records a picture of the current video content, and displays the picture of the current video content on the display screen, and so on.
  • the processor 420 is specifically configured to: zoom in or zoom out the first video content with the center point of the first video content as the center, so as to determine the target video content.
  • the processor 420 is specifically configured to determine a cropping or scaling strategy of the video source according to the user's position, so as to obtain the target video content.
  • the video source includes at least one of the following: a video with a resolution greater than or equal to 4K, a video with a field of view greater than or equal to 140 degrees, or a long strip video.
  • the transmission interface 410 is also used to transmit the preset second video content to the display screen, so that the display screen can play the second video content.
  • the apparatus 400 further includes a memory 430 for storing information such as the relative position of the user and the display device.
  • the device 400 may further include a display screen 440.
  • the device 400 may further include a camera 450, and the camera includes a sensor.
  • each functional device in the device can be realized by the steps performed by the device in the embodiment shown in FIG. 12 and FIG. 18, and achieve the corresponding technical effect. Therefore, the device provided in the embodiment of the present application The specific working process of the company will not be repeated here.
  • the embodiment of the present application also provides a computer-readable storage medium.
  • the computer-readable storage medium stores instructions. When the instructions run on a computer or a processor, the computer or the processor executes the steps in FIG. 12 and FIG. 18 Methods.
  • the embodiment of the present application also provides a computer program product containing instructions, which when it runs on a computer or a processor, causes the computer or the processor to execute the method of each step in FIG. 12 and FIG. 18.

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un procédé et un appareil pour commander, au moyen du suivi du mouvement d'un utilisateur, la lecture d'un contenu vidéo. Le procédé consiste à : acquérir la position d'un utilisateur par rapport à un dispositif d'affichage, la position relative étant acquise par un capteur d'image lorsque le dispositif d'affichage lit une vidéo ; selon la position relative, déterminer, dans une source vidéo, un contenu vidéo cible, le contenu vidéo cible étant un contenu vidéo dans la source vidéo qui correspond à la portée de ligne de visée de l'utilisateur lorsqu'il est dans la position relative ; et lire le contenu vidéo cible sur un écran d'affichage du dispositif d'affichage, de telle sorte que le contenu vidéo lu suit le mouvement de l'utilisateur, ce qui permet d'augmenter la sensation de présence de l'utilisateur lors de la visualisation de la vidéo, et d'améliorer l'expérience de l'utilisateur.
PCT/CN2019/082177 2019-04-11 2019-04-11 Procédé et appareil pour commander, au moyen du suivi du mouvement d'utilisateur, la lecture d'un contenu vidéo WO2020206647A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202410565748.XA CN118400584A (zh) 2019-04-11 2019-04-11 跟随用户运动控制播放视频内容的方法和装置
PCT/CN2019/082177 WO2020206647A1 (fr) 2019-04-11 2019-04-11 Procédé et appareil pour commander, au moyen du suivi du mouvement d'utilisateur, la lecture d'un contenu vidéo
CN201980078423.6A CN113170231A (zh) 2019-04-11 2019-04-11 跟随用户运动控制播放视频内容的方法和装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/082177 WO2020206647A1 (fr) 2019-04-11 2019-04-11 Procédé et appareil pour commander, au moyen du suivi du mouvement d'utilisateur, la lecture d'un contenu vidéo

Publications (1)

Publication Number Publication Date
WO2020206647A1 true WO2020206647A1 (fr) 2020-10-15

Family

ID=72751805

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/082177 WO2020206647A1 (fr) 2019-04-11 2019-04-11 Procédé et appareil pour commander, au moyen du suivi du mouvement d'utilisateur, la lecture d'un contenu vidéo

Country Status (2)

Country Link
CN (2) CN113170231A (fr)
WO (1) WO2020206647A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125149A (zh) * 2021-11-17 2022-03-01 维沃移动通信有限公司 视频播放方法、装置、系统、电子设备及存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114245210B (zh) * 2021-09-22 2024-01-09 北京字节跳动网络技术有限公司 视频播放方法、装置、设备以及存储介质
CN114205669B (zh) * 2021-12-27 2023-10-17 咪咕视讯科技有限公司 自由视角视频的播放方法、装置及电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103455253A (zh) * 2012-06-04 2013-12-18 乐金电子(中国)研究开发中心有限公司 一种与视频设备交互的方法及用于交互的视频设备
CN103559006A (zh) * 2010-12-08 2014-02-05 索尼电脑娱乐公司 利用视线跟踪的自适应显示
US20140043211A1 (en) * 2012-08-09 2014-02-13 Lg Electronics Inc. Head mounted display for adjusting audio output and video output in relation to each other and method for controlling the same
CN104020842A (zh) * 2013-03-01 2014-09-03 联想(北京)有限公司 一种显示方法及装置、电子设备
CN104702919A (zh) * 2015-03-31 2015-06-10 小米科技有限责任公司 播放控制方法及装置、电子设备
US20160255322A1 (en) * 2013-10-07 2016-09-01 Vid Scale, Inc. User adaptive 3d video rendering and delivery

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10063848B2 (en) * 2007-08-24 2018-08-28 John G. Posa Perspective altering display system
US9389682B2 (en) * 2012-07-02 2016-07-12 Sony Interactive Entertainment Inc. Methods and systems for interaction with an expanded information space
JP2016025633A (ja) * 2014-07-24 2016-02-08 ソニー株式会社 情報処理装置、管理装置、情報処理方法、およびプログラム
JP2016066918A (ja) * 2014-09-25 2016-04-28 大日本印刷株式会社 映像表示装置、映像表示制御方法、及びプログラム
CN106303706A (zh) * 2016-08-31 2017-01-04 杭州当虹科技有限公司 基于人脸和物件跟踪实现以主角跟随视角观看虚拟现实视频的方法
CN108882018B (zh) * 2017-05-09 2020-10-20 阿里巴巴（中国）有限公司 虚拟场景中的视频播放、数据提供方法、客户端及服务器

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103559006A (zh) * 2010-12-08 2014-02-05 索尼电脑娱乐公司 利用视线跟踪的自适应显示
CN103455253A (zh) * 2012-06-04 2013-12-18 乐金电子(中国)研究开发中心有限公司 一种与视频设备交互的方法及用于交互的视频设备
US20140043211A1 (en) * 2012-08-09 2014-02-13 Lg Electronics Inc. Head mounted display for adjusting audio output and video output in relation to each other and method for controlling the same
CN104020842A (zh) * 2013-03-01 2014-09-03 联想(北京)有限公司 一种显示方法及装置、电子设备
US20160255322A1 (en) * 2013-10-07 2016-09-01 Vid Scale, Inc. User adaptive 3d video rendering and delivery
CN104702919A (zh) * 2015-03-31 2015-06-10 小米科技有限责任公司 播放控制方法及装置、电子设备

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125149A (zh) * 2021-11-17 2022-03-01 维沃移动通信有限公司 视频播放方法、装置、系统、电子设备及存储介质

Also Published As

Publication number Publication date
CN118400584A (zh) 2024-07-26
CN113170231A (zh) 2021-07-23

Similar Documents

Publication Publication Date Title
CN109416931B (zh) 用于视线跟踪的装置和方法
TWI530157B (zh) 多視角影像之顯示系統、方法及其非揮發性電腦可讀取紀錄媒體
CN106101741B (zh) 在网络视频直播平台上观看全景视频的方法及系统
JP2020188479A (ja) ３次元メディアガイダンスアプリケーションをナビゲートするためのシステムおよび方法
US9597590B2 (en) Methods and apparatus for accessing peripheral content
Lelyveld Virtual reality primer with an emphasis on camera-captured VR
EP3065049A2 (fr) Procédé, dispositif et système d'affichage vidéo interactif
US20120200667A1 (en) Systems and methods to facilitate interactions with virtual content
JP2016025633A (ja) 情報処理装置、管理装置、情報処理方法、およびプログラム
WO2020206647A1 (fr) Procédé et appareil pour commander, au moyen du suivi du mouvement d'utilisateur, la lecture d'un contenu vidéo
CN114327700A (zh) 一种虚拟现实设备及截屏图片播放方法
KR20180051202A (ko) 디스플레이장치 및 그 제어방법
WO2021095573A1 (fr) Système et procédé de traitement d'informations ainsi que programme
CN110730340B (zh) 基于镜头变换的虚拟观众席展示方法、系统及存储介质
US20230353717A1 (en) Image processing system, image processing method, and storage medium
JP2007501950A (ja) ３次元像表示装置
US11187895B2 (en) Content generation apparatus and method
JP2019512177A (ja) 装置および関連する方法
CN108134928A (zh) Vr显示方法和装置
US20210058611A1 (en) Multiviewing virtual reality user interface
US20190295324A1 (en) Optimized content sharing interaction using a mixed reality environment
JP2021018575A (ja) 画像処理装置、画像配信システム、および画像処理方法
CN111149356A (zh) 用于投影沉浸式视听内容的方法
CN115623149A (zh) 视频记录及回放系统和方法
CN109462775A (zh) 全景视频播放方法、机顶盒、计算机可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19923989

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19923989

Country of ref document: EP

Kind code of ref document: A1