CN114040231A - VR video playing system and method and VR glasses - Google Patents

VR video playing system and method and VR glasses Download PDF

Info

Publication number
CN114040231A
CN114040231A CN202111285300.5A CN202111285300A CN114040231A CN 114040231 A CN114040231 A CN 114040231A CN 202111285300 A CN202111285300 A CN 202111285300A CN 114040231 A CN114040231 A CN 114040231A
Authority
CN
China
Prior art keywords
video
instruction
angle
key
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111285300.5A
Other languages
Chinese (zh)
Inventor
朱磊
杨晓光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Yispace Technology Co ltd
Original Assignee
Qingdao Yispace Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Yispace Technology Co ltd filed Critical Qingdao Yispace Technology Co ltd
Priority to CN202111285300.5A priority Critical patent/CN114040231A/en
Publication of CN114040231A publication Critical patent/CN114040231A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A VR video playing system, a VR video playing method and VR glasses relate to the technical field of virtual reality and are used for solving the problem that the requirement of a user for VR video watching experience cannot be met due to the fact that the existing VR video playing system is limited in function. The VR video playing system comprises a VR device end and a mobile device end, VR devices corresponding to the VR device end are VR glasses, and a plurality of keys corresponding to the mobile device end are arranged on the VR glasses; a user sends an instruction to the mobile equipment end through operating a key, wherein the instruction comprises a playing adjustment instruction and a shooting instruction; the mobile equipment end comprises an execution module and a processing module, wherein the execution module is used for executing corresponding playing adjustment operation according to a playing adjustment instruction sent by the VR equipment end; and the processing module is used for carrying out corresponding processing according to the shooting instruction sent by the VR equipment end so as to obtain the picture or the short video. The invention further comprises a VR video playing method and VR glasses. The invention is suitable for VR video playing corresponding to the VR video player on the VR equipment and the mobile equipment.

Description

VR video playing system and method and VR glasses
Technical Field
The invention relates to the technical field of virtual reality, in particular to a VR video playing system and method and VR glasses.
Background
Virtual Reality (VR) technology is a computer simulation system that can create and experience a Virtual world, which uses a computer to create a simulated environment, which is a systematic simulation of interactive three-dimensional dynamic views and physical behaviors with multi-source information fusion, and immerses users in the environment.
When the user uses the virtual reality product, can produce the experience of immersing in the virtual reality environment in the vision, the first equipment that shows of VR is the most common virtual reality product on the market at present, and generally speaking, the first equipment that shows of VR can be divided into three types: external head shows equipment, the first equipment that shows of integral type, mobile terminal show equipment, wherein, mobile terminal shows that equipment simple structure, low price can be watched as long as put into the cell-phone. Because the shell of the mobile terminal display device is closed, when the mobile phone is installed in the shell, a user cannot directly control the mobile phone, namely when the user watches VR video by using the mobile terminal display device, due to the fact that the sight line is completely shielded, the user needs to search physical keys arranged on the mobile terminal display device through finger touch to perform related operations on products, the user judges the functions of the keys according to the shapes and the positions of the touched keys, and the like, and the operation is easy to miss in use; and the operation of the physical keys on the existing mobile terminal display device on the product is only limited to playing, pausing, fast forwarding, fast rewinding, volume adjustment and the like, and the adjustment or other functions of the video playing angle through the physical keys on the mobile terminal display device are not involved, and meanwhile, no VR video player can realize the adjustment or other functions of the video playing angle corresponding to the physical keys on the mobile terminal display device, so that the functions realized by the existing VR video playing system are limited, and the ever-increasing higher requirements of people on VR video watching experience can not be met.
Disclosure of Invention
In view of the above problems, the invention provides a VR video playing system, a VR video playing method and VR glasses, so as to solve the problem that the requirements of users for VR video viewing experience cannot be met due to limited implementation functions of the existing VR video playing system.
According to an aspect of the present invention, a VR video playing system is provided, which includes a VR device side and a mobile device side,
the VR equipment corresponding to the VR equipment end is VR glasses, and a plurality of keys corresponding to the mobile equipment end are arranged on the VR glasses; a user sends an instruction to a mobile equipment end through an operation key, wherein the instruction comprises a playing adjustment instruction and a shooting instruction;
the mobile equipment end comprises a display module, an execution module and a processing module, wherein the display module is used for displaying a VR video; the execution module is used for executing corresponding playing adjustment operation according to the playing adjustment instruction sent by the VR equipment end; and the processing module is used for carrying out corresponding processing according to the shooting instruction sent by the VR equipment end so as to obtain the picture or the short video.
Further, the playing adjustment instruction comprises a field angle enlarging instruction, a field angle reducing instruction or a field angle restoring initial instruction; the shooting instruction comprises a picture shooting instruction and a short video recording instruction.
Further, the keys on the VR glasses are configured as follows: two keys are arranged outside the VR glasses and are respectively a play adjusting key and a shooting key.
Further, the process of the execution module executing the corresponding play adjustment operation according to the play adjustment instruction sent by the play adjustment key includes: when the VR video is played with the initial value of the field angle being 1 time, if the playing adjustment key is pressed or continuously pressed for a long time, the execution module acquires a field angle amplification instruction, and the field angle is increased or gradually increased until the field angle of the display area is adjusted to the maximum value and then is not increased; after the angle of view is adjusted to the maximum value, if the playing adjustment key is pressed down or continuously pressed for a long time, the execution module acquires an angle of view reduction instruction, and the angle of view is reduced or gradually reduced until the angle of view of the display area is adjusted to the minimum value and is not reduced; and if the play adjusting key is double-clicked, the execution module acquires an initial instruction of the angle of view recovery, namely the angle of view is recovered to be 1 time of the initial value.
Further, the process of performing corresponding processing according to the shooting instruction sent by the shooting key in the processing module to obtain the picture or the short video includes: when the shooting key is pressed down, the processing module acquires a picture shooting instruction, and processes the panoramic video frame data according to the time information and the angle information carried in the picture shooting instruction to acquire a screenshot; and if the shooting key is continuously pressed for a long time, the processing module acquires a short video recording instruction, processes the panoramic video frame sequence data according to the time period information and the angle information of each frame carried in the short video recording instruction, and acquires videos formed by a plurality of screenshots.
Further, the process of processing the panoramic video frame data according to the time information and the angle information carried in the picture shooting instruction in the processing module to obtain the screenshot comprises the following steps: the method comprises the steps of pre-storing a panoramic video image frame sequence which has the same content with a VR video, namely the same time sequence and mapping angle, selecting a multi-frame image of one frame or a plurality of frames before and after the frame corresponding to the current time information of the VR video from the stored panoramic video image frame sequence, and fusing the multi-frame images to obtain a fused enhanced image; intercepting a screenshot corresponding to the direction and angle information in the frame image or the fused enhanced image;
the processing module processes the panoramic video frame sequence data according to the time period information and the angle information of each frame carried in the short video recording instruction, and the process of acquiring the video formed by a plurality of screenshots comprises the following steps: selecting a part of or all panoramic image frames corresponding to the time period from the stored panoramic video image frame sequence as candidate images according to the time period information; capturing screenshots of which the directions correspond to the angle information carried in the instruction in each frame of candidate panoramic image aiming at the selected plurality of frames of candidate images; and coding all the intercepted screenshots according to a time sequence to form a video file.
Further, VR equipment that VR equipment end corresponds still includes the VR handle, the VR handle communicates with the mobile device end through wireless mode, not set up the button that corresponds the function on the VR glasses, be provided with a plurality of buttons that correspond with the mobile device end on the VR handle.
According to another aspect of the present invention, a VR video playing method is provided, which includes the following steps:
step one, playing and displaying a VR video;
step two, acquiring a playing adjustment instruction input by VR equipment adapted to the mobile equipment, and playing and adjusting the VR video played currently according to the playing adjustment instruction; the VR equipment is VR glasses, and a plurality of keys corresponding to the mobile equipment are arranged on the VR glasses; the playing adjustment instruction comprises a field angle enlarging instruction, a field angle reducing instruction or a field angle restoring initial instruction;
step three, acquiring a shooting instruction input by VR equipment adapted to the mobile equipment, and shooting a picture or a short video of the VR video played currently according to the shooting instruction; the shooting instruction comprises a picture shooting instruction and a short video recording instruction.
Further, the process of performing play adjustment on the currently played VR video according to the play adjustment instruction in the second step includes: when the VR video is played with the field angle as the initial value of 1 time, a field angle enlarging instruction is obtained, and the field angle is enlarged or gradually enlarged until the field angle of the display area is adjusted to the maximum value and is not enlarged; after the angle of view is adjusted to the maximum value, acquiring an angle of view reduction instruction, wherein the angle of view is reduced or gradually reduced until the angle of view of the display area is adjusted to the minimum value and then is not reduced; and acquiring an initial command of the angle of view recovery, and recovering the angle of view to be 1 time of the initial value.
Further, the process of taking a picture or a short video of the VR video currently played according to the shooting instruction in the third step includes: processing panoramic video frame data which are the same as VR video content, namely the same time sequence and the same mapping angle according to time information and angle information carried in the picture shooting instruction, and acquiring a screenshot; and processing panoramic video frame sequence data which is the same as VR video content, namely the same time sequence and mapping angle according to time period information and angle information of each frame carried in the short video recording instruction to obtain videos formed by a plurality of screenshots.
According to another aspect of the invention, the VR glasses for realizing the VR video playing system comprise a glasses box body and two visual lenses arranged in the glasses box body, wherein the glasses box body comprises two side plates, a top plate, a bottom plate and an arc panel, the top plate, the bottom plate and the two side plates are encircled to form a frame with openings at two sides, the outer edge of the arc panel is connected with the inner edge of the opening at one side of the frame, the arc panel is matched with the face of a human body, the arc panel is provided with two circular through holes matched with the positions of the eyes of the human body, the arc panel is provided with an arc through hole matched with the position of the nose of the human body, and one visual lens is arranged at each circular through hole;
the mobile phone screen touch screen is characterized by further comprising an upper touch key, a lower touch key, a first transmission device, a second transmission device, a first key and a second key, wherein the first key and the second key are mounted on the top plate, the side, facing the bottom plate, of the top plate is connected with the upper touch key used for touching the mobile phone screen, the side, facing the top plate, of the bottom plate is connected with the lower touch key used for touching the mobile phone screen, the first key and the upper touch key are connected through the first transmission device, and the second key and the lower touch key are connected through the second transmission device.
The beneficial technical effects of the invention are as follows:
the invention provides a VR video playing system, a VR video playing method and VR glasses, and aims to provide a virtual reality system based on VR glasses and a smart phone.
Drawings
The invention may be better understood by referring to the following description in conjunction with the accompanying drawings, in which like reference numerals are used throughout the figures to indicate like or similar parts. The accompanying drawings, which are incorporated in and form a part of this specification, illustrate preferred embodiments of the present invention and, together with the detailed description, serve to further explain the principles and advantages of the invention.
Fig. 1 is a schematic structural diagram of a VR video playing system according to the present invention;
FIG. 2 is a schematic flow chart illustrating a VR video playing method according to the present invention;
FIG. 3 is a schematic diagram of a VR glasses according to the present invention;
FIG. 4 is a schematic perspective view of VR glasses according to the present invention;
FIG. 5 is a schematic diagram of an internal structure of VR glasses according to the present invention;
FIG. 6 is a schematic side view of an internal structure of VR glasses according to the present invention;
fig. 7 is a schematic structural diagram of a first rotating rod of VR glasses according to the present invention;
fig. 8 is a schematic structural diagram of a second rotating rod of VR glasses according to the present invention.
Detailed Description
In order that those skilled in the art will better understand the disclosure, exemplary embodiments or examples of the disclosure are described below with reference to the accompanying drawings. It is obvious that the described embodiments or examples are only some, but not all embodiments or examples of the invention. All other embodiments or examples obtained by a person of ordinary skill in the art based on the embodiments or examples of the present invention without any creative effort shall fall within the protection scope of the present invention.
The embodiment of the invention provides a VR video playing system, as shown in fig. 1, the system comprises a VR device end 10 and a mobile device end 20, VR devices corresponding to the VR device end 10 are VR glasses, the VR glasses belong to mobile terminal display devices, and a plurality of keys corresponding to the mobile device end 20 are arranged on the VR glasses; the mobile device corresponding to the mobile device terminal 20 is, for example, a smart phone, and the user sends an instruction to the smart phone by operating a key on the VR glasses; the instructions comprise a playing adjustment instruction and a shooting instruction; the playing adjustment instruction comprises a view angle enlarging instruction, a view angle reducing instruction or a view angle restoring initial instruction; the shooting instruction comprises a picture shooting instruction and a short video recording instruction.
Different key combination modes can be set for sending the corresponding instruction, for example, two keys are arranged outside the VR glasses: the playing adjusting key and the shooting key respectively correspond to the playing adjusting instruction and the shooting instruction; or, four keys are arranged: the field angle amplifying key, the field angle reducing key, the field angle recovery initial key and the shooting key respectively correspond to the field angle amplifying instruction, the field angle reducing instruction, the field angle recovery initial instruction and the shooting instruction; or, five keys are provided: the visual angle enlarging key, the visual angle reducing key, the visual angle restoring initial key, the picture shooting key and the short video recording key respectively correspond to the visual angle enlarging instruction, the visual angle reducing instruction, the visual angle restoring initial instruction, the picture shooting instruction and the short video recording instruction.
The mobile device 20 includes a display module 210, an execution module 220 and a processing module 230, wherein the display module 210 is configured to display a VR video; the execution module 220 is configured to execute a corresponding play adjustment operation according to the play adjustment instruction sent by the VR device end; the processing module 230 is configured to perform corresponding processing according to a shooting instruction sent by the VR device side to obtain a picture or a short video.
The display process for the VR video in the display module 210 includes: firstly, a mapping layer is established, and then video image frames are rendered onto the mapping layer according to the time sequence. The mapping layer refers to a canvas capable of drawing characters or images, and can be stacked in sequence and combined to form the final effect of a view; rendering generally refers to the process of rendering some form of graphics into a two-dimensional matrix of pixels in computer graphics, a process of generating an image from a model, and displaying the data to a user in a particular way. The method specifically comprises the following steps: for each frame of VR video image, firstly determining a demarcation point of a left view part and a right view part, establishing a left-eye plane mapping layer for the left view part, establishing a right-eye plane mapping layer for the right view part, then rendering the left view part on the left-eye plane mapping layer, and rendering the right view part on the right-eye plane mapping layer.
When only two keys, namely, a play adjustment key and a shooting key, are arranged on the VR glasses, the process that the execution module 220 executes the corresponding play adjustment operation according to the play adjustment instruction sent by the play adjustment key includes: when the VR video is played with the initial value of the field angle being 1 time, if the playing adjustment key is pressed or continuously pressed for a long time, the execution module acquires a field angle amplification instruction, and the field angle is increased or gradually increased until the field angle of the display area is adjusted to the maximum value and then is not increased; after the angle of view is adjusted to the maximum value, if the playing adjustment key is pressed down or continuously pressed for a long time, the execution module acquires an angle of view reduction instruction, and the angle of view is reduced or gradually reduced until the angle of view of the display area is adjusted to the minimum value and is not reduced; and if the play adjusting key is double-clicked, the execution module acquires an initial instruction of the angle of view recovery, namely the angle of view is recovered to be 1 time of the initial value.
When four or five buttons are arranged on the VR glasses, the process of executing the corresponding play adjustment operation by the execution module 220 according to the play adjustment instruction sent by the buttons with different functions includes: when the VR video is played with the initial value of the field angle being 1 time, the field angle enlarging key is pressed or continuously pressed for a long time, the execution module acquires a field angle enlarging instruction, and the field angle is enlarged or gradually enlarged until the field angle of the display area is adjusted to the maximum value and is not enlarged; when the field angle reduction key is pressed or continuously pressed for a long time, the execution module acquires a field angle reduction instruction, and the field angle is reduced or gradually reduced until the field angle of the display area is adjusted to the minimum value and is not reduced; and when the initial viewing angle recovery key is pressed down, the execution module acquires an initial viewing angle recovery instruction, and the viewing angle is recovered to be 1 time of the initial value.
When only two keys are set on the VR glasses, that is, the adjustment key and the shooting key are played, the process that the processing module 230 performs corresponding processing according to the shooting instruction sent by the shooting key to obtain the picture or the short video includes: when the shooting key is pressed down, the processing module acquires a picture shooting instruction, and processes the panoramic video frame data according to the time information and the angle information carried in the picture shooting instruction to acquire a screenshot; and if the shooting key is continuously pressed for a long time, the processing module acquires a short video recording instruction, processes the panoramic video frame sequence data according to the time period information and the angle information of each frame carried in the short video recording instruction, and acquires videos formed by a plurality of screenshots.
When five keys are set on the VR glasses, the process that the processing module 230 performs corresponding processing according to the shooting instruction sent by the picture shooting key and the short video recording key to acquire a picture or a short video includes: when the picture shooting key is pressed down, the processing module acquires a picture shooting instruction, and processes the panoramic video frame data according to the time information and the angle information carried in the picture shooting instruction to acquire a screenshot; and when the short video recording key is pressed down, the processing module acquires a video recording starting instruction, and when the short video recording key is pressed down after a period of time, the processing module acquires a video recording ending instruction, and then the panoramic video frame sequence data is processed according to the time period information from the video recording starting to the video recording ending and the angle information of each frame, so as to acquire a video formed by a plurality of screenshots.
It should be noted that, keys may be arranged on both sides of the top end of the outside of the VR glasses, or keys may be arranged at other positions of the outside of the VR glasses; two keys are preferably arranged on VR glasses, and four or five keys are arranged, so that the user experience is easily influenced by confusion of key functions when the user touches the keys; secondly, the design of VR glasses is also complex. Of course, other arrangements in different combinations may be performed according to the requirements.
Further, the VR device corresponding to the VR device end 10 may further include a VR handle, and the VR handle communicates with the mobile device in a wireless manner, that is, the VR glasses do not have keys corresponding to the functions, and the VR handle has a plurality of keys corresponding to the mobile device end 20. The arrangement mode of the keys on the VR handle is the same as that of VR glasses.
Furthermore, the external hardware form of the VR glasses or the VR handle for correspondingly sending the playing and adjusting instruction and the shooting instruction can be a sliding block or a wave wheel or other expression forms besides a key.
Specifically, a specific process of processing the panoramic video frame data according to the time information and the angle information carried in the picture taking instruction in the processing module 230 to obtain the screenshot is described as follows.
The method comprises the steps that panoramic video image frame sequences which are the same as VR video content, namely the time sequence and the mapping angle are stored in advance, namely VR video image frames displayed and played correspond to panoramic video image frames stored in advance in time and mapping angles in a one-to-one mode; the angle information comprises a horizontal angle and a pitch angle corresponding to the mobile device, for example, a multi-frame image of one frame or a plurality of frames before and after the frame corresponding to the current time information of the VR video is selected from the stored panoramic video image frame sequence, and the multi-frame image is fused to obtain a fused enhanced image; and intercepting the screenshot corresponding to the direction and the angle information in the frame image or the fused enhanced image. The screenshot can be further stored as a photographed picture in a user account corresponding to the mobile device terminal for final preview and download of the user.
Similar to the process of acquiring the screenshot corresponding to the processing of the image shooting instruction, the specific process of processing the panoramic video frame sequence data according to the time period information from the beginning of video recording to the end of video recording and the angle information of each frame in the processing module 230 to acquire the video formed by the plurality of screenshots is as follows: selecting a part or all of panoramic image frames (or enhanced images) corresponding to the time period from the stored panoramic video image frame sequence according to the time period information as candidate images; capturing screenshots of which the directions correspond to the angle information carried in the instruction in each frame of candidate panoramic image aiming at the selected plurality of frames of candidate images; and coding all the intercepted screenshots according to a time sequence to form a video file. Further, the video file can be stored under a user account corresponding to the mobile equipment terminal for final preview and downloading of the user.
The screenshot method in the above processing process is a known technique, and is not described herein again.
In summary, after the shooting instruction is obtained, the VR video currently played by the display module 210 is shot with a picture or a short video according to the shooting instruction, and actually the panoramic video having the same time and mapping angle as the VR video displayed and played is shot with the picture or the short video, that is, the shooting instruction includes angle information and time information, and the processing module 230 captures the picture or continuously captures a plurality of pictures in the panoramic video according to the angle information and the time information and sequentially forms the video.
Another embodiment of the present invention provides a VR video playing method, as shown in fig. 2, the VR video playing method includes the following steps:
step one, playing and displaying a VR video;
step two, acquiring a playing adjustment instruction input by VR equipment adapted to the mobile equipment; performing play adjustment on the VR video which is played currently according to the play adjustment instruction;
step three, acquiring a shooting instruction input by VR equipment adapted to the mobile equipment; shooting a picture or a short video of the VR video played currently according to the shooting instruction;
the VR equipment is VR glasses, and a plurality of keys corresponding to the mobile equipment are arranged on the VR glasses; the playing adjustment instruction comprises a view angle enlarging instruction, a view angle reducing instruction or a view angle restoring initial instruction; the shooting instruction comprises a picture shooting instruction and a short video recording instruction.
Wherein, the process of playing and adjusting the VR video played currently according to the playing and adjusting instruction in the step two comprises: when the VR video is played with the field angle as the initial value of 1 time, a field angle enlarging instruction is obtained, and the field angle is enlarged or gradually enlarged until the field angle of the display area is adjusted to the maximum value and is not enlarged; after the angle of view is adjusted to the maximum value, acquiring an angle of view reduction instruction, wherein the angle of view is reduced or gradually reduced until the angle of view of the display area is adjusted to the minimum value and then is not reduced; and acquiring an initial command of the angle of view recovery, and recovering the angle of view to be 1 time of the initial value.
Wherein, the process of taking pictures or short videos of the VR video played at present according to the shooting instruction in the third step includes: processing panoramic video frame data which are the same as VR video content, namely the same time sequence and the same mapping angle according to time information and angle information carried in the picture shooting instruction, and acquiring a screenshot; and processing panoramic video frame sequence data which is the same as VR video content, namely the same time sequence and mapping angle according to time period information and angle information of each frame carried in the short video recording instruction to obtain videos formed by a plurality of screenshots.
The functions of the VR video playing method in this embodiment can be described by the VR video playing system, so that reference may be made to the above method embodiments for details in this embodiment, which are not described herein again.
Another embodiment of the present invention provides VR glasses for implementing the above-mentioned key function, and referring to fig. 3 to 8, the VR glasses have the following specific structure:
including a spectacle case body 1 and locate two vision lenses 2 in spectacle case body 1, spectacle case body 1 includes: the human body nose glasses comprise two side plates 11, a top plate 12, a bottom plate 13 and an arc panel 14, wherein the top plate 12, the bottom plate 13 and the two side plates 11 surround to form a frame with openings at two sides, the outer edge of the arc panel 14 is connected with the inner edge of the opening at one side of the frame, the arc panel 14 is matched with the face of a human body, two circular through holes 141 matched with the eye positions of the human body are arranged on the arc panel 14, an arc through hole 142 matched with the nose position of the human body is arranged on the arc panel, and a visual lens 2 is arranged at each circular through hole 141;
the mobile phone screen touch screen display device further comprises an upper touch key 3, a lower touch key 4, a first transmission device 5, a second transmission device 6, a first key 7 and a second key 8, wherein the first key 7 and the second key 8 are both installed on the top plate 12, the side, facing the bottom plate 13, of the top plate 12 is connected with the upper touch key 3 used for touching the mobile phone screen, the side, facing the top plate 12, of the bottom plate 12 is connected with the lower touch key 4 used for touching the mobile phone screen, the first key 7 and the upper touch key 3 are connected through the first transmission device 5, and the second key 8 and the lower touch key 4 are connected through the second transmission device 6.
Wherein, go up touch key 3 and include touch key connecting plate 31, go up touch key connecting plate 31 and be trapezoidal, go up touch key connecting plate 31 broad one side and roof 12 connection, go up touch key connecting plate 31 and deviate from one side of cambered plate 14 and be connected with touch key 3. The lower touch key 4 comprises a lower touch key connecting plate 41, one side of the lower touch key connecting plate 41 is connected with the bottom plate 13, and one side of the lower touch key connecting plate 41, which is far away from the arc panel 14, is connected with the lower touch key 4. The top plate 12 and the bottom plate 13 are parallel and horizontally arranged, the two side plates 11 are parallel and vertically arranged, and the cambered plate 14 is vertically arranged.
Furthermore, the frame also comprises a cover plate 9 arranged at the opening at the other side of the frame, and the bottom edge of the cover plate 9 is rotatably connected with the bottom plate 13. Be equipped with a horizontal partition plate 10 in the frame, an limit and the cambered plate 14 of horizontal partition plate 10 are connected, install first transmission 5 between horizontal partition plate 10 and roof 12, and first transmission 5 includes: the first shaft sleeve 51 is fixedly connected with the horizontal partition plate 10, the first rotating rod 52 is arranged in the first shaft sleeve 51, and the first pressing rod 53 is connected with the first key 7, one end of the first rotating rod 52 is connected with a first swinging block 521, the first swinging block 521 is in a water droplet shape, the first swinging block 521 abuts against one side, away from the upper touch key 3, of the upper touch key connecting plate 31, the other end of the first rotating rod 52 is provided with a first poking piece 522, a first compression spring 54 is arranged between one side face of the first poking piece 522 and the horizontal partition plate 10, and the lower end of the first pressing rod 53 abuts against the other side face of the first poking piece 522.
Further, a first short plate 55 is arranged between the first key 7 and the horizontal partition plate 10, the first short plate 55 is connected with the cambered plate 14, a first mounting hole is formed in the middle of the first short plate 55, the first pressing rod 53 is arranged in the first mounting hole, a first return spring 56 is sleeved on the first pressing rod 53, one end of the first return spring 56 abuts against the first key 7, and the other end of the first return spring 56 abuts against the first short plate 55.
Further, the second transmission device 6 includes a second shaft sleeve 61 fixedly connected to one side plate 11, a second pressing rod 62 disposed in the second shaft sleeve 61, a third shaft sleeve 63 fixedly connected to the bottom plate 13, and a second rotating rod 64 disposed in the third shaft sleeve 63, one end of the second rotating rod 64 is connected to a second swinging block 641, the second swinging block 641 is in a droplet shape, the second swinging block 641 abuts against one side of the lower touch key connecting plate 41 deviating from the lower touch key 4, the other end of the second rotating rod 64 is provided with a second toggle piece 642, a second compression spring 65 is installed between one side surface of the second toggle piece 642 and the bottom plate 13, and the lower end of the second pressing rod 62 abuts against the other side surface of the second toggle piece 642.
Further, a second short plate 66 is arranged between the second key 8 and the second shaft sleeve 61, the second short plate 66 is connected with the cambered plate 14, a second mounting hole is formed in the middle of the second short plate 66, the second pressing rod 62 is arranged in the second mounting hole, a second return spring 67 is sleeved on the second pressing rod 62, one end of the second return spring 67 abuts against the second key 8, and the other end of the second return spring 67 abuts against the second short plate 66.
Further, the glasses case body 1 further comprises a mobile phone partition board 15 installed in the frame, an accommodating space for accommodating a mobile phone is arranged between the mobile phone partition board 15 and the cover plate 9, and the mobile phone partition board 15 is provided with a film watching through hole for accommodating the upper touch key 3 and the lower touch key 4 and facilitating the watching of a mobile phone screen.
In a further embodiment, a right-angle partition plate is further installed in the frame, and the second transmission device 6 is arranged between the partition plate and the inner wall of the frame. The baffle that is the right angle form separates second transmission 6 and the middle zone in the frame, avoids the user of service to observe second transmission 6's structure in the frame, influences user of service's use and experiences using the VR glasses in-process. The horizontal partition plate 10 separates the first transmission device 5 from the middle area in the frame, so that the influence on the use experience of users due to the fact that the users observe the structure of the first transmission device 5 in the frame in the process of using VR glasses is avoided. The user of service is using VR glasses in-process, and the visible region of naked eye all coats and is equipped with black pigment in the frame, effectively absorbs the light of dispersing, avoids diffuse reflection's emergence, influences user of service's use and experiences.
User of service is when using VR glasses, place after opening the cell-phone in the accommodation space that is used for laying the cell-phone between cell-phone baffle 15 and apron 9, the cell-phone is towards vision lens direction 2, and rotatory apron 9, become airtight space with apron 9 and the involution of glasses box body 1, user of service takes up VR glasses and puts at the sight the place ahead of oneself, with the cambered plate 14 of VR glasses and the facial laminating of oneself, cambered plate 14 and human facial phase-match, user of service's forehead supports in the upper end of cambered plate 14 this moment, user of service's nose is located arc through-hole 142, user of service's eyes just can see through the vision lens 2 of installation in two circular through-holes 141 and observe the image of playing on the cell-phone screen.
The user of service can be through pressing first button 7 in order to control touch key 3 point on the cell-phone screen, perhaps through pressing second button 8 in order to control touch key 4 point on the cell-phone screen down, and then give the instruction to the cell-phone, need not to take out the cell-phone from the VR glasses and control again.
The first key 7 and the upper touch key 3 are connected through the first transmission device 5, in the using process, a user presses the first key 7, the first key 7 moves vertically downward, the first return spring 56 is compressed under the action of force, the first key 7 pushes the first pressure lever 53 to move downward, the first pressure lever 53 is pressed on the first dial piece 522 of the first rotating rod 52, the first compression spring 54 is compressed under the action of the first dial piece 522, the first rotating rod 52 located in the first shaft sleeve 51 rotates, the first rotating rod 52 rotates to drive the first swinging block 521 to rotate, the rotating direction is as shown in fig. 6, at this time, the first swinging block 521 pushes the upper touch key connecting plate 31 to incline to drive the upper touch key 3 to touch the mobile phone screen, and the upper touch key 3 clicks the mobile phone screen. The user presses the first key 7, and after the user gives an instruction to the mobile phone, the finger is moved away from the first key 7, at the moment, the first return spring 56 recovers to the original length, the first key 7 is pushed back to the original position, the first compression spring 54 recovers to the original length, the first toggle piece 522 is pushed back to the original position, the upper touch key connecting plate 31 returns to the original position, and the upper touch key 3 is moved away from the mobile phone screen and recovered to the original position.
The second key 8 and the lower touch key 4 are connected through the second transmission device 6, in the using process, a user presses the second key 8, the second key 8 moves vertically downward, the second return spring 67 is stressed and compressed, the second key 8 pushes the second pressing rod 62 to move downward, the second pressing rod 62 is pressed on the second shifting sheet 642 of the second rotating rod 64, the second compression spring 65 is stressed and compressed under the action of the second shifting sheet 642, so that the second rotating rod 64 in the third shaft sleeve 63 rotates, the second rotating rod 64 rotates to drive the second swinging block 641 to rotate, the rotating direction is as shown in fig. 6, at this time, the second swinging block 641 pushes the lower touch key connecting plate 41 to incline to drive the lower touch key 4 to touch the mobile phone screen, and the lower touch key 4 clicks the mobile phone screen. The user presses the second key 8, and after the user gives an instruction to the mobile phone, the finger is removed from the second key 8, at the moment, the second return spring 67 restores the original length, the second key 8 is pushed back to the original position, the second compression spring 65 restores the original length, the second toggle piece 642 is pushed back to the original position, the lower touch key connecting plate 41 returns to the original position, and the lower touch key 4 is removed from the mobile phone screen and restored to the original position.
The inner wall of the first shaft sleeve 51 and the outer wall of the first rotating rod 52 are connected by balls, and the first rotating rod 52 can freely rotate in the first shaft sleeve 51. Lubricating oil is coated between the inner wall of the first shaft sleeve 51 and the outer wall of the first rotating rod 52, and the first rotating rod 52 can freely rotate in the first shaft sleeve 51. The inner wall of the third shaft housing 63 and the outer wall of the second rotating lever 64 are connected by a ball, and the second rotating lever 64 can freely rotate in the third shaft housing 63. Lubricating oil is coated between the inner wall of the third shaft sleeve 63 and the outer wall of the second rotating rod 64, and the second rotating rod 64 can freely rotate in the third shaft sleeve 63.
In a further embodiment, as shown in fig. 4 and fig. 6, when a user uses VR glasses, the user opens the mobile phone and places the mobile phone in the accommodating space between the mobile phone partition 15 and the cover plate 9 for placing the mobile phone, the mobile phone partition 15 is installed between the upper touch key connecting plate 31 and the mobile phone screen, the upper end of the viewing through hole of the mobile phone partition 15 is matched with the upper touch key 3, a part of the upper touch key 3 is located in the viewing through hole, when the user presses the first button 7 to give an instruction to the mobile phone, the upper touch key connecting plate 31 inclines towards the mobile phone screen until the upper touch key 3 touches the mobile phone screen, and gives the instruction to the mobile phone, at this time, the upper touch key connecting plate 31 is elastically deformed under the action of the first swinging block 521, when the user removes the finger from the first button 7, the first swinging block 521 returns to the original position, and no longer applies an acting force to the upper touch key connecting plate 31, the upper touch key connecting plate 31 is restored, and the upper touch key 3 is removed from the mobile phone screen and restored to the original position.
A mobile phone partition plate 15 is arranged between a lower touch key connecting plate 41 and a mobile phone screen, the lower end of a film viewing through hole of the mobile phone partition plate 15 is matched with a lower touch key 4, one part of the lower touch key 4 is positioned in the film viewing through hole, when a user presses a second key 8 to give an instruction to a mobile phone, the lower touch key connecting plate 41 inclines towards the mobile phone screen until the lower touch key 4 touches the mobile phone screen to give the instruction to the mobile phone, the lower touch key connecting plate 41 is elastically deformed under the action of a first swinging block 521, when the finger of the user is removed from the second key 8, the first swinging block 521 returns to the original position, the acting force is not applied to the lower touch key connecting plate 41 any more, the lower touch key connecting plate 41 returns to the original position, and the lower touch key 4 is removed from the mobile phone screen and returns to the original position.
The upper touch key connecting plate 31 and the lower touch key connecting plate 41 are made of flexible materials and can elastically deform.
The second presser bar 62 is attached to the second boss 61 so as to be displaceable only in the vertical direction, and the second boss 61 serves to restrict displacement of the second presser bar 62 in the other direction. The inner wall of the second sleeve 61 and the outer wall of the second press rod 62 are connected by balls, and the second press rod 62 can freely displace in the vertical direction in the second sleeve 61. Lubricating oil is coated between the inner wall of the second shaft sleeve 61 and the outer wall of the second pressure lever 62, and the second pressure lever 62 can freely move in the second shaft sleeve 61 along the vertical direction.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. The present invention has been disclosed in an illustrative rather than a restrictive sense, and the scope of the present invention is defined by the appended claims.

Claims (10)

1. A VR video playing system is characterized by comprising a VR device end and a mobile device end,
the VR equipment corresponding to the VR equipment end is VR glasses, and a plurality of keys corresponding to the mobile equipment end are arranged on the VR glasses; a user sends an instruction to a mobile equipment end through an operation key, wherein the instruction comprises a playing adjustment instruction and a shooting instruction;
the mobile equipment end comprises a display module, an execution module and a processing module, wherein the display module is used for displaying a VR video; the execution module is used for executing corresponding playing adjustment operation according to the playing adjustment instruction sent by the VR equipment end; and the processing module is used for carrying out corresponding processing according to the shooting instruction sent by the VR equipment end so as to obtain the picture or the short video.
2. The VR video playing system of claim 1, wherein the playing adjustment instruction includes a field angle enlarging instruction, a field angle reducing instruction, or a field angle restoring initial instruction; the shooting instruction comprises a picture shooting instruction and a short video recording instruction.
3. The VR video playback system of claim 2, wherein the keys on the VR glasses are configured to: two keys are arranged outside the VR glasses and are respectively a play adjusting key and a shooting key.
4. The VR video playback system of claim 3, wherein the process of executing the corresponding playback adjustment operation by the execution module according to the playback adjustment command sent by the playback adjustment button includes: when the VR video is played with the initial value of the field angle being 1 time, if the playing adjustment key is pressed or continuously pressed for a long time, the execution module acquires a field angle amplification instruction, and the field angle is increased or gradually increased until the field angle of the display area is adjusted to the maximum value and then is not increased; after the angle of view is adjusted to the maximum value, if the playing adjustment key is pressed down or continuously pressed for a long time, the execution module acquires an angle of view reduction instruction, and the angle of view is reduced or gradually reduced until the angle of view of the display area is adjusted to the minimum value and is not reduced; and if the play adjusting key is double-clicked, the execution module acquires an initial instruction of the angle of view recovery, namely the angle of view is recovered to be 1 time of the initial value.
5. The VR video playing system of claim 4 wherein the processing module performs corresponding processing according to the shooting instruction sent by the shooting button to obtain the picture or short video, and the processing module further comprises: when the shooting key is pressed down, the processing module acquires a picture shooting instruction, and processes the panoramic video frame data according to the time information and the angle information carried in the picture shooting instruction to acquire a screenshot; and if the shooting key is continuously pressed for a long time, the processing module acquires a short video recording instruction, processes the panoramic video frame sequence data according to the time period information and the angle information of each frame carried in the short video recording instruction, and acquires videos formed by a plurality of screenshots.
6. The VR video playback system of claim 5 wherein the processing module processes the panoramic video frame data according to the time information and the angle information carried in the picture taking command to obtain the screenshot comprises: the method comprises the steps of pre-storing a panoramic video image frame sequence which has the same content with a VR video, namely the same time sequence and mapping angle, selecting a multi-frame image of one frame or a plurality of frames before and after the frame corresponding to the current time information of the VR video from the stored panoramic video image frame sequence, and fusing the multi-frame images to obtain a fused enhanced image; intercepting a screenshot corresponding to the direction and angle information in the frame image or the fused enhanced image;
the processing module processes the panoramic video frame sequence data according to the time period information and the angle information of each frame carried in the short video recording instruction, and the process of acquiring the video formed by a plurality of screenshots comprises the following steps: selecting a part of or all panoramic image frames corresponding to the time period from the stored panoramic video image frame sequence as candidate images according to the time period information; capturing screenshots of which the directions correspond to the angle information carried in the instruction in each frame of candidate panoramic image aiming at the selected plurality of frames of candidate images; and coding all the intercepted screenshots according to a time sequence to form a video file.
7. The VR video playing system of claim 6 wherein the VR device corresponding to the VR device end further comprises a VR handle, the VR handle wirelessly communicates with the mobile device end, the VR glasses are not provided with keys with corresponding functions, and the VR handle is provided with a plurality of keys corresponding to the mobile device end.
8. A VR video playing method is characterized by comprising the following steps:
step one, playing and displaying a VR video;
step two, acquiring a playing adjustment instruction input by VR equipment adapted to the mobile equipment, and playing and adjusting the VR video played currently according to the playing adjustment instruction; the VR equipment is VR glasses, and a plurality of keys corresponding to the mobile equipment are arranged on the VR glasses; the playing adjustment instruction comprises a field angle enlarging instruction, a field angle reducing instruction or a field angle restoring initial instruction;
step three, acquiring a shooting instruction input by VR equipment adapted to the mobile equipment, and shooting a picture or a short video of the VR video played currently according to the shooting instruction; the shooting instruction comprises a picture shooting instruction and a short video recording instruction.
9. The VR video playing method of claim 8, wherein the step two of adjusting the playing of the currently played VR video according to the playing adjustment instruction includes: when the VR video is played with the field angle as the initial value of 1 time, a field angle enlarging instruction is obtained, and the field angle is enlarged or gradually enlarged until the field angle of the display area is adjusted to the maximum value and is not enlarged; after the angle of view is adjusted to the maximum value, acquiring an angle of view reduction instruction, wherein the angle of view is reduced or gradually reduced until the angle of view of the display area is adjusted to the minimum value and then is not reduced; acquiring an initial command of restoring the field angle, and restoring the field angle to be 1 time of the initial value; the process of shooting the picture or the short video of the VR video played currently according to the shooting instruction in the third step comprises the following steps: processing panoramic video frame data which are the same as VR video content, namely the same time sequence and the same mapping angle according to time information and angle information carried in the picture shooting instruction, and acquiring a screenshot; and processing panoramic video frame sequence data which is the same as VR video content, namely the same time sequence and mapping angle according to time period information and angle information of each frame carried in the short video recording instruction to obtain videos formed by a plurality of screenshots.
10. The VR glasses for realizing the VR video playing system of any one of claims 1-6, comprising a glasses case and two vision lenses arranged in the glasses case, wherein the glasses case comprises two side plates, a top plate, a bottom plate and a cambered plate, the top plate, the bottom plate and the two side plates surround to form a frame with openings at two sides, the outer edge of the cambered plate is connected with the inner edge of the opening at one side of the frame, the cambered plate is matched with the face of a human body, the cambered plate is provided with two circular through holes matched with the positions of the eyes of the human body, the cambered plate is provided with a cambered through hole matched with the positions of the nose of the human body, and each circular through hole is provided with one vision lens;
the mobile phone screen touch screen is characterized by further comprising an upper touch key, a lower touch key, a first transmission device, a second transmission device, a first key and a second key, wherein the first key and the second key are mounted on the top plate, the side, facing the bottom plate, of the top plate is connected with the upper touch key used for touching the mobile phone screen, the side, facing the top plate, of the bottom plate is connected with the lower touch key used for touching the mobile phone screen, the first key and the upper touch key are connected through the first transmission device, and the second key and the lower touch key are connected through the second transmission device.
CN202111285300.5A 2021-11-02 2021-11-02 VR video playing system and method and VR glasses Pending CN114040231A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111285300.5A CN114040231A (en) 2021-11-02 2021-11-02 VR video playing system and method and VR glasses

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111285300.5A CN114040231A (en) 2021-11-02 2021-11-02 VR video playing system and method and VR glasses

Publications (1)

Publication Number Publication Date
CN114040231A true CN114040231A (en) 2022-02-11

Family

ID=80135937

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111285300.5A Pending CN114040231A (en) 2021-11-02 2021-11-02 VR video playing system and method and VR glasses

Country Status (1)

Country Link
CN (1) CN114040231A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6559846B1 (en) * 2000-07-07 2003-05-06 Microsoft Corporation System and process for viewing panoramic video
CN106406536A (en) * 2016-09-29 2017-02-15 努比亚技术有限公司 Head device, display device and image display method
CN106773066A (en) * 2017-03-13 2017-05-31 华勤通讯技术有限公司 A kind of VR glasses and its sighting distance adjusting method
CN107659824A (en) * 2017-10-20 2018-02-02 哈尔滨市舍科技有限公司 Virtual player based on user perspective
CN209044189U (en) * 2016-05-06 2019-06-28 深圳脑穿越科技有限公司 Virtual reality glasses
CN110446116A (en) * 2019-09-05 2019-11-12 青岛一舍科技有限公司 Panoramic video playing device and method
CN113286138A (en) * 2021-05-17 2021-08-20 聚好看科技股份有限公司 Panoramic video display method and display equipment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6559846B1 (en) * 2000-07-07 2003-05-06 Microsoft Corporation System and process for viewing panoramic video
CN209044189U (en) * 2016-05-06 2019-06-28 深圳脑穿越科技有限公司 Virtual reality glasses
CN106406536A (en) * 2016-09-29 2017-02-15 努比亚技术有限公司 Head device, display device and image display method
CN106773066A (en) * 2017-03-13 2017-05-31 华勤通讯技术有限公司 A kind of VR glasses and its sighting distance adjusting method
CN107659824A (en) * 2017-10-20 2018-02-02 哈尔滨市舍科技有限公司 Virtual player based on user perspective
CN110446116A (en) * 2019-09-05 2019-11-12 青岛一舍科技有限公司 Panoramic video playing device and method
CN113286138A (en) * 2021-05-17 2021-08-20 聚好看科技股份有限公司 Panoramic video display method and display equipment

Similar Documents

Publication Publication Date Title
EP2359915B1 (en) Media viewing
WO2018188499A1 (en) Image processing method and device, video processing method and device, virtual reality device and storage medium
US8922588B2 (en) Information processing program, information processing system, information processing apparatus, and information processing method, utilizing augmented reality technique
CN110809115B (en) Shooting method and electronic equipment
WO2010062117A2 (en) Immersive display system for interacting with three-dimensional content
JP2015513232A (en) 3D display system
CN114286142B (en) Virtual reality equipment and VR scene screen capturing method
CN111970456B (en) Shooting control method, device, equipment and storage medium
JP2017220032A (en) Information processing apparatus, information processing method, and computer program
JP6683864B1 (en) Content control system, content control method, and content control program
CN111467803B (en) Display control method and device in game, storage medium and electronic equipment
US20150244984A1 (en) Information processing method and device
CN104270623A (en) Display method and electronic device
CN112732089A (en) Virtual reality equipment and quick interaction method
WO2017173890A1 (en) Helmet having dual cameras
Wischgoll Display systems for visualization and simulation in virtual environments
CN107748616A (en) VR boxes, terminal control method, terminal, system and readable storage medium storing program for executing
CN114040231A (en) VR video playing system and method and VR glasses
EP3654099A2 (en) Method for projecting immersive audiovisual content
CN114286077B (en) Virtual reality device and VR scene image display method
CN108833783A (en) It scratches as group photo all-in-one machine and application method
WO2020248682A1 (en) Display device and virtual scene generation method
CN209859042U (en) Wearable control device and virtual/augmented reality system
CN216411742U (en) VR glasses
CN112019924A (en) Method for setting FOV of panoramic player

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination