CN106454098A - Virtual reality shooting and displaying method and system - Google Patents

Virtual reality shooting and displaying method and system Download PDF

Info

Publication number
CN106454098A
CN106454098A CN201610927758.9A CN201610927758A CN106454098A CN 106454098 A CN106454098 A CN 106454098A CN 201610927758 A CN201610927758 A CN 201610927758A CN 106454098 A CN106454098 A CN 106454098A
Authority
CN
China
Prior art keywords
image
mobile terminal
module
virtual reality
user
Prior art date
Application number
CN201610927758.9A
Other languages
Chinese (zh)
Inventor
严家亮
Original Assignee
深圳晨芯时代科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳晨芯时代科技有限公司 filed Critical 深圳晨芯时代科技有限公司
Priority to CN201610927758.9A priority Critical patent/CN106454098A/en
Publication of CN106454098A publication Critical patent/CN106454098A/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control ; Control of cameras comprising an electronic image sensor
    • H04N5/23229Devices for controlling television cameras, e.g. remote control ; Control of cameras comprising an electronic image sensor comprising further processing of the captured image without influencing the image pickup process
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/04Picture signal generators
    • H04N9/045Picture signal generators using solid-state devices

Abstract

The present invention relates to a virtual reality shooting and displaying method and system. The virtual reality shooting and displaying method comprises a tenth step that a mobile terminal takes an image of 180-degree angle of view or over 180-degree angle of view by using a fisheye lens disposed in front of a camera of the mobile terminal; a twentieth step that post-processing is performed on the obtained image; and a thirtieth step that a pair of VR glasses acquires a head posture of a user, clips the acquired image according to the acquired head posture, and displays the clipped image. Through adoption of the method and system, each user can take an image by using the fisheye lens installed on a camera of the mobile terminal, after post-processing is performed on the image, the image can be seen by using the pair of VR glasses, so that more video sources are available for the user to watch; and the user can take images by himself/herself, so that the user experience is improved sharply.

Description

A kind of virtual reality shooting and the method for showing, system

Technical field

The present invention relates to technical field of virtual reality, more particularly to a kind of virtual reality shooting and the method for showing, system.

Background technology

VR glasses are also referred to as virtual reality glasses, and it can provide immersion visual experience to wearer, significantly carry Game and video tastes are risen.User is when using VR glasses at present, and the quantity of the video source that can watch is very limited, and And, special VR capture apparatus are expensive, user can not easily voluntarily shooting image for viewing.

Content of the invention

The technical problem to be solved in the present invention is, the above-mentioned user for prior art can not easily voluntarily shooting figure As the defect for watching, method, system that a kind of virtual reality shoots and shows is provided, user easily voluntarily can shoot Image is for viewing.

The technical solution adopted for the present invention to solve the technical problems is:Construct the side that a kind of virtual reality shoots and shows Method, including:

S10. mobile terminal is shot at least 180 degree visual field scope by being arranged on the fish eye lens in front of its photographic head Image;

S20. post processing is carried out to captured image;

S30.VR glasses obtain the head pose of user, and according to acquired head pose, the image after process are carried out Intercept, and show institute's truncated picture.

Preferably, in step S20, the post processing includes anti-distortion process, color compensation process, image smoothing Process, denoising.

The present invention also constructs the system that a kind of virtual reality shoots and shows, including:

VR glasses;

Mobile terminal;And

The fish eye lens being arranged in front of the photographic head of mobile terminal;

Wherein,

The mobile terminal includes:

Taking module, for shooting the image at least 180 degree visual field scope by the fish eye lens;

Processing module, for carrying out post processing to captured image;

The VR glasses include:

Attitude acquisition module, for taking the head pose at family;

Interception module, for intercepting to acquired image according to acquired head pose;

Display module, for showing to institute's truncated picture.

Preferably, the post processing includes anti-distortion process, color compensation process, picture smooth treatment, denoising.

The present invention also constructs the system that a kind of virtual reality shoots and shows, including:

VR glasses;

Mobile terminal;

Image for being sent to mobile terminal carries out post processing and the Cloud Server is managed by user;And

The fish eye lens being arranged in front of the photographic head of mobile terminal;

Wherein,

The mobile terminal includes:

Taking module, for shooting the image at least 180 degree visual field scope by the fish eye lens;

Upper transmission module, for sending captured image to the Cloud Server;

First acquisition module, for obtaining image from the Cloud Server;

The VR glasses include:

Attitude acquisition module, for obtaining the head pose of user;

Interception module, for intercepting to acquired image according to acquired head pose;

Display module, for showing to institute's truncated picture.

Preferably, the post processing includes anti-distortion process, color compensation process, picture smooth treatment, denoising.

The present invention also constructs the system that a kind of virtual reality shoots and shows, including:

VR glasses;

Mobile terminal;

Image for being sent to mobile terminal carries out post processing and the Cloud Server is managed by user;And

The fish eye lens being arranged in front of the photographic head of mobile terminal;

Wherein,

The mobile terminal includes:

Taking module, for shooting the image at least 180 degree visual field scope by the fish eye lens;

Upper transmission module, for sending captured image to the Cloud Server;

The VR glasses include:

Second acquisition module, for obtaining image from the Cloud Server;

Attitude acquisition module, for obtaining the head pose of user;

Interception module, for intercepting to acquired image according to acquired head pose;

Display module, for showing to institute's truncated picture.

Preferably, the post processing includes anti-distortion process, color compensation process, picture smooth treatment, denoising.

Implement technical scheme, each user can be entered by the fish eye lens that installs on the photographic head of mobile terminal Row image taking, after post processing is carried out to the image, just can be watched by VR glasses.Therefore, user can watch Video source is more, and easily voluntarily can shoot.

Description of the drawings

In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing Accompanying drawing to be used needed for technology description is had to be briefly described, it should be apparent that, drawings in the following description are only this Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, acceptable Other accompanying drawings are obtained according to these accompanying drawings.In accompanying drawing:

Fig. 1 is the flow chart of virtual reality of the present invention shooting and the embodiment of the method one for showing;

Fig. 2 is the building-block of logic of virtual reality of the present invention shooting and the system embodiment one for showing;

Fig. 3 is the building-block of logic of virtual reality of the present invention shooting and the system embodiment two for showing;

Fig. 4 is the building-block of logic of virtual reality of the present invention shooting and the system embodiment three for showing.

Specific embodiment

In the virtual reality of the present invention shooting shown in Fig. 1 and the flow chart of the embodiment of the method one for showing, the embodiment Virtual reality shoots and the method for display is comprised the following steps:

S10. mobile terminal is shot at least 180 degree visual field scope by being arranged on the fish eye lens in front of its photographic head Image;

In this step, on the front of the photographic head of mobile terminal, a fish eye lens is removably installed, when user makes When being shot with the photographic head, the angle of visual field that just can photograph 180 degree is even more than the image in 180 degree visual field scope.

S20. post processing is carried out to captured image;

Fish eye lens is employed when in this step, due to shooting image, so the image for being obtained carries barrel distortion, In order to exaggerate its deformation effect, the picture that takes is in addition to centre, and other all of straight lines can all become the arc for bending Line, at this time, it may be necessary to carry out anti-distortion process, by repairing and being superimposed, goes back original image essence.In addition, to shooting obtained figure As also color compensation process can be carried out, to be optimized and improve color rendition and color representation to the brightness of image, color. In addition, the post processing also includes figure smoothing processing, denoising etc..In addition it should be noted that, the process of image Carry out on APP that can be on mobile terminals, can also send is carried out to Cloud Server.

S30.VR glasses obtain the head pose of user, and according to acquired head pose, the image after process are carried out Intercept, and show institute's truncated picture.

In this step, when user wants to watch image by VR glasses, the image for wanting to see first can be obtained, for example, Image after mobile terminal shoots and processes can be directly used for viewing, also can obtain others' institute by mobile terminal from Cloud Server The image of shooting, certainly, VR glasses also directly can obtain the image captured by others from Cloud Server.To watch obtaining Image after, the attitude transducer (such as gyroscope) inside VR glasses just can start detect user head pose, and according to Acquired head pose is intercepted to acquired image, for example, user's rotary head to the left, just intercept the left lateral of image Point, user's rotary head to the right, the right-hand component of image is just intercepted, in a particular application, can be pre-set corresponding to unit angle Pixel, then according to the pixel that the head rotation angle calculation for being detected every time is to be offset, is then intercepted again, and Image after intercepting is shown.

Implement the technical scheme of the embodiment, each user can pass through the fish eye lens that installs on the photographic head of mobile terminal Image taking is carried out, and after post processing being carried out to the image, just can be watched by VR glasses.Therefore, user can watch Video source more, and can voluntarily shoot, substantially increase Consumer's Experience.

Fig. 2 is the building-block of logic of virtual reality of the present invention shooting and the system embodiment one for showing, the void of the embodiment The system that intends reality shooting and show includes mobile terminal 10, VR glasses 20 and fish eye lens 30.Wherein, fish eye lens 30 is arranged Front in the photographic head of mobile terminal 10.Mobile terminal 10 includes taking module 11 and processing module 12, and, taking module 11 are used for shooting the image at least 180 degree visual field scope by fish eye lens 30;Processing module 12 is used for captured Image carries out post processing, and the post processing includes anti-distortion process, color compensation process, picture smooth treatment, denoising.VR eye Mirror 20 includes attitude acquisition module 21, interception module 22 and display module 23, and, attitude acquisition module 21 is used for obtaining user Head pose, the attitude acquisition module 21 be, for example, gyroscope;Interception module 22 is used for according to acquired head pose pair Acquired image is intercepted;Display module 23 is used for showing institute's truncated picture.

Fig. 3 is the building-block of logic of virtual reality of the present invention shooting and the system embodiment two for showing, the void of the embodiment The system that intends reality shooting and show includes mobile terminal 10, VR glasses 20, fish eye lens 30 and Cloud Server 40, wherein, fish Glasses head 30 is arranged on the front of the photographic head of mobile terminal 10.Mobile terminal 10 includes taking module 11,13 and of upper transmission module First acquisition module 14, and, taking module 11 is used for shooting at least 180 degree visual field scope by the fish eye lens Image;Upper transmission module 13 is used for sending captured image to Cloud Server 40;First acquisition module 14 is used for from cloud service Device 40 obtains image, can obtain image online, can also download acquisition image.Cloud Server 40 is used for sending out mobile terminal The image for sending carries out post processing and user is managed, and wherein, includes anti-distortion process to the process of image, at color compensation Reason, picture smooth treatment, denoising;Management to user includes:The image that user is uploaded with which is associated, Yong Huyu Can pay attention between user, cancel concern, recommended users etc., in addition, image can also carry class label and time tag, classification Label for example includes landscape, personage etc..VR glasses 20 include attitude acquisition module 21, interception module 22 and display module 23, And, attitude acquisition module 21 is used for obtaining the head pose of user;Interception module 22 is used for according to acquired head pose Acquired image is intercepted;Display module 23 is used for showing institute's truncated picture.

Fig. 4 is the building-block of logic of virtual reality of the present invention shooting and the system embodiment three for showing, the void of the embodiment The system that intends reality shooting and show includes mobile terminal 10, VR glasses 20, fish eye lens 30 and Cloud Server 40, wherein, fish Glasses head 30 is arranged on the front of the photographic head of mobile terminal 10.Mobile terminal 10 includes taking module 11, upper transmission module 13, and And, taking module 11 is used for shooting the image at least 180 degree visual field scope by the fish eye lens;Upper transmission module 13 is used In captured image is sent to Cloud Server 40.Cloud Server 40 is used for locating after the image that sends mobile terminal is carried out Reason and user is managed, wherein, the process of image is included anti-distortion process, color compensation process, at image smoothing Reason, denoising;Management to user includes:The image that user is uploaded with which is associated, and can add between user and user Concern, cancellation concern, recommended users etc., in addition, image can also carry class label and time tag, class label for example include There are landscape, personage etc..VR glasses 20 include attitude acquisition module 21, interception module 22, display module 23 and the second acquisition module 24, and, the second acquisition module 24 is used for obtaining image from Cloud Server 40, can obtain image online, can also download and obtain Take image;Attitude acquisition module 21 is used for obtaining the head pose of user;Interception module 22 is used for according to acquired head appearance State is intercepted to acquired image;Display module 23 is used for showing institute's truncated picture.

The preferred embodiments of the present invention are the foregoing is only, the present invention is not limited to, for the skill of this area For art personnel, the present invention can have various modifications and variations.All any buns that within the spirit and principles in the present invention, is made Change, equivalent, improvement etc., should be included within scope of the presently claimed invention.

Claims (8)

1. a kind of method that virtual reality shoots and shows, it is characterised in that include:
S10. mobile terminal shoots the figure at least 180 degree visual field scope by being arranged on the fish eye lens in front of its photographic head Picture;
S20. post processing is carried out to captured image;
S30.VR glasses obtain the head pose of user, and according to acquired head pose, the image after process are carried out cutting Take, and show institute's truncated picture.
2. the method that virtual reality according to claim 1 shoots and shows, it is characterised in that in step S20, The post processing includes anti-distortion process, color compensation process, picture smooth treatment, denoising.
3. the system that a kind of virtual reality shoots and shows, it is characterised in that include:
VR glasses;
Mobile terminal;And
The fish eye lens being arranged in front of the photographic head of mobile terminal;
Wherein,
The mobile terminal includes:
Taking module, for shooting the image at least 180 degree visual field scope by the fish eye lens;
Processing module, for carrying out post processing to captured image;
The VR glasses include:
Attitude acquisition module, for taking the head pose at family;
Interception module, for intercepting to acquired image according to acquired head pose;
Display module, for showing to institute's truncated picture.
4. the system that virtual reality according to claim 3 shoots and shows, it is characterised in that the post processing includes instead Distortion process, color compensation process, picture smooth treatment, denoising.
5. the system that a kind of virtual reality shoots and shows, it is characterised in that include:
VR glasses;
Mobile terminal;
Image for being sent to mobile terminal carries out post processing and the Cloud Server is managed by user;And
The fish eye lens being arranged in front of the photographic head of mobile terminal;
Wherein,
The mobile terminal includes:
Taking module, for shooting the image at least 180 degree visual field scope by the fish eye lens;
Upper transmission module, for sending captured image to the Cloud Server;
First acquisition module, for obtaining image from the Cloud Server;
The VR glasses include:
Attitude acquisition module, for obtaining the head pose of user;
Interception module, for intercepting to acquired image according to acquired head pose;
Display module, for showing to institute's truncated picture.
6. the system that virtual reality according to claim 5 shoots and shows, it is characterised in that the post processing includes instead Distortion process, color compensation process, picture smooth treatment, denoising.
7. the system that a kind of virtual reality shoots and shows, it is characterised in that include:
VR glasses;
Mobile terminal;
Image for being sent to mobile terminal carries out post processing and the Cloud Server is managed by user;And
The fish eye lens being arranged in front of the photographic head of mobile terminal;
Wherein,
The mobile terminal includes:
Taking module, for shooting the image at least 180 degree visual field scope by the fish eye lens;
Upper transmission module, for sending captured image to the Cloud Server;
The VR glasses include:
Second acquisition module, for obtaining image from the Cloud Server;
Attitude acquisition module, for obtaining the head pose of user;
Interception module, for intercepting to acquired image according to acquired head pose;
Display module, for showing to institute's truncated picture.
8. the system that virtual reality according to claim 7 shoots and shows, it is characterised in that the post processing includes instead Distortion process, color compensation process, picture smooth treatment, denoising.
CN201610927758.9A 2016-10-31 2016-10-31 Virtual reality shooting and displaying method and system CN106454098A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610927758.9A CN106454098A (en) 2016-10-31 2016-10-31 Virtual reality shooting and displaying method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610927758.9A CN106454098A (en) 2016-10-31 2016-10-31 Virtual reality shooting and displaying method and system

Publications (1)

Publication Number Publication Date
CN106454098A true CN106454098A (en) 2017-02-22

Family

ID=58178030

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610927758.9A CN106454098A (en) 2016-10-31 2016-10-31 Virtual reality shooting and displaying method and system

Country Status (1)

Country Link
CN (1) CN106454098A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108355334A (en) * 2018-02-12 2018-08-03 东南大学 A kind of virtual swimming body-building device
WO2018161817A1 (en) * 2017-03-08 2018-09-13 捷开通讯(深圳)有限公司 Storage medium, and method and system for simulating photography in virtual reality scene

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090059041A1 (en) * 2007-08-27 2009-03-05 Sung Jin Kwon Method of correcting image distortion and apparatus for processing image using the method
WO2013083730A1 (en) * 2011-12-06 2013-06-13 Hexagon Technology Center Gmbh Coordinate measuring machine having a camera
CN104994308A (en) * 2015-06-30 2015-10-21 广东欧珀移动通信有限公司 Method and device for shooting fisheye image
TW201618030A (en) * 2014-06-30 2016-05-16 英特爾公司 Facilitating dynamic and efficient pre-launch clipping for partially-obscured graphics images on computing devices
CN105589199A (en) * 2014-11-06 2016-05-18 精工爱普生株式会社 Display device, method of controlling the same, and program
CN105739525A (en) * 2016-02-14 2016-07-06 普宙飞行器科技(深圳)有限公司 System of matching somatosensory operation to realize virtual flight
CN105847538A (en) * 2016-03-16 2016-08-10 惠州Tcl移动通信有限公司 Mobile phone and method for controlling operations of VR (Virtual Reality) glasses based on eyeball tracking
CN105929543A (en) * 2016-06-18 2016-09-07 深圳晨芯时代科技有限公司 Virtual reality device, virtual reality glass box thereof and virtual reality plate

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090059041A1 (en) * 2007-08-27 2009-03-05 Sung Jin Kwon Method of correcting image distortion and apparatus for processing image using the method
WO2013083730A1 (en) * 2011-12-06 2013-06-13 Hexagon Technology Center Gmbh Coordinate measuring machine having a camera
TW201618030A (en) * 2014-06-30 2016-05-16 英特爾公司 Facilitating dynamic and efficient pre-launch clipping for partially-obscured graphics images on computing devices
CN105589199A (en) * 2014-11-06 2016-05-18 精工爱普生株式会社 Display device, method of controlling the same, and program
CN104994308A (en) * 2015-06-30 2015-10-21 广东欧珀移动通信有限公司 Method and device for shooting fisheye image
CN105739525A (en) * 2016-02-14 2016-07-06 普宙飞行器科技(深圳)有限公司 System of matching somatosensory operation to realize virtual flight
CN105847538A (en) * 2016-03-16 2016-08-10 惠州Tcl移动通信有限公司 Mobile phone and method for controlling operations of VR (Virtual Reality) glasses based on eyeball tracking
CN105929543A (en) * 2016-06-18 2016-09-07 深圳晨芯时代科技有限公司 Virtual reality device, virtual reality glass box thereof and virtual reality plate

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018161817A1 (en) * 2017-03-08 2018-09-13 捷开通讯(深圳)有限公司 Storage medium, and method and system for simulating photography in virtual reality scene
CN108355334A (en) * 2018-02-12 2018-08-03 东南大学 A kind of virtual swimming body-building device

Similar Documents

Publication Publication Date Title
US9959676B2 (en) Presentation of enhanced communication between remote participants using augmented and virtual reality
KR101313740B1 (en) OSMU( One Source Multi Use)-type Stereoscopic Camera and Method of Making Stereoscopic Video Content thereof
CN105103034B (en) Display
US20120162384A1 (en) Three-Dimensional Collaboration
CN106797460A (en) The reconstruction of 3 D video
US20110096095A1 (en) Display device and method for adjusting image on display screen of the same
EP3262614B1 (en) Calibration for immersive content systems
US20110234475A1 (en) Head-mounted display device
JP2014508430A (en) Zero parallax plane for feedback-based 3D video
JPH07287761A (en) Device and method for processing picture
US9412169B2 (en) Real-time visual feedback for user positioning with respect to a camera and a display
US20080174659A1 (en) Wide field of view display device and method
WO2014197109A3 (en) Infrared video display eyewear
CN103049175B (en) Preview screen rendering method, device and terminal
CN103513421A (en) Image processing device, image processing method, and image processing system
US20150358539A1 (en) Mobile Virtual Reality Camera, Method, And System
JP2017505004A (en) Image generation method and dual lens apparatus
CN104796594B (en) Method for instantly presenting special effect of preview interface and terminal equipment
US9065967B2 (en) Method and apparatus for providing device angle image correction
EP3151539A1 (en) Image acquisition device, image acquisition method and terminal
US9538160B1 (en) Immersive stereoscopic video acquisition, encoding and virtual reality playback methods and apparatus
WO2015081555A1 (en) Photographing method for dual-camera device and dual-camera device
CN103493480A (en) Video conferencing display device
EP2978217A1 (en) Display device and visual display method for simulating holographic 3d scene
KR20150068299A (en) Method and system of generating images for multi-surface display

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170222