CN204679953U - A kind of wear-type 3D audio and video player based on aspect sensor - Google Patents

A kind of wear-type 3D audio and video player based on aspect sensor Download PDF

Info

Publication number
CN204679953U
CN204679953U CN201420684762.3U CN201420684762U CN204679953U CN 204679953 U CN204679953 U CN 204679953U CN 201420684762 U CN201420684762 U CN 201420684762U CN 204679953 U CN204679953 U CN 204679953U
Authority
CN
China
Prior art keywords
audio
control unit
aspect sensor
speech control
wear
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201420684762.3U
Other languages
Chinese (zh)
Inventor
曹一挥
朱锐
米磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Low-Light Medical Skill Co Ltd Of Section In Xi'an
Original Assignee
Low-Light Medical Skill Co Ltd Of Section In Xi'an
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Low-Light Medical Skill Co Ltd Of Section In Xi'an filed Critical Low-Light Medical Skill Co Ltd Of Section In Xi'an
Priority to CN201420684762.3U priority Critical patent/CN204679953U/en
Application granted granted Critical
Publication of CN204679953U publication Critical patent/CN204679953U/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Controls And Circuits For Display Device (AREA)

Abstract

The utility model relates to a kind of wear-type 3D audio and video player based on aspect sensor.Comprise Virtual Reality Head-mounted Displays, also comprise and be arranged on detachable image-display units in Virtual Reality Head-mounted Displays and speech control unit; Image-display units comprises display screen, aspect sensor and sends the receiver of signal for receiving speech control unit; Speech control unit comprises voice receiving unit, for judging voice recognition unit and the signal projector of voice command; Image-display units controls the open and close of display screen by the signal receiving the transmitting of speech control unit signal projector; Image-display units is connected with signal projector by receiver with speech control unit.The utility model provides a kind of wear-type 3D audio and video player that at will can adjust viewing picture easy to use.

Description

A kind of wear-type 3D audio and video player based on aspect sensor
Technical field
The utility model belongs to the audio-visual broadcasting field of 3D, relate to a kind of wear-type 3D audio and video player, be specifically related to a kind of wear-type 3D audio and video player based on aspect sensor, the utility model is according to aspect sensor, can according to user's head movement information adjustment picture position when playing 3D and being audio-visual, make user can see the picture of area-of-interest position clearly, improve the 3D feeling of immersion of user.
Background technology
Flourish along with wear-type virtual reality technology, the audio-visual broadcasting of 3D is also play from large screen projection and is transferred to the display frame of the audio-visual broadcasting of wear-type 3D.The audio-visual broadcasting of wear-type 3D generally adopts bar phone screen as display, because its cost performance is high, has become the main flow of the audio-visual broadcasting of wear-type 3D.
The audio-visual 3D video referred to by the shooting of binocular camera simulating human eyes of 3D, during with mobile phone screen as 3D video display apparatus, mobile phone screen is divided into equably two pictures in left and right, when showing 3D video capture respectively captured by binocular camera two-way picture, people watch the left and right picture of mobile phone screen respectively by left and right eyes, just can observe the effect of 3D vision.
But, in above-mentioned 3D audio and video player, there is a problem: due in the audio-visual broadcasting of wear-type 3D, the distance of human eye and display screen is too near, the viewpoint of human eye can only see the central area of picture clearly, when being concerned about certain corner regions in video pictures as people, during captions below such as video, just cannot see this place's picture clearly, cause the problem that 3D experience effect is deteriorated.And after user brings the virtual helmet, peeped due to the visual field and hide completely, therefore Non-follow control player has inconvenience more.
Utility model content
In order to solve technical matters existing in background technology, the utility model devises a kind of wear-type 3D audio and video player based on aspect sensor, when user needs to see picture corner place clearly, head is only needed to move to for seeing picture position clearly, time mobile, mobile phone aspect sensor can capture head movement information, according to this information, calculate moving direction and the size of audio-visual picture, will for seeing picture moving clearly to video hub, i.e. view region, make user can see this region clearly, thus solve the problems referred to above, and can by the open and close of Voice command player display screen, use very convenient.
Technical solution of the present utility model is: a kind of wear-type 3D audio and video player based on aspect sensor, comprise Virtual Reality Head-mounted Displays, its special character is: also comprise and be arranged on detachable image-display units in Virtual Reality Head-mounted Displays and speech control unit;
Above-mentioned image-display units comprises display screen, aspect sensor and sends the receiver of signal for receiving speech control unit;
Above-mentioned speech control unit comprises voice receiving unit, for judging voice recognition unit and the signal projector of voice command;
Above-mentioned image-display units controls the open and close of display screen by the signal receiving the transmitting of speech control unit signal projector;
Above-mentioned image-display units is connected with signal projector by receiver with speech control unit;
Above-mentioned receiver is connected by bluetooth with between signal projector;
Above-mentioned aspect sensor comprises mobile message capturing unit and the position calculation unit adjusted for image frame; Position calculation unit by the mobile message capturing unit in called side level sensor, and calculates the image frame after adjustment according to capturing information, shows user finally by display screen.
The utility model has the advantages that: viewpoint immovable problem when the utility model is intended to solve wear-type 3D audio-visual broadcasting.In existing technology, also not for this way to solve the problem.The simplest mode that can expect is by showing after picture compression, but compression can reduce the resolution of video.And the utility model is from the reverse angle of another one, addressed this problem by the algorithm adjusting display frame.Make user can by simple interactive operation just can to see clearly in broadcasting pictures any region of relation.And by the open and close of Voice command screen, use very convenient.
Accompanying drawing explanation
Fig. 1 is the audio-visual picture view of 3D play according to the head-wearing mobile phone screen of preferred embodiment of the present utility model;
Fig. 2 moves schematic diagram according to the screen-picture of preferred embodiment of the present utility model with aspect sensor;
Fig. 3 is all movable direction schematic diagram according to preferred embodiment of the present utility model;
Fig. 4 is the workflow diagram of a kind of wear-type 3D audio and video player based on aspect sensor according to preferred embodiment of the present utility model;
Fig. 5 is the utility model structural representation;
Wherein 101-Virtual Reality Head-mounted Displays, 102-image-display units, 202-left-eye video district, 203-right eye video area.
Embodiment
See Fig. 1-5, a kind of wear-type 3D audio and video player based on aspect sensor, comprises Virtual Reality Head-mounted Displays 101, also comprises and is arranged on detachable image-display units 102 in Virtual Reality Head-mounted Displays 101 and speech control unit; Image-display units 102 comprises display screen, aspect sensor and sends the receiver of signal for receiving speech control unit; Speech control unit comprises voice receiving unit, for judging voice recognition unit and the signal projector of voice command; Image-display units 102 controls the open and close of display screen by the signal receiving the transmitting of speech control unit signal projector; Image-display units 102 is connected with signal projector by receiver with speech control unit; Be connected by bluetooth between receiver with signal projector; Aspect sensor comprises mobile message capturing unit and the position calculation unit adjusted for image frame; Position calculation unit by the mobile message capturing unit in called side level sensor, and calculates the image frame after adjustment according to capturing information, shows user finally by display screen.
Based on an image frame adjustment position calculating method for wear-type 3D audio and video player, its special character is: comprise the following steps:
1] first, user's head movement information data are gathered with the mobile message capturing unit of aspect sensor;
2] secondly, then by the information data transmission that gathers to position calculation unit, calculate user the video area of relation;
2.1] data of aspect sensor are set to x and y by position calculation unit respectively, and x correspondence vertically moves, the corresponding transverse shifting of y;
When the positional information of 2.2] catching when aspect sensor does not change, namely user does not have moving-head, then x and y value is 0, directly raw frames is returned to display screen and shows;
When the positional information of 2.3] catching when aspect sensor changes, namely user has moving-head, then x and y value is not 0, and it is contrary that user's head moving direction and picture adjust moving direction, needs to carry out negate to x, y, finally determines that user pays close attention to picture area;
3] last, by image-display units, regional display is adjusted within the scope of viewpoint.
Above-mentioned steps 2] in x, y span formula as follows:
x = x , x < 0.3 * h e i g h t 0.3 * x , x &GreaterEqual; 0.3 * h e i g h t
y = x , x < 0.4 * w i d t h 0.4 * x , x &GreaterEqual; 0.4 * w i d t h
Wherein, height and width represents the height and the width value of display screen respectively, when the displacement in aspect sensor information is greater than this range scale, then replaced by maximum mobile range value.
Below in conjunction with drawings and embodiments, the utility model is described in further detail.It should be noted that embodiment described herein is the example of the utility model principle, these examples are not by the utility model limitation in the embodiments described herein.
A kind of wear-type 3D audio and video player based on aspect sensor that the utility model proposes, its starting point is the aspect sensor collection user head movement information by mobile phone, and user's head moving direction and distance corresponding with its interest region, the algorithm that the utility model proposes, according to the information of aspect sensor calculate user the video area of relation, and this regional display is adjusted within the scope of viewpoint, i.e. screen center, thus make user can see its interest region picture clearly.
Fig. 1 is according to the audio-visual broadcasting pictures schematic diagram of the 3D of preferred embodiment of the present utility model.Wherein, 101 is bar phone shell, and 102 is screens of mobile phone, 103 and 104 be respectively play 3D audio-visual time corresponding binocular video in left and right order picture, in 103 and 104, A, B, C, D are for the upper left in markup picture, upper right, lower-left, four, bottom right corner regions.In existing wear-type 3D audio and video player, the viewpoint due to human eye is the central area in each screen all the time, if user needs to pay close attention to picture corner region, because viewpoint cannot move, causes this problem of the content cannot seeing corner regions clearly.
Because the viewpoint of human eye cannot move, in order to can allow user interested in the corner regions content of video be see clearly, the utility model proposes by mobile display screen position, user's area-of-interest moved to screen center region, namely view region, solves the problems referred to above.And the information of required moving direction and size during moving display screen, be make use of user to see information when moving-head action is made in certain region clearly, this information is again caught by the aspect sensor of mobile phone.
Fig. 2 is the information according to aspect sensor according to preferred embodiment of the present utility model and schematic diagram to the audio-visual picture adjustment of 3D.Wherein, 201 represent the head movable signal that aspect sensor is caught, its direction representative of consumer head moves down, represent that user pays close attention to video lower zone content, in screen 202 and 203, picture entirety moves up, and makes C, D region content below former video is moved, and moves within the scope of the viewpoint of personnel.Video pictures is moved to the white space flowed out below rear screen, the utility model pixel value be 0 black region fill.
Fig. 3 is all directions schematic diagram according to the adjustment of the 3D of preferred embodiment of the present utility model audio-visual picture.Figure (a) represents customer relationship video upper area, and picture entirety moves down, and A, B region moves to the view region of screen center; Figure (b) represents region, customer relationship video right, and picture entirety moves to left, and B, D region moves to the view region of screen center; Figure (c) represents customer relationship video lower zone, and picture moves on the whole, and C, D region moves to the view region of screen center; Figure (d) represents region, customer relationship video left, and picture entirety moves to right, and A, C region moves to the view region of screen center; Figure (e) represents region, customer relationship video upper left side, and picture entirety moves to the right, and a-quadrant moves to the view region of screen center; Figure (f) represents region, customer relationship video upper right side, and picture entirety left below is mobile, and B region moves to the view region of screen center; Figure (g) represents customer relationship video bottom-left quadrant, and picture entirety moves to upper right side, and C region moves to the view region of screen center; Figure (h) represents region, customer relationship video lower right, and picture entirety moves to upper left side, and D region moves to the view region of screen center.
The workflow of the utility model video pictures adjustment unit algorithm is as follows:
Computing unit monitors the rreturn value of aspect sensor in real time by get_move () function: x, y, the here positive and negative decision moving direction of x, y, the size of x, y value determines mobile size, and x correspondence vertically moves, and namely moves up and down, the corresponding transverse shifting of y, namely moves left and right.If the positional information that aspect sensor is caught does not change, namely user does not have moving-head, then x and y value is 0, directly raw frames is returned to display screen unit and shows; If the positional information that aspect sensor is caught changes, namely user has moving-head, then x and y value is not 0, now call picture Tuning function make_move (), in this function, due to user's head moving direction and picture, to adjust moving direction contrary, so need to carry out negate to x, y; In addition, this algorithm limit picture laterally, the maximum magnitude that vertically moves, maximum mobile range be picture laterally 40%, vertical scale 30%, if the displacement in aspect sensor information is greater than this range scale, then replaced by maximum mobile range value, that is:
x = x , x < 0.3 * h e i g h t 0.3 * x , x &GreaterEqual; 0.3 * h e i g h t
y = x , x < 0.4 * w i d t h 0.4 * x , x &GreaterEqual; 0.4 * w i d t h
Here, height and width represents the height and the width value of display screen respectively.
4 the workflow of a kind of wear-type 3D audio and video player based on aspect sensor of the present utility model is introduced further by reference to the accompanying drawings more below:
Step 401: open the 3D audio and video player in display unit, and worn virtual implementing helmet;
Step 402: viewing video, now, video hub region is that viewpoint is the most local;
Step 403: if user thinks that other corner regions are known in viewing, moving-head direction is to region-of-interest direction;
Step 404: the picture Adjustable calculation unit in display unit is monitored and obtains the rreturn value of aspect sensor, and calculates display frame according to rreturn value.
Step 405: display screen by the picture exhibition that calculates in step 404 to user.
Foregoing detailed description is about exemplary description of the present utility model, it will be obvious to those skilled in the art that and in spirit of the present utility model and scope, can obtain some amendment, change and interchangeable structure to described utility model.

Claims (3)

1. based on a wear-type 3D audio and video player for aspect sensor, comprise Virtual Reality Head-mounted Displays, it is characterized in that: also comprise and be arranged on detachable image-display units in Virtual Reality Head-mounted Displays and speech control unit; Described image-display units comprises display screen, aspect sensor and sends the receiver of signal for receiving speech control unit; Described speech control unit comprises voice receiving unit, for judging voice recognition unit and the signal projector of voice command; Described image-display units controls the open and close of display screen by the signal receiving the transmitting of speech control unit signal projector; Described image-display units is connected with signal projector by receiver with speech control unit.
2. a kind of wear-type 3D audio and video player based on aspect sensor according to claim 1, is characterized in that: described receiver is connected by bluetooth with between signal projector.
3. a kind of wear-type 3D audio and video player based on aspect sensor according to claim 1 and 2, is characterized in that: described aspect sensor comprises mobile message capturing unit and the position calculation unit adjusted for image frame; Position calculation unit by the mobile message capturing unit in called side level sensor, and calculates the image frame after adjustment according to capturing information, shows user finally by display screen.
CN201420684762.3U 2014-11-14 2014-11-14 A kind of wear-type 3D audio and video player based on aspect sensor Expired - Fee Related CN204679953U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201420684762.3U CN204679953U (en) 2014-11-14 2014-11-14 A kind of wear-type 3D audio and video player based on aspect sensor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201420684762.3U CN204679953U (en) 2014-11-14 2014-11-14 A kind of wear-type 3D audio and video player based on aspect sensor

Publications (1)

Publication Number Publication Date
CN204679953U true CN204679953U (en) 2015-09-30

Family

ID=54179629

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201420684762.3U Expired - Fee Related CN204679953U (en) 2014-11-14 2014-11-14 A kind of wear-type 3D audio and video player based on aspect sensor

Country Status (1)

Country Link
CN (1) CN204679953U (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105677275A (en) * 2015-12-31 2016-06-15 北京小鸟看看科技有限公司 Interface layout method and wraparound interface system
CN105812768A (en) * 2016-03-18 2016-07-27 深圳市维尚境界显示技术有限公司 Method and system for playing 3D video in VR (Virtual Reality) device
CN106445098A (en) * 2016-07-29 2017-02-22 北京小米移动软件有限公司 Control method and control apparatus used for head-mounted device, and mobile device
CN108139804A (en) * 2015-10-15 2018-06-08 索尼公司 Information processing unit and information processing method
CN108536279A (en) * 2017-03-06 2018-09-14 北京可见文化传播有限公司 The method and system of numerical value adjusting are carried out based on head movement in VR environment
US10372289B2 (en) 2015-12-31 2019-08-06 Beijing Pico Technology Co., Ltd. Wraparound interface layout method, content switching method under three-dimensional immersive environment, and list switching method

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108139804A (en) * 2015-10-15 2018-06-08 索尼公司 Information processing unit and information processing method
CN105677275A (en) * 2015-12-31 2016-06-15 北京小鸟看看科技有限公司 Interface layout method and wraparound interface system
CN105677275B (en) * 2015-12-31 2018-11-23 北京小鸟看看科技有限公司 A kind of quick interface arrangement method and circulating type interface system
US10372289B2 (en) 2015-12-31 2019-08-06 Beijing Pico Technology Co., Ltd. Wraparound interface layout method, content switching method under three-dimensional immersive environment, and list switching method
CN105812768A (en) * 2016-03-18 2016-07-27 深圳市维尚境界显示技术有限公司 Method and system for playing 3D video in VR (Virtual Reality) device
CN105812768B (en) * 2016-03-18 2018-06-19 深圳市维尚境界显示技术有限公司 Playback method and system of a kind of 3D videos in VR equipment
CN106445098A (en) * 2016-07-29 2017-02-22 北京小米移动软件有限公司 Control method and control apparatus used for head-mounted device, and mobile device
CN108536279A (en) * 2017-03-06 2018-09-14 北京可见文化传播有限公司 The method and system of numerical value adjusting are carried out based on head movement in VR environment
CN108536279B (en) * 2017-03-06 2021-08-03 北京可见文化传播有限公司 Method and system for interaction in virtual reality environment

Similar Documents

Publication Publication Date Title
CN204679953U (en) A kind of wear-type 3D audio and video player based on aspect sensor
CN104219584B (en) Panoramic video exchange method and system based on augmented reality
US9451242B2 (en) Apparatus for adjusting displayed picture, display apparatus and display method
CN204465755U (en) Can reciprocal stereo mixed reality device and apply the virtual implementing helmet of this device
CN105933726A (en) Virtual reality terminal and video resolution adaptation method and device thereof
US9854229B2 (en) Three-dimensional image processing apparatus and method for adjusting location of sweet spot for displaying multi-view image
CN101998029A (en) Image processing device and image processing method
CN110471249B (en) In-situ holographic display system
CN104661012A (en) Individual holographic three-dimensional display method and equipment
KR20110091443A (en) Image display device, image display viewing system and image display method
CN204496107U (en) A kind of wear-type image scaled correction display device
JP6384940B2 (en) 3D image display method and head mounted device
CN104506836A (en) Personal holographic three-dimensional display method and device based on eyeball tracking
CN105578044A (en) Panoramic view adaptive teacher image analysis method
KR20130040771A (en) Three-dimensional video processing apparatus, method therefor, and program
CN101984651A (en) Image stabilization system, display device and method for stabilizing images
CN103905806B (en) The system and method that 3D shootings are realized using single camera
CN105472358A (en) Intelligent terminal about video image processing
CN108989784A (en) Image display method, device, equipment and the storage medium of virtual reality device
CN111147883A (en) Live broadcast method and device, head-mounted display equipment and readable storage medium
CN201928352U (en) Image stabilization system and display device
CN207397518U (en) Wireless mobile objects projection system
CN103248910A (en) Three-dimensional imaging system and image reproducing method thereof
CN204832689U (en) Adjustable virtual reality glasses of interpupillary distance
CN109696959B (en) Picture display method, equipment and storage medium

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150930

Termination date: 20171114

CF01 Termination of patent right due to non-payment of annual fee