CN103731659B - head-mounted display apparatus - Google Patents
head-mounted display apparatus Download PDFInfo
- Publication number
- CN103731659B CN103731659B CN201410008313.1A CN201410008313A CN103731659B CN 103731659 B CN103731659 B CN 103731659B CN 201410008313 A CN201410008313 A CN 201410008313A CN 103731659 B CN103731659 B CN 103731659B
- Authority
- CN
- China
- Prior art keywords
- head
- mounted display
- display apparatus
- image information
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Controls And Circuits For Display Device (AREA)
Abstract
The invention provides a kind of head-mounted display apparatus, described head-mounted display apparatus comprises: display screen; Multiple camera, is arranged in the different azimuth of head-mounted display apparatus, and the zones of different of head-mounted display device carries out taking to obtain image information; Controller, receives image information from described multiple camera, by image information display on the display screen, and determines whether to User Alarms according to the image information from camera.
Description
Technical field
The invention belongs to automatic alarm field, relate to a kind of head-mounted display apparatus.
Background technology
Head-mounted display apparatus (HeadMountedDisplay, HMD) refers to the display device that can be worn on the head.HMD generally uses " nearly optics of the eye system " comes at multimedia messagess such as the upper display graphics pictures of display screen (such as eyeglass) apart from several centimetres, eyeball.According to the quantity of display screen, HMD can be subdivided into " single eyeglass HMD " and " two lens HMD ".Some HMD only show " computer generated image " (CGI), and the HMD of some kinds then can show the CGI of superposition in the mode at " real world visual angle ".The latter is generally also called " reality of enhancing ", because the image information for real world of user is attached image on the display device to " strengthening ".Specifically, be exactly that user both can by the external world around transparent eyeglass viewing oneself, also some multimedia messagess can be shown by control system on eyeglass, such as word (name of the mansion seen in front, the position in the restaurant nearest apart from oneself and its instant messages such as specialty, menu).
HMD is that have many practicality with recreational application.Such as, AEROSPACE APPLICATION permission pilot not under the prerequisite that flight path is removed, checks vital flight control information in eye.The face that public safety applications can comprise tracking display cartographic information and suspect identifies match information etc. automatically.Other applications also can comprise video-game, tele-medicine, Long-distance Control etc.Because this technology is also in commitment, along with the development of this technology, more practicality and recreational application appearance will be had.But these apply the efficiency etc. being limited in cost, size, viewing area and being used for the conventional optical device realizing current HMD at present.Further, some other technical problem not yet thoroughly solved progressively will be captured along with the fast development of HMD and be realized its extensive use commercially.
But, when the wearer of head-mounted display apparatus in daily walking, drive, etc. in moving process, viewing is from the multimedia messages on head-mounted display apparatus, and when watching external world information on one side, wholeheartedly dual-purpose, has very large danger.In addition, such as, for law enfrocement official, its expectation can utilize head-mounted display apparatus to flutter the suspect caught in enforcing law in real time, retains video evidence, and expands the visual visual field, strengthen its eyesight.
Therefore, need a kind of head-mounted display apparatus with auto-alarm function to meet the demand of user.
Summary of the invention
For the problems referred to above, the present invention proposes a kind of head-mounted display apparatus, carrys out the power supply that automatic control head wears formula display device, thus save the mutual cost of user by eye tracking technology.
According to an aspect of the present invention, a kind of head-mounted display apparatus comprises: display screen; Multiple camera, is arranged in the different azimuth of head-mounted display apparatus, and the zones of different of head-mounted display device carries out taking to obtain image information; Controller, receives image information from described multiple camera, by image information display on the display screen, and determines whether to User Alarms according to the image information from camera.
Head-mounted display apparatus also can comprise microphone, and controller is sounded to user to sound warning message by being controlled microphone.
Head-mounted display apparatus also can comprise LED, and controller sends light by control LED and sends light warning information to user.
Described multiple camera can comprise: the first camera, is arranged on the front side of head-mounted display apparatus, and the front area of head-mounted display device is taken, and the image information of shooting is sent to controller; Second camera, is arranged on the rear side of head-mounted display apparatus, and the posterior region of head-mounted display device is taken, and the image information of shooting is sent to controller; 3rd camera, is arranged on the left side of head-mounted display apparatus, and the left field of head-mounted display device is taken, and the image information of shooting is sent to controller; 4th camera, is arranged on the right side of head-mounted display apparatus, and the right side area of head-mounted display device is taken, and the image information of shooting is sent to controller.
Described multiple camera also can comprise: the 5th camera, is arranged on the upside of head-mounted display apparatus, and the upper area of head-mounted display device is taken, and the image information of shooting is sent to controller.
When the object of the side being positioned at the user wearing head-mounted display apparatus moves to user, if according to the image information from corresponding camera, controller determines that the speed of described object is greater than predetermined threshold speed, then controller control loudspeaker and/or LED can send warning message to user.
Head-mounted display apparatus also can comprise: wireless communication unit, communicates with remote server.
Human face image information from a camera in described multiple camera can be compared with the human face image information received from remote server by wireless communication unit by controller; If from the matching degree between the human face image information of the camera of in multiple camera and the human face image information received from remote server by wireless communication unit higher than predetermined matching degree threshold value, then controller control loudspeaker and/or LED can send warning message to user.
Human face image information from multiple camera is sent to remote server, to perform face images match in remote server by wireless communication unit by controller.
Image information from the camera of in multiple camera is sent to the wireless communication unit of other head-mounted display apparatus by controller by wireless communication unit, or via remote server, the image information from the camera of in multiple camera is sent to the wireless communication unit of other head-mounted display apparatus by wireless communication unit, shares to realize human face image information.
Head-mounted display apparatus of the present invention can the image information in each orientation of supervisory user in real time, realizes auto-alarm function, to protect the personal safety of user; Also can real time record danger signal, dangerous person image information etc., save evidence, for user provides convenience.
Accompanying drawing explanation
In conjunction with the drawings, from the description of the following examples, the present invention these and/or other side and advantage will become clear, and are easier to understand, wherein:
Fig. 1 is the forward direction visual angle schematic diagram of the head-mounted display apparatus illustrated according to the embodiment of the present invention;
Fig. 2 is the schematic diagram being positioned at the angular field of view of the camera in four orientation of the head-mounted display apparatus illustrated according to the embodiment of the present invention;
Fig. 3 is the schematic diagram of the two display screens of the head-mounted display apparatus illustrated according to the embodiment of the present invention;
Fig. 4 is the schematic diagram of single display screen of the head-mounted display apparatus illustrated according to the embodiment of the present invention;
Fig. 5 is the schematic diagram of the warning example of the camera of the head-mounted display apparatus illustrated according to the embodiment of the present invention;
Fig. 6 is the schematic diagram of the recognition of face of the head-mounted display apparatus illustrated according to the embodiment of the present invention;
Fig. 7 is the schematic diagram that head-mounted display apparatus is according to another embodiment of the present invention shown;
Fig. 8 is the control block diagram of the automatic alarm of the head-mounted display apparatus illustrated according to the embodiment of the present invention;
Fig. 9 is the flow chart of the automatic alarm of the head-mounted display apparatus illustrated according to the embodiment of the present invention.
Embodiment
Embodiments of the invention are described in detail referring to accompanying drawing.According to the quantity of the display screen of HMD, HMD can be subdivided into single eyeglass HMD and two lens HMD.The present invention can be applicable to single eyeglass HMD and two lens HMD simultaneously.
Fig. 1 is the forward direction visual angle schematic diagram of the head-mounted display apparatus illustrated according to the embodiment of the present invention.
Label 1 in Fig. 1 represents the framework of head-mounted display apparatus.Framework 1 can be made up of certain material (light material such as such as carbon fiber).With reference to Fig. 1, head-mounted display apparatus can comprise display screen 2, multiple camera 3, microphone 4, loud speaker 5 and LED 6.Above-mentioned parts can be arranged in the framework 1 of head-mounted display apparatus.In addition, in the framework 1 of head-mounted display apparatus, also controller and wireless communication unit can be set.Wireless communication unit can communicate with remote server.In addition, wireless communication unit can communicate with the wireless communication unit of another head-mounted display apparatus.
Display screen 2 can be equipped with touch control inerface or microphone coordinates sound recognition module etc. to accept the control informations such as the touch of user and sound, realizes mutual.
Display screen 2 can be a display screen or two display screens (that is, left display screen 21 and right display screen 22), corresponds respectively to single eyeglass HMD and two lens HMD.
Multiple camera 3 can be arranged in the different azimuth of head-mounted display apparatus.Multiple camera 3 can comprise the first camera 31, second camera 32, the 3rd camera 33 and the 4th camera 34.
First (front side) camera 31 is arranged on the front side of head-mounted display apparatus, and the front area of head-mounted display device is taken, and the image information of shooting is sent to controller.
Second (rear side) camera 32 is arranged on the rear side of head-mounted display apparatus, and the posterior region of head-mounted display device is taken, and the image information of shooting is sent to controller.
3rd (left side) camera 33 is arranged on the left side of head-mounted display apparatus, and the left field of head-mounted display device is taken, and the image information of shooting is sent to controller.
4th (right side) camera 34 is arranged on the right side of head-mounted display apparatus, and the right side area of head-mounted display device is taken, and the image information of shooting is sent to controller.
Controller can by the image information display that receives on display screen 2.Controller can determine whether to User Alarms according to the image information from camera.
Microphone 4 receives acoustic information, such as, from phonetic order that is outside or user.
Loud speaker 5 sends acoustic information to user, such as warning message.Such as, controller sends audible alarm information according to the image information control loudspeaker 5 received to user.
LED 6 sends light information to user.Such as, controller controls LED 6 according to the image information received and sends light warning information (such as light flash information) to user.
Fig. 2 is the schematic diagram being positioned at the angular field of view of the camera in four orientation of the head-mounted display apparatus illustrated according to the embodiment of the present invention.By the first camera 31 to the cooperation of the 4th camera 34, the picket surveillance of 360 degree to user's surrounding environment can be realized.
Fig. 3 is the schematic diagram (user perspective direction) of the two display screens of the head-mounted display apparatus illustrated according to the embodiment of the present invention.Controller can be presented on left display screen 21 side by side by from the image information of the first camera 31 to two cameras in the 4th camera 34, and can be presented at from the image information of the first camera 31 to all the other two cameras in the 4th camera 34 side by side on right display screen 21.
Fig. 4 is the schematic diagram of single display screen of the head-mounted display apparatus illustrated according to the embodiment of the present invention.Controller can by be presented at side by side from the first camera 31 to the image information of the 4th camera 34 in left display screen 21 and right display screen 22 one.
Fig. 5 is the schematic diagram of the warning example of the camera of the head-mounted display apparatus illustrated according to the embodiment of the present invention.
Such as, when the object (such as the vehicles) of side of the user wearing head-mounted display apparatus moves to user, if according to the image information from corresponding camera, controller determines that the speed of described object is greater than predetermined threshold speed and there is the danger of collision, then controller performs at least one in following operation: control loudspeaker 5 sends audible alarm information to user; Control LED 6 and send light warning information to user.
Fig. 6 is the schematic diagram of the recognition of face of the head-mounted display apparatus illustrated according to the embodiment of the present invention.With reference to Fig. 6, controller can by from multiple camera 3 human face image information be presented at display screen 2 by wireless communication unit from the human face image information that remote server receives and compare.Such as, in figure 6, on the left of display screen, show the human face image information from multiple camera 3, on the left of display screen, show the human face image information received from remote server.If from the matching degree between the human face image information of in multiple camera 3 and the human face image information received from remote server by wireless communication unit higher than predetermined matching degree threshold value, then controller control loudspeaker 5 and/or LED 6 send warning message to user.Human face image information from multiple camera 3 is also sent to remote server by wireless communication unit by controller, to perform face images match in remote server.
Such as, by application the present invention, for wearing head-mounted display apparatus law enfrocement official, the facial image of the human face image information of suspect with oneself surrounding captured in real time can be compared, if matching degree is higher than threshold value, then controller trigger alarm, and on display screen 2, show the result figure of coupling.Like this, law enfrocement official is facilitated to follow the trail of suspect in real time.Further, multiple head-mounted display apparatus can collaborative work, like this, in the process that multidigit law enfrocement official enforces the law in zones of different, by the information (short distance situation) around the direct real-time sharing of wireless communication unit oneself of head-mounted display apparatus, or by the wireless communication unit of head-mounted display apparatus via the information (long distance situation) around remote server Real-Time Sharing oneself, and alarm signal is passed in real time other multidigit law enfrocement official; Also by wireless communication unit, the facial image captured is sent to remote server, to perform face images match in remote server.Short haul connection (near-field communication) can adopt the modes such as Bluetooth communication, infrared communication, Wi-Fi communication.
In addition, the geographical location information relative to oneself of other members of same team can be shown on a head-mounted display apparatus; If target is locked by a head-mounted display apparatus, then the information of this target can be passed to other members immediately automatically, thus realizes cooperative cooperating more quickly and easily, such as, several law enfrocement official, when tracking suspect, realizes real-time cooperative cooperating.
Fig. 7 is the schematic diagram that head-mounted display apparatus is according to another embodiment of the present invention shown.With reference to Fig. 7, multiple camera 3 also can comprise the 5th (upside) camera 35.5th camera 35 is arranged on the upside of head-mounted display apparatus, takes with the upper area of head-mounted display device, and the image information of shooting is sent to controller.
Fig. 8 is the control block diagram of the automatic alarm of the head-mounted display apparatus illustrated according to the embodiment of the present invention.Fig. 9 is the flow chart of the automatic alarm of the head-mounted display apparatus illustrated according to the embodiment of the present invention.
With reference to Fig. 9, in step 901, each camera catches the image information in respective orientation, and is sent to controller.
In step 902, controller determines whether to send warning message to user according to the image information from camera.
In step 903, controller control loudspeaker 5 and/or LED 6 send warning message to user.
By adopting head-mounted display apparatus of the present invention, can the image information in each orientation of supervisory user in real time, realize auto-alarm function, to protect the personal safety of user; Also can real time record danger signal, dangerous person image information etc., save evidence, for user provides convenience.
Although the present invention is described in detail with reference to its exemplary embodiment and shows, but will be understood by those skilled in the art that, when not departing from the spirit and scope of the present invention be defined by the claims, the various changes of form and details can be carried out to it.
Claims (8)
1. a head-mounted display apparatus, comprising:
Display screen;
Multiple camera, is arranged in the different azimuth of head-mounted display apparatus, and the zones of different of head-mounted display device carries out taking to obtain image information;
Wireless communication unit, communicates with the wireless communication unit of other head-mounted display apparatus or remote server;
Controller, image information is received from described multiple camera, by image information display on the display screen, and determine whether to User Alarms according to the image information from camera, when determining to User Alarms, the wireless communication unit of other head-mounted display apparatus will be sent in real time from the image information of the camera of in multiple camera and alarm signal by wireless communication unit, or the wireless communication unit of other head-mounted display apparatus will be sent in real time from the image information of the camera of in multiple camera and alarm signal by wireless communication unit via remote server, share and cooperative cooperating to realize image information.
2. head-mounted display apparatus according to claim 1, head-mounted display apparatus also comprises loud speaker, and controller is sounded to user by control loudspeaker and to be sounded warning message.
3. head-mounted display apparatus according to claim 2, head-mounted display apparatus also comprises LED, and controller sends light by control LED and sends light warning information to user.
4. head-mounted display apparatus according to claim 1, wherein, described multiple camera comprises:
First camera, is arranged on the front side of head-mounted display apparatus, and the front area of head-mounted display device is taken, and the image information of shooting is sent to controller;
Second camera, is arranged on the rear side of head-mounted display apparatus, and the posterior region of head-mounted display device is taken, and the image information of shooting is sent to controller;
3rd camera, is arranged on the left side of head-mounted display apparatus, and the left field of head-mounted display device is taken, and the image information of shooting is sent to controller;
4th camera, is arranged on the right side of head-mounted display apparatus, and the right side area of head-mounted display device is taken, and the image information of shooting is sent to controller.
5. head-mounted display apparatus according to claim 4, wherein, described multiple camera also comprises: the 5th camera, is arranged on the upside of head-mounted display apparatus, the upper area of head-mounted display device is taken, and the image information of shooting is sent to controller.
6. head-mounted display apparatus according to claim 3, wherein, when the object of the side being positioned at the user wearing head-mounted display apparatus moves to user, if according to the image information from corresponding camera, controller determines that the speed of described object is greater than predetermined threshold speed, then controller control loudspeaker and/or LED send warning message to user.
7. head-mounted display apparatus according to claim 3, wherein, the human face image information from a camera in described multiple camera is compared with the human face image information received from remote server by wireless communication unit by controller,
If from the matching degree between the human face image information of the camera of in multiple camera and the human face image information received from remote server by wireless communication unit higher than predetermined matching degree threshold value, then controller control loudspeaker and/or LED send warning message to user.
8. head-mounted display apparatus according to claim 7, wherein, the human face image information from multiple camera is sent to remote server, to perform face images match in remote server by wireless communication unit by controller.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410008313.1A CN103731659B (en) | 2014-01-08 | 2014-01-08 | head-mounted display apparatus |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410008313.1A CN103731659B (en) | 2014-01-08 | 2014-01-08 | head-mounted display apparatus |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103731659A CN103731659A (en) | 2014-04-16 |
CN103731659B true CN103731659B (en) | 2016-03-30 |
Family
ID=50455563
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410008313.1A Active CN103731659B (en) | 2014-01-08 | 2014-01-08 | head-mounted display apparatus |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103731659B (en) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103941870B (en) * | 2014-04-21 | 2017-01-11 | 百度在线网络技术(北京)有限公司 | Head-mounted display device |
US9773350B1 (en) | 2014-09-16 | 2017-09-26 | SilVR Thread, Inc. | Systems and methods for greater than 360 degree capture for virtual reality |
CN105007424A (en) * | 2015-07-22 | 2015-10-28 | 深圳市万姓宗祠网络科技股份有限公司 | Automatic focusing system, method and wearable device based on eye tracking |
CN106254852A (en) * | 2015-11-10 | 2016-12-21 | 深圳市拓丰源电子科技有限公司 | Image capture method, image-capturing apparatus and virtual reality strengthen system |
US9979930B2 (en) | 2015-12-03 | 2018-05-22 | Beijing Pico Technology Co., Ltd. | Head-wearable apparatus, 3D video call system and method for implementing 3D video call |
CN106896917B (en) * | 2017-02-21 | 2021-03-30 | 北京小米移动软件有限公司 | Method and device for assisting user in experiencing virtual reality and electronic equipment |
CN107395981A (en) * | 2017-08-18 | 2017-11-24 | 太仓宏璟瑞远物业管理有限公司 | A kind of multimedia system played of photographing |
CN108040247A (en) * | 2017-12-29 | 2018-05-15 | 湖南航天捷诚电子装备有限责任公司 | A kind of wear-type augmented reality display device and method |
CN110197569B (en) * | 2018-11-19 | 2021-06-25 | 广东小天才科技有限公司 | Safety monitoring method based on wearable device and wearable device |
CN111491128B (en) * | 2019-01-25 | 2021-11-30 | 上海奥畅智能科技有限公司 | Security joint control system |
JP2021077262A (en) * | 2019-11-13 | 2021-05-20 | セイコーエプソン株式会社 | Head-mounted type display device, switching method for input system, and switching program for the same |
CN111175972A (en) * | 2019-12-31 | 2020-05-19 | Oppo广东移动通信有限公司 | Head-mounted display, scene display method thereof and storage medium |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102682733A (en) * | 2011-03-07 | 2012-09-19 | 微软公司 | Augmented view of advertisements via head-mounted display |
CN103480154A (en) * | 2012-06-12 | 2014-01-01 | 索尼电脑娱乐公司 | Obstacle avoidance apparatus and obstacle avoidance method |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101632033B (en) * | 2007-01-12 | 2013-07-31 | 寇平公司 | Helmet type monocular display device |
JP2013164737A (en) * | 2012-02-10 | 2013-08-22 | Nec Corp | Obstacle alarm display system, information processor, obstacle alarm display method, and obstacle alarm display program |
CN103455746B (en) * | 2013-09-10 | 2016-10-05 | 百度在线网络技术(北京)有限公司 | head-mounted display apparatus |
-
2014
- 2014-01-08 CN CN201410008313.1A patent/CN103731659B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102682733A (en) * | 2011-03-07 | 2012-09-19 | 微软公司 | Augmented view of advertisements via head-mounted display |
CN103480154A (en) * | 2012-06-12 | 2014-01-01 | 索尼电脑娱乐公司 | Obstacle avoidance apparatus and obstacle avoidance method |
Also Published As
Publication number | Publication date |
---|---|
CN103731659A (en) | 2014-04-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103731659B (en) | head-mounted display apparatus | |
US10564919B2 (en) | Display system, display apparatus, method for controlling display apparatus, and program | |
US10613330B2 (en) | Information processing device, notification state control method, and program | |
US9881422B2 (en) | Virtual reality system and method for controlling operation modes of virtual reality system | |
US11589022B2 (en) | Scope of coverage indication in immersive displays | |
US9542958B2 (en) | Display device, head-mount type display device, method of controlling display device, and method of controlling head-mount type display device | |
CN102999160B (en) | The disappearance of the real-world object that user controls in mixed reality display | |
US20160054565A1 (en) | Information processing device, presentation state control method, and program | |
US20150355463A1 (en) | Image display apparatus, image display method, and image display system | |
US11314323B2 (en) | Position tracking system for head-mounted displays that includes sensor integrated circuits | |
CN105453011A (en) | Virtual object orientation and visualization | |
US20170123747A1 (en) | System and Method for Alerting VR Headset User to Real-World Objects | |
TWI614729B (en) | Warning system for virtual reality device and the warning method of the same | |
JP6492673B2 (en) | Head-mounted display device, method for controlling head-mounted display device, computer program | |
JP2018067773A (en) | Imaging device, control method thereof, program, and storage medium | |
US20200062181A1 (en) | Immersive display | |
KR20200061564A (en) | Comand and control system for supporting compound disasters accident | |
WO2017022769A1 (en) | Head-mounted display, display control method and program | |
JP2015087523A (en) | Head-mounted display device, method for controlling head-mounted display device, and image display system | |
CN110809148A (en) | Sea area search system and three-dimensional environment immersive experience VR intelligent glasses | |
JP2021009647A (en) | Virtual reality control apparatus, virtual reality head set, virtual reality control method, and program | |
WO2016012516A1 (en) | Head mounted display assembly comprising a sensor assembly having a rear view sensing area direction | |
US20180348519A1 (en) | Waterproofed wearable displaying device | |
US20230360264A1 (en) | Identifying a position of a controllable device using a wearable device | |
US20230308753A1 (en) | Camera system for focusing on and tracking objects |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
EE01 | Entry into force of recordation of patent licensing contract | ||
EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20140416 Assignee: Beijing Intellectual Property Management Co.,Ltd. Assignor: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. Contract record no.: X2023110000098 Denomination of invention: Headworn display device Granted publication date: 20160330 License type: Common License Record date: 20230822 |