JP2013210643A - Display device and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device performing display just before user's eyes, where a display device for performing the display of an information image in a part of a screen is assumed to realize improvement in visibility of the information image displayed by the device and improvement in user's usability.SOLUTION: Display of various kinds of an information image is performed in an image display region as a part of a display screen. The display such as, for example, the image based on a picked-up image, the image based on received data, and the image based on reproduced data, is performed in a partial region of the display screen. Visibility of the display image is improved by controlling transmittance of an image display region to transmittance different from transmittance other than the image display region. Also, the transmittance of the image display region is automatically set or variably adjusted according to external light or a processing program (application to be started) or is set or variably adjusted according to user's behavior or conditions.

Description

  The present invention relates to a display device and a display method for displaying an image in front of a user's eyes in a state of being worn by a user using, for example, a spectacle-type or head-mounted type mounting unit.

JP-A-4-26289 JP-A-8-126031 JP-A-9-27970 Japanese Patent Laid-Open No. 9-185009

  For example, as in each of the above patent documents, various devices have been proposed in which a display unit is arranged in front of the user's eyes and displayed by a spectacle-type or head-mounted mounting unit.

When the display is performed immediately before the user's eyes in the wearing state as described above, it is preferable that the display screen is in a transparent or translucent through state so that the user can see the external scene.
In addition, as an image to be displayed on the screen, it may be assumed that the image is not necessarily displayed on the entire screen. For example, a display mode in which some information image is displayed on a part of the display screen in the through state is also conceivable.
Therefore, in the present invention, a display device that displays information immediately before the eyes of the user is assumed to be a display device that displays an information image on a part of the screen, and the visibility of the displayed information image is improved and the user's usability is displayed. It aims at realizing improvement.

The display device of the present invention displays an image on a display screen arranged so as to be positioned in front of the eyes of the user, and can change the transmittance of the display screen by a liquid crystal shutter having a variable transmittance. When the image display is executed on the display means and the display means, a partial area of the display screen is set as an image display area, and the area other than the image display area is controlled to be transparent or translucent. Control means for controlling the transmittance to a transmittance different from the area other than the image display area and executing image display in the image display area, and user information detection for detecting user information as a user's behavior or situation and means, and said control means controls the activation of an application program by the user information detected by the user information detection means, the Apu to start According to the application program to control the position and size of the image display area.

In addition, the control means performs control to execute the image display based on the application program in the image display area by controlling the transmittance according to the application program that activates the image display area.
Further, the control means controls the image display area to a non-transparent transmittance so that image display is executed in the image display area.
Further, the apparatus further includes an external light detection unit that detects an external light level, and the control unit controls the image display area to a transmittance calculated according to the external light level detected by the external light detection unit.
Further, the control means controls the image display area to a transmittance according to the application program to be started, and causes the image display based on the application program to be executed in the image display area.
The user information detection means captures a user's behavior and analyzes the captured image to detect user information.
The user information detection means detects user information by an acceleration sensor, an angular velocity sensor, a vibration sensor, a pressure sensor, or a biological sensor.

Further, the image pickup device further includes image pickup means for picking up an image, and the control means displays an image based on the image picked up by the image pickup means in the image display area of the display means. The imaging means is configured using a CCD sensor or a CMOS sensor as an imaging element.
Further, the information processing apparatus further includes storage means, and the control means displays an image based on the information read from the storage means in the image display area of the display means.
The information processing apparatus further includes reproducing means for reproducing information from the recording medium, and the control means displays an image based on the information read from the recording medium by the reproducing means in the image display area of the display means.
In addition, it further includes communication means for performing data communication with an external device, and the control means displays an image based on information received by the communication means in the image display area of the display means.
Further, it further comprises position detection means for detecting current position information, and the control means displays an image based on the current position information detected by the position detection means, such as a map image, in the image display area of the display means. .

The display method of the present invention displays an image on a display screen arranged so as to be positioned in front of the eyes of the user, and can change the transmittance of the display screen by a liquid crystal shutter having a variable transmittance. As a display method of a display device comprising means, a partial area of the display screen is set as an image display area, and the other areas than the image display area are controlled to be transparent or translucent, and the transmittance of the image display area is set. A step of making the transmittance different from that other than the image display area, a step of executing image display in the image display area, and a user information detection step of detecting user information as a user's behavior or situation, controls the activation of an application program by the user information detected by the user information detection step, start to the Apurikeshonpu Corresponding to grams, the position of the image display region, by controlling the size and permeability, to execute an image display based on the application program in the image display area.

In the above-described present invention, in the display device that displays an image on the display screen arranged so as to be positioned in front of the eyes of the user (user), various information images are displayed in the image display area as a part of the display screen. Is displayed. For example, an image based on a captured image, an image based on received data, an image based on reproduced data, and the like are displayed in a partial area of the display screen.
The image displayed by the display means in the present invention is not only a so-called “image” in a narrow sense such as a moving image or a still image, but also any display content displayed by the display means including a text image, an icon image, and the like. As an “image” in a broad sense.
When an image is displayed in an image display area that is a part of the screen, the display image may be difficult to see due to the contents viewed by the user outside the surrounding image display area. Therefore, the visibility of the display image is improved by controlling the transmittance of the image display region to a transmittance different from that other than the image display region.
The transmittance of the image display area is automatically set or variably adjusted according to external light or a processing program (started application), or is set or variably adjusted according to the user's behavior or situation.

According to the present invention, when an image is displayed in an image display area that is a part of the screen, the visibility of the display image is controlled by controlling the transmittance of the image display area to a different transmittance from that other than the image display area. Can be improved. For example, when the area other than the image display area is in the through state and the user can visually recognize the view scene, if the image display area is also in the through state, the visibility of the display image decreases, but the image display area has a different transmittance. By doing so, a display image with good visibility can be provided.
Further, the transmittance of the image display area is automatically set or variably adjusted according to external light or a processing program (started application), so that there is no burden on the user. Further, the transmittance desired by the user can be easily realized by setting or variably adjusting according to the user's behavior and situation.
Accordingly, it is possible to provide a display device with excellent visibility and usability.

It is explanatory drawing of the example of an external appearance of the display apparatus of embodiment of this invention. It is explanatory drawing of the usage condition of the display apparatus of embodiment. It is a block diagram of a display device of an embodiment. It is a block diagram of the display part of embodiment. It is explanatory drawing of an example of the user's behavior recognized by embodiment. It is explanatory drawing of the example of a display of embodiment. It is explanatory drawing of the example of a display of embodiment. It is explanatory drawing of the example of a display of embodiment. It is explanatory drawing of the example of a display of embodiment. It is a flowchart of the example of a process of the display apparatus of embodiment.

Embodiments of the display device and display method of the present invention will be described below. The description will be given in the following order.
[1. Example of appearance of display device]
[2. Example of configuration of display device]
[3. Display example]
[4. Example of control processing for display]
[5. Effect of embodiment, modification and extension example]

[1. Example of appearance of display device]

As an embodiment, FIG. 1 shows an example of the appearance of a display device 1 that is a glasses-type display. The display device 1 has a mounting unit having a frame structure that, for example, makes a half turn from the heads of both sides to the back of the head, and is worn by the user by being put on both ear shells as shown in FIG.
In the mounted state, the display device 1 is provided with a pair of display panels 2a and 2a for the left eye and the right eye immediately before the user's eyes, that is, at a position where a lens in normal glasses is located. It is configured. For example, a liquid crystal panel is used for the display panel unit 2a. By controlling the transmittance, a through state as shown in the figure, that is, a transparent or translucent state can be obtained. Since the display panel unit 2a is in the through state, even if the user always wears it like glasses, there is no problem in normal life.

  In addition, the imaging lens 3a is arranged in the forward direction of the user when the user is wearing it. In other words, in this case, the imaging lens 3a is configured to take an image in which the direction that the user visually recognizes through the display panel unit 2a when the display panel unit 2a is in the through state is the subject direction.

Note that FIG. 1 is an example, and various structures for the user to wear the display device 1 can be considered. In general, the display unit 2a and 2a may be provided close to the front of the user's eyes.
Although an example having a spectacle-type or head-mounted type mounting unit as the display device 1 is shown, any mounting unit such as a headphone type, a neckband type, an ear-hook type, etc. may be used by the user. May be. Further, for example, a configuration may be adopted in which the user attaches to normal glasses, a visor, headphones, or the like with an attachment such as a clip.
In addition to the configuration in which a pair of display units are provided corresponding to both eyes as the display panel unit 2a, a configuration in which one display panel unit 2a is provided corresponding to one eye is also possible.
In addition, a configuration in which an earphone speaker that is inserted into one or both of the user's right ear hole and left ear hole in a worn state or a microphone that collects external sound can be considered.
In addition, a light emitting unit formed by, for example, an LED (Light Emitting Diode) or the like may be provided so as to illuminate the imaging direction by the imaging lens 3a.

In FIG. 1, the imaging lens 3 a is attached so that the front of the user is the subject direction, but the direction in which the user visually recognizes the display unit 2 through the display unit 2 when the imaging unit 3 is in the through state. It may be attached so as to pick up an image in a direction different from the direction of the subject. For example, the imaging lens 3a may be attached so that the rear, upper, left side, right side, foot, etc. of the user are the subject direction.
In the example of FIG. 1, the imaging lens 3a is fixedly attached so that the subject direction during imaging is fixed. However, the imaging lens 3a is attached via a movable mechanism that can change the subject direction. Thus, the subject direction at the time of imaging may be changed manually or automatically.
A plurality of imaging lenses 3a may be attached and a plurality of imaging function units may be provided.
Furthermore, the structure which does not provide the imaging part mentioned later containing the imaging lens 3a is also considered.

For example, in such a display device 1, normally, the entire screen of the display panel unit 2 a is in a through state (the transmittance is set to 100% or a value close to 100%) so that the user can visually recognize the front. .
Based on some information, the image of the display panel unit 2a is displayed. In this case, an image is displayed using a part of the screen of the display panel unit 2a as an image display area. Various images are assumed to be displayed, such as still images, moving images, text images, images such as tables and graphs, character images, and icon images.
The region where the image is displayed has a transmittance different from that of the other region, that is, the region in the through state.

FIG. 2 illustrates a usage pattern of the display device 1 in relation to an external device.
FIG. 2A shows a case where the display device 1 is used alone. In this case, the display device 1 has an imaging function, so that a display image signal generated using the captured image signal as a source is displayed. It can be displayed on the panel unit 2a.
Alternatively, display based on internally generated data or display based on data stored in the internal memory can be performed.
In addition, if a reproduction drive function for a portable recording medium is provided, display based on data read from the portable recording medium can be performed.

FIG. 2B is an example in which the display device 1 has a communication function and communicates with an external data transmission device 70. In this case, the display device 1 can perform display based on data transmitted from the external data transmission device 70.
The data transmission device 70 can be a variety of devices such as a data server having a communication function, a personal computer, a video player, a video camera, and a digital still camera.
The external data transmission device 70 is a device owned by the user who uses the display device 1 or a device such as a public or service company that provides data and can communicate with the display device 1. Think variously.

FIG. 2C is an example in which the display device 1 has a communication function, particularly a communication access function via the network 73 such as the Internet, so as to communicate with an external data transmission device 70 connected via the network 73. . In this case, the display device 1 can perform display based on data received via the network 73.

[2. Example of configuration of display device]

A configuration example of the display device 1 will be described with reference to FIG.
The system controller 10 includes, for example, a microcomputer including a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), a nonvolatile memory unit, and an interface unit, and controls the entire display device 1. The control unit The system controller 10 performs various arithmetic processes and exchanges control signals with each unit via the bus 13 based on a program held in an internal ROM or the like, and causes each unit to execute a required operation.

The imaging unit 3 includes an imaging optical system, an imaging element unit, and an imaging signal processing unit.
In the imaging optical system in the imaging unit 3, the imaging system 3a shown in FIG. 1, a lens system including an aperture, a zoom lens, a focus lens, and the like, and a focusing operation and a zooming operation are performed on the lens system. Drive system and the like.
In addition, the imaging device section in the imaging section 3 is provided with a solid-state imaging device array that detects imaging light obtained by the imaging optical system and generates an imaging signal by performing photoelectric conversion. The solid-state imaging device array is, for example, a CCD (Charge Coupled Device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array.
The imaging signal processing unit in the imaging unit 3 includes a sample hold / AGC (Automatic Gain Control) circuit that performs gain adjustment and waveform shaping on a signal obtained by the solid-state imaging device, and a video A / D converter, and serves as digital data. Captured image data is obtained. Also, white balance processing, luminance processing, color signal processing, blur correction processing, and the like are performed on the captured image data.

Imaging is performed by the imaging unit 3 including these imaging optical system, imaging element unit, and imaging signal processing unit, and image data obtained by imaging is obtained.
Image data obtained by the imaging operation of the imaging unit 3 is processed by the imaging control unit 6.
The imaging control unit 6 performs processing for converting the captured image data into a predetermined image data format and required signal processing for display on the display unit 2 under the control of the system controller 10. Signal processing for monitor display on the display unit 2 includes, for example, brightness level adjustment, color correction, contrast adjustment, sharpness (outline emphasis) adjustment, screen division processing, character image composition processing, enlarged or reduced image generation, mosaic Image effect processing such as image / intensity inverted image / soft focus / highlight display of a part of the image / variation of color atmosphere of the entire image.
Further, the imaging control unit 6 controls on / off of the imaging operation in the imaging unit 3 based on an instruction from the system controller 10, zoom lens of the imaging optical system, drive control of the focus lens, sensitivity and frame rate control of the imaging element unit, Settings of parameters and execution processes for each process of the imaging signal processing unit are performed.
Further, the imaging control unit 6 supplies the captured image data to the memory unit 12 for recording or the display control unit 7 for display on the display unit 2 based on an instruction from the system controller 10. When the captured image data is supplied to the memory unit 12, the imaging control unit 6 performs an encoding process for recording the image data.

  Further, the imaging control unit 6 can perform analysis processing of the captured image data, and can perform determination of the captured object, determination of the behavior and shape of the object, and the like. Then, the analysis result information is supplied to the system controller 10.

A display unit 2 and a display control unit 7 are provided as a configuration for displaying to the user in the display device 1.
As shown in FIG. 4, the display unit 2 includes a display panel unit 2 a having a screen 21, a liquid crystal shutter 22, and an external light detector 23, a pixel driving unit 24, and a shutter driving unit 25.
In the display panel unit 2a, the liquid crystal shutter 22 and the screen 21 are formed to overlap each other, and the screen is formed by, for example, a normal liquid crystal display panel to form a display screen.
The liquid crystal shutter 22 is provided to change the transmittance of the display screen. As the types of liquid crystal used in the liquid crystal shutter 22, there are a liquid crystal shutter liquid crystal such as STN liquid crystal and TFT liquid crystal that can be switched between transmission and light shielding states and a liquid crystal shutter such as a polymer network liquid crystal that can switch between transmission and diffusion states.
When the liquid crystal shutter 22 is in the transmissive state, the display panel unit 2a is in the through state, that is, the user can see an external scene through the display panel unit 2a.
By displaying an image on the screen 21, the user can view the display image on the display panel unit 2a.
Here, when the transmittance of the liquid crystal shutter 22 is changed, the contrast ratio between the image of the outside world transmitted through the liquid crystal shutter 22 and the image displayed on the screen 21 can be changed.

The pixel driving unit 24 causes the screen 21 to execute display based on the supplied display image signal. That is, for each pixel arranged in a matrix on the screen 21, a drive signal based on the video signal is applied at a predetermined horizontal / vertical drive timing, and display is executed.
The shutter drive unit 25 applies a transmittance control signal to each liquid crystal pixel arranged in a matrix in the liquid crystal shutter 22 and drives the liquid crystal shutter 22 so as to have a predetermined transmittance, for example, in units of pixels.

The display control unit 7 causes the display unit 2 to execute a display operation and a transmittance change based on the control of the system controller 10.
That is, various processing for display is performed based on display data transferred under the control of the system controller 10 and an image signal to be displayed, and the display image signal is supplied to the pixel driver 24.
As processing for display, for example, brightness level adjustment, color correction, contrast adjustment, sharpness (outline emphasis) adjustment, and the like can be performed. Also, generation of an enlarged image obtained by enlarging a part of the image data, generation of a reduced image, soft focus, mosaic, luminance inversion, highlight display (highlight display) of a part of the image, change in atmosphere of the whole color, etc. Image effect processing, separation and synthesis of images for divided display of captured images, generation of character images and image images, processing of combining the generated images with captured images, and the like can also be performed.

  The display control unit 7 displays the display image signal generated by performing various processes on a part of the screen as the display panel unit 2a. A part of the display screen is set as an image display area in accordance with an instruction from the system controller 10, and display using a display image signal is executed in a pixel set as the image display area.

Further, the display control unit 7 controls the shutter driving unit 25 in accordance with an instruction from the system controller 10 to vary the transmittance of the liquid crystal shutter 22.
For example, control is performed so that the entire surface of the liquid crystal shutter 22 is in a through state or the front surface is in a non-transmissive state. Furthermore, control is performed to partially change the transmittance on the screen. In particular, only the image display area where the image is displayed is controlled to have a different transmittance from the other areas. For example, the screen is basically set to a through state, and only the image display area is controlled to be in a non-transparent state.

As described above, the external light detector 23 is provided in the display unit 2. The external light detector 23 can be composed of a light detection element such as a photodiode or a phototransistor.
The ambient light level is detected by the ambient light detector 23. For example, an electrical signal corresponding to the amount of external light is generated, and the display control unit 7 converts the electrical signal into level information and supplies it to the system controller 10.

The communication unit 15 transmits / receives data to / from an external device. As the external device, various devices as the data transmission device 70 described in FIG. 2 can be considered.
The communication unit 15 may be configured to perform network communication via short-range wireless communication with a network access point using a method such as wireless LAN or Bluetooth, or directly with an external device having a corresponding communication function. Wireless communication may be performed.

The position detector 14 is, for example, a GPS receiver. The GPS receiver receives radio waves from a GPS (Global Positioning System) satellite, and outputs latitude / longitude information as the current position to the system controller 10.
The position detection unit 14 may use a location information service provided by WiFi (Wireless Fidelity) or a mobile phone company, or may be used in combination with GPS. It is also conceivable to determine the user's walking speed based on information from the sensor unit 11 described later and to correct the detection position.

The memory unit 12 is used for storing various data. For example, it is used for storing captured image data and data received by the communication unit 15. It is also used to store various application programs.
The memory unit 12 may be configured by a solid-state memory such as a RAM or a flash memory, or may be configured by, for example, an HDD (Hard Disk Drive).
Further, instead of a built-in recording medium, a portable recording medium, for example, a recording / reproducing drive corresponding to a recording medium such as a memory card incorporating a solid-state memory, an optical disk, a magneto-optical disk, or a hologram memory may be used.

The memory unit 12 records image data obtained by imaging and received data by communication based on the control of the system controller 10. Further, based on the control of the system controller 10, the recorded data is read and supplied to the system controller 10, the display control unit 7, and the like.
Moreover, although the example which displays a map image on the display part 2 is mentioned later, you may make it memorize | store a map database in the memory part 12 for a map image display.

The display device 1 detects user information as a user's behavior or situation, and processes the user information as a user operation input. That is, display operation and transmittance control are performed according to the user's behavior and situation.
A sensor unit 11 is provided as means for detecting the user's behavior and situation. The above-described imaging unit 3 and imaging control unit 6 are also used as means for detecting the user's behavior.

First, the sensor unit 11 will be described.
When the sensor unit 11 is configured to detect a user's behavior, an acceleration sensor, an angular velocity sensor, a vibration sensor, a pressure sensor, or the like may be provided as the sensor unit 11.
For example, when the user taps the display device 1 from the side, it is detected by an acceleration sensor, a vibration sensor, or the like. For example, when the lateral acceleration exceeds a certain value, the system controller 10 operates the user (for example, It can be recognized as a variable transmittance operation).
Also, if it is possible to detect whether the user has struck the side part (the part corresponding to the vine of the glasses) from the right side or the side part from the left side by an acceleration sensor or angular velocity sensor, they can be used as predetermined operations. It can also be determined.
Further, it is possible to detect that the user turns his head or shakes his / her head with an acceleration sensor or an angular velocity sensor, and the system controller 10 can recognize this as a user operation.
In addition, pressure sensors are arranged on the left and right side portions (portions corresponding to spectacles) of the display device 1, and when the user presses the right side with a finger, the operation increases the transmittance. When pressed with, the transmittance can be lowered.
In addition, it is possible to determine whether the user is stationary, walking, running, or the like using an acceleration sensor or a vibration sensor, and changing the transmittance according to each determination result.

In addition, the sensor unit 11 may be provided with a configuration as a biometric sensor so that the biometric information of the user is detected and recognized as an operation input.
Biometric information includes pulse rate, heart rate, electrocardiogram information, electromyography, respiratory information (eg, respiratory rate, depth, ventilation), sweating, GSR (skin electrical response), blood pressure, blood oxygen saturation level Skin surface temperature, brain waves (for example, information on α wave, β wave, θ wave, and δ wave), blood flow change, eye condition, and the like.
The system controller 10 may recognize the detection information of the biosensor as a user operation input. For example, the user's conscious behavior may be an eye movement (change in line-of-sight direction or blinking), but if it is detected that the user has blinked three times, it is determined as a specific operation input. Furthermore, it is possible to detect that the user has attached or removed the display device 1 or that a specific user has attached by detecting the biometric information, and the system controller 10 can turn on / off the power in response to the detection. You may make it perform off.
Further, by detecting the above-described biometric information with a biometric sensor, it is possible to determine, for example, the user's physical condition, such as the user's tension state, excitement state, calm state, dying state, comfortable state, and unpleasant state. A processing example in which the transmittance is changed in accordance with such determination is also conceivable.
For example, the transmittance can be adjusted so that the user is comfortable.
Further, it is possible to determine the glare or the like that the user feels by detecting the degree of opening of the user's pupil, and perform transmittance control accordingly.

The biosensor may be arranged inside the wearing frame of the glasses-type display device 1, for example, so as to be able to detect the various types of information by contacting the user's temporal region or occipital region. It may be attached to a predetermined part of the body as a separate body from the one mounting frame portion.
In order to detect the state of the eye, the state of movement, the pupil, and the like, it is conceivable to use a camera that images the user's eyes.

The user's behavior can also be detected by the imaging unit 3 and the imaging control unit 6.
For example, the user puts his hand in front of his / her eyes so that the image is picked up by the imaging unit 3. Then, as shown in FIGS. 5A, 5B, 5C, and 5D, predetermined operation inputs are performed according to the shape of the hand.
Such a hand shape can be determined by the imaging control unit 6 analyzing the captured image, and information on the determined hand shape is supplied to the system controller 10. The system controller 10 recognizes each hand shape as predetermined operation information.
For example, the hand information shown in FIGS. 5A, 5B, 5C, and 5D is operated information as image display start, image display area transmittance increase, image display area transmittance decrease, image display end, and the like. It is possible to recognize that.
Alternatively, the number of fingers is made to correspond to the transmittance percentage. In the case of FIG. 5A, the transmittance is 0%, the transmittance of one finger is 20%, and the fingers are two as shown in FIGS. 5B and 5C. Interpretation of operation input as 40% transmittance, 60% transmittance with 3 fingers, 80% transmittance with 4 fingers, 100% transmittance with 5 fingers as shown in FIG. 5D. Also good.
Of course, these are only examples, and various types of operation information corresponding to the shape of the hand can be considered.

In addition, as a structure for acquiring user information as a user's behavior and situation, other sensors such as a sensor for detecting the voice of the user and a sensor for detecting the movement of the lips may be provided.
Further, an operator such as a key or a dial may be provided.

The configuration of the display device 1 has been described above, but this is only an example. Addition and deletion of various components are naturally conceivable depending on the actual operation example and function.

[3. Display example]

Display examples on the display device 1 of this example are shown in FIGS.
In this example, various types of image display are performed on the display unit 2. For example, display of an image by a processing operation by an application program, display of an image based on data received by the communication unit 15, display based on an image captured by the imaging unit 3, display based on data read from the memory unit 12, When the memory unit 12 is a recording / reproducing drive for a portable recording medium, display based on data reproduced from the portable recording medium is performed.

First, FIG. 6 shows an example of displaying a map image.
For example, it is assumed that an application program having a map display function is stored in the memory unit 12 and is activated in the system controller 10 to display a map. As an example, this map display program is a program that displays a map of the surroundings according to the current location or provides route guidance on a map.

For example, the display panel unit 2a is normally in a through state where the entire surface is 100% transmittance, for example, that is, the display unit 2 is a simple transparent plate-like body. For example, as shown in FIG. The sight can be seen.
Here, when the map display program is activated in the CPU of the system controller 10, the system controller 10 performs map display by setting a partial area on the screen as an image display area.
For example, the system controller 10 acquires map image data according to the current position detected by the position detection unit 14. In this case, if a map database is stored in the memory unit 12, map image data corresponding to the current position information can be searched and acquired.
If the map database is not stored, for example, the current position information is transmitted from the communication unit 15 to the data transmitting device 70 such as an external server, and the map image data corresponding to the current position information is transmitted to the external data. A process of receiving from the device 70 is also conceivable.

The system controller 10 displays a map image corresponding to the current position in a partial area on the display screen. For example, the screen is divided into areas AR1 and AR2 as shown in FIGS. Is displayed.
Here, FIG. 6B shows a case where the area AR2 is in the same transmittance state as the area AR1 in the through state (that is, the through state), while FIG. 6C shows that the area AR2 is in the through state. This shows a case where the state is a state of transmittance different from that of the region AR1 (that is, a non-transmissive state or a state of low transmittance).
In the example of FIG. 6B, since the entire surface remains in the through state, the map image displayed in the area AR2 is difficult to see.
On the other hand, by changing the transmittance of only the area AR2 as shown in FIG. 6C, the map image can be easily displayed and presented to the user.

In addition, although the example of a display by a map display program was shown here, the application program accompanying a display operation in this way can be considered variously.
For example, display images by various application programs such as browser software such as an Internet web browser, image management / display program for photographic images, graphic creation / editing software, document creation software, spreadsheet software, and the like are assumed.
Of course, various kinds of image contents to be displayed are considered, such as moving images, still images, texts, charts, and download images.
Depending on the operation of the application program, the information to be displayed is an image of a character, chart, or design created by the program operation, an image downloaded by the communication unit 15 by the operation of the browser software, or the like. There are various types such as an image based on the data read from the unit 12 and the read image itself.

FIG. 7 shows an example of displaying information transmitted from the external data transmission device 70.
FIG. 7A shows a case where the entire surface of the display panel unit 2a is in a through state. For example, a scene when the user is at the exhibition hall of the winning cup is shown.
A data transmission device 70 for transmitting information related to the exhibit, various advertisement information, guidance information, and the like is installed in the vicinity, and transmits various information to the display device 1 worn by the user. Suppose that
In the display device 1, for example, in response to receiving information from the data transmission device 70, a text image based on the received information is displayed in a partial area AR2 of the screen.
FIG. 7B shows a case where the area AR2 is in the same transmittance state as the area AR1 in the through state (that is, the through state), while FIG. 7C shows that the area AR2 is in the through state. A case is shown in which the transmittance is different from a certain area AR1 (that is, a non-transmissive state or a low transmittance state).
In the example of FIG. 7B, since the entire surface remains in the through state, the text image displayed in the area AR2 is difficult to see.
On the other hand, by changing the transmittance of only the area AR2 as shown in FIG. 7C, the text image can be easily displayed and presented to the user.
Here, an example in which a text image is displayed has been described. However, as the information transmitted from the external data transmission device 70, a still image, a moving image, or the like can be considered.

8 and 9 show an example in which display based on an image captured by the imaging unit 3 is performed.
FIG. 8A shows a through state.
FIGS. 8B and 8C illustrate an example in which a part of an image captured by the imaging unit 3 is enlarged and displayed in the area AR2. FIG. 8B shows a case where the area AR2 is in the same through state as the area AR1, and FIG. 8C shows a case where the area AR2 is different from the area AR1 in a non-transmissive state or a low transmittance state. Show. Similar to the above examples, the visibility of the display content can be improved by changing the transmittance of the area AR2 as shown in FIG. 8C.
9A shows an entire through state, and FIGS. 9B and 9C show an example in which an image obtained by telephoto imaging in the imaging unit 3 is displayed in the area AR2. FIG. 8B shows a case where the area AR2 is in the same through state as the area AR1, and FIG. 9C shows a case where the area AR2 is different from the area AR1 in a non-transmissive state or a low transmittance state. Show. Similar to the above examples, by changing the transmittance of the area AR2 as shown in FIG. 9C, the visibility of the display content of the captured image can be enhanced.

Various display contents as an image captured by the imaging unit 3 are considered as follows.
An image normally captured by the imaging unit 3 A telephoto zoom image obtained by the zoom operation of the imaging unit 3 A wide-angle zoom image obtained by the zoom operation of the imaging unit 3 A distant view image obtained by the focus control operation of the imaging unit 3 High-speed captured image obtained by changing the imaging frame rate in the foreground image / imaging unit 3 obtained by the focus control operation of the imaging unit 3 or the enlargement in the signal processing of the low-speed captured image / imaging control unit 6 or the display control unit 7 In the image / imaging unit 3 in which the image / imaging unit 3 that has been subjected to the processing or reduction processing is increased in imaging sensitivity and the brightness is increased, and in which the imaging sensitivity in the imaging unit 3 is decreased and the brightness is suppressed. Image / imaging control unit 6 obtained by cutting the specific wavelength band in the image / image capturing unit 3 obtained by increasing the ultraviolet imaging sensitivity in the night image / imaging unit 3 Brightness is increased by signal processing of the display controller 7 The brightness of the image / imaging control unit 6 or the display control unit 7 is increased and the brightness is reduced by the signal processing of the image / imaging control unit 6 or the display control unit 7. As the signal processing of the image / imaging control unit 6 or display control unit 7 in which the contrast, sharpness, etc. are adjusted by the signal processing of the image / imaging control unit 6 or display control unit 7 in which the atmosphere is changed, mosaic / brightness inversion / software Image obtained by performing image effect processing such as focus / highlight display of part of image / highlight display, etc./image obtained by combination of the above operations or signal processing

Of course, the present invention is not limited to those listed, and various images for display obtained by the operation of the imaging unit 3 and the signal processing of the imaging control unit 6 or the display control unit 7 can be considered.

[4. Example of control processing for display]

As described above as the display example, in this example, an image is displayed in the partial area AR2 on the display screen. At this time, the area AR2 has a transmittance different from that of the surrounding area AR1. , Improve visibility. In addition, a more suitable display is realized by adjusting the transmittance according to the user's behavior and situation.
A processing example of the system controller 10 for this operation is shown in FIG.

Step F101 indicates a control process in which the system controller 10 causes the display control unit 7 to put the entire surface of the display panel unit 2a into a through state with a transmittance of 100%. For example, at the initial stage when the display device 1 is turned on, the system controller 10 controls the entire screen of the display panel unit 2a to the through state in step F101.
During a period in which the entire screen of the display panel unit 2a is in the through state, the system controller 10 checks whether or not a display start trigger has occurred in step F102.

There are various display triggers.
For example, when a certain application program is started according to the user's behavior and situation and a display corresponding to the operation of the application program is executed, the system controller 10 may determine that a display trigger has occurred.
When the communication unit 15 receives information for display from an external device, the system controller 10 may determine that a display trigger has occurred.
The system controller 10 can also determine that a display trigger has occurred when it is recognized that a user operation has been performed by detecting the user's behavior or situation.
In addition, when an imaging operation in the imaging unit 3 is started in accordance with an operation based on a user's behavior or the like, it may be determined that a display trigger for the imaging monitor is started.

If it is determined that there has been a display start trigger, the system controller 10 advances the processing to step F103, and first sets an image display area on the display screen. That is, the position and size on the screen as the area AR2 are set.
The position and size of the image display area may be fixed, or may be variable according to user settings.
Alternatively, it may be determined according to the contents of the display trigger. For example, there may be an example in which the lower right corner of the screen is activated when a certain application program is activated, the upper left corner of the screen is activated when another certain application program is activated, and the lower left corner of the screen is displayed as an imaging monitor.

In addition, the transmittance of the image display area (area AR2) is set. Various types of transmittance setting processing are considered as follows.
First, an example in which the transmittance is set fixedly can be considered. For example, the transmittance is always 0%.
Or you may make it determine the transmittance | permeability of an image display area according to the transmittance | permeability other than the image display area at that time (namely, area | region AR1). For example, a predetermined coefficient calculation is performed on the transmittance of the area AR1 to calculate the transmittance of the area AR2 where a sufficient contrast ratio is obtained.

Further, since the external light amount can be detected by the external light detector 23, the transmittance of the image display area may be calculated according to the external light amount. For example, the transmittance of the image display area is calculated by performing a coefficient calculation on the value of the amount of external light.
When an application program is activated, an example in which the transmittance is set depending on the type or type of the application program is conceivable. For example, the transparency of the image display area is set to 0% when a certain application program is activated, and the transparency of the image display area is set to 20% when another certain application program is activated.
First, an example in which the transmittance is set according to the contents of the display trigger can be considered. For example, different transmittances are set depending on whether the application program is activated or data is received from the external data transmission device 70.
Furthermore, it is conceivable to set the transmittance according to the operation content as the user's behavior. For example, this is a case where the user instructs the transmittance by the shape of the hand described in FIG. 5 or allows the transmittance to be instructed by a behavior that can be detected by the sensor unit 11.

Subsequently, the system controller 10 proceeds to step F104, and controls the transmittance of the set image display area to the set transmittance. That is, the display control unit 7 is instructed about the image display area and the transmittance, and the liquid crystal shutter 22 is driven so that the transmittance of the area AR2 that is the image display area is different from that of the other area AR1.
In step F105, the display panel unit 2a displays an image. That is, the display control unit 7 controls to execute a predetermined image display in the image display area on the screen 21 of the display panel unit 2a based on the supplied display data.

  After the image display is started, that is, during a period in which a part is the through area AR1 and a part is the image display area AR2 on the screen of the display panel unit 2a, the system controller 10 transmits in step F106. It is monitored whether or not a rate change trigger has occurred, and whether or not a display end trigger has occurred in step F107.

In step F106, an example is considered in which the system controller 10 determines whether a display switching trigger has occurred based on the detection of the user's behavior or situation. For example, when the user consciously changes the transmittance according to the user's operation input in the form of a hand as described in FIG. 5 or the user's behavior detected by the sensor unit 11, the transmittance is changed. A trigger may be generated.
Alternatively, if it is determined from the biometric information detected by the biosensor in the sensor unit 11 that the user is in an uncomfortable situation (a situation where it is difficult to see the image), a transmittance change trigger may be generated.
Furthermore, the external light amount detected by the external light detector 23 may be monitored, and when a change in the external light amount is detected, a transmittance change trigger may be generated.

If it is determined that the transmittance change trigger has occurred, the system controller 10 proceeds to step F108 and calculates the transmittance to be changed.
For example, when a transmittance change trigger is generated by a user's conscious behavior, the transmittance indicated by the behavior (that is, operation) is set as a new transmittance.
When a transmittance change trigger is generated due to a change in the amount of external light, coefficient calculation is performed on the value of the amount of external light to calculate a new transmittance that can maintain visibility.
When a transmittance change trigger is generated as a detection of the user's situation (for example, an unpleasant situation), a new transmittance is calculated in the direction of improving visibility.
When the new transmittance is calculated, the system controller 10 returns to step F104, performs control to change the transmittance of the image display area to the new transmittance, and proceeds to steps F105, F106, and F107.

As for the display end trigger in step F105, for example, when the user performs an operation to end the display by a predetermined behavior, the system controller 10 may determine that a trigger to end the display state is generated. Alternatively, the system controller 10 can determine that a display end trigger has occurred according to a predetermined condition.
If it is determined that a display end trigger has occurred, the system controller 10 advances the process from step F107 to F109, performs display end control, and ends the image display in the image display area on the display unit 2. Then, the process returns to step F101 to instruct the entire surface of the display panel unit 2a to be in a through state with a transmittance of 100%.

During a period in which the user wears the display device 1 and is turned on, the system controller 10 performs control processing as shown in FIG. 10, for example.
However, various modification examples can be considered as specific processing examples.
For example, at the time of step F103, the transmittance of the area AR2 as the image display area may not be changed, that is, the area AR1 may be the same. In that case, for example, the display states as shown in FIG. 6B, FIG. 7B, FIG. 8B, and FIG. 9B are obtained, but thereafter calculated in step F108 according to the transmittance change trigger. You may make it change to the transmittance | permeability which is.

[5. Effect of embodiment, modification and extension example]

According to the above embodiment, when image display is performed on the image display area AR2 which is a part of the screen of the display panel unit 2a, the transmittance of the image display area AR2 is different from that of the area AR1 other than the image display area. By controlling the transmittance, the visibility of the display image can be improved. For example, when the area AR1 is in the through state and the user can visually recognize the view scene, if the image display area is also in the through state, the visibility of the display image is reduced, but the image display area AR2 has a different transmittance. By doing so, a display image with good visibility can be provided.
Further, the transmittance of the image display area is automatically set or variably adjusted according to the amount of external light and the processing program (started application), so that there is no burden on the user. In addition, it is possible to set an appropriate transmittance according to the display content.
Further, the transmittance desired by the user can be easily realized by setting or variably adjusting according to the user's behavior and situation. Accordingly, a display device having excellent visibility and good usability can be realized.

  In general, the entire surface of the display panel unit 2a is set to the through state so that the normal life can be prevented even when the display panel portion 2a is in the mounted state. Also, when performing image display, the area AR1 is in the through state, and the user can visually recognize the outside world. For this reason, the advantage of the display apparatus 1 of this example can be enjoyed effectively in a user's normal life.

  Note that the present invention is not limited to the above-described embodiment, and various modification examples and extension examples are conceivable as configuration examples and processing examples of the display device 1.

  In the above example, the image display area AR2 is controlled to have a transmittance different from that of the area AR1, but in addition to such transmittance control, the brightness and color of the display image may be adjusted. For example, in displaying a text image, visibility can be further improved by selecting and displaying a color or luminance that contradicts the surrounding image, for example.

Various positions on the screen of the display panel unit 2a to display the area AR2 as the image display area can be considered. In the example of FIGS. 6 to 9, the case where the area AR2 is set like the child screen in the area AR1 is shown. However, the area AR1 is divided and set at the lower end, the upper end, etc. on the screen. Also good. The area AR2 may be larger than the area AR1. The display position and size of the area AR2 on the screen may be selected by the user, or may be arbitrarily changed during display execution.
Further, when there is a large amount of data to be displayed, it may be possible to display all data in the area AR2 by scroll display or page feed display.

The full screen at the time when image display is not performed and the area AR1 during image display are not necessarily in the through state with 100% transmittance. For example, the transmittance may be about 50%. That is, the transmittance may be lowered within a range where the user can visually recognize the outside world. It is also preferable to adjust these transmittances according to the amount of external light detected by the external light detector 23.
Even when the transmittance of the area AR1 is lowered in this way, the visibility of the display image can be improved by setting the area AR2 to a very low transmittance (for example, a transmittance of about 0%).
Further, the image display area may be expanded and the transmittance may be changed to the periphery of the image display area so that, for example, the periphery of the image display area is recognized by the user as a black image.

  DESCRIPTION OF SYMBOLS 1 Display apparatus, 2 Display part, 2a Display panel part, 3 Imaging part, 6 Imaging control part, 7 Display control part, 10 System controller, 11 Sensor part, 12 Memory part, 14 Position detection part, 15 Communication part

Claims (13)

Display means capable of displaying an image on a display screen arranged so as to be positioned in front of the user's eyes and changing the transmittance of the display screen by a liquid crystal shutter having a variable transmittance;
When image display is executed in the display means, a part of the display screen is set as an image display area, and the area other than the image display area is controlled to be transparent or translucent, and the transmittance of the image display area is set. Control means for controlling the transmittance to be different from that other than the image display area, and causing the image display area to perform image display;
User information detecting means for detecting user information as a user's behavior or situation;
With
The control means controls the activation of the application program by the user information detected by the user information detection means, and controls the position, size, and transmittance of the image display area according to the application program to be activated. Then, a display device that executes image display based on the application program in the image display area.   The display device according to claim 1, wherein the control unit controls the image display area to a non-transparent transmittance so as to perform image display in the image display area. It further comprises external light detection means for detecting the external light level,
The display device according to claim 1, wherein the control unit controls the image display region to a transmittance calculated according to an external light level detected by the external light detection unit.   The display device according to claim 1, wherein the user information detection unit captures a user's behavior and analyzes the captured image to detect user information.   The display device according to claim 1, wherein the user information detection unit detects user information by an acceleration sensor, an angular velocity sensor, a vibration sensor, a pressure sensor, or a biological sensor. It further comprises imaging means for taking an image by starting the application program,
The display device according to claim 1, wherein the control unit displays an image based on an image captured by the imaging unit in the image display area of the display unit.   The display device according to claim 6, wherein the imaging unit is configured using a CCD sensor or a CMOS sensor as an imaging element. A storage means,
The display device according to claim 1, wherein the control unit displays an image based on information read from the storage unit when the application program is activated in the image display area of the display unit. It further comprises reproducing means for reproducing information from the recording medium,
The display device according to claim 1, wherein the control unit displays an image based on information read from the recording medium by the reproducing unit by starting the application program in the image display area of the display unit. It further comprises a communication means for performing data communication with an external device,
The display device according to claim 1, wherein the control unit displays an image based on information received by the communication unit in the image display area of the display unit. It further comprises position detecting means for detecting current position information,
The display device according to claim 1, wherein the control unit displays an image based on the current position information detected by the position detection unit when the application program is activated in the image display area of the display unit.   The display device according to claim 11, wherein the image based on the current position information is a map image. A display device comprising a display means for displaying an image on a display screen arranged so as to be positioned in front of a user's eyes and capable of changing the transmittance of the display screen by a liquid crystal shutter having a variable transmittance. As a display method,
A partial area of the display screen is set as an image display area, and the area other than the image display area is controlled to be transparent or translucent, and the transmittance of the image display area is set to be different from that other than the image display area. Steps,
Executing image display in the image display area;
A user information detection step for detecting user information as a user's behavior or situation; and
With
Control the start of the application program by the user information detected in the user information detection step, and control the position, size and transmittance of the image display area according to the application program to be started, the image A display method for executing image display based on the application program in a display area.

Images