JP3045321B2 - Handset type television device and videophone device using it - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a compact television apparatus having good operability and workability, and a video telephone apparatus using the television apparatus.

[0002]

2. Description of the Related Art First, a conventional television device will be described. As shown in FIG. 18, a conventional television apparatus includes an image display 1 for displaying a television image and a speaker for outputting sound.
F, the television signal communication control unit 3 is integrated with the viewer M, and the viewer M is positioned away from the image display 1 (usually,
The optimum position is a position separated by a distance of about 4 to 6 times the screen height of the display screen).
Such a conventional television device is installed in a collaborative working environment where a plurality of people coexist, such as an office, to obtain information for each individual.
When applied to applications such as information presentation, the following
There was a problem on the man interface.

[0003] Since the sound output from the speaker 2 is output in a radial manner, the sound of the television can be heard by people other than the viewer M, such as people in the office and others nearby, such as offices, and noise sources. Become annoying, noisy, anxious, etc. If you do not want to show, listen, or want to see or display the TV display information / sound information to others, use it alone or keep it confidential. Is not easy to shield from others.

On the other hand, the sound generated from the speaker 2
Conventionally, as a method of preventing others from hearing it, an earphone / headphone type television apparatus using an earphone or headphones as shown in FIG. 19 has been used. This is done by inserting a small sound output device 6 that is shielded so that no sound is leaked outside the ear, into the ear hole, hook it on the earlobe, or cover it over the ear while supporting it with the head. Device main body 4 including image display 1
The sound information is connected to the audio output device 6 by a wired cable 5 or a wireless device so that only the individual M can hear the sound information. With this method, the sound information of the television apparatus main body 4 can be shielded from others. However, the information is frequently changed in an office or the like, so that the television viewing work (information acquisition for each individual) and other work actions (other persons) can be performed. Conversation with
When the present invention is applied to a collaborative work environment in which it is necessary to quickly switch between (communication, etc.), there are the following problems.

[0005] Image information cannot be shielded from others. In addition, as a human interface for performing one operation of watching television, it is necessary to prepare two non-integrated devices, namely, the image display 1 and the sound output device (earphone, headphone) 6. In addition, there are problems in operability such as troublesome wiring of the wired cable 5, difficulty in placing the sound output device 6 when not in use, and the like. Further, an acoustic output device 6 such as an earphone or a headphone.
In the form of hooking on the ear or supporting with the head, installation and removal are complicated, and the wearing feeling is poor.

On the other hand, as a method for achieving both complete shielding of image information from the environment around the viewer M and powerful realism equivalent to large-screen display, a head-mounted television apparatus as shown in FIG. There is. This covers the small-sized image display 1 in front of both eyes of the viewer M while supporting it with the head, and further shields the small-sized image display 1 from being outside. In addition,
7 is a lens. This makes it impossible for the viewer M to see the external environment, and makes the viewer M feel as if he were in the world of image information. With this method, the image information of the television apparatus can be shielded from others, and people around the viewer M can completely understand what the viewer M is looking at. Has changed, and when applied to a collaborative work environment in which it is necessary to quickly switch between TV viewing work (information acquisition for each individual) and other work activities (conversation with other people, communication, etc.), the following problems arise. is there.

[0007] The form in which the image display 1 is supported by the head is cumbersome to attach and detach, and the wearing feeling is poor. In order to hear the sound information while shielding it, it is necessary to use it in combination with the earphone or the headphone shown in FIG. 19, and to attach two devices (head-up display and earphone) that are not integrated each time the user views. Doing so is extremely troublesome. Further, when the image display 1 is put in front of both eyes of the viewer M and the other external environment cannot be seen by blocking, the user takes notes while watching the television or compares it with other information (documents and the like). Etc. cannot be performed in parallel, and the work efficiency deteriorates. In addition, frequent switching between the artificial television image display state in which the external environment is completely invisible and the real environment state in which the image display 1 is removed causes a great psychological stress on the viewer M and a feeling of fatigue. growing.

Next, a conventional videophone device will be described with reference to FIG. In FIG. 21, 1 is an image display for displaying a television image, 8 is a handset for inputting and outputting sound, 9 is an image pickup device for inputting a television image, 10 is a videophone signal communication control unit, and NET is a communication network. . A user (hereinafter, referred to as a viewer) M performs voice conversation communication similar to that of a telephone using the handset 8 which inputs and outputs sounds. At the same time, the face of the viewer M is imaged using the imager 9, transmitted to the other party's videophone device via the videophone signal communication control unit 10, and displayed on the image display 1 of the other device. By mutually displaying the faces of both viewers M, mutual communication of actions such as facial expressions and gestures is realized as in actual face-to-face dialogue. Such a conventional video telephone device is installed in a collaborative working environment where a plurality of people coexist, such as an office, and is applied to a remote conference, a remote meeting, a remote collaborative work, a remote training, and the like. -There was a problem in the man interface.

[0009] If the person M or image information displayed on the image display 1 of the videophone device is not desired to be seen or viewed by others, it is used only by the individual viewer M, or is desired to be kept secret. It is not easy to shield the display information from others. Further, since the position of the image pickup device 9 and the position of the image display device 1 are physically different, even if the user looks at the other party, the eyes do not meet (the eyes cannot match).

[0010] In a normal face-to-face conversation, one person presents topic information (image information), and the other person also talks while watching the information. The person presenting the topic information proceeds while confirming that the other party has certainly not seen it. Alternatively, proceed while checking what part the other party has noticed and showed interest in. In other words, in an actual face-to-face conversation, the user proceeds while talking and grasping what the other party is looking at by looking ahead of the other party's eyes. Smooth dialogue and communication are performed by such mutual viewpoint detection. However, with a videophone device, it is impossible to see what is ahead of the other party's eyes. Even if various types of image information are presented to the other party, it is not clear whether the other party really saw it or not. For this reason, in the videophone device, the conversation is inevitably smoother than the actual face-to-face conversation.
Do not go to

Further, in an actual face-to-face conversation, a conference table or a desk is usually prepared, and topic information is spread to the table, and the user proceeds while talking and comparing various things. For this reason, a large space (table) for preparing topic information is prepared. However, in the conventional videophone device, the size of the image display 1 is the same as the size of the image display of a normal TV receiver, and only one is provided. It is not practical to prepare a larger image display 1 or a plurality of image displays 1 because the cost and size of the apparatus increase. For this reason, it is not possible for a single image display 1 to proceed with talking while comparing and comparing topic information.

[0012]

The conventional television device is
As described above, in both the earphone / headphone type television device and the head mounted type television device, the image display device 1 and the sound output device 6 are not integrated and must be mounted on the head. There was a drawback that the feeling of wearing was poor and the operability was poor.

Further, the conventional video telephone apparatus has disadvantages in that, in addition to the above-mentioned disadvantages of the conventional television apparatus, it is difficult to match the lines of sight of the viewers M, and it is not possible to follow the other party's line of sight to the topic image. was there.

The present invention has been made in order to solve the above-mentioned drawbacks, and it is possible to block viewing information for each individual, to easily switch between viewing and other work, and to view and perform other work. A handset-type television device that can perform parallel processing with actions, is compact and portable, has a high sense of realism, and realizes powerful realism equivalent to simultaneous use of multiple image displays and large-screen display. And a videophone device using the same.

[0015]

SUMMARY OF THE INVENTION A handset type television apparatus according to the present invention comprises: an image display for inputting and displaying television image information to one eye of a viewer; an acoustic output device, integrated in an arrangement condition to match the image display device and audio output device on the positional relationship between the left or right eye and ear of the viewer manner and fixedly holding constituting the handset Together with it
An upside-down inverting unit that inverts the display of image information,
Left and right discriminating means for judging the left and right of the mounting state of the unit is provided,
Further, a position / direction detecting means for detecting the position or direction of the handset, and a signal switching control unit for switching television information to be output to the image display and the audio output device according to the detected position or direction are provided.

Further, the handset type videophone apparatus according to the present invention has an image display for inputting / displaying television image information to one eye of a viewer, and an audio output for outputting television sound information to one ear of the viewer. The device, the image display device and the sound output device are integrally and fixedly held in an arrangement condition suitable for the positional relationship between one eye and one ear on either side of the viewer. A viewpoint camera for capturing a direction, and a transmitter for inputting a conversation, comprising the image display, the sound output device, the viewpoint camera and the transmitter, and the position of the handset. Or, a position / direction detecting means for detecting a direction, a signal switching control section for switching information to be output to an image display, an audio output device and information to be imaged / transmitted according to the position or direction detected by the position / direction detecting means. , Emotion The transmission, in which a communication control unit for receiving. And a face to capture the viewer's face image
And a handset for the position / direction detection means.
Detects that the camera is facing the face camera,
Display the image of the other party's face camera
It is configured to be displayed on a container.

[0017]

The handset-type television device according to the present invention provides a powerful realism equivalent to a large-screen display by mounting a small image display on the viewer so as to cover the vicinity of the eyes. As in the case of a telephone handset, the sound output device is mounted in the form of being pressed against the ear near the ear by a solid holding portion made of plastic or the like, thereby realizing a function of shielding sound information from others. By arranging the image display and the sound output device only on one eye and one ear on the right or left side, the other eye and one ear can be used simultaneously for tasks other than watching television. In addition, the above-described image display for one eye and the sound output device for one ear are integrally formed such that plastic or metal or the like is fixedly maintained in an arrangement condition adapted to the positional relationship between the human eye and the ear. With the handset fixed integrally using the coating, molding, mounting material, etc., it is not necessary to separately mount the image display and the sound output device, and both are integrated at an appropriate viewing position. It can be easily and quickly placed and mounted, and can be held with one hand. In addition, whether the handset is worn on the left eye / one ear or the right eye / one ear, the display image can be flipped upside down or flipped so that it can be used with the same device. A mechanical switch to a relationship is possible. In addition, by incorporating a function of detecting the position and direction of the handset in the device, the display image and output sound of the television are switched according to the detected position and direction, so that the viewer can watch the handset type television device. By simply changing the direction of the face or neck while holding the held device, the information content can be quickly and freely switched and selected with good operability. As a result, one c
Multiple images can be displayed by attaching
Device and multiple sound output devices
A powerful sense of presence can be realized.

Further, in addition to the above-described operation of the handset type television device, the handset type videophone device according to the present invention can be quickly and freely changed only by changing the direction of the face or neck while wearing the viewer's handset. The user can switch and select information contents with good operability, and can perceive a virtual face-to-face conversation space. This invention has left / right discriminating means.
Handset from one side of the observer's head to the other
When the position is changed to the side, the display image and viewpoint of the image display
Automatically change the upper and lower relationship of both images taken by the camera
It is also possible to send and receive
Can share points. In addition, by controlling the display of the handset, imaging from an external facial camera, and matching of the position and angle information of the handset, the eyes can be matched , and the communication partner can be determined .
And face-to-face matching. Further position / direction detection means
Conversation while switching between face image and shared information
be able to.

[0019]

1 (a) and 1 (b) are diagrams for explaining a first embodiment of the present invention, in which 11 is an image display, 12 is an audio output device, and 13 is a handset. It is a television device. 14 is a television signal receiving antenna, 15 is a television signal receiving cable, and 16 is a television signal communication control unit. FIG. 1A shows an example in which these components are separated into a handset 13 and a television signal communication control unit 16, and FIG. It is an example of an integrated form. In order to operate this, a television signal composed of audio information and image information is input to the television signal communication control unit 16 via the television signal receiving antenna 14 or the television signal receiving cable 15 and the television signal is transmitted to the image display 11.
And output to the acoustic output device 12.

Here, the configuration of the handset 13 is as follows.
The mounting form is as shown in the front view, plan view, and perspective view of (a), (b), and (c) of FIG.
The mounting is performed as shown in the perspective view and the plan view of FIG. That is, the image display 11 and the sound output device 1 of the handset 13
2 is arranged in a size and a mounting form so as to satisfy the positional relationship between the eye Ey and the ear Ea on one of the right side and the left side of the viewer M. It realizes a handset form that can be easily attached, held or removed. As a mounting structure of the handset 13, a solid material such as plastic or metal can be used.

FIGS. 4A and 4B show the handset 1 described above.
3A and 3B are a side view and a plan view showing a size / positional relationship in a state where the earphone 3 is mounted, and the sound output device 12 is mounted by pressing against the position of the ear Ea like a handset of a telephone. The image display 11 is arranged at a position separated by a distance d from the position of the eye Ey. If there is no optical system such as a lens between the image display 11 and the eye Ey, the viewing distance D and the distance d of the virtual image to be viewed
Is equal to The sound output device 12 is arranged at a position separated by a distance L from the position of the eye Ey of the viewer M. The distance L is adjusted to the standard actual size of the positions of the eyes Ey and the ears Ea of the actual viewer M. W is the distance between the eye Ey and the inner surface of the handset 13.

Here, the display direction vector V of the image display 11 (a vector extending from the center of the display surface of the image display 11 perpendicular to the display surface) and the output direction vector W of the sound output device 12 (the sound output device 12 Are placed on the same plane and satisfy the condition that they are orthogonal to each other, so that the handset 13 is attached to one eye / ear of the left side, and The dimensions can be the same as when mounted on In the case of an arrangement condition that does not satisfy this condition, the viewing feeling differs between when the handset 13 is mounted on the right side and when the handset 13 is mounted on the left side.

FIGS. 5 (a) and 5 (b) correspond to FIGS.
FIG. 4B is a side view and a plan view showing dimensions and a positional relationship when a handset 13 including another optical lens is mounted, and the acoustic output device 12 is mounted at a position of an ear Ea. The image display 11 is arranged at a position separated by a distance d from the position of the eye Ey. In this case, the optical lens 17 is disposed between the eye Ey and the image display 11, and the viewing distance D of the virtual image to be viewed is larger than the distance d. And reducing the distance d in order to achieve miniaturization of the handset 13, both training and ensuring only legible distance viewing distance D - becomes a offs, thus, the optical lens 17 and a reflecting mirror or the like By combining them, both can be compatible.

FIG. 6 shows an embodiment of the present invention in which a position sensor is incorporated inside the handset 13. Reference numeral 18 denotes a position sensor, 19 denotes a signal switch, and 20 denotes a signal switch control unit.
Others are the same as FIG. 1 (a). In order to operate this, a television signal composed of audio information and image information is input to the television signal communication control section 16 via the television signal receiving antenna 14 or the television signal receiving cable 15 and the signal is transmitted to the signal switch 19. To the image display 11 and the sound output device 12 via the. The location inside the handset 13
A position sensor 18 for constituting a direction detecting unit is disposed, and detects the direction (direction) and position of the handset 13. In accordance with the detected direction and position of the handset 13, the signal switching control unit 20 instructs the signal switch 19 to switch the television signal, and switches the signal to be output to the image display 11 and the sound output device 12. Here, as the position sensor 18, a magnetic sensor, an ultrasonic sensor, a radio wave sensor, or the like can be used. The position sensor 18 is incorporated in the handset 13 as shown in FIG.
A method of detecting the position of the handset 13 from the outside and disposed outside the can be easily realized by the combination of the sensor.

FIG. 7 is a diagram showing a method of detecting the position of the handset when an ultrasonic transmitter is incorporated in the handset 13 and an ultrasonic distance sensor is installed outside the handset 13, and reference numeral 21 denotes an ultrasonic transmitter. 22 and 23 are ultrasonic distance sensors installed outside the handset 13;
24 is a position calculation unit. To operate this, the ultrasonic transmitter 2 which is a sound source incorporated in the handset 13 is used.
1 are received by ultrasonic distance sensors (sound sensors) 22 and 23 installed outside the handset 13, and the distance d 1 between the ultrasonic distance sensors 22 and 23 and the ultrasonic transmitter 21 is received. , D2. The positional relationship between the ultrasonic distance sensors 22 and 23 is given in advance, and the distance between the two and the positional relationship (position [ X ₁ , Y
₁ ] and [ X ₂ , Y ₂ ] distance d0) are known,
The position calculator 24 can calculate the position [x, y] of the ultrasonic transmitter 21 (ie, the position of the handset 13) based on the principle of triangulation.

FIG. 8 shows an example in which two such ultrasonic transmitters 21 are incorporated in a handset and the direction is detected. 21A and 21B are ultrasonic transmitters installed outside the handset 13, and the other components are the same as those in FIG. Two ultrasonic transmitters 21A, 21 having different transmission frequencies incorporated in the handset 13 are provided by the ultrasonic distance sensors 22, 23 installed outside the handset 13.
The ultrasonic wave transmitted from B is received, and the distances d1, d2, d3, and d4 between the ultrasonic distance sensors 22, 23 and the ultrasonic transmitters 21A, 21B are detected. The positional relationship between the ultrasonic distance sensors 22 and 23 is given in advance, and the distance between the two and the positional relationship (position [ X ₁ ,
Y ₁ ], [ X ₂ , Y ₂ ], and distance d0) are known, and the ultrasonic transmitters 21A, 21A, 2
The positions A [x, y] and B [x ', y'] of 1B can be calculated by the position calculation unit 24. Further, by calculating the positions of the points A and B, the direction of the vector AB given by the two points A and B can be calculated. here,
By locating the points A and B such that the vector AB indicates the direction of the handset 13 (ie, the direction of the line of sight) as shown in FIG. 8, the direction and angle of the handset 13 (the direction and angle of the line of sight) can be detected. Can be.

FIGS. 9 and 10 are diagrams showing the operation when the display image and the output sound of the television device are switched using the position detection of the handset 13. FIG. The function of detecting the position and direction (angle) of the handset type television apparatus using the position / direction detection method as shown in FIGS. 7 and 8, the signal switch 19 and the signal switch shown in FIG. The function of switching the display image and output sound of the television device can be realized in accordance with the position and direction detected in combination with the control unit 20. FIG. 9 shows an example of display images A0, A1, and A2 in which the image displayed on the image display 11 is switched according to the position (x, y) of the handset 13 in the two-dimensional plane. FIG. 10 shows an example of display images A0, A1, and A2 in which the image displayed on the image display 11 is switched according to the direction (angle: θ) of the handset 13. Here, the sound information can be switched simultaneously with the switching of the image information, and the image and the sound being viewed can be switched in conjunction with each other.

Thus, the viewer M can quickly, freely, and easily switch information contents while viewing the handset-type television device by simply changing the direction of the face or neck while wearing the held device. You can choose. As a result, the viewer M was surrounded by the plurality of image displays 11 and the sound output devices 12 such as speakers by using only one image display device 11 and one sound output device 12. It is possible to realize the same effect as described above and a powerful sense of reality equivalent to a large screen display.

In the handset type television apparatus in which the image display 11 for one eye and the audio output device 12 for one ear are integrated, the case where the apparatus is mounted on the left eye and one ear and the case where the apparatus is mounted on the right one eye and one ear It is practically important to be able to use the same device in both cases where it is mounted on a vehicle. Human eyes and ears differ from person to person, and when using for a long time, the left and right are often used as needed. However, if the device set for the left one eye / one ear is directly attached to the right one eye / one ear (and vice versa), the displayed image is upside down. In the present invention, as a method of returning this upside down according to the positional relationship between eyes and ears, i) the image display 11 and the sound output device 1
2 and 3) a method of mechanically deforming the positional relationship with 2 and a method of ii) electronically inverting the displayed image upside down.

FIG. 11 shows an example of an embodiment in which the right side and the left side are mechanically deformed. The holding unit 25 of the sound output unit 12 is rotated by the rotation mechanism (centering on the image display 11). A structure in which the joint 26 is coupled to the holding portion 27 of the image display 11 is realized. The present invention
The display image is automatically transformed by the left / right discrimination means instead of
This is described next.

FIG. 12 shows a state in which the handset 13 is attached to the left eye / one ear and a right eye / one ear automatically. This is an example of a form in which the same device can be used for both left and right. 21A and 21B are ultrasonic transmitters, 22 and 23 are ultrasonic distance sensors, 16 is a television signal communication control unit, and 24 is a position calculation unit, and these constitute left and right discriminating means. Numeral 28 denotes a vertical turning part. In order for this to work, points A,
The ultrasonic waves (two different frequencies) transmitted from the two ultrasonic transmitters 21A and 21B built in B are transmitted to the ultrasonic distance sensors 22 and 23 disposed at upper and lower points C and D outside the handset 13. (At least two are arranged above and below) and the distance to points A and B is detected. The positions of the ultrasonic distance sensors 22 and 23 are given in advance,
The positional relationship between points A and B with respect to points C and D can be calculated based on the principle of triangulation. The points C of points A and B obtained in this way,
From the positional relationship with respect to D, the vertical relationship between two points A and B can be detected. In FIG. 12, if the point A is above the point B, it is determined to be mounted on the left side;

The above-described determination processing is performed by the position calculating unit 24, and based on the result, it is determined whether or not the display image is to be vertically inverted, and is executed by the vertically inverted unit 28.
It is displayed on the image display 11. As a method for detecting the mounting position of the handset 13, a magnetic sensor or the like can be easily detected in addition to the ultrasonic distance sensors 22 and 23 described above.

Next, an embodiment of the handset type videophone device according to the present invention will be described. FIG. 13 is a diagram showing a basic configuration of a handset-type videophone device according to the present invention. Reference numeral 31 denotes a handset in which an image and audio input / output device and the like are integrated. Is the same. Reference numeral 32 denotes a facial camera for imaging a face. This system has the following basic functions. Output system: An image display and a receiver are arranged so as to cover the monocular / monaural ear on either side. Holding system: A handset structure for integrally holding the output system with one hand. Input system: A viewpoint camera that captures the direction of the line of sight of the covered monocular and a transmitter are integrated into the handset 31. Position detection system: equipped with a position / angle sensor for detecting the position / direction of the handset 31 (the position / direction of the face). Face-to-face system: A face camera 32 for capturing a face image of one's own face is arranged at a position where a face-to-face partner is to be virtually displayed. Signal switching system: switching between a display image and a received sound in accordance with the position and direction of the handset 31 (creating a virtual space) The input / output / hold function is a handset having a size that can be held with one hand. It is integrated as 31 and is used by pressing it to one of the left and right monoculars / single ears. The left and right images are separate for the eyes (one for the display,
An external real image is input to one side, but only one image consciously focused and selected in the brain is perceived by the selective visual function of the human eye.

FIG. 14 is a diagram for explaining a method of creating a virtual space according to the present invention. P1 to P3 are topic images, P4 is an image viewed by the other party, P5 is a person image of the other party, and P6 is an image monitor of one's own. It is. In the present invention, the handset 31
A virtual face-to-face conversation space is created as follows by switching between the display image and the reception sound in accordance with the position and direction of.

As information sources to be switched, there are a video from a viewpoint camera (not shown), a video from the face camera 32, and an external video source (external camera, external stored image information, etc.). A virtual space is created by switching control, and the following dialogue support functions are realized. Eye-gaze matching function When the user faces the direction of the face camera 32 on his / her side, a signal captured by the face camera 32 on the partner side is displayed on the image display 11. As a result, if both look into the direction of the facial camera 32, both eyes can be matched, and a sense of facing each other in the virtual space can be realized. Viewpoint Sharing Function When the handset 13 is turned in a specific direction, the same information as that displayed on the image display 11 of the other party is displayed on the own image display 11. As a result, a function of sharing and seeing what the other party is looking at can be realized. You can also use this method when you want to show your partner what you see. Virtual table function By switching and displaying the information of the external video source according to the position and direction of the handset 31, it is possible to display a plurality of external video information (image display 11) on a blank desk.
(Virtual table) can be realized. Furthermore, by superimposing and synthesizing the image of the tip of the user's hand captured by the viewpoint camera, a virtual collaborative work space in which operations such as instructions from both sides can be created can be created.

FIG. 15 is a view for explaining an embodiment of the present invention, in which 11 is an image display such as a CRT, 12 is an acoustic output device (receiver) such as a speaker, 17 is an optical lens, and 33 is a viewpoint. A camera, 34 is a transmitter such as a microphone, 35 is a position / angle sensor, 36 is a handset type holding unit, 20 is a signal switching control unit, 32 is a face camera, 37 is a communication control unit, and NE is
T is a communication network, and 38 is an external video source such as image storage. This is done as follows.

Transmission of Information The viewer M according to the present invention is provided with an image display 11 and an audio output device 12.
The information is transmitted using the handset 31 integrated by the holding unit 36. That is, when the user wants to show something (article, document, etc.) on a desk or the like while holding the handset 31, the image is transmitted by the viewpoint camera 33 incorporated in the handset 31 and transmitted. In addition, one's face and appearance are taken by a face camera 3 installed on a desk or the like.
2 and is transmitted. The voice of the conversation is input and transmitted by a transmitter 34 such as a microphone incorporated in the handset 31. Information is also transmitted from an external video source 38 such as a video file as needed. The transmission information is sent by the communication control unit 37 to the other party via the communication network NET .

Reception of Information Voice information and image information sent from the other party via the communication network NET are received by the communication control unit 37, and the image information is displayed on the image display 11 incorporated in the handset 31. The viewing angle, the viewing distance, and the magnification are adjusted by the optical lens 17 and are visually recognized by the eyes. The audio signal is output to the audio output device 12 incorporated in the handset 31 and enters the ear.

Information Switching Control The position / angle of the handset 31 is detected by a position / angle sensor 35 that detects the position / angle of the handset 31 incorporated in the present system. Since the handset 31 is attached to the eyes and ears of the face, the position and angle of the handset 31 are equivalent to the position and angle of the face of the viewer M (face direction, gaze direction). The signal switching control unit 20 displays based on the detected position / angle information.
Switch the images. The switching control method is described in FIG.
This is performed by the method using the line-of-sight matching function, the viewpoint sharing function, and the virtual table function described above. Thereby, the virtual space is perceived.

FIG. 16 is a perspective view and a plan view for explaining the mounting of the handset 31. The handset 31 is worn as shown in FIG. This is the same as described in FIG. The viewpoint camera 33 is arranged so as to capture the direction of the line of sight of the face, and captures an image of the outside world seen by the user with one eye not covered by the image display 11 while holding the handset 31. Is done.

The dimensions and positional relationship when the handset 31 is mounted are the same as those described with reference to FIG. The dimensions and the positional relationship when the handset 31 including the other optical lens is mounted are the same as those described with reference to FIG. In addition, handset 3
In the case where the ultrasonic transmitter 21 is incorporated in the handset 31 and the ultrasonic distance sensors 22 and 23 are installed outside the handset 31 as the position / angle detection mechanism 1, the same as described with reference to FIG. become. Ultrasonic transmitter 21
In order to incorporate A and 21B into the handset 31 to detect the direction, the above-described operation shown in FIG.

In the above-mentioned handset-type video telephone device in which the image display 11 for one eye, the audio output device 12 for one ear, the viewpoint camera 33 and the like are integrated, the device is connected to the left eye
It is practically important to be able to use the same device both in the case where it is worn on one ear and in the case where it is worn on the right eye and one ear. Human eyes and ears differ from person to person, and when using for a long time, the left and right are often used as needed. However, if the device set for the left one eye / one ear is attached to the right one eye / one ear as it is (and vice versa), the displayed image and the captured image are inverted upside down. The method shown in FIG. 12 may be applied as a method of returning the upside down in accordance with the positional relationship between the eyes and the ears.

FIG. 17 is a view for explaining the eye-gaze matching method of the present invention. Reference numeral 11 denotes an image display in the handset 31, and reference numeral 32 denotes a face camera. Direction vector X representing the line-of-sight direction of handset 31 used by viewer MA
Is displayed on the image display 11 of the viewer MA only when the user faces the direction of the imaging direction vector Y of the facial camera 32. Similarly, the other party also captures an image from the facial camera 32 on the viewer MA side only when the direction vector X ′ representing the line of sight of the handset 31 is oriented in the direction of the imaging direction vector Y ′ of the facial camera 32. The displayed image is displayed on the image display 11 of the viewer MB. By performing signal control according to such a direction, both eyes can be guided in the direction of the face camera 32, and the eyes can be matched.

[0044]

As described above, the handset type television apparatus according to the present invention has an image display for inputting and displaying television image information on one eye of a viewer, and a television sound information applied to one ear of the viewer. acoustic output device for sound output and Tona
Ri comprises a handset comprising holding together, and fixedly on an arrangement condition to match the image display device and audio output device to the left or right eye and ear of the positional relationship between the viewer
With the left or right handset for one eye or one ear
Image information by determining whether the
Display of image information is changed to change the vertical relationship of display.
Upside down reversing part and handset for one eye / one ear
A left / right discriminating means for judging the left / right of the mounting state of the
The position of the handset or the position to detect the direction
.Direction detection means, the position detected by this position / direction detection means
The image display, the sound output device according to the position or direction
Signal switching control section for switching TV information to be output to
, Which automatically adapts to the viewing position and direction to provide instruction information
To change the position and direction of the detected handset.
Based on multiple received video and audio
And output sound can be selected.
By mounting the set, a plurality of image display devices
Or multiple sound output devices
A powerful presence can be realized.

Further, the handset-type videophone device according to the present invention is capable of inputting television image information to one eye of a viewer.
The image display to be displayed, the audio output device that outputs TV sound information by hitting the viewer's one ear, and the image display and the audio output are adapted to the positional relationship between one of the viewer's left and right eyes and one ear A viewpoint camera for capturing an eye gaze direction, and a transmitter for inputting conversation, and an image display and an audio output device. and composed of view camera and transmitter, position and direction detecting means for detecting the position or direction of the handset, the position and direction detecting means in accordance with the position or direction is detected, the image display device, the acoustic output device signal switching controller for switching the information to the information and imaging and transmission are output, transmit information, and a communication control unit that receives the position of the viewing, square
To automatically change the input and output of presentation information
The image displayed on the image display and the image captured by the viewpoint camera.
The upside-down part that flips upside down and the handset
By providing left and right discriminating means for judging left and right, automatic
The left or right side to determine whether
The vertical relationship of the image information display can be changed
And send / receive viewpoint images between communicators to share viewpoints
it can. In addition, by providing a facial camera, communication
Face-to-face matching with the hand is possible, and position / direction detection means
Conversation while switching between face image and shared information
be able to.

[Brief description of the drawings]

FIG. 1 is a diagram showing one embodiment of a handset type television device according to the present invention.

FIG. 2 is a front view, a plan view, and a perspective view showing a configuration of a handset of the present invention.

FIG. 3 is a perspective view and a plan view showing a mounted state of the handset of the present invention.

FIGS. 4A and 4B are a side view and a plan view showing a dimension / positional relationship when the handset of the present invention is mounted.

FIGS. 5A and 5B are a side view and a plan view showing a dimensional and positional relationship in a state where a handset including the optical lens of the present invention is mounted.

FIG. 6 is a configuration diagram showing an embodiment in which a position sensor is incorporated inside the handset.

FIG. 7 incorporates an ultrasonic transmitter in the handset,
FIG. 11 is a diagram illustrating a method of detecting a handset position when an ultrasonic distance sensor is installed outside the handset.

FIG. 8 is a diagram showing an example of a case where two ultrasonic transmitters are incorporated in a handset and a direction is detected.

FIG. 9 is a diagram illustrating an example in which an image displayed on an image display is switched according to a position of a handset in a two-dimensional plane.

FIG. 10 is a diagram illustrating an example in which an image displayed on an image display is switched according to the direction of a handset.

FIG. 11 is a perspective view showing an embodiment in which the right hand side and the left hand side of the handset of the present invention are mechanically deformed.

FIG. 12 automatically determines whether the handset is attached to one eye / one ear on the left side or one eye / one ear on the right side, and electronically flips the handset. FIG. 6 is a diagram showing an example of an embodiment which can be used for both left and right.

FIG. 13 is a diagram showing a basic configuration of a handset type videophone device according to the present invention.

FIG. 14 is a diagram illustrating a method for creating a virtual space according to the present invention.

FIG. 15 is a diagram showing a configuration of one embodiment of the present invention.

FIG. 16 is a perspective view and a plan view showing a mounted state of the handset of the present invention.

FIG. 17 is a diagram illustrating a method of eye-gaze matching.

FIG. 18 is an explanatory diagram of a conventional television device.

FIG. 19 is an explanatory diagram of a conventional earphone / headphone type television device.

FIG. 20 is an explanatory diagram of a conventional head mounted television device.

FIG. 21 is an explanatory diagram of a conventional videophone device.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Image display 2 Speaker 3 Television signal communication control part 4 Television apparatus main body 5 Wired cable 6 Sound output device 7 Lens 8 Handset 9 Image pickup device 10 Telephone signal communication control part 11 Image display 12 Sound output device 13 Handset 14 TV Signal Receiving Antenna 15 TV Signal Receiving Cable 16 TV Signal Communication Controller 17 Optical Lens 18 Position Sensor 19 Signal Switcher 20 Signal Switching Controller 21 Ultrasonic Transmitter 22 Ultrasonic Distance Sensor 23 Ultrasonic Distance Sensor 24 position calculating unit 25 holding unit 26 rotating mechanism 27 holding unit 28 upside down unit 31 handset 32 face camera 33 viewpoint camera 34 transmitter 35 position / angle sensor 36 handset type holding unit 37 communication control unit 38 external video source

──────────────────────────────────────────────────続 き Continuation of the front page (56) References JP-A-2-63379 (JP, A) JP-A-62-214782 (JP, A) JP-A-4-23579 (JP, A) (58) Field (Int.Cl. ⁷ , DB name) H04N 5/64 H04M 11/06 H04N 7/14

Claims (3)

(57) [Claims] 1. A television image information is input to one eye of a viewer.
An image display device to be displayed, and an audio output device that outputs television sound information by applying sound to one ear of the viewer, and the image display device and the audio output device are connected to one of left and right eyes and one ear of the viewer. A handset that is integrally and fixedly held in an arrangement condition that conforms to the positional relationship of An up-down inverting unit for inverting the display of image information so as to change the up-down relationship of the image information display; Or a position / direction detecting means for detecting a direction, and television information to be output to the image display or the sound output device in accordance with the position or direction detected by the position / direction detecting means. A signal switching control unit that automatically changes the indication information according to the viewing position and direction, and displays a plurality of images and sounds to be displayed from the plurality of received images and sounds based on the detected handset position and direction. A handset-type television device characterized by selecting audio to be output. 2. An image display for inputting and displaying a television image on one eye of a viewer, an audio output device for outputting television sound information to one ear of the viewer, and an image display and an audio output device And a viewpoint camera that captures the direction of the eye's line of sight, and is integrally and fixedly held in an arrangement condition that matches the positional relationship between one of the left and right eyes and one ear of the viewer. A handset for inputting the handset, comprising the image display device, the sound output device, the viewpoint camera and the handset, and a position / direction detecting means for detecting the position or direction of the handset; A signal switching control unit for switching information to be output to the image display and the sound output device and information to be imaged and transmitted according to the position or direction detected by the direction detection means; and a communication control unit for transmitting and receiving information. , Viewing rank A vertical reversing unit that automatically adapts to the position and direction to change the input and output of presentation information and communicates, and flips the display image of the image display and the captured image of the viewpoint camera up and down. A handset-type videophone device comprising: a left / right discriminating means for judging the right and left sides, and automatically determining whether the left or right side is in the mounted state, and adapting the mounted state to change the vertical relationship of the image information display. 3. A face camera for photographing a face image of a viewer, wherein the position / direction detecting means detects that the handset is oriented in the direction of the face camera. 3. The handset-type videophone device according to claim 2, wherein the image of the facial camera is displayed on an image display.