JP2018137568A - Reception telephone terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a reception telephone terminal capable of accurately discriminating even a gesture operation by any user and originating a telephone call to a party of a visit by retrieving each of sections at a destination of the visit or a telephone number of a person in charge easily even for any user.SOLUTION: A reception telephone terminal comprises: a housing 1 with which an image forming template 20 for displaying an operation target object 11 in a three-dimensional space that is visible for a user, as an aerial image 2 is installed on its surface; a 3D sensor 30 which detects a motion of a hand 3 of the user in the three-dimensional space; a control unit 40 which recognizes a gesture operation based on the motion of the hand 3 of the user; a call origination control part 51 which originates a telephone call while specifying a party to whom the user originates the telephone call, based on the gesture operation; and a speech control part 52 which enables the user to talk with the party. Thus, a section or the like at the destination of a visit is displayed as a real image and the user is enabled to perform retrieval in a non-contact manner through the gesture operation and originate a telephone call to the party of the visit.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a reception telephone terminal that allows a visitor to make a call to a visiting partner at reception of a general building or a company.

  Conventionally, extension telephones have been installed at receptions in general buildings and companies so that visitors can call the reception information department and view printed materials with the telephone numbers of each department and person in charge. By using this, a reception telephone that can make a call to a visiting party is used. In recent years, a touch-panel reception telephone terminal that can search the telephone number of each department or person in charge is often installed.

  On the other hand, as a terminal device, in recent years, there has been known a gesture operation device that determines a user's operation command based on a movement of a user's hand in a three-dimensional space, that is, a gesture, with respect to an input device such as a personal computer. (For example, Patent Document 1).

JP 2011-248606 A Japanese Patent No. 5665140

Gesture UI solution “Finger Gesture”, NEC Solution Innovator Co., Ltd., Internet <URL: http://www.nec-solutioninnovators.co.jp/sl/finger/>

  However, when browsing printed materials with the telephone number of each department or person in charge, or when using a touch-panel reception telephone terminal, the user must touch the printed material or touch panel. Therefore, a large number of unspecified people touch and operate, and there is a problem that it is not very hygienic.

  Therefore, it is conceivable to apply the gesture operating device as described above to the reception telephone. However, in the conventional gesture operating device as shown in Patent Document 1, for example, it is difficult for the user to understand how to use it. Since it is difficult to detect the operation with high accuracy, there is a problem that the operation as intended for the user is not smoothly performed and the usability is poor.

  The present invention has been made to solve the above-described problems, and can accurately determine the operation regardless of the gesture operation by any user. It is an object of the present invention to provide a reception telephone terminal that can easily search a telephone number of a person in charge by a non-contact operation and make a call to a visiting party.

  In order to achieve the above object, the present invention provides a reception telephone terminal equipped with a gesture operation function for recognizing a gesture operation by a movement of the user's hand in a three-dimensional space visible to the user. An operation object that is an object to be displayed and operated is installed inside, and an image imaging plate that displays the operation object as an aerial image in a three-dimensional space visible to the user is installed on the surface A housing, a 3D sensor that detects movement of the user's hand in the three-dimensional space, a display control unit that is connected to the operation target and controls display of the operation target, the 3D sensor, and the display NEC solution innovator stock connected to the control unit and recognizing gesture operation by movement of the user's hand in the three-dimensional space Based on a control unit equipped with a finger gesture made by the company, and a gesture operation based on the movement of the user's hand recognized by the control unit, the destination to which the user makes a call is identified and the destination It is characterized by comprising a call control unit for making a phone call, and a call control unit for enabling the user to make a call with the other party telephone-called by the call control unit.

  According to the reception telephone terminal of the present invention, a display image of an input device such as a personal computer causes each department or person in charge of the visited site to emerge as a real image in a three-dimensional space, and the user makes non-contact by gesture operation. You can make a search and make a call to the person you are visiting, so you can easily and accurately search for each department or person in charge who visits, regardless of the gesture operation by any user, Because it is non-contact, it can be operated without any problems in terms of hygiene.

3 is a configuration diagram illustrating a schematic configuration of a reception telephone terminal according to Embodiment 1. FIG. 3 is a functional block diagram showing a functional configuration of a control unit and a telephone unit of the reception telephone terminal according to Embodiment 1. 4 is a flowchart showing the operation of the control unit of the reception telephone terminal in the first embodiment. 6 is an explanatory diagram illustrating an example of use of a reception telephone terminal according to Embodiment 1. FIG. 6 is a configuration diagram illustrating a schematic configuration of a reception telephone terminal according to Embodiment 2. FIG. 6 is a functional block diagram illustrating a functional configuration of a reception telephone terminal according to Embodiment 2. FIG. FIG. 10 is an explanatory diagram illustrating an example of using a reception telephone terminal in a second embodiment.

The reception telephone terminal of the present invention is equipped with a gesture operation function based on the movement of the user's hand in a three-dimensional space that can be visually recognized by the user, and specifies the other party to whom the user makes a call based on the gesture operation. Phone call to the other party.
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

Embodiment 1 FIG.
FIG. 1 is a configuration diagram showing a schematic configuration of a reception telephone terminal according to Embodiment 1 of the present invention. This reception telephone terminal is provided with a housing 1, and the housing 1 is displayed to the user such as a liquid crystal display device that displays a display image that is an operation screen of an input device such as a personal computer. An operation object 11 that is an object to be operated is installed.

  In addition, an image imaging plate 20 that displays the operation target 11 as an aerial image 2 in a three-dimensional space that can be visually recognized by the user is provided on the surface of the housing 1. That is, the aerial image 2 is an image in which the operation object 11 that is an object to be displayed and operated by the user is raised as a real image in a three-dimensional space. In addition, it cannot be overemphasized that the display image surface of the operation target object 11 installed in the inside of the housing | casing 1 has faced the image imaging plate 20 side.

  Further, as the image imaging plate 20 for displaying the operation target 11 as the aerial image 2 in a three-dimensional space that can be visually recognized by the user, for example, an aerial imaging plate of Ascarnet Co., Ltd. is already known. Since an aerial imaging technique may be used, description thereof is omitted here. In the figure, the aerial image 2 is represented by a one-dot chain line, and although the image appears in the three-dimensional space, the other side is transparent and visible.

  Furthermore, the movement of the user's hand 3 operating the aerial image 2 displayed in the three-dimensional space is detected by the image imaging plate 20 at a position where the image imaging plate 20 is not installed on the surface of the housing 1. 3D sensor 30 is provided. The 3D sensor 30 may be any sensor as long as it can detect a position in a three-dimensional space, such as a TOF camera (TOF sensor).

  Further, in FIG. 1, among the positions where the image imaging plate 20 on the surface of the housing 1 is not installed, the side far from the aerial image 2 or the user's hand 3 (left side of the image imaging plate 20 in the figure). Although the case where the 3D sensor 30 is installed is shown, if the image imaging plate 20 on the surface of the housing 1 is not installed, for example, the side closer to the aerial image 2 or the user's hand 3 ( The 3D sensor 30 may be installed on the right side of the image forming plate 20 in the drawing.

  A control unit 40 connected to the 3D sensor 30 is provided. The control unit 40 detects and recognizes a gesture operation in a three-dimensional space caused by the movement of the user's hand 3. The control unit 40 is installed inside the housing 1.

  In addition, a display control unit 12 that performs display control of the operation target 11 that is a target to be displayed and operated by the user, such as a liquid crystal display device that displays a display image that is an operation screen of an input device such as a personal computer. The display control unit 12 is connected to the operation object 11 and the control unit 40. And in this Embodiment 1, the display control part 12 and the operation target object 11 shall be integrated in the input devices 10, such as a personal computer, (refer FIG. 2 mentioned later).

  The display control unit 12 may be built in the main body of the input device 10 such as a personal computer, and the operation target 11 may be a liquid crystal display device that is separate from the main body. That is, in the first embodiment, the display control unit 12 is installed in the housing 1 integrally with the operation target 11 (incorporated into the input device 10). In the case of a separate body from the operation target 11, the display control unit 12 is installed inside the housing 1.

  In addition, the user calls the visiting partner at a position where the image imaging plate 20 on the surface of the casing 1 is not installed, and at a position where the user can easily use (for example, the left front position of the casing 1). A telephone 60 capable of making a call is provided, and based on the gesture operation by the movement of the user's hand 3 detected / recognized by the control unit 40, the other party that the user wants to call (want to visit) is specified. A telephone call is made to the other party, and the user can make a call with the other party through the telephone unit 50 that enables a call. The telephone unit 50 is also installed inside the housing 1.

FIG. 2 is a functional block diagram showing functional configurations of the control unit 40 and the telephone unit 50 of the reception telephone terminal according to the first embodiment.
The control unit 40 includes a space operation recognition unit 41, a touch operation determination unit 42, and an operation control unit 43. The telephone unit 50 includes a call control unit 51 and a call control unit 52.

  Based on the movement of the user's hand 3 detected by the 3D sensor 30, the spatial operation recognition unit 41 recognizes a gesture operation in the three-dimensional space by the movement of the user's hand 3, and from the 3D sensor 30 to the user's hand 3 And the difference between the distance from the 3D sensor 30 to the aerial image 2 is calculated and transmitted to the touch operation determination unit 42.

  The touch operation determination unit 42 calculates a difference between the distance from the 3D sensor 30 to the user's hand 3 and the distance from the 3D sensor 30 to the aerial image 2 calculated by the spatial operation recognition unit 41 in a predetermined range. It is determined whether it is within (for example, within 5 mm), and the gesture operation recognized by the spatial operation recognition unit 41 is a touch operation performed on the aerial image 2 when it is within a predetermined range. It is determined that it is present, and is transmitted to the operation controller 43.

  When it is determined by the touch operation determination unit 42 that the gesture operation by the movement of the user's hand 3 is a touch operation performed on the aerial image 2, the operation control unit 43 performs the original operation of the aerial image 2 by the user. Information indicating what kind of touch operation has been performed on the operation object 11 is transmitted to the display control unit 12 and the transmission control unit 51.

The transmission control unit 51 specifies a partner to which the user makes a call (want to visit) based on a gesture operation based on the movement of the user's hand 3 detected and recognized by the control unit 40, and calls the partner. Make a call.
The call control unit 52 enables the user to make a call with the other party when the other party who has made a call by the outgoing call control unit 51 answers the call.

Here, the processing operation of the control unit 40 will be described.
FIG. 3 is a flowchart showing the operation of the control unit 40 of the reception telephone terminal in the first embodiment.
First, based on the movement of the user's hand 3 detected by the 3D sensor 30, the space operation recognition unit 41 recognizes a gesture operation in the three-dimensional space due to the movement of the user's hand 3, and the touch operation determination unit 42. (Step ST1).

  For this gesture recognition method, various methods are already known. For example, a gesture recognition technique as shown in Patent Document 2 may be used. In this invention, a finger gesture manufactured by NEC Solution Innovator Co., Ltd. is used. Shall be used. That is, the control unit 40 in the mobile phone terminal according to the first embodiment is equipped with a finger gesture manufactured by NEC Solution Innovator Co., Ltd. The same applies to the following embodiments. In addition, since this finger gesture made by NEC Solution Innovator is a known technique, detailed description thereof is omitted here (see Non-Patent Document 1).

  The spatial operation recognition unit 41 also determines the distance from the 3D sensor 30 to the user's hand 3 and the distance from the 3D sensor 30 to the aerial image 2 based on the movement of the user's hand 3 detected by the 3D sensor 30. Is calculated and transmitted to the touch operation determination unit 42 (step ST2).

  The touch operation determination unit 42 calculates a difference between the distance from the 3D sensor 30 to the user's hand 3 and the distance from the 3D sensor 30 to the aerial image 2 calculated by the space operation recognition unit 41 in accordance with a predetermined value. (For example, within 5 mm) (step ST3), and when it is determined that it is within the predetermined range (in the case of YES in step ST3), it is recognized by the space operation recognition unit 41. It is determined that the gesture operation is a touch operation performed on the aerial image 2, and is transmitted to the operation control unit 43 (step ST4).

On the other hand, when it is determined that the difference between the distance from the 3D sensor 30 to the user's hand 3 and the distance from the 3D sensor 30 to the aerial image 2 is not within a predetermined range (NO in step ST3) In the case), the process returns to step ST1 to repeat the process.
It should be noted that the “predetermined predetermined range” used here can be changed as appropriate so that any user's gesture operation can accurately determine the operation command.

  When the touch operation determination unit 42 determines that the gesture operation by the movement of the user's hand 3 is a touch operation performed on the aerial image 2, the operation control unit 43 performs the aerial image 2 by the user. The display control unit 12 and the transmission control of the input device 10 such as a personal computer connected to the operation target object 11 are used for information on what touch operation has been performed on the operation target object 11 that is the image that is the basis of It transmits to the part 51 (step ST5).

  Here, in this embodiment, as the operation target object 11, each department to be visited and the telephone number of the person in charge are displayed to the user. That is, a user can search for a visit partner by a gesture operation by using a display image of the input device 10 such as a personal computer and the like, and by highlighting each visitor's department or the telephone number of the person in charge in a three-dimensional space. It can be done.

  Further, as described above, the control unit 40 is equipped with a finger gesture manufactured by NEC Solution Innovator Co., Ltd., and the processing operation shown in FIG. 3 is realized by the finger gesture manufactured by NEC Solution Innovator Co., Ltd. Is.

  As described above, according to the reception telephone terminal equipped with the gesture operation function according to the first embodiment, operations such as the telephone number of each department or person in charge of the visited site are made by using the display image of the input device 10 such as a personal computer. Since the user can perform a gesture operation on the aerial image 2 that floats in the three-dimensional space as a real image of the operation target 11 that is desired to be performed, the user can accurately determine the operation regardless of the gesture operation by any user. be able to. In addition, since the user can perform a contactless search by gesture operation and can make a call to the person to be visited, it is easy for any user to search for the department number or the telephone number of the person in charge. Can be operated without any problem in terms of hygiene.

  FIG. 4 is an explanatory diagram showing one example of use of the reception telephone terminal according to the first embodiment. FIG. 4 shows that a visitor (user) who has arrived at a certain company uses the reception telephone terminal to obtain information such as the visiting department and the telephone number of the person in charge in order to contact the visiting party at the reception of the company. This is an example showing a state of making a phone call without contact, and the state in which the image imaging plate 20 and the 3D sensor 30 are installed on the surface of the housing 1 of the reception telephone terminal can be seen. The phone number of each department or person in charge is shown as an aerial image 2 in the original space.

  In this case, the visitor (user) does not need to have the telephone 60 handset until the visiting department or the telephone number of the person in charge is found, and only touches the aerial image 2 in the three-dimensional space without contact. When an operation is performed and the destination can be searched, for example, an instruction such as “Please take the handset” is displayed on the aerial image 2, whereby the telephone set of the telephone 60 can be lifted to make a call.

  FIG. 4 shows a case where the reception telephone terminal further includes a haptic feedback device 70. The tactile feedback device 70 provides tactile feedback such as vibration to the user's hand 3 when it is detected that the user's hand 3 has touched an operation button or the like of the aerial image 2.

  Thus, if the function of giving tactile feedback is also provided, there is an effect that even if the operation is performed on the aerial image 2, the user can obtain an input feeling by the gesture operation. In addition, since various techniques are already known about the structure and operation | movement of this haptic feedback apparatus 70 which provides this haptic feedback, although description is abbreviate | omitted here, you may make it use any of them.

  Note that FIG. 4 is merely an example, and the reception telephone terminal according to the first embodiment is normally used as a gesture operation terminal, for example, in an ATM or the like, and is provided with an interphone capable of making a call with a person in charge. Application to a device is possible.

  As described above, according to the reception telephone terminal of the first embodiment, by using the display image of the input device 10 such as a personal computer or the like, the departments or the telephone numbers of the persons in charge of the visited site appear as a real image in a three-dimensional space. The user can make a contactless search by gesture operation and make a call to the person to be visited, so that any user can make a gesture accurately and easily. Can be searched, and since it is non-contact, it can be operated without problems in terms of hygiene.

Embodiment 2. FIG.
FIG. 5 is a configuration diagram showing a schematic configuration of the reception telephone terminal according to Embodiment 2 of the present invention. In the second embodiment, the telephone 60 of the reception telephone terminal shown in FIG. 1 in the first embodiment is not provided, but a directional speaker 81 and a microphone 82 are provided instead. Further, the directional speaker 81 and the microphone 82 are referred to as a communication device 80 in the second embodiment. In addition, the same code | symbol is attached | subjected to the structure similar to what was demonstrated in FIG. 1, and the overlapping description is abbreviate | omitted.

  The directional speaker 81 outputs the voice from the other party in a direction that only the user can hear when a call is established by the call control unit 52. The microphone 82 detects the voice spoken by the user.

  As described above, since the directional speaker 81 is used, even if a call is established, a person around the reception telephone terminal cannot hear the voice of the other party's telephone. Thus, the user can use the same usage as when the telephone 60 in the first embodiment is provided in a completely hands-free state. In other words, since it is possible to make a call without contact with the user's hand, in addition to being able to perform a contactless search by gesture operation, it is possible to make a contact with a visiting partner without contact, There is an effect that it is hygienic.

  FIG. 6 is a functional block diagram showing a functional configuration of the reception telephone terminal according to the second embodiment. Further, since the flowchart showing the operation of the control unit 40 is the same as that in FIG. 3 in the first embodiment, illustration and description thereof are omitted here.

  Moreover, FIG. 7 is explanatory drawing which shows one of the usage examples of the reception telephone terminal in this Embodiment 2. In FIG. This FIG. 7 is similar to FIG. 4 in the first embodiment. A visitor (user) who has come to a certain company uses this reception telephone terminal to contact the visiting party at the reception of the company. This is an example in which a telephone number of a previous department or a person in charge is searched in a non-contact manner and a telephone call is made. An image imaging plate 20 and a 3D sensor 30 are provided on the surface of the case 1 of the reception telephone terminal. The installed state is visible, and the telephone number of each department or person in charge is shown as an aerial image 2 in the three-dimensional space.

  In this case, the visitor (user) does not need to have a handset and is completely hands-free, not only until the visiting department or the telephone number of the person in charge is found, but also after the call is possible and during the call. In this state, you can touch the aerial image 2 in the three-dimensional space without touching it. If you can find a place to visit and establish a call, for example, the aerial image 2 will be instructed to “speak as it is”. Thus, the user can make a call.

  Needless to say, the second embodiment may further include a haptic feedback device 70 as in the case shown in FIG. In this case, since the tactile feedback device 70 can be arranged at the same position as the communication device 80 in FIG. 7, it is not necessary to take an extra place for installation, and an increase in the size of the entire device is prevented. be able to.

  As described above, according to the reception telephone terminal of the second embodiment, each department or person in charge of the person visited is displayed in a three-dimensional space as a real image on the display image of the input device 10 such as a personal computer. The user can make a contactless search by gesture operation and make a call to the person to be visited, so that any user can make a gesture accurately and easily. In addition to the same effect as that of the first embodiment that it is possible to search for and to operate without any problem in terms of hygiene because of non-contact, it is also possible to perform non-contact until a call with a visiting partner So it has the effect of being more hygienic.

  In the present invention, within the scope of the invention, any combination of the embodiments, or any modification of any component in each embodiment, or omission of any component in each embodiment is possible. .

DESCRIPTION OF SYMBOLS 1 Case 2 Aerial image 3 User's hand 10 Input device 11 Operation target 12 Display control device 20 Imaging plate 30 3D sensor 40 Control unit 41 Spatial operation recognition unit 42 Touch operation determination unit 43 Operation control unit 50 Telephone unit 51 Transmission control Unit 52 Call control unit 60 Telephone 70 Tactile feedback device 80 Communication device 81 Directional speaker 82 Microphone

Claims (3)

A reception telephone terminal equipped with a gesture operation function for recognizing a gesture operation by a movement of the user's hand in a three-dimensional space visible to the user,
An operation target object that is a target to be displayed and operated for the user is installed inside, and an image imaging plate that displays the operation target object as an aerial image in a three-dimensional space visible to the user is provided on the surface. An installed housing;
A 3D sensor for detecting movement of the user's hand in the three-dimensional space;
A display control unit connected to the operation object and performing display control of the operation object;
A control unit that is connected to the 3D sensor and the display control unit and recognizes a gesture operation by a movement of the user's hand in the three-dimensional space, and is equipped with a finger gesture manufactured by NEC Solution Innovator Co., Ltd.
Based on the gesture operation by the movement of the user's hand recognized by the control unit, a call control unit for specifying a caller to which the user makes a call and making a call to the callee,
A reception telephone terminal comprising: a call control unit that enables the user to make a call with the other party that has made a call by the call control unit. The control unit equipped with the finger gesture manufactured by the NEC Solution Innovator Co., Ltd. recognizes the gesture operation caused by the movement of the user's hand based on the movement of the user's hand in the three-dimensional space detected by the 3D sensor. And determining whether or not a difference between the distance from the 3D sensor to the user's hand and the distance from the 3D sensor to the aerial image is within a predetermined range. When the user determines that the recognized gesture operation is a touch operation performed on the aerial image, the user performs an operation on the operation object that is the source of the aerial image. Information on what kind of touch operation has been performed is transmitted to the display control unit and the transmission control unit The reception telephone terminal according to claim 1. When a call is established by the call control unit, the apparatus further includes a directional speaker that outputs sound from the other party in a direction that can be heard only by the user, and a microphone that detects sound uttered by the user. The reception telephone terminal according to claim 1 or 2, characterized by the above-mentioned.

Images