JP2017050718A - Wearable terminal, method, and system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a wearable terminal, a method, and a system that can simply display an image at a position distant from a user.SOLUTION: According to an embodiment, a wearable terminal that can be attached to a user's head can change its position and can communicate with an enclosure comprising a first camera. The wearable terminal comprises: a second camera that takes an image along the user's visual line; a display unit that is situated on the user's visual line and displays an image taken with the first camera or an image taken with the second camera; first detection means that includes a function to detect the position and orientation of the wearable terminal and detects a photographing position and photographing direction of the second camera; and a controller that moves the enclosure to the photographing position detected by the first detection means and takes an image with the first camera at the photographing position and in the photographing direction detected by the first detection means.SELECTED DRAWING: Figure 1

Description

  Embodiments described herein relate generally to a wearable terminal, a method, and a system.

  2. Description of the Related Art Conventionally, in order to support work such as inspection and repair of a manufacturing apparatus at a manufacturing site in the manufacturing industry, a display system that provides a worker with an image of a place away from the worker has been developed.

  This system can accommodate an imaging device, a display device mounted on a user's head, a transmission device that transmits image data generated by imaging by the imaging device to the display device, and the imaging device and the display device. And a display system that includes a case that also serves as a support for the imaging device, and can form an image corresponding to the image data by a display device that is disposed at a position away from the imaging device. According to this system, the image data generated by the imaging by the imaging device can be transmitted to a display device arranged at a remote location, and an image corresponding to the image data can be viewed by an observer.

JP 2000-287204 A

  In this system, it is necessary for the user to set a camera on the pan head, and it takes time and effort for preparation.

  An object of the present invention is to provide a wearable terminal, a method, and a system that can easily display an image at a position away from a user.

  According to the embodiment, the wearable terminal that can be worn on the user's head can change the position and can communicate with the housing including the first camera. The wearable terminal includes a second camera that captures an image along the user's line of sight, a display unit that is positioned on the user's line of sight and displays a captured image of the first camera or the second camera, and the position and orientation of the wearable terminal. A first detecting means having a detecting function and detecting a photographing position and a photographing direction of the second camera; and a photographing position detected by the first detecting means after moving the housing to the photographing position detected by the first detecting means. And a controller that captures an image with the first camera in the capturing direction.

It is a perspective view which shows an example of the wearable terminal of embodiment. It is the figure which shows the front view and cross-sectional structure which show an example of a wearable terminal. It is a figure which shows an example of the position detection of a wearable terminal. It is a figure which shows the principle of position detection of a wearable terminal. It is a figure which shows the signal waveform at the time of the position detection of a wearable terminal. It is a figure which shows an example of the system containing a wearable terminal and a communication server. It is a block diagram which shows the electric constitution of a wearable terminal. It is a block diagram which shows the electrical structure of a drone. It is a flowchart which shows the first half of an example of imaging | photography control of the drone by a system. It is a flowchart which shows the second half of an example of imaging | photography control of the drone by a system. It is a flowchart which shows the first half of the other example of the imaging | photography control of the drone by a system. It is a flowchart which shows the second half of the other example of the imaging | photography control of the drone by a system.

  Hereinafter, embodiments will be described with reference to the drawings.

  Wearable terminals include head-mounted types (including glasses, goggles, helmets, etc., which may be collectively referred to as glasses), wristbands, pendants, and the like. Here, an embodiment of a glasses-type wearable terminal will be described. Glasses-type wearable devices include a type that allows you to see the scenery ahead of your line of sight through a transparent lens, and a type that is called a head-mounted display where the view is blocked and you cannot see the scenery. Explain the type that can be seen.

  FIG. 1 is a perspective view of a glasses-type wearable terminal (hereinafter simply referred to as a wearable terminal) 10, FIG. 2 (a) is a front view, and FIG. 2 (b) is a diagram showing a cross-sectional structure viewed from above.

  The wearable terminal 10 has substantially the same shape as normal glasses, but here, the projection device 12 is attached to the outside of the temple on the right eye side. Glasses 14 and 16 are fitted in the frame. The glass 14 on the left eye side is a normal transparent glass so that the user can see the scenery. The right-eye glass 16 is at least partially a screen 16. The screen 16 allows the user to see the image projected by the projection device 12. The screen 16 is transparent when the projection device 12 does not project an image, and the user can view the scenery through the glass (screen) 16 on the right eye side.

  The projection device 12 includes a power supply unit 22 and a control unit 24 as electronic components. The power supply unit 22 may include a button-type battery, a rechargeable battery, a secondary battery capable of non-contact power supply, and the like. Alternatively, the projection apparatus 12 may be supplied with power from an external power supply via a power supply line without incorporating a power supply. The control unit 24 communicates with a server and other electronic devices via a network described later, and transmits and receives information. This communication may be either wired or wireless. For wireless, Bluetooth (registered trademark), ZigBee (registered trademark), short-range wireless communication such as UWB, medium-range wireless communication such as WiFi (registered trademark), 3G / 4G, WiMAX (registered trademark) depending on the usage environment Any of long-distance wireless communications such as the above may be used.

  The projection device 12 further includes a light source 28, a display unit 30, a prism 32, a lens group 34, and the like as optical components. The light source 28 may be a dimming white LED light source including a plurality of, for example, three LEDs (Light Emitting Diodes) whose emission colors are different from each other and whose output light amounts can be changed independently. According to the dimmable white LED light source, even when the use environment of the wearable terminal 10 is, for example, in a clean room where illumination mainly using orange is used, the emission color is changed according to the use environment. And a clear projected image can be obtained. Furthermore, according to the dimming white LED light source, it is possible to output a display color that is easy for the user to see, and compared with the case where the user outputs a display color that is difficult to see, eye fatigue, migraines associated therewith, etc. It is possible to avoid the occurrence of a factor that hinders the user.

  The display unit 30 is, for example, a reflective LCD (Liquid Crystal Display) module. Based on display control by the control unit 24, a predetermined text, image, or the like (hereinafter, what the display unit 30 displays is referred to as a display image). May be collectively referred to). Non-parallel light emitted from the light source 28 (divergent light, sometimes referred to as divergent light) is reflected by the half mirror surface 32a of the prism 32 and illuminates the display image of the display unit 30. The reflected light of the display unit 30 passes through the half mirror surface 32a as light corresponding to the display image (sometimes referred to as image light), is emitted from the emission surface 32c, and is projected through the lens group 34 to a predetermined size. An image is projected onto the screen 16.

  The screen 16 includes a near-side transparent refractor 42, a Fresnel lens-shaped half mirror surface 44, and a back-side transparent refractor 46. A part of the image light reaching the Fresnel lens half mirror surface 44 is reflected by the Fresnel lens half mirror surface 44 to form a virtual image (projected image) corresponding to the display image of the display unit 30 several meters ahead. Note that the screen 16 can partially transmit the scenery ahead of the user's line of sight wearing the wearable terminal 10, and the screen 16 is configured to display a scenery that can be visually recognized by the user together with the projected image. Also good.

  Part of the image light (diverged light) emitted from the light source 28 and passed through the half mirror surface 32a is totally reflected by the total reflection surface 32b, refracted by the emission surface 32c, and leaked light that is divergent light from the light source 28. 50. The leaked light 50 is emitted in a direction different from that of the screen 16 through an opening or a gap (guidance portion) 52 formed on the front surface of the projection unit 12.

  The wearable terminal 10 includes a speaker 54A, an earphone jack 54B, a microphone jack 56, a slide switch 57, a rotary switch 58, and the like at a predetermined position of the projection device 12, for example, a bottom surface portion. A hands-free microphone (not shown) is connected to the microphone jack 56 to collect user's voice. The slide switch 57 can adjust the brightness, color tone, and the like of the projection image of the projection device 12, for example. The rotary switch 58 can adjust the projection angle of the projection image, for example. By making it possible to set different adjustment amounts by different operations such as the slide switch 57 and the rotary switch 58, the user can adjust the projection image by blind touch while viewing the projection image. For example, by operating the slide switch 57, it is possible to provide a projected image with display brightness and color tone that suits the user's preference. By operating the rotary switch 58, the projection angle can be adjusted so as to display an image at an optimal position in accordance with the shape and size of the user's head. Of course, the objects to be adjusted by the slide switch 57 and the rotary switch 58 may be reversed, or the positions of the slide switch 57 and the rotary switch 58 may be reversed. You may assign to two types of operation of one operation member.

  The selection by these switches 57 and 58 may be carried out in practice and error while only looking at the projection image. However, in order to increase the efficiency of adjustment, a menu screen is projected and items are selected on the screen. You may adjust. When the display unit 30 displays the menu screen, the menu screen is projected on the screen 16.

  Further, the menu item may be selected by a touch operation, not by the operation of the switches 57 and 58. For this reason, a touch pad 55 is also provided outside the projection device 12. When the display unit 30 displays a menu or the like and touches a position in the touch pad 55 corresponding to the display position of the item in the menu, a user operation can be input easily and efficiently.

  A camera 59 is provided outside the center of the front, and an image ahead of the user's line of sight (either a still image or a moving image is acceptable) can be taken. Although not shown, a camera is provided on the inner side of the front center (a position corresponding to the arrangement position of the camera 59) so as to face the user's face so that the user's eyeball can be photographed and the user's iris can be detected. Also good. The iris can be used for user authentication.

  By using the leaked light 50 from the wearable terminal 10, the state of the wearable terminal 10, that is, the state of the user can be detected. The principle of detecting the state of the wearable terminal will be described with reference to FIGS. Here, the state includes a position and a movement of the position.

  An example of the usage example of the wearable terminal is shown in FIG. For example, an arbitrary number of work spaces or product shelves A01 to Axy (x and y are both positive integers), B01 to Bxy in a work area 60 such as a factory parts yard, a mail order company's product warehouse, or a retail delivery department , C01 to Cxy are arranged. The work space or the product shelf may be, for example, a factory work table, a manufacturing apparatus in a production line, a school desk, a seating position in a conference room, or the like.

  In the work area 60, at least one optical sensor 62-1 to 62-n (n is a positive integer) is arranged. The optical sensors 62-1 to 62-n indicate the position, number, change in position (movement), change in direction, and the like of wearable terminals 10-1 to 10-m (m is a positive integer), as shown in FIGS. It can detect individually by the detection method shown in. By detecting changes in position, number, movement, and orientation of the wearable terminals 10-1 to 10-m. It is possible to recognize the positions, movements, and the like of an arbitrary number of users wearing the wearable terminals 10-1 to 10-m.

  The user can move freely in the work area 60. The user performs a predetermined work in a work space 64 that is a predetermined position, for example, a station (cart), a container according to the work, or a movable table. The work space 64 is not movable and may be a fixed desk, a seating position thereof, or the like.

  As shown in FIGS. 3 and 4, the detection system includes one or more wearable terminals 10 and one or more optical sensors 62. The optical sensor 62 has a function of detecting the leaked light 50 and a communication function of transmitting the detection result to a server or the like. This communication function may be either wired or wireless, similar to the communication function of wearable terminal 10. For wireless, Bluetooth (registered trademark), ZigBee (registered trademark), short-range wireless communication such as UWB, medium-range wireless communication such as WiFi (registered trademark), 3G / 4G, WiMAX (registered trademark) depending on the usage environment Any of long-distance wireless communications such as the above may be used. Although the embodiment described below includes various units and modules having a communication function, the communication functions of these units and modules may be either wired or wireless as well. For wireless, Bluetooth (registered trademark), ZigBee (registered trademark), short-range wireless communication such as UWB, medium-range wireless communication such as WiFi (registered trademark), 3G / 4G, WiMAX (registered trademark) depending on the usage environment Any of long-distance wireless communications such as the above may be used.

  In order to be able to identify the wearable terminal 10 from the leaked light 50 received by the optical sensor 62, the wearable terminal 10 uses the information including the terminal identification information (hereinafter also referred to as terminal ID) to detect the leaked light 50. Modulate intermittently. A typical example of the modulation method is a chopper type modulation method that reduces the light emission amount to zero. Here, a modulation method that can secure a light emission amount equal to or larger than a predetermined amount even when the light emission amount is low is adopted. Thereby, the burden with respect to a user's eyes can be reduced. As a modulation method, for example, a DSV (Digital Sum Value) free modulation method (that is, a modulation method in which a DSV of a modulation signal is always calculated, a bit inversion code can be inserted as appropriate, and a DC component is zero) is employed. The change in the amount of light emission in a relatively long range is suppressed, the change in the amount of light emission can always be made macroscopically, and the burden on the user's eyes is further reduced. Since the human eye can recognize a change of about 0.02 seconds, an effect of reducing the burden on the user's eyes by setting the reference frequency of the modulation to 10 Hz or more, for example, 20 Hz or more, more preferably 60 Hz or more. Is also born. On the other hand, since the LED used for the light source 28 has internal impedance and connection capacitance, the accurate modulation frequency is preferably less than 100 MHz, preferably 10 MHz or less. Therefore, the modulation frequency of the light source 28 used in the detection system of the embodiment is preferably 10 Hz to 100 MHz, and more preferably 10 Hz to 10 MHz.

  Since the diverging light leakage light 50 from the light source 28 is used, the amount of light detected by the optical sensor 62 changes according to the distance between the wearable terminal 10 and the optical sensor 62. If this phenomenon is used, the distance between the wearable terminal 10 and the optical sensor 62 or the orientation of the wearable terminal 10 with respect to the optical sensor 62 can be obtained. Since the position (including height) of the optical sensor 62 is fixed, if the distance between the optical sensor 62 and the wearable terminal 10 is known, the position (x, y, z) of the wearable terminal 10 can be detected.

  Furthermore, since the diverging light leakage light 50 from the light source 28 is used, the leakage light 50 can be detected in a relatively wide range. As a result, only by installing a relatively small number of optical sensors 62-1 to 62-n, the position of the wearable terminals 10-1 to 10-m in the work area 60, the distance between the wearable terminal 10 and the optical sensor 62, The direction of wearable terminals 10-1 to 10-m or the direction of wearable terminal 10 with respect to optical sensor 62 can be detected. Thereby, the installation cost required in order to install a detection system can be reduced.

  The light amount information of the leakage light 50 detected by the optical sensor 62 is transmitted from the optical sensor 62 to a server described later at a predetermined timing. The server analyzes the collected information from the optical sensor 62. Thereby, arbitrary wearable terminals 10-1 to 10-m, that is, the position and state of the user can be detected.

  FIG. 4 is a schematic diagram illustrating a specific usage example of the system that recognizes the wearable terminal according to the embodiment. Assume a situation in which there are three users wearing wearable terminals 10-1 to 10-3 around four optical sensors 62-1 to 60-4. The leaked light 50 from the wearable terminals 10-1 and 10-2 is detected by the optical sensors 62-1 to 60-4. Each of the optical sensors 62-1 to 60-4 performs AD (Analog-Digital) conversion on the light amount of the leaked light 50 detected in each of them, and uses, for example, short-range wireless communication at predetermined timing as light amount information corresponding to the light amount. To the server.

  Wearable terminal 10-1 moves to optical sensor 62-1 according to the movement of the user, while wearable terminal 10-2 is temporarily oriented according to the user's arbitrary operation, for example, swinging (head turning). Suppose that The change of the detection information at this time is shown in FIG.

  In FIG. 5, the example which used the intermittent time change system as a modulation system of each leaked light 50 of wearable terminal 10-1 to 10-3 is shown. That is, the ID modulation period is shifted in each of the wearable terminals 10-1 to 10-3.

  As shown in FIGS. 5A, 5 </ b> B, and 5 </ b> C, the ID modulation period of the wearable terminal is intermittently set for the first to third wearable terminals 10-1 to 10-3, and the others This period is a non-modulation period. Within each ID modulation period, the synchronization signal SYNC and the terminal IDs of wearable terminals 10-1 to 10-3 constitute one set (corresponding one-to-one), and the set is a plurality of times (as shown in FIG. 5). If there are four sensors, a multiple of 4) is repeated.

  As soon as the first wearable terminal 10-1 enters the non-modulation period, the ID modulation period of the second wearable terminal 10-2 starts. Similarly, the ID modulation period of the third wearable terminal 10-3 starts at the same time as the second wearable terminal 10-2 enters the non-modulation period.

  In the ID modulation period of the second wearable terminal 10-2 and the ID modulation period of the third wearable terminal 10-3, the synchronization signal SYNC and the terminal IDs of the wearable terminals 10-2 and 10-3 are repeatedly modulated. Is done. Thus, the terminal ID can be detected by placing the terminal ID of the wearable terminal 10 in the modulated signal.

  In the above example, the modulation timings of the wearable terminals 10-1 to 10-3 are time-division (intermittent). However, for example, all the wearable terminals 10-1 to 10-3 may be continuously modulated, and the modulation reference frequencies of the wearable terminals 10-1 to 10-3 may be changed. Moreover, each frequency spectrum characteristic at the time of spectrum spreading may be changed.

  As shown in FIGS. 5D, 5E, 5F, and 5G, the information communication period from the optical sensors 62-1 to 62-4 is finely divided in each ID modulation period.

  As shown in FIG. 4, at the initial time, part of the leaked light from the wearable terminal 10-1 reaches the optical sensor 62-4. Therefore, at the initial time, as shown in FIG. 5 (k), the optical sensor 62-4 detects the leaked light from the wearable terminal 10-1. However, as the wearable terminal 10-1 moves toward the optical sensor 62-1, the modulation signal amplitude of the leaked light from the wearable terminal 10-1 detected by the optical sensor 62-4 decreases. On the other hand, as shown in FIG. 5 (h), the modulation signal amplitude of the leaked light from the wearable terminal 10-1 detected by the optical sensor 62-1 increases with time. In this way, by comparing the time change of the amplitude of the modulation signal detected by the optical sensors 62-1 to 62-n, the time change (moving state) of the position of the wearable terminal 10-1 to 10-m that is the detection target. Can be detected.

  On the other hand, since the wearable terminal 10-2 is directed to the optical sensor 62-3 at the initial time, the modulation signal amplitude obtained from the leaked light is detected by the optical sensor 62-3 from the detection value of the optical sensor 62-2. The detected value of is larger. Thereafter, for example, it is assumed that the second user swings his head and temporarily faces the optical sensor 62-2. Then, the detection output of the wearable terminal 10-2 output by the optical sensor 62-2 temporarily increases and then decreases as shown in FIG. 5 (i). On the other hand, as shown in FIG. 5 (j), the detection output of the wearable terminal 10-2 output by the optical sensor 62-3 increases after being temporarily reduced.

  In this way, by comparing the time change of the modulation signal amplitude detected by the optical sensor 62, the time change in the direction of the wearable terminals 10-1 to 10-m that are detection targets can also be estimated.

  The above detection example is an example in the case of movement or swing as the user's movement. However, the present invention is not limited to this, and various other actions of the user may be used. For example, the leakage light may be temporarily blocked by moving the user's hand, twisting the upper body (body), or the like. In this case, in all the optical sensors 62-1 to 60-4, the modulation signal amplitude temporarily decreases in the same time zone. Thus, by comparing the relevance of the change in the modulation signal amplitude of all the optical sensors 62-1 to 60-4, it is possible to identify different behavior patterns of the user.

  By using the above method, it is possible not only to detect the user's behavior but also to recognize the user's intention.

  Note that a beacon may be used as a method of detecting the position (x, y, z) of the wearable terminal 10. In the above-described example, the light whose terminal identification information is modulated is emitted from a large number of wearable terminals 10 to a large number of optical sensors 60, and the information received by the large number of optical sensors 60 is compared to determine the position of the wearable terminal 10, Although the state is detected, a large number of position information transmitters are arranged in the work area 60, and a beacon according to the arrangement position is transmitted from the transmitter by short-range wireless communication such as RF-ID having a reach distance of several meters, for example. Then, the wearable terminal 10 that has received it can be considered to be at substantially the same position as the position of the transmitter. Furthermore, the position of the wearable terminal can be detected using GPS. The position detection does not need to be based on only one type of method, and the detection accuracy can be improved by using a plurality of methods in combination.

  FIG. 6 shows an example of the entire system using a wearable terminal. The system includes one or more LANs 102 and one wide area network 104. The wide area network 104 may be a network for each factory, building, or company, or the Internet. The LAN 102 may be a unit such as a factory building, a department, a building floor, a company sales office, or the like. Each LAN 102 includes a plurality of wearable terminals 10, a drone 202, a plurality of optical sensors 62, an access point 112, a plurality of position information transmitters 113, a plurality of cameras 114, and the like. It is not necessary to prepare the number of wearable terminals 10 by the number of workers. A predetermined number of wearable terminals 10 may be prepared and a shared wearable terminal having a necessary worker available may be attached. Similarly, only one or several drones 202 may be prepared, and a shared drone free of necessary workers may be used. Wearable terminal 10, drone 202, optical sensor 62, position information transmitter 113, camera 114, and the like are connected to access point 112 by radio. The LAN 102 is connected to the communication server 106 via the wide area network 104. The position information transmitter 113 transmits a beacon according to the position by short-range wireless communication such as RF-ID having a reach distance of several meters. The camera 114 captures the area of the LAN 102, and can analyze the user's behavior by analyzing the image. For example, the wearing user can be identified by storing a standard image for each user and comparing it with an image when the user attaches or removes the wearable terminal 10. In the case where a large number of cameras cannot be arranged, the camera 114 that can shoot a wide range of users with a single camera is arranged.

  The drone 202 is a small flying object that is remotely operated. However, when the destination is set, the drone 202 can also fly autonomously to the destination. Usually, it has four propellers, but the number of propellers is not limited. The drone 202 is equipped with a camera, transmits a captured image to the wearable terminal 10 via the LAN 102, and further transmits the captured image to the communication server 106 via the network 104. The drone 202 can stand still in the air, land on the ground, and take a picture from a fixed position. For example, when the work area 60 as shown in FIG. 3 is an area of one LAN 102, the drone 202 can freely move within the work area 60 and, for example, can photograph the back side of the manufacturing apparatus A02. The captured image is transmitted to another place, for example, the wearable terminal 10-3 of the user in front of the manufacturing apparatus A04. As a result, the worker can view on the screen 16 a landscape that he / she cannot actually see. Note that the number of drones 202 need not be as many as the number of workers, and may be as many as necessary.

  The communication server 106 includes an information search unit 120, a position / information management unit 122, a wearer estimation unit 124, a schedule management unit 126, an image storage unit 128, an imaging control unit 130, and the like.

  The position / state management unit 122 collects and manages information on the position and state of the wearable terminal 10 and the administrator terminal 202. Further, the information is extracted from the information search unit 120. The schedule management unit 126 has a function for managing and providing schedule information and attendance records of employees who wear terminals. The schedule information includes the work schedule of the employee (from what time to what time in which area he / she will be engaged in work, etc.), the time of departure / working, and the work record (from what time to what time in which area he / she is working. Etc.). Further, the information is extracted from the information search unit 120. The information search unit 120 has a function for searching and processing information held by the position / state management unit 122 and the schedule management unit 126. The wearer estimation unit 124 determines who the wearer is by correlating existing feature data of the managed employee with the feature data of the given user. The shooting control unit 130 sets the flight destination of the drone 202, the shooting direction, the magnification of the shooting zoom lens, and the like, and controls the movement of the drone 202. The image storage unit 128 captures an image captured by the drone 202 or an image captured by the camera of the wearable terminal 10, an imaging date / time, an ID of an imaging device, an imaging position, an imaging direction, and other imaging conditions (user ID, work area name, user Can be stored together with the device name, zoom magnification, etc. Depending on the embodiment, only a part of the information may be stored.

  FIG. 7 shows an example of the electrical configuration of the wearable terminal 10. The wearable terminal 10 includes a CPU 140, a system controller 142, a main memory 144, a storage device 146, a microphone 148, a speaker 54, an image processing unit 150 (controls the light source 28 and the display unit 30), a camera 59, a wireless communication device 152, a motion A sensor 154, a line-of-sight detection sensor 156, a gesture sensor 158, a touch pad 55, a vibrator 68, a position information receiver 159, a GPS module 155, and the like are provided.

  The CPU 140 is a processor that controls the operation of various modules in the wearable terminal 10, and executes a computer program loaded into the main memory 144 from the storage device 146 formed of a nonvolatile semiconductor memory such as an SSD or a flash array. These programs include an operating system (OS) and various application programs. The CPU 140 executes various application programs and communicates with the communication server 106 via the network using the wireless communication device 152, and performs the following processing, for example. For example, the CPU 140 performs various controls such as performing voice input using the microphone 148, sending voice data to the communication server 106, and generating sound from a stereo earphone or speaker 54 (not shown) connected to the earphone jack 54B. . When a stereo speaker is necessary, although not shown in FIGS. 1 and 2, a speaker may be provided on the temple on the left eye side.

  The system controller 142 is a device that connects between the local bus of the CPU 140 and various components. The microphone 148 is connected to the microphone jack 56 and collects voice or environmental sound emitted by the user. By recognizing the voice uttered by the user or analyzing the environmental sound, the user's behavior can be estimated and the user can be identified. For example, the wearing user can be specified by storing the standard voice for each user and comparing it with the voice generated by the wearer. Further, by analyzing the environmental sound, it is possible to identify the work place where the wearer is located, and to narrow down the user who is at the place from the user's action schedule. The speaker 54 outputs an alarm for alerting the user. The image processing unit 150 outputs an image signal to the display unit 30 and turns on the light source 28 to project the image of the display unit 30 on the screen 16. This image can include not only still images but also moving images. The wireless communication device 152 has a wireless LAN function, for example, and connects the wearable terminal 10 and the access point 112 wirelessly.

  The motion sensor 154 is a sensor that integrates a three-axis acceleration, a three-axis gyro, and a three-axis geomagnetic sensor. The motion sensor 154 can detect the movement of the head of the user who uses the wearable terminal 10, and as a result, determines the direction in which the face is facing. To do. The line-of-sight detection sensor 156 is provided toward the user's face inside the center of the frame of the glasses, photographs the user's eyeball, and detects the movement of the line of sight. Further, the line-of-sight detection sensor 156 may be capable of detecting the user's iris. The gesture sensor 158 is a sensor that determines a gesture caused by finger movement. Specifically, it is a generic term for sensors that determine a user's gesture by analyzing the movement of a finger on the touch pad 55 provided in the projection device 12 and the image of the camera 59. The vibrator 68 vibrates the temple of the wearable terminal 10 by vibrating the projection device 12, and conveys some information to the user. The position information receiver 159 receives a beacon including position information transmitted from a plurality of position information transmitters 113 arranged in the area of the LAN 102 using near field communication such as RF-ID. Since it is short-range wireless communication, the position of the transmitter and the receiver (wearable terminal) can be regarded as almost the same. The GPS module 155 detects the position (x, y, z) of the wearable terminal 10. By combining this detection result, the detection result of the position information receiver 159, and the detection result of the optical sensor 62 in FIG. 3, the position of the user and its change can be detected more accurately.

  FIG. 8 shows an example of the electrical configuration of the drone 202. Like the wearable terminal 202, the drone 202 includes a CPU 140A, a system controller 142A, a main memory 144A, a storage device 146A, a wireless communication device 152A, a motion sensor 154A, a GPS module 155A, and the like. The CPU 140A of the drone 202, the system controller 142A, the main memory 144A, the storage device 146A, the wireless communication device 152A, the motion sensor 154A, and the GPS module 155A are the CPU 140, the system controller 142, the main memory 144, the storage device 146, the wireless device of the wearable terminal 10. It corresponds to the communication device 152, the motion sensor 154, and the GPS module 155. The GPS module 155 detects the current position of the drone 202 and enables autonomous flight to the destination.

  The drone 202 may further include a camera 156, a motor 157, and the like. The camera 156 preferably has the same function as the camera 59 of the wearable terminal 10, but the function may be different. For example, the camera 156 may have higher resolution and higher functionality. Of course, the camera 156 has a variable shooting direction, but the focal length of the lens may be variable. The camera 156 may be able to shoot both still images and moving images, or may be able to shoot only moving images. The motor 157 is a drive source for flying the drone 202, and can drive each of the plurality of propellers.

  Next, video distribution processing by the wearable terminal 10, the communication server 106, and the drone 202 configured as described above will be described. Here, it is assumed that the use environment of the wearable terminal 10 is a manufacturing factory having a large number of manufacturing apparatuses. At the manufacturing site, the operating rate of the manufacturing apparatus is a major factor affecting the production volume of the product. Manufacturing equipment requires periodic maintenance and inspection. However, since the equipment is stopped during maintenance and inspection, the efficiency of maintenance and inspection work is desired. In addition, it is desired to improve the efficiency of recovery work when a sudden failure occurs in the manufacturing apparatus. During such maintenance and restoration work, there is a request to refer to the back side of the device or the meter value of other devices. Conventionally, it is necessary to help other workers and move to other places. In this embodiment, the camera 156 of the drone 202 flying autonomously captures an image of another place on behalf of the person.

  Referring to the flowcharts of FIG. 9 and FIG. 10, before starting the work, the user first takes an image (still image) that he / she wants to move to a place different from the work site, i. The flow of processing when the drone 202 is controlled based on the information and shooting of the drone 202 is started and then moved to the work site and the video of another part is viewed while performing the work will be described. For example, it is assumed that there is a meter on the back side of the manufacturing apparatus A04 in FIG. 3, and the value of this meter is necessary for work such as inspection of the apparatus A04.

  A user using wearable terminal 10 goes to the back side of manufacturing apparatus A04 in FIG. 3 and observes the meter. In block B12, the user operates the camera 59 at the center of the frame of the wearable terminal 10 to photograph the meter. The captured image is projected onto the screen 16 by the projection device 12. In block B14, the user looks at the photographed image on the screen 16 and adjusts the photographing position and photographing direction, that is, the position and orientation of the face so that an optimum image can be obtained. When the camera 59 has a zoom function, an optimal image may be obtained by adjusting the focal length of the lens. The zoom adjustment may be performed by operating the touch pad 55 or the like. In the projection onto the screen 16, the brightness, color tone, angle, etc. can be adjusted by the switches 57, 58. However, when adjusted, the adjustment value is stored, and the same adjustment value is displayed when displaying the captured image of the drone 202. It may be configured to be applied.

  When a desired image is obtained, the user performs a shutter operation by operating the touch pad 55 or the like. When the shutter operation is performed, the CPU 140 of the wearable terminal 10 stores the captured image (still image) in the storage device 146 together with the shooting direction information at that time in block B16. The shooting direction information is obtained from the orientation of the face detected by the motion sensor 154, and is represented by a three-dimensional vector starting from the camera 59. Other examples of the shutter operation include inputting a voice command from the microphone 148, detecting the command by voice recognition, swinging the face in a predetermined direction, detecting a predetermined movement of the face by the motion sensor 154, a finger, There are cases where a hand is shaken in a predetermined direction, an image is taken by the camera 59, and a predetermined movement of a finger or hand is detected by image analysis.

  Thereafter, in block B18, the CPU 140 transmits the image and shooting direction information to the communication server 106 and requests drone shooting. That is, the shutter operation is a user operation that requests drone shooting. Thereafter, the user moves from the shooting location. For example, the user goes to the front side of the manufacturing apparatus A04 in FIG. 3 and performs maintenance inspection or restoration work.

  In the communication server 106, the position / state management unit 122 receives the outputs of the multiple optical sensors 62 in block B20, performs arithmetic processing, and the position of the wearable terminal 10 that requested drone shooting: shooting position (x, y, z) is detected.

  When the shooting position is detected, the shooting control unit 130 activates the drone 202 in block B24, and the shooting position detected in block B20 together with the shot image and shooting direction information transmitted from the wearable terminal 10 in block B36. Information is transmitted to the drone 202. The activation of the drone 202 may be performed not at the timing of the block B24 but at the transmission timing of the captured image, the imaging direction information, and the imaging position information of the block B36, or after that.

  When the drone 202 is activated in the block B32, the drone 202 receives the photographed image, the photographing direction information, and the photographing position information.

  The drone 202 flies to a position corresponding to the received photographing position information and stops at block B38. As a result, the user is no longer at the position of the wearable terminal 10 when the still image is taken, but the drone 202 is positioned at that place instead.

  Next, the drone 202 adjusts the orientation of the camera 156 in accordance with the received shooting direction information in block B40. As a result, the camera 156 of the drone 202 located at the same location as the position of the wearable terminal 10 when the still image is captured is in the same direction as the camera 59 of the wearable terminal 10 that captured the still image.

  In block B42, the drone 202 starts photographing with the camera 156. The still image included in the moving image photographed at this time should be the same as the image photographed by the wearable terminal 10. However, the degree may vary slightly depending on the position / photographing direction detection error of the wearable terminal 10 and the position / photographing direction control error of the drone 202, but may differ slightly from the image photographed by the wearable terminal 10. Therefore, the drone 202 or the communication server 106 calculates feature amounts of both images and executes feature amount matching to check whether or not both images match. Here, an example in which feature amount matching is executed by the drone 202 will be described. However, the communication server 106 may execute feature amount matching.

  In step B44, the drone 202 calculates the feature amount of the photographed image of the wearable terminal 10 transmitted from the communication server 106 and the feature amount of the image photographed in the block B42. According to the determination result, the position of the drone 202, the direction of the shooting camera 156, or other shooting conditions are adjusted as necessary, so that the same image as the image shot by the wearable terminal 10 is shot. .

  If the same image is obtained, the drone 202 transmits a video distribution notification to the communication server 106 in block B46. The communication server 106 transmits a video distribution notification to the wearable terminal 10 in block B48. When the wearable terminal 10 responds to the notification, the drone 202 starts video distribution at block B54, and the wearable terminal 10 starts video reception at block B56. The video distribution continues until the wearable terminal 10 transmits a termination request. The distributed video is projected on the screen 16 by the image processing unit 150.

  The wearable terminal 10 may have a function of remotely controlling shooting of the distributed video. For example, the user may want to see images of different shooting directions and different places depending on the progress of work. Specific examples of the shooting direction and shooting location adjustment operations include operations of the switches 57 and 58, operation of the touch pad 55, voice input, face motion, finger motion, and the like. In the case of voice input, the voice input from the microphone 148 is recognized and an adjustment command is detected. In the case of a face motion, the position and direction may be adjusted by moving up, down, left, and right, and zoom or the like may be adjusted by moving back and forth. In the case of a gesture operation, the movement of a finger is photographed by the camera 59, and when a specific gesture is recognized by analyzing the image, an adjustment command is detected.

  As described above, when the shooting position, shooting direction, and the like of the scene taken by the user by the camera 59 of the wearable terminal 10 are transmitted to the drone 202, the drone 202 moves to the same shooting position and has the same shooting direction. 202 cameras 156 are controlled. Therefore, the drone 202 shoots the site on behalf of the user only by shooting the site before the user leaves the site. The user can see the scenery ahead of the current line of sight through the lens on the left eye side of the wearable terminal 10, and at the same time, the image of the distant site being photographed by the drone 202 on the screen 16 on the right eye side. Can see. As a result, the operator does not have to leave the site after adjusting the camera such as a tripod so that a desired image can be taken, and can work while easily referring to images at different locations. This increases work efficiency. Moreover, since the shooting position, shooting direction, and the like of the two images are finely adjusted using the feature amount matching, the drone 202 can surely capture the same image as the image captured by the user with the wearable terminal 10.

  Although the drone 202 is used to photograph a place away from the user, it is not limited to the drone but may be another flying object, not only the flying object, but also a self-propelled object traveling on the ground or walking on the ground. A camera may be attached to the robot or the like.

  9 and 10 illustrate an example in which the user moves after setting the drone 202 so as to continuously capture an image captured by the user before the start of work. However, the use example of this system is not limited thereto. . Another usage example will be described with reference to the flowcharts of FIGS. This example is configured such that an image is selected from images stored in the image storage unit 128 of the communication server 106 and the drone 202 captures the same image as that image. According to this example, if the user specifies an image or a portion that the user wants to see without setting the drone 202 in advance, a necessary image is distributed.

  In block B102, the user operates the camera 59 in the center of the frame of the wearable terminal 10 to photograph the meter. The captured image is projected onto the screen 16 by the projection device 12. In block B104, the user looks at the photographed image on the screen 16 and adjusts the photographing position and photographing direction, that is, the face position and orientation so that an optimum image is obtained. When the camera 59 has a zoom function, an optimal image may be obtained by adjusting the focal length of the lens. The zoom adjustment may be performed by operating the touch pad 55 or the like. In the projection onto the screen 16, the brightness, color tone, angle, and the like can be adjusted by the switches 57 and 58. However, when the adjustment is made, the adjustment value is stored, and the same adjustment value is displayed when the captured image of the drone 202 is displayed. It may be configured to be applied.

  When a desired image is obtained, the user performs a shutter operation by operating the touch pad 55 or the like. When the shutter operation is performed, the CPU 140 of the wearable terminal 10 stores the photographed image (still image) in the storage device 146 together with the photographing direction information at that time and transmits it to the communication server 106 in block B106.

In the communication server 106, the position / state management unit 122 receives the outputs of the multiple optical sensors 62 in block B108, performs arithmetic processing, detects the position (x, y, z) of each wearable terminal 10, and I manage. When the captured image and the shooting direction information transmitted from the wearable terminal 10 are received, the image storage unit 128 reads the position information of the transmitting terminal from the position / state management unit 122 in block B112, and the received captured image and the shooting direction information. Along with other information, it is stored as a captured image database as shown in Table 1.

  The reason why a lot of information is stored in association with the image ID is to search for an image based on such information. The shooting direction is a three-dimensional vector starting from the shooting position in the previous example. The user ID indicates a photographer, and is stored for searching not only a photographed image of himself but also a photographed image of another person from the image database. The work position is uniquely derived from the shooting position, but is stored for convenience of search. The reason for storing thumbnail images as well as photographed images is to display a list of stored images.

  In any wearable terminal 10, the above-described operation is repeated, and a large number of captured images are accumulated in the image storage unit 128 of the communication server 106.

  In block B114, the CPU 140 of the wearable terminal 10 determines whether drone shooting is requested by operating the touch pad 55 or the like. If not, the process returns to block B102 and the accumulation of the captured image continues. During this time, the user may move.

  If drone shooting is requested, the CPU 140 requests the communication server 106 for an image selection menu in block B118.

  When receiving the drone shooting request, the communication server 106 activates the drone 202 in block B122, generates an image selection menu based on the shot image database, and transmits it to the wearable terminal 10.

  When the wearable terminal 10 receives the image selection menu, the image processing unit 150 projects the image selection menu onto the screen in block B126. Various selection menus are prepared and can be selected in advance or changed to another selection menu while the menu is displayed.

Selection menu example:
List of thumbnail images of the same user for the same device in different shooting directions List of thumbnail images of the same user for different devices in the same shooting direction List of thumbnail images related to the same device for the same user or a specific other user Same user Alternatively, a list of thumbnail images on a specific day of a specific other user The user selects any image in the menu. In addition to the operation of the touch pad 55, the selection operation includes inputting a voice command from the microphone 148, detecting the command by voice recognition, swinging the face in a predetermined direction, and detecting a predetermined movement of the face by the motion sensor 154. In other words, a finger or hand may be swung in a predetermined direction, photographed by the camera 59, and a predetermined movement of the finger or hand may be detected by image analysis. When any one of the thumbnail images is selected, the CPU 140 transmits the selection result to the communication server 106 in block B130.

  The selection menu may be a list of image attributes shown in Table 1 instead of a list of thumbnail images. For example, the text “Select the work device you want to see: (1) Device A, (2) Device B,...” Is displayed. Instead of the screen of “1) Front, (2) Back, (3) Upper right,...”, A list of attributes specifying the images may be displayed one after another.

  Upon receiving the selection result, the communication server 106 reads the shooting position and shooting direction information corresponding to the selected image from the captured image database of the image storage unit 128 in block B146. Alternatively, when an attribute is selected instead of an image, the imaging control unit 130 reads an image according to the selected attribute from the captured image database of the image storage unit 128 in block B146. Next, in block B <b> 148, the shooting control unit 130 transmits the image, shooting position information, and shooting direction information to the drone 202.

  The drone 202 is activated in block B138, and in block B150, the drone 202 flies to a position corresponding to the received photographing position information and stops. Thereby, the drone 202 is located at the place of the wearable terminal 10 when the image selected by the user in the selection menu is taken.

  Next, the drone 202 adjusts the direction of the camera 156 in accordance with the received shooting direction information in block B152. As a result, the camera 156 of the drone 202 located at the same location as the position of the wearable terminal 10 when the selected still image is captured is oriented in the same direction as the camera 59 of the wearable terminal 10 that captured the still image.

  In block B154, the drone 202 starts photographing with the camera 156. The still image included in the moving image photographed at this time should be the same as the image photographed by the wearable terminal 10. However, the degree may vary slightly depending on the position / photographing direction detection error of the wearable terminal 10 and the position / photographing direction control error of the drone 202, but may differ slightly from the image photographed by the wearable terminal 10. Therefore, the drone 202 or the communication server 106 calculates feature amounts of both images and executes feature amount matching to check whether or not both images match. Here, an example in which feature amount matching is executed by the drone 202 will be described. However, the communication server 106 may execute feature amount matching.

  In step B156, the drone 202 calculates the feature amount of the photographed image of the wearable terminal 10 transmitted from the communication server 106 and the feature amount of the image photographed in the block B42. According to the determination result, the position of the drone 202, the direction of the shooting camera 156, or other shooting conditions are adjusted as necessary, so that the same image as the image shot by the wearable terminal 10 is shot. .

  If the same image is obtained, the drone 202 transmits a video distribution notification to the communication server 106 in block B158. The communication server 106 transmits a video distribution notification to the wearable terminal 10 in block B162. When the wearable terminal 10 responds to the notification, the drone 202 starts video distribution at block B166, and the wearable terminal 10 starts video reception at block B168. The video distribution continues until the wearable terminal 10 transmits a termination request. The distributed video is projected on the screen 16 by the image processing unit 150.

  As described above, since the image storage unit 130 stores a large number of still images taken by the wearable terminal 10, when the user wants to view a video of a place where the user cannot actually see, such as the back side of the apparatus during work, By selecting an image close to the desired video from the stored images, the drone 202 captures the same image as that image and distributes it to the wearable terminal of the user. According to this example, since shooting of the drone 202 can be started before work, if the user selects an image and starts video distribution before the work, the user can view the necessary video as the work starts. Work efficiency is improved.

In the flowcharts of FIGS. 11 and 12, it has been described that when a drone shooting is requested, an image selection menu is displayed and the user makes a selection. However, selection may be unnecessary. For example, if the location to be referred to next is determined according to the work target device for each user or the user's schedule, the drone 202 is automatically controlled in accordance with that and the video to be referred to is shot. May be. The imaging control unit 130 may store a reference image database for each user as shown in Table 2, and may control the moving destination and imaging direction of the drone 202 according to the current work content.

  In addition, when the work procedure is finely determined as in periodic inspections, the schedule management unit 126 manages the work schedule for each user. Therefore, the moving destination and shooting direction of the drone 202 may be automatically determined sequentially according to the schedule.

  Even when the distribution video is automatically determined as described above, a selection menu may be displayed instead of the distribution video by a user operation.

  The glasses-type wearable terminal has been described as an embodiment, but other head-mounted types such as a goggle type and a helmet type may be used, and the present invention is applicable to a wristband type and a pendant type. For example, in the case of a helmet type or goggles type, the projection device 12 and the camera 59 can be attached to a helmet or goggles, and a normal glasses user can also be used. Furthermore, if the helmet type is used, the speaker 54 can be attached to the inside of the helmet, so that a clearer sound can be heard, the microphone can be attached to the helmet, and the position can be adjusted. improves.

  The present invention can also be applied to wearable terminals other than the head-mounted type.

  Furthermore, the present invention can be applied to a small and light portable device that is not wearable and always with the user, such as a notebook computer, a tablet computer, and a smartphone.

  The function sharing between the wearable terminal and the communication server is not limited as described above, and part of what is described as the function of the wearable terminal may be realized as the function of the communication server, or described as the function of the communication server. A part of the device may be realized as a wearable terminal function.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

  DESCRIPTION OF SYMBOLS 10 ... Wearable terminal, 12 ... Projection apparatus, 16 ... Screen, 54 ... Speaker, 55 ... Patch pad, 59 ... Camera, 62 ... Optical sensor, 106 ... Communication server, 114 ... Camera, 148 ... Microphone, 152 ... Wireless communication device 202 ... Drone.

Claims (18)

A wearable terminal that can change position and communicate with a housing having a first camera and can be worn on a user's head,
A second camera that captures an image along the user's line of sight;
A display unit that is positioned on the user's line of sight and that displays a captured image of the first camera or the second camera;
A first detecting means having a function of detecting the position and orientation of the wearable terminal, and detecting a shooting position and a shooting direction of the second camera;
A controller that moves the casing to a shooting position detected by the first detection unit and shoots an image by the first camera in a shooting direction detected by the first detection unit;
A wearable terminal comprising:   The wearable terminal according to claim 1, wherein the housing includes a walking robot, a self-propelled object, or a flying object. The controller is
A memory for storing shooting position information of the second camera;
Means for displaying one or more pieces of shooting position information stored in the memory on the display unit;
Selecting means for selecting one or a plurality of shooting position information displayed on the display unit based on a user operation,
The wearable terminal according to claim 1 or 2, wherein the housing is moved based on the photographing position information selected by the selection unit. The controller is
A memory for storing an image photographed by the first camera or the second camera and photographing position information of the image;
Means for displaying one or more images stored in the memory on the display unit;
Selecting means for selecting either one or a plurality of images displayed on the display unit based on a user operation,
The wearable terminal according to claim 1 or 2, wherein the casing is moved based on photographing position information of an image selected by the selection unit.   The selection means is provided in the wearable terminal, the detection result of the second detection means for detecting the movement of the wearable terminal, the operation of the touch panel or switch provided in the wearable terminal, and the wearable terminal. The wearable terminal according to claim 3 or 4, wherein the wearable terminal is selected based on at least one of voice inputs from a microphone.   6. The adjusting device according to claim 1, further comprising adjusting means capable of remotely controlling at least one of the position of the casing, the shooting direction of the first camera, and the shooting angle of view. The wearable terminal described. A second camera that can be repositioned and is communicable with a housing having a first camera, can be worn on the user's head, and captures an image along the user's line of sight; and on the user's line of sight Detecting a shooting position and a shooting direction of the second camera by detecting a position and a direction of a wearable terminal that is located and includes a display unit that displays a captured image of the first camera or the second camera; ,
Moving the housing to the detected shooting position and shooting an image with the first camera at the detected shooting position and the shooting direction;
A method comprising:   The method according to claim 7, wherein the housing is attached to any of a walking robot, a self-propelled object, and a flying object. Taking an image with the first camera
Storing the shooting position information of the second camera in a memory;
Displaying one or a plurality of shooting position information stored in the memory on a display unit attached to the wearable terminal and positioned on the line of sight of the user;
Selecting either one or a plurality of shooting position information displayed on the display unit based on a user operation;
9. The method according to claim 7, further comprising moving the housing based on the selected photographing position information. Taking an image with the first camera
Storing an image photographed by the first camera or the second camera and photographing position information of the image in a memory;
Displaying one or more images stored in the memory on a display unit attached to the wearable terminal and positioned on the user's line of sight;
Selecting either one or a plurality of images displayed on the display unit based on a user operation;
The method according to claim 7 or 8, further comprising moving the housing based on photographing position information of the selected image.   The selecting includes selecting based on at least one of movement of the wearable terminal, operation of a touch panel or switch provided in the wearable terminal, and voice input from a microphone provided in the wearable terminal. 11. A method according to claim 9 or claim 10 comprising.   The remote control of at least one of the position of the housing, the shooting direction of the first camera, and the shooting angle of view is further provided. the method of. A housing that can be repositioned and includes a first camera;
A second camera that is communicable with the housing and can be mounted on the user's head and captures an image along the user's line of sight; and is positioned on the user's line of sight, the first camera or the second A wearable terminal including a display unit that displays a captured image of the camera;
A first detecting means having a function of detecting the position and orientation of the wearable terminal, and detecting a shooting position and a shooting direction of the second camera;
A controller that moves the housing to a shooting position detected by the first detection means, and takes an image by the first camera at the shooting position and shooting direction detected by the first detection means;
A system comprising:   The system according to claim 13, wherein the casing includes any one of a walking robot, a self-running robot, and a flying robot. The controller is
A memory for storing shooting position information of the second camera;
Means for displaying one or more pieces of shooting position information stored in the memory on the display unit;
Selecting means for selecting one or a plurality of shooting position information displayed on the display unit based on a user operation,
The system according to claim 13 or 14, wherein the casing is moved based on the photographing position information selected by the selection means. The controller is
A memory for storing an image photographed by the first camera or the second camera and photographing position information of the image;
Means for displaying one or more images stored in the memory on the display unit;
Selecting means for selecting either one or a plurality of images displayed on the display unit based on a user operation,
The system according to claim 13 or 14, wherein the housing is moved based on photographing position information of an image selected by the selection means.   The selection means is provided in the wearable terminal, the detection result of the second detection means for detecting the movement of the wearable terminal, the operation of the touch panel or switch provided in the wearable terminal, and the wearable terminal. The system according to claim 15 or 16, wherein the selection is based on at least one of audio inputs from a microphone.   The wearable terminal further comprises adjustment means capable of remotely controlling at least one of the position of the casing, the shooting direction of the first camera, and the shooting angle of view. 18. A system according to claim 16 or claim 17.

Images