JPH04192067A - Commodity remote experience show-room system - Google Patents

Abstract

PURPOSE:To enable a user to gain artificial experience of external form confirmation or the like of a commodity by controlling a robot device, which is arranged in a commodity exhibition site, based on detection information of each detecting means of a user-side device and allowing the user to see the picture of a mounted television camera through a goggle type display device. CONSTITUTION:An arithmetic unit 7 for robot control generates a control signal, which controls a robot device 1 arranged in the commodity exhibition site, based on detection information of respective detecting means 3, 4 and 12 of the user-side device, and the robot device 1 is run and moved or directions of mounted television cameras 5A and 5B are turned to change the photographing direction or an arm part 10 is driven in accordance with the control signal. The user sees the photographed picture through a goggle type display device 2 to confirm the external form of a commodity as if he directly saw it, and he moves his hands to gain the experience of operation as if he actually operated the commodity through the arm part of the robot device. Thus, the user can gain artificial experience of operation, external form confir mation, or the like in a place other than the commodity exhibition site.

Description

DETAILED DESCRIPTION OF THE INVENTION [Industrial Application Field] The present invention relates to a product remote experience showroom system that allows users to experience a simulated experience of actually operating a product or seeing its appearance.

[Conventional technology]

In order to check the appearance of the actual products displayed in conventional showrooms or to experience the operation,
I had to go to that showroom.

[Problem to be solved by the invention]

However, if the showroom is located in a remote location, there is a problem in that it becomes a burden on customers and they have to endure just looking at catalogs and the like.

The present invention has been made in view of these problems, and its purpose is to enable the operation of products and the confirmation of their appearance at locations other than the product display location, even if they are located at the product display location or in a remote location. To provide a product remote experience showroom system that allows customers to have a simulated experience and give customers the same sense of satisfaction as when they actually come into contact with the product.

[Means to solve the problem]

In order to achieve the above-mentioned object, the present invention is arranged at a place where products are displayed, its movement is controlled by an external control signal, the photographing direction of the TV camera to be loaded can be controlled and changed, and the arm part is A driving robot device, a goggle-type display that is attached to the user's face and displays images from a television camera of the robot device, a detection means that is attached to the user and detects the user's three-dimensional position and the direction of the user's face; a user-side device comprising a detection means for detecting the position of the user's hand and the movement of the fingers; controlling the movement and running of the robot device based on information from each detection means of the user-side device; and controlling the shooting direction of the television camera. It consists of a robot control arithmetic unit that generates control signals for controlling the robot and controlling the drive of the arm.

[Effect]

According to the present invention, a control signal for controlling a robot control arithmetic unit or a robot device placed at a product exhibition hall is generated based on the detection information of each detection means of the user side device,
Depending on this control signal, the robot device can be moved, the direction of the TV camera mounted on it can be changed to change the shooting direction, and the arm can be driven. By viewing the image taken by the television camera on the robot device side through a goggle-type display, you can check the appearance of the product as if you were looking directly at it, and by moving your hand, you can see the image taken by the robot device's arm. You can get the experience of actually operating the product.

〔Example〕

The present invention will be explained below with reference to Examples.

FIG. 1 shows a schematic configuration of an embodiment of the present invention, which includes a robot device l placed in a product display area, a goggle-type display (hereinafter abbreviated as display) 2 to be worn on the user's face, and a data glove 3. and a user-side device consisting of a magnetic sensor 4, and an image transmission unit that receives video signals obtained by imaging by television cameras 5A and 5B mounted on the robot device l and sends the video signals to the display 2. 6, the data glove 3 and the magnetic sensor 4
The robot control arithmetic unit 7 takes in detection information from the robot device 1 and generates control signals for each part of the robot device 1.

The robot device l includes a traveling unit 8 that drives and rotates traveling wheels 8A in order to move on the floor of the product display area, and television cameras 5A that are arranged side by side on the left and right to obtain stereoscopic images corresponding to the left and right eyes of a person. , 5B and this TV camera 5A,
5B is supported and mounted on the traveling unit 8,
It is composed of a camera direction control section 9 that changes and controls the photographing direction of the television cameras 5A and 5B, and an arm section 10 that can drive and control the fingertips and arm sections to resemble human hands, and the configuration of each section. uses a conventionally known structure.

The goggle-type display 2 of the user-side device has a goggle-type main body with small liquid crystal displays arranged corresponding to the left and right eyes, and images projected on the left and right liquid crystal displays are displayed at the viewing angle of the user M. It is designed to be spread out, and the images taken by TV cameras 5A and 5B, which are installed in parallel on the left and right corresponding to both eyes, are displayed on the liquid crystal displays on both sides, so that user M can see a 3D image. Become.

Data Glove 3 is glove-shaped, and a three-dimensional sensor is installed on the back of the hand to detect the movement and position of the hand, and optical fiber cables are installed in the parts corresponding to each floor, and the bending angle of the fingers is It is possible to extract the change in the amount of light passing through the optical fiber cable as a change in the amount of light passing through the optical fiber cable, and the detection output is transmitted to the arithmetic unit 7 for robot control. Note that a well-known structure is used in terms of structure.

The magnetic sensor 4 is attached to the head of the user M, and detects a total of six coordinates of the three-dimensional position of the user M in the room and the direction of the face based on output changes within the magnetic field of the space such as the room where the user M is present. The detection output of the magnetic sensor 4 is transmitted to the 6-bot control arithmetic unit 7 through the magnetic sensor unit 11.

The robot control calculation bag f17 determines the hand movements and fingertip movements of the user M based on the detection output from the data glove 3, and generates a control signal for the arm section 10 of the robot device l.

Further, the photographing direction of the television cameras 5A, 5B of the robot device l and the traveling movement position of the traveling unit 8 are calculated and determined from the position of the user M and the direction of the face based on the detection output from the magnetic sensor unit 11, Generate respective control signals.

These generated control signals are transmitted to the robot device l at the product display area via a transmission line.

In the system of the present invention, the day glove 3 and the magnetic sensor 4 of the user side device detect the hand movement of the user M, the three-dimensional position of the user M, and the direction of the face, and based on the detected information, The robot control arithmetic unit 7 generates a control signal to control the robot device l placed in the product exhibition hall, and in response to this control signal, the robot device 1 moves the traveling unit 8 to a predetermined position, You can change the shooting direction of the mounted TV cameras 5A and 5B, or
The images taken by the television cameras 5A and 5B are transmitted to the user side device through the image transmission unit 6, and the goggle-type display 2 is attached to the face of the user M.
will be displayed on the screen. In this way, the user M can see the image in the direction facing his/her face through the goggle-type display 2, and can also view the image taken while moving closer to or away from the product depending on the moving position. Therefore, you can check the appearance of the product as if you are looking at it with your mouth, and by moving your hands, you can get the experience of actually manipulating the product through the arm part 10 of the robot device 1. However, if the location where the robot device 1 is placed is close to the location of the user M, the video signal may be directly transmitted without providing the image transmission unit 6. In addition, when moving the robot device 1 over a wide range, the joystick 1 is used to reduce the burden on the user M.
2 may be used to control the movement of the traveling unit IO.

By the way, as shown in FIG. 2, there are showrooms scattered all over the place, and if you want to simulate operating or viewing products from other showrooms in each showroom, the robot devices 11 to 11 are installed in each of the showrooms A1 to A. 1, and user-side devices 81-B, and a transmission unit 13 is provided at the head office, etc., and the robot devices 1, - of each showroom 80-A are transmitted through this transmission unit 13.
If the video signals from 1 and the control signals from user devices 81 to B are switched and relayed to each robot device 11 to 1, the products displayed in showrooms A1 to A in various places can be You can have a simulated remote experience in any of the showrooms A1 to A9.

[Effects of the Invention] The present invention provides a robot that is placed in a place where products are displayed, whose movement is controlled by an external control signal, and which can control and change the photographing direction of a TV camera to be loaded, and which drives an arm part. The device includes a goggle-type display that is attached to the user's face and displays images from the robot device's television camera, a detection means that is attached to the user and detects the user's three-dimensional position and the direction of the user's face, and the user's hand. a user-side device comprising a detection means for detecting the position of the user-side device and the movement of the finger; control of the movement of the robot device based on information from each detection means of the user-side device; control of the shooting direction of the television camera; Consisting of a robot control computing device that generates control signals for controlling the drive of the arm, the robot control computing device is placed in the product exhibition hall based on the detection information of each detection means of the user side device. It is capable of generating control signals to control the robot device that is being used, and depending on these control signals, the robot device can be moved, or the direction of the mounted television camera can be changed to change the shooting direction. The user can change the appearance of the product and drive the arm, so by viewing the image taken with a TV camera or through a goggle-type display, the user can check the appearance of the product as if they were looking directly at it with their mouth, and they can also see it with their hands. By moving the robot, you can experience the feeling of actually manipulating the product through the arm of the robot device. As a result, you can simulate operating the product and checking its appearance outside of the product display area, giving customers the opportunity to experience the product in real life. This has the effect of giving the same sense of satisfaction as when touching the product.

[Brief explanation of the drawing]

FIG. 1 is a schematic configuration diagram of an embodiment of the present invention, and FIG. 2 is an explanatory diagram of a developed example of the same. 1 is a robot device, 2 is a goggle type display, 3 is a data glove, 4 is a magnetic sensor, 5A, 5B are television cameras, 6 is an image transmission unit, 7 is a robot control arithmetic unit, 8 is a travel unit, 9 is a camera direction control unit, l
O is an arm portion, 11 is a magnetic sensor unit, and 12 is a joystick.

Claims (1)

[Claims] 1) A robot device that is placed in a place where products are displayed, whose movement is controlled by an external control signal, and which can control and change the shooting direction of the loaded TV camera, and which drives an arm, and a robot device that moves on the user's face. A goggle-type display that is worn on the robot device displays images from the television camera of the robot device, a detection means that is worn on the user and detects the user's three-dimensional position and facial direction, and a detection means that is worn on the user to detect the user's three-dimensional position and facial direction, and a detection means that detects the user's hand position and finger movements. a user-side device comprising a detection means for detecting; and controlling the movement and running of the robot device, controlling the photographing direction of the television camera, and controlling the drive of the arm portion based on information from each detection means of the user-side device. A product remote experience showroom system comprising a robot control arithmetic unit that generates control signals for a robot.