WO2017047527A1

WO2017047527A1 - Fitness device and fitness system

Info

Publication number: WO2017047527A1
Application number: PCT/JP2016/076689
Authority: WO
Inventors: 藤代　一朗
Original assignee: コニカミノルタ株式会社
Priority date: 2015-09-15
Filing date: 2016-09-09
Publication date: 2017-03-23
Also published as: JPWO2017047527A1

Abstract

A fitness device (1) is provided with a movable member (2), a floating image display device (4), and a contactless input device (5). The movable member (2) is displaced as a user exercises. The floating image display device (4) displays an image of an input screen (M) in mid-air for inputting settings for the fitness device (1). The contactless input device (5) receives the input of settings by contactlessly detecting an indicator at a prescribed position in the input screen (M) displayed in mid-air.

Description

Fitness equipment and fitness system

The present invention relates to a fitness device that promotes user exercise and a fitness system including the fitness device.

Conventionally, devices such as treadmills and fitness bikes (bicycle fitness devices) are known as fitness devices. A fitness device is usually provided with an input unit (operation unit) for a user to input device settings and a display unit for displaying the user's exercise status. For example, in the treadmill, the moving speed and inclination of the movable member (belt) are set by the input at the input section, and the display section displays the distance traveled and the travel time when the user is running Is done. The input unit and the display unit can be integrally configured by a touch panel display device (hereinafter also abbreviated as a touch panel).

An example of such a fitness device is disclosed in Patent Document 1. In Patent Document 1, during the exercise of a user who uses a fitness device, graphical information (for example, the inclination of the movable member) displayed on the display unit when the inclination of the movable member increases or the moving speed increases. By changing the display position of the LED bar indicating the change in the screen to the upper part of the screen and enlarging the display size, the visibility of the display information is improved. In addition, by enlarging the display icon on the touch panel, it is likely that input will be easier on the touch panel even during intense exercise.

JP 2013-211004 A (refer to claim 1, paragraphs [0055] to [0057], FIG. 1, FIG. 8 to FIG. 11, etc.)

In a conventional fitness device, an input unit, a display unit, a touch panel, and the like are provided at positions that do not hinder the user's exercise, that is, at positions away from the user so as not to contact the user during exercise. For this reason, for example, when the user tries to change the setting of the device while exercising, the user needs to operate the input unit and the touch panel while losing his / her posture, and the convenience of the device is reduced. In addition, since all users who use the fitness device touch the input unit and touch panel, the sweat of the previous user may be attached to the input unit, etc. There were also psychological discomforts.

The present invention has been made to solve the above-described problems, and its purpose is to facilitate input during exercise of the user while avoiding that the devices constituting the apparatus interfere with the exercise of the user. It is an object of the present invention to provide a fitness device that can improve the convenience of the device and is excellent in hygiene, and a fitness system equipped with the fitness device.

A fitness device according to one aspect of the present invention is a fitness device having a movable member, and the movable member is displaced in accordance with a user's exercise, and displays an input screen for inputting settings of the fitness device. And an aerial video display device that displays in the air, and a non-contact input device that detects an indicator at a predetermined position on the input screen displayed in the air and receives the setting input.

A fitness system according to another aspect of the present invention accumulates the exercise information of the user obtained based on the displacement of the movable member transmitted from the fitness device and the fitness device via a communication line, It has a management server to manage.

According to the above configuration, the aerial video display device and the non-contact input device are arranged at positions where they do not come into contact with the user who is exercising, and only the input screen is displayed as video in front of the user for input. It is possible to perform setting input based on position detection, that is, detection of an indicator at a predetermined position on the input screen. Thereby, while avoiding that the device which comprises an apparatus obstructs a user's exercise | movement, the input during the user's exercise | movement with respect to an input screen can be made easy, and the convenience of an apparatus can be improved. In addition, since the input screen displayed in the air is a video image, the user's sweat does not adhere to the input screen when inputting to the input screen, and a device with excellent hygiene can be realized.

It is the perspective view which looked at the fitness apparatus which concerns on one Embodiment of this invention from diagonally backward. It is explanatory drawing which simplifies and shows the structure of the said fitness apparatus. It is a perspective view which shows an example of the input screen displayed in the air by the said fitness equipment. It is a block diagram which shows the structure of the control system of the said fitness apparatus. It is a perspective view which shows typically the outline structure of the aerial video display device of a corner mirror system which is an example of the aerial video display device with which the said fitness apparatus is provided. It is a perspective view of the mirror element contained in one optical panel when the said aerial image display device is comprised by bonding together two optical panels. It is a perspective view of the mirror element contained in the other optical panel. It is explanatory drawing which shows the imaging principle of the real image in two dimensions. It is explanatory drawing which shows typically reflection of the light ray in three-dimensional space. It is explanatory drawing which shows typically a mode that the several light ray emitted from the point light source condenses to one point via a separate reflective surface in three-dimensional space. It is explanatory drawing which shows typically the outline structure of the aerial image display device of a concave mirror system which is another example of the aerial image display device. It is explanatory drawing which shows typically the structure of the outline of the hologram type aerial image display device which is another example of the aerial image display device. It is explanatory drawing which shows one structural example of the non-contact input device with which the said fitness apparatus is provided. It is explanatory drawing which shows an example of the ellipse pattern fitted in a three-dimensional space. It is explanatory drawing which shows the other example of the said elliptical pattern. It is a block diagram which shows the other structure of the said fitness apparatus. It is explanatory drawing which shows typically the luminance change of a user's face surface, and the luminance waveform of a green component. It is a perspective view which shows the other example of the said input screen. It is explanatory drawing which shows the structure of the outline of the fitness system containing the said fitness apparatus. It is a block diagram which shows the schematic structure of the management server which the said fitness system has. It is explanatory drawing which shows an example of the statistics produced in the said management server.

An embodiment of the present invention will be described below with reference to the drawings. In this specification, when the numerical range is expressed as a to b, the numerical value range includes the values of the lower limit a and the upper limit b. The present invention is not limited to the following contents.

[Configuration of fitness equipment]
FIG. 1 is a perspective view of a fitness device 1 according to the present embodiment as viewed obliquely from the rear, and FIG. 2 is an explanatory diagram showing a simplified configuration of the fitness device 1. Note that the front and rear, left and right, and top and bottom directions shown below refer to the front and back, left and right, and top and bottom directions as viewed from the user using the fitness device 1.

The fitness equipment 1 is, for example, a treadmill (running machine, wakening machine), and includes a movable member 2, a display element 3, an aerial video display device 4, and a non-contact input device 5. The user's movement is promoted and supported by the displacement of the movable member 2 accompanying the movement. The movable member 2, the display element 3, the aerial video display device 4, and the non-contact input device 5 are accommodated or supported in a substantially L-shaped device body 1a as viewed from the side.

The movable member 2 is, for example, an endless belt, and is supported on the bottom 1a ₁ of the device main body 1a. When the user runs on the movable member 2 or walks, the movable member 2 is displaced (moved, circulated), and the user's movement is promoted. The load of the movable member 2 is adjusted by the drive mechanism 2a (see FIG. 4) based on a setting input on an input screen M described later.

The display element 3 displays an object image (the same image as an input screen M to be described later) as a source of an image displayed in the air by the aerial image display device 4 and emits light (image light) corresponding to the display image. For example, a liquid crystal panel (LCD) or an organic EL (Electro-Luminescence) display device is used. The display element 3 is disposed inside the housing 1a ₂ of the device main body 1a. The casing 1a ₂ is supported by two

leg portions

1a ₃ and 1a ₃ rising upward from the left and right positions in front of the bottom portion 1a ₁ .

The aerial video display device 4 is a device that displays an input screen M for inputting settings of the fitness equipment 1 as a video in the air. Although details of the aerial video display device 4 will be described later, when the aerial video display device 4 is configured by, for example, a corner mirror type display device, the aerial video display device is in a direction perpendicular to the display surface of the display element 3. The aerial video display device 4 is arranged so that the light incident surface 4 of FIG. 4 is tilted at an angle of 45 °, so that the aerial video display device 4 is positioned in a plane symmetrical with the display element 3 with respect to the aerial video display device 4. The input screen M can be displayed in the air between the device 4 and the user. Accordingly, by appropriately setting the arrangement position of the display element 3 and the aerial video display device 4 in the housing 1a ₂ (the distance to each other and the angle with respect to the bottom 1a ₁ ), the user can easily visually recognize the front, And the input screen M can be displayed in the position where it is easy to input.

FIG. 3 shows an example of the input screen M described above. Settings of the fitness device 1 include the moving speed, load, and inclination of the movable member 2 as well as whether or not a television screen or advertisement is displayed and whether or not audio information is output. The input screen M includes an input button 6 for inputting the above settings. The input button 6 includes various operation keys such as a numeric keypad (numerical value input key), UP / DOWN key, selection key, start key, and stop key. In addition, information necessary for calculation of calorie consumption such as the user's weight and age can also be input via the input button 6. Since the input screen M is a video, the input button 6 included in the input screen M is also a video.

Also, the input screen M can display the input settings of the fitness device 1 and the current exercise status of the user. Examples of the state of exercise include travel distance, average speed, travel time, and calorie consumption (estimated from weight and travel distance). Further, if a landing sensor is built in the movable member 2, the number of steps, step length, pitch, and the like can be displayed based on information from the landing sensor.

The non-contact input device 5 is a device that detects the indicator V at a predetermined position on the input screen M displayed in the air by the aerial video display device 4 in a non-contact manner and receives a setting input. As the non-contact input device 5, a device that detects the indicator V in a non-contact manner by moving object detection using infrared rays can be used. Since the user cannot visually recognize the infrared rays, the infrared rays can be used for position detection (detection of the pointing object V at a predetermined position), thereby performing position detection without being noticed by the user. Details of the non-contact input device 5 will be described later. The indicator V for designating the input position may be a user's finger or a pen.

FIG. 4 is a block diagram showing the configuration of the control system of the fitness device 1. In addition to the movable member 2, the display element 3, the aerial image display device 4, and the non-contact input device 5, the fitness device 1 includes a drive mechanism 2 a, a storage unit 7, a time measuring unit 8, a communication unit 9, and a control unit 10 ( Device side control unit). The control unit 10 is composed of a CPU (Central Processing Unit) that controls the operation of each unit of the fitness device 1 and executes an operation program stored in the storage unit 7 to operate each unit.

The drive mechanism 2a includes a motor and a roller, and drives the movable member 2. The drive mechanism 2 a includes a mechanical adjustment mechanism that adjusts the inclination of the movable member 2. The controller 10 can set the moving speed, load, and inclination of the movable member 2 to predetermined values by driving the drive mechanism 2a based on information detected by the non-contact input device 5.

The storage unit 7 is a memory that stores information acquired by the fitness device 1 and a program for operating the control unit 10, and includes a RAM, a ROM, a nonvolatile memory, and the like. The information acquired by the fitness device 1 is input on the user's exercise information (for example, travel distance) obtained based on the displacement of the movable member 2 on the input screen M and detected by the non-contact input device 5. Various settings of the fitness device 1 and information (for example, date and time of travel) acquired by the time measuring unit 8 are included.

If the amount of movement of the movable member 2 per rotation of the roller of the drive mechanism 2a is obtained in advance, the amount of movement of the movable member 2 based on the number of rotations of the roller, that is, the travel distance during the movement of the user. Can be sought. The control unit 10 described above includes an arithmetic circuit that obtains a travel distance based on the number of rotations of the roller.

The timer unit 8 is a timer for measuring time, and for example, measures the date and time of the user's exercise and the user's exercise time (for example, travel time). The communication unit 9 is an interface for transmitting and receiving information between the fitness device 1 and an external device (for example, the management server 120 or the external terminal device 130 illustrated in FIG. 18).

According to the above configuration, when an image that is the source of the input screen M is displayed on the display surface of the display element 3, the image light from the display element 3 is guided to the air via the aerial image display device 4. Thereby, the input screen M for inputting the settings of the fitness device 1 is displayed in the air as a video. Since the input position on the input screen M (indicator V at the predetermined position) is detected by the non-contact input device 5, the user sets the input position by placing a finger at the predetermined position on the displayed input screen M or the like. By specifying, the setting input of the fitness device 1 is accepted. The control unit 10 operates each unit of the fitness device 1 such as driving the driving mechanism 2 a based on the input received by the non-contact input device 5.

As described above, the aerial video display device 4 displays the input screen M in the air, and the non-contact input device 5 detects the indicator V at a predetermined position on the input screen in a non-contact manner, thereby displaying the aerial video display. While the device 4 and the non-contact input device 5 (hereinafter collectively referred to as a device) are arranged at positions where they do not come into contact with the user during exercise, only the input screen M is displayed in the air while the user is exercising. It can be arranged (displayed) at a position where it is easy to input (for example, a position near the user in front of the user during exercise). Thereby, it is possible to facilitate input during the user's exercise on the input screen M without interfering with the user's exercise by the device (the user can perform the input without greatly losing the posture even during the exercise). ), The convenience of the fitness device 1 can be improved. Since the input screen M is an image, even if the input screen M overlaps with an exercising user, the user's exercise is not hindered. Further, since the input screen M is displayed in the air as a video (real image), the user can easily visually recognize the input screen M displayed in the air without wearing special glasses.

In particular, since the input screen M is displayed in the air between the aerial video display device 4 and the user, the user can view the input screen M displayed in the air by looking at the direction of the aerial video display device 4. It can be visually recognized with certainty. Moreover, since the input screen M does not overlap with the user, the user can always visually recognize the input screen M even during exercise.

In addition, by performing input on the input screen M displayed in the air, the user can perform input without touching any device that physically exists. Moreover, since the input screen M is an image, the user's sweat does not adhere to the input screen M when inputting to the input screen M. Thereby, the fitness apparatus 1 excellent in hygiene can be realized, and psychological discomfort (psychological resistance) can also be reduced.

[Details of aerial video display device]
(Corner mirror method)
The aerial video display device 4 described above can be configured by a corner mirror type display device. The corner mirror method is a method of displaying an image (input screen M) in the air by guiding the image light from the display element 3 to the air through a plurality of reflecting surfaces orthogonal in a plan view. In the corner mirror method, the resolution of an image displayed in the air is high and distortion is less than that of a concave mirror method and a hologram method, which will be described later, so that a high-quality image can be visually recognized by the user. The corner mirror type display device includes a two-layer type in which the plurality of reflective surfaces are formed in separate layers and a single-layer type in which the reflective surfaces are formed in the same layer, but the display principle is the same. Either may be adopted. Hereinafter, a two-layer type display device will be described as an example.

FIG. 5 is a perspective view schematically showing a schematic configuration of the aerial video display device 4. The aerial video display device 4 is configured by bonding two

optical panels

20 and 30 together. One optical panel 20 has a plurality of mirror elements 21 arranged in one direction (for example, the X direction) of two directions perpendicular to each other within a plane perpendicular to the stacking direction (for example, the Z direction) of the

optical panels

20 and 30. It is formed by adhering with an adhesive. The other optical panel 30 is formed by arranging a plurality of mirror elements 31 in the other direction (for example, the Y direction) of the two directions and bonding them with an adhesive.

FIG. 6 is a perspective view of one mirror element 21. The mirror element 21 has a rectangular parallelepiped transparent substrate 21a. The transparent substrate 21a extends in the Y direction, and a reflective film 21b is formed by vapor deposition on one of two opposing surfaces (for example, two surfaces along the YZ surface). The reflective film 21b may be formed on both opposing surfaces of the transparent substrate 21a.

FIG. 7 is a perspective view of one mirror element 31. The mirror element 31 has a rectangular parallelepiped transparent substrate 31a. The transparent substrate 31a extends in the X direction, and a reflective film 31b is formed by vapor deposition on one of two opposing surfaces (for example, two surfaces along the ZX surface). Note that the reflective film 31b may be formed on both opposing surfaces of the transparent substrate 31a.

By arranging a plurality of mirror elements 21 extending in the Y direction adjacent to each other in the X direction, the plurality of reflective films 21b are arranged side by side in the X direction at intervals corresponding to the width of the mirror element 21 in the X direction. Similarly, by arranging a plurality of mirror elements 31 extending in the X direction so as to be adjacent to each other in the Y direction, a plurality of reflection films 31b are arranged side by side in the Y direction at intervals corresponding to the width of the mirror element 31 in the Y direction. . With the arrangement of the plurality of

mirror elements

21 and 31, the reflective film 21b (reflective surface) of each mirror element 21 and the reflective film 31b (reflective surface) of each mirror element 31 are viewed in plan view (from the Z-axis direction). (See) and the positional relationship is orthogonal to each other.

It should be noted that spacers for making the mutual adhesive thickness uniform may be integrally formed on each mirror element 21. Similarly, each mirror element 31 may be integrally formed with a spacer for making the mutual adhesive thickness uniform.

By using the aerial image display device 4 having the above configuration, an image can be formed in the air. Hereinafter, the imaging principle will be described.

FIG. 8 shows the imaging principle of a real image in two dimensions (in the ZX plane). A plurality of light rays emitted from the point light source P are respectively reflected by a reflecting surface (reflective film 21b) parallel to the Z axis, and a position P ′ opposite to the point light source P with respect to the X axis (point light source P and Condensed at a position symmetrical to the X axis). Thereby, a real image of the point light source P is formed at the position P ′.

FIG. 9 schematically shows the reflection of light rays in a three-dimensional space (XYZ coordinate system). In the three-dimensional space, the light beam A emitted from the point light source O is decomposed into a light beam a1 in the ZX plane and a light beam a2 in the YZ plane, and the ZX plane of the respective light beams a1 and a2 according to FIG. By considering the reflection in the inner or YZ plane, the intersection of the ray A with the Z axis can be obtained. That is, the light ray a1 in the ZX plane is reflected by the reflective surface (reflective film 21b) parallel to the YZ plane and then goes to the Z axis, and the light ray a2 in the YZ plane is reflective surface (reflective) parallel to the ZX plane. After being reflected by the film 31b), it goes to the Z axis. These light rays a1 and a2 intersect at one point on the Z axis, that is, at the point O '. Therefore, the light ray A is reflected twice by the reflective film 21b and the reflective film 31b, and then travels toward the point O 'on the Z axis.

FIG. 10 schematically shows a state in which a plurality of light rays emitted from the point light source O are condensed at one point through different reflecting surfaces in a three-dimensional space. A plurality of light rays emitted from the point light source O are reflected by the reflecting surface (reflecting film 21b) parallel to the YZ plane and the reflecting surface (reflecting film 31b) parallel to the ZX plane in the same manner as in FIG. Focus on the same point O ′ above. Thereby, a real image of the point light source O is formed at the point O ′.

That is, when the display element 3 is arranged at the position of the point light source O, the image light from the display element 3 is sequentially reflected by the plurality of reflecting

surfaces

21b and 31b orthogonal to each other in plan view and guided into the air, and the point light source O ′. Concentrate at the position of. Thereby, the real image (input screen M) of the display image of the display element 3 is displayed at the position of the point light source O ′.

Actually, there is a deviation in the light collection state due to the deviation of the incident position of the light beam in the height direction (Z-axis direction) of each reflection surface, the arrangement accuracy of each reflection surface, and the like. It should be small enough to be ignored in observation. In addition, some of the light rays follow a complicated path that is reflected three times or more on each reflecting surface, but such light rays can be ignored.

(Concave mirror system)
The aerial video display device 4 may be a concave mirror type display device. The concave mirror method is a method of displaying an image (input screen M) in the air by guiding the image light from the display element 3 to the air through the concave mirror. Since the concave mirror is available at a low cost, the aerial image display device 4 can be realized at a lower cost than the corner mirror method or the hologram method. As such a concave mirror type aerial image display device 4, for example, a display device disclosed in US Pat. No. 6,817,716 can be used.

FIG. 11 is an explanatory diagram showing a schematic configuration of the aerial image display device 4 of the concave mirror type disclosed in the above publication. The image light from the display element 3 enters the half mirror 41, a part of the image light is transmitted through the half mirror 41, and the remaining image light is reflected by the half mirror 41. The image light reflected by the half mirror 41 is reflected by the concave mirror 42 and enters the half mirror 41 again. Then, the image light transmitted through the half mirror 41 is guided into the air. Thereby, the real image (input screen M) of the image displayed on the display element 3 is displayed in the air.

(Hologram method)
The aerial video display device 4 may be a hologram type display device. That is, the aerial image display device 4 may include a hologram generation unit that generates a hologram image of the input screen M, and may be a device that displays the hologram image in the air. By using the hologram image, it is possible to display an image having a depth (three-dimensional effect). Therefore, for example, a three-dimensional video display is facilitated, for example, by giving unevenness to each input button 6 of the input screen M to give a stereoscopic effect. As such a holographic aerial image display device 4, for example, a display device disclosed in US Patent Publication No. 2014/0033052 can be used. In addition, when the aerial video display device 4 is a hologram system, the display element 3 is unnecessary (since the aerial video display device 4 has a spatial light modulator).

FIG. 12 is an explanatory diagram showing a schematic configuration of the hologram-type aerial image display device 4 disclosed in the above publication. The hologram generation unit 51 includes a light source and a spatial light modulator (SLM). The light representing the hologram image generated by the hologram generation unit 51 is reflected by the concave mirror 52, then enters the plane mirror 54 via the V-shaped prism 53, is reflected there, and then passes through the concave mirror 55 in the air. Led to. Thereby, the hologram image (input screen M) is displayed in the air. It is possible to adjust the focus of the hologram image by moving the V-shaped prism 53. In addition, the hologram generation unit 51 generates different hologram images corresponding to the left and right eyes of the user, and rotates the plane mirror 54 by a minute angle (for example, 3 °) about the axis 54a. Different hologram images can be viewed with the left and right eyes.

[Details of non-contact input devices]
Next, the details of the non-contact input device 5 will be described. As the non-contact input device 5 that performs moving object detection using infrared rays, for example, a known device such as Kinect (registered trademark) of Microsoft Corporation or LEAP MOTION (registered trademark) controller of Leap Motion Corporation can be used. Although these devices are small in size, highly accurate position detection is possible.

There are two types of Kinect (registered trademark): a sensor that employs a Light Coding method and a sensor that employs a TOF (Time of Flight) method. The former sensor has an IR projector that projects an infrared pattern and an IR camera that reads the projected infrared pattern. The infrared pattern projected on the moving object is photographed by the IR camera (calibrated at the time of factory shipment). The depth (position) of each point on the image is calculated by triangulation.

That is, in the Light-Coding method, position detection is performed in two stages, “Calibration (preparation)” and “Test (actual shooting)”. In “Calibration”, a simple and accurate object (such as a plane or a cube) is captured for a known pattern with the parameter “how much the point in the pattern moves (shifts), how much the depth changes”. To obtain in advance. In the “test”, the position of each point of the captured image corresponding to the known pattern is obtained by image processing (such as template matching), and then the pixel obtained from the parameters obtained in “calibration”. Calculate the depth of.

On the other hand, the latter sensor (TOF type sensor) includes a projector that projects pulse-modulated infrared light and an infrared camera, and measures the time when the infrared light projected on the moving object is reflected back. The distance (position information) to each point of the moving object is obtained from the above time and the moving speed of infrared rays.

As shown in FIG. 13, the LEAP MOTION (registered trademark) controller includes three

light sources

61a, 61b, and 61c that emit infrared rays, a left camera 62L disposed between the

light sources

61a and 61b, and a light source. And a right camera 62R disposed between 61b and 61c. A three-dimensional space 63 (Visual Hull) shielded by the outer shape of the finger is calculated from images taken by the left camera 62L and the right camera 62R. When the cross section 64 of the fingertip or the pen tip is considered as an elliptical shape, when the elliptical shape fits in the three-dimensional space 63, the position of the ellipse can be detected as the position of the fingertip or the pen tip.

Here, as an elliptical pattern that fits in the three-dimensional space 63, two patterns shown in FIGS. 14A and 14B are conceivable. However, considering the shape and structure of fingers, pens, etc. (the ratio of the length of the major axis to the minor axis of the cross-sectional ellipse), the ellipse is uniquely determined as the pattern of FIG. 14A and the pattern of FIG. 14B is excluded. . Therefore, by calculating the three-dimensional space 63 and grasping the position of the ellipse that fits in the three-dimensional space 63, the input position by the fingertip or the pen tip can be detected at high speed and with high accuracy.

[Other configurations of fitness equipment]
FIG. 15 is a block diagram showing another configuration of the fitness device 1. The fitness device 1 may be configured to further include at least one of the directional acoustic system 11 and the biological information detection unit 12 in addition to the configurations illustrated in FIGS. 2 and 4.

The directional acoustic system 11 is a system that provides audio information only to a user who is using the fitness device 1, and a range in which the audio information is provided is limited to the user (directivity is very narrow). ). As such a directional acoustic system 11, for example, a Yamaha TLF speaker (such as TLF-SP1-B2X1) or a Mitsubishi Electric Engineering directional acoustic system (such as MSP-50E-1) can be used. The sound information includes not only music, TV sound, and radio sound, but also sound of exercise information (traveling speed and distance) of a user who is currently exercising, sound of advertisement (promotion), and the like. The setting of whether or not to provide audio information and the selection of audio information to be provided can be performed by the user by inputting on the input screen M.

The directional acoustic system 11 provides audio information only to the user who uses the fitness device 1, and for example, the audio information is not provided to the user who uses the adjacent device. Therefore, the user can listen and enjoy the voice information casually and freely without paying attention to the surroundings.

The biological information detection unit 12 is a mechanism that detects the biological information of the user in a non-contact manner. The biological information includes at least one of information on a user's heart rate (pulse rate), blood pressure, and blood flow. The detected biological information may be displayed in the air on the input screen M or side by side with the input screen M by the aerial video display device 4, stored in the storage unit 7, or via the communication unit 9. It may be sent to an external server.

Here, in the detection of the pulse, for example, “technology for measuring a pulse in real time from a face image” developed by Fujitsu Laboratories Ltd. may be applied to the biological information detection unit 12. In this case, the biometric information detection unit 12 includes an imaging unit (camera) that captures a user's face image and a calculation unit that calculates biometric information (pulse rate) by calculation processing using data of the captured image. The

FIG. 16 schematically shows the luminance change of the user's face and the luminance waveform of the green component. The above technology, developed by Fujitsu Laboratories, Ltd., was taken with a camera to capture changes in the brightness of the facial surface thought to be caused by blood flow, focusing on the characteristic that hemoglobin contained in blood absorbs green light. The average value of the color components (red component, green component, blue component) of the face area is obtained for each acquisition frame from the moving image of the user's face, and the noise common to the three color components is removed, and the green component Extract a luminance waveform for. Then, the pulse rate is calculated from the number of peaks of the luminance waveform of the green component. Thereby, the pulse measurement in a short time becomes possible. In addition to the above, the pulse rate may be detected in a non-contact manner by applying a non-contact pulse wave detection technology developed by Asahi Kasei Corporation's Fusion Solution Laboratory to the biological information detection unit 12.

As for blood flow, for example, a non-contact type laser blood flow meter (for example, FLO-N1) manufactured by Neuroscience Co., Ltd., a laser speckle blood flow imaging device (for example, PeriCam PSI) manufactured by Integral Co., Ltd. By using as, it is possible to detect the blood flow of the user in a non-contact manner.

Regarding blood pressure, for example, by using the device described in Japanese Patent Application Laid-Open No. 2015-054223 or Japanese Patent Application Laid-Open No. 2014-230671 as the biological information detection unit 12, the blood pressure of the user can be detected in a non-contact manner.

As described above, since the biological information detection unit 12 detects the biological information of the user in a non-contact manner, it is not necessary for the user to stop exercising for the measurement of the biological information. That is, the biological information can be measured while the user continues to exercise. Further, for example, in contact-type measurement in which a cuff is wrapped around an arm and blood pressure is measured, a sense of pressure due to the cuff may occur, but when detecting biological information without contact as described above, There is no sense of incongruity. In addition, since the biological information includes at least one of the user's heart rate, blood pressure, and blood flow, the user's physical condition can be appropriately managed based on the heart rate and the like.

[About advertisement display]
The aerial video display device 4 described above may display advertisement information in the air. That is, the advertisement information may be displayed on the display element 3 and the real image of the advertisement information may be displayed in the air by the aerial video display device 4. At this time, the advertisement information may be displayed in the input screen M, or may be displayed outside the input screen M (for example, side by side with the input screen M).

FIG. 17 shows another example of the input screen M displayed in the air by the aerial video display device 4. In the input screen M, advertisement information S is displayed. As the advertisement information S, for example, product information such as sports equipment, sportswear, and supplements sold in the sports club in which the fitness device 1 is installed, information on various events and tournament announcements, and sports related manufacturers sell it. Information on new products to do. The advertiser pays advertising expenses to the company that manages the fitness device 1 as necessary. For a product that the user is interested in, displaying the details of the product by placing a finger on the displayed product and detecting the input position (user's finger at a predetermined position) by the non-contact input device 5 You can also display the homepage of the company that sells the above products.

As described above, the aerial video display device 4 displays the advertisement information S in the air, so that the advertising activities can be performed to the user. In addition, as described above, the user can also access the home page from the displayed advertisement information S to obtain additional information.

[About the fitness system]
FIG. 18 is an explanatory diagram illustrating a schematic configuration of the fitness system 100 including the fitness device 1. The fitness system 100 can be constructed by connecting the above-described fitness device 1 to the management server 120 via the communication line 110. The management server 120 uses the exercise information (for example, travel distance, travel speed) of the user obtained based on the displacement of the movable member 2 of the fitness device 1 and the living body detected by the biological information detection unit 12 (see FIG. 15). Information (eg, heart rate, blood pressure, blood flow information) is accumulated and managed. That is, information (exercise information, biometric information) acquired by the fitness device 1 is transmitted to the management server 120 via the communication line 110 and is managed for each user by the management server 120.

FIG. 19 is a block diagram showing a schematic configuration of the management server 120. The management server 120 includes a storage unit 121 (server side storage unit), an information processing unit 122, a communication unit 123, and a control unit 124 (server side control unit). The storage unit 121 accumulates the above-described exercise information, biological information, and statistics described later, and stores an operation program for the control unit 124. The storage unit 121 includes a RAM, a ROM, a nonvolatile memory, a hard disk, and the like.

The information processing unit 122 is a block that creates statistics on exercise of a user for a certain period based on the exercise information accumulated in the storage unit 121. The information processing unit 122 includes, for example, a circuit for performing information processing and arithmetic processing, and a dedicated board. Consists of. The above statistics include, for example, changes in the user's accumulated travel distance and average speed. The communication unit 123 is an interface for transmitting / receiving information to / from the outside.

The control unit 124 is composed of a CPU that controls the operation of each unit of the management server 120, and executes the operation program stored in the storage unit 121 to operate each unit. The control unit 124 also controls transmission of user-specific information to the fitness device 1. The user-specific information refers to information unique to the user, such as the above statistics, the user's past exercise information and biological information accumulated in the storage unit 121.

In the above configuration, exercise information and biological information acquired by the fitness device 1 are transmitted to the management server 120 via the communication line 110 and accumulated in the storage unit 121. The information processing unit 122 creates exercise statistics for a certain period for each user based on the exercise information. FIG. 20 shows the travel distance statistics (cumulative travel distance) of the user for the past three weeks as an example of the above statistics.

The user-specific information including the above statistics is transmitted from the management server 120 to the fitness device 1 under the control of the control unit 124 in response to a transmission instruction from the fitness device 1.

Here, the procedure for transmitting the user-specific information to the fitness device 1 is as follows. First, the aerial video display device 4 of the fitness device 1 displays an instruction screen for instructing the management server 120 to transmit user-specific information to the fitness device 1 in the air. This instruction screen may be inside the input screen M displayed in the air or outside the input screen M. When the non-contact input device 5 detects an instruction input on the instruction screen in a non-contact manner, the control unit 10 instructs the management server 120 to transmit user-specific information to the fitness device 1. The control unit 124 of the management server 120 receives the transmission instruction from the fitness device 1 and transmits user-specific information to the fitness device 1.

When the user-specific information is transmitted to the fitness device 1, the user-specific information is displayed in the air by the aerial video display device 4. That is, user-specific information is displayed on the display element 3, and a real image of the display video is displayed in the air by the aerial video display device 4. The display of the aerial image (display of the image on the display element 3) is controlled by the control unit 10.

As described above, in the fitness system 1, information (exercise information, biometric information by non-contact detection) acquired by the fitness device 1 is transmitted to the management server 120 and managed there at once. It can be integrated and used for total health care.

Further, in the management server 120, the information processing unit 122 generates the statistics of the user's exercise for a certain period, and outputs the statistics (displayed as an aerial image in the above example). Can be presented. Thereby, the user can make a plan (program) for future exercise with reference to the statistics. For example, it is possible to determine whether to increase or decrease the future travel distance (when exercise is insufficient) / decrease (when trying to recover from fatigue) by looking at how the cumulative travel distance increases.

Further, the user-specific information including the above statistics is transmitted to the fitness device 1 and is displayed as an aerial image there. Therefore, the user can display it in the air while exercising using the fitness device 1. The degree of exercise can be considered on the spot, such as whether or not the current amount of exercise (for example, travel distance) should be increased by looking at the user-specific information.

In addition, since the user-specific information is transmitted from the management server 120 to the fitness device 1 based on a transmission instruction from the fitness device 1, the user-specific information is transmitted to the user only when the user is required. Feedback can be used for health management. Further, since the transmission instruction is performed based on an instruction input on an instruction screen (aerial video) displayed in the air, the user can easily instruct transmission even during exercise, which is convenient.

Incidentally, the fitness system 100 may have a printer 130 as shown in FIG. The above user-specific information may be printed by the printer 130. 18 illustrates an example in which the printer 130 is connected to the management server 120, but the printer 130 may be connected to the fitness device 1.

By printing the user-specific information by the printer 130, the user can surely grasp the state of exercise by looking at the printed user-specific information. It is also possible to save the printed material and check the user-specific information when necessary.

The user-specific information is transmitted from the management server 120 to the external terminal device 140 based on a transmission instruction from the external terminal device 140 that is communicably connected to the management server 120, and is displayed on the external terminal device 140. It may be displayed on the part 140a. As the external terminal device 140, for example, a personal computer owned by an individual user or a portable information terminal such as a smartphone can be considered.

By accessing the management server 120 from the external terminal device 140, the user specific information is transmitted to the external terminal device 140 and displayed on the display unit 140a. For example, the user specific information at the user's home or away from home. Can be used for future health management.

The fitness system 100 may further include a measuring device (for example, a weight scale or a body fat scale) having a communication function, and may be communicably connected to the management server 120. In this case, in addition to the information transmitted from the fitness device 1, data (for example, data related to body weight and body fat percentage) transmitted from the measurement device may be stored in the storage unit 121 of the management server 120. Further, data (for example, data relating to height and age) manually input from the external terminal device 140 such as a smartphone may be stored in the storage unit 121.

[Others]
In the present embodiment, a treadmill is assumed as the fitness equipment 1, but in addition, a fitness bike (bicycle fitness equipment), an elliptical exercise machine, a stepper machine, a rowing machine, a ski simulation machine, a leg press machine, a climbing machine, a pendulum The configuration of the present embodiment can also be applied to devices such as exercise machines, weight pull-down machines, bench press machines, squat machines, and abdominal muscle exercise machines. For example, for equipment that requires input of certain settings such as load during exercise, number of reciprocating movements, exercise time, and programs on the input screen, display the input screen in the air and give instructions at a predetermined position on the input screen. The configuration of this embodiment for detecting an object without contact can be applied. At this time, the movable member 2 that is displaced in accordance with the movement of the user includes a belt and a pedal that the user's foot contacts, a hand grip that is held by the user's hand, and other parts of the user's body (shin , Shoulders, thighs, etc.) can be envisaged.

The fitness device and fitness system of the present embodiment described above may be expressed as follows.

The fitness device according to the present embodiment has a movable member, and the movable member is displaced in accordance with a user's exercise, and an input screen for inputting settings of the fitness device is displayed in the air as an image. An aerial video display device to be displayed and a non-contact input device that detects an indicator at a predetermined position on the input screen displayed in the air without contact and receives an input of the setting.

It is desirable that the aerial video display device displays the input screen in the air between the aerial video display device and the user.

The fitness device further includes a display element that emits image light, and the aerial image display device guides the image light from the display element to the air through a plurality of reflecting surfaces that are orthogonal in a plan view. A corner mirror type display device that displays the input screen in the air may be used.

The fitness device further includes a display element that emits image light, and the aerial image display device guides the image light from the display element to the air through a concave mirror, thereby bringing the input screen into the air. The display device may be a concave mirror type display device.

The aerial image display device may be a hologram type display device that includes a hologram generation unit that generates a hologram image of the input screen and displays the hologram image in the air.

The non-contact input device may detect the indicator in a non-contact manner by moving object detection using infrared rays.

The fitness device may further include a directional acoustic system that provides audio information only to a user who uses the fitness device.

The fitness device may further include a biological information detection unit that detects the biological information of the user in a non-contact manner.

The biological information may include information on at least one of the user's heart rate, blood pressure, and blood flow.

The aerial video display device may display advertisement information in the air.

The cross-sectional shape of the indicator may be an elliptical shape.

The instruction may be a user's finger.

The management server includes a server-side storage unit that stores the exercise information, and an information processing unit that creates exercise statistics for a certain period of time based on the exercise information stored in the server-side storage unit; May be provided.

The management server further includes a server-side control unit that controls transmission of user-specific information including the statistics to the fitness device, and the fitness device is controlled by the server-side control unit. When the information is transmitted to the fitness device, the user-specific information may be displayed in the air by the aerial video display device.

The aerial video display device of the fitness device displays an instruction screen for instructing the management server to transmit the user-specific information to the fitness device in the air, and the fitness device When the contact input device detects an instruction input on the instruction screen in a non-contact manner, the management server includes a device-side control unit that instructs the management server to transmit the user-specific information to the fitness device. The side control unit may transmit the user specific information to the fitness device when there is an instruction to transmit the user specific information from the device side control unit.

The fitness system may further include a printer that prints user-specific information including the statistics.

The user-specific information including the statistics is transmitted from the management server to the external terminal device based on an instruction from the external terminal device that is communicably connected to the management server, and is displayed on the display unit of the external terminal device. May be displayed.

The present invention can be used for fitness equipment and fitness systems.

DESCRIPTION OF SYMBOLS 1 Fitness equipment 2 Movable member 3 Display element 4 Aerial video display device 5 Non-contact input device 10 Control part (equipment side control part)
DESCRIPTION OF SYMBOLS 11 Directional sound system 12 Biometric information detection part 100 Fitness system 110 Communication line 120 Management server 121 Storage part (server side memory | storage part)
122 Information processing unit 124 Control unit (server-side control unit)
DESCRIPTION OF SYMBOLS 130 Printer 140 External terminal device 140a Display part M Input screen S Advertisement information V Indicator

Claims

A fitness device having a movable member, wherein the movable member is displaced as a user moves,
An aerial video display device that displays an input screen for inputting the settings of the fitness device as a video in the air;
A fitness apparatus, comprising: a non-contact input device that detects an indicator at a predetermined position on the input screen displayed in the air without contact and receives an input of the setting.
The fitness apparatus according to claim 1, wherein the aerial video display device displays the input screen in the air between the aerial video display device and a user.
It further comprises a display element that emits image light,
The aerial image display device is a corner mirror type display device that displays the input screen in the air by guiding the image light from the display element to the air through a plurality of reflecting surfaces orthogonal in a plan view. The fitness device according to claim 1, wherein
It further comprises a display element that emits image light,
The aerial video display device is a concave mirror type display device that displays the input screen in the air by guiding the video light from the display element to the air via a concave mirror. 2. Fitness equipment according to 2.
The fitness apparatus according to claim 1 or 2, wherein the aerial video display device is a hologram display device that includes a hologram generation unit that generates a hologram video of the input screen and displays the hologram video in the air.
The fitness device according to any one of claims 1 to 5, wherein the non-contact input device detects the indicator in a non-contact manner by moving object detection using infrared rays.
The fitness device according to any one of claims 1 to 6, further comprising a directional acoustic system that provides voice information only to a user who uses the fitness device.
The fitness device according to any one of claims 1 to 7, further comprising a biological information detection unit that detects the biological information of the user in a non-contact manner.
The fitness apparatus according to claim 8, wherein the biological information includes at least one of a user's heart rate, blood pressure, and blood flow.
The fitness device according to any one of claims 1 to 9, wherein the aerial video display device displays advertisement information in the air.
The fitness device according to any one of claims 1 to 10, wherein a cross-sectional shape of the indicator is an elliptical shape.
The fitness device according to any one of claims 1 to 11, wherein the instruction is a finger of a user.
The fitness device according to any one of claims 1 to 12,
A fitness system comprising: a management server that accumulates and manages user exercise information obtained based on displacement of the movable member, transmitted from the fitness device via a communication line.
The management server is
A server-side storage for storing the exercise information;
The fitness system according to claim 13, further comprising: an information processing unit that creates statistics on exercise of a user for a certain period based on the exercise information accumulated in the server-side storage unit.
The management server is
A server-side control unit that controls transmission of the user-specific information including the statistics to the fitness device;
The fitness device causes the aerial video display device to display the user-specific information in the air when the user-specific information is transmitted to the fitness device under the control of the server-side control unit. The fitness system described in.
The aerial video display device of the fitness device displays an instruction screen for instructing the management server to transmit the user-specific information to the fitness device in the air,
The fitness equipment
A device-side control unit that instructs the management server to transmit the user-specific information to the fitness device when the non-contact input device detects an instruction input on the instruction screen in a non-contact manner;
The fitness system according to claim 15, wherein the server-side control unit transmits the user-specific information to the fitness device when an instruction to transmit the user-specific information is received from the device-side control unit.
The fitness system according to any one of claims 14 to 16, further comprising a printer that prints user-specific information including the statistics.
The user-specific information including the statistics is transmitted from the management server to the external terminal device based on an instruction from the external terminal device that is communicably connected to the management server, and is displayed on the display unit of the external terminal device. The fitness system according to any of claims 14 to 17, wherein the fitness system is displayed.