JP2009201799A - Exercise supporting apparatus, exercise supporting method, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an exercise supporting apparatus allowing a user to sing as well as to get exercise and capable of letting the user get exercise while enjoying the exercise. <P>SOLUTION: A control computer 10 of the exercise supporting apparatus displays a supporting image such as a three-dimensional image of a person in a first display part 121a or second display part 121b disposed in a casing 12, and outputs a music number selected by the user from a speaker 123. At the time, the control computer 10 displays lyrics of the number according to the degree of importance set for each bar composing the number, and adjusts the degree of difficulty of the exercise to be performed by the user. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an exercise support apparatus, an exercise support method, and a computer program that can display an image for supporting exercise on a display unit, and can support a user's exercise by playing and outputting a music that matches the exercise. .

  2. Description of the Related Art Conventionally, an increasing number of users use exercise facilities such as sports clubs and fitness clubs for the purpose of health promotion and dieting. In order to effectively promote health, diet, etc., it is necessary to continuously perform appropriate exercise according to the physical strength and exercise ability of the user, rather than excessive exercise at once. In the exercise facility as described above, since the instructor instructs the exercise content and exercise amount suitable for the user, it is possible to expect effective health promotion and diet. However, since such an exercise facility requires a large space for many users to exercise and many instructors for instructing many users, it is often provided around a station, There are cases where it is difficult for the user to use the device because it does not exist near the home. In addition, in order to use the exercise facility, there is a problem that the user needs to pay a high usage fee.

  Therefore, in recent years, an exercise support device that can be installed in a relatively small space and can support exercise by automatically determining and providing exercise content and exercise amount suitable for the user has attracted attention. Yes. Since this exercise support apparatus does not require an instructor, the labor cost can be reduced and the user can use it at low cost. It is also possible to install and use the exercise support device at the user's home. In this case, it is easy for the user to continuously exercise, so that the exercise can be performed more effectively. . Such exercise support devices are described in, for example, Patent Document 1 and Patent Document 2 below.

  In Patent Document 1, a training management system capable of providing appropriate training according to individual differences among users is proposed. This system is composed of a host device and a training device used by a user. The host device creates a training menu based on user identification information transmitted from the training device, and loads are set according to the created training menu. Send information to the training device. The training device receives load setting information from the host device and changes the load based on the load setting information.

Patent Document 2 proposes an exercise support system that can present optimal exercise content according to changes in the user's exercise ability and physical condition, and that allows the user to perform effective exercise without excess or deficiency. . In this system, the center device selects exercise content data suitable for the user based on the user's exercise purpose and personal data and distributes the exercise content data to the user terminal, and the user terminal receiving the exercise content data uses the exercise content data. To help. In addition, while the user is exercising, the user terminal acquires the user's vital information with the sensor unit, calculates the user's exercise amount based on the vital information, and the calculated exercise amount is within the range of the target value. It is determined whether or not there is. When the amount of exercise is not within the range of the target value, the user terminal transmits a request to change the exercise content data to the center device, and the center device that receives this changes the frame of the exercise content data in response to the change request and distributes it.
JP 2000-51390 A JP 2006-255028 A

  In order to obtain effects such as health promotion and diet through exercise, the user needs to continuously exercise. However, when exercise is performed using an exercise facility or exercise is performed using an exercise support device, the user often fails to continue the exercise before obtaining a sufficient effect. This is mainly due to the user getting bored of using the exercise facility or the exercise support device or exercising itself. Therefore, it is also important not to get tired of the user in order to support the user's exercise and give sufficient effects such as health promotion and diet.

  The training management system described in Patent Document 1 is merely intended to set an appropriate load for each user, and cannot solve the above-described problem that the user gets bored and frustrates continuation of exercise. Absent. This training management system has a function of displaying an image image on a display according to calorie consumption due to exercise, but it cannot exhibit a sufficient effect from the viewpoint of not getting tired of the user. Similarly, the exercise support system described in Patent Document 2 is also merely intended to present exercise content according to changes in the user's exercise ability and physical condition, and cannot solve the above-described problems. Absent.

  The present invention has been made in view of such circumstances, and an object of the present invention is to reproduce music in response to display of a support image that supports exercise and to acquire lyrics data of the music. The lyric display stage is determined for each of a plurality of music parts constituting the music, and the user performs exercise and sings, for example, by displaying the lyrics at an important part (so-called rust part) of the music. It is an object of the present invention to provide an exercise support device that can allow a user to exercise while having fun.

  Another object of the present invention is to determine the exercise content based on the user's exercise ability and the lyrics display stage of the music, and to display a support image according to the determined exercise content. An object of the present invention is to provide an exercise support device that can allow a user to perform exercise and sing in a well-balanced manner, and can give the user both the effect of exercise and the pleasure of singing.

  The exercise support device according to the present invention is an exercise support device comprising display processing means for performing a process of displaying a support image for supporting exercise on a display unit, and playing music corresponding to the display of the support image on the display unit. Reproducing means for reproducing, data obtaining means for obtaining music data relating to the music reproduced by the reproducing means and lyrics data relating to the lyrics of the music, and a plurality of music parts constituting the music, the corresponding lyrics Determination means for determining a display stage related to display on the display section, and display of lyrics on the display section associated with the music portion of the music reproduced by the reproduction means based on the display stage determined by the determination means And lyric display processing means for performing processing.

  Further, the exercise support device according to the present invention is based on athletic ability acquisition means for acquiring a user's athletic ability, athletic ability acquired by the athletic ability acquisition means, and the lyrics display stage determined by the determination means. Exercise content determining means for determining the content of the exercise to be performed, wherein the display processing means performs processing for displaying on the display unit a support image that supports exercise according to the exercise content determined by the exercise content determining means. It is made to perform.

  The exercise support apparatus according to the present invention further includes an accepting unit that accepts a selection related to one or a plurality of music pieces, and an exercise type determining unit that decides an exercise type according to the type of music accepted by the accepting unit. The exercise content determination means determines the exercise content based on the exercise type determined by the exercise type determination means together with the step of displaying the exercise ability and the lyrics.

  The exercise support apparatus according to the present invention is characterized in that the determination means is configured to display the lyrics of the music part in a non-display, a simple display in which the lyrics are abstracted or simplified, and a complete display in which the lyrics are displayed. The exercise content determination means determines the exercise corresponding to the music portion whose lyrics are not displayed as compared with the exercise corresponding to the music portion where the lyrics are simply displayed, as compared with the exercise corresponding to the music portion where the lyrics are simply displayed. The motion is determined, and the motion corresponding to the music portion whose lyrics are completely displayed is determined as the motion of low difficulty.

  In the exercise support apparatus according to the present invention, the data acquisition unit further acquires data related to the importance level determined for each music portion of the music, and the determination unit determines the importance level. The display stage is determined accordingly.

  Moreover, the exercise support apparatus according to the present invention is characterized in that the music portion is a measure constituting the music.

  In addition, the exercise support method according to the present invention is the exercise support method for supporting the user's exercise by displaying a support image for supporting the exercise on the display unit, the song data relating to the song and the lyrics data relating to the lyrics of the song. For a plurality of music parts constituting the music, the display stage related to the display of the corresponding lyrics on the display unit is determined, and the music is played in response to the display of the support image on the display unit Then, on the basis of the determined display step, the lyrics are displayed on the display unit associated with the music portion of the music to be reproduced.

  The computer program according to the present invention is a computer program for supporting a user's exercise by displaying a support image for supporting exercise on a display unit on the computer. , Based on the determined display step, the step of determining the display stage related to the display on the display unit of the corresponding lyrics, the step of playing the music corresponding to the display of the support image on the display unit, And a step of displaying lyrics on the display section associated with the music portion of the music to be reproduced.

  In the present invention, the music is reproduced in response to the display of the support image supporting the exercise, and the lyrics data is acquired and the lyrics are displayed. Thereby, the user can exercise while singing. However, since it is difficult to exercise with a high degree of difficulty while singing, there is a possibility that the amount of exercise may be reduced if lyrics are displayed for all the songs and the user is allowed to sing. Therefore, by determining the display stage of the lyrics for a plurality of music parts constituting the music and displaying the lyrics based on the determination result, for example, the user is allowed to sing only at the chorus part of the music, and otherwise the exercise is performed. The exercise support according to the music such as to be performed mainly can be realized.

  Further, in the present invention, the athletic ability is acquired from information such as the user's age and exercise frequency, and based on the acquired user's athletic ability and the display stage of the lyrics related to the music to be reproduced, Determine the content. Thus, for example, when displaying lyrics and letting the user sing and enjoy, exercise with low difficulty, and when performing exercise with high difficulty, do not display lyrics and sing with exercise Can be performed in a well-balanced manner. Moreover, since the exercise | movement content is determined automatically in consideration of a user's athletic ability, each user can be made to perform an optimal exercise | movement.

  Moreover, in this invention, the user can enjoy exercise | movement and a song with favorite music by receiving selection of the music by a user, and reproducing the received music and displaying a lyrics. In addition, the type of exercise (genre) is determined according to the type (genre) of the music that has been selected, and the content of exercise is determined in consideration of this exercise genre. The genre of music can be, for example, J-POP (Japanese popular music), rock, euro beat, hip hop, rap, Latin, and the like. The exercise genre can be, for example, aerobics, hip-hop dance, Latin dance, or the like. As a result, it is possible to cause the user to perform an exercise suitable for the selected music piece, and to further entertain the user.

  Further, in the present invention, the lyrics display stage is not displayed at all for each music part constituting the music, the lyrics are not displayed at all, the lyrics are abstracted or simplified (for example, the lyrics are “Larala…” or “Rurulu…”). For example, replacing it with a hamming display such as a simple display, and a complete display displaying lyrics. By determining the exercise corresponding to the music portion whose lyrics are not displayed as the exercise of high difficulty, the user's exercise effect can be enhanced. By deciding the exercise corresponding to the music portion whose lyrics are completely displayed as the exercise of low difficulty, the user can sing and enjoy singing. Moreover, the exercise | movement corresponding to the music part of which a lyric is simply displayed should just be a moderate difficulty.

  Moreover, in this invention, while acquiring music data and lyrics data, the data regarding the importance of the music part predetermined for every music part which comprises a music are acquired. A general song has a structure such as intro → A melody → B melody → rust →. In contrast, for example, the A melody part has a low importance and the B melody part has a medium importance. The degree of importance of each piece of music is set in advance and stored as data, such as increasing the degree of importance of the rust portion. Set the importance of the music part appropriately in advance, for example, hide the lyrics for music parts with low importance, and display the lyrics completely for music parts with high importance, based on the acquired importance. By this, it is possible to make the user enjoy more singing.

  Further, in the present invention, measures constituting music are used as music parts. The music is composed of a plurality of bars (for example, if the music has a playback time of 4 to 5 minutes, it is often composed of about 120 bars), and each bar has an intro, A melody, B melody, or chorus. It is easy to determine which one belongs. In addition, since the time length of each measure is often constant, it is easy to associate music, lyrics, and importance as data, and data storage and data processing can be easily performed uniformly. it can.

  In the case of the present invention, the music is reproduced in response to the display of the support image for supporting the exercise, and the lyrics are displayed in, for example, the rust portion of the music, so that only the portion displaying the lyrics is displayed. Exercise support according to the music such as letting the user sing and otherwise exercise mainly can be realized. For this reason, the user can enjoy exercising by singing, and can continue exercising without getting bored. Moreover, since it is the structure which makes a user sing only in one part instead of all the music, a user can be made to exercise reliably, without reducing a momentum. Therefore, the user can continue the exercise while having fun, and can reliably achieve the purposes such as health promotion and diet.

  Further, in the case of the present invention, exercise and singing can be performed by configuring the content of the exercise to be performed by the user based on the user's athletic ability and the display stage of the lyrics related to the music to be reproduced. Can be performed in a well-balanced manner, and each user can perform optimal exercise, so that the user can be exercised with more enjoyment, and the purpose of health promotion and dieting can be achieved more reliably. be able to.

  Hereinafter, the present invention will be specifically described with reference to the drawings showing embodiments thereof. FIG. 1 is a schematic diagram showing the overall configuration of a system using an exercise support apparatus according to the present invention. In FIG. 1, reference numeral 1 denotes an exercise support apparatus that displays a support image that supports user exercise, plays music, and the like, and includes a housing 12 that includes a display unit that displays an image, a speaker for audio output, and the like. The computer 10 is configured to control the above. The control computer 10 of the exercise support apparatus 1 is connected to a personal information management computer 2 that collectively manages personal information of users who use the exercise support apparatus, a server computer 3 that distributes music data, lyrics data, and the like (LAN ( It is connected via a communication network N composed of a local area network) and the Internet, and can exchange data with each other. In the present system, a plurality of exercise support devices 1 can be connected to one server computer 3 and personal information management computer 2 via a communication network N. In FIG. A configuration in which is connected is shown.

  The server computer 3 combines the music data in a format such as MIDI (Musical Instrument Digital Interface), the lyrics data of each music, and the importance data related to the importance set for each measure of the music into a set, and the song title of the music And a database stored in association with the singer name and type (genre). When the server computer 3 receives a data acquisition request from the control computer 10 of the exercise support apparatus 1, the server computer 3 reads the requested data from the database and transmits it to the control computer 10. Since the server computer 3 is a computer that stores and distributes data related to music, a computer that distributes music data related to so-called karaoke may be used.

  The personal information management computer 2 is a process for receiving input of personal information (name, age, sex, exercise habits, etc.) by the user, registration processing and management processing for the received personal information, user authentication processing, and exercise support device 1 Processing such as transmission / reception of personal information to / from the control computer 10 is performed.

  FIG. 2 is a schematic external view showing the external appearance of the exercise support apparatus 1 according to the present invention. The exercise support device 1 is desirably installed in a private room for privacy protection and soundproofing. The housing 12 of the exercise support device 1 includes a substantially rectangular front panel 12F provided upright on a floor surface, and a left panel 12L and a right panel 12R having substantially the same size attached to the left and right of the front panel 12F. It is the composition which includes.

  The left panel 12L and the right panel 12R are attached so as to form an angle of about 90 ° to 150 ° with respect to one surface (front surface) of the front panel 12F, and are provided upright on the floor surface. The user exercises between the left panel 12L and the right panel 12R of the housing 12 at a position separated from the front surface of the front panel 12F. The left panel 12L and the right panel 12R have a mirror surface on the front surface, and a user who moves toward the front panel 12F can visually recognize his / her whole body using the mirror surface. Note that the left panel 12L and the right panel 12R are as described above with respect to the front panel 12F in order to provide the three panels upright on the floor surface in a stable state and to project the whole body of the user on the mirror surface. It is desirable to make an angle of about 90 ° to 150 °. However, the shape of the housing 12 shown in FIG. 2 is an example, and is not limited to this.

  On the front surface of the front panel 12F, a first display unit 121a and a second display unit 121b, such as a liquid crystal monitor, are arranged vertically. In addition, as for the 1st display part 121a provided in the upper side, it is desirable to arrange | position in the position where the center position substantially corresponds with the gaze position based on a female average height. Further, it is desirable that the second display portion 121b provided on the lower side is disposed at a center position of about 50 cm from the bottom side of the front panel 12F (that is, from the floor surface).

  In addition, a camera 124 for user imaging is disposed at the center of the upper portion of the front panel 12F, and speakers 123 are disposed at the left and right ends. The imaging direction of the camera 124 is set so as to capture an image from the upper part of the front panel 12F toward the front and obliquely downward so that a whole body image of the user who uses the exercise support apparatus 1 can be captured. The processed image is transmitted to the control computer 10. The control computer 10 is configured to determine the user's posture (a standing state, a sitting state, a sleeping state, etc.) based on an image captured by the camera 124.

  The control computer 10 includes a first display unit 121a or a second display unit provided on the front panel 12F according to the posture of the user determined based on the image captured by the camera 124 for the support image that supports the user's exercise. It is displayed on either one of 121b. For example, when the control computer 10 determines that the user is standing, the control computer 10 displays a support image on the first display unit 121a provided on the upper side and determines that the user is sitting. The support image can be displayed on the second display unit 121b provided on the lower side.

  In the support image displayed on the first display unit 121a or the second display unit 121b, for example, a moving image in which a three-dimensional human image composed of polygons, textures, and the like operates according to the exercise content determined for each user. Can be used. In addition, the control computer 10 reproduces music for instructing the user about the exercise content and the tempo suitable for the exercise rhythm according to the display of the support image from the two speakers 123 provided on the upper portion of the front panel 12F. And output it.

  Thereby, the user imitates the operation of the three-dimensional human image displayed as the support image on the first display unit 121a or the second display unit 121b, and matches the instruction by voice output from the speaker 123 and the tempo of the music. By moving the body, exercise suitable for each user can be performed. At this time, the user can see his / her appearance in the mirror surface of the left panel 12L and the right panel 12R, and can also perform exercise compared to the operation of the three-dimensional human image displayed as the support image.

  Furthermore, the exercise support apparatus 1 according to the present invention has a function of displaying the lyrics of the music reproduced and output from the speaker 123 together with the support image on the first display unit 121a or the second display unit 121b at an appropriate position of the music. Have. Thereby, the user can sing according to the lyrics of the displayed music while exercising according to the support image. In the exercise support apparatus 1, the user can select music to be played back and output from the speaker 123, and the control computer 10 acquires data related to the music selected by the user from the server computer 3 and plays it back. At the same time, the exercise content to be supported is determined to be suitable for the selected music, and a support image of a three-dimensional human image that performs an operation suitable for the music is displayed.

  FIG. 3 is a block diagram showing the configuration of the exercise support apparatus 1 according to the present invention. A control computer 10 of the exercise support apparatus 1 includes a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a display unit 103, an operation unit 104, a storage unit 105, a video signal output unit 106, an operation signal input unit 107, An audio signal output unit 108, an imaging signal input unit 109, a communication unit 110, and the like are included.

  The CPU 101 reads out and executes the control program 105 a stored in the storage unit 105, thereby performing control processing of various units of the control computer 10 and various arithmetic processes. The RAM 102 includes a memory element such as SRAM (Static RAM) or DRAM (Dynamic RAM), and temporarily stores data generated during the processing of the CPU 101 and temporarily stores data received by the communication unit 110. Is to do. The display unit 103 is a liquid crystal display or the like, and the operation unit 104 is a device such as a keyboard and a mouse. The display unit 103 and the operation unit 104 serve as an interface between the control computer 10 and the user.

  The storage unit 105 includes a large-capacity storage device such as a hard disk, and includes the above-described control program 105a, music genre database (hereinafter referred to as DB) 105b, genre determination table 105c, exercise DB 105d, and lyrics display table. Various data such as 105e are stored. Details of various data stored in the storage unit 105 will be described later.

  The video signal output unit 106 to the imaging signal input unit 109 of the control computer 10 include a first display unit 121 a, a second display unit 121 b, an operation unit 122, a speaker 123, and a camera 124 provided on the housing 12 of the exercise support device 1. For transmitting and receiving data or signals. The video signal output unit 106 is a video signal suitable for displaying data related to images (including a menu image and a warning message in addition to a support image and lyrics) displayed on the first display unit 121a and the second display unit 121b. It is made to output after converting.

  Although not shown in FIG. 2, the housing 12 of the exercise support apparatus 1 has an operation unit 122 in which a plurality of buttons or switches such as a start button, a stop button, a cursor key, and a confirmation key are arranged. ing. The operation unit 122 can be provided, for example, between the first display unit 121a and the second display unit 121b of the entire panel 12F of the housing 12. The operation unit 122 detects a user operation such as a button or a switch and notifies the control computer 10 of the operation. The operation signal input unit 107 of the control computer 10 acquires the user operation content given as an operation signal from the operation unit 122 of the housing 12 and notifies the CPU 101 of it.

  Under the control of the CPU 101, the audio signal output unit 108 converts the data related to the sound instructing the exercise content and the data related to the music to be reproduced into an audio signal and outputs it to the speaker 123. Further, the imaging signal input unit 109 acquires a signal related to an image captured by the camera 124, converts it into image data, and stores the image data in the RAM 102 or the storage unit 105.

  The communication unit 110 transmits / receives data to / from other devices via a communication network N such as a LAN or the Internet. Under the control of the CPU 101, the communication unit 110 reads data for transmission from the RAM 102 or the storage unit 105 according to a predetermined protocol, transmits the data to other devices, and receives data from other devices. The received data is stored in the RAM 102 or the storage unit 105, and the CPU 101 is notified that the data has been received. With the communication unit 110, the control computer 10 can transmit and receive various data between the personal information management computer 2 and the server computer 3 via the communication network N.

  FIG. 4 is a block diagram showing the configuration of the personal information management computer 2 and the server computer 3. The personal information management computer 2 includes a CPU 21 that performs control processing of various units and various arithmetic processes, a RAM 22 that temporarily stores data, a display unit 23 that includes a liquid crystal display, an operation that includes a keyboard, a mouse, and the like. Unit 24, a communication unit 25 for transmitting and receiving data via the communication network N, and a storage unit 26 including a large-capacity storage device such as a hard disk. The storage unit 26 of the personal information management computer 2 stores a control program 261 read and executed by the CPU 21, a personal information DB 262 composed of personal information of a plurality of users who use the exercise support device 1, and the exercise level of each user. An exercise level conversion table 263 and the like for acquisition are stored. Details of the personal information DB 262 and the exercise level conversion table 263 will be described later.

  Similarly, the server computer 3 includes a CPU 31 that performs control processing of each unit and various arithmetic processes, a RAM 32 that temporarily stores data, a display unit 33 that includes a liquid crystal display, a keyboard, a mouse, and the like. An operation unit 34, a communication unit 35 for transmitting and receiving data via the communication network N, and a storage unit 36 including a large-capacity storage device such as a hard disk are included. The storage unit 36 of the server computer 3 stores a control program 361 that is read and executed by the CPU 31, a music DB 362 that includes data related to music that the exercise support apparatus 1 plays, and the like. Details of the music DB 362 will be described later.

  In the system shown in FIG. 1, a user who wishes to exercise using the exercise support apparatus 1 first operates while viewing the initial registration screen displayed on the display unit 23 of the personal information management computer 2. It is necessary to register personal information using the unit 24. FIG. 5 is a schematic diagram illustrating an example of an initial registration screen for registering personal information. The initial registration screen includes, for example, a box for entering a name and age, two option buttons for selecting a gender, and five check buttons for selecting exercise habits. After inputting the information, the personal information can be registered by operating the “registration” button by the operation unit 24.

  When personal information is registered by the user, the personal information management computer 2 assigns identification information such as an ID (IDentifier) number to each user and stores the registered personal information in the personal information DB 262. . FIG. 6 is a schematic diagram illustrating a configuration example of the personal information DB 262. The personal information DB 262 stores personal information such as name, age, sex, exercise level, and experience value in association with identification information uniquely assigned to each user. Information relating to the name, age, and sex stored in the personal information DB 262 is information registered by the user on the initial registration screen shown in FIG.

  The information relating to the exercise level and the experience value in the personal information DB 262 indicates the exercise ability of each user. The personal information management computer 2 refers to the exercise level conversion table 263 stored in the storage unit 26 based on the age, sex, and exercise habits of the user registered on the initial registration screen, thereby determining the exercise level of each user. I am going to decide. FIG. 7 is a schematic diagram illustrating a configuration example of the exercise level conversion table 263. The exercise level conversion table 263 stores the exercise levels in five levels of 1 to 5 in association with the age group determined for each male or female gender and the values obtained by evaluating exercise habits in five levels. It is. The values registered by the user on the initial registration screen can be applied to the sex and age group of the exercise level conversion table 263.

  The value of the exercise habit in the exercise level conversion table 263 is determined by which of the five check boxes provided on the initial registration screen is selected. For example, when “exercise every day” is selected, the value of exercise habit is determined to be “5”, and when “exercise about 3 times a week” is selected, the value of exercise habit is set to “4”. When “exercise only on weekends” is selected, the exercise habit value is determined as “3”, and when “execute about once a month” is selected, the exercise habit value is “2”. When “not exercise” is selected, the exercise habit value is determined as “1”. The personal information management computer 2 determines one exercise level according to the age group for each gender of the user and the value of exercise habits, and stores it in the personal information DB 262.

  In addition, as the experience value of the personal information DB 262, four-stage numerical values of 1 to 4 are stored for each genre of exercise that can be performed by the user with the exercise support device 1. FIG. 6 shows an example in which experience values are stored for four types of exercise genres such as “stretch”, “aerobics”, “hip hop”, and “latin dance”. The experience value of each exercise genre is not determined based on the information on the initial registration screen shown in FIG. 5, but is determined based on the number of use and frequency of use of the exercise support device 1 of each user. Therefore, for the user newly registered in the personal information DB 262, the experience value of each exercise genre is “1”, and the experience value of the genre that exercised is increased every time the exercise support apparatus 1 is used. It is. Further, the personal information management computer 2 may perform processing for automatically increasing the exercise level as the experience value of the personal information DB 262 increases.

  A user who has completed registration of personal information (or a user who has already registered personal information) operates the operation unit 122 with the chassis 12 of the exercise support apparatus 1 and inputs identification information given to each user. The control computer 10 of the exercise support apparatus 1 that has received the input of identification information transmits a request for acquiring personal information related to the received identification information from the communication unit 110 to the personal information management computer 2 via the communication network N. is there. When the personal information management computer 2 receives the personal information acquisition request, the personal information management computer 2 reads the personal information related to the corresponding identification number from the personal information DB 262 and transmits the acquisition request from the communication unit 25 via the communication network N. 10 is transmitted. The control computer 10 that has received the personal information from the personal information management computer 2 displays the received personal information on the first display unit 121a or the second display unit 121b.

  Next, the control computer 10 of the exercise support apparatus 1 displays a music selection screen on the first display unit 121a or the second display unit 121b so as to prompt the user to select a music to be reproduced when exercising. . FIG. 8 is a schematic diagram illustrating a configuration example of a music selection screen. In the music selection screen, an input box for inputting the name of the singer of the music, a search execution button associated with the input box, a pull-down menu for selecting the genre of the music, and a search associated with the input box The execution button is provided. In the singer name input box, the user can input the name of a favorite singer by using the operation unit 122, and the control computer 10 operates the corresponding search execution button to select a song corresponding to the input singer name. A search is performed and search results are displayed in a list (not shown). The user can also perform a search specifying the genre of music, and by selecting one music genre from the music genre pull-down menu and operating the corresponding search execution button, the control computer 10 selects the selected music genre. The music corresponding to is searched and the search results are displayed in a list. The user can select one or more music pieces from the list of search results, and the control computer 10 plays back the selected music piece when supporting exercise.

  When searching for music based on the singer name or music genre input on the music selection screen, the control computer 10 performs the search based on the music genre DB 105 b stored in the storage unit 105. FIG. 9 is a schematic diagram illustrating a configuration example of the music genre DB 105b. In the music genre DB 105b, a music number assigned to each music, a music name, a singer name related to the music, a music genre, and the like are stored in association with each other. The music genre DB 105b is a list of music stored in the music DB 362 of the server computer 3, and the control computer 10 obtains music list information from the server computer 3 periodically or as needed to update the music genre DB 105b. I have to do it. However, the control computer 10 does not store the music genre DB 105b, transmits a music search request to the server computer 3 according to the user's selection, receives the search result from the server computer 3, and displays the search result. It is good.

  FIG. 10 is a schematic diagram illustrating a configuration example of the music DB 362. The music DB 362 of the server computer 3 stores a music number, a music name, a singer name related to the music, a music genre, music data related to the music, lyrics data, importance data, and the like associated with each music. It is. Among these items, items such as a song number, a song name, a singer name, and a song genre are the same as the items stored in the song genre DB 105 b of the control computer 10, and the server computer 3 responds to an acquisition request from the control computer 10. These items are transmitted as music list information. The music DB 362 of the server computer 3 is updated by the administrator of the server computer 3 or the administrator of this system.

  The music data stored in the music DB 362 is data necessary for reproduction of music such as MIDI format. Note that the music data may include only music accompaniment or may include music accompaniment and voice (singing voice). The music data in the music DB 362 may be configured to be embedded as actual data in the music DB 362, but may be configured to store the file name of the music data or the address in the storage unit 36 storing the music data instead. .

  The lyrics data stored in the music DB 362 is data in which the lyrics of the music are stored in association with each of a plurality of measures constituting the music. Note that the lyrics of the music are text data, and the control computer 10 displays the lyrics as characters. However, as is the case with the so-called karaoke lyrics display, the lyrics display color is synchronized with the playback of the music. When processing such as changing is performed, data related to these processing timings may be included in the lyrics data. Like the music data, the lyrics data in the music DB 362 may be embedded in the music DB 362, but the file name of the lyrics data or the address in the storage unit 36 storing the lyrics data is stored instead. May be.

  The importance data stored in the music DB 362 is data in which the importance of each measure is stored in association with each measure of the music. FIG. 11 is a schematic diagram illustrating an example of importance data. Generally, a music piece is composed of a combination of a prelude, A melody, B melody, rust, interlude, posterior, and the like, and these are composed of a plurality of bars. The music shown as an example in FIG. 11 is composed of prelude → A melody → B melody → chorus → intermediate chorus → rust chorus → follower, each of which is composed of four bars, and is composed of 32 bars in total. ing. However, this is a simplified example, and if the performance time is about 5 minutes, it is often composed of about 120 bars.

  The importance level data of the music is obtained by associating the numbers assigned to the bars constituting the music in the order of performance, the presence / absence of lyrics corresponding to each bar, and the importance of each bar. In the illustrated example, the bars of the prelude, the interlude, and the postlude have no corresponding lyrics, and the bars of A melody, B melody, and chorus have corresponding lyrics. Moreover, the importance of each measure is classified into three levels of 1 to 3, and the greater the numerical value, the higher the importance. Note that the importance data of the music DB 362 is created in advance by the administrator of the server computer 3 or the administrator of the present system and stored in the server computer 3.

  The control computer 10 that has received the user's selection of the music based on the music genre DB 105b determines the genre of the exercise to be supported according to the genre of the selected music, and details of the exercise according to the determined genre of the exercise. To be determined. At this time, the control computer 10 determines the exercise genre based on the genre determination table 105 c stored in the storage unit 105. FIG. 12 is a schematic diagram illustrating an example of the genre determination table 105c. The genre determination table 105c is a table in which a music genre assigned to each music is associated with an exercise genre related to exercise. In the illustrated example, the music genres of “J-POP”, “Eurobeat” and “Rock” are associated with the exercise genre of “Aerobics”, and the music genres of “hip hop” and “rap” are “hip”. The song genre of “Latin” is associated with the exercise genre of “Latin Dance”. The control computer 10 acquires a music genre for each music selected by the user based on the music genre DB 105b, and determines an exercise genre corresponding to the acquired music genre based on the genre determination table 105c.

  The control computer 10 that has determined the exercise genre corresponding to the music genre searches for the exercise belonging to this exercise genre from the exercise DB 105d stored in the storage unit 105, and takes into account the music selected by the user, and the exercise content suitable for the user. (Exercise menu) is determined. FIG. 13 is a schematic diagram illustrating a configuration example of the exercise DB 105d. The exercise DB 105d stores a detailed exercise according to the user's exercise level, experience value, and the like, and has a structure in which the detailed exercise is classified and stored for each exercise genre. In the illustrated example, the exercise DB 105d includes three databases: an aerobics DB that stores exercises related to aerobics, a hip-hop DB that stores exercises related to hip-hop dance, and a Latin dance DB that stores exercises related to Latin dance. It is. However, the illustrated configuration is an example, and the exercise DB 105d may be configured with a database relating to more exercise genres.

  FIG. 14 is a schematic diagram illustrating a configuration example of the aerobics DB. The configurations of the hip hop DB and the Latin dance DB are the same as the configuration of the aerobics DB, and thus illustration and description thereof are omitted. The aerobics DB stores the details of exercise related to aerobics in association with each combination of 5 levels of exercise for each user and 4 levels of experience values related to aerobics. For example, an exercise with an exercise level of “1” and an aerobics experience value of “1” is “slow march”. For example, an exercise with an exercise level of “4” and an aerobics experience value of “3” is “side step & crap”. The aerobics DB stores exercises with higher exercise intensity as the exercise level is higher, and exercises with higher difficulty as the experience value is higher. That is, the exercise with the exercise level “5” and the aerobics experience value “4” has the highest exercise intensity and difficulty, and the exercise with the exercise level “1” and the aerobics experience value “1” has the most exercise intensity and difficulty. The degree is low.

  In the illustrated aerobics DB, only items such as “slow march”, “march & back-and-forth exercise” and “jogging & turn” are described as the exercise according to the exercise level and the aerobics experience value. In the DB, data for creating a support image corresponding to each exercise, voice data for instructing the exercise, and the like are stored in association with each item. The data for creating a support image is, for example, polygon data and texture data for forming a person image to be displayed.

  In the exercise support device 1 according to the present invention, when supporting a user's exercise by displaying a support image and outputting a voice instructing the exercise, the user selects and plays back the music selected by the user. It has a function to display lyrics. At this time, the exercise support device 1 does not display the lyrics for all the music to be played, but displays the lyrics with high importance of each measure constituting the music. As a result, the user can exercise while watching the lyrics while singing at the key points of the music, but it is difficult to see and sing the lyrics while exercising with a high degree of difficulty. Therefore, when creating the exercise menu from the exercise DB 105d, the control computer 10 of the exercise support apparatus 1 acquires importance data together with music data and lyrics data related to the music selected from the server computer 3, and the acquired importance With reference to the lyrics display table 105e stored in the storage unit 105 based on the data, whether or not to display lyrics for each measure of the music and the difficulty level of the exercise are determined.

  FIG. 15 is a schematic diagram illustrating an example of the lyrics display table 105e. The lyric display table 105e has an importance level assigned to each measure constituting the music, a display step of lyrics corresponding to the measure, and an adjustment amount of the difficulty level of the exercise performed when the measure is being reproduced. It is associated. For example, for a measure whose importance is “1” (ie, an unimportant measure), the lyrics display stage is not displayed, and the exercise difficulty level is not adjusted with respect to the exercise difficulty level determined from the exercise DB 105d. . The measure with importance level “2” is an abstracted humming display by replacing the display stage of the lyrics with “Lalala ...” or “Rurulu ...” etc., and the exercise difficulty is determined from the exercise DB 105d. One level of difficulty is facilitated. In other words, when the difficulty level of the exercise is facilitated by one step, the control computer 10 selects an exercise having the same exercise level and an aerobics experience value one step lower in the aerobics DB shown in FIG. In addition, the measure with importance level “3” is completely displayed without abstracting the lyrics of the music (the display stage of the lyrics is completely displayed), and has the lowest exercise difficulty, that is, no exercise (upright) And

  Note that the lyrics display table 105e shown in FIG. 15 is configured to facilitate one level of difficulty of exercise when displaying lyrics by humming, but is not limited to this and is configured to facilitate two or more levels. There may be a configuration that facilitates exercise at least as compared with the case where lyrics are not displayed. Similarly, the lyric display table 105e is configured such that there is no exercise when the lyrics are completely displayed, but is not limited to this, and at least in the case of hamming display such as facilitating one step from the case of hamming display. Any configuration that facilitates exercise may be used.

  As a result, the control computer 10 of the exercise support apparatus 1 sets the importance data relating to the music selected by the user, the exercise difficulty determined from the importance for each measure of the music, and the music genre of the music selected by the user. Based on the exercise genre determined accordingly, the exercise to be performed by the user can be determined for each measure of the music from the exercise DB 105d, and the display of lyrics for each measure can be determined. FIG. 16 is a schematic diagram showing an example of the determined exercise content and lyric display, and shows an example of exercise content and lyric display corresponding to the music (first to twentieth measures) shown as an example in FIG. It is. In this example, it is assumed that the user has selected a music genre of which the exercise genre is determined to be aerobics, the user's exercise level is “4”, and the aerobics experience value is “2”.

  In the example shown in FIG. 16, the control computer 10 determines that the lyrics display is “hidden” and the exercise contents are not displayed because the corresponding lyrics do not exist in the 1st to 4th measures and the 17th to 20th measures of the music. From the combination of the exercise level “4” and the aerobics experience value “2”, the aerobics DB is referred to and “side step & back and forth exercise” is determined without adjusting the difficulty level. Further, since the importance of the ninth to twelfth measures of the music is “1”, the control computer 10 similarly determines that the lyrics display is “non-display”, the exercise content is the exercise level “4”, and the aerobics. From the combination of the experience value of “2”, it is determined as “side step & back-and-forth motion” by referring to the aerobics DB without adjusting the difficulty level.

  Further, the control computer 10 determines that the lyrics display is “hamming display” because the importance level of the fifth to sixth measures of the music is “2”, the exercise content is facilitated by one step, and the exercise level is “4”. “And the side step” is determined with reference to the aerobics DB from the combination of the aerobics experience value “1”. The control computer 10 determines that the lyrics display is “complete display” and the exercise content is “no exercise” because the importance of the seventh to eighth measures and the thirteenth to sixteenth measures of the music is “3”. "Upright" is determined. In addition, when the exercise content is “upright”, the person image of the support image displayed by the control computer 10 also maintains an upright state, or maintains a state of singing with a microphone, etc. It may be an image.

  The control computer 10 that has determined the exercise content and the lyrics display for each piece of music as described above, after the user operates the operation unit 122 provided on the housing 12 of the exercise support apparatus 1 and is given an instruction to start exercise. According to the determined exercise content, data for generating a support image is read from the exercise DB 105d to generate a support image, and the support image is displayed on either the first display unit 121a or the second display unit 121b according to the posture of the user. It is supposed to be displayed. At this time, the control computer 10 reads out voice data from the exercise DB 105d according to the determined exercise content, and gives an audio signal from the audio output unit 108 to the speaker 123, thereby outputting an audio signal indicating an instruction according to the exercise content. It is.

  Further, the control computer 10 acquires music data related to the music selected by the user from the server computer 3, reproduces the music in accordance with the display of the support image, and outputs it from the speaker 123. Furthermore, the control computer 10 acquires lyrics data related to the music selected by the user from the server computer 3 and displays the lyrics in accordance with the reproduction of each measure of the music according to the determined lyrics display. In the case where the lyrics of the music are displayed in a complete or hamming manner, the control computer 10 displays the lyrics of the music or characters such as “Lalala ...” or “Rururu ...” and also plays back the music like so-called karaoke. It is also possible to perform processing for changing the color of the lyrics displayed at the same timing.

  Therefore, the exercise support device 1 reproduces the music selected by the user and outputs the music from the speaker 123, and the first display unit 121a or the first video of the 3D human image corresponding to the determined exercise content is reproduced. 2 The lyrics of the music can be displayed on the first display 121a or the second display 121b according to the degree of importance displayed on the display 121b and attached to each measure constituting the music.

  Below, the process of this system including the exercise assistance apparatus 1 is demonstrated using a flowchart. FIG. 17 is a flowchart showing a procedure of personal information reception processing performed by the personal information management computer 2, and processing performed when the CPU 21 of the personal information management computer 2 executes the control program 261 stored in the storage unit 26. It is. The personal information management computer 2 displays an initial registration screen (see FIG. 5) on the display unit 23 (step S1), checks whether or not the input of personal information by the user is accepted (step S2), and does not accept the input. In the case (S2: NO), the process returns to step S1, displays the initial registration screen, and waits for the input of personal information.

  When the input of personal information by the user is accepted (S2: YES), the personal information management computer 2 reads the personal information DB 262 from the storage unit 26 (step S3), and searches for identification information not registered in the personal information DB 262. The identification information for the new user is determined (step S4). At this time, the personal information management computer 2 may display the determined identification information on the display unit 23 to notify the user.

  Next, the personal information management computer 2 reads the exercise level conversion table 263 stored in the storage unit 26 (step S5), and exercises based on the exercise level conversion table 263 from the gender, age and exercise habits of the received personal information. A level is determined (step S6). After determining the exercise level, the personal information management computer 2 stores the received personal information and the determined exercise level in the personal information DB 262 (step S7), and ends the process.

  FIG. 18 to FIG. 20 are flowcharts showing the procedure of the exercise content and lyrics display determination process performed by the control computer 10 of the exercise support apparatus 1. The CPU 101 of the control computer 10 stores the control program 105 a stored in the storage unit 105. It is a process performed by executing. The control computer 10 of the exercise support apparatus 1 checks whether or not the input of identification information by the user has been received from the operation unit 122 provided in the housing 12 (step S21). If the input has not been received (S21: NO) ), And wait for input.

  When the input of identification information is received (S21: YES), the control computer 10 transmits a personal information acquisition request related to the received identification information from the communication unit 110 to the personal information management computer 2 via the communication network N ( Step S22). Thereafter, the control computer 10 checks whether or not the personal information transmitted from the personal information management computer 2 has been received by the communication unit 110 (step S23), and if not received (S23: NO), further It is checked whether or not an error transmitted from the personal information management computer 2 has been received (step S24). When the error is received (S24: YES), the control computer 10 notifies the first display unit 121a or the second display unit 121b of the housing 12 that the identification information input by the user contains an error. Display is performed (step S25), and the process is terminated. If no error has been received (S24: NO), the control computer 10 returns to step S23 and waits for reception of personal information from the personal information management computer 2. When personal information is received from the personal information management computer 2 (S23: YES), the control computer 10 displays the received personal information on the first display unit 121a or the second display unit 121b (step S26).

  Next, the control computer 10 displays a music selection screen (see FIG. 8) on the first display unit 121a or the second display unit 121b (step S31), and operates the search execution button provided on the music selection screen. It is checked whether or not a user search request has been accepted (step S32). If the search request has not been received (S32: NO), the control computer 10 returns to step S31 and continues to display the music selection screen and waits for reception of the search request.

  When the search request is accepted (S32: YES), the control computer 10 reads the music genre DB 105b stored in the storage unit 105 (step S33) and corresponds to the singer name or music genre input on the music selection screen. The music is searched from the music genre DB 105 (step S34), and the search result is displayed on the first display unit 121a or the second display unit 121b (step S35). Thereafter, the control computer 10 checks whether or not the user's selection from the music displayed as the search result has been accepted (step S36). If the selection has not been accepted (S36: NO), the control computer 10 returns to step S35 and the search result. Is kept waiting for acceptance of music selection.

  When the selection of the music is accepted (S36: YES), the control computer 10 acquires the music genre of the selected music from the music genre DB 105b (step S37), and reads the genre determination table 105c stored in the storage unit 105. (Step S38) The exercise genre is determined based on the genre determination table 105c from the music genre of the selected music (Step S39).

  Next, the control computer 10 transmits an importance level data acquisition request relating to the selected music piece from the communication unit 110 to the server computer 3 via the communication network N (step S41), and the importance level transmitted from the server computer 3 is transmitted. It is checked whether data has been received (step S42). If the importance data has not been received (S42: NO), the control computer 10 waits until the importance data is received.

  When the importance data is received (S42: YES), the control computer 10 reads the lyrics display table 105e stored in the storage unit 105 (step S43) and displays the lyrics completely for each measure of the music or humming. Whether or not to display the lyrics related to display or not to be displayed is based on the received importance level data (step S44), and the difficulty level of the exercise content corresponding to each measure of the music is not adjusted, or one step is facilitated The determination relating to the difficulty level adjustment of whether or not to exercise is performed based on the importance data (step S45). Next, the control computer 10 reads the exercise DB 105d stored in the storage unit 105 (step S46), and according to the exercise genre determined in step S39 and the difficulty level adjustment determined in step S45, the music is based on the exercise DB 105d. The exercise content is determined for each bar (step S47), and the process is terminated.

  FIG. 21 is a flowchart showing a procedure of personal information transmission processing performed by the personal information management computer 2, and processing performed when the CPU 21 of the personal information management computer 2 executes the control program 261 stored in the storage unit 26. It is. The personal information management computer 2 checks whether or not the personal information acquisition request (see step S22 in FIG. 18) transmitted from the control computer 10 of the exercise support apparatus 1 has been received by the communication unit 25 (step S61). If not (S61: NO), it waits until a personal information acquisition request is received.

  When the personal information acquisition request is received (S61: YES), the personal information management computer 2 reads the personal information DB 262 stored in the storage unit 26 (step S62) and corresponds to the identification information of the user who has requested acquisition. It is checked whether or not personal information to be present exists in the personal information DB 262 (step S63). If the corresponding personal information exists (S63: YES), the personal information management computer 2 acquires the corresponding personal information from the personal information DB 262 (step S64), and acquires the acquired personal information from the communication unit 25 through the communication network N. The personal information acquisition request is transmitted to the control computer 10 (step S65), and the process is terminated. If the corresponding personal information does not exist (S63: NO), the personal information management computer 2 transmits an error to the control computer 10 that transmitted the personal information acquisition request (step S66), and ends the process.

  FIG. 22 is a flowchart showing a procedure of importance data transmission processing performed by the server computer 3, and is processing performed by the CPU 31 of the server computer 3 executing the control program 361 stored in the storage unit 36. The server computer 3 checks whether or not the importance level data acquisition request (see step S41 in FIG. 20) transmitted from the control computer 10 of the exercise support device 1 has been received by the communication unit 35 (step S81). If not (S81: NO), it waits until an importance data acquisition request is received.

  When the importance data acquisition request is received (S81: YES), the server computer 3 reads the music DB 362 stored in the storage unit 36 (step S82), and stores the importance data of the music requested to be acquired as the music DB 362. (Step S83), the acquired importance data is transmitted from the communication unit 35 to the control computer 10 that has transmitted the importance data acquisition request via the communication network N (Step S84), and the process is terminated.

  Although the server computer 3 performs transmission processing of music data and lyrics data in addition to importance data, the processing procedure is the same as the transmission processing of importance data, so the illustration and detailed description of the flowchart are omitted. To do.

  FIG. 23 is a flowchart showing a procedure of exercise support processing performed by the control computer 10 of the exercise support device 1, and is processing performed when the CPU 101 of the control computer 10 executes the control program 105 a stored in the storage unit 105. is there. The control computer 10 of the exercise support apparatus 1 checks whether or not an instruction to start exercise is received from the operation unit 122 provided on the housing 12 (step S101). If the instruction is not received (S101: NO) ), Wait until the instruction is accepted.

  When an instruction to start exercise is received (S101: YES), the control computer 10 transmits a request for acquiring music data and lyrics data related to the music to be reproduced from the communication unit 110 to the server computer 3 via the communication network N ( Step S102). Thereafter, the control computer 10 checks whether or not the music data and lyrics data transmitted from the server computer 3 has been received (step S103). When the music data and lyrics data have not been received (S103: NO), Wait until music data and lyric data are received. When the music data and the lyrics data are received (S103: YES), the control computer 10 initializes the value of the variable i to 1 (step S104), and performs the exercise support process for the i-th measure of the music (step S105).

  FIG. 24 is a flowchart showing the procedure of the exercise support process for the i-th measure performed by the control computer 10 of the exercise support apparatus 1, and is the process performed in step S105 of FIG. The control computer 10 includes data included in the exercise DB 105 d stored in the storage unit 105, of the exercise content determined in step S 47 of the process shown in FIG. (Step S121), and the generated support image is displayed on the first display unit 121a or the second display unit 121b according to the posture of the user detected based on the user image captured by the camera 124. (Step S122), the i-th measure of the music is reproduced (Step S123), and output from the speaker 123.

  Accordingly, the control computer 10 checks whether or not the lyrics of the i-th measure are determined to be complete display according to the lyrics display determined in step S44 of the process shown in FIG. 20 (step S124). Is determined (S124: YES), the lyrics are displayed together with the support image on the first display part 121a or the second display part 121b (step S125), and the process returns to the process shown in FIG. If the lyrics of the i-th measure are not determined to be complete display (S124: NO), the control computer 10 further checks whether or not the lyrics of the i-th measure are determined to be hamming display (step S126). When the lyrics of the i-th measure are determined to be hamming display (S126: YES), the control computer 10 replaces the lyrics of the i-th measure with “Lalala ...” or “Rururu ...” etc. The hamming display to be displayed on the second display unit 121b is performed (step S127). If the hamming display is not determined (S126: NO), the process returns to the process shown in FIG. 23 without displaying the lyrics.

  In FIG. 24, the control computer 10 performs processing in the order of display of support images (step S122), reproduction of music (step S123), and display of lyrics (step S125 or S127). These processes are performed in parallel with timing.

  After the exercise support processing for the i-th measure is completed in step S105, the control computer 10 checks whether or not the above-described processing is completed for all the measures of the music (step S106), and the processing for all the measures is completed. If not (S106: NO), 1 is added to the variable i (step S107), the process returns to step S105, and the exercise support process for the i-th measure is repeated. When the processes for all the measures are completed (S106: YES), the control computer 10 ends the exercise support process.

  In the exercise support device 1 according to the present invention having the above-described configuration, a support image such as a three-dimensional person image that supports exercise is displayed on the first display unit 121a or the second display unit 121b provided on the housing 12, and is supported. In response to the display of the image, the music selected by the user is reproduced and output from the speaker 123, and the lyrics are displayed together with the support image at an appropriate position of the music so that the user can sing along with the favorite music. While doing exercise. Also, importance is determined in advance for each music part such as a plurality of bars constituting the music, and is stored in the server computer 3 as importance data, and the control computer 10 of the exercise support apparatus 1 that has obtained the data displays lyrics. Exercise support according to the music such as letting the user sing only in the rust part of the music, etc. realizable. Thereby, the user can enjoy exercising by singing, and can continue exercising without getting bored. Moreover, since it is the structure which makes a user sing only in one part instead of all the music, a user can be made to exercise reliably, without reducing a momentum. Therefore, the user can continue the exercise while having fun, and can reliably achieve the purposes such as health promotion and diet.

  In addition, the exercise support apparatus 1 acquires the user's exercise ability (exercise level) determined from the age, sex, exercise frequency (exercise habit), etc. input by the user from the personal information management computer 2 as personal information. For example, the lyrics are displayed and the user is allowed to sing by adopting a configuration that determines the exercise content to be performed by the user based on the athletic ability and the display stage of the lyrics of the music (or the importance of the measure of the music) It is possible to allow the user to perform exercise and singing in a well-balanced manner, such as performing exercise with a low difficulty level when entertaining and not displaying lyrics when performing an exercise with high difficulty level. Moreover, since the exercise | movement content is determined automatically in consideration of a user's athletic ability, each user can be made to perform an optimal exercise | movement.

  Further, the exercise support apparatus 1 accepts selection of music by the user by displaying the music selection screen shown in FIG. 8 and the like, and sets the exercise type (genre) according to the type (genre) of the accepted music. By determining and determining the content of the exercise in consideration of the exercise genre, it is possible to cause the user to perform an exercise suitable for the selected music piece, and the user can exercise while having more fun.

  In addition, the exercise support device 1 determines whether the display stage of the lyrics is hidden, simple display (hamming display), or complete display based on the importance level for each measure constituting the music, and the lyrics are not displayed. By making the movement corresponding to the bars of the high difficulty level and the movement corresponding to the bars whose lyrics are completely displayed a low difficulty level, the user's exercise effect can be enhanced and the user can concentrate. Can sing and enjoy singing.

  In addition, the exercise support apparatus 1 acquires music data and lyrics data from the server computer 3, acquires importance data related to the importance determined for each measure constituting the music, and determines the importance of each measure. The user can sing by appropriately setting the importance of each measure, such as increasing the importance of the chorus part of the song by determining the display of the lyrics and the content of exercise etc. Can enjoy more.

  In addition, by setting the importance for each of a plurality of bars constituting the music and determining the display of lyrics and the content of exercise for each bar, the intro, A melody, B melody, rust, etc. for each bar It is easy to determine which one belongs, and since the time length of each measure is often constant, it is easy to associate music, lyrics, and importance as data. The processing for these data can be easily performed uniformly.

  In addition, in this Embodiment, although it was set as the structure which provides two display parts (the 1st display part 121a and the 2nd display part 121b) in the housing | casing 12 of the exercise assistance apparatus 1, it does not restrict to this but one or It is good also as a structure which provides three or more display parts. The exercise support device 1 is configured to display both the support image and the lyrics of the music on the first display unit 121a or the second display unit 121b. However, the present invention is not limited to this, and the support image is displayed on the first display unit 121a. It is good also as a structure of displaying and displaying a lyrics on the 2nd display part 121b.

  Moreover, although this Embodiment is comprised as a system using several apparatuses, such as the exercise assistance apparatus 1, the personal information management computer 2, and the server computer 3, it is not restricted to this, Only the exercise assistance apparatus 1 is comprised. It is good also as a structure which performs all the processes. In addition, the system includes one personal information management computer 2 and one server computer 3, but the present invention is not limited to this. A system including two or more personal information management computers 2 or server computers 3 may be used.

  Further, the music selection screen shown in FIG. 8 is configured to search for music by directly inputting a singer's name or selecting a music genre. However, the present invention is not limited to this. Other selection methods may be employed, such as a list display and a configuration in which the displayed singer name and song name are selected by the user.

  In addition, the setting of the importance level, the determination of the display stage of the lyrics, the determination of the exercise content, and the like are performed for each measure of the music. However, the present invention is not limited to this, and the music may be a prelude, A melody, B melody, chorus, It is good also as a structure which divides | segments into an interlude and a postlude, etc., and sets the importance etc. for every part. Moreover, although it was set as the structure which determines to non-display, a humming display, and a complete display as a display stage of a lyric, it is not restricted to this, For example, it is good also as a structure determined to display or non-display. In addition, when the importance of the measure of the music is “3”, the exercise content is “no exercise (upright)”, but this is not limited to this. For example, the difficulty level is displayed in two steps. May be.

It is a mimetic diagram showing the whole system composition using the exercise support device concerning the present invention. It is a typical external view which shows the external appearance of the exercise assistance apparatus which concerns on this invention. It is a block diagram which shows the structure of the exercise assistance apparatus which concerns on this invention. It is a block diagram which shows the structure of a personal information management computer and a server computer. It is a schematic diagram which shows an example of the initial registration screen for registering personal information. It is a schematic diagram which shows one structural example of personal information DB. It is a schematic diagram which shows one structural example of an exercise level conversion table. It is a schematic diagram which shows one structural example of a music selection screen. It is a schematic diagram which shows one structural example of music genre DB. It is a schematic diagram which shows one structural example of music DB. It is a schematic diagram which shows an example of importance data. It is a schematic diagram which shows an example of a genre determination table. It is a schematic diagram which shows one structural example of exercise | movement DB. It is a schematic diagram which shows one structural example of aerobics DB. It is a schematic diagram which shows an example of a lyrics display table. It is a schematic diagram which shows an example of the determined exercise | movement content and a lyric display. It is a flowchart which shows the procedure of the reception process of the personal information which a personal information management computer performs. It is a flowchart which shows the procedure of the determination process of the exercise | movement content and lyrics display which the control computer of an exercise | movement assistance apparatus performs. It is a flowchart which shows the procedure of the determination process of the exercise | movement content and lyrics display which the control computer of an exercise | movement assistance apparatus performs. It is a flowchart which shows the procedure of the determination process of the exercise | movement content and lyrics display which the control computer of an exercise | movement assistance apparatus performs. It is a flowchart which shows the procedure of the transmission process of the personal information which a personal information management computer performs. It is a flowchart which shows the procedure of the transmission process of the importance data which a server computer performs. It is a flowchart which shows the procedure of the exercise | movement assistance process which the control computer of an exercise | movement assistance apparatus performs. It is a flowchart which shows the procedure of the exercise | movement assistance process of the i-th bar which the control computer of an exercise | movement assistance apparatus performs.

Explanation of symbols

1 exercise support device 2 personal information management computer 3 server computer 10 control computer (computer)
12 chassis 21 CPU
26 storage unit 31 CPU
36 storage unit 101 CPU (display processing means, reproduction means, data acquisition means, determination means, lyrics display processing means, exercise ability acquisition means, exercise content determination means, reception means, exercise type determination means)
105 storage unit 105a control program (computer program)
105b Music Genre DB
105c Genre determination table 105d Exercise DB
105e Lyrics display table 121a First display section (display section)
121b Second display section (display section)
122 Operation Unit 123 Speaker 124 Camera 261 Control Program 262 Personal Information DB
263 Movement level conversion table 361 Control program 362 Music DB

Claims (8)

In an exercise support apparatus comprising display processing means for performing processing for displaying a support image for supporting exercise on a display unit,
Playback means for playing back music corresponding to the display of the support image on the display unit;
Data acquisition means for acquiring music data relating to the music reproduced by the reproduction means and lyrics data relating to the lyrics of the music;
Determination means for determining a display stage related to display of the corresponding lyrics on the display unit for a plurality of music parts constituting the music;
And a lyric display processing means for performing a lyric display processing process on the display section associated with the music portion of the music to be reproduced by the reproduction means based on the display stage determined by the determination means. Support device. Athletic ability acquisition means for acquiring a user's athletic ability;
An exercise content determination means for determining the content of the exercise to be supported based on the exercise ability acquired by the exercise capability acquisition means and the display step of the lyrics determined by the determination means;
2. The display processing unit according to claim 1, wherein the display processing unit performs a process of displaying on the display unit a support image that supports exercise according to the exercise content determined by the exercise content determination unit. Exercise support device. An accepting means for accepting a selection related to one or a plurality of songs;
An exercise type determining means for determining an exercise type according to the type of music received by the receiving means;
The exercise content determining means determines the exercise content based on the exercise type determined by the exercise type determining means, together with the exercise ability and lyrics display step. Exercise support device. The determination means performs determination in three display stages: non-display that does not display lyrics of the music portion, simple display that displays the lyrics in an abstracted or simplified manner, and complete display that displays the lyrics. ,
The exercise content determination means determines the exercise corresponding to the music portion whose lyrics are not displayed as a highly difficult exercise compared to the exercise corresponding to the music portion where the lyrics are simply displayed, and the song portion where the lyrics are completely displayed. The exercise support apparatus according to claim 2 or 3, wherein the exercise corresponding to the above is determined as an exercise of a low difficulty level. The data acquisition means is configured to further acquire data relating to the importance determined for each music part of the music,
The exercise support apparatus according to claim 1, wherein the determination unit is configured to determine the display stage according to the importance. The exercise support apparatus according to any one of claims 1 to 5, wherein the music portion is a bar constituting the music. In an exercise support method for supporting a user's exercise by displaying a support image supporting the exercise on a display unit,
Acquire music data related to the music and lyrics data related to the lyrics of the music,
For a plurality of music parts constituting the music, determine the display stage related to the display on the display unit of the corresponding lyrics,
In response to the display of the support image on the display unit, the music is played,
An exercise support method, comprising: displaying lyrics on the display unit associated with the music portion of the music to be played back based on the determined display stage. In a computer program for supporting a user's exercise by displaying a support image supporting the exercise on a display unit on a computer,
On the computer,
Determining a display step related to display of the corresponding lyrics on the display unit for a plurality of music parts constituting the music;
Playing back music corresponding to the display of the support image on the display unit;
And a step of displaying lyrics on the display unit associated with the music portion of the music to be reproduced based on the determined display stage.

Images