CN110678920A - Data output system and data output method - Google Patents
Data output system and data output method Download PDFInfo
- Publication number
- CN110678920A CN110678920A CN201780085802.9A CN201780085802A CN110678920A CN 110678920 A CN110678920 A CN 110678920A CN 201780085802 A CN201780085802 A CN 201780085802A CN 110678920 A CN110678920 A CN 110678920A
- Authority
- CN
- China
- Prior art keywords
- information processing
- processing apparatus
- information
- data
- score
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims description 16
- 230000010365 information processing Effects 0.000 claims abstract description 164
- 238000004891 communication Methods 0.000 description 23
- 238000010586 diagram Methods 0.000 description 19
- 230000033001 locomotion Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000005286 illumination Methods 0.000 description 6
- 208000023514 Barrett esophagus Diseases 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 239000004984 smart glass Substances 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000012447 hatching Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10G—REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS
- G10G1/00—Means for the representation of music
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Auxiliary Devices For Music (AREA)
- Electrophonic Musical Instruments (AREA)
Abstract
A data output system (1) is provided with an information processing device (10) and an information processing device (20). The information processing device (10) has an output unit (141) that outputs position information indicating a position in a music piece to the information processing device (20). An information processing device (20) is provided with: an information input unit into which position information is input from an information processing device (10); a position output unit (23) that outputs position data in a predetermined format indicating a position, based on the position information; and a score output unit (24) for outputting score display data for displaying a score of the music piece in accordance with the position data.
Description
Technical Field
The invention relates to a system and a method for outputting data.
Background
Techniques for displaying a musical score in a computer apparatus are known. For example, patent document 1 describes a technique of transmitting data of a musical score stored in a server to a display device.
Patent document 1: japanese laid-open patent publication No. 2004-20807
Disclosure of Invention
In the technique described in patent document 1, the player must perform an operation for turning the pages of the musical score, and the operation may hinder the performance. In view of this, the present invention provides a technique of reducing the load of a player on updating the display of a musical score.
The present invention provides a data output system, comprising: 1 st information processing apparatus; and a 2 nd information processing device, the 1 st information processing device having a position output portion that outputs information indicating a position in the music to the 2 nd information processing device, the 2 nd information processing device having: an information input unit to which the information is input from the 1 st information processing apparatus; a position output unit that outputs position data in a predetermined format indicating the position, based on the information; and a score output unit that outputs score display data for displaying a score of the music piece in accordance with the position data.
The 2 nd information processing apparatus may include an operation input unit that receives an operation input from a user, and the 1 st information processing apparatus may include an instruction output unit that outputs an instruction to invalidate the operation input unit of the 2 nd information processing apparatus.
The data output system may further include a 3 rd information processing device, wherein the position output unit outputs the information to the 2 nd information processing device and the 3 rd information processing device, and wherein the 3 rd information processing device includes: an information input unit to which the information is input from the 1 st information processing apparatus; a position output unit that outputs position data in a predetermined format indicating the position, based on the information; and a score output unit that outputs score display data representing a score of the music piece corresponding to the position data, the score output unit of the 2 nd information processing apparatus and the score output unit of the 3 rd information processing apparatus each outputting the score display data of a different sound part in the music piece.
The data output system may further include a 4 th information processing apparatus, and the 4 th information processing apparatus may include: an information input unit to which the information is input from the 1 st information processing apparatus; a position output unit that outputs position data in a predetermined format indicating the position, based on the information; and a data output unit that outputs data for controlling an operation other than the display of the musical score to another device in accordance with the position data.
In addition, the present invention provides a data output method including the steps of: the 2 nd information processing apparatus acquires information indicating a position in the music from the 1 st information processing apparatus; the 2 nd information processing apparatus outputting position data in a predetermined format indicating the position based on the information; and the 2 nd information processing apparatus outputs score display data for displaying a score of the music piece to a display apparatus based on the position data.
ADVANTAGEOUS EFFECTS OF INVENTION
According to the present invention, the load on the player when updating the display of the musical score can be reduced.
Drawings
Fig. 1 is a diagram showing an outline of a data output system 1 according to an embodiment.
Fig. 2 is a diagram illustrating a functional configuration of the information processing apparatus 10.
Fig. 3 is a diagram illustrating a functional configuration of the information processing apparatus 20.
Fig. 4 is a diagram illustrating a hardware configuration of the information processing apparatus 10.
Fig. 5 is a diagram illustrating a hardware configuration of the information processing apparatus 20.
Fig. 6 is a diagram illustrating a software configuration in the information processing apparatus 20.
Fig. 7 is a timing chart showing an operation according to an embodiment of the data output system 1.
Fig. 8 is a flowchart showing an operation according to an embodiment of the data output system 1.
Fig. 9 is a flowchart showing an operation according to an embodiment of the data output system 1.
Fig. 10 is a diagram illustrating a musical score displayed in the display device 30.
Fig. 11 is a diagram illustrating a UI screen in the control program.
Fig. 12 is a diagram illustrating a display screen of a musical score updated in accordance with position data.
Description of the reference numerals
1 … data output system, 10 … information processing device, 11 … storage unit, 12 … display unit, 13 … operation input unit, 14 … position output unit, 20 … information processing device, 21 … storage unit, 22 … information input unit, 23 … position output unit, 24 … score output unit, 25 … operation input unit, 30 … display device, 101 … CPU, 102 … memory, 103 … memory, 104 … communication IF, 105 … display, 106 … input device, 201 … CPU, 202 … memory, 203 … memory, 204 … communication IF, 205 … display, 206 … input device
Detailed Description
1. Structure of the product
Fig. 1 is a diagram showing an outline of a data output system 1 according to an embodiment. The data output system 1 is a system for displaying a score (score partscore) corresponding to an instrument played by each player at the time of ensemble, for example. The data output system 1 includes an information processing device 10 and a plurality of information processing devices 20. The information processing device 10 is a device serving as a master of the data output system 1, and the information processing device 20 is a device serving as a slave. The information processing apparatus 10 is an example of the 1 st information processing apparatus. The information processing apparatus 10 controls the plurality of information processing apparatuses 20. The information processing apparatus 20 is an apparatus for performing output of a musical score. In this example, the display device 30 displays a musical score. The display device 30 displays a musical score in accordance with musical score display data described later. Also, here, "score display data" refers to data used for displaying a score in the display device 30. The information processing device 20 is a device for controlling the display device 30, and is connected to the display device 30. In this example, the data output system 1 includes a plurality of (2 in the example of the drawing) information processing apparatuses 20. In distinguishing each information processing apparatus 20, a corner mark is used as in the case of the information processing apparatus 20A or 20B. The same applies to the display device 30. The information processing apparatus 20A is an example of a 2 nd information processing apparatus, and the information processing apparatus 20B is an example of a 3 rd information processing apparatus.
Fig. 2 is a diagram illustrating a functional configuration of the information processing apparatus 10. In this example, the information processing apparatus 10 is operated by an operator other than the player. The information processing apparatus 10 includes: a storage unit 11, a display unit 12, an operation input unit 13, and an output unit 14. The storage unit 11 stores various data. The display unit 12 displays various information. The operation input unit 13 receives an operation input by an operator. The output unit 14 outputs various information to the information processing device 20. In this example, the output unit 14 includes a position output unit 141 and an instruction output unit 142. The position output unit 141 outputs position information indicating a position in a music piece performing a performance (hereinafter referred to as "performance music piece") to the information processing device 20. Instruction output unit 142 outputs an instruction to invalidate an operation input in information processing apparatus 20 to information processing apparatus 20 (details will be described later).
Fig. 3 is a diagram illustrating a functional configuration of the information processing apparatus 20. In this example, the information processing apparatus 20 is held by a player. The information processing device 20 includes: a storage unit 21, an information input unit 22, a position output unit 23, a musical score output unit 24, and an operation input unit 25. The storage unit 21 stores various data. The information input unit 22 receives input of position information from the information processing device 10. The position output unit 23 outputs position data indicating a position in the musical performance music in a predetermined data format based on the position information output from the position output unit 141 of the information processing device 10. The score output unit 24 outputs score display data representing a score for performing a music piece in accordance with the position data. In this example, the musical score output unit 24 outputs musical score display data to the display device 30.
The operation input unit 25 receives an operation input by a user, i.e., a player. The information processing apparatus 20 performs processing corresponding to an operation input in the operation input unit 25. The operation input unit 25 invalidates the operation input if an instruction to invalidate the operation input in the operation input unit 25 is given from the instruction output unit 142 of the information processing apparatus 10. That is, processing corresponding to the operation input is not performed.
Fig. 4 is a diagram illustrating a hardware configuration of the information processing apparatus 10. The information processing apparatus 10 is a computer apparatus having a CPU 101, a memory 102, a storage 103, a communication IF 104, a display 105, and an input device 106. Specifically, for example, a personal computer, a tablet terminal, or a smartphone. The CPU 101 is a control device that executes a program to control other hardware elements of the information processing device 10. The memory 102 is a main storage device that functions as a work area when the CPU 101 executes a program, and includes, for example, a ram (random Access memory). The storage 103 is a nonvolatile auxiliary storage device for storing various programs and data, and includes, for example, ssd (solid State drive) or hdd (hard disk drive). The communication IF 104 is an Interface for communicating with other devices, and includes, for example, an nic (network Interface card). The communication IF 104 can perform wireless communication according to standards of WiFi (registered trademark) or the like. The display 105 is a display device for displaying information, and includes, for example, an lcd (liquid Crystal display). The input device 106 is a device for a user to input instructions or information with respect to the information processing device 10, and includes, for example, a touch sensor or a keyboard.
In this example, the storage 103 stores a program (hereinafter referred to as a "control program") for causing the computer device to function as a main control unit (server) in the data output system 1. The CPU 101 executes the control program, thereby installing the functions of fig. 2 in the computer apparatus. At least one of the memory 102 and the storage 103 is an example of the storage unit 11. The display 105 is an example of the display unit 12. The input device 106 is an example of the operation input unit 13. The communication IF 104 is an example of the output unit 14.
Fig. 5 is a diagram illustrating a hardware configuration of the information processing apparatus 20. The information processing apparatus 20 is a computer apparatus having a CPU 201, a memory 202, a storage 203, a communication IF204, a display 205, and an input device 206, and specifically, is, for example, a smartphone or a tablet terminal. The CPU 201 is a control device that executes a program to control other hardware elements of the information processing device 20. The memory 202 is a main storage device that functions as a work area when the CPU 201 executes a program, and includes, for example, a RAM. The storage 203 is a nonvolatile auxiliary storage device that stores various programs and data, and includes, for example, an SSD or an HDD. Communication IF204 is an interface for communicating with other devices, and includes an antenna and a chipset for performing wireless communication, for example. In this example, communication IF204 corresponds to a plurality of communication standards, and communicates with information processing apparatus 10 via WiFi (registered trademark) and communicates with display apparatus 30 via Bluetooth (registered trademark), for example. Communication IF204 may perform wired communication with information processing apparatus 10 or may perform wired communication with display apparatus 30. The display 205 is a display device for displaying information, and includes an LCD, for example. The input device 206 is a device for a user to input instructions or information with respect to the information processing device 10, and includes at least 1 of a touch sensor, a button, and a keyboard, for example.
Fig. 6 is a diagram illustrating a software configuration in the information processing apparatus 20. The storage 203 stores an OS (operating system) 291, a relay program 292, and a music score display program 293. The OS 291 is a program for providing a standard interface to users and applications and managing resources such as hardware. The relay program 292 is a program for converting the position information supplied from the information processing device 10 into position data in a predetermined format. The musical score display program 293 is a program for displaying a musical score. At least one of the memory 202 and the storage 203 is an example of the storage unit 21. Communication IF204 is an example of information input unit 22. The CPU 201 executing the relay program 292 is an example of the position output unit 23. The CPU 201 executing the score display program 293 is an example of the score output part 24. The input device 206 is an example of the operation input unit 25.
In addition, the storage 203 stores score data of a score representing a piece of music performing performance. In this example, 1 player holds each of the information processing device 20 and the display device 30. The memory 203 stores a score of a Part (instrument) played by a corresponding player.
The functional configuration and hardware configuration of the display device 30 are not specifically described, but the display device 30 may have any hardware configuration as long as it displays an image according to input data. The display device 30 is, for example, a wearable device called smart glasses or a scout mirror (scout). Smart glasses or spy glasses are display devices of the so-called see-through type (sethrough). That is, the player can visually recognize the image displayed on the front panel (glass of glasses) and visually recognize the periphery through the panel. This allows the player to see the musical score and the instrument in hand. Alternatively, the display device 30 may also be a non-wearable device using a projector or direct-view display.
2. Movement of
Fig. 7 is a sequence diagram illustrating an operation according to an embodiment of the data output system 1, and fig. 8 and 9 are flowcharts illustrating an operation according to an embodiment of the data output system 1. Here, the following example is used for explanation. The data output system 1 is used in a concert. The information processing apparatus 10 (an example of the 1 st information processing apparatus) is a personal computer. The information processing device 10 is installed at a position invisible to an audience on the side of a Stage (Stage sleep), for example, and is operated by an operator other than a performer. The data output system 1 includes 2 slave units (only 1 information processing apparatus 20 is shown in the drawing) of an information processing apparatus 20A (an example of a 2 nd information processing apparatus) and an information processing apparatus 20B (an example of a 3 rd information processing apparatus). The information processing device 20 is a smartphone, and each player holds the information processing device 20 by putting in a pocket of clothes or the like. The display device 30 is a wearable apparatus. At the time of ensemble, 2 players, players a and B, participate in the ensemble. The player a plays a violin and the player B plays a cello. The information processing device 20A stores the score of the violin, and the display device 30A displays the score of the violin. The information processing device 20B stores the score of the cello, and the display device 30B stores the score of the cello. In the following, software such as a control program may be described as a main body of processing, but this means that a hardware element such as the CPU 101 that executes the software cooperates with another hardware element to execute processing.
First, description is given with reference to fig. 7 and 8. In step S101, the operator inputs information for performing initial setting with respect to the control program of the information processing apparatus 10. The information for performing the initial setting includes, for example, information for specifying a music piece to be played and information for specifying a size (for example, m measure × n segment) of a musical score displayed on the screen. The information for performing the initial setting also includes information indicating the correspondence relationship between the information processing device 20 and the musical instrument (for example, information for associating the information processing device 20A with a violin and the information processing device 20B with a cello). The control program performs initial setting in accordance with the input information. For example, the control program reads out score data of a music piece being performed from a plurality of score data stored in the storage 103. Score data is described in a prescribed format (e.g., midi (musical instrument digital interface) format). The control program generates score display data for displaying a score on the display 105 using the read score data. The display 105 displays the musical score in accordance with the musical score display data. The musical score displayed in the information processing apparatus 10 is a total score of a musical score including a plurality of vocal parts.
In step S102, the control program transmits information for performing initial setting to the information processing apparatuses 20A to 20C. Identification information for specifying the information processing device 20 constituting the data output system 1 is associated with identification information of a corresponding musical instrument and registered in advance in the control program. The control program refers to the information and determines a transmission destination of the information for performing the initial setting. The score display program performs initial setting according to the received information. For example, the control program reads out score data of a sound part of a music piece being performed, from among a plurality of score data stored in the memory 203. The score data is described in a predetermined format (for example, MIDI format). The control program generates score display data for displaying a score on the display 205 using the read score data. The display 205 displays the musical score in accordance with the musical score display data. The music score displayed in the display device 30A is a score of a violin, and the music score displayed in the display device 30B is a score of a cello.
Fig. 10 is a diagram illustrating a musical score displayed in the display device 30. In this example, a musical score of 3 measure × 2 measure, which amounts to 6 measures, is displayed on one screen. The reason why only 6 measures of music score are displayed is that, in the case of a wearable device, since the screen of most of the display devices 30 is small, a large number of measures are displayed on one screen and are not easy to view. Note that, in this example, a musical score of 6 bars in total of 3 bars × 2 pieces is displayed, but the musical score displayed on one screen may be appropriately changed according to the size and resolution of the screen of the display device.
The description will be made with reference to fig. 7 and 8 again. In step S103, the user determines whether or not the operation input via the input device 206 is invalidated in the information processing device 20. When the user determines to invalidate, the control program outputs, to the information processing apparatus 20, an instruction to invalidate the operation input via the input device 206 in the musical score display program 293 based on the operation of the input device 106 in the information processing apparatus 10 by the user. Upon receiving an instruction to invalidate the operation input from the information processing apparatus 10, the musical score display program switches the operation mode from the normal mode (one example of the 1 st operation mode) to the remote control mode (one example of the 2 nd operation mode) (step S104). The normal mode is a mode in which, if the user makes an operation input via the input device 206, the musical score display program 293 updates the display of the musical score in accordance with the operation input thereof. The update of the display includes, for example, processing corresponding to turning of a sheet of a musical score or change of a size (magnification). When the music score display program 293 operates in the normal mode, if the user operates, for example, a touch panel (an example of the input device 206), the music score display program 293 turns a page or changes the magnification of a music score according to the operation input by the user. The remote control mode is an operation mode in which an operation input via the input device 206 is invalidated, and is a mode in which the musical score display program 293 does not update the display of the musical score even if the user performs an operation input via the input device 206. In the remote control mode, the musical score display program 293 updates the display of the musical score in correspondence with instructions provided from other software or hardware. The music score display program 293 can be used for various purposes by installing a normal mode and a remote control mode in the music score display program 293. In a case where the musical score display program 293 does not have the remote control mode, for example, when the player accidentally touches the touch panel (an example of the input device 206) of the information processing device 20 during the performance, the display of the musical score may be updated against the intention of the player. In the present embodiment, in order to prevent unintended display update by the player, the operation input via the input device 206 is invalidated, and the update of the display of the musical score is controlled by the information processing device 10.
Fig. 11 is a diagram illustrating a UI (User Interface) screen in the control program (information processing apparatus 10). The UI screen includes a window 51 and buttons 52. The window 51 is a region where a musical score is displayed. The score is displayed in a size specified by the operator. In this example, a musical score of 8 bars × 8 lines is displayed in the window 51. The control program stores position information indicating a position on the musical score. The position information is, for example, information for specifying a measure currently being performed. In the window 51, the bar currently being played is displayed using a different display mode (appearance) from the other bars. In this example, the bar currently being played is highlighted (represented by diagonal hatching in the figure). The operator listens to the ensemble of the players a and B on the stage, and presses the button 52 when the playing position reaches a new bar. The button 52 is a UI object for notifying the control program of the fact that the performance position reaches a new bar (next bar).
Next, description will be given with reference to fig. 7 and 9. If it is determined that the performance position reaches the new bar, the operator presses the button 52 (step S105). If it is detected that the button 52 is pressed, the control program transmits the position information to the information processing apparatus 20 (step S106). The position information transmitted here indicates the absolute value of the bar number corresponding to the performance position. This is because if the bar number is stored on the client side (score display program 293) and the position information indicates only "the performance enters a new bar", the client cannot grasp the correct performance position if data is lost during transmission. In this example, the location information is broadcast using a connectionless communication protocol, specifically, using UDP (User datagram protocol) without specifying a communication destination. In the present example, the control program repeatedly transmits the same position information a plurality of times (for example, 10 to 20 times at intervals of 50 msec) at predetermined time intervals. The reason for this is that retransmission of lost data (packets) is not supported in the communication protocol (UDP).
The timing at which the operator presses the button 52 is not limited to the bar unit. The operator may also press the button 52 at a timing corresponding to the tempo of the performance. In this case, the control program manages the position information in units of beats. The position information used in the data output system 1 may be a combination of the absolute value of the bar number and the absolute value of the beat number in the bar, or a beat number given by a serial number to the music piece.
In the case where the beat number or the combination of the beat number and other information is used as the position information, the control program may display information corresponding to the beat number together on the UI screen illustrated in fig. 11. The information corresponding to the tempo number is, for example, an image object such as a cursor that moves in the time axis direction of the musical score (in the example of fig. 11, the direction from left to right). The image object moves from left to right at least in a unit of a beat as the performance proceeds. The image object is an image of a vertical bar, a triangular mark, an arrow, or the like representing a color (e.g., red) different from that of the musical score part. Alternatively, the image object may be an image of a numeric value or a symbol indicating a numeric value of a beat number (a beat number within a bar or a beat number continuing in a music piece). The image object may be displayed at a predetermined position in the musical score or may be displayed in a bar (hatched portion in fig. 11) currently being played.
In information processing apparatus 20, relay program 292 receives (i.e., acquires) the position information from information processing apparatus 10. The relay program 292 converts the received position information into position data describing a position on the musical score in a predetermined format (or generates position data) (step S107). As a format of the position data, for example, a MIDI format is used. MIDI is a data format widely used for the transmission of score information and has high versatility. In step S108, the relay program 292 outputs the position data to the musical score display program 293.
The musical score display program 293 generates musical score display data for causing the display device 30 to display a musical score in accordance with the position data input from the relay program 292 (step S109). The musical score display data is, for example, image data of a musical score. The musical score display program 293 transmits the musical score display data to the display device 30 (step S110). The display device 30 displays the musical score in accordance with the musical score display data.
Fig. 12 is a diagram illustrating a display screen of a musical score updated in accordance with position data. In this example, the bar specified by the position data is displayed first (upper left), and then the 5 bars following the bar are displayed in order. The partial spectrum of the sound part to be played by the user is displayed on the display device 30. The bar specified by the position data, i.e., the bar corresponding to the performance position is highlighted. The player can play the musical instrument while viewing the score. When the position information includes the beat number, an image object indicating the beat number may be displayed in fig. 12, as in fig. 11. The image object may be displayed at a predetermined position on the screen or may be displayed within a bar currently being played (hatched portion in fig. 12).
The operator of the information processing apparatus 10, while listening to the performance on the stage, presses the button 52 if it is determined that the performance has reached a new measure. If the operator presses the button 52, the processing of steps S106 to S110 is repeatedly executed. Since the operation for updating the display of the musical score is performed by an operator other than the player, the load on the player is reduced, and the player can concentrate on the performance of the musical instrument.
3. Modification example
The present invention is not limited to the above-described embodiments, and various modifications can be made. Next, several modifications will be described. In the following modifications, 2 or more of the following modifications may be used in combination.
The specific method of acquiring the performance position by the information processing device 10 is not limited to the example described in the embodiment, and a human operator listens to the performance and determines whether or not the performance position reaches a new bar, and inputs the fact that the performance position reaches the new bar via the input device 106. The information processing apparatus 10 can acquire a performance position on the musical score in accordance with the motion of a stick waved by a performer (e.g., a director) on the stage. The motion of the stick is detected by, for example, a sensor (for example, an acceleration sensor) incorporated in the stick. The wand and the information processing device 10 communicate with each other by Bluetooth (registered trademark), for example. The baton transmits data indicating the motion detected by the built-in sensor to the information processing apparatus 10. In the information processing apparatus 10, the control program acquires bar or beat information based on the motion of the stick indicated by the data received from the stick. The control program makes bar numbers absolute (1 by 1) based on the acquired bar or beat information, and transmits the bar numbers as position information to the information processing device 20. In this example, at least a part of the technology described in japanese patent No. 4626087 can be applied. The method of detecting the motion of the stick is not limited to the method using a built-in sensor of the stick. For example, the control program may detect the motion of the stick using an external sensor such as a camera. In this case, the information processing apparatus 10 need not communicate with the wand, and may communicate with the camera. The object of motion detection is not limited to the stick, and the performance position on the musical score may be acquired according to the motion of the musical instrument performed by the player. Further, when acquiring information for specifying a beat as in this example, the data output system 1 may use a beat number or a combination of a bar number and a beat number as the position information.
Alternatively, the control program of the information processing apparatus 10 may automatically acquire the performance position on the musical score based on the sound signal. As a technique for obtaining a musical performance position on a Score from a sound signal, for example, a technique described in japanese patent application laid-open No. 2015-114360 or a Score alignment (Score alignment) technique described in japanese patent application laid-open No. 2015-79183 can be used.
The control program of the information processing apparatus 10 may acquire the performance position on the musical score in accordance with a signal (e.g., MIDI signal) output from the musical instrument. In this case, the input device 106 receives an input of a signal (e.g., MIDI signal) output from the musical instrument. The control program adds the bar numbers in accordance with the MIDI signals, and transmits the bar numbers as position information to the information processing device 20. In addition, the information processing apparatus 10 may be an electronic musical instrument having a communication IF. In this case, the electronic musical instrument may have an input operation member such as a button or a pedal, and the position information may be transmitted in accordance with an operation performed on the input operation member.
In the above-described embodiment, the information processing device 20 controls the display device 30, but may control a device that performs an operation other than the display of the musical score. For example, the information processing device 20 may control an illumination device (not shown). The information processing apparatus 20 in this case is an example of the 4 th information processing apparatus. In this example, the information processing apparatus 20 executes an illumination control program (not shown) instead of the musical score display program 293. The lighting control program is a program for controlling the lighting device, and is an example of a program for controlling operations other than the display of a musical score. The sequence for controlling the lighting is controlled by, for example, MIDI data. The memory 203 of the information processing device 20 stores MIDI data describing the control procedure of lighting in accordance with the music being played. The lighting control program specifies the performance position using the position data output from the relay program 292, and outputs a command corresponding to the performance position to the lighting device. The illumination device controls illumination in accordance with a command output from the information processing device 20. This command is an example of data for controlling an action other than the display of the musical score. According to this example, the brightness, color, position, or size of the illumination can be controlled according to the actual music. In the information processing device 20, the CPU 201 that executes the illumination control program is an example of a data output unit that outputs data for controlling operations other than the display of the musical score to other devices in accordance with the position data.
Although the relay program 292 repeatedly receives position information indicating the same bar number a plurality of times, the relay program 292 may generate position data each time position information is received. Alternatively, if the location information is received, the relay program 292 may determine whether the location information received this time is the same as the location information received last time, and may generate no location data only when it is determined that the location information different from the location information received last time is received.
The software configuration in the information processing device 20 is not limited to the configuration illustrated in the embodiment. For example, although the embodiment describes an example in which the position output unit 23 and the score output unit 24 are installed in different programs, these 2 functions may be installed in one program.
The functional configuration of the data output system 1 is not limited to the configuration illustrated in the embodiment. For example, a part of the functions illustrated in fig. 2 and 3 may be omitted. Specifically, the remote control mode may not be installed in the score display program of the information processing apparatus 20, and in this case, the control program of the information processing apparatus 10 may not have the function of the instruction output unit 142.
The processing performed by the information processing device 20 using the position data is not limited to the processing illustrated in the embodiment. The information processing device 20 may perform any processing such as playing of an electronic musical instrument or control of a stage device. In this case, the system may be configured using only the information processing apparatus 20 and the information processing apparatus 10 that perform only processing other than display of the musical score.
The data format, communication protocol, and the like described in the embodiments are merely examples, and the present invention is not limited thereto. Data forms or communication protocols other than those exemplified in the embodiments may also be used.
The hardware configuration of the data output system 1 is not limited to the configuration illustrated in the embodiment. For example, a device having the functions of these 2 devices may be used instead of the information processing device 20 and the display device 30.
The programs executed by the information processing devices 10 and 20 may be provided from a storage medium such as an optical disk, a magnetic disk, or a semiconductor memory, or may be downloaded via a communication line such as the internet. In addition, these programs need not have all of the steps of FIG. 7. A part of these steps may be omitted. Although the information processing device 20 is described as being held by the player, the player may not hold the information processing device 20 unless the player does not have to hold the information processing device.
Claims (5)
1. A data output system having:
1 st information processing apparatus; and
the 2 nd information processing apparatus, which is capable of processing a plurality of information,
the 1 st information processing apparatus has a position output section that outputs information indicating a position in a music piece to the 2 nd information processing apparatus,
the 2 nd information processing apparatus includes:
an information input unit to which the information is input from the 1 st information processing apparatus;
a position output unit that outputs position data in a predetermined format indicating the position, based on the information; and
and a score output unit that outputs score display data for displaying a score of the music piece in accordance with the position data.
2. The data output system of claim 1,
the 2 nd information processing apparatus has an operation input section that receives an operation input from a user,
the 1 st information processing apparatus includes an instruction output unit that outputs an instruction to invalidate the operation input unit of the 2 nd information processing apparatus.
3. The data output system of claim 1 or 2,
the data output system further has a 3 rd information processing apparatus,
the position output unit outputs the information to the 2 nd information processing apparatus and the 3 rd information processing apparatus,
the 3 rd information processing apparatus includes:
an information input unit to which the information is input from the 1 st information processing apparatus;
a position output unit that outputs position data in a predetermined format indicating the position, based on the information; and
a score output unit that outputs score display data representing a score of the music piece in accordance with the position data,
the score output part of the 2 nd information processing apparatus and the score output part of the 3 rd information processing apparatus each output score display data of different sound parts in the music piece.
4. The data output system of any one of claims 1 to 3,
the data output system further has a 4 th information processing apparatus,
the 4 th information processing apparatus includes:
an information input unit to which the information is input from the 1 st information processing apparatus;
a position output unit that outputs position data in a predetermined format indicating the position, based on the information; and
and a data output unit that outputs data for controlling an operation other than the display of the musical score to another device in accordance with the position data.
5. A data output method having the steps of:
the 2 nd information processing apparatus acquires information indicating a position in the music from the 1 st information processing apparatus;
the 2 nd information processing apparatus outputting position data in a predetermined format indicating the position based on the information; and
the 2 nd information processing apparatus outputs score display data for displaying a score of the music piece to a display apparatus based on the position data.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2017-026717 | 2017-02-16 | ||
| JP2017026717 | 2017-02-16 | ||
| PCT/JP2017/039958 WO2018150647A1 (en) | 2017-02-16 | 2017-11-06 | Data output system and data output method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110678920A true CN110678920A (en) | 2020-01-10 |
Family
ID=63170190
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780085802.9A Pending CN110678920A (en) | 2017-02-16 | 2017-11-06 | Data output system and data output method |
Country Status (3)
| Country | Link |
|---|---|
| JP (1) | JP6741085B2 (en) |
| CN (1) | CN110678920A (en) |
| WO (1) | WO2018150647A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7504446B2 (en) | 2020-09-28 | 2024-06-24 | くるみ 北出 | Performance support device, performance support method, and program |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007011220A (en) * | 2005-07-04 | 2007-01-18 | Toshiba Plant Systems & Services Corp | Electronic musical score display device |
| WO2012090279A1 (en) * | 2010-12-27 | 2012-07-05 | キャスティングメディア株式会社 | Musical score display system |
| CN103325362A (en) * | 2012-03-22 | 2013-09-25 | 赵汉青 | Musical performance auxiliary system with collaborative music score turning function |
| JP2013225070A (en) * | 2012-04-23 | 2013-10-31 | Nec Casio Mobile Communications Ltd | Musical score display system, musical score display method, baton, musical score generation device, control method for musical score generation device and program |
| JP2014170087A (en) * | 2013-03-04 | 2014-09-18 | Jvc Kenwood Corp | Musical score display device and musical score display system |
| WO2016080479A1 (en) * | 2014-11-21 | 2016-05-26 | ヤマハ株式会社 | Information provision method and information provision device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5561263B2 (en) * | 2011-09-26 | 2014-07-30 | ヤマハ株式会社 | Musical sound reproducing apparatus and program |
-
2017
- 2017-11-06 WO PCT/JP2017/039958 patent/WO2018150647A1/en active Application Filing
- 2017-11-06 JP JP2018567985A patent/JP6741085B2/en active Active
- 2017-11-06 CN CN201780085802.9A patent/CN110678920A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007011220A (en) * | 2005-07-04 | 2007-01-18 | Toshiba Plant Systems & Services Corp | Electronic musical score display device |
| WO2012090279A1 (en) * | 2010-12-27 | 2012-07-05 | キャスティングメディア株式会社 | Musical score display system |
| CN103325362A (en) * | 2012-03-22 | 2013-09-25 | 赵汉青 | Musical performance auxiliary system with collaborative music score turning function |
| JP2013225070A (en) * | 2012-04-23 | 2013-10-31 | Nec Casio Mobile Communications Ltd | Musical score display system, musical score display method, baton, musical score generation device, control method for musical score generation device and program |
| JP2014170087A (en) * | 2013-03-04 | 2014-09-18 | Jvc Kenwood Corp | Musical score display device and musical score display system |
| WO2016080479A1 (en) * | 2014-11-21 | 2016-05-26 | ヤマハ株式会社 | Information provision method and information provision device |
Also Published As
| Publication number | Publication date |
|---|---|
| JPWO2018150647A1 (en) | 2019-11-07 |
| WO2018150647A1 (en) | 2018-08-23 |
| JP6741085B2 (en) | 2020-08-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102395515B1 (en) | Touch Event Processing Method and electronic device supporting the same | |
| US9348445B2 (en) | Information processing device, information processing method, and information processing program | |
| KR20120004023A (en) | Apparatus and method for playing on musical instruments by augmented reality in portable terminal | |
| KR20150131872A (en) | Electronic device and method for executing a musical performance in the electronic device | |
| US10642409B2 (en) | Electronic instrument controller | |
| US20210166669A1 (en) | Communication method, sound generation method and mobile communication terminal | |
| US20140243086A1 (en) | Server, method for controlling a game in a server, mobile apparatus, method for controlling a mobile apparatus, display apparatus, and method for displaying a game image in a display apparatus | |
| CN110796918A (en) | Training method and device and mobile terminal | |
| JP2021149051A (en) | Musical instrument and musical instrument cooperation program | |
| KR20160059281A (en) | System for practicing piano play | |
| JP6741085B2 (en) | Data output system and data output method | |
| US20180193738A1 (en) | Vibration control system, vibration control apparatus and vibration control method | |
| JP2013144143A (en) | Game device, control method of game device, and program | |
| KR102087491B1 (en) | Music score video output device connected to karaoke system and musical score output method using the same | |
| JPH1138967A (en) | Electronic musical instrument | |
| EP3077069B1 (en) | Program, recording medium, information processing apparatus, and control method | |
| US10033809B2 (en) | Output data providing server, information processing apparatus, information processing system, output data providing method, information processing method, and data structure of content data | |
| CN108337367B (en) | Musical instrument playing method and device based on mobile terminal | |
| JP2016062071A (en) | Electronic equipment, method and program | |
| JP7429936B1 (en) | Keyboard screen display program and its system | |
| JP6782491B2 (en) | Musical tone generator, musical tone generator and program | |
| JP2012210253A (en) | Game device, control method of game device, and program | |
| WO2023175674A1 (en) | Program and signal output device | |
| JP2011200742A5 (en) | Game machine | |
| JP2011039248A (en) | Portable sound output device, computer program, and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200110 |
|
| RJ01 | Rejection of invention patent application after publication |