CN108847206B - Intelligent piano playing method, intelligent keyboard and intelligent piano system - Google Patents
Intelligent piano playing method, intelligent keyboard and intelligent piano system Download PDFInfo
- Publication number
- CN108847206B CN108847206B CN201810579459.XA CN201810579459A CN108847206B CN 108847206 B CN108847206 B CN 108847206B CN 201810579459 A CN201810579459 A CN 201810579459A CN 108847206 B CN108847206 B CN 108847206B
- Authority
- CN
- China
- Prior art keywords
- key
- player
- sound
- piano
- finger
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H7/00—Instruments in which the tones are synthesised from a data store, e.g. computer organs
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/32—Constructional details
- G10H1/34—Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/155—User input interfaces for electrophonic musical instruments
- G10H2220/221—Keyboards, i.e. configuration of several keys or key-like input devices relative to one another
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
- G10H2240/171—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
- G10H2240/201—Physical layer or hardware aspects of transmission to or from an electrophonic musical instrument, e.g. voltage levels, bit streams, code words or symbols over a physical link connecting network nodes or instruments
- G10H2240/211—Wireless transmission, e.g. of music parameters or control data by radio, infrared or ultrasound
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Auxiliary Devices For Music (AREA)
Abstract
The embodiment of the invention relates to the technical field of musical instruments and discloses an intelligent piano playing method, an intelligent keyboard and an intelligent piano system. The intelligent piano playing method comprises the following steps: presetting a basic key sound library; acquiring playing characteristic information of a player, wherein the playing characteristic information comprises: key position, finger pressure value and finger velocity value; modifying the basic key sound library according to the playing characteristic information of the player to generate a key sound library corresponding to the player; and receiving the key value played by the player, and outputting corresponding musical instrument sound according to the key sound library corresponding to the player. Through the mode, the technical problems that the traditional piano occupies a large space and is inconvenient to carry can be solved, and the piano sound suitable for individuals can be output.
Description
Technical Field
The invention relates to the technical field of musical instruments, in particular to an intelligent piano playing method, an intelligent keyboard and an intelligent piano system.
Background
A keyboard musical instrument in piano and Western classical music is called "king of musical instrument". A piano is a musical instrument played using a keyboard. When a player presses a key of a piano, hammers of the piano vibrate at respective resonance frequencies by striking metal strings and transmitting the vibrations to a sound board, which amplifies by coupling sound energy into air.
As one of the most popular musical instruments in the world, there are nowadays more and more people playing and learning pianos, which also increasingly walk into thousands of households. In order to cultivate the interest of children in learning the piano and improve the playing skills of the piano, parents also buy the piano for the children at his wonderful age and place the piano at home for the children to learn playing. However, in the prior art, because the traditional piano has a large volume, occupies a large space and is not easy to move and carry, and in the playing process, people who are not in the current area cannot share the scenes in the playing process in real time, and cannot listen to the piano sound or watch the playing video. Therefore, the conventional piano has limitations in its application in terms of volume, portability, and shared audio-visual sense.
Based on the above, the invention provides an intelligent piano playing method, an intelligent keyboard and an intelligent piano system.
Disclosure of Invention
The embodiment of the invention aims to provide an intelligent piano playing method, an intelligent keyboard and an intelligent piano system, which solve the technical problems that the traditional piano occupies a large space and is inconvenient to carry, and can realize output of piano sound suitable for an individual.
In order to solve the above technical problems, embodiments of the present invention provide the following technical solutions:
in a first aspect, an embodiment of the present invention provides an intelligent piano playing method, which is applied to an intelligent piano system, and the method includes:
presetting a basic key sound library;
acquiring playing characteristic information of a player, wherein the playing characteristic information comprises: key position, finger pressure value and finger velocity value;
modifying the basic key sound library according to the playing characteristic information of the player to generate a key sound library corresponding to the player;
and receiving the key value played by the player, and outputting corresponding musical instrument sound according to the key sound library corresponding to the player.
In some embodiments, the preset basic key sound library includes:
acquiring at least one section of exercise musical instrument sound;
extracting playing characteristic information corresponding to the practice piano sound according to the practice piano sound;
and generating a basic key sound library according to the playing characteristic information.
In some embodiments, the method further comprises:
and presetting a basic key sound library corresponding to the player according to the identity information of the player.
In some embodiments, the presetting of the basic key sound library corresponding to the player according to the identity information of the player includes:
acquiring practice piano tones corresponding to the players according to the identity information of the players;
extracting playing characteristic information corresponding to the practice piano sound according to the practice piano sound corresponding to the player;
and generating a basic key sound library corresponding to the player according to the playing characteristic information.
In some embodiments, the modifying the basic key sound library according to the playing characteristic information of the player to generate the key sound library corresponding to the player includes:
presetting a finger pressure threshold range, and if the finger pressure value corresponding to the position of the key played by the player is within the finger pressure threshold range, reserving the finger pressure value corresponding to the position of the key in a basic key sound library;
and if the finger pressure value corresponding to the key position played by the player is not within the finger pressure threshold range, updating the finger pressure value corresponding to the key position in the basic key sound library.
In some embodiments, the modifying the basic key sound library according to the playing characteristic information of the player to generate the key sound library corresponding to the player includes:
presetting a finger speed threshold range, and if the finger speed value corresponding to the position of a key played by the player is within the finger speed threshold range, reserving the finger speed value corresponding to the position of the key in a basic key sound library;
and if the finger velocity value corresponding to the position of the key played by the player is not within the range of the finger velocity threshold value, updating the finger velocity value corresponding to the position of the key in the basic key sound library.
In some embodiments, the key values include a finger pressure value and a finger velocity value corresponding to the key position, and each key position in the key sound library corresponds to one key value; the receiving the key value played by the player and outputting the corresponding musical instrument sound according to the key sound library corresponding to the player includes:
acquiring a finger pressure value and a finger speed value corresponding to a key value played by the player;
and acquiring a finger pressure value corresponding to a key value played by the player and a piano sound closest to a finger speed value according to the key sound library corresponding to the player, and determining to output the piano sound.
In some embodiments, the obtaining, according to the key sound library corresponding to the player, the piano sound closest to the finger pressure value and the finger speed value corresponding to the key value played by the player and determining to output the piano sound includes:
calculating a first difference value between the finger pressure value corresponding to the piano sound of the piano key sound library and the finger pressure value played by the player;
calculating a second difference value between the finger velocity value corresponding to the piano sound of the piano key sound library and the finger velocity value played by the player;
and calculating the sum of the first difference and the second difference, and determining the sound corresponding to the finger pressure value and the finger speed value with the minimum sum of the first difference and the second difference as the output sound.
In a second aspect, an embodiment of the present invention provides an intelligent keyboard, including:
the keyboard body is used for receiving playing characteristic information played by a player;
the camera unit is used for acquiring a playing video of a player;
a wireless communication unit for wirelessly connecting a mobile terminal of a user;
the sensing unit is arranged on the keyboard body and used for generating a playing instruction according to the playing characteristic information of a player and sending the playing instruction to the mobile terminal through the wireless communication unit;
and the control unit is connected with the keyboard body, the camera unit, the wireless communication unit and the induction unit and is used for controlling the work of the intelligent keyboard.
In some embodiments, the sensing unit includes:
the position sensing unit is used for determining the positions of keys played by the player;
the finger pressure sensing unit is connected with the position sensing unit and used for determining a finger pressure value corresponding to the position of a key played by the player;
and the finger speed sensing unit is connected with the finger pressure sensing unit and is used for determining a finger speed value corresponding to the position of the keys played by the player.
In a third aspect, an embodiment of the present invention provides an intelligent piano system, including:
the above-mentioned smart keyboard;
the local sound box is connected with the intelligent keyboard and is used for playing the sound played by the player;
the cloud server is connected with the intelligent keyboard and used for storing the sound played by the player and the playing video, and the cloud server comprises:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the above-mentioned smart piano playing method;
and the mobile terminal is connected with the cloud server and is used for receiving the musical instrument sound and the playing video sent by the cloud server.
The embodiment of the invention has the beneficial effects that: in contrast to the prior art, an embodiment of the present invention provides an intelligent piano playing method, including: presetting a basic key sound library; acquiring playing characteristic information of a player, wherein the playing characteristic information comprises: key position, finger pressure value and finger velocity value; modifying the basic key sound library according to the playing characteristic information of the player to generate a key sound library corresponding to the player; and receiving the key value played by the player, and outputting corresponding musical instrument sound according to the key sound library corresponding to the player. Through the mode, the technical problems that the traditional piano occupies a large space and is inconvenient to carry can be solved, and the piano sound suitable for individuals can be output.
Drawings
One or more embodiments are illustrated by way of example in the accompanying drawings, which correspond to the figures in which like reference numerals refer to similar elements and which are not to scale unless otherwise specified.
Fig. 1 is a schematic flowchart of a method for playing an intelligent piano according to an embodiment of the present invention;
FIG. 2 is a detailed flowchart of step S10 in FIG. 1;
fig. 3 is a schematic structural diagram of an intelligent keyboard according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of the sensing unit in FIG. 3;
fig. 5 is a schematic structural diagram of an intelligent piano system according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of the cloud server in fig. 5.
Referring to fig. 1 to 6, 100, an intelligent piano system; 10. an intelligent keyboard; 11. a control unit; 12. a keyboard body; 13. a sensing unit; 131. a position sensing unit; 132. a finger pressure sensing unit; 133. a finger speed sensing unit; 14. a wireless communication unit; 15. a camera unit; 20. local sound equipment; 30. a cloud server; 301. a processor; 302. a memory; 40. a mobile terminal.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
Example 1
In the embodiment of the invention, the intelligent piano playing method is applied to an intelligent piano system, and the intelligent piano system comprises an intelligent keyboard, a local sound, a mobile terminal and a cloud server. The intelligent keyboard is provided with a control unit, a keyboard body, a camera unit, a sensing unit and a wireless communication unit. The user can be through playing the key of smart keyboard, the induction element on the key will respond to the key position, the finger pressure value and the value of pointing the speed that the user played, learn through the high in the clouds and generate corresponding key sound storehouse, and according to corresponding musical instrument is produced to key sound storehouse, the musical instrument sound will be exported through local stereo to through wireless communication unit, can give a plurality of users 'mobile terminal with the musical instrument sound of playing or the video sharing of playing, play the musical instrument sound of playing or play the video through user's mobile terminal, produce the musical instrument sound of playing locally or strangely, realize the effect that long-range listening was listened to or was watched.
Referring to fig. 1, fig. 1 is a schematic flowchart of a method for playing an intelligent piano according to an embodiment of the present invention. As shown in fig. 1, the method is applied to a smart piano system, and the method includes:
step S10: presetting a basic key sound library;
the basic key sound library is a key sound library preset by the intelligent piano system, faces all players, and is convenient for players to generate proper piano sound when playing through the intelligent piano system. Specifically, please refer to fig. 2, fig. 2 is a detailed flowchart of step S10 in fig. 1; as shown in fig. 2, the step S10 includes:
step S11: acquiring at least one section of exercise musical instrument sound;
the exercise musical instrument sound can be acquired in an on-line downloading mode or through self playing of the user. Practice musical instrument sound can be the multistage, and it can be understood, the great musical instrument sound of rhythm difference each other can be acquireed specially to multistage musical instrument sound, through acquireing at least one section exercise musical instrument sound, and each section exercise musical instrument sound is all inequality, can satisfy practice the variety of musical instrument sound, guarantees the rationality of basic key sound storehouse.
Step S12: extracting playing characteristic information corresponding to the practice piano sound according to the practice piano sound;
wherein the playing characteristic information includes: the key position, the finger pressure value and the finger speed value of the practice piano voice are different from one another due to the fact that the practice piano voice comprises multiple sections, and the key position, the finger pressure value and the finger speed value of each section of the practice piano voice are different from one another, so that playing characteristic information corresponding to the multiple sections of the practice piano voice can be extracted. Specifically, the key positions, and the finger pressure values and finger speed values corresponding to the key positions are determined by identifying the tone, tone and loudness corresponding to each of the practice piano tones, so as to determine the playing characteristic information corresponding to the practice piano tones.
Step S13: and generating a basic key sound library according to the playing characteristic information.
The practice piano sound comprises a plurality of sections, and each section of practice piano sound corresponds to different playing characteristic information. Specifically, the playing characteristic information corresponding to the multiple sections of practice musical instrument sounds can be extracted, for example: in a certain section of piano sound, a certain key is played for multiple times, and the corresponding finger pressure value and finger speed value of the key are multiple, so that the multiple finger pressure values and finger speed values can be respectively averaged, the average value of the multiple finger pressure values is determined as the finger pressure value corresponding to the key in the basic key sound library, and the average value of the multiple finger speed values is determined as the finger speed value corresponding to the key in the basic key sound library. When the practice piano voice is in multiple sections, the average of the finger pressure value and the finger speed value of each section of the keys for practicing piano voice can be obtained, the average of the finger pressure value and the finger speed value of each section of the keys for practicing piano voice is obtained, then the average of the finger pressure value and the finger speed value of all the keys for practicing piano voice is obtained, the average obtained by all the practice piano voices is used as the finger pressure value and the finger speed value corresponding to the key in the basic key sound database, and the basic key sound database is generated by traversing all the keys.
Alternatively, the basic keysound library is associated with the identity information of the user. It can be understood that, when users of different ages are playing, due to the difference of finger pressure and finger speed, the music sounds emitted by playing are greatly different, so that when different players play, in order to ensure the accuracy of the music sounds played, a basic key sound library corresponding to the players needs to be preset, and the basic key sound library corresponding to the players is preset according to the identity information of the players. Specifically, the practice piano voice corresponding to the player is obtained according to the identity information of the player, the playing characteristic information corresponding to the practice piano voice is extracted according to the practice piano voice corresponding to the player, and the basic key sound library corresponding to the player is generated according to the playing characteristic information. For example: the players can be divided into children, young, middle-aged and old people according to the ages, and basic key sound libraries corresponding to different ages can be generated by acquiring exercise piano sounds corresponding to players of different ages. Such as: acquiring exercise piano tones of young players, extracting playing characteristic information corresponding to the exercise piano tones according to the exercise piano tones, and generating a basic key sound library corresponding to the young players according to the playing characteristic information.
Step S20: acquiring playing characteristic information of a player, wherein the playing characteristic information comprises: key position, finger pressure value and finger velocity value;
the intelligent piano system comprises an intelligent keyboard, wherein a position sensing unit, a finger pressure sensing unit and a finger speed sensing unit are arranged on the intelligent keyboard, the key positions are acquired through the position sensing unit, the finger pressure values are acquired through the finger pressure sensing unit, and the finger speed values are acquired through the finger speed sensing unit. The finger speed sensing unit can determine the finger speed value by acquiring the pressing time length corresponding to the key position. The basic information of the player can be acquired, the basic information of the player includes age, face characteristics, height and the like, and by storing the basic information of the player and corresponding the basic information of the player to the playing characteristic information of the player, a key sound library with individual attributes can be established based on the basic information of the player and the playing characteristic information.
Wherein, the acquiring of the playing characteristic information of the player further comprises: acquiring fingering skills of the player, and according to the basic information of the player, for example: and information such as age, height, playing duration, facial features and the like, pre-judging fingering skills of the player and generating a key sound library corresponding to fingering of the player. The key sound library corresponding to the fingering is generated through big data learning of the cloud server, and key sound libraries corresponding to various fingering can be generated. Because the player can not determine the piano sound corresponding to the specific fingering of the player in the process of using the intelligent piano for the first time, the player can iteratively generate a key sound library suitable for the personal fingering characteristics by establishing a key sound library corresponding to the fingering as an initial input condition and then continuously playing.
Step S30: modifying the basic key sound library according to the playing characteristic information of the player to generate a key sound library corresponding to the player;
the basic key sound library is a key sound library preset by the intelligent piano system, and it can be understood that the basic key sound library is a key sound library facing all users, and as the finger pressure and the finger speed for playing by different users are different, in order to meet the accuracy of the musical instrument played by a player, the basic key sound library is required to be modified, and the key sound library corresponding to the player is generated and stored. The method comprises the steps of obtaining a key position, a finger pressure value and a finger speed value corresponding to each key played by a player, comparing the finger pressure value and the finger speed value corresponding to the key position in the basic key sound library, determining whether to correct the finger pressure value and the finger speed value corresponding to the key position in the basic key sound library, obtaining the key position, the finger pressure value and the finger speed value corresponding to the key played by the player for multiple times, generating the finger pressure value and the finger speed value of the key position in an iteration mode, and traversing all the key positions to generate a key sound library suitable for the player.
Specifically, a finger pressure threshold range may be preset, and if the finger pressure value corresponding to the key position played by the player is within the finger pressure threshold range, the finger pressure value corresponding to the key position in the basic key sound library is retained; and if the finger pressure value corresponding to the key position played by the player is not within the finger pressure threshold range, updating the finger pressure value corresponding to the key position in the basic key sound library. Wherein, by setting a minimum adjustment threshold, if the difference between the finger pressure value of the corresponding key position in the key sound library and the finger pressure value of the key position played by the player is greater than the minimum adjustment threshold, the finger pressure value of the corresponding key position in the basic key sound library is updated. For example: the method comprises the steps that a finger pressure value corresponding to a certain key position in a basic key sound library is 12Pa, a minimum adjustment threshold corresponding to the key position is 2Pa, the finger pressure threshold range corresponding to the key position is determined to be 10Pa-14Pa, if the finger pressure value corresponding to the key position played by a player is 13Pa, the finger pressure value corresponding to the key position is kept to be 12Pa, and if the finger pressure value corresponding to the key position played by the player is 15Pa, the finger pressure value corresponding to the key position is corrected to be 15 Pa. It can be understood that, in order to reduce the error, the finger pressure values of the key positions after one playing may be averaged, the average value is taken as the finger pressure value corresponding to the key position played by the player, and whether to modify the basic key sound library is determined according to the comparison between the average value and the finger pressure threshold range.
Specifically, a fingering speed threshold range can be preset, and if the fingering speed value corresponding to the position of the key played by the player is within the fingering speed threshold range, the fingering speed value corresponding to the position of the key in the basic key sound library is reserved; and if the finger velocity value corresponding to the position of the key played by the player is not within the range of the finger velocity threshold value, updating the finger velocity value corresponding to the position of the key in the basic key sound library. Wherein, if the difference between the finger velocity value of the corresponding key position in the key sound library and the finger velocity value of the key position played by the player is greater than the minimum adjustment threshold, the finger velocity value of the corresponding key position in the basic key sound library may be updated by setting a minimum adjustment threshold. For example: the method comprises the steps that a finger velocity value of a corresponding key position in a basic key sound library is 5, a minimum adjustment threshold corresponding to the key position is 2, the finger velocity threshold range corresponding to the key position is determined to be 3-7, if the finger velocity value corresponding to the key position played by a player is 4, the finger velocity value corresponding to the key position is kept to be 5, and if the finger velocity value corresponding to the key position played by the player is 2, the finger velocity value corresponding to the key position is corrected to be 2. It can be understood that, in order to reduce errors, the finger velocity values of the key positions after one playing may be averaged, the average value is taken as the finger velocity value corresponding to the key position played by the player, and whether to modify the basic key sound library is determined according to the comparison between the average value and the finger velocity threshold range. And iteratively correcting the finger pressure value and the finger speed value corresponding to the key position in the basic key sound library, updating the basic key sound library, and generating the key sound library corresponding to the player.
Step S40: receiving a key value played by the player, and outputting corresponding piano tones according to the key sound library corresponding to the player;
wherein, the key value refers to when the player plays a certain key, the corresponding finger pressure value in key position and the value of pointing the speed, every key position corresponds a key value in the key sound storehouse, receive the key value that the player played, according to the key sound storehouse that the player corresponds, output corresponding musical instrument sound, include: acquiring a finger pressure value and a finger speed value corresponding to a key value played by the player; and acquiring a finger pressure value corresponding to a key value played by the player and a piano sound closest to a finger speed value according to the key sound library corresponding to the player, and determining to output the piano sound. And the sound in the playing process is played in real time through the local sound or the sound of the mobile terminal.
Specifically, the key value corresponding to each key position, namely the finger pressure value and the finger speed value corresponding to the key position, are stored in the key sound library corresponding to the player, and the finger pressure value and the finger speed value at each key position both correspond to a musical instrument sound. For example: a first difference value between a finger-pressure value corresponding to the piano sound of the piano key sound library and a finger-pressure value played by the player can be calculated; calculating a second difference value between the finger velocity value corresponding to the piano sound of the piano key sound library and the finger velocity value played by the player; and calculating the sum of the first difference and the second difference, and determining the sound corresponding to the finger pressure value and the finger speed value with the minimum sum of the first difference and the second difference as the output sound. In order to avoid the influence caused by the cancellation of the positive and negative addition when the difference is summed, the first difference and the second difference are subjected to absolute value calculation, such as: the key sound library comprises a finger pressure value of 5, a piano sound 1 corresponding to a finger speed value of 5, a piano sound 2 corresponding to a finger speed value of 5, wherein if the finger pressure value of a user for playing is 4 and the finger speed value is 7, according to calculation, a first difference value corresponding to the piano sound 1 is 1, a second difference value corresponding to the piano sound 1 is 2, the sum of the first difference value and the second difference value corresponding to the piano sound 1 is 3, the first difference value corresponding to the piano sound 2 is 2, the second difference value corresponding to the piano sound 2 is 2, and the sum of the first difference value and the second difference value is 4, so that the piano sound 1 is used as the piano sound corresponding to the key value played by the user.
Wherein, the intelligent piano playing method further comprises: and sending the output music to the mobile terminal of the person to be shared. Specifically, wait to share personnel and authenticate through mobile terminal's cell-phone APP, will establish the connection after the authentication succeeds, when the player plays, the cloud ware will be in real time with the musical instrument sound or the video of playing send wait to share personnel's cell-phone APP, cell-phone APP will receive play musical instrument sound or the video of playing, the local scene of playing a musical instrument of sharing. Or after the authentication of the personnel to be shared is successful, the video can be played on the mobile phone APP of the personnel to be shared in a live broadcast mode, so that the personnel to be shared can conveniently listen to or watch the video. For example: when the child plays the intelligent piano, the captain can acquire the piano sound and the playing video played by the child, and listen to or watch the piano sound and the playing video played by the child in real time.
The cloud server receives the basic information of the player and authenticates the legality of the basic information of the player, and after the authentication is successful, a key bank corresponding to the player is established based on the basic information of the player. The identity information of the intelligent piano or the identity information of the player can be acquired through the cloud server by the allopatric mobile phone APP, wherein the identity information of the intelligent piano can be the MAC address, the IP address and the like of the intelligent piano, the identity information of the player can be represented through the identity number, and the unique identity number of the player is determined by numbering each player, so that the identity number can be determined according to the basic information of the player. In order to ensure the privacy information of players, each player can authenticate the legality of the different-place mobile phone APP through the local mobile phone APP, and through the different-place mobile phone APP authenticated by the local mobile phone APP, the cloud server confirms that the playing organ sound or the playing video of the player is sent to the different-place mobile phone APP, so that the privacy safety of the user is protected.
In the embodiment of the invention, the key sound library is preset; acquiring playing characteristic information of a player, wherein the playing characteristic information comprises: key position, finger pressure value and finger velocity value; modifying the basic key sound library according to the playing characteristic information of the player to generate a key sound library corresponding to the player; and receiving the key value played by the player, and outputting corresponding musical instrument sound according to the key sound library corresponding to the player. Through the mode, the technical problems that the traditional piano occupies a large space and is inconvenient to carry can be solved, and the piano sound suitable for individuals can be output.
Example 2
Referring to fig. 3, fig. 3 is a schematic structural diagram of an intelligent keyboard according to an embodiment of the present invention, and as shown in fig. 3, the intelligent keyboard 10 includes: control unit 11, keyboard body 12, induction element 13, wireless communication unit 14 and camera unit 15. The control unit 11 is connected to the keyboard body 12, the sensing unit 13, the wireless communication unit 14 and the camera unit 15, respectively, and the keyboard body 12 is connected to the sensing unit 13.
The control unit 11 is a controller, the control unit 11 is configured to control the operation of the smart keyboard 10, specifically, the control unit may be a central processing unit, and the control unit 11 may control the wireless communication unit 14 to transmit the playing feature information collected by the keyboard body 12 to a cloud server, or control the camera unit 15 to transmit a playing video to a mobile terminal of a user, and so on.
The keyboard body 12 is connected to the control unit 11, and is configured to receive playing characteristic information of a player. Specifically, the keyboard body 12 may be a computer keyboard, wherein each key of the computer keyboard corresponds to one key of a conventional piano. By pressing the keys of the computer keyboard, corresponding keys corresponding to the keys are pressed, and corresponding musical instrument sound can be generated. It can be understood that the number of keys of the keyboard body 12 should be the same as that of keys of a conventional piano, and the relative positions thereof can be set to be the same as the distribution of black and white keys of a conventional piano, which is convenient for users to use.
The sensing unit 13 is connected to the control unit 11, is arranged on the keyboard body 12, and is configured to generate a playing instruction according to the playing characteristic information of a player, and send the playing instruction to the mobile terminal through the wireless communication unit;
referring to fig. 4, fig. 4 is a schematic structural diagram of the sensing unit in fig. 3; as shown in fig. 4, the sensing unit 13 includes:
a position sensing unit 131 for determining the position of the keys played by the player. Specifically, the position sensing unit 131 may be a position sensor for determining the position of the key played by the player according to the position pressed by the player.
And a finger pressure sensing unit 132 connected to the position sensing unit 131 for determining a finger pressure value corresponding to the position of the key played by the player. Specifically, the finger pressure sensing unit 132 may be a pressure sensor for determining the pressure of the key position depressed by the player.
And a finger speed sensing unit 133, connected to the finger pressure sensing unit 132, for determining a finger speed value corresponding to the position of the key played by the player. Specifically, the finger speed sensing unit 133 may be a speed sensor, an acceleration sensor and/or a timer, and the speed sensor or the acceleration sensor may be configured to determine a finger speed value corresponding to the position of the key played by the player according to the switching speed of the player. The timer can be used for calculating the pressing duration of the position of the key played by the player, and determining the fingering speed value corresponding to the position of the key played by the player according to the pressing duration.
The wireless communication unit 14 is connected to the control unit 11, and is configured to wirelessly connect to a cloud server or a mobile terminal of the user. The wireless communication unit 14 may send the player's playing organ sound or playing video to the cloud server, and send the player's playing organ sound or playing video to the user's mobile terminal through the cloud server, or the wireless communication unit may directly send the player's playing organ sound or playing video to the user's mobile terminal, specifically, the wireless communication unit 14 may be a bluetooth module, a WIFI module, and so on.
The camera unit 15 is connected to the control unit 11, and is configured to acquire a playing video of a player. The camera unit 15 may further obtain a face feature of the player, and identify the identity information of the player according to the face feature of the player. Specifically, the camera unit 15 includes: the camera is used for acquiring images, the face recognizer can determine identity information of a player according to the face characteristics of the player and send the identity information of the player to the control unit 11, the control unit 11 controls the wireless communication unit 14 to send the identity information of the player or the playing video to the cloud server, the cloud server identifies the identity information of the player, and according to the identity information of the player, a key sound library corresponding to the player is acquired and the playing video is sent to the mobile terminal.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an intelligent piano system according to an embodiment of the present invention;
as shown in fig. 5, the intelligent piano system 100 includes: smart keyboard 10, local stereo 20, cloud server 30 and mobile terminal 40. The smart keyboard 10 is connected to the local audio 20 and the cloud server 30, and the cloud server 30 is connected to the mobile terminal 40.
The intelligent keyboard 10 receives key values played by a player, wherein the key values comprise the positions of playing keys, finger pressure values and finger speed values, corresponding musical notes are determined through a key sound library according to the finger pressure values and the finger speed values, and the local sound 20 emits the musical notes. Meanwhile, the mobile terminal 40 of the user includes a user interface, and when users at other locations need to share and listen to the playing music, the playing music can be issued to the mobile terminal 40 of the user through the cloud server 30, and the music can be played through the mobile terminal 40. The playing organ sound can be issued to the mobile terminals 40 of multiple users at the same time, so that the playing organ sound can be shared by the multiple users conveniently. Alternatively, the playing video of the player may be issued to the mobile terminal 40 of the user, and the playing video is played by the user interface of the mobile terminal 40 of the user. The cloud server 30 stores basic information of a player and a key sound library corresponding to the player, and by acquiring a key value played by the player and comparing the key value with the key sound library corresponding to the cloud server 30, a proper piano sound of the player can be generated.
Wherein, the local sound box 20 is connected with the intelligent keyboard 10 and is used for playing the sound played by the player. Specifically, the local stereo 20 is separated from the smart keyboard 10, thereby minimizing the volume of the smart piano. The local sound box 20 is in communication connection with the intelligent keyboard 10, wherein the local sound box 20 may be provided with a memory, the memory is used for storing a key sound library corresponding to a player, the local sound box 20 is further provided with a communication module, and the communication module generates corresponding musical instrument sound by receiving a key value sent by the intelligent keyboard 10 and combining the key sound library of the player stored in the memory of the local sound box 20. Or, the local stereo 20 is connected to the cloud server 30 through a communication module according to a communication protocol, the smart keyboard 10 sends a key value played by a player to the cloud server 30, the cloud server 30 matches a key sound library of the player according to the key value played by the player to generate a corresponding organ sound, the organ sound is sent to the local stereo 20, and the organ sound is played through the local stereo 20.
The cloud server 30 is configured to store a key sound library of the player, specifically, please refer to fig. 6 again, and fig. 6 is a schematic structural diagram of the cloud server in fig. 5;
as shown in fig. 6, the cloud server 30 includes one or more processors 301 and a memory 302. In fig. 6, one processor 301 is taken as an example.
The processor 301 and the memory 302 may be connected by a bus or other means, such as the bus connection in fig. 6.
The memory 302 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the memory 302 may optionally include memory located remotely from the processor 301, which may be connected to the processor 301 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The modules are stored in the memory 302, and when executed by the one or more processors 301, perform the smart piano playing method in any of the above-described method embodiments, for example, perform the respective steps shown in fig. 1 or fig. 2 described above.
The mobile terminal 40 is connected to the cloud server 30, and is configured to receive the musical instrument sound and the playing video played by the player, which are sent by the cloud server 30. The mobile terminal 40 includes but is not limited to:
(1) a mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such electronic devices include smart phones (e.g., iphones), multimedia phones, functional phones, and low-end phones, among others.
(2) The mobile personal computer equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such electronic devices include: PDA, MID, and UMPC devices, etc., such as ipads.
(3) A portable entertainment device: such devices can display and play video content, and generally also have mobile internet access features. This type of device comprises: video players, handheld game consoles, and intelligent toys and portable car navigation devices.
(4) And other electronic equipment with a video playing function and an internet surfing function.
Embodiments of the present invention also provide a non-volatile computer storage medium storing computer-executable instructions, which are executed by one or more processors, such as one processor 301 in fig. 6, to enable the one or more processors to execute the smart piano playing method in any of the above-described method embodiments, such as the smart piano playing method in any of the above-described method embodiments, for example, to execute the steps shown in fig. 1 or fig. 2 described above.
In the embodiment of the invention, the intelligent keyboard comprises a keyboard body, a camera unit, a wireless communication unit, a sensing unit and a control unit, and the intelligent piano system comprises the intelligent keyboard, a local sound, a cloud server and a mobile terminal. The key value played by the player is obtained through the intelligent keyboard, the cloud server generates corresponding organ sound, and the organ sound is shared to the mobile terminal through the wireless communication unit. Through the mode, the embodiment of the invention can realize the sharing of the playing music or the playing video.
The above-described embodiments of the apparatus or device are merely illustrative, wherein the unit modules described as separate parts may or may not be physically separate, and the parts displayed as module units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network module units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a general hardware platform, and certainly can also be implemented by hardware. Based on such understanding, the technical solutions mentioned above may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute the method according to each embodiment or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; within the idea of the invention, also technical features in the above embodiments or in different embodiments may be combined, steps may be implemented in any order, and there are many other variations of the different aspects of the invention as described above, which are not provided in detail for the sake of brevity; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
Claims (10)
1. An intelligent piano playing method is applied to an intelligent piano system and is characterized by comprising the following steps:
presetting a basic key sound library;
acquiring playing characteristic information of a player, wherein the playing characteristic information comprises: key position, finger pressure value and finger velocity value;
modifying the basic key sound library according to the playing characteristic information of the player to generate a key sound library corresponding to the player;
and receiving a key value played by the player, wherein the key value comprises the key position, and a finger pressure value and a finger speed value corresponding to the key position, and outputting corresponding piano sound according to the key sound library corresponding to the player.
2. The intelligent piano playing method according to claim 1, wherein said preset basic key sound library comprises:
acquiring at least one section of exercise musical instrument sound;
extracting playing characteristic information corresponding to the practice piano sound according to the practice piano sound;
and generating a basic key sound library according to the playing characteristic information.
3. The smart piano playing method according to claim 1, wherein said method further comprises:
and presetting a basic key sound library corresponding to the player according to the identity information of the player.
4. The intelligent piano playing method according to claim 3, wherein the presetting of the basic key sound library corresponding to the player according to the identity information of the player comprises:
acquiring practice piano tones corresponding to the players according to the identity information of the players;
extracting playing characteristic information corresponding to the practice piano sound according to the practice piano sound corresponding to the player;
and generating a basic key sound library corresponding to the player according to the playing characteristic information.
5. The intelligent piano playing method according to claim 1, wherein said modifying the basic key sound library according to the playing characteristic information of the player to generate the key sound library corresponding to the player comprises:
presetting a finger pressure threshold range, and if the finger pressure value corresponding to the position of the key played by the player is within the finger pressure threshold range, reserving the finger pressure value corresponding to the position of the key in a basic key sound library;
and if the finger pressure value corresponding to the key position played by the player is not within the finger pressure threshold range, updating the finger pressure value corresponding to the key position in the basic key sound library.
6. The intelligent piano playing method according to claim 1, wherein said modifying the basic key sound library according to the playing characteristic information of the player to generate the key sound library corresponding to the player comprises:
presetting a finger speed threshold range, and if the finger speed value corresponding to the position of a key played by the player is within the finger speed threshold range, reserving the finger speed value corresponding to the position of the key in a basic key sound library;
and if the finger velocity value corresponding to the position of the key played by the player is not within the range of the finger velocity threshold value, updating the finger velocity value corresponding to the position of the key in the basic key sound library.
7. The intelligent piano playing method according to claim 1, wherein each key position in the key sound library corresponds to a key value; the receiving the key value played by the player and outputting the corresponding musical instrument sound according to the key sound library corresponding to the player includes:
acquiring a finger pressure value and a finger speed value corresponding to a key value played by the player;
and acquiring a finger pressure value corresponding to a key value played by the player and a piano sound closest to a finger speed value according to the key sound library corresponding to the player, and determining to output the piano sound.
8. The intelligent piano playing method according to claim 7, wherein said obtaining, according to the key sound library corresponding to the player, the piano sound closest to the finger pressure value and finger velocity value corresponding to the key value played by the player and determining to output the piano sound comprises:
calculating a first difference value between the finger pressure value corresponding to the piano sound of the piano key sound library and the finger pressure value played by the player;
calculating a second difference value between the finger velocity value corresponding to the piano sound of the piano key sound library and the finger velocity value played by the player;
and calculating the sum of the first difference and the second difference, and determining the sound corresponding to the finger pressure value and the finger speed value with the minimum sum of the first difference and the second difference as the output sound.
9. A smart keyboard, comprising:
presetting a basic key sound library;
the keyboard body is used for receiving playing characteristic information played by a player, and the playing characteristic information comprises: the key position, and the finger pressing finger and finger speed value corresponding to the key position;
modifying the basic key sound library according to the playing characteristic information of the player to generate a key sound library corresponding to the player;
the camera unit is used for acquiring a playing video of a player;
a wireless communication unit for wirelessly connecting a mobile terminal of a user;
the sensing unit is arranged on the keyboard body and used for generating a playing instruction according to playing characteristic information of a player, sending the playing instruction to the mobile terminal through the wireless communication unit and generating corresponding musical instrument sound according to the key sound library, and the sensing unit comprises: the device comprises a position sensing unit, a finger pressure sensing unit and a finger speed sensing unit, wherein the position sensing unit is used for determining the position of a key played by a player, the finger pressure sensing unit is connected with the position sensing unit and used for determining a finger pressure value corresponding to the position of the key played by the player, and the finger speed sensing unit is connected with the finger pressure sensing unit and used for determining a finger speed value corresponding to the position of the key played by the player;
and the control unit is connected with the keyboard body, the camera unit, the wireless communication unit and the induction unit and is used for controlling the work of the intelligent keyboard.
10. An intelligent piano system, comprising:
the smart keyboard of claim 9;
the local sound box is connected with the intelligent keyboard and is used for playing the sound played by the player;
the cloud server is connected with the intelligent keyboard and used for storing the sound played by the player and the playing video, and the cloud server comprises:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the smart piano playing method of any one of claims 1-8;
and the mobile terminal is connected with the cloud server and is used for receiving the musical instrument sound and the playing video sent by the cloud server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810579459.XA CN108847206B (en) | 2018-06-07 | 2018-06-07 | Intelligent piano playing method, intelligent keyboard and intelligent piano system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810579459.XA CN108847206B (en) | 2018-06-07 | 2018-06-07 | Intelligent piano playing method, intelligent keyboard and intelligent piano system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108847206A CN108847206A (en) | 2018-11-20 |
| CN108847206B true CN108847206B (en) | 2021-07-30 |
Family
ID=64211501
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810579459.XA Active CN108847206B (en) | 2018-06-07 | 2018-06-07 | Intelligent piano playing method, intelligent keyboard and intelligent piano system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108847206B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105709419A (en) * | 2016-01-18 | 2016-06-29 | 北京联联看科技有限公司 | Communication method and system of piano game device |
| CN205354631U (en) * | 2015-12-30 | 2016-06-29 | 宜昌金宝乐器制造有限公司 | Interactive piano |
| CN108073867A (en) * | 2016-11-18 | 2018-05-25 | 北京酷我科技有限公司 | A kind of video feature extraction method and system of piano performance |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090075711A1 (en) * | 2007-06-14 | 2009-03-19 | Eric Brosius | Systems and methods for providing a vocal experience for a player of a rhythm action game |
-
2018
- 2018-06-07 CN CN201810579459.XA patent/CN108847206B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN205354631U (en) * | 2015-12-30 | 2016-06-29 | 宜昌金宝乐器制造有限公司 | Interactive piano |
| CN105709419A (en) * | 2016-01-18 | 2016-06-29 | 北京联联看科技有限公司 | Communication method and system of piano game device |
| CN108073867A (en) * | 2016-11-18 | 2018-05-25 | 北京酷我科技有限公司 | A kind of video feature extraction method and system of piano performance |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108847206A (en) | 2018-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8380119B2 (en) | Gesture-related feedback in eletronic entertainment system | |
| US10482862B2 (en) | Computer implemented method for providing augmented reality (AR) function regarding music track | |
| US10235898B1 (en) | Computer implemented method for providing feedback of harmonic content relating to music track | |
| CN107146631B (en) | Music identification method, note identification model establishment method, device and electronic equipment | |
| CN104902012A (en) | Method for carrying out singing contest through network and singing contest system | |
| CN102737161A (en) | Importing audio to affect gameplay experience | |
| CN110808019A (en) | Song generation method and electronic equipment | |
| CN110585705A (en) | Network game control method, device and storage medium | |
| CN108847206B (en) | Intelligent piano playing method, intelligent keyboard and intelligent piano system | |
| CN111161734A (en) | Voice interaction method and device based on designated scene | |
| CN112188226B (en) | Live broadcast processing method, device, equipment and computer readable storage medium | |
| Saputra et al. | Design and implementation of beatme as a networked music performance (nmp) system | |
| WO2020241441A1 (en) | System, device, method, and program | |
| CN112870689A (en) | Intelligent violin, interaction method thereof and computer readable storage medium | |
| JP6168981B2 (en) | Karaoke device and karaoke system | |
| KR102562174B1 (en) | System and method for providing cloud game service | |
| CN111048090A (en) | Animation interaction method and device based on voice | |
| US20160179926A1 (en) | Music playing service | |
| WO2022208609A1 (en) | Distribution system, distribution method, and program | |
| JP5941811B2 (en) | Program, music output method and music output system | |
| CN114667174A (en) | Intelligent violin, interaction method thereof and computer readable storage medium | |
| CN116798440A (en) | Game voice conversion method and device based on voice sample | |
| CN113066455A (en) | Music control method, equipment and readable storage medium | |
| CN118102039A (en) | Game sound adjusting method and device, electronic equipment and storage medium | |
| CN115531878A (en) | Game voice playing method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |