TW595198B - Method and apparatus for creating and distributing real-time interactive media content through wireless communication networks and the internet - Google Patents

Abstract

Disclosed is a method and apparatus for creating and distributing the real-time interactive media content through wireless communication Networks. The user can sing to the equipment such as cellular phone accordingly, or the message can be generated by pressing buttons of the equipment when the user is listening to the background music played by the equipment, and the user can generate sound similar to that played by musical instruments. The remote server stores user's language or the representation of press input, maintains the physically primitive rhythm relation of the user and transmits the message expressing the user's input and background music to one or more receivers.

Description

595198 11Η1ϊ Revised Year—Λ 02.

[Field of the Invention] The present invention relates to the use of computers and networks to generate and transmit messages, and in particular, to methods for allowing operators to transmit real-time interactive media content generated and transmitted by operators using handheld devices such as mobile phones. 5 [Background of the Invention] / 罝. The use of mobile devices such as cellular phones, personal digital assistants (pDAs), and handheld computers has grown at a rate that exceeded the predictions of the most optimistic people a few years ago. Cellular phones are widely accepted because they are low in price and allow individuals to move freely 'but still maintain contact with friends and entertainment resources. Other mobile devices that can record, play music, or animate are also widely accepted because they provide entertainment and make people happy. Therefore, these mobile devices are used by people of all ages all over the world, and are especially popular with people who love, pop culture, and lifestyle. This popular culture attracts most age groups, especially young people, and is widely accepted around the world. The music and movement recorded and transmitted by professional resources has become an important part of popular culture. However, it is increasingly common for individuals to make their own hearing or visual content and then share it with friends. However, the production and transmission of auditory and visual content such as music and moving day requires the use of non-portable 20-type devices that cannot be as portable as cellular phones. Therefore, there is a need to use mobile devices such as cellular telephones to generate and transmit auditory and / or visual content. [Summary of the Invention] An object of the present invention is to provide a method for generating and transmitting paper using mobile Pei Chi paper, which is applicable to the Chinese National Standard (CNS) A4 specification (21 〇χ 297 公 爱). Page 4% ΙΙΛ7 Description of the invention (2 Send content such as music or animation. According to the implementation of the present invention, the operation instruction and a first content ^ to the handheld device to connect the identity of multiple recipients ":; and via this handheld device Provide-or-content played by beat X and; · Transmission according to the rhythm relationship controlled by the operator and the identity of the first recipient: 22 content; the representation of the second content and the connection based on this rhythm relationship: 2; and Enables the remote feeder to transmit a message representing one or more recipients' content and the second content according to another example of the present invention. I1. The hand of the sender and the processing circuit are two ... one system includes-has Send wirelessly | Rotate representative instructions and 4 hold: device 'This handheld device provides the operator with the recipient's identification and ::: ;;: received by the author-or more than the "author" of the beat weight * Controlled Rhythmic Relationship and Content Sound_; «one and one content; and transmitting the identity of the second 15, D or multiple recipients via a wireless transmitter; and including a server | crying 1 5 subsystem receiving and storing in the wild _ 'Ho ^ The identity of the service is identified, the content of the rite ,,,,, and the content of one or more recipients, θB, 'the special representative represents the first content arranged by this rhythm relationship-content-message to one Or multiple recipients. In a consistent manner in January, a server system receives one or more signals generated under the control of the hand-held i: author, and these signals are transmitted to the user 2 and according to the operation. The rhythmic relationship controlled by the player and the second content of the beat j broadcasted by the first content and the identification of one or more recipients; obtaining knowledge of the relationship between the two; the relationship; and transmitting the representative arranged according to this rhythmic relationship The first inner valley and the second content of a message to one or more recipients. For the features of the present invention and its preferred embodiments, please refer to the following description and 20 595198

A7 B7 V. Description of the invention and better understanding. In these drawings, the same elements are represented by the same reference numerals. The following description and subsequent drawings are examples of implementation and should not be considered as limiting the scope of the invention. [Brief description of the diagram] 5 The first diagram is a system block diagram. The operator of the handheld phone can interact with servers connected to various networks and communication paths. The second figure is a block diagram of the main components of a hypothetical embodiment of a handheld phone. The third figure illustrates a method that allows individuals to use devices such as cellular phones or personal digital assistants (PDAs) to generate and deliver auditory content. 10 The fourth diagram illustrates the method of allowing individuals to use non-simultaneous data and voice communication paths to generate and transmit auditory content messages. [Detailed description of the invention] A. Overview The first diagram is a system block diagram illustrating that the operator of the mobile device 10 can interact with the server 30 to generate a unique and pre-existing combination of hearing and / or visual content messages. And control the transmission of such messages to one or more recipients, such as recipients 42, 52, and 62. The following is more specifically described with a cellular telephone, a public switched telephone network (PSTN), and the Internet. These devices are important examples of how the invention can be used, but the invention can be implemented and used in a wider range than these three specific examples. The cellular phone is only an example of the device 10. Other suitable devices include personal digital assistants (PDAs), portable computers for handheld computers, and two-way radios. The teachings according to the present invention can also be applied to fixed or desktop phones and fixed or desktop computers. According to the existing or expected standard This paper size applies the Chinese National Standard (CMS) A4 specification (2Ι0χ 297 mm) Page 6 595198

595198% 11 17 ^ year and month g dagger_ supplement positive A7 B7

V. Description of invention and communication facilities among possible recipients such as mobile device 62. The system may also include communication facilities between the feeder 30 and services represented by the computer system 41 and the telephone 51, or valley providers. For example, the server 30 may obtain other contents from the computer system 41, which are not present in the content database of the storage device 5 of the server 3 () itself. The communication facility between Feed 1 § 30 and Device 10 is used by the operator of Device 10 to generate and send messages to Feeder 30, and Feeder 30 then sends the message to one or more Recipient's server 30. The communication facility between the server 30 and the receiver is controlled by the server 30 to transmit the message to the receiver 10 and the receiver. The communication facility between the server 30 and a service or content provider such as pre-recorded music or music is controlled by the server 30 to obtain such a service or content. Various communication technologies, technologies, and communication protocols can be used. No specific communication facility is necessary; however, the device of the first figure is commercially important to many embodiments of the present invention. 3. Server The server 30 can be achieved by general hardware, including the processor 31, the storage device 33, and communication devices such as the public switched telephone network (pSTN) 50, the cellular telephone system, and the network 40. Connection. The network 40 may be a global network such as the Internet, or a more limited company intranet. It supports various application operating environments described below, such as existing Linux'Unix, or various Versions of Windows and other operating systems are provided. The implementation of the present invention is not limited to the use of special software H for feeding 595198 correction without A7 B7 6) 5. Description of the invention 30 is a computer system with a single processor; however, the server 30 may be one or more computers The system has a single or multiple processors. These systems can be configured close to each other or can be separated from each other. No specific configuration is limited. The server 30 provides several services for implementing the above-mentioned song mail 5 (SongMail) and DIY music (MusicDIY). The server 30 of the present invention can provide various services, including e-mail, interactive voice response (IVR), short message service (SMS), or multimedia messaging service (Multimedia Messaging Service). (MMS)), Wireless Access Protocol 10 (Wireless Access Protocol (WAP)), and Hypertext Transfer Protocol (HTTP). This type of service is an example of what is known today and can easily be replaced by more advanced services in the future. In accordance with the teachings of the present invention, the server 30 can work with such service patterns now and in the future. It can include multiple storage devices. 15 /-·-Operating system and application system software of N1 corpse / f track line, and store the data used by this software. Three examples of data are operator personal data, content databases, and information generated by operators. Operator profile information may include secondary data with similar accounting information and personal preferences related to a particular operator. Operator's preference — ^ 2〇 is a note of favorite music style or singer. The operator's personal data also fainted in the recipient's "address book". The content database contains the operator ’s option to save the author ’s own content and merge it into a “pre-message”. The internal surname surname ③ recognizes the next day J M Valley. Or Shenzu% 主 α 1] Where ^ style or wind ... ", see the basic message or atmosphere as options to help choose.

Page 9 595198

Amendment I V. Description of the invention (7) Basically, the server 30 can use any form of communication to contact other system elements. In the embodiment shown in the first figure, the server 30 communicates with the mobile devices via the radio channel 60, 62, and communicates with the electric activity 51, 52 via the public switched telephone network (STN) 50, and via the network. Road 40 communicates with the computer system 41 42. The transmission and reception of the 尨 number is achieved through the radio channel 60 by receiving 35 and transmitting 36, and the receiver 35 and the transmitter 36 are connected to the antenna 3 7 and are connected to the processing by the communication device 34.器 3 1. The receiver 35 and the transmitter 36 may be located close to the processor 31 or may be far apart. In one embodiment, the communication device 34 is connected to a cellular telephone system including a plurality of receivers 35, a plurality of transmitters 36, and a plurality of antennas 37. θ For the convenience of description, in an embodiment described below, the server 30 is a single computer system with a processor 31 connected to the storage device 33, the public, a telephone network (PSTN) 50, a network 40, and a receiver. Transmitter 35 and transmitter%. Various changes in configuration and implementation are possible. 15 4. Handheld device The mobile device 10 in the first figure is a cellular phone; however, other types of clothes can be used as described above. In this particular example, the device ιo has a plurality of input devices and a plurality of output devices. The input device includes a switch array 21 such as a keyboard, which is activated by an operator, and a sound input converter 22 such as a microphone, which can be used by the operator to speak or provide other sound inputs. The output device includes a sound output converter such as a speaker & and a visual display device capable of presenting a visible Dfl such as an LCD panel. In another embodiment, which is not shown in the drawings, the device 1G is a personal digital assistant having a switch array 21 for input and a visual display device 24 for output 297 mm). Applicable standard standard (pda), But any sound input or output converter can be used in the second picture. Department ... represents two RAMs and various :: electricity :. The memory Π represents a circuit that provides storage such as sex information. _People ’s only memory and other volatile and non-volatile 21 (keyboard) and warning devices; 6 ("= system 18 represents to the switch array surface. The display control π represents the input and output devices to the display clothing / j Interface encoding screw card. Does not install the interface of 24 (LCD panel). And transmission 2: 6: output circuit to 10 circuit for decoding. Rain, Lu, II (speaking) audio signal encoding and P processing state 14 Represents the transmitter 1 and ° coupled to the antenna 25, and transmits signals to and from the radio channel 60. 15 In the example shown in the above example, the various components of the device 1Q are connected to Huiba to represent more In a physical bus. In other embodiments, it can also be achieved using other architectural forms different from the bus. For example, in the embodiment of the personal digital assistant (pDA), such as the codec 16, voice The input converter 22 and the sound output converter 23 4 components can be omitted, and other components such as the communication processor 14, the transmitter 15, the receiver 19, and the antenna 25 can be provided by a device other than the device i 0. In other words, various replacement types are possible The function of one or more components can be implemented in many different ways, including abstract logic components (discrete logic components), one or more application specific integrated circuits (Application Specific Integrated

Circuits (ASICs)) and / or programmable control processors. The implementation type is not limited. This paper size applies to Chinese National Standard (CNS) A4 specifications (2) 0x297 mm. Page 11 595198

Explanation of the invention Positive complements Some components such as antenna duplexers and power management circuits are important in actual implementation, but they are not so important when explaining the principles of the present invention, so they are omitted in the drawings for clarity. B • Application 5 Many songmails and DIY applications "Small 6" depends on the device! 〇The characteristics and the linking device servo is 30, and the party receiver This depends on the communication technology. This paragraph provides a brief description of the concept and ignores the detailed considerations that may be required for actual implementation. Additional considerations are discussed below in various embodiments. 1. SongMail Operator Songmail messages can be generated using a phone or other device with a voice input and output converter. Preferably, the phone has a switch array 21 that can be actuated by pressing the corresponding button array, and a voice input converter 22 such as A microphone, a sound output converter 23 such as a speaker, and a raster-type 15 visual display device 24 (rasterized visual), such as an LCD panel. For example, an operator starts a song by pressing one or more buttons of the device 10. Mail (SongMail) processing flow. Device 10 uses one or more of its output devices to present prompts or other information to guide the operator through song mail (SongMail) Processing flow, such as expressing auditory 20 information through sound output converter 23, or preferably visual information through display device 24. For example, if device 10 is a general mobile phone, visual display device 24 is only displaying The telephone number entered by the operator assists the operator in setting the voice communication path described below. In response, the operator uses one or more input devices of the device to control the generation and transmission of messages. For example, This paper size applies to China National Standard (CNS) A4 specifications (2) 0x297 mm. Page 12 595l98 5. Description of the invention (10 Voice input converter 22 provides voice wheel man 'or better, you can press the button so that One or more switches of the switch array 21 are moved to provide tactile input. A) Setting, ancient third picture display * _ about the steps of the song mail (sngngs) processing flow in the embodiment. In step ⑻ of this processing flow, The operator can start the song mail (sngMaii) application in any way suitable for the specific embodiment. In step 102, 'Know the author's language choice for the system Used to provide prompts or other information to guide the operator through the processing flow. In step ι03, the operator can choose. | Generate new messages; I listen to previously generated messages; delete previously generated messages; # 送 previously generated Message; or ㈣. In the preferred embodiment, 'if there is no previously generated message, there are no options for functions such as listening to messages, deleting messages, or sending messages. If the operator selects the option to generate new information, , The processing flow will continue to step 1 丨 4. If the operator 15 selects the message option generated by shame first, the processing flow will continue to step 124. If the operator chooses to delete the previously generated message option, the processing flow will Continue to step 134. If the operator chooses to send the previously generated message option, the process flow continues to step 144. If the operator selects the option to leave, the processing flow will continue to step 104 to stop the processing flow. b) Generate 20 In step 114, the operator selects "background music" for his message. In the preferred embodiment, the operator can select background music by title, singer, music style, or the atmosphere conveyed by the music. This system can also display part of the available content to the operator from the content database. The available content is filtered and arranged according to the operator's preference and stored in the storage device 33. This paper size applies to the national standard (CNS) A4 specification of f〇χ297297 幻 幻 第 13 页 595198 5. Description of the invention (11 The wide-ranging interior music vocabulary is used to classify the pre-stored data provided by the system. : Two Γ for the "operator content" provided by the operator. The content that this member first exists does not have tAf scene music, but the mode is selected. In the-embodiment, the server 30 will = save 2 Inner valley storage In the storage device 33, the selected content is stored in the device m library and transmitted to the operator. In another embodiment, a pre-existing device such as a removable solid-state memory device is stored in the device]. „At step In 115, the system plays the selected background music through the sound output Han converter 23, and outputs the content of the transition ^ " through the sound. For example, the second = turn… 2 receives the operation song from the operator ~ Operate in the corpse when listening to background music "* The author provides pull-up content that overlaps with the background music representation in rhythm, and controls this overlapping rhythmic relationship. Li = 115 and 116 — Repeat until step m is determined. The generation of aerobics is completed Then the material process here will continue 15: 1: a case 'This method can continue to other steps to allow: make: the two recipients to identify' and will have the operator just created two: two !: to these Recipient. A method of message transmission will be: monthly. Better, if this method goes directly to a step that allows the operator to convey his heart, a step-by-step will be provided to allow the operator to stop the message transmission. Better For example, the "server 30 stores a representation of a message in the storage device 33" The representation of this message includes the operator's content but does not include the background music by the operator. The server 30 only stores the identification of the selected background music and this-content space An indication of the rhythmic relationship. The background music itself is stored elsewhere in the database. When the message is transmitted to the recipient or operator for review, 20! Vvv 5. Description of the invention (12 The content provided by the operator will be combined, and the relationship will be maintained during the combination. The rhythm between the two contents observed by the author is as follows: when the honeycomb type thunder contains 5 scene music is transmitted to the device 1 When the first special technology is used to carry back the selected operator's content, it usually means the time when it is presented to the operator, and the delay of receiving by the device can be significantly delayed. Unless this rhythmic relationship between representations, two, two methods = the relationship between the content of the operator and the background music. When a small number of decisions can be transmitted to the receiver, the delay determination method of maintaining this Γ :: r is unified: Tool: Service mention: Communication service of nested phone service 'and this service is 15 systems. ^ The author Naigu was provided by "The rhythm known by the author Guan Er = Service provider can not provide an estimate of the transmission delay, then the server π operation" Tiger-to-device 10 can use this signal to cause certain identifiable events 2 to be transmitted back to the device 30 to measure this delay. The device lQ includes a characteristic that can automatically respond to a specific signal, and the server 30 may not need to request such a delay. _30 can observe ^ t the wheel to ^ 10, if the operator takes a button such as a wish button Action 7 and receiving some instructions from the device] such as actions taken by the operator, use the time interval between them to measure the delay. Right these delays are not accurately known, then the server 30 will not be able to accurately determine the paper rule. Shijia _Jia Su 7 ^ 17 two. _ (2) 17297 issued. Page 15 V. Description of the invention (13)疋 #The rhythm sewn by the author is sent to the receiver or to the operator for review. However, if the feeder 30 has a certain rhythm, it will maintain this rhythm relationship. C) Ling Ting, as seen by the author of the internal office for the time, c) Ling Ting In step 124, choose to go and force @ a 视. At step 125+, the device has already produced the message to review the background music of the message: As soon as the 4: 1 author content is selected and selected to play with 10, it will basically be maintained when the insider is provided. The performance of the selected background music content and ^ L, Gui Dong $ get up. This representation is continued until it is judged in step 126 that this is the end of the author's request, such as by pressing a button. This processing flow continues to step 103. , D) Delete 15 In step 134, the operator who chose to delete the previously generated message is selected in y step 1 35. The operator is asked to confirm the delete operation. If it is confirmed to be deleted, the message will be deleted at step 136, and processing proceeds to step 103. If the deletion has not been confirmed, processing continues to step 103. e) Transmission In step 144, the operator selects an option to transmit a previously generated message. In step 145, the operator identifies one or more recipients. In a preferred embodiment using a cellular phone, the operator can press a button on one or more phones to specify a phone number, or the phone number or e-mail address list on the storage device 33. Select recipients, this list must be handled by the operator 595198

Page 17 595198

595198

595198

1 · Ancestral Server-Operator Communication

Although device 10 is indispensable in principle without specific communication facilities in the U.S. and U.S., it is expected that for many applications, communication via cellular telephone systems will be of commercial importance. The technologies that can be used with many forms of cellular telephone systems are discussed below. Obviously, these technologies can be used for a wide range of combinations. a) Successive use of data and voice communication facilities The first technology can be used with one or more communication systems that provide data and voice communication facilities. According to this No. 1 technology, the operator uses data communication.

The communication facility setting application is then stopped using this data communication facility and the voice communication facility is used to generate the message content. For example, this first technology can be used with cellular telephone systems without the need to provide simultaneous access to data and voice communication facilities. One way this first technology can be implemented is shown in the fourth figure. In step 1 5 20 1 for an operator who has never

"(session)" starts by establishing a data communication path, and uses this path to convey the operator's choices, such as the application (SongMail or MusicDi γ), language, and Background music etc. In other embodiments, step 20i also allows the operator to designate one or more 20 recipients for the message to be generated. In step 202, the use of the data communication path is terminated. The server 30 stores the author's side; the selections made during the application setting and other data provided, etc., are stored in the storage device 33 for connection (sessio). This information will be used to perform the remainder of the application connection. This paper size applies the Chinese National Standard (CMS) A4 specification (210x 297). Page 20 595198 192. 11. 17 V. Description of the invention

Year and month In step 203, for an operator who has never used the connection, the connection is continued by starting the voice communication path. Some examples of how this technique can be achieved are detailed below. In the first example, before terminating the use of the data communication path, the server 5 30 transmits information to the device 10, which includes an identification of the connection period and a code designating a telephone number for the operator to dial. For example, if Short Message Services (SMS) is available, it can be used to transmit this information. This voice communication path is established when the operator dials a phone number. When receiving a call from the server, the server 30 responded to request the operator to enter a connection code of 10, perhaps by pressing a button on the phone. Alternatively, the device 10 stores the connection identification information and automatically recognizes the connection by transmitting an audible signal such as a dual-tone multi-frequency (DTMF) tone to the server 30. For example, in any example, the server 30 may use Interactive Voice Response (IVR) to obtain the connection 15 code from the voice communication channel. When the server 30 receives the correct connection code, it uses the voice communication path to continue the connection application. In the second example, before the use of the data communication path is terminated, the server 30 obtains a telephone number for the operator to dial. This number can be obtained directly by the operator or by personal information stored on the storage device 33 for use by the operator. The server 30 may ask the operator to confirm this number. When the operator dials to connect to the server 30 using this phone number, the voice communication path is established. The server 30 may then ask the user to enter certain codes to confirm his or her identity, or to identify a particular connection in a manner similar to that described above. When the server 30 successfully contacts the operator, it continues to connect using the voice communication path 595198

Supplement A7 B7 V. Description of Invention (19) Application. In a third example, an application executing on the device 10 uses a service provided via a wireless telephone application interface (WTAI) to call the server 30, establishes a voice communication path, and uses, for example, a wireless access protocol 5 (Wireless Access Pr0c01 (WAP)) protocol transmits audible signal connection identification such as dual-tone multi-frequency (DTMF) tones. In the fourth example, before the use of the data communication path is terminated, the device j 〇 transmits information including user identification to the server 30. At the start of the call response of the voice communication path, the server 30 automatically determines the user identifier 10 and connects and recognizes it. For example, the device 10 is paired with a phone number, and the device J 0 may send its matched phone number to the server 30, which will be stored with other information about the connection. The server 30 may automatically determine user identification by using a telephone system feature such as "Caller ID" or Automatic Telephone Number Identification (ANI). In step 204, the server 30 may & provide the desired prompt or instruction, and it may automatically play background music or wait for the operator to give a start command, such as by pressing a button on the phone.

In step 205, the server is in the storage device 33.

Button, or when background music playback ends, add a judgment.

595198

Supplement A7 ------------...--- B7 V. Description of the invention (20) ~ " a 'one ~~ The remaining part of the application processing flow of step 207 can be implemented in various ways. In the embodiment, step 207 transmits the generated message to the recipient identified during the application setting. In another implementation, steps 2Q7 allow the operator to listen to the message and perform other functions using techniques similar to those described below using only voice communications. + In another embodiment, step 207 terminates the use of the voice communication path, and continues to connect to the application by starting the use of the data communication path by mistake. The operator can then send messages similar to those described below for use by technical devices that can simultaneously process data and voice communications facilities. 10 In an alternative embodiment of the first technique, steps 202 and 203 are implemented in different ways. In step 202, it is indicated that the information determined and selected by the operator is stored in the device R0 instead of the server 30. In step 203, the application executing in the device 10 is to use a service provided via the wireless telephone application interface (WTAI) to call the server 3 to establish a voice communication path, and 15 by using such as wireless access communication The protocol of the Wireless Aecess Protocol (WAP) transmits audible signals such as dual-tone multi-frequency (DTMF) tones to identify operator decisions and choices. b) Only using voice communication facilities The second technology can be used with any communication system that provides voice communication facilities. According to the second technology, the operator only uses the voice communication facility to set up the application and generate the message content. The third figure shows a way to implement the second technique. In step 10J, a voice communication path is established for an operator who has never used it. The remaining steps are by allowing the operator to make a choice and communicate via voice communication. The paper size applies the Chinese National Standard (CNS) A4 specification (21 × 297 mm). Page 23 595198 \ ϊ ^ > c 九九 丨 02 11Ί 7 ^ Jl a V. Description of the invention (21 Enter 而 7 to enter. For example, this can be entered by utterance or by pressing the button on the phone. The server can use the speech recognition software (speech reC 〇g_〇n S0ftware) to explain this discourse expression. In a suitable embodiment a, I double frequency (DTMF) signals are used to represent operator choices and commands. Alphanumeric characters can be used by using existing The technology is input by buttons. If the word is known, this feature should be limited or carefully controlled when the operator provides the content to the song mail (S0 is called 1). For example, this can be achieved by using The use of verbal ascertainment restricts non-operator expressions as limited reserved words for the operator's content. Preferably, the verbal ascertainment process stage is suppressed 'and only dtmf signals are read as commands 15 If the dual-tone multi-frequency (DTMF) method is used, this feature should be limited or carefully controlled when the operator provides the operator's content for making his own music (MusieDiY) application. Preferably, if the device 10 Permits should limit all ^ Li Xi frequency (then F) production S during the DIY music generation phase; however, two or two buttons such as the pound key (#) or asterisk key , Can be reserved as a command to stop the generation phase. In another option, all buttons can be used as input for the operator content, and the method known as Shijiao 20 can be used as a way to terminate the execution of this phase. Order ... C) Simultaneous use of data and voice communication facilities The third technology can be used in any communication system that provides simultaneous access to data and voice communication facilities. According to the third technology, the operator uses the data communication facilities to set the application ’and then does not interrupt the use of the data communication facilities. The standard THiTTr specification (hiring 297 public love) Page 24

Generate message content by using 5Way communication facilities. The second figure also shows that the third technology can be implemented in 1 Π Ί. In step A, for any operator who has never used it, the data and voice ventilation path must be established. The rest of the steps can be implemented by allowing the operator to count through the data communication path, select and enter a command, and receive background music through the voice communication path. Μ and d) Only the use of data communication facilities The fourth technology uses features such as "Internet telephone (V〇ice 〇ver Ip)", 10 15 This feature is to transmit operator content via the data communication path. This is to use the data communication path for application settings and message generation. ’The third figure shows one possible implementation of the fourth technique. In step step, if no path is available, a data communication path is established. The rest of the steps can be implemented by allowing the operator to make choices, enter commands, receive background music, and provide author content via a data path. 2. Server-Receiver Communication Although the servo is 30, it can directly send the content of the message to the recipient, but in the preferred embodiment, it will be replaced by only sending a message notification. The content of the message includes instructions for retrieving the message. , And may also include an introduction or explanation by the person who created the message. This can be done in various ways. There is no particular way to limit the invention. One way to send notifications is to use the messaging services of the telephone system, such as Simple Message Service (SMS) or Multimedia Messaging Service (mms). For example, the content of the Short Message Service (SMS) is limited in length and can only be applied to the Chinese paper standard (CNS) Α4 specifications (2) 0 × 297 published on page 25. Page 25

595198

92. 11. 1 * 7 η: I Supplement V. Description of the invention (24 D • Extra features In a preferred embodiment of DIY, the device 10 can synchronize with background music to make the switch array Any switch actuation can cause the device 1G to produce-follow the specified music rules. With this feature, no matter which switch is actuated, the overall effect of combining the operator's content with the background music is pleasing. Device 10 You can change the corresponding relationship between the corresponding switch in the switch array and a specific sound or note. One or more corresponding relationships classified as corresponding here can be stored in device 1 () in advance, or can be transmitted with background music The information obtained by 10. 1 · Synchronization 15 When the scene music is played to the operator, the valid correspondence within a specific time can be modified or selected from a group of correspondence. The identification of the correspondence used and the time of the correspondence can be By receiving the background music and playing the interval to the operator, f is specified by the previously received control information. Generally speaking, this correspondence will be changed in accordance with the interval to match the background sound The tone change or chord change is the same. 20 The right control information is received before playback, and it should specify the correspondence and when to use this correspondence. You can use the corresponding identifier and the end of the background music playback, σ σ such as and Specify the expected correspondence and the corresponding time for the offset related to the start of music. For example, specifying the control information of 7 @ 37 · 2 can indicate that the device 10 should start using 37.2 seconds after the background music starts The seventh correspondence in the previously stored correspondence group. If the control music is received during the background music playback, it can only identify the correspondence that it wants to use, because the time has been adjusted by the time when the control information is received for China National Standard " ^ CNS) A4 Specification (210 × 297 Gongchu) Page 27 595198 92 · 11. Π Amendment A7 B7 date, H, Supplement No. 5 and Invention Description (25). 2. Correspondence In the preferred embodiment, the correspondence relationship is basically based on standard music theory and based on five jazz / pop music chords: Major, Dominant 7th ), Minor (Dorian), weak starting (Locrian), and incomplete bar (Diminished) and other one of the predetermined scale structure.

Chords represent a series of tones called scales. The scales of other chords can be ordered based on their "sound" or harmonic level (level 〇f c〇ns〇nance) or the level of dissonance related to the basic tonality of a particular chord. There are usually five or more scales that can be harmonized with any particular chord. The following list shows specific chords (categorized here as "basic chords and two other chords that harmonize with this basic chord interval. Example. US version 15 is shown on the first line, which shows that the second chord that occurred in the background music is shown in this second and green notes. The note is shown on the second line. Another harmony with the basic chord interval ^

The second one. In one example, the harmonic interval chords are chosen to match the base chords. The notes in the scale of the harmonic interval chord are shown on the fourth line. + Basic and knot Basic and knot notes Harmonic interval scale C major D (C Major) (Major) C is seventh and C E G Bb D is seventh and chord (Dominant (C Dominant 7th) 7 th) Notes c D E F G a Bb

C The size of this paper applies to the Chinese national A4 specification (2) 0χ 297 Gongchu Page 28 20 595198

false. The device 10 is a mobile phone with a 2-key keyboard (with buttons labeled 1 to 9, 0, #, etc.). These two harmonic intervals can be mapped to the keyboard in the following manner.

C Major C D E F G A B C E F G

C is a 7th chord (C Dominant 7th) C D E F G A Bb C D E F G When the basic chord changes in the background music, the corresponding relationship should also be changed, so that no pitch will produce a discordant interval sound or "wrong" notes. For example, let ’s say that the first four chords of the background music are F major (F 0 Major), E minor seventh chord (E Min〇r 7th (Em7)), and A seventh chord (a 7th), and a D minor seventh chord (D Minor 7th (Dm7)). It can also be assumed that the harmonic interval scale selected to match each basic sum is the basic chord scale itself. The pitch of this fourth chord can correspond to the following ...

If the corresponding relationship is changed by the operator only pressing the button "1", a series of notes F / E / A / D will be generated. This paper size applies the Chinese National Standard (CNS) A4 specification (21 × 297 public love) Page 29 595198 9ϋ17 Revision + Supplementary description C 27) Unfortunately, 'skilled musicians do not come in this way Working with scales. When the chords in the background music change based on chords, scale relationships, rhythmic numbers (hime figures), and note settings, musicians will choose the most appropriate series of notes to replace. As mentioned above, the simple correspondence relationship between the keys is not given to the less-skilled one in musical skills. "Examination, this implementation experience can be greatly improved by controlling the logical flow from one correspondence to another. Two different correspondences can be used in combination to achieve this purpose. F The correspondence is the chord / scale mentioned above. Contrast. This correspondence is pre-established by the musician ... The relationship can be selected by music = according to a particular song that it thinks is most suitable. Another option: Musicians can according to different music styles, such as jazz , Blues ⑽ Xiao Er 15 songs (sewing), pop (P0P), etc., establish a variety of relationships, and allow the operator to choose the style they want. This can establish the first-and knot / scale correspondence. Second Correspondence relationship controls the process of changing between different correspondence relationships. This second flow relationship can also be provided by the accent reading device Λ device 10. It can be established 'or it can be automated by the feeder 1 or 20 / using the above example to establish The above four and _ and @ / scale correspondence. The flow change between these correspondences is controlled by adapting the notes of each scale designated at the key Γ1 ″. In the 〇ne-half musical step, under a specific correspondence relationship, the key "notes with the same note and the previous corresponding note with the same note. This results in the following correspondence: '' This paper rule ¥ Applicable page 30

_ F F G A Bb C D " E F G (A Bb C

Em7 F # G A B C # D E Ff --- Circle ~ G A B— C? A7 F # G A B C # D E F # G A B C #

Dm7 F G A B C D E F G A B C The relationship between the right and the right is that the operator only has to press the button "丨" and f 夂 will generate a -sequence note F / F # / F # / F. By pressing the button "4", the dull author will generate a sequence of notes Bb / B / B / B. —By binding the change in the correspondence flow, the operator can more easily anticipate the notes that will be produced by pressing the special keys and the music that will be more realistic than the way the keys are pressed. Substitution relationships can be used to control the flow of changes between correspondences. For example, for a specific correspondence of 10 "brothers", the third, fifth, or seventh note of the chord can be assigned to the key "1", and the same note can be assigned to the key "1" for half-music. Use the corresponding relationship of. The operator can also be allowed to select the corresponding process relationship. For example, if the corresponding flow relationship and subsequent correspondence are sequentially arranged on the fifth key, the corresponding relationship for the above-mentioned fourth chord, "1" corresponds to the notes c, c #, c #, and c. ^ This paper size applies the Chinese National Standard (CMS) A4 (210x 297 mm) page 31

595198 V. Description of the invention (29) [Comparison of component numbers] 10 Mobile device 11 Bus 12, Processor ~ 13 Memory 14 Communication processor 15 Transmitter 16 Codec 17 Display control 18 Input / output control 19 Receiver 21 Switch array 22 Audio input converter 23 Audio output converter 24 Visual display device 25 Antenna 26 Warning device 30 Server 3 1 Processor 33 Storage device 3 4 Communication device 35 Receiver 36 Transmitter 37 Antenna 40 Network 4 1 Computer System 42 Recipients, Computer Department, 50 Public Switched Telephone Network PSTN 5 1 Telephone 52 Recipient, Telephone 60 Radio Channel 62 Recipient, Movable Device, 101, 102, 103, 104, 114, 115, 116, 117, 124, 125, 126, 134 '135, 136' 144, 145, 146, 147, 20 202, 203, 204, 2 05 ^ 20 6 > 2 0 7 Steps This paper size applies Chinese National Standard (CNS) A4 Specifications (2〗 0x 297 mm) Page 32

Claims (1)

595198 A8 B8 C8 D8 Six patent application scopes 2 2 1 1 ^ 9: 1 "year of the tiger application 4 cargo application patent scope amendment-a method for handheld devices, the handheld device has one or more L The output device includes a raster visual display device that rotates the display of an operator, or includes a switch array that receives input from the operator: "a spoon input device; a wireless transmitter; and controls such as One or more output devices, the one or more input devices, and a processing circuit controlled by the wireless transmitter, the method includes the following steps to perform the actions: installing and passing the raster visual display device will assist the operator in controlling The operation information of the handheld device is indicated to the operator; the operator is provided with a representation of a first content representative via the one or more output devices; 2. According to a rhythm relationship controlled by the operator, the operator receives, through the one or more turn-in devices, an identification of the second content with the first content representing the child and one or more recipients. ; And transmitting, via the wireless transmitter, the second content representative identification with the one or = recipients to a remote server spatially isolated from the handheld device, and causing the remote server to transmit a The information arranged according to the rhythm relationship indicates that the first content and the second content are transmitted to the one or more recipients. The method for a handheld device according to item 1 of the scope of patent application, further comprising receiving and transmitting a first signal represented by the first content through wireless communication. 3. The method for a handheld device as described in item 2 of the scope of the patent application, the first signal transmitting a bandwidth-compressed representative of the first content, and the method includes expanding the bandwidth-compressed representative. Page 33 A8 B8 C8 D8 Λ. Feed 93. 4. 30 Ε | Six applications for patent scope 4 · The method for handheld devices as described in the first and second members of the scope of patent application, the 1 transmits the first-content-adjustable bandwidth compression representative, the basin has a response The bandwidth changed by the representative characteristic of the second handheld device transmitting the second content needs a wide compression representative. ^ Method includes expanding the adjustable frequency. 5. ==, the dialect for a handheld device as described in the item: language LI: includes music, and the second content includes receiving by the operator 6. =: patent scope first The method for a handheld device described in item 2, and secondly, "in response to the actions of the switch arrays, each output device indicates the sound to the operator, wherein the switch array actions from the author of the money Instructions. 7. The method for a handheld device as described in item 6 of the scope of patent application, 1 further includes adapting according to the characteristics of the first Inner Xuanla ## _ 士 ^ αΑ ^ ^ The sound produced by the action of a special switch in the switch array. 8. The method for a handheld 0-type device, as described in item 6 of the scope of patent application, 1 further includes adaptively controlling the handheld device to respond This action on the switch arrays generates dual-tone multi-frequency (DTMF) signals. 9. The method for a handheld device as described in item No.! Of the patent application scope, further comprising causing the remote feeder to switch the first Three contents added to the message, the second Uchiya The operator controls 10. 10. A system for generating messages, the system includes ... U)-a handheld device having one or more outputs including a raster visual display device that represents the output to an operator Device; one or more paper sizes are applicable to China National Standard (CNS) A4 specifications (210x297), page 34 VI— ~ Applicable patent scope C8 D8 Into the device; the following actions: the wireless input of the switch array receiving the input-wireless transmission 芎! .. and the processing circuit to make the handheld device decay: 1 (1) (2) (3) raster visual display device Present to the operator information that assists the operator to control the temple-type equipment; provide the operator with a content representation via the-or multiple output devices; received by the operator through the one or more input devices The signal of the second content overlapping the first content and the identification of the one or more recipients according to the rhythmic relationship controlled by the operator; and (4) transmitting the second content via the first wireless transmitter A representative and one or more recipient identifications; and (b) a feeder subsystem, system, the fitness subsystem having-a wireless receiver, one or more storage devices, and the server subsystem A processing circuit that: (1) receives via the wireless receiver and stores the second content representative and the one or more recipient identifications via the one or more storage devices; and (2) sends a Representative root The rhythm of discharge opposed relationship to the first message content and the second content to one or more recipients to such. Π · The system for generating a message as described in Item 10 of the scope of patent application, the server subsystem includes a second wireless transmitter, and the server subsystem is based on Chinese paper standard (CNS) A4 Specifications (210χ 297 mm) Page 35 595198 A8 B8 C8 D8 6. The processing circuit in the patent application system causes the server subsystem to transmit a first signal representing the first content to the handheld device via the second wireless transmitter. 12. The system for generating information as described in item 丨 丨 of the scope of patent application, the first signal conveys the / content compression representation of the first content. 1 3 · The system for generating a message as described in item 11 of the scope of patent application, the processing circuit in the server subsystem responds to the content of the younger brother representing the characteristic received by the handheld device, and causes the temple to serve The processor subsystem changes the bandwidth requirement of the first signal. 14. The system for generating a message as described in item 10 of the scope of patent application, the first content includes music and the second content includes speech sounds from the operator. 15. The system for generating a message as described in item 10 of the scope of patent application, the second content includes the actuation of the switch array by the operator, and the The processing circuit causes the handheld device to respond to the actuation of the switch arrays, and to sound the operator via the one or more output devices. 16 · The processing circuit for generating a handheld device as described in item 15 of the scope of patent application causes the handheld internal characteristic to be adapted to the sound generated in response to actuation in the switch arrays. Message system, the device is a system for generating messages according to the 17 hands of the first specific switch as described in item 15 of the scope of interest, and the processing circuit of the two Γ controls the handheld device to In response to this actuation of the 4-switch array, a dual tone multifrequency signal is generated. Page 36 595198 ^ ____ A8 B8 C8 D8-~ Mao Bei3 6. Scope of Patent Application _ 1 9 · A server system with a wireless receiver device and the server system to perform the following actions 18. The system for generating information as described in item 10 of the scope of patent application, the processing circuit in the server subsystem is responsive to the information received by the handheld device, so that the feeder subsystem adds the third content To that message. One or more robust processing circuits: (w receiving one or more signals via a wireless receiver by a handheld device, the signals being generated under the control of an operator of the handheld device, wherein the one or more Each signal transmits (1) an identification of the first content, and (2) a second content overlapping with a representation from the handheld device of the first content, wherein the overlap is based on control by the operator Comes from a rhythm relationship, and (3) —an identification of one or more recipients; (b) obtains information identifying the rhythm relationship; and (c) represents the first content and A message of the second content is transmitted to the one or more recipients. 20. The server system according to item 19 of the scope of patent application, the server system includes a wireless transmitter, and the server system The processing circuit inside causes the server system to transmit a first signal of the representative of the first content to the handheld device via the wireless transmitter. 21 · The server system according to item 20 of the scope of patent application, The first signal A bandwidth compression representative of the first content is transmitted. 22. The server system described in item 20 of the scope of patent application, the § mystery processing circuit in the temple server system causes the temple server subsystem to respond to the The size of the handheld paper is applicable to Chinese National Standard (CNS) A4 (210x 297 mm) Page 37 ^ 95198 6. The scope of patent application is positive The characteristics of the second content ordering table received by the device change the first bandwidth requirement. 2 3 · As described in the Qing Dynasty Patent Scope Dingsuo and Gudi Xiang's shrine server system, this section contains music and the second content contains the sound received by the inlay #writer. 24. For example, the server system of 19% of Gule, which is covered by the 1st g% of the δ Qing patent scope, includes the music and the second inner mystery. The inner brother represents the formula by the operator. The action of a switch array in the device. 25. According to the temple server system described in item 19 of the scope of patent application, the temple shall add the third content to the information received by the handheld device. 26. A machine-readable medium containing a machine-executable program instruction for execution—for a handheld device method. The handheld device has one or three winter days including an output table operation. The output device of the raster visual display device of the user; or one more turn-in device line transmitter that receives the switch array turned in by the operator; and controls the one or more output devices, the input devices, and the A processing circuit controlled by a wireless transmitter, which includes the following steps for performing these actions: · The information assisting the operator in controlling the operation of the handheld device is displayed to the operator via the raster visual display device; The output device provides a representation of the operator's representative. According to the rhythm relationship controlled by the operator, the content of the voice through the content of the three tigers is added to the one or more parties. One includes: one or more methods to package the hand first and so on Scope of patent application A8 B8 C8 D8 or multiple turn-in devices are operated by the operator ^ λα ^ ^. The recipient receives an identification of the first content that overlaps with the first content and one or more sisters and sisters; and ' Passed by the wireless transmitter ^ ^ 1 finds 4 苐 2 content represents an arrangement that is isolated from the handheld device or the Daddy 2 from the handheld device | makes the & 鳊 server transmit a according to the rhythm The relationship arrangement indicates the first internal receiver. One or more content messages to one or more of these 27. For example, the 26th yarn of the scope of patent application, Fujie—Renbei ’s -the-then-signal of the machine-readable medium. "Representation of No.-Content 2 8. As described in item 27 of the patent application scope of the patent, 哕 ^ ^] the medium read by the machine ~ the first ^ will convey the first content ^ ^ »Female, t ^ 5 member width & contraction representative, and the method includes expanding the bandwidth compression representative. 29. As described in item 27 of the patent application scope, the-signal conveys the content of the first content The media table read by a precision and two machine has a bandwidth requirement that is changed in response to the representative characteristics of the handheld: suitable bandwidth compression generation, and the method and the second content adjust the bandwidth compression representation. Contains the extension of the available voice. The vocal sound of the machine as described in item 26 of the scope of the patent application, the first content contains music and the second content is received by the media. The operator 31. The miscellaneous & product robotic spider object as described in item 26 of the scope of the patent application, which further includes a plurality of output devices in response to the action of the switch array. Operator, * μ find one or the second content of this paper Chinese National Standard (CNS) Α4 Specification (210χ 297 mm) on 39 595 198 Year, month and year A8 B8 C8 D8 6. Scope of patent application Contains the action instruction of the switch array from the operator. 3 2. The machine-readable medium as described in item 31 of the scope of patent application, further comprising adapting the sound generated in response to the activation of a specific switch in the switch array according to the characteristics of the first content . 3 3. The machine-readable medium according to item 31 of the scope of patent application, further comprising adaptively controlling the handheld device to generate dual-tone multi-frequency (DTMF) in response to the activation of the switch array. signal. 3 4. The machine-readable medium according to item 26 of the scope of patent application, which further includes causing the remote server to add third content to the message, wherein the third content is provided by the operator control. This paper size applies to China National Standard (CNS) A4 (210x 297 mm) Page 40