JP2006119572A - Portable moving picture multimedia player, microphone type picture/song accompaniment device, method for generating music file for picture/song accompaniment, reproducing method, and storage medium therefor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable multimedia player capable of being attached to/detached from a microphone case and a microphone type picture/song accompaniment device. <P>SOLUTION: The device includes the microphone case and the detachable portable device. A head part of the microphone case is provided with an external microphone. An attachment groove is formed on a handle part, and a microphone connection terminal and audio line and video line terminals are formed in the attachment groove. The detachable portable device is detachably attached to the attachment groove of the microphone case, in which a plurality of connection terminals to be electrically connected to the microphone connection terminal and the audio line and video line terminals are formed on the outer circumferential surface. In response to the attachment/detachment operation, the detachable portable device switches the external microphone and the internal microphone, operates in a picture/song accompaniment mode when attached, and operates in a portable multimedia player mode when detached. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a portable video multimedia player, a microphone-type video song accompaniment apparatus, a video song accompaniment music file generation method, a playback method, and a storage medium thereof, and in particular, a portable video multimedia player as a microphone case. The present invention relates to an apparatus and a method that can be worn and provide a television with a background image composed of a moving image and a still image together with an accompaniment of a song and enjoy a song together with the background image.

  The inventor has disclosed Patent Document 1 (a microphone with an automatic accompaniment device) in 1995, Patent Document 2 (a microphone for transmitting video / song lyrics information and accompaniment tone) in 1997, and Patent Document 2001 in 2001. 3 (automatic accompaniment and video output control microphone and video / caption generation receiving device) have been filed.

  A microphone-type video song accompaniment device is one in which a video song accompaniment device is built in a microphone case, and the microphone and the video song accompaniment device are integrated. It is a device that can transmit the background video, accompaniment tone, and lyrics by the method and enjoy the video song accompaniment.

  The device in Patent Document 3 transmits accompaniment tone and voice, but does not transmit actual video, but simply generates and transmits a video output control signal and subtitle control signal. Corresponding video and subtitles are configured to be displayed on the television screen. This is because a large amount of memory capacity is required to store video data in the microphone.

  The conventional microphone-type singing accompaniment device is about the size of a microphone and is small, but there is a limit that it can be enjoyed only in a place where a box-type case is provided, at home, in karaoke, or in a car, etc., and always used anywhere It was bulky and inconvenient to carry.

  Usually, when storing live music of a singer on a compact disc (CD), a data capacity of about 1.41 Mbps (= 44.1 kHz × 16 bits × 2 ch) (176 kB) is required. Therefore, assuming that one song is 4 minutes, a total data amount of 338.4 Mb (= 1.41 Mbps × 240 sec) (42.3 MB) is required. An MP3 file obtained by compressing audio data of CD sound quality level at a 1/12 compression rate can be stored with a capacity of 3.525 MB.

  Accordingly, in order to store about 5000 song accompaniment files in the MP3 file system, a memory capacity of 17.625 GB is required. Therefore, when the portable song accompaniment apparatus is embodied in the MP3 file format, the downsizing of the apparatus and the expensive production cost are burdened. When a small hard disk is used as a storage device instead of a semiconductor memory chip, there are problems such as power consumption, physical shock stability, and product miniaturization.

  Furthermore, in order to support the background video during the accompaniment of the song, the background video data must also be stored in the apparatus. When a color moving image and a still image having a size of 720 × 480 are stored as RGB data, a storage capacity of 8.29 Mb (= 720 × 480 × 8 bits × 3 (RGB)) per screen is required.

Therefore, it is very difficult to commercialize a portable song accompaniment apparatus capable of storing all of the thousands of song song accompaniment files and background image files due to memory capacity problems. Met.
Korean Patent No. 93362 Specification Korean Patent Application Publication No. 1997-68724 Korean Patent No. 295271 Specification

  An object of the present invention is to solve such problems of the prior art, and has a convenient size for carrying, and can enjoy moving picture singing accompaniment of thousands of songs anytime and anywhere. It is an object of the present invention to provide a portable video multimedia player that can play back data downloaded from the Internet.

Another object of the present invention is to provide a portable video multimedia player that can be attached to and detached from a microphone case.
Still another object of the present invention is to provide a microphone-type song accompaniment apparatus that can be configured as a microphone type when a removable portable moving picture multimedia player and a microphone case are integrated.

  Still another object of the present invention is to generate a video song accompaniment file with a small capacity so that a portable video song accompaniment device can store thousands of music files and thousands of background still images. Is to provide.

Still another object of the present invention is to provide a method adapted to playback of the generated music file.
Still another object of the present invention is to provide a storage medium storing the music file.

  In order to achieve the above object, the device of the present invention has a housing that can be attached to and detached from a microphone case and that can be carried in a pocket. The housing has an internal microphone, an external microphone provided in the microphone case, a plurality of connection terminals for electrically connecting to an audio line and a video line, and a lyric information and menu information for selecting a song. A liquid crystal display unit, a user interface unit for inputting user commands, a computer interface unit for interfacing data upload / download with a computer, thousands of compressed video song files, and compressed background video A non-volatile storage unit in which a file is stored and downloaded from a computer or externally or having a storage area for storing a provided data file, audio data is input and converted into an analog audio signal, and converted audio Through the signal and the external or internal microphone An audio codec that mixes the input audio signal to generate an output audio signal, converts the input audio signal into digital audio data, and inputs video data and subtitle data to generate a TV composite video signal A video codec that inputs video signals to generate video data, and a control unit.

  In the present invention, the control unit detects whether the microphone case can be attached or detached, controls the switching of the external and internal microphones, and, when attached, responds to a user command to store the selected video / music file in the nonvolatile memory. The compressed audio data is decompressed and provided to the audio codec, and the compressed background image is decompressed and provided to the video codec to execute the video song accompaniment mode. In response to the selection, a video song accompaniment playback mode, a computer data playback / storage mode, and a computer data up / down mode are executed.

  In the present invention, the compressed video music file is a voice data obtained by converting a singer's voice into digital data and compressed, accompaniment data generated by generating midi data from an instrument sound, lyrics data, music lyrics, atmosphere, And video control data for accessing background video associated with the genre.

  Here, the voice data is data obtained by compressing the voice signal of the singer. Preferably, the singer's audio signal is converted to 16-bit audio data (704 kbps = 22 kHz × 16 bits) at a sampling frequency of 22 kHz, and the converted audio data is converted to approximately about per second by a compression algorithm of audio standard G726 to G729, for example. Compress with 12 kbps data. Therefore, in the case of music of about 4 minutes, the voice signal of the singer is compressed into data of about 360 kB (= 12 kbps × 240 sec / 8 bit). Here, various algorithms within the same range can be applied as the audio data compression algorithm.

  Accompaniment data is data obtained by generating midi data from a musical instrument sound of a song and compressing the generated midi data. Preferably, 16-channel (16-person) standard, midi data of about 4 minutes has a data amount of about 45 kB. The midi data is compressed to about 13 kB using lossless compression, for example, a compression algorithm such as ZIP or LHA for compressing computer data.

  Therefore, the video song accompaniment file per song has a data amount of about 400 kB including voice and instrument data, lyrics data, and video control data having a data amount of about 373 kB. For example, on the basis of 5000 songs, a storage area of 2 GB is required. Therefore, it has a data compression rate of about 9 times compared to an MP3 file of 5000 songs, and a data compression rate of about 106 times compared to the original signal. Since the capacity of the currently commercialized flash memory is about 2 GB, in the case of the present invention, it is possible to realize a portable multimedia device that stores 5000 songs.

  The background video file includes a moving video file and a still video file. Preferably, in the case of a moving image, 720 × 480 size RGB color data per screen is applied to the MPEG4 compression method and configured as a moving image file having a data amount of 512 kbps.

  For example, the size of a moving image file of about 1 minute can be configured with about 3.8 MB. In the case of a still picture, it has a data amount of about 40 kB by the MPEG4 compression method. Accordingly, when a background video file is composed of about 100 files of about 1 minute of moving video and about 1000 still video files, about 420 MB (= 380 MB + 40 MB) of background video storage area is required. Therefore, the size of the storage area can be appropriately designed by combining thousands of background video files and thousands of video song performance files.

  For example, if a moving picture song accompaniment apparatus is composed of 3000 songs of video song accompaniment files, about 100 1 minute moving picture files, and 1000 still picture files, the overall storage area is about 1.62 GB. Since it is necessary, when the size of the storage area is constituted by a 2 GB flash card, it has a surplus area of about 380 MB.

  Here, 2 GB is described as an example, and various models can be developed by several GB depending on a storage capacity of a size that can be mounted as a portable device of a flash memory card or a memory device.

  In the present invention, this surplus area is provided as a data file storage area. Therefore, about 95 songs of 4MB MP3 files can be stored in the surplus area, and about 100 minutes of moving images can be stored, as well as voice recording data, photo image data, computer files, etc. It is possible to provide a portable semiconductor memory device that can be used.

  The data file according to the present invention, that is, a data file that can be uploaded / downloaded with a computer, is one of an MP3 music file, a voice recording file, a digital photo image file, a moving image file, or a combination thereof. Can be included.

  The non-volatile storage unit in the present invention can be configured by any one of an EEPROM, a flash memory, a flash memory card, a mini hard disk drive, and a combination thereof. Preferably, the medium is exchangeable, and the flash memory card is resistant to physical shock.

  The computer interface according to the present invention can be configured by any one of a USB interface, a LAN interface, a 1394 bus interface, a Bluetooth wireless interface, and a combination thereof.

  In the present invention, the user interface unit includes a direction key provided on the housing, a jog dial combined with a dial and a push button, a mode selection key for selecting a music selection menu mode, and a start and end of a song. The number of keypads is minimized. Accordingly, the production unit price of the product is lowered, and the convenience for the user is improved.

  When the song number selection menu mode is selected by the mode selection key, the song number is scrolled by up / down dialing of the jog dial, and when the song title list selection menu mode is selected, it is displayed by up / down dialing of the jog dial. By moving the cursor on the selected title list, a large number of songs can be selected quickly.

  The jog dial push button according to the present invention moves the cursor along the number of digits of the song number each time it is pressed when selecting the song number selection menu mode, and every time it is pressed when selecting the song title list song selection menu mode. It is preferable to configure the subject list page to be changed.

  The player in the present invention further includes a vibration motor provided in the housing, and the control unit controls the vibration motor so that the housing is vibrated in accordance with the rhythm of the selected song accompaniment. Therefore, when the user sings a song, the user can feel the rhythm of music through the hand holding the microphone. In addition, make it possible to feel the start signal of the song with vibration, evaluate the singing, give a celebration signal when passing, and give a strong vibration corresponding to penalties when failing to increase enjoyment Can do.

  The player according to the present invention further includes a camera module provided in the housing, and the control unit compresses the photographic image picked up through the camera and stores the photographic image file in the data file storage area of the nonvolatile storage unit. Remember me. Therefore, it is also possible to directly produce a music video or music album by taking a picture of the person who enjoys the song or the surrounding people who enjoy the song together.

  The player according to the present invention further includes an FM transmission / reception unit provided in the housing, and the control unit receives the audio data signal and the control data signal transmitted from the auxiliary wireless microphone through the FM transmission / reception unit, and receives the received audio data. The signal is provided to the audio codec, and in response to the received control data signal, the lyrics data of the selected video / music file is displayed on the liquid crystal display unit.

  The player according to the present invention further includes a television transmission unit provided in the housing, and the control unit transmits the composite video signal and the output audio signal as a television channel signal through the television transmission unit.

  An image singing accompaniment apparatus according to an embodiment of the present invention is provided with an external microphone in a head portion, having a mounting groove on an outer surface of a handle portion, a microphone connection terminal, an audio line terminal, and a video line in the mounting groove. A microphone case in which a terminal is formed, and has a portable size, is detachably mounted in a mounting groove of the microphone case, and is electrically connected to the microphone connection terminal, the audio line and the video line terminal on an outer peripheral surface. A plurality of connection terminals are formed, and the external microphone and the internal microphone are switched in response to the attachment and detachment operations, and are operated in the video song accompaniment mode when worn, and are operated in the portable multimedia player mode when detached. A portable device.

  An image singing accompaniment apparatus according to another embodiment of the present invention is provided with an external microphone in the head portion, having a mounting groove on the outer surface of the handle portion, and a microphone connection terminal, an audio line terminal, and a video in the mounting groove. A microphone case in which a line terminal is formed, an FM transmitter and a user interface unit, an auxiliary wireless microphone for transmitting an audio signal and a user command input through the microphone as FM signals, and a portable size, A plurality of connection terminals for electrically connecting to the microphone connection terminal and the audio line and video line terminal are formed on the outer peripheral surface of the microphone case, and are transmitted from the auxiliary wireless microphone. The FM signal is received to restore the audio signal and the user command, and the external microphone and the internal microphone are switched in response to the attachment and detachment operations. And etching, at the time of attachment be operated in the video song accompaniment mode, including, a portable device that is operating in a portable moving picture multimedia player mode at the time of withdrawal.

  Therefore, when the auxiliary microphone is used, the portable device can be used as a lyrics caption device. In addition, it is possible to enjoy a video song accompaniment with a duet using one microphone case and one auxiliary microphone each equipped with a portable device.

  In the present invention, the video song accompaniment is possible only with the portable video multimedia player. However, in order to form an atmosphere of singing a song by holding a microphone in karaoke, it can be used by being attached to a microphone case. It is characterized by that.

  The music file generating method of the present invention includes a step of generating voice data by sampling a live signal of a music singer at a sampling frequency of several tens of KHz, and a step of generating accompaniment data composed of midi data from musical instrument sounds. A music file including a step of generating music lyrics data, a body composed of voice data, midi data, and lyrics data, and a header including a plurality of pointer values for specifying initial positions of the data. And generating.

  The method of reproducing a music file according to the present invention includes a step of obtaining the plurality of pointer values from a header of the music file, and referring to the obtained pointer values, the voice data, accompaniment data, and lyrics from the body of the music file. The method includes a step of obtaining each of the data and a step of outputting an analog music signal by synchronizing the obtained voice data, accompaniment data, and lyrics data.

  The storage medium of the present invention samples a live signal of a music singer at a sampling frequency of several tens of KHz to generate voice data, and generates accompaniment data composed of midi data from the musical instrument sound, A step of generating lyrics data of the music, a step of generating video control data from the index value of the background screen of the music, a body composed of voice data, accompaniment data, lyrics data, and video control data, and A plurality of music files generated by the step of generating a music file including a header including a plurality of pointer values designating an initial position of the data;

  The storage medium of the present invention stores a plurality of background screen files that can be accessed by video control data.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
FIG. 1 is a front external perspective view of a portable video multimedia player according to a preferred embodiment of the present invention, and FIG. 2 is a rear external perspective view.

  Referring to FIG. 1, the housing 100 of the portable video multimedia player has a pocket or a hand-held ultra-small size. A camera 101, a liquid crystal display window 102, and a direction keypad 104 are formed on the front surface of the housing 100. The direction keypad 104 includes four up / down / left / right direction keys.

  The right side of the housing 100 includes a jog dial / button 106, a mode selection button 108, a play button 110, and a headphone jack 112. A card slot 114 is formed on the upper surface of the housing 100, and a flash memory card 116 is inserted and attached.

Referring to FIG. 2, a microphone connection terminal 118 and a video audio line connection terminal 119 are formed on the bottom surface of the housing 100.
FIG. 3 is a front view of a portable moving picture multimedia player according to a preferred embodiment of the present invention mounted on a microphone case, and FIG. 4 is a side view.

  In the microphone case 200, a microphone is built in the head portion 210, and a groove is formed in the upper end portion of the handle portion 220. The housing 100 of the portable player is detachably mounted. A connection terminal that is electrically connected to the connection terminals 118 and 119 on the bottom surface of the housing is formed at the inner bottom end of the groove of the microphone case 200. An AV cable is connected to the lower end of the handle 220, and plugs inserted into the audio line input jack and video line input jack of the television are formed at the end of the cable. Therefore, it can be connected to the television by a wired system.

FIG. 5 is a block diagram of a preferred embodiment of the portable device of FIG.
5 shows a main memory 120, a flash memory card interface 122, a flash memory card 116, a mini hard disk drive 126, a USB interface 128, an RS232C interface 130, a LAN interface 132, a MIDI interface 133, a MIDI sound source generator 135, a power supply unit 134, Attachment detection unit 136, control unit 138, selection switch 140, microphone connection terminal 118, internal microphone 144, audio codec 146, headphone jack 148, AV line output jack 150, video codec 152, AV line input jack 154, super video input jack 156, wireless transmission / reception unit 158, key input unit 160, liquid crystal display unit 162, camera module 164, and vibration motor 16 It contains.

  The control unit 138 uses a multimedia processor manufactured by TI, which is mainly used in portable digital media application fields. The processor is a one-chip processor including an ARM7 central processing unit, a digital signal processing unit, a memory controller, an OSD NTSC / PAL encoder, a digital camera interface, an image processing engine, and a communication interface such as a USB, UART, and serial interface. The control unit 138 is programmed to generate a video song accompaniment music file according to the present invention and to execute a program for playing it.

  The main memory 120 includes a synchronous DRAM having a size of 2M × 16 × 4 banks, an SRAM having a size of 512 × 16, a flash memory having a size of 16 Mb, and the like, and stores data through a memory controller of the control unit 138.

  The flash memory card interface 122 provides a slot of a flash memory card such as a compact flash card, a memory stick, or smart media, and stores data through a memory controller of the control unit 138. In the present invention, a music file for video song accompaniment, a background video file, a computer data file such as an MP3 file downloaded from a computer, a voice recording file, a photo image file, and the like are stored in the flash memory card 116.

  The mini hard disk drive 126 may be used as an option with or in combination with a flash memory card. For example, a moving image file of a background image file can be stored, or an MP3 file or the like can be stored.

  The USB interface 128 and the LAN interface 132 are provided as channels for downloading an MP3 file from an external computer through the communication interface of the control unit 138 or uploading a voice file stored in a flash memory card.

The RS 232C interface 130 is provided as a serial communication port, and can be extended to various applications.
The MIDI interface 133 provides an interface for inputting MIDI data directly from the outside. Therefore, the midi data can be input directly to the portable device.

The midi sound generator 135 generates a sound source corresponding to the midi data input through the flash memory card or the midi interface.
The power supply unit 134 is supplied with main power from a 3.6V charging battery or a dry battery, and generates an internal power supply voltage such as 3.3V and 1.8V. The power supply unit 134 generates a system reset signal in response to the reset switch and provides it to the control unit 138, and the power supply is turned on / off in response to the power key.

  The attachment detection unit 136 provides an attachment detection signal to the control unit 138 when the housing 100 is attached to the groove of the microphone case 200. For example, the mounting detection signal can be maintained at a high level when mounted, and can be maintained at a low level when separated (separated).

  The selection switch 140 selects the internal microphone 144 or the external microphone provided in the microphone case 200 in response to the attachment / detachment detection signal provided from the control unit 138. The external microphone is electrically connected to the housing 100 through the microphone connection terminal 118.

  The audio codec 146 is a TLV320AIC23PW audio codec chip manufactured by TI. The audio codec 146 converts a stereo line input audio signal into digital data or receives digital audio data input and converts it into an analog audio signal. Generate output and stereo headphone output. It also has a function of mixing the microphone input into a stereo line input or a stereo output.

  A stereo headphone output signal is output through the headphone jack 148. The stereo line output signals L and R are connected to an external stereo audio output line through the AV line output jack 150, and the composite video signal CVBS provided from the NTSC / PAL encoder of the control unit 138 is applied to the AV line output jack 150. Connected to an external video output line. Therefore, each terminal of the AV line output jack 150 is electrically connected to the connection terminal of the mounting groove of the microphone case 200 when mounted. The stereo audio signal input through the AV line input jack 154 is provided to the audio codec 146.

  The video codec 152 is a Philips SAA 7115 9-bit video codec chip, which provides an external video signal through the AV line input jack 154 or the super video input jack 156, converts the provided video signal into digital video data, and controls it. Part 138.

  The wireless transmission / reception unit 158 receives a signal transmitted from the auxiliary microphone 300, for example, the auxiliary microphone 300 disclosed in Patent Literature 1 and Patent Literature 2, detects a music selection signal from the received signal, and controls the control unit 138. To provide. In addition, the stereo audio signal and the composite video signal are input, modulated into a TV channel signal, for example, a TV signal of channel 12 or channel 14, and provided to the TV receiver 350 wirelessly. Therefore, when used in a wireless system, the background image, lyrics, audio signals, etc. are transmitted from the portable device of the present invention with the TV channel tuned by 12 or 14, displayed on the TV screen, and output as audio through the TV speaker. Can enjoy.

  The key input unit 160 includes a direction key, a playback key, a function key, a stop key, a jog dial, a mode selection key, a play key, and the like as a user interface. The liquid crystal display unit 162 displays the lyrics characters provided from the control unit 138.

  Direction keys are used when moving menus and catalogs. The up and down keys are used to adjust the pitch of the song during performance, and the left and right keys adjust the speed. The left key is used with the “reservation” button when selecting music in the catalogue.

The function key displays a menu or function on the screen and is pressed again to cancel the function. Press and hold the function key to turn the power on / off.
The stop key is used to cancel the function and move to the previous stage, interrupt the song, or cancel the menu.

  The play key is used as an enter key for starting a song or pressing it again in a state where the song has started to select the item where the cursor is located in the menu or function.

  The jog dial can be used to increase or decrease the adjustment value by speeding up the number of the song to be selected and selecting the song from the up / down menu by turning the dial and moving to the up / down menu at a high speed. When the jog dial button is pressed, the item on which the cursor is positioned is selected, or the function or adjustment value is confirmed.

  With the song number input mode set by the mode selection key, press the jog dial button to move the number of digits, and turn the jog dial at the specified number of digits, the number of digits will be scrolled up and down and displayed . When the desired number is displayed and the jog dial button is pressed, the corresponding number is set. In this way, the song number can be quickly input while changing the number of digits only with the jog dial.

  When the song title selection mode is set by the mode selection key, for example, the amount of one page, for example, 20 songs is displayed on the screen, and when the jog dial button is pressed, the next page is displayed. About 20 songs are displayed for each page, and the music can be selected by turning the jog dial and moving the desired title position with the cursor. When the music selection is completed, the singing accompaniment can be started by pressing the play key.

  The camera module 164 converts an image picked up through the CMOS image sensor by the ultra-small camera module into a video signal and provides it to the control unit 138. The control unit 138 compresses the provided video signal using the MPEG algorithm, generates a photographic image file, and stores it in the flash memory card 116. Photo images taken through the camera module 164 can be viewed through a television, or uploaded to a computer through a computer interface and then viewed through a computer display.

  The vibration motor 166 is driven by the control unit 138 and generates a specific vibration. For example, it notifies you by vibration according to the song start count, generates vibration due to song rhythm and transmits it to the hand holding the microphone case or the housing of the portable device, so that you can feel the rhythm sense, or respond to pass or fail By generating vibrations, you can enjoy singing accompaniment.

FIG. 6 shows a mapping state of the storage unit according to the present invention.
Referring to FIG. 6, the storage unit includes a song accompaniment file storage area 410 and a data file storage area 420. The song accompaniment file storage area 410 is divided into a song table area 430, an audio file area 440, and a video file area 450.

  In the song table area 430, an audio file inventory and initial address values corresponding to the items of the inventory are created and stored in a table. When selecting a song, the corresponding audio file is accessed by referring to the song table. A video file list and initial address values are created and stored in a table. During system booting, the table in the music table area 430 is automatically accessed and loaded into the main memory 120 through the control unit 138.

  A video song accompaniment file corresponding to each song is stored in the audio file area. Each video song accompaniment file is stored in a size of about 350 to 450 kB depending on the song time.

FIG. 7 shows a format of an audio file, that is, a music file according to the present invention.
Referring to FIG. 7, the audio file 442 includes a header 443 and a body 451 having voice data 444, accompaniment data 446, lyrics data 448, video control data 449, and a CRC code 452.

  The header 443 includes a header ID code 443a, a header size 443b, a layer size 443c, a pointer 1 (443d), a pointer 2 (443e), a pointer 3 (443f), and a pointer 4 (443g). Pointer 1 (443d) designates the initial address of voice data 444, pointer 2 (443e) designates the initial address of accompaniment data 446, pointer 3 (443f) designates the initial address of lyrics data 448, and pointer 4 (443g) designates the initial address of the video control data 449.

  The voice data 444 is data obtained by compressing a singer's voice signal, and the singer's voice signal is converted into 16-bit audio data (704 kbps = 22 kHz × 16 bits) at a sampling frequency of 22 kHz, and the converted audio data is converted into, for example, Compressed to about 12 kbps data per second by the compression algorithm of audio standard G726-G729. Therefore, in the case of music of about 4 minutes, the voice signal of the singer is compressed into data of about 360 kB (= 12 kbps × 240 sec / 8 bits). Here, various algorithms within the same range can be applied as the audio data compression algorithm.

  Accompaniment data 446 is a data obtained by generating midi data from a musical instrument sound of a song and compressing the generated midi data. A 16-channel (16-person group) standard, midi data of about 4 minutes has a data amount of about 45 kB. Have This midi data is compressed at about 13 kB using lossless compression, for example, a compression algorithm such as ZIP or LHA for compressing computer data.

  Therefore, the video song accompaniment file for each song includes voice data 444 and accompaniment data 446, lyrics data 448, and video control data 449 having a data amount of about 373 kB, and has a data amount of about 400 kB. For example, on the basis of 5000 songs, a storage area of 2 GB is required. Therefore, it has a data compression rate of about 9 times compared to an MP3 file of 5000 songs, and a data compression rate of about 106 times compared to the original signal. At present, since the capacity of the commercialized flash memory is about 2 GB, in the case of the present invention, it is possible to realize a portable multimedia device that stores 5000 songs.

  Accompaniment data 446 is midi data, and is composed of one status byte and one or more data bytes. The status message is divided into a channel message and a system message. The channel message is further divided into a voice message and a mode message. The system message is divided into an exclusive message, a command, and a real-time message. The note-on / note-off message indicates which pitch among the 128 pitches and which strength of the dozens of sounds is generated and stopped.

The lyric data 448 is composed of character data for showing lyrics in subtitles.
The video control data 449 is composed of index values of several or tens of related background videos corresponding to the mood of the song or the contents of the lyrics in the index order value of the background video.

  Accordingly, when a specific song is selected, the related background video screen is sequentially accessed from the video file area by the video control data of the related audio file 442 and displayed on the screen.

  Voice data, midi data, lyrics data, and video control data are synchronized by a midi time code. The medium time code includes a header frame message, a full time code message, a user bit message, and a setup message.

  6 includes an initial logo title still screen 453, a title moving image file 454, several thousand background still screen files 456, and several tens to several hundreds of background moving image screen files 458.

  The background video file includes a moving video file and a still video file. Preferably, in the case of a moving image, a moving image file having a data amount of 512 kbps is configured by applying the MPEG4 compression method to RGB color data having a size of 720 × 480 per screen.

  For example, the size of a moving image file of about 1 minute can be configured with about 3.8 MB. In the case of a still picture, it has a data amount of about 40 kB by the MPEG4 compression method. Therefore, when a background video file is composed of about 100 moving video files of about 1 minute and about 1000 still video files, a background video storage area of about 420 MB (= 380 MB + 40 MB) is required. Accordingly, the size of the storage area can be appropriately designed by combining thousands of background video files and thousands of video song performance files.

  For example, if a moving image song accompaniment device is composed of 3000 songs of video song accompaniment files, about 100 1 minute moving image files, and 1000 still image files, the entire storage area is required to be about 1.62 GB. Therefore, when the size of the storage area is constituted by a 2 GB flash card, it has a surplus area of about 380 MB.

  Here, background images are by season (spring / summer / autumn / winter), by atmosphere (ballad / dance / disco / jazz / funky), by age (children / teens / 20s / 30s / 40s and above) ) Etc.

  Accordingly, the video control data is composed of a background video classification code and a specific background file access code, and can be controlled so that a specific background or random background file is selected and accessed at a corresponding timing. Therefore, various background images can be produced even with a background image smaller than the number of songs.

  The data file storage area 420 in FIG. 6 includes a file table 460, an MP3 file 470, a photo image file 472, a voice recording file 474, a moving image content file 476 downloaded from a computer, a computer up / down data file 478, other text or An English conversation file 480 is stored.

  The file table 460 includes index data of MP3 files and voice recording files. MP3 files are stored in 3 to 5 MB size, and voice recording files 474 are stored so that the file size varies depending on various sampling frequencies such as sampling frequencies 4 KHz, 8 KHz, 9.6 KHz, 16 KHz, 22 KHz, 36 KHz, 44.1 KHz. Is done.

8 to 10 are flowcharts for explaining the operation of the microphone type video song accompaniment apparatus according to the present invention.
11 to 17 are state diagrams of operation screens of the microphone type video song accompaniment apparatus according to the present invention.

  Referring to FIG. 8, when the function key is pressed long (about 2 seconds) and the power is turned on (S502), the control unit 138 receives a reset signal and initializes the system (S504). When the system is initialized, the table of the flash memory card 116 is accessed and stored in the main memory 120. It is detected whether the housing 100 is attached to the microphone case 200 through the attachment detection unit 136 (S506).

  In step S506, a singing performance mode routine is executed at the time of wearing (S508), and a portable mode routine is executed at the time of separation (S510). After each routine is executed, the power-off state is checked (S512). If the power is off, the process ends. If not, the process returns to step S506.

  Referring to FIG. 9, in the mounted state, the control unit 138 controls the selection switch 140 to switch so that an external microphone provided in the microphone case 200 is connected to the audio codec 146 (S514). Also, the audio codec 146 and the video codec 152 are enabled so that the external audio and video lines are connected to the internal circuit through the AV line output jack 150 (S516).

  The control unit 138 reads the title screen, which is a still screen, from the storage unit, outputs it as a composite video signal, displays a logo on the television 350 screen (see FIG. 11) (S518), and the moving image title display is about 5 times. Let it progress for 2 seconds. If there is a key input during the moving image display, the process proceeds to the music selection screen (see FIG. 12) (S520). Here, the read video data is obtained by decompressing the video data compressed by the control unit 138, converting the decompressed video data into an analog video signal, and superimposing a synchronization signal to obtain a composite video signal (CVBS). To output.

  When the music selection menu is displayed on the screen, the music number is entered and the desired music is selected. Press the up / down arrow keys or use the jog dial to change the cursor position number. If the changed number is correct, press the right arrow key or jog dial to confirm the entry and move the cursor to the next position to enter the next number.

In this way, the 4-digit or 5-digit music selection number is confirmed, and the performance starts when the play key is pressed.
If you make a mistake in entering the number, you can delete it by pressing the left arrow key and enter it again.

When a function key is entered, various music selection menus are displayed as shown in FIG.
Akasatana order, male singer song, singer name order, female singer song, search by age, random enumeration, nursery rhyme akasatana order, multiple condition search, recent / latest song, composer search, tempo search, songwriter There is another search. In the Akasatana order, when the song titles are displayed in the Akasatana order and the cursor is moved to select the desired song title, the play key is pressed to start the performance. The name of the singer is selected by displaying the names of the singer in the order of Akasatana. Search by period is 60's / 70's / 80's / 90's / 2000 or later / latest song, etc. After selecting the era menu, the cursor is moved in the listed list and the desired song is selected. In the selection of nursery rhymes catalogue, nursery rhymes are listed in the order of Akasatana and selected from the catalogue. The most recent song selection is to select songs within 2 years in Akasatana order. The latest song selection is to select songs within 6 months or 3 months in order of Akasatana. For selection by tempo, select a slow song, medium tempo, nimble song, and fast song menu, and then select them in the order of Akasatana. In the multiple condition selection, after selecting a music selection menu first, a desired music is selected by narrowing the range by performing a multiple menu search by further selecting another menu. When the Akasatana order menu is selected, the Akasatana order menu is displayed as shown in FIG. When the enter key is pressed after the cursor is positioned on the desired item on the submenu screen, the corresponding musical titles are sequentially displayed. While scrolling the displayed list with the up / down direction keys or the jog dial, the desired music title is searched.

  As shown in FIG. 15, when the cursor is placed on the selected item and then the left direction key is pressed, the song reservation is performed while the reservation display appears. The number of currently reserved songs is displayed at the upper left corner of the screen.

When a favorite song appears while selecting a song, it can be registered as a favorite song by pressing the right arrow key. Up to 10 users can manage their favorite songs.
When the music selection is completed, the control unit 138 accesses the video song accompaniment file selected from the flash memory card 116, stores it in the main memory 120, reads the pointer value in the file header, and stores voice data, midi data, and lyrics. Data and video control data are stored separately.

  When the start key is pressed, the song performance starts (S522). When the song is played, as shown in the screen of FIG. 16, the reserved song, the title of the song, the lyrics / composition / singer name are displayed on the screen. If you press the left / right key in the performance, the speed is adjusted. When the adjustment is completed, the function key is pressed or the menu disappears after 3 seconds. When the up / down direction key is pressed during the performance, a pitch adjustment menu screen appears as shown in FIG. 17, and the pitch can be adjusted. Press the function key during performance, male / female, volume, echo, reverb adjustment, song selection menu, by voice (soprano / alto / tenor / bass), melody erasure (playing only accompaniment), lyrics erasure (without showing lyrics) , Singing songs), menu functions such as instrument conversion. In addition, continuous performance, background screen conversion, singing games, etc. can be performed.

  The control unit 138 synchronizes and outputs the instrument sound and the voice signal in accordance with the timing while performing the midi data, simultaneously refers to the video control data, reads the background file, and superimposes it on the lyrics data. The background screen signal with is displayed.

  When the performance mode is ended in step S522 (S524), the process returns to the main program. If the performance mode is not ended, the camera operation is checked (S519). If the camera operation is checked, a photographic image is stored (S521). . If the camera operation is not checked in step S521, it is checked whether or not vibration setting is possible (S523), and if it is in the vibration setting mode, the vibration motor is driven according to the set conditions (S525). If the vibration mode is not checked in step S523, the screen returns to the music selection screen in S520.

  Referring to FIG. 10, in the portable mode operation at the time of separation, first, the control unit 138 detects the separation state through the attachment detection unit 136 and controls the selection switch 140 to connect the internal microphone 144 to the audio codec 146 ( S526).

  The control unit 138 sequentially checks whether the data up / down mode (S528), the MP3 file music selection mode (S532), the voice recording mode (S536), and the RF reception mode (S541). In the S528 mode and the data up / down mode, a computer data file, for example, an MP3 file is downloaded to the portable device through the computer and the USB interface or the LAN interface. The downloaded MP3 file is provided and stored in the flash memory card interface 122 through the controller 138 (S530).

  If the MP3 music selection mode is selected in step S532, the control unit 138 accesses the selected MP3 file with reference to the file table, decompresses the accessed MP3 file, and provides the decompressed MP3 file to the audio codec 146. The audio codec 146 outputs the digital audio data as an analog stereo audio signal to the headphones or earphones through the headphone jack 148 (S534).

  In step S536, in the voice recording mode, the voice signal input through the internal microphone 144 is converted into digital audio data at the sampling frequency given by the audio codec 146. The converted voice data generates a voice recording file through the control unit 138, and the generated voice recording file is stored in the flash memory card 116 (S538).

  If it is not in the voice recording mode in step S536, it is checked whether the camera can be operated (S537), and the picked-up image is stored as a photographic image file (S539).

  If the camera operation is not checked in step S537, the RF transmission is checked (S541). If checked, the background video image and the audio signal are modulated into a television signal and transmitted wirelessly (S542) because it is the singing accompaniment mode. .

  When the RF signal transmitted from the auxiliary microphone 300 is received through the wireless transmission / reception unit 158 in step S543, the control unit 138 accesses the lyrics data of the corresponding song by executing the received command, and the liquid crystal display unit The lyrics are displayed as subtitles in 162 (S544). Therefore, in this case, it can be used as a caption device for lyrics.

  In steps S530, S534, S538, S539, S542, and S544, it is checked whether the operation is completed or the portable mode is ended in step S545 (S545). Then, the process returns to step S528 to wait for operation.

  As described above, in the present invention, the microphone case and the portable device are configured to be detachable in the microphone type video song accompaniment device, so that it can be used in the video song accompaniment device and the portable music file playback device.

  Also, since about 5000 songs of music files for song accompaniment and background video files can be stored in the portable device, if you connect to a TV or the like without using a song accompaniment device in the form of a set-top box, you can enjoy the background video along with the song accompaniment. be able to.

  As described above, the embodiments of the present invention have been described in detail. However, the present invention is not limited to these embodiments, and any technical knowledge to which the present invention belongs can be used without departing from the spirit and spirit of the present invention. The present invention can be modified or changed.

1 is a front external perspective view of a portable video multimedia player according to a preferred embodiment of the present invention. 1 is a rear external perspective view of a portable video multimedia player according to a preferred embodiment of the present invention. The front view of the state which mounted | wore the microphone case with the portable moving image multimedia player of preferable one Embodiment by this invention. The side view of the state which mounted | wore the microphone case with the portable moving image multimedia player of preferable one Embodiment by this invention. 1 is a block diagram of a preferred embodiment of a portable video multimedia player according to the present invention. FIG. The figure which shows the mapping state of preferable one Embodiment of the storage medium by this invention. The figure which shows the format structure of the music file for video song accompaniments by this invention. The flowchart for demonstrating operation | movement of the microphone type image | video song accompaniment apparatus by this invention. The flowchart for demonstrating operation | movement of the microphone type image | video song accompaniment apparatus by this invention. The flowchart for demonstrating operation | movement of the microphone type image | video song accompaniment apparatus by this invention. The operation | movement screen state figure of the microphone type image song accompaniment apparatus by this invention. The operation | movement screen state figure of the microphone type image song accompaniment apparatus by this invention. The operation | movement screen state figure of the microphone type image song accompaniment apparatus by this invention. The operation | movement screen state figure of the microphone type image song accompaniment apparatus by this invention. The operation | movement screen state figure of the microphone type image song accompaniment apparatus by this invention. The operation | movement screen state figure of the microphone type image song accompaniment apparatus by this invention. The operation | movement screen state figure of the microphone type image song accompaniment apparatus by this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 ... Housing, 101 ... Camera, 102 ... Liquid crystal display window, 104 ... Direction keypad, 106 ... Jog dial button, 108 ... Mode selection button, 110 ... Play button, 112 ... Headphone jack, 114 ... Card slot, 116 ... Flash memory Card 118 118 Microphone connection terminal 119 Video audio line connection terminal 120 Main memory 122 Flash memory card interface 126 Mini hard disk drive 128 USB interface 132 LAN interface 158 Wireless transceiver 166: Vibration motor, 200: Microphone case, 210: Head portion, 220: Handle portion, 300: Auxiliary microphone

Claims (22)

A housing that is detachable from the microphone case and has a portable size;
An internal microphone built into the housing;
A plurality of connection terminals provided on the outer peripheral surface of the housing for electrically connecting to an external microphone, an audio line and a video line provided in the microphone case;
In order to display the selected lyrics information and menu information, a liquid crystal display provided on the front of the housing;
A user interface unit for inputting user commands;
A computer interface portion provided in the housing for interfacing data upload / download with a computer;
Non-volatile provided in the housing for storing thousands of compressed video song files and compressed background video files, having a storage area for storing data files that are downloaded from a computer or externally, or provided A storage unit;
Provided in the housing, inputs audio data and converts it into an analog audio signal, mixes the converted audio signal and an audio signal input through the external or internal microphone, and generates an output audio signal, the input An audio codec that converts the recorded audio signal into digital audio data;
A video codec that is provided in the housing, inputs video data and subtitle data to generate a television composite video signal, and inputs video signals to generate video data;
Provided in the housing, detects whether or not the microphone case can be attached / detached, controls switching of the external and internal microphones, and when attached, in response to a user command, the selected video / music file is stored in the nonvolatile memory. The compressed audio data is decompressed and provided to the audio codec, and the compressed background image is decompressed and provided to the video codec to execute the video song accompaniment mode. A portable video multimedia player comprising: a controller for executing a video song accompaniment playback mode, a computer data playback / storage mode, and a computer data up / down mode in response to the selection; . The compressed video music file is
Voice data obtained by converting the music singer's voice into digital data and compressing it,
Accompaniment data obtained by generating midi data from the musical instrument sound and compressed,
Lyric data and
The portable video multimedia player according to claim 1, further comprising: video control data for accessing a background image related to the lyrics, atmosphere, and genre of the music.   The portable video multimedia player according to claim 2, wherein the compressed video music file has a size of several hundred KB. The data file is
3. The portable moving picture multimedia player according to claim 2, wherein the portable moving picture multimedia player is one of an MP3 music file, a voice recording file, a moving picture file, or a combination thereof. The data file is
3. The portable moving picture multimedia player according to claim 2, wherein the portable moving picture multimedia player is one of an MP3 music file, a voice recording file, a moving picture file, a photo image file, text data, or a combination thereof. . The nonvolatile storage unit is
2. The portable video multimedia player according to claim 1, wherein the portable video multimedia player is one of an EEPROM, a flash memory, a flash memory card, a mini hard disk drive, and a combination thereof. The computer interface is
The portable moving picture multimedia player according to claim 1, wherein the portable moving picture multimedia player is one of a USB interface, a LAN interface, and a combination thereof. The user interface unit includes:
Direction keys provided on the housing;
A jog dial provided in the housing and combined with a dial and a push button;
A mode selection key for selecting a music selection menu mode;
A play key for the beginning and end of the song,
When the song number selection menu mode is selected by the mode selection key, the song number is scrolled by up / down dialing of the jog dial, and when the song title list selection menu mode is selected, it is displayed by up / down dialing of the jog dial. 2. The portable moving picture multimedia player according to claim 1, wherein a large number of songs are quickly selected by moving a cursor on the selected title list. The jog dial push button
When the song number selection menu is selected, the cursor is moved along the number of digits of the song number each time it is pressed. When the song title list selection menu mode is selected, the title list page is changed each time the selection is made. The portable moving picture multimedia player according to claim 8, wherein: The player
A vibration motor provided in the housing;
The portable video multimedia player according to claim 1, wherein the controller controls the vibration motor so that the housing is vibrated in accordance with a rhythm of a selected song accompaniment. The player
A camera module provided on the housing;
The portable moving image according to claim 1, wherein the control unit compresses a photographic image picked up through the camera and stores the compressed photographic image as a kind of data file in the nonvolatile storage unit. Multimedia player. The player
An FM transmitter / receiver provided in the housing;
The control unit receives an audio data signal and a control data signal transmitted from an auxiliary wireless microphone through the FM transmitter / receiver unit, provides the received audio data signal to the audio codec, and converts the received control data signal into the received control data signal. The portable video multimedia player according to claim 1, wherein the lyrics data of the selected video and music file is displayed on the liquid crystal display unit in response. The player
A television transmitter provided in the housing;
The portable video multimedia player according to claim 1, wherein the control unit transmits the composite video signal and the output audio signal through the TV transmission unit as a TV channel signal. An external microphone is provided in the head portion, and there is a mounting groove on the outer surface of the handle portion, and a microphone case having a microphone connection terminal, an audio line terminal, and a video line terminal formed in the mounting groove;
It has a portable size, is detachably mounted in the mounting groove of the microphone case, and a plurality of connection terminals for electrically connecting to the microphone connection terminal, the audio line and the video line terminal are formed on the outer peripheral surface. A portable device that switches between the external microphone and the internal microphone in response to attachment and detachment operations, and that is operated in a video song accompaniment mode when attached, and that is operated in a portable multimedia player mode when detached. A microphone-type video song accompaniment device characterized by the above. An external microphone is provided in the head portion, and there is a mounting groove on the outer surface of the handle portion, and a microphone case having a microphone connection terminal, an audio line terminal, and a video line terminal formed in the mounting groove;
An auxiliary wireless microphone that includes an FM transmitter and a user interface unit, and transmits an audio signal and a user command input through the microphone as an FM signal;
It has a portable size, is detachably mounted in the mounting groove of the microphone case, and a plurality of connection terminals for electrically connecting to the microphone connection terminal, audio line, and video line terminal are formed on the outer peripheral surface. Receiving the FM signal transmitted from the auxiliary wireless microphone to restore the audio signal and the user command, switching the external microphone and the internal microphone in response to the mounting and detaching operations, and at the time of mounting the video song accompaniment mode A microphone-type video song accompaniment apparatus, comprising: a portable device that is operated in a portable multimedia player mode when detached. Sampling a live signal of a music singer at a predetermined sampling frequency to generate voice data;
Generating accompaniment data composed of midi data from the musical instrument sound;
Generating lyrics data of the music;
Generating a music file including a body composed of the voice data, accompaniment data, and lyrics data, and a header including a plurality of pointer values specifying initial positions of the data. A method for generating a music file for accompaniment. Obtaining the plurality of pointer values from the header of the music file of claim 16;
Obtaining the voice data, accompaniment data, and lyrics data from the body of the music file with reference to the obtained pointer value;
A method of reproducing a music file for singing accompaniment, comprising: synchronizing the obtained voice data, accompaniment data, and lyrics data and outputting an analog music signal. Sampling a live signal of a music singer at a predetermined sampling frequency to generate voice data;
Generating midi data from the musical instrument sound;
Generating lyrics data of the music;
Generating video control data from an index value of the music background screen;
Generating a music file including a body composed of the voice data, accompaniment data, lyrics data, and video control data, and a header including a plurality of pointer values specifying initial positions of the data. A music file generating method for video song accompaniment, comprising: Obtaining the plurality of pointer values from the header of the music file of claim 18;
Obtaining the voice data, midi data, lyrics data, and video control data from the body of the music file with reference to the obtained pointer value;
Accessing a background video screen in response to the obtained video control data;
Synchronizing the obtained voice data and accompaniment data to output an analog music signal, and simultaneously synchronizing the lyrics data to the accessed background video screen and displaying it on the background screen of the analog music signal; A music file playback method for video song accompaniment, comprising:   The method of claim 19, wherein the music file has a size of 400KB or less. Sampling a live signal of a music singer at a predetermined sampling frequency to generate voice data;
Generating accompaniment data composed of midi data from the musical instrument sound;
Generating lyrics data of the music;
Generating video control data from an index value of the music background screen;
Generating a music file including a body composed of the voice data, accompaniment data, lyrics data, and video control data, and a header including a plurality of pointer values specifying initial positions of these data; A storage medium that can be stored and played back on a computer that stores a plurality of generated music files.   The computer-readable storage medium according to claim 21, wherein the storage medium stores a plurality of background screen files that can be accessed by the video control data.

Images