KR101342404B1 - System and method for controlling the image of multivision using a voice recognition - Google Patents

Abstract

The present invention relates to an electronic display board image control system using voice recognition capable of controlling the output image of an electronic display board according to the announcement of an announcer in a sports stadium. In particular, the present invention includes a stadium broadcasting system which includes a microphone for inputting the voice of an announcer and at least one camera for taking images of the inside of the stadium; an electronic display board control device which receives voice signals inputted through the microphone of the announcer, recognizes the voice, and, if a certain predefined word is included in the voice signal, selects a relevant image for the certain word, and generates an image to be displayed on the electronic display board; and the electronic display board which receives an image signal from the electronic display board control device and displays the signal on a predefined screen area. [Reference numerals] (310) lmage signal receiving unit;(320) Voice signal receiving unit;(330) Voice recognition unit;(340) Image signal selecting unit;(350) Output image generating unit;(360) Image sending unit;(371) Image database;(372) Event database;(373) Word database;(374) Sports game database;(375) Advertisement database;(AA) First camera image;(BB) N^th camera image;(CC) Announcer voice

Description

Electronic image control system and method using speech recognition {SYSTEM AND METHOD FOR CONTROLLING THE IMAGE OF MULTIVISION USING A VOICE RECOGNITION}

The present invention relates to a system and method for controlling a signboard image, and more particularly, to a signboard image control system and method using voice recognition that can control the output image of the signboard according to the announcement of the announcer in a sports stadium. .

1 is a view showing a conventional electronic sign. Referring to FIG. 1, generally, the electronic display panel 100 installed in a sports stadium or the like includes a clock display unit 110 on the upper left side, a score display unit 120 on the lower left side, and an image display unit 130 on the right side. .

On the other hand, the conventional electronic display board has a disadvantage of not only providing a variety of information, but the effect of notifying the game because the watch display unit 110 and the score display unit 120 exports a certain game screen in a fixed state.

In addition, due to the lack of content, only a predetermined screen should be sent out, which gives the audience a monotony. As a result, audiences are losing interest in electronic displays, such as utilizing various information through smartphones while watching a game. In addition, due to the decrease in interest in the electronic signboard installed at a high cost, it is difficult to attract advertisements.

On the other hand, Korean Patent Publication No. 10-0683578, "Contents service method and system using an electronic signboard (Doowon)" (Document 1) has a method for displaying a predetermined content in real time, such as using a text message or an e-mail function in real time Is initiated. However, the above method can also increase the utilization of the billboard, but does not provide a variety of information related to the game through the billboard.

Therefore, there is a demand for a method for providing a variety of new information through a signboard and providing information related to a game in real time quickly.

[Document 1] Content service method and system using Korean Registered Patent Publication No. 10-0683578 (Lee Doowon) 2007.02.09

It is an object of the present invention to provide a signboard image control system and method using speech recognition that recognizes a voice of an announcer broadcast in a stadium and outputs various information related thereto in real time through a signboard.

In addition, another object of the present invention is a video display system and method using a voice recognition for voice recognition of the voice of the announcer broadcast in the stadium and the associated game information, advertising information, event information, etc. in real time through the electronic display board In providing.

In addition, another object of the present invention is to recognize the voice of the announcer broadcast in the stadium, and if a match is detected with a keyword related to the game pre-stored in the database, the game information, advertising information, event information, etc. The present invention provides an electronic image control system and method using voice recognition to output in real time.

The above objects and various advantages of the present invention will become more apparent from the preferred embodiments of the present invention by those skilled in the art.

In order to achieve the above-described object of the present invention and to achieve the specific effects of the present invention described below, the characteristic structure of the present invention is as follows.

According to an aspect of the present invention, an electronic signboard image control system using voice recognition may include: an internal broadcasting system including an announcer microphone that receives an announcer's voice and at least one camera for capturing an image in a stadium; When the voice signal received by the announcer is received and the voice signal is received, and a predetermined word is included in the voice signal according to the voice recognition result, the related image corresponding to the specific word is selected to generate an image to be displayed on the electronic display board. An electronic board control device; And an electronic display board configured to receive an image signal from the electronic display board control device and display the video signal in a preset screen area.

Preferably, the electronic control panel, the word information database for storing the predetermined specific word; And a voice recognition unit determining whether the voice signal includes a specific word stored in the word information database.

Preferably, the related video, any one or more selected from the support article video, Mia finder video, corporate promotional video, real-time photos or videos uploaded by the crowd, snack event promotional order receiving video, game supplies related shopping mall event video It is done.

Preferably, the specific word is any one or more selected from a player's point of view, national anthem, time, event, draw, crowd, cheer, goal, home run, record.

According to another aspect of the present invention, a signboard image control method using voice recognition, receiving a voice signal of the announcer input through the announcer microphone; Receiving an image captured by at least one camera that captures an image in the stadium; Recognizing speech by processing the voice signal input to the announcer microphone; Determining whether a predetermined word is included in the speech signal according to the speech recognition result; Generating an image to be displayed on an electronic board by selecting a related image corresponding to the specific word included in the voice signal according to the determination result; And displaying the generated image on a preset screen area of the display board.

Meanwhile, the information for providing the signboard image control method using the voice recognition may be stored in a recording medium readable by a server computer. Such a recording medium includes all kinds of recording media in which programs and data are stored so that they can be read by a computer system. Examples include ROMs (Read Only Memory), Random Access Memory, CD (Compact Disk), DVD (Digital Video Disk) -ROM, magnetic tape, floppy disk, optical data storage device, (For example, transmission over the Internet). Such a recording medium may also be distributed over a networked computer system so that computer readable code in a distributed manner can be stored and executed.

As described above, according to the present invention, there is an advantage that can provide a variety of new information through the electric signboard installed in the stadium.

In addition, by analyzing the voice of the announcer to reflect on the billboard in real time there is an advantage that can quickly provide information related to the game in real time through the billboard.

Therefore, the audience visiting the stadium has an advantage of increasing the advertising effect through the billboard by increasing the concentration and interest in the billboard.

1 is a perspective view showing a screen configuration of a general electronic sign.
2 is a diagram illustrating a signboard image control system using speech recognition according to an exemplary embodiment of the present invention.
3 is a diagram illustrating a detailed configuration of an electronic display control apparatus according to an embodiment of the present invention.
4 is a flowchart illustrating a display image control procedure using voice recognition according to an embodiment of the present invention.
5 to 8 are perspective views of a sign board in which an image is controlled according to voice recognition according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. Accordingly, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

The present invention discloses a signboard image control system and method for controlling an image output from a signboard installed in a stadium. In particular, the present invention analyzes the voice of the announcer in real time, generates a video related to the content of the announcer to provide as an electronic signboard image.

In addition, according to an embodiment of the present invention, the display board control apparatus may store keywords related to a game in advance, and may provide image content corresponding to a word that matches the stored keywords in the announcer's voice through the display board.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention.

Electronic Display Control System

2 is a diagram illustrating a signboard image control system using speech recognition according to an exemplary embodiment of the present invention. Referring to FIG. 2, a system according to an exemplary embodiment of the present invention includes a broadcasting station server 210, a communication network 220, an in-house broadcasting system 230, an electronic board control device 240, and an electronic board 250. Can be.

The on-site broadcasting system 230 includes various devices related to video and audio broadcasting in a stadium, and may transmit video and audio information produced in the stadium to the broadcasting station server 210 through the communication network 220. The intestinal broadcasting system 230 may include an announcer microphone 231, a commentator microphone 232, a speaker 233, a camera 234, and the like. The voice data input through the announcer microphone 231 or the commentator microphone 232 is output in the field through the speaker 233 or transmitted to the broadcasting station server 210 through the communication network 220. In addition, the image information photographed through the camera 234 is output to the electronic sign 250, or transmitted to the broadcasting station server 210 through the communication network 220.

In this case, according to an embodiment of the present invention, the electronic scoreboard control device 240 receives the voice signal of the announcer microphone 213 and the image signal photographed through the camera 234 from the intestinal broadcasting system 230, and the announcer microphone. The audio signal inputted to 213 is analyzed to output a related image through the electronic sign 250.

The communication network 220 may be configured without regard to communication modes such as wired and wireless, and may include a personal area network (PAN), a local area network (LAN), and a metropolitan area network (MAN). ), And various communication networks such as a wide area network (WAN). In addition, the communication network 220 may be a well-known World Wide Web (WWW), and may use a wireless transmission technology used for short-range communication such as an infrared data association (IrDA) or Bluetooth. It may be.

Hereinafter, with reference to FIG. 3, a detailed configuration of the electronic control panel 240 according to an embodiment of the present invention will be described in detail.

3 is a diagram illustrating a detailed configuration of an electronic display control apparatus according to an embodiment of the present invention. Referring to FIG. 3, the electronic sign control device 240 according to the embodiment of the present invention includes an image signal receiver 310, an audio signal receiver 320, a voice recognition unit 330, an image signal selector 340, and an output. It may be configured to include an image generating unit 350 and the image transmitting unit 360.

Meanwhile, the functional units may perform respective functions by storing and reading data in association with at least one database.

For example, the billboard control device 240 further includes databases such as an image information database 371, an event information database 372, a word information database 373, a game information database 374, and an advertisement information database 375. can do.

First, the image signal receiver 310 receives image signals captured in real time from a plurality of N cameras installed in a stadium. The received video signal is stored in the video information database 371.

In addition, the voice signal receiver 320 receives a voice signal input through the announcer microphone 231. In this case, the intestinal broadcasting system 230 may process a voice signal and convert the voice signal into digital data to provide the voice signal to the voice signal receiver 320.

The voice signal of the announcer received through the voice signal receiver 320 is analyzed by the voice recognition unit 330. That is, the speech signal data is analyzed by a speech recognition algorithm, and the analyzed word is extracted. In this case, in order to increase the efficiency of speech recognition, speech recognition may be performed by determining whether a keyword (word) previously stored in the word information database 373 is included in the speech signal data.

Examples of words stored in the word information database 373 may be a player's position, national anthem, a pitch, an event, a draw, a crowd, a cheer, a goal, a home run, a record, and the like. If included, the word information is provided to the image signal selector 340. For example, when the word 'support' is analyzed as the voice signal analysis result of the announcer, the image signal selection unit 340 outputs an image image of a cheering scene of the audience from the image information stored in the image information database 371 as an output image. Choose.

That is, the image signal selector 340 selects a video signal corresponding to the provided keyword according to the speech recognition result of the speech recognizer 330. For example, the video information database 371 or the game video signal received from each camera may be selected, the information related to the game stored in the game information database 374 may be selected, and the event information may be selected in the event information database 372. Information may be selected, and information related to an advertisement stored in the advertisement information database 375 may be selected. Specific examples thereof will be described later with reference to FIGS. 5 to 8.

As such, when the corresponding image information is selected by the image signal selection unit 340 according to the voice recognition result of the announcer, the output image generation unit 350 reconstructs the selected image information into an image that can be output to the electronic display. For example, the selected image information is converted according to a preset format, and the size and text of the image are edited and provided to the electronic display board 250 through the image transmission unit 360.

As described above, the electronic sign image control system using voice recognition according to an exemplary embodiment of the present invention has been described with reference to FIGS. 2 and 3. Hereinafter, an electronic sign image control method using voice recognition according to an exemplary embodiment of the present invention will be described with reference to FIG. 4.

Display image control method

4 is a flowchart illustrating a display image control procedure using voice recognition according to an embodiment of the present invention. Referring to FIG. 4, first, image information is received in real time from each camera installed in a stadium (S401). At the same time, the voice information input through the announcer's microphone is received in real time (S402).

Next, the voice information of the announcer is analyzed and voice recognized to determine whether a specific word or keyword is included in the voice information. When a specific keyword is analyzed according to the speech recognition, the type of output content corresponding to the keyword is determined (S404). For example, when an announcer's voice signal includes the word event, content information related to the event is selected as the output content.

Then, the content to be output is selected (S405), and an image to be output to the electronic display board with the selected content is generated (S406). Finally, by transmitting the generated image data to the electronic display (S407), an image suitable for the announcer's voice may be displayed on the electronic display.

As described above, the electronic sign image control procedure according to the embodiment of the present invention has been described with reference to FIG. 4. Hereinafter, an example in which an image related to an audio signal of an announcer is actually output to an electronic board according to the system and method described above with reference to FIGS. 5 to 8 will be described.

Example

5 to 8 are perspective views of a sign board in which an image is controlled according to voice recognition according to an embodiment of the present invention.

According to an embodiment of the present invention, when a word of a announcer includes a specific word, an image related thereto may be output to the electronic display board.

For example, when the announcer's comment includes the word player's position, the player's position image may be output to the electronic display board. Similarly, if the announcer's comment includes words such as national anthem, verse, event, draw, crowd, cheer, goal, home run, etc., the word is identified according to an embodiment of the present invention, the relevant video is selected and displayed on the electronic display. do.

On the other hand, the type of video output on the billboard may include a support article, Mia finder, corporate publicity, real-time photos or videos uploaded by the audience, receiving a snack event promotional order, game supplies related shopping mall events.

For example, when the word "player position" is included in the announcement of the announcer, voice recognition is performed, and the player position image 500 is selected and output to the electronic display panel 100 as shown in FIG.

In addition, when the word 'hour' is included in the announcement of the announcer, voice recognition is performed, and as shown in FIG. 6, the hourly image 600 is selected and output to the electronic display panel 100.

In addition, when the announcer's comment includes the word 'progression', the speech recognition is performed, and as shown in FIG. 7, the adversary image 700 pre-stored in the game information database 374 is selected and output to the electronic display panel 100. Let's do it.

In addition, when the announcement includes the word 'advertisement', the voice recognition is performed, and as shown in FIG. 8, the advertisement image 800 previously stored in the advertisement information database 375 is selected and output to the electronic display panel 100. Let's do it.

Various operations and functions as described herein with respect to various methods may be any of many types of functionality, such as specific processing functionality and / or processing functionality implemented therein, and / or other components therein. It can be carried out in the thing. For example, such functions may be described herein, as well as performing various operations and processes as described herein, or any other operations and functions as described herein, etc., or the like, And may perform such operations, processes, and the like.

In some embodiments, such functions (which may be implemented on the same device or on distinct devices) may be implemented in such a manner and in accordance with various aspects of the present invention, etc., and / Operations and functions, and their equivalents. In some embodiments, such processing is performed together by the first functional portion in the first device and the second functional portion in the second device. In other embodiments, such processing, operations, etc. are performed entirely by the processing units within one particular apparatus. Even in other embodiments, such processing, operations are performed using at least a first functional unit and a second functional unit in one single device.

In addition, in the above description, the terms 'system', 'apparatus', '~ unit' may be a single processing device or a plurality of processing devices. Such a processing device may be a microprocessor, a microcontroller, a digital signal processor, a microcomputer, a central processing unit, a field programmable gate array, a programmable logic device, a state machine, a logic circuit, an analog circuit, a digital circuit, and / (Analog and / or digital) based on hard coding of operational instructions. The processing module, module, processing circuit, and / or processing unit may be implemented as a single memory device, a plurality of memory devices, and / or a combination of the processing modules, the processing circuitry, and / Lt; / RTI > memory and / or an integrated memory element. Such a memory device may be any device that stores read only memory (ROM), random access memory (RAM), volatile memory, non-volatile memory, static memory, dynamic memory, flash memory, cache memory, and / . If the processing module, the module, the processing circuit, and / or the processing unit include one or more processing devices, the processing devices may be centrally located (i.e., directly or indirectly via a wired and / Connected), distributed (e.g., cloud computing via an indirect connection over a local and / or wide area network). If the processing module, module, processing circuitry, and / or processing unit implements one or more of their functions via a static machine, analog circuitry, digital circuitry, and / or circuitry, storing memory and / or memory components, It should further be noted that the corresponding operating instructions may be internal to or external to a circuit comprising the static machine, analog circuit, digital circuit, and / or logic circuit. The memory element may be stored and the processing module, module, processing circuitry, and / or processing unit may be configured to store a hard-coded and / or hard-coded data item corresponding to at least a portion of the steps and / or functions depicted in one or more of the figures It should be further noted that it carries out operational instructions. Such a memory device or memory element may be included within the components of the manufacture.

The present invention has been described above with the aim of method steps indicative of the performance of certain functions and their relationships. The boundaries and order of these functional components and method steps have been arbitrarily defined herein for convenience of description. Alternative boundaries and sequences may be defined as long as the specific functions and relationships are properly performed. Any such alternative boundaries and sequences are therefore within the scope and spirit of the claimed invention. In addition, the boundaries of these functional components have been arbitrarily defined for ease of illustration. Alternative boundaries can be defined as long as certain important functions are properly performed. Likewise, the flow diagram blocks may also be arbitrarily defined herein to represent any significant functionality. For extended use, the flowchart block boundaries and order may have been defined and still perform some important function. Alternative definitions of both functional components and flowchart blocks and sequences are therefore within the scope and spirit of the claimed invention. Those skilled in the art will also appreciate that the functional components and other illustrated blocks, modules, and processors herein may execute components as shown or separate components, semiconductor integrated circuits (ASICs), and appropriate software. It will be appreciated that the present invention may be embodied by any of the foregoing and similar or any combination thereof.

The invention may also be described, at least in part, in terms of one or more embodiments. Embodiments of the invention are used herein to describe the invention, aspects thereof, features thereof, concepts thereof, and / or examples thereof. The physical embodiment of an apparatus, article of manufacture, machine, and / or process for implementing the invention may include one or more aspects, features, concepts, examples, etc., described with reference to one or more embodiments described herein . Moreover, in the entire drawing, embodiments may incorporate the same or similarly named functions, steps, modules, etc. that may use the same or different reference numbers, and as such, the functions, The steps, modules, etc. may be the same or similar functions, steps, modules, etc. or others.

Meanwhile, the term "processing unit" is used in the description of various embodiments of the present invention. A module includes a functional block implemented via hardware to perform one or more functions, such as processing one or more input signals to produce one or more output signals. The hardware implementing the functional block may operate directly by combining software and / or firmware. As used herein, a module may include one or more sub-modules that are themselves modules.

While various combinations of features and specific combinations of features of the present invention are explicitly described herein, other combinations of these features and functions are likewise possible. The present invention is not limited to the specific examples disclosed herein, and obviously incorporates these other combinations.

As described above, the present invention has been described by specific embodiments such as specific components and the like. For those skilled in the art, various modifications and variations are possible from these descriptions.

Accordingly, the spirit of the present invention should not be construed as being limited to the embodiments described, and all of the equivalents or equivalents of the claims, as well as the following claims, belong to the scope of the present invention .

100: display board 110: clock display unit
120: score display unit 130: video display unit
210: broadcasting station server 220: communication network
230: intestinal broadcasting system 231: announcer microphone
232: commentator microphone 233: speaker
234: camera 240: electronic board control
250: LED board 310: video signal receiver
320: voice signal receiving unit 330: voice recognition unit
340: Image signal selector 350: Output image generator
360: video transmission unit 371: video information database
372: Event Information Database 373: Word Information Database
374: Match Information Database 375: Advertising Information Database

Claims (8)

An intestinal broadcasting system including an announcer microphone for receiving an announcer's voice and at least one camera for capturing an image in a stadium;
Receives a voice signal input to the announcer microphone and recognizes the voice, and selects one of a player's entrance, national anthem, a ward, an event, a draw, a crowd, a cheer, a goal, a home run, and a record according to the voice recognition result. When the specific word is included, any selected from the support video corresponding to the specific word, the missing child image, corporate promotional video, real-time photos or videos uploaded by the crowd, snack event promotion order video, match supplies related shopping mall event video An electronic board control device that selects one or more related images and generates an image to be displayed on the electronic display in real time; And
And an electronic display board configured to receive an image signal from the electronic display board control device and display the image signal in a preset screen area in real time.
The electronic board control device,
An image signal receiver for receiving an image signal captured in real time from the at least one camera, an image information database for storing the received image signal, an audio signal receiver for receiving an audio signal input through the announcer microphone, and the received signal A voice signal analyzer for analyzing a voice signal of an announcer based on a speech recognition algorithm, extracting an analyzed word, and determining whether a keyword previously stored in a word information database is included in the voice signal. When included in the audio signal, a video signal selection unit for selecting a video signal corresponding to a keyword, converts the selected video information according to a preset format, edits the size and text of the image and provides it to the electronic board through the image transmission unit An output image generator,
The video signal corresponding to the keyword is any one of information corresponding to a game stored in a game information database, information corresponding to an event stored in an event database, and information corresponding to an advertisement stored in an advertisement information database. Scoreboard video control system.
delete delete delete In the signboard image control method using the speech recognition performed in the signboard image control system using speech recognition,
Storing the preset specific word in a word information database;
Receiving a voice signal of an announcer input through an announcer microphone;
Receiving an image captured by at least one camera that captures an image in the stadium;
Recognizing speech by processing the voice signal input to the announcer microphone;
Determining whether the voice signal includes a predetermined word which is one or more selected from among a player's position, an anthem, a pitch, an event, a draw, a crowd, a cheer, a goal, a home run, and a record according to the voice recognition result;
Determining whether the speech signal includes a specific word stored in the word information database through a speech recognition unit;
According to the determination result, a cheering video, a missing child video, a corporate promotional video, a real-time picture or a video uploaded by a crowd, a snack event promotion order video, a match item for a shopping mall event Selecting an associated image selected from at least one of the images to generate an image to be displayed on an electronic board;
Displaying the generated image on a preset screen area of the electronic display board;
Lt; / RTI >
The signboard control device of the signboard image control system using speech recognition,
An image signal receiver for receiving an image signal captured in real time from the at least one camera, an image information database for storing the received image signal, an audio signal receiver for receiving an audio signal input through the announcer microphone, and the received signal A voice signal analyzer for analyzing a voice signal of an announcer based on a speech recognition algorithm, extracting an analyzed word, and determining whether a keyword previously stored in a word information database is included in the voice signal. When included in the audio signal, a video signal selection unit for selecting a video signal corresponding to a keyword, converts the selected video information according to a preset format, edits the size and text of the image and provides it to the electronic board through the image transmission unit An output image generator,
The video signal corresponding to the keyword is any one of information corresponding to a game stored in a game information database, information corresponding to an event stored in an event database, and information corresponding to an advertisement stored in an advertisement information database. Display image control method. delete delete delete

Images