JP2021129282A

JP2021129282A - Musical performance photographing device

Info

Publication number: JP2021129282A
Application number: JP2020024689A
Authority: JP
Inventors: 孝一郎比嘉; Koichiro Higa
Original assignee: Mtex Corp
Current assignee: Mtex Corp
Priority date: 2020-02-17
Filing date: 2020-02-17
Publication date: 2021-09-02

Abstract

To provide a musical performance photographing device that expands the base of musical performance image distribution and enhances entertainment in the musical performance image distribution by reducing necessary expenses for facilities and people in photographing performers in a musical performance space.SOLUTION: A musical performance photographing device includes: means for associating and identifying positional information within a musical performance space 310 of a performer 330 with musical performance means 360 by the performer including a musical instrument 370 owned by the performer based on first image information obtained by photographing the musical performance space with a camera 500; means for storing performer feature information representing features of the performer including the musical performance means in association with positional information on the performer within the musical performance space; means for identifying the musical performance means being performed in the musical performance space based on sound information in the musical performance space acquired by a sound collection device; extraction means for extracting the positional information within the musical performance space corresponding to the identified musical performance means in the storage means; and means for instructing the camera 510 to photograph a place identified by the extracted positional information within the musical performance space.SELECTED DRAWING: Figure 1

Description

舞台上で演奏する演者を自動で撮影する技術に関する。 It is related to the technology to automatically shoot the performers who perform on the stage.

現在、ライブ会場の映像配信では、複数台のカメラ装置、照明器具、編集器具、中継車、撮影者・編集者等の大掛かりな装置・人の準備が必要となり、大規模なライブ会場のみが映像配信の対象となっている。 Currently, video distribution at live venues requires the preparation of multiple camera devices, lighting equipment, editing equipment, relay vehicles, large-scale equipment and people such as photographers and editors, and only large-scale live venues are video. It is the target of distribution.

一方で、中小規模のライブ会場においては、設備・人・予算の制約があるため、映像配信がなされることはなく、その結果、マイナーなアーティストは露出が少なくなり、マーケットに認知される機会が少ないという実情がある。
ところで、特許文献１では、音源の位置を特定し、特定周波数の音源を自動的に追尾して撮影することのできる音源追尾型カメラ装置が提案されている。 On the other hand, in small and medium-sized live venues, due to restrictions on equipment, people, and budget, video distribution is not done, and as a result, minor artists are less exposed and have the opportunity to be recognized by the market. There is a fact that there are few.
By the way, Patent Document 1 proposes a sound source tracking type camera device capable of specifying the position of a sound source and automatically tracking and photographing a sound source having a specific frequency.

特開２００２−３５９７６７号公報JP-A-2002-359767

しかしながら、上記の従来技術は、交通取り締まり用のカメラ装置の技術であって、想定されていないライブ会場等の演奏空間への適用が難しいという問題点があった。 However, the above-mentioned conventional technique is a technique of a camera device for traffic control, and has a problem that it is difficult to apply it to a performance space such as an unexpected live venue.

そこで本発明では、上記問題点に鑑み、演奏空間における演者の撮影において、設備・人に掛かる必要経費を低減させることによって、演奏画像配信の裾野を拡大させると共に、演奏画像配信におけるエンターテインメント性を高める演奏撮影装置を提供することを目的とする。 Therefore, in view of the above problems, the present invention expands the base of performance image distribution and enhances the entertainment property in performance image distribution by reducing the necessary expenses for equipment and people in shooting the performer in the performance space. It is an object of the present invention to provide a performance photographing apparatus.

開示する演奏撮影装置の一形態は、一人以上の演者によって演奏が行われる演奏空間を認識用カメラ装置が撮影した認識用画像情報に基づいて、各前記演者の前記演奏空間内の位置情報と、前記各演者が所持する楽器を含む前記各演者による演奏手段と、を対応付けて特定する演者情報特定手段と、前記演奏手段を含む前記各演者の特徴を表す演者特徴情報と、前記各演者の前記演奏空間内の位置情報と、を対応付けて記憶する演者情報記憶手段と、集音装置が取得した前記演奏空間における音情報に基づいて、前記演奏空間において演奏されている前記演奏手段を特定する音源特定手段と、前記演者情報記憶手段において、前記音源特定手段が特定した前記演奏手段と対応する前記演者の演奏空間内の位置情報を抽出する位置情報抽出手段と、撮影用カメラ装置に対し、抽出された前記演奏空間内の位置情報で特定される場所を撮影するように指示を行う撮影指示手段と、を有することを特徴とする。 One form of the performance photographing device disclosed is, based on the recognition image information taken by the recognition camera device of the performance space in which the performance is performed by one or more performers, the position information of each performer in the performance space and the position information in the performance space. Performer information specifying means for specifying the performance means by each performer including the musical instrument possessed by each performer in association with each other, performer characteristic information representing the characteristics of each performer including the performance means, and each performer's performance means. The performance means being played in the performance space is specified based on the performer information storage means that stores the position information in the performance space in association with each other and the sound information in the performance space acquired by the sound collector. With respect to the sound source specifying means to be performed, the position information extracting means for extracting the position information in the performance space of the performer corresponding to the performance means specified by the sound source specifying means, and the photographing camera device in the performer information storage means. It is characterized by having a photographing instruction means for instructing to photograph a place specified by the extracted position information in the performance space.

開示する演奏撮影装置は、演奏空間における演者の撮影において、設備・人に掛かる必要経費を低減させることによって、演奏画像配信の裾野を拡大させると共に、演奏画像配信におけるエンターテインメント性を高める。 The disclosed performance photographing device expands the base of performance image distribution and enhances the entertainment property in the performance image distribution by reducing the necessary expenses for equipment and people in the shooting of the performer in the performance space.

本実施の形態に係る演奏撮影装置の概要を説明する図である。It is a figure explaining the outline of the performance photographing apparatus which concerns on this embodiment. 本実施の形態に係る演奏撮影装置と他装置との接続態様を説明する図である。It is a figure explaining the connection mode of the performance photographing apparatus and other apparatus which concerns on this embodiment. 本実施の形態に係る演奏撮影装置の機能ブロック図である。It is a functional block diagram of the performance photographing apparatus which concerns on this embodiment. 本実施の形態に係る演者情報記憶手段の一例を示す図である。It is a figure which shows an example of the performer information storage means which concerns on this embodiment. 本実施の形態に係る演奏撮影装置のハードウエア構成例を示す図である。It is a figure which shows the hardware configuration example of the performance photographing apparatus which concerns on this embodiment. 本実施の形態に係る演奏撮影装置による演者の位置及び特徴を特定する処理例の流れを示すフローチャートである。It is a flowchart which shows the flow of the processing example which specifies the position and feature of the performer by the performance photographing apparatus which concerns on this embodiment. 本実施の形態に係る演奏撮影装置によるカメラ装置及び照明装置への制御指示を行う処理例の流れを示すフローチャートである。It is a flowchart which shows the flow of the processing example which gives the control instruction to the camera device and the lighting device by the performance photographing apparatus which concerns on this embodiment.

図面を参照しながら、本発明を実施するための形態について説明する。
（本実施の形態に係る演奏撮影装置の動作原理） A mode for carrying out the present invention will be described with reference to the drawings.
(Operating principle of the performance photographing apparatus according to the present embodiment)

図１乃至４を用いて、本実施の形態に係る演奏撮影装置（以下、単に「本装置」という。）１００の動作原理について説明する。図１及び２は、本装置１００の概略を説明するための図であり、図３は、本装置１００の機能ブロック図である。 The operating principle of the performance photographing apparatus (hereinafter, simply referred to as “the apparatus”) 100 according to the present embodiment will be described with reference to FIGS. 1 to 4. 1 and 2 are diagrams for explaining the outline of the present device 100, and FIG. 3 is a functional block diagram of the present device 100.

図１で示すように、本装置１００は、ライブ会場のように、一人以上の演者３３０が演奏を行う演奏空間３１０において、現に演奏を行う演者３３０の撮影を行ったり、演者３３０に照明装置５２０の光を当てたりするためのものである。演奏空間３１０には認識用カメラ装置５００が設置され、認識用カメラ装置５００は、演奏空間３１０全体を撮影し、演者３３０の位置や演者３３０の特徴３４０を認識するために用いる認識用画像情報３２０を出力する。 As shown in FIG. 1, the present device 100 takes a picture of the performer 330 who is actually performing in the performance space 310 where one or more performers 330 perform, or a lighting device 520 for the performer 330, as in a live venue. It is for shining the light of. A recognition camera device 500 is installed in the performance space 310, and the recognition camera device 500 photographs the entire performance space 310 and uses recognition image information 320 for recognizing the position of the performer 330 and the feature 340 of the performer 330. Is output.

また、演奏空間３１０には、演者３３０が発する音を集音する集音装置５３０が設置される。集音装置５３０は、例えば、マイク装置であっても良く、複数の音声信号を電気的に加算、加工し出力する音響機器であるミキサーであっても良い。さらに、演奏空間３１０には、本装置１００の指示に従って演者３３０を撮影する撮影用カメラ装置５１０や演者３３０へライトを当てる照明装置５２０も設置される。 Further, in the performance space 310, a sound collecting device 530 for collecting sounds emitted by the performer 330 is installed. The sound collecting device 530 may be, for example, a microphone device, or may be a mixer, which is an audio device that electrically adds, processes, and outputs a plurality of audio signals. Further, in the performance space 310, a camera device 510 for photographing the performer 330 according to the instruction of the device 100 and a lighting device 520 that illuminates the performer 330 are also installed.

図２で示すように、本装置１００は、通信ネットワーク５５０を介して、認識用カメラ装置５００、撮影用カメラ装置５１０、照明装置５２０、集音装置５３０、ユーザー端末５４０と接続される。通信ネットワーク５５０は、有線通信ネットワークであっても良く、無線通信ネットワークであっても良い。 As shown in FIG. 2, the present device 100 is connected to the recognition camera device 500, the photographing camera device 510, the lighting device 520, the sound collecting device 530, and the user terminal 540 via the communication network 550. The communication network 550 may be a wired communication network or a wireless communication network.

図１及び２で示すように、本装置１００は、認識用カメラ装置５００が撮影した画像３２０に基づいて、演者３３０一人ひとりの位置３５０、楽器３７０や歌声などの演奏手段３６０を含む演者３３０の特徴を表す情報３４０を特定し、データーベース化する。その一方で、本装置１００は、集音装置５３０が取得した演奏空間３１０の音情報４７０に基づいて、演奏空間３１０において音を発している演奏手段３６０を特定し、データーベース１１０内で紐付けられる演者３３０の位置情報３５０や演者特徴情報３４０を抽出する。そして、本装置１００は、抽出した演者３３０の位置情報３５０や演者特徴情報３４０に基づいて、撮影用カメラ装置５１０や照明装置５２０へ制御指示を行う。 As shown in FIGS. 1 and 2, the present device 100 is based on the image 320 taken by the recognition camera device 500, and features the performer 330 including the position 350 of each performer 330 and the playing means 360 such as the musical instrument 370 and the singing voice. The information 340 representing the above is specified and made into a database. On the other hand, the present device 100 identifies the playing means 360 that emits sound in the playing space 310 based on the sound information 470 of the playing space 310 acquired by the sound collecting device 530, and associates the performance means 360 with the data base 110. The position information 350 and the performer characteristic information 340 of the performer 330 to be performed are extracted. Then, the present device 100 gives a control instruction to the photographing camera device 510 and the lighting device 520 based on the extracted position information 350 of the performer 330 and the performer feature information 340.

このようにして、本装置１００は、ライブ会場のような演奏空間３１０の撮影において、人手を減らし、人件費を削減することによって、小さな演奏空間３１０における演奏画像を配信するなど演奏画像配信の裾野を拡大させることができる。加えて、本装置１００は、演奏画像の自動配信におけるエンターテインメント性を高める。 In this way, the present device 100 distributes a performance image in a small performance space 310 by reducing manpower and labor costs in shooting a performance space 310 such as a live venue. Can be expanded. In addition, the present device 100 enhances the entertainment property in the automatic distribution of the performance image.

図３で示すように、本装置１００は、演者情報記憶手段１１０、画像情報取得手段１２０、演者情報特定手段１３０、音源情報取得手段１４０、音源特定手段１５０、位置情報抽出手段１６０、撮影指示手段１７０、照明指示手段１８０、撮影選択受付手段１９０、照明選択受付手段２００、画像配信手段２１０を有する。 As shown in FIG. 3, the apparatus 100 includes a performer information storage means 110, an image information acquisition means 120, a performer information identification means 130, a sound source information acquisition means 140, a sound source identification means 150, a position information extraction means 160, and a shooting instruction means. It has 170, a lighting instruction means 180, a shooting selection reception means 190, a lighting selection reception means 200, and an image distribution means 210.

演者情報記憶手段１１０は、演者３３０が所持する楽器３７０や演者３３０の歌声などの演奏手段３６０を含む演者３３０それぞれの特徴を表す演者特徴情報３４０と、演者３３０それぞれの演奏空間３１０内の位置情報３５０と、を対応付けて記憶する。演者特徴情報３４０は、例えば、演者３３０それぞれについて、演奏手段３６０、全身の大きさ４２０、顔の位置３８０や大きさ４３０、所持する楽器３７０の位置３９０や大きさ４６０、手の位置４００や大きさ４４０、口の位置４１０や大きさ４５０を含む。なお、位置情報３５０、３８０、３９０、４００、４１０は、ＸＹＺ座標で表される情報であっても良く、その他の座標系で表される情報であっても良い。また、大きさを表す情報４２０、４３０、４４０、４５０、４６０は、どの様な単位を以って表現されても良い。 The performer information storage means 110 includes performer characteristic information 340 representing the characteristics of each performer 330 including the musical instrument 370 possessed by the performer 330 and the performance means 360 such as the singing voice of the performer 330, and position information in the performance space 310 of each performer 330. 350 and are stored in association with each other. The performer characteristic information 340 is, for example, for each performer 330, the performance means 360, the size of the whole body 420, the position of the face 380 and the size 430, the position 390 and the size 460 of the musical instrument 370 possessed, the position 400 and the size of the hand. 440, including mouth position 410 and size 450. The position information 350, 380, 390, 400, 410 may be information represented by XYZ coordinates, or may be information represented by other coordinate systems. Further, the information 420, 430, 440, 450, 460 indicating the size may be expressed by any unit.

図４で示すように、演者情報記憶手段１１０においては、例えば、演者識別情報：「Ａ」、演奏手段３６０：「ボーカル」、位置情報３５０：「８，２，５」、全身の大きさ４２０：「１０」、顔の位置情報３８０：「８，２，〇」、…のような形態で、演者特徴情報３４０と位置情報３５０とが紐付けて記憶される。また、演者情報記憶手段１１０においては、例えば、演者識別情報：「Ｃ」、演奏手段３６０：「ドラムス」、位置情報３５０：「１８，７，６」、…、楽器の位置情報３９０：「１８，７,◇」、楽器の大きさ４６０：「１０」、…のような形態で、演者特徴情報３４０と位置情報３５０とが紐付けて記憶される。 As shown in FIG. 4, in the performer information storage means 110, for example, the performer identification information: “A”, the performance means 360: “vocal”, the position information 350: “8,2,5”, and the size of the whole body 420. : "10", face position information 380: "8,2,0", ... The performer feature information 340 and the position information 350 are stored in association with each other. Further, in the performer information storage means 110, for example, the performer identification information: "C", the performance means 360: "drums", the position information 350: "18, 7, 6", ..., The position information of the musical instrument 390: "18". , 7, ◇ ”, musical instrument size 460:“ 10 ”, ... The performer characteristic information 340 and the position information 350 are stored in association with each other.

画像情報取得手段１２０は、一人以上の演者３３０によって演奏が行われる演奏空間３１０について、認識用カメラ装置５００が撮影した認識用画像情報３２０を、通信ネットワーク５５０を介して取得する。認識用画像情報３２０は、どの様なデータ形式であっても良い。 The image information acquisition means 120 acquires the recognition image information 320 taken by the recognition camera device 500 for the performance space 310 in which the performance is performed by one or more performers 330 via the communication network 550. The recognition image information 320 may be in any data format.

演者情報特定手段１３０は、認識用画像情報３２０に基づいて、各演者３３０の演奏空間３１０内の位置情報３５０と、各演者３３０が所持する楽器３７０を含む各演者３３０による演奏手段３７０と、を対応付けて特定する。 Based on the recognition image information 320, the performer information identifying means 130 provides the position information 350 in the performance space 310 of each performer 330 and the performance means 370 by each performer 330 including the musical instrument 370 possessed by each performer 330. Identify by associating.

また、演者情報特定手段１３０は、認識用画像情報３２０に基づいて、演者３３０の顔の位置３８０、演者３３０が所持する楽器３７０の位置３９０、演者３３０の手の位置４００、演者３３０の口の位置４１０のうち何れか一つ以上の情報を特定する。 Further, the performer information identifying means 130 is based on the recognition image information 320, the face position 380 of the performer 330, the position 390 of the musical instrument 370 possessed by the performer 330, the hand position 400 of the performer 330, and the mouth position of the performer 330. Identify any one or more pieces of information at position 410.

さらに、演者情報特定手段１３０は、認識用画像情報３２０に基づいて、演者３３０の全身の大きさ４２０、演者３３０の顔の大きさ４３０、演者３３０が所持する楽器３７０の大きさ４６０、演者３３０の手の大きさ４４０、演者３３０の口の大きさ４５０のうち何れか一つ以上の情報を特定する。 Further, the performer information identifying means 130 is based on the recognition image information 320, the whole body size 420 of the performer 330, the face size 430 of the performer 330, the size 460 of the musical instrument 370 possessed by the performer 330, and the performer 330. The information of any one or more of the hand size 440 and the mouth size 450 of the performer 330 is specified.

演者情報特定手段１３０が認識用画像情報３２０に基づいて、演奏手段３６０、位置情報３５０、３８０、３９０、４００、４１０、大きさを表す情報４２０、４３０、４４０、４５０、４６０を特定する手法は、従来の画像認識技術が用いられる。また、演者情報特定手段１３０は、認識用画像情報３２０に基づいて、演者３３０が所持する楽器３７０が特定できない場合、演者３３０の演奏手段３６０を“ボーカル（歌を歌う行為）”と認識する形態であっても良い。 The method by which the performer information specifying means 130 identifies the playing means 360, the position information 350, 380, 390, 400, 410, and the size information 420, 430, 440, 450, 460 based on the recognition image information 320 is , Conventional image recognition technology is used. Further, the performer information specifying means 130 recognizes the playing means 360 of the performer 330 as "vocal (act of singing a song)" when the musical instrument 370 possessed by the performer 330 cannot be specified based on the recognition image information 320. It may be.

音源情報取得手段１４０は、演奏空間３１０において集音装置５３０が取得した音情報４７０を、通信ネットワーク５５０を介して取得する。音情報４７０は、どの様なデータ形式であっても良い。集音装置５３０は、例えば、マイク装置であっても良く、複数の音声信号を電気的に加算、加工し出力する音響機器であるミキサーであっても良い。 The sound source information acquisition means 140 acquires the sound information 470 acquired by the sound collecting device 530 in the performance space 310 via the communication network 550. The sound information 470 may be in any data format. The sound collecting device 530 may be, for example, a microphone device, or may be a mixer, which is an audio device that electrically adds, processes, and outputs a plurality of audio signals.

音源特定手段１５０は、集音装置５３０が取得した演奏空間３１０における音情報４７０に基づいて、演奏空間３１０において演奏されている演奏手段３６０を特定する。演奏手段３６０とは、例えば、演者３３０が所持する楽器３７０や演者３３０の歌声である。音源特定手段１５０が演奏手段３６０を特定する手法は、従来の音声認識技術が用いられ、既知（登録済み）の音情報と音情報４７０とを比較することによって行われる。 The sound source specifying means 150 identifies the playing means 360 being played in the playing space 310 based on the sound information 470 in the playing space 310 acquired by the sound collecting device 530. The performance means 360 is, for example, the musical instrument 370 possessed by the performer 330 or the singing voice of the performer 330. The method for the sound source specifying means 150 to identify the playing means 360 is performed by using a conventional voice recognition technique and comparing known (registered) sound information with sound information 470.

位置情報抽出手段１６０は、演者情報記憶手段１１０において、音源特定手段１５０が特定した演奏手段３６０と対応して記憶される演者３３０の演奏空間３１０内の位置情報３５０を抽出する。 The position information extracting means 160 extracts the position information 350 in the performance space 310 of the performer 330, which is stored in the performer information storage means 110 in correspondence with the performance means 360 specified by the sound source specifying means 150.

位置情報抽出手段１６０は、演者情報記憶手段１１０において、音源特定手段１５０が特定した演奏手段３６０と対応して記憶される演者３３０の顔の位置３８０、演者３３０が所持する楽器３７０の位置３９０、演者３３０の手の位置４００、演者３３０の口の位置４１０のうち何れか一つ以上の位置情報を抽出する。 The position information extracting means 160 includes the position 380 of the face of the performer 330 and the position 390 of the musical instrument 370 possessed by the performer 330, which are stored in the performer information storage means 110 in correspondence with the performance means 360 specified by the sound source specifying means 150. The position information of any one or more of the position 400 of the hand of the performer 330 and the position 410 of the mouth of the performer 330 is extracted.

また、位置情報抽出手段１６０は、演者情報記憶手段１１０において、音源特定手段１５０が特定した演奏手段３６０と対応して記憶される演者３３０の全身の大きさ４２０、演者３３０の顔の大きさ４３０、演者３３０の手の大きさ４４０、演者３３０の口の大きさ４５０、演者３３０が所持する楽器３７０の大きさ４６０のうち何れか一つ以上の情報を抽出する。 Further, the position information extracting means 160 has a whole body size 420 of the performer 330 and a face size 430 of the performer 330 stored in the performer information storage means 110 corresponding to the performance means 360 specified by the sound source specifying means 150. , The information of any one or more of the hand size 440 of the performer 330, the mouth size 450 of the performer 330, and the size 460 of the musical instrument 370 possessed by the performer 330 is extracted.

また、位置情報抽出手段１６０は、演者情報記憶手段１１０において、後述する選択情報４８０、４９０と対応して記憶される演者３３０の顔の位置３８０、演者３３０が所持する楽器３７０の位置３９０、演者３３０の手の位置４００、演者３３０の口の位置４１０のうち何れか一つ以上の位置情報を抽出する形態としても良い。 Further, the position information extracting means 160 is the performer information storage means 110, the position 380 of the face of the performer 330 stored in correspondence with the selection information 480 and 490 described later, the position 390 of the musical instrument 370 possessed by the performer 330, and the performer. The position information of any one or more of the position 400 of the hand of 330 and the position 410 of the mouth of the performer 330 may be extracted.

撮影指示手段１７０は、撮影用カメラ装置５１０に対し、位置情報抽出手段１６０が抽出した演奏空間３１０内の位置情報３５０、３８０、３９０、４００、４１０で特定される場所を撮影するように指示を行う。撮影用カメラ装置５１０は、１台であっても、複数台であっても良い。 The shooting instruction means 170 instructs the camera device 510 for shooting to shoot a place specified by the position information 350, 380, 390, 400, 410 in the performance space 310 extracted by the position information extraction means 160. conduct. The number of the photographing camera devices 510 may be one or a plurality.

撮影指示手段１７０は、撮影用カメラ装置５１０に対し、位置情報抽出手段１６０が抽出した大きさを表す情報４２０、４３０、４４０、４５０、４６０に合わせて、撮影する範囲の大小を変更するように指示を行う。大きさを表す情報４２０、４３０、４４０、４５０、４６０と撮影する範囲の大きさ（これを変更する制御指示）との関係は、適宜定めることが可能である。
なお、撮影用カメラ装置５１０は、撮影指示手段１７０による指示に従って撮影を行い、本装置１００へ撮影した画像情報を送信する。 The shooting instruction means 170 changes the size of the shooting range for the shooting camera device 510 according to the information 420, 430, 440, 450, 460 indicating the size extracted by the position information extracting means 160. Give instructions. The relationship between the size information 420, 430, 440, 450, 460 and the size of the shooting range (control instruction for changing this) can be appropriately determined.
The camera device 510 for shooting takes a picture according to the instruction by the shooting instruction means 170, and transmits the image information taken to the device 100.

照明指示手段１８０は、照明装置５２０に対し、位置情報抽出手段１６０が抽出した演奏空間３１０内の位置情報３５０、３８０、３９０、４００、４１０で特定される場所を照らすように指示を行う。照明装置５２０は、１台であっても、複数台であっても良い。 The lighting instruction means 180 instructs the lighting device 520 to illuminate the places specified by the position information 350, 380, 390, 400, 410 in the performance space 310 extracted by the position information extraction means 160. The number of lighting devices 520 may be one or a plurality.

照明指示手段１８０は、照明装置５２０に対し、位置情報抽出手段１６０が抽出した大きさを表す情報４２０、４３０、４４０、４５０、４６０に合わせて、照明を当てる範囲の大小を変更するように指示を行う。大きさを表す情報４２０、４３０、４４０、４５０、４６０と照明を当てる範囲の大きさ（これを変更する制御指示）との関係は、適宜定めることが可能である。
なお、照明装置５２０は、照明指示手段１８０による指示に従って照明（投光）する。 The lighting instruction means 180 instructs the lighting device 520 to change the size of the illumination range according to the information 420, 430, 440, 450, 460 indicating the size extracted by the position information extraction means 160. I do. The relationship between the size information 420, 430, 440, 450, 460 and the size of the illuminated range (control instruction for changing this) can be appropriately determined.
The lighting device 520 illuminates (projects light) according to the instructions given by the lighting instruction means 180.

撮影選択受付手段１９０は、ユーザー端末５４０から、撮影用カメラ装置５１０に撮影させる場所として、演者３３０の全身・顔・口・手（指先）、演者３３０が所持する楽器３７０のうち何れかを選択させた選択情報４８０を受け付ける。 The shooting selection receiving means 190 selects one of the whole body, face, mouth, hands (fingertips) of the performer 330, and the musical instrument 370 possessed by the performer 330 as a place for the camera device 510 for shooting to shoot from the user terminal 540. The selected selection information 480 is accepted.

照明選択受付手段２００は、ユーザー端末５４０から、照明装置５２０に照明を当てさせる場所として、演者３３０の全身・顔・口・手（指先）、演者３３０が所持する楽器３７０のうち何れかを選択させた選択情報４９０を受け付ける。
画像配信手段２１０は、撮影用カメラ装置５１０が撮影した画像情報を、通信ネットワーク５５０を介して配信する。 The lighting selection receiving means 200 selects one of the whole body, face, mouth, hands (fingertips) of the performer 330, and the musical instrument 370 possessed by the performer 330 as a place to illuminate the lighting device 520 from the user terminal 540. The selected selection information 490 is accepted.
The image distribution means 210 distributes the image information captured by the photographing camera device 510 via the communication network 550.

本装置１００は、上記のような動作原理に基づいて、演奏空間３１０における演者３３０の撮影において、設備・人に掛かる必要経費を低減（自動化）させることによって、演奏画像配信の裾野を拡大させ、演奏画像配信におけるエンターテインメント性も高める。
（本実施の形態に係る演奏撮影装置のハードウエア構成） Based on the above operating principle, the apparatus 100 expands the base of performance image distribution by reducing (automating) the necessary expenses for equipment and people in shooting the performer 330 in the performance space 310. It also enhances entertainment in performance image distribution.
(Hardware configuration of the performance photographing device according to the present embodiment)

図５を用いて、本装置１００のハードウエア構成例について説明する。図５は、本装置１００のハードウエア構成の一例を示す図である。図５で示すように、本装置１００は、ＣＰＵ（Central Processing Unit）６１０、ＲＯＭ（Read-Only Memory）６２０、ＲＡＭ（Random Access Memory）６３０、補助記憶装置６４０、通信Ｉ／Ｆ６５０、入力装置６６０、出力装置６７０、記録媒体Ｉ／Ｆ６８０を有する。 An example of the hardware configuration of the present device 100 will be described with reference to FIG. FIG. 5 is a diagram showing an example of the hardware configuration of the present device 100. As shown in FIG. 5, the present device 100 includes a CPU (Central Processing Unit) 610, a ROM (Read-Only Memory) 620, a RAM (Random Access Memory) 630, an auxiliary storage device 640, a communication I / F 650, and an input device 660. , Has an output device 670 and a recording medium I / F 680.

ＣＰＵ６１０は、ＲＯＭ６２０に記憶されたプログラムを実行する装置であり、ＲＡＭ６３０に展開（ロード）されたデータを、プログラムの命令に従って演算処理し、本装置１００全体を制御する。ＲＯＭ６２０は、ＣＰＵ６１０が実行するプログラムやデータを記憶している。ＲＡＭ６３０は、ＣＰＵ６１０でＲＯＭ６２０に記憶されたプログラムを実行する際に、実行するプログラムやデータが展開（ロード）され、演算の間、演算データを一時的に保持する。 The CPU 610 is a device that executes a program stored in the ROM 620, and performs arithmetic processing on the data expanded (loaded) in the RAM 630 according to the instruction of the program to control the entire device 100. The ROM 620 stores programs and data executed by the CPU 610. When the CPU 610 executes a program stored in the ROM 620, the RAM 630 expands (loads) the program or data to be executed, and temporarily holds the calculation data during the calculation.

補助記憶装置６４０は、基本ソフトウエアであるＯＳ（Operating System）や本実施の形態に係るアプリケーションプログラムなどを、関連するデータとともに記憶する装置であり、例えば、ＨＤＤ（Hard Disk Drive）やフラッシュメモリなどである。 The auxiliary storage device 640 is a device that stores an OS (Operating System), which is basic software, an application program related to the present embodiment, and the like together with related data. For example, an HDD (Hard Disk Drive), a flash memory, or the like. Is.

通信Ｉ／Ｆ６５０は、有線・無線ＬＡＮ（Local Area Network）、インターネットなどの通信ネットワーク５５０に接続し、通信機能を提供する他装置５００、５１０、５２０、５３０、５４０とデータの授受を行うためのインターフェースである。 The communication I / F 650 connects to a communication network 550 such as a wired / wireless LAN (Local Area Network) or the Internet, and exchanges data with other devices 500, 510, 520, 530, 540 that provide communication functions. It is an interface.

入力装置６６０は、キーボードやタッチパネルなど本装置１００にデータ入力を行うための装置である。出力装置６７０は、ＬＣＤ（Liquid Crystal Display）等で構成される装置であり、本装置１００が有する機能をユーザーが利用する際や各種設定を行う際のユーザーインターフェースとして機能する装置である。
記録媒体Ｉ／Ｆ６８０は、ＣＤ−ＲＯＭ、ＤＶＤ−ＲＯＭ、ＵＳＢメモリなどの記録媒体６９０とデータの送受信を行うためのインターフェースである。 The input device 660 is a device for inputting data to the device 100, such as a keyboard and a touch panel. The output device 670 is a device composed of an LCD (Liquid Crystal Display) or the like, and is a device that functions as a user interface when the user uses the functions of the device 100 or when making various settings.
The recording medium I / F 680 is an interface for transmitting / receiving data to / from a recording medium 690 such as a CD-ROM, a DVD-ROM, or a USB memory.

本装置１００が有する各手段は、ＣＰＵ６１０が、ＲＯＭ６２０又は補助記憶装置６４０に記憶された各手段に対応するプログラムを実行することにより実現される形態としても良い。また、本装置１００が有する各手段は、当該各手段に関する処理をハードウエアとして実現される形態としても良い。また、通信Ｉ／Ｆ６５０を介して外部サーバー装置から本発明に係るプログラムを読み込ませたり、記録媒体Ｉ／Ｆ６８０を介して記録媒体６９０から本発明に係るプログラムを読み込ませたりして、本装置１００に当該プログラムを実行させる形態としても良い。
（本実施の形態に係る演奏撮影装置による処理例）
（１）演者３３０の位置３５０及び特徴３４０を特定する処理例 Each means included in the present device 100 may be realized by the CPU 610 executing a program corresponding to each means stored in the ROM 620 or the auxiliary storage device 640. Further, each means included in the present device 100 may be in a form in which processing related to each means is realized as hardware. Further, the program 100 according to the present invention is read from the external server device via the communication I / F 650, or the program according to the present invention is read from the recording medium 690 via the recording medium I / F 680. It may be a form in which the program is executed.
(Example of processing by the performance photographing apparatus according to this embodiment)
(1) Processing example for specifying the position 350 and the feature 340 of the performer 330

図６を用いて、本装置１００による演者３３０の位置３５０及び特徴３４０を特定する処理例について説明する。図６は、本装置１００による演者３３０の位置３５０及び特徴３４０を特定する処理の一例の流れを示すフローチャートである。 An example of processing for specifying the position 350 and the feature 340 of the performer 330 by the present apparatus 100 will be described with reference to FIG. FIG. 6 is a flowchart showing a flow of an example of processing for specifying the position 350 and the feature 340 of the performer 330 by the present device 100.

Ｓ１０で認識用カメラ装置５００が、演奏空間３１０全体を撮影し、演者３３０の位置や演者３３０の特徴３４０を認識するために用いる認識用画像情報３２０を出力する。そして、認識用カメラ装置５００は、通信ネットワーク５５０を介して、認識用画像情報３２０を本装置１００へ送付する。 In S10, the recognition camera device 500 photographs the entire performance space 310 and outputs recognition image information 320 used for recognizing the position of the performer 330 and the feature 340 of the performer 330. Then, the recognition camera device 500 sends the recognition image information 320 to the device 100 via the communication network 550.

さらに、Ｓ１０で画像情報取得手段１２０が、認識用カメラ装置５００から通信ネットワーク５５０を介して送付される認識用画像情報３２０を取得する。なお、認識用画像情報３２０は、どの様なデータ形式であっても良い。 Further, in S10, the image information acquisition means 120 acquires the recognition image information 320 sent from the recognition camera device 500 via the communication network 550. The recognition image information 320 may be in any data format.

Ｓ２０で演者情報特定手段１３０が、Ｓ１０において取得された認識用画像情報３２０に基づいて、各演者３３０の演奏空間３１０内の位置情報３５０と、各演者３３０が所持する楽器３７０を含む各演者３３０による演奏手段３７０と、を対応付けて特定する。 The performer information identifying means 130 in S20, based on the recognition image information 320 acquired in S10, each performer 330 including the position information 350 in the performance space 310 of each performer 330 and the musical instrument 370 possessed by each performer 330. The performance means 370 by the above is associated with and specified.

演者情報特定手段１３０は、従来の画像認識技術が用いて、演奏手段３６０、位置情報３５０、３８０、３９０、４００、４１０、大きさを表す情報４２０、４３０、４４０、４５０、４６０を特定する。また、演者情報特定手段１３０は、認識用画像情報３２０に基づいて、演者３３０が所持する楽器３７０が特定できない場合、演者３３０の演奏手段３６０を“ボーカル（歌を歌う行為）”と認識する形態であっても良い。 The performer information identifying means 130 identifies the playing means 360, the position information 350, 380, 390, 400, 410, and the size information 420, 430, 440, 450, 460 by using the conventional image recognition technique. Further, the performer information specifying means 130 recognizes the playing means 360 of the performer 330 as "vocal (act of singing a song)" when the musical instrument 370 possessed by the performer 330 cannot be specified based on the recognition image information 320. It may be.

Ｓ３０で演者情報特定手段１３０が、Ｓ２０において特定された楽器３７０や演者３３０の歌声などの演奏手段３６０を含む演者３３０それぞれの特徴を表す演者特徴情報３４０と、演者３３０それぞれの演奏空間３１０内の位置情報３５０と、を対応付けて、演者情報記憶手段１１０へ登録する。 The performer information specifying means 130 in S30 contains the performer characteristic information 340 representing the characteristics of each of the performers 330 including the performance means 360 such as the musical instrument 370 and the singing voice of the performer 330 specified in S20, and the performer 330's performance space 310. The position information 350 is associated with the performer information storage means 110 and registered.

なお、演者特徴情報３４０は、例えば、演者３３０それぞれについて、演奏手段３６０、全身の大きさ４２０、顔の位置３８０や大きさ４３０、所持する楽器３７０の位置３９０や大きさ４６０、手の位置４００や大きさ４４０、口の位置４１０や大きさ４５０を含む。なお、位置情報３５０、３８０、３９０、４００、４１０は、ＸＹＺ座標で表される情報であっても良く、その他の座標系で表される情報であっても良い。また、大きさを表す情報４２０、４３０、４４０、４５０、４６０は、どの様な単位を以って表現されても良い。 The performer characteristic information 340 is, for example, for each performer 330, the performance means 360, the size of the whole body 420, the position of the face 380 and the size 430, the position 390 and the size 460 of the musical instrument 370 possessed, and the position 400 of the hand. Includes size 440, mouth position 410 and size 450. The position information 350, 380, 390, 400, 410 may be information represented by XYZ coordinates, or may be information represented by other coordinate systems. Further, the information 420, 430, 440, 450, 460 indicating the size may be expressed by any unit.

図４で示すように、演者情報記憶手段１１０においては、例えば、演者識別情報：「Ａ」、演奏手段３６０：「ボーカル」、位置情報３５０：「８，２，５」、全身の大きさ４２０：「１０」、顔の位置情報３８０：「８，２，〇」、…のような形態で、演者特徴情報３４０と位置情報３５０とが紐付けて登録される。また、演者情報記憶手段１１０においては、例えば、演者識別情報：「Ｃ」、演奏手段３６０：「ドラムス」、位置情報３５０：「１８，７，６」、…、楽器の位置情報３９０：「１８，７,◇」、楽器の大きさ４６０：「１０」、…のような形態で、演者特徴情報３４０と位置情報３５０とが紐付けて登録される。
（２）カメラ装置５１０及び照明装置５２０への制御指示を行う処理例 As shown in FIG. 4, in the performer information storage means 110, for example, the performer identification information: “A”, the performance means 360: “vocal”, the position information 350: “8,2,5”, and the size of the whole body 420. : "10", face position information 380: "8,2,0", ... The performer feature information 340 and the position information 350 are registered in association with each other. Further, in the performer information storage means 110, for example, the performer identification information: "C", the performance means 360: "drums", the position information 350: "18, 7, 6", ..., The position information of the musical instrument 390: "18". , 7, ◇ ”, musical instrument size 460:“ 10 ”,…, and the performer characteristic information 340 and the position information 350 are registered in association with each other.
(2) Example of processing for giving control instructions to the camera device 510 and the lighting device 520

図７を用いて、本装置１００によるカメラ装置５１０及び照明装置５２０への制御指示を行う処理例について説明する。図７は、本装置１００によるカメラ装置５１０及び照明装置５２０への制御指示を行う処理の一例の流れを示すフローチャートである。 An example of processing in which the present device 100 gives a control instruction to the camera device 510 and the lighting device 520 by the present device 100 will be described with reference to FIG. 7. FIG. 7 is a flowchart showing an example flow of a process of giving a control instruction to the camera device 510 and the lighting device 520 by the present device 100.

Ｓ１１０で集音装置５３０が、演奏空間３１０において演者３３０が発する音を集音し、通信ネットワーク５５０を介して、集音した音情報４７０を本装置１００へ送付する。なお、集音装置５３０は、例えば、マイク装置であっても良く、複数の音声信号を電気的に加算、加工し出力する音響機器であるミキサーであっても良い。そして、Ｓ１１０で音源情報取得手段１４０が、集音装置５３０が取得した音情報４７０を、通信ネットワーク５５０を介して取得する。音情報４７０は、どの様なデータ形式であっても良い。 In S110, the sound collecting device 530 collects the sound emitted by the performer 330 in the performance space 310, and sends the collected sound information 470 to the device 100 via the communication network 550. The sound collecting device 530 may be, for example, a microphone device, or may be a mixer, which is an audio device that electrically adds, processes, and outputs a plurality of audio signals. Then, in S110, the sound source information acquisition means 140 acquires the sound information 470 acquired by the sound collecting device 530 via the communication network 550. The sound information 470 may be in any data format.

さらに、Ｓ１１０で音源特定手段１５０が、Ｓ１１０において取得された演奏空間３１０における音情報４７０に基づいて、演奏空間３１０において演奏されている演奏手段３６０を特定する。演奏手段３６０とは、例えば、演者３３０が所持する楽器３７０や演者３３０の歌声である。音源特定手段１５０が演奏手段３６０を特定する手法は、従来の音声認識技術が用いられ、既知（登録済み）の音情報と音情報４７０とを比較することによって行われる。 Further, in S110, the sound source specifying means 150 identifies the playing means 360 being played in the playing space 310 based on the sound information 470 in the playing space 310 acquired in S110. The performance means 360 is, for example, the musical instrument 370 possessed by the performer 330 or the singing voice of the performer 330. The method for the sound source specifying means 150 to identify the playing means 360 is performed by using a conventional voice recognition technique and comparing known (registered) sound information with sound information 470.

Ｓ１２０で位置情報抽出手段１６０が、Ｓ１１０において特定された演奏手段３６０と演者情報記憶手段１１０において対応して記憶される演者３３０の演奏空間３１０内の位置情報３５０を抽出する。また、位置情報抽出手段１６０は、Ｓ１１０において特定された演奏手段３６０と演者情報記憶手段１１０において対応して記憶される演者３３０の顔の位置３８０、演者３３０が所持する楽器３７０の位置３９０、演者３３０の手の位置４００、演者３３０の口の位置４１０のうち何れか一つ以上の位置情報を抽出する。 In S120, the position information extracting means 160 extracts the position information 350 in the performance space 310 of the performer 330 correspondingly stored in the performance means 360 specified in S110 and the performer information storage means 110. Further, the position information extracting means 160 includes the performance means 360 specified in S110 and the face position 380 of the performer 330 correspondingly stored in the performer information storage means 110, the position 390 of the musical instrument 370 possessed by the performer 330, and the performer. The position information of any one or more of the position 400 of the hand of 330 and the position 410 of the mouth of the performer 330 is extracted.

また、位置情報抽出手段１６０は、Ｓ１１０において特定された演奏手段３６０と演者情報記憶手段１１０において対応して記憶される演者３３０の全身の大きさ４２０、演者３３０の顔の大きさ４３０、演者３３０の手の大きさ４４０、演者３３０の口の大きさ４５０、演者３３０が所持する楽器３７０の大きさ４６０のうち何れか一つ以上の情報を抽出する。 Further, the position information extracting means 160 has a whole body size 420 of the performer 330, a face size 430 of the performer 330, and a performer 330 correspondingly stored in the performance means 360 specified in S110 and the performer information storage means 110. Information on any one or more of the hand size 440, the mouth size 450 of the performer 330, and the size 460 of the musical instrument 370 possessed by the performer 330 is extracted.

Ｓ１３０で撮影指示手段１７０が、撮影用カメラ装置５１０に対し、Ｓ１２０において抽出された演奏空間３１０内の位置情報３５０、３８０、３９０、４００、４１０で特定される場所を撮影するように指示を行う。撮影用カメラ装置５１０は、１台であっても、複数台であっても良い。 In S130, the shooting instruction means 170 instructs the shooting camera device 510 to shoot the locations specified by the position information 350, 380, 390, 400, 410 in the performance space 310 extracted in S120. .. The number of the photographing camera devices 510 may be one or a plurality.

また、撮影指示手段１７０は、撮影用カメラ装置５１０に対し、Ｓ１２０において抽出された大きさを表す情報４２０、４３０、４４０、４５０、４６０に合わせて、撮影する範囲の大小を変更するように指示を行う。大きさを表す情報４２０、４３０、４４０、４５０、４６０と撮影する範囲の大きさ（これを変更する制御指示）との関係は、適宜定めることが可能である。 Further, the shooting instruction means 170 instructs the camera device 510 for shooting to change the size of the shooting range according to the information 420, 430, 440, 450, 460 indicating the size extracted in S120. I do. The relationship between the size information 420, 430, 440, 450, 460 and the size of the shooting range (control instruction for changing this) can be appropriately determined.

加えて、Ｓ１３０で照明指示手段１８０が、照明装置５２０に対し、Ｓ１２０において抽出された演奏空間３１０内の位置情報３５０、３８０、３９０、４００、４１０で特定される場所を照らすように指示を行う。照明装置５２０は、１台であっても、複数台であっても良い。 In addition, in S130, the lighting instruction means 180 instructs the illumination device 520 to illuminate the location specified by the position information 350, 380, 390, 400, 410 in the performance space 310 extracted in S120. .. The number of lighting devices 520 may be one or a plurality.

また、照明指示手段１８０は、照明装置５２０に対し、Ｓ１２０において抽出された大きさを表す情報４２０、４３０、４４０、４５０、４６０に合わせて、照明を当てる範囲の大小を変更するように指示を行う。大きさを表す情報４２０、４３０、４４０、４５０、４６０と照明を当てる範囲の大きさ（これを変更する制御指示）との関係は、適宜定めることが可能である。 Further, the lighting instruction means 180 instructs the illumination device 520 to change the size of the illumination range according to the information 420, 430, 440, 450, 460 indicating the size extracted in S120. conduct. The relationship between the size information 420, 430, 440, 450, 460 and the size of the illuminated range (control instruction for changing this) can be appropriately determined.

なお、撮影用カメラ装置５１０は、撮影指示手段１７０による指示に従って撮影を行い、本装置１００へ撮影した画像情報を送信する。画像配信手段２１０は、撮影用カメラ装置５１０が撮影した画像情報を、通信ネットワーク５５０を介して配信する。 The camera device 510 for shooting takes a picture according to the instruction by the shooting instruction means 170, and transmits the image information taken to the device 100. The image distribution means 210 distributes the image information captured by the photographing camera device 510 via the communication network 550.

上記（１）（２）で示すような処理に基づいて、本装置１００は、演奏空間３１０における演者３３０の撮影において、設備・人に掛かる必要経費を低減させることによって、演奏画像配信の裾野を拡大させることができる。それに加えて、本装置１００は、演奏画像配信におけるエンターテインメント性も高めることができる。 Based on the processes shown in (1) and (2) above, the present device 100 reduces the necessary expenses for equipment and people in shooting the performer 330 in the performance space 310, thereby providing a base for the distribution of performance images. Can be expanded. In addition to that, the present device 100 can also enhance the entertainment property in the performance image distribution.

以上、本発明の実施の形態について詳述したが、本発明は係る特定の実施の形態に限定されるものではなく、特許請求の範囲に記載された本発明の要旨の範囲において、種々の変形・変更が可能である。 Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments, and various modifications are made within the scope of the gist of the present invention described in the claims.・ Can be changed.

１００演奏撮影装置
１１０演者情報記憶手段
１２０画像情報取得手段
１３０演者情報特定手段
１４０音情報取得手段
１５０音源特定手段
１６０位置情報抽出手段
１７０撮影指示手段
１８０照明指示手段
１９０撮影選択受付手段
２００照明選択受付手段
２１０画像配信手段
３１０演奏空間
３２０認識用画像情報
３３０演者
３４０演者特徴情報
３５０演者の位置
３６０演奏手段
３７０演者が所持する楽器
３８０演者の顔の位置
３９０演者が所持する楽器の位置
４００演者の手の位置
４１０演者の口の位置
４２０演者の全身の大きさ
４３０演者の顔の大きさ
４４０演者の手の大きさ
４５０演者の口の大きさ
４６０演者が所持する楽器の大きさ
４７０演奏空間における音情報
４８０撮影選択受付手段による選択情報
４９０照明選択受付手段による選択情報
５００認識用カメラ装置
５１０撮影用カメラ装置
５２０照明装置
５３０集音装置（ミキサーを含む）
５４０ユーザー端末
５５０通信ネットワーク
６１０ＣＰＵ
６２０ＲＯＭ
６３０ＲＡＭ
６４０補助記憶装置
６５０通信インターフェース
６６０入力装置
６７０出力装置
６８０記録媒体インターフェース
６９０記録媒体 100 Performance photography device 110 Performer information storage means 120 Image information acquisition means 130 Performer information identification means 140 Sound information acquisition means 150 Sound source identification means 160 Position information extraction means 170 Shooting instruction means 180 Lighting instruction means 190 Shooting selection reception means 200 Lighting selection reception Means 210 Image distribution means 310 Performance space 320 Recognition image information 330 Performer 340 Performer feature information 350 Performer position 360 Performance means 370 Performer's instrument 380 Position of performer's face 390 Position of performer's instrument 400 Performer's hand Position of 410 Performer's mouth position 420 Performer's whole body size 430 Performer's face size 440 Performer's hand size 450 Performer's mouth size 460 Musical instrument size of performer 470 Sound in the performance space Information 480 Selection information by shooting selection reception means 490 Selection information by lighting selection reception means 500 Recognition camera device 510 Shooting camera device 520 Lighting device 530 Sound collector (including mixer)
540 User terminal 550 Communication network 610 CPU
620 ROM
630 RAM
640 Auxiliary storage device 650 Communication interface 660 Input device 670 Output device 680 Recording medium interface 690 Recording medium

Claims

Based on the recognition image information taken by the recognition camera device of the performance space in which the performance is performed by one or more performers, the position information of each performer in the performance space and the musical instrument possessed by each performer are included. Performer information specifying means for specifying the performance means by each performer in association with each other,
Performer information storage means for storing the performer characteristic information representing the characteristics of each performer including the performance means and the position information of each performer in the performance space in association with each other.
Based on the sound information in the performance space acquired by the sound collector, the sound source specifying means for specifying the performance means being played in the performance space, and the sound source specifying means.
In the performer information storage means, a position information extracting means for extracting position information in the performance space of the performer corresponding to the performance means specified by the sound source specifying means, and
A performance shooting device comprising: a shooting instruction means for instructing a camera device for shooting to shoot a place specified by the extracted position information in the performance space.

The performer characteristic information includes any one or more of the position of the performer's face, the position of the musical instrument possessed by the performer, the position of the performer's hand, and the position of the performer's mouth.
The performer information identifying means is one of the position of the performer's face, the position of the musical instrument possessed by the performer, the position of the performer's hand, and the position of the performer's mouth based on the recognition image information. Identify more than one piece of information
In the performer information storage means, the position information extracting means includes the position of the performer's face corresponding to the specified performance means, the position of the musical instrument possessed by the performer, the position of the performer's hand, and the position of the performer's mouth. The performance photographing apparatus according to claim 1, wherein the position information of any one or more of the positions is extracted.

The performer characteristic information is any of the size of the whole body of the performer, the size of the face of the performer, the size of the hands of the performer, the size of the mouth of the performer, and the size of the musical instrument possessed by the performer. Contains one or more pieces of information
Based on the recognition image information, the performer information identifying means includes the size of the whole body of the performer, the size of the face of the performer, the size of the musical instrument possessed by the performer, the size of the performer's hand, and the like. Identify any one or more of the performer's mouth sizes and
In the performer information storage means, the position information extracting means has the size of the whole body of the performer, the size of the face of the performer, the size of the hands of the performer, and the mouth of the performer corresponding to the specified performance means. Information on one or more of the size of the performer and the size of the musical instrument possessed by the performer is extracted.
The performance according to claim 2, wherein the shooting instruction means instructs the camera device for shooting to change the size of the shooting range according to the extracted information on the size. Shooting equipment.

The performance according to any one of claims 1 to 3, wherein the lighting device has a lighting instruction means for instructing the lighting device to illuminate a place specified by the extracted position information in the performance space. Shooting equipment.

Claim 3 quoting claim 3, wherein the lighting instructing means instructs the lighting device to change the magnitude of the range to be illuminated according to the extracted information on the size. 4. The performance photographing apparatus according to 4.

There is a shooting selection receiving means for receiving selection information from the user terminal to select any of the performer's whole body, face, mouth, hands, and the musical instrument possessed by the performer as a place to be photographed by the shooting camera device. death,
The position information extracting means corresponds to the selection information received by the shooting selection receiving means in the performer information storage means, the position of the performer's face, the position of the musical instrument possessed by the performer, and the position of the performer's hand. The performance photographing apparatus according to claim 2, further comprising extracting one or more of the above-mentioned position information from the positions of the performer's mouth.

As a place to illuminate the lighting device from the user terminal, there is a lighting selection receiving means for receiving selection information in which the performer's whole body, face, mouth, hands, or musical instrument possessed by the performer is selected. death,
The position information extracting means corresponds to the selection information received by the lighting selection receiving means in the performer information storage means, the position of the performer's face, the position of the musical instrument possessed by the performer, and the position of the performer's hand. The performance photographing apparatus according to claim 4, wherein the performance photographing apparatus according to claim 2, wherein one or more of the positions of the performer's mouth is extracted.

The performance photographing apparatus according to any one of claims 1 to 7, further comprising an image distribution means for distributing image information photographed by the photographing camera device via a communication network.

Based on the recognition image information taken by the recognition camera device of the performance space in which the performer information specifying means is performed by one or more performers, the position information of each performer in the performance space and each performer A step of associating and specifying the performance means by each performer including the possessed musical instrument, and
A step in which the sound source specifying means identifies the playing means being played in the playing space based on the sound information in the playing space acquired by the sound collecting device.
In the performer information storage means, in which the position information extracting means stores the performer characteristic information representing the characteristics of each performer including the performance means and the position information of each performer in the performance space in association with each other, the sound source specifying means. The step of extracting the position information in the performance space of the performer corresponding to the performance means specified by
A performance shooting method including a step in which a shooting instruction means instructs a camera device for shooting to shoot a place specified by the extracted position information in the performance space.

The performer characteristic information includes any one or more of the position of the performer's face, the position of the musical instrument possessed by the performer, the position of the performer's hand, and the position of the performer's mouth.
The performer information identifying means is one of the position of the performer's face, the position of the musical instrument possessed by the performer, the position of the performer's hand, and the position of the performer's mouth based on the recognition image information. Identify more than one piece of information
In the performer information storage means, the position information extracting means includes the position of the performer's face corresponding to the specified performance means, the position of the musical instrument possessed by the performer, the position of the performer's hand, and the position of the performer's mouth. The performance photographing method according to claim 9, wherein the position information of any one or more of the positions is extracted.

The performer characteristic information is any of the size of the whole body of the performer, the size of the face of the performer, the size of the hands of the performer, the size of the mouth of the performer, and the size of the musical instrument possessed by the performer. Contains one or more pieces of information
Based on the recognition image information, the performer information identifying means includes the size of the whole body of the performer, the size of the face of the performer, the size of the musical instrument possessed by the performer, the size of the performer's hand, and the like. Identify any one or more of the performer's mouth sizes and
In the performer information storage means, the position information extracting means has the size of the whole body of the performer, the size of the face of the performer, the size of the hands of the performer, and the mouth of the performer corresponding to the specified performance means. Information on one or more of the size of the performer and the size of the musical instrument possessed by the performer is extracted.
The performance according to claim 10, wherein the shooting instruction means instructs the camera device for shooting to change the size of the shooting range according to the extracted information on the size. Shooting method.

6. The described performance shooting method.

Claim 11 quoting claim 11, wherein the lighting instructing means instructs the lighting device to change the magnitude of the range to be illuminated according to the extracted information on the size. The performance shooting method according to 12.

The shooting selection receiving means receives selection information from the user terminal to select any of the performer's whole body, face, mouth, hands, and the musical instrument possessed by the performer as the place to be photographed by the shooting camera device. Including steps
The position information extracting means corresponds to the selection information received by the shooting selection receiving means in the performer information storage means, the position of the performer's face, the position of the musical instrument possessed by the performer, and the position of the performer's hand. The performance photographing method according to claim 10, further comprising extracting one or more of the above-mentioned position information from the positions of the performer's mouth.

The lighting selection receiving means receives selection information from the user terminal that selects any of the performer's whole body, face, mouth, hands, and the musical instrument possessed by the performer as a place to illuminate the lighting device. Including steps
The position information extracting means corresponds to the selection information received by the lighting selection receiving means in the performer information storage means, the position of the performer's face, the position of the musical instrument possessed by the performer, and the position of the performer's hand. The performance photographing method according to claim 12, wherein the performance photographing method according to claim 10, wherein one or more of the positions of the performer's mouth is extracted.

The performance shooting method according to any one of claims 9 to 15, wherein the image distribution means includes a step of distributing image information taken by the shooting camera device via a communication network.

A performance shooting program for causing a computer to execute the method according to any one of claims 9 to 16.