WO2021117679A1 - Terminal device, control program, information processing device, information processing program, and information processing system - Google Patents

Terminal device, control program, information processing device, information processing program, and information processing system Download PDF

Info

Publication number
WO2021117679A1
WO2021117679A1 PCT/JP2020/045488 JP2020045488W WO2021117679A1 WO 2021117679 A1 WO2021117679 A1 WO 2021117679A1 JP 2020045488 W JP2020045488 W JP 2020045488W WO 2021117679 A1 WO2021117679 A1 WO 2021117679A1
Authority
WO
WIPO (PCT)
Prior art keywords
image pickup
information
information processing
pickup device
terminal device
Prior art date
Application number
PCT/JP2020/045488
Other languages
French (fr)
Japanese (ja)
Inventor
祐哉 木原
慶太 白根
須藤　一郎
Original Assignee
ソニーグループ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニーグループ株式会社 filed Critical ソニーグループ株式会社
Publication of WO2021117679A1 publication Critical patent/WO2021117679A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus

Definitions

  • This technology relates to terminal devices, control programs, information processing devices, information processing programs and information processing systems.
  • a broadcasting station When a broadcasting station produces a news program, for example, it makes a plan for what kind of news to cover, and requests and instructs cameramen to cover it. Based on the plan, the cameraman will interview and obtain the contents of the interview such as video, image, audio, and text. The content of the interview collected in the interview is transmitted to a management server such as a broadcasting station and accumulated, and then a news program video to be edited and broadcast is created.
  • a management server such as a broadcasting station and accumulated
  • Patent Document 1 a file name is automatically assigned to the file to be recorded based on the title information in the interview instruction data, and the work from imaging to importing to the broadcasting station material server is efficiently performed ().
  • This technology was made in view of these points, and provides terminal equipment, control programs, information processing equipment, information processing programs, and information processing systems that can efficiently manage the data acquired by interviews. The purpose.
  • the first technique links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and combines the coverage instruction information with the image pickup device-related information.
  • It is a terminal device including a control unit that controls transmission of associated information to an information processing device.
  • the second technology links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and processes the information in which the coverage instruction information and the image pickup device-related information are linked. It is a control program that causes a computer to execute a control method of a terminal device that controls transmission to the device.
  • the coverage instruction information is transmitted to the terminal device, and the data is received from the image pickup device and the image pickup device based on the image pickup device-related information received from the terminal device and received from the image pickup device.
  • It is an information processing device including a control unit that controls the distribution of data received from an imaging device into groups by associating it with a group that is a data storage destination.
  • the coverage instruction information is transmitted to the terminal device, and the data is received from the image pickup device and the image pickup device based on the image pickup device-related information received from the terminal device and received from the image pickup device.
  • This is an information processing program that causes a computer to execute an information processing method that controls the distribution of data received from an imaging device into groups by associating it with a group that is a data storage destination.
  • the fifth technique links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and processes the information in which the coverage instruction information and the image pickup device-related information are linked.
  • An image pickup device based on a terminal device having a control unit that controls transmission to the device, and image pickup device-related information received from the terminal device by transmitting coverage instruction information to the terminal device and received from the image pickup device by the terminal device. It is an information processing system including an information processing device including a control unit that controls to distribute the data received from the imaging device to the group by associating the information with the group that is the storage destination of the data received from the imaging device.
  • Embodiment> [1-1. Configuration of information processing system 10] [1-2. Configuration of terminal device 100] [1-3. Configuration of image pickup device 200] [1-4. Configuration of information processing device 300] [1-5. Processing in Information Processing System 10] ⁇ 2.
  • Application example of this technology> [2-1. MOJO configuration] [2-2. First aspect of coverage in MOJO] [2-3. Second aspect of coverage in MOJO] ⁇ 3. Modification example>
  • the information processing system 10 includes a terminal device 100, an image pickup device 200, and an information processing device 300.
  • the terminal device 100 and the image pickup device 200 are used by the interviewer who conducts the interview.
  • the information processing device 300 is used in a broadcasting station or the like where an interview instructor such as a director who requests an interviewer works.
  • the terminal device 100 and the information processing device 300, and the image pickup device 200 and the information processing device 300 are connected to each other via a network such as the Internet. Further, the terminal device 100 and the image pickup device 200 are connected and associated with each other by, for example, short-range wireless communication.
  • the terminal device 100 receives the coverage instruction information from the information processing device 300 and presents the coverage instruction information to the interviewer.
  • the interview instruction information is created by the interview instructor and includes the specific contents of the interview instruction such as the interview target and the interview location.
  • the terminal device 100 receives the image pickup device-related information as information about the image pickup device 200 from the image pickup device 200, and transmits the information in which the image pickup device-related information and the coverage instruction information are linked to the information processing device 300. Is responsible for. In the present embodiment, the information related to the image pickup device will be described as the image pickup device identification information for identifying the image pickup device.
  • the image pickup device 200 takes a picture, generates video data and image data as coverage contents, and transmits them to the information processing device 300.
  • the present embodiment will be described by taking as an example a case where video data is transmitted from the image pickup apparatus 200 to the information processing apparatus 300.
  • the information processing device 300 transmits the coverage instruction information to the terminal device 100, and receives the image pickup device-related information from the terminal device 100. Further, the information processing device 300 receives the video data transmitted from the image pickup device 200. In the present embodiment, the information processing device 300 stores the video data transmitted from the image pickup device 200 in the classification of a group associated with the coverage instruction information transmitted from the information processing device 300 to the terminal device 100 in advance.
  • This information processing system 10 is used, for example, in a broadcasting system that broadcasts using video data captured by an imaging device 200.
  • the terminal device 100 includes a control unit 101, a communication unit 102, a storage unit 103, an input unit 104, a display unit 105, a microphone 106, a speaker 107, and a camera 108.
  • the control unit 101 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.
  • the ROM stores a program or the like that is read and operated by the CPU.
  • the RAM is used as the work memory of the CPU.
  • the CPU controls the entire terminal device 100 and each part by executing various processes according to the program stored in the ROM and issuing commands.
  • control unit 101 performs the first reception process of receiving the coverage instruction information transmitted from the information processing device 300 via the communication unit 102.
  • control unit 101 performs a second reception process of receiving the image pickup device identification information transmitted from the image pickup device 200 via the communication unit 102. Then, when the control unit 101 receives the image pickup device identification information, the control unit 101 performs a transmission process of transmitting the information in which the image pickup device-related information and the interview instruction information are linked to the information processing device 300 via the communication unit 102.
  • the communication unit 102 is a communication module for transmitting and receiving data and various information to and from the terminal device 100 and the information processing device 300.
  • Communication methods include wireless LAN (Local Area Network), WAN (Wide Area Network), WiFi (Wireless Fidelity), 4G (4th generation mobile communication system), 5G (5th generation mobile communication system), and Bluetooth (registered trademark). ), ZigBee®, etc., and any method that can connect to the Internet and other devices may be used.
  • the communication between the terminal device 100 and the image pickup device 200 may be short-range wireless communication such as NFC or ZigBee (registered trademark), or tethering connection such as WiFi tethering, USB tethering, or Bluetooth (registered trademark) tethering.
  • the storage unit 103 is a large-capacity storage medium such as a hard disk or a flash memory. Various applications and data used in the terminal device 100 are stored in the storage unit 103.
  • the input unit 104 is for the user to input information and messages to the terminal device 100, perform various instructions, and the like.
  • a control signal corresponding to the input is generated and supplied to the control unit 101.
  • the control unit 101 performs various processes corresponding to the control signal.
  • the input unit 104 includes a touch panel, a touch screen integrally configured with the display as the display unit 105, and the like.
  • the display unit 105 is a display device such as a display that displays images, images, GUIs, and the like. By displaying the interview instruction information on the display unit 105, the interviewer can confirm the content of the interview instruction.
  • the microphone 106 is used by the user to input voice to the terminal device 100.
  • the microphone 106 is also used as a voice input device in a voice call and a video call between the terminal device 100 and the information processing device 300.
  • the speaker 107 is an audio output device that outputs audio messages, video audio, and the like.
  • the speaker 107 is also used as a voice output device in a voice call and a video call between the terminal device 100 and the information processing device 300.
  • the camera 108 is composed of a lens, an image sensor, a video signal processing circuit, and the like, and is for capturing a video or an image.
  • the terminal device 100 is configured as described above. Specific examples of the terminal device 100 include smartphones, tablet terminals, personal computers, wearable devices, portable game machines, and the like.
  • the microphone 106, the speaker 107, and the camera 108 are not indispensable configurations.
  • the image pickup device 200 includes a control unit 201, an optical image pickup system 202, a lens drive driver 203, an image sensor 204, an image signal processing unit 205, an image memory 206, a storage unit 207, a communication unit 208, an input unit 209, a display unit 210, and a microphone. It is configured to include 211.
  • the control unit 201 is composed of a CPU, RAM, ROM, and the like.
  • the CPU controls the entire image pickup apparatus 200 and each part by issuing commands by executing various processes according to the program stored in the ROM.
  • control unit 201 controls the connection with the terminal device 100 via the communication unit 208.
  • control unit 201 performs a process of transmitting the image pickup device identification information used for associating the group in the image pickup device 200 and the information processing device 300 to the terminal device 100 whose communication has been established by pairing via the communication unit 208. ..
  • the image pickup device identification information includes the serial number of the image pickup device 200, the model name, and the like.
  • the identification information may be a device-specific identification number such as IMEI (International Mobile Equipment Identifier), or any information that can identify an individual device, such as ID information dedicated to device identification.
  • IMEI International Mobile Equipment Identifier
  • the optical imaging system 202 includes an imaging lens for concentrating light from a subject on an imaging element 204, a drive mechanism for moving the imaging lens to perform focusing and zooming, a shutter mechanism, an iris mechanism, and the like. There is. These are driven based on the control signals from the control unit 201 and the lens drive driver 203. The optical image of the subject obtained through the optical image pickup system 202 is imaged on the image pickup device 204.
  • the lens drive driver 203 is composed of, for example, a microcomputer or the like, and by moving the image pickup lens by a predetermined amount along the optical axis direction under the control of the control unit 201, autofocus is performed so as to focus on the target subject. Further, according to the control from the control unit 201, the operation of the drive mechanism, the shutter mechanism, the iris mechanism, etc. of the optical imaging system 202 is controlled. As a result, the exposure time (shutter speed) and the aperture value (F value) are adjusted.
  • the image sensor 204 photoelectrically converts the incident light from the subject obtained through the image sensor into an electric charge amount and outputs an image pickup signal. Then, the image sensor 204 outputs the pixel signal to the image signal processing unit 205.
  • a CCD Charge Coupled Device
  • CMOS Complementary Metal Oxide Semiconductor
  • the image signal processing unit 205 is a sample hold for maintaining a good S / N (Signal / Noise) ratio by CDS (Correlated Double Sampling) processing with respect to the image pickup signal output from the image sensor 204, AGC (Auto Gain Control). ) Processing, A / D (Analog / Digital) conversion, etc. are performed to create an image signal. Further, the image signal processing unit 205 performs a recording process on the image signal for recording and a display process on the image signal for display.
  • the image memory 206 is a volatile memory, for example, a buffer memory composed of a DRAM (Dynamic Random Access Memory).
  • the image memory 206 temporarily stores image data that has been subjected to predetermined processing by the image signal processing unit 205.
  • the storage unit 207 is a large-capacity storage medium such as a hard disk or a flash memory.
  • the image signal subjected to image processing for recording by the image signal processing unit 205 is stored in a compressed state or an uncompressed state based on a standard such as JPEG (Joint Photographic Experts Group).
  • JPEG Joint Photographic Experts Group
  • EXIF Exchangeable Image File Format
  • the storage unit 207 stores the image pickup device identification information for identifying the image pickup device 200, which is required when connecting to the terminal device 100 and the information processing device 300.
  • the communication unit 208 is a communication module for transmitting and receiving various data and various information to and from the terminal device 100 and the information processing device 300. Any method may be used for communication as long as it can be connected to the Internet and other devices such as wireless LAN, WAN, WiFi, 4G, 5G, and broadband.
  • Communication between the image pickup device 200 and the terminal device 100 includes short-range wireless communication such as NFC (Near Field Communication) and ZigBee (registered trademark), WiFi tethering, USB (Universal Serial Bus) tethering, Bluetooth (registered trademark) tethering, etc. It may be a tethering connection.
  • short-range wireless communication such as NFC (Near Field Communication) and ZigBee (registered trademark), WiFi tethering, USB (Universal Serial Bus) tethering, Bluetooth (registered trademark) tethering, etc. It may be a tethering connection.
  • the interviewer is aware of the image pickup device used for the interview, so that the interview instruction information and the interview instruction information are surely displayed.
  • the image pickup device 200 and the group can be linked, and it is possible to prevent the image pickup device to be paired from being mistaken.
  • the input unit 209 is for the user to give various instructions to the image pickup apparatus 200.
  • a control signal corresponding to the input is generated and supplied to the control unit 201.
  • the control unit 201 performs various processes corresponding to the control signal.
  • the input unit 209 includes a shutter button for shutter input, a physical button for various operations, a touch panel, a touch screen integrally configured with a display as a display unit 210, and the like.
  • the display unit 210 is a through image which is an image signal for display that has been processed for display by the image signal processing unit 205, and has been subjected to image processing for recording by the image signal processing unit 205 and stored in the storage unit 207. It is a display device such as a display that displays the image / video, GUI (Graphical User Interface), and the like.
  • the microphone 211 is for recording audio in video recording.
  • the image pickup device 200 is configured as described above.
  • the image pickup device 200 includes devices specialized in camera functions such as digital cameras, single-lens reflex cameras, camcorders, professional cameras, and professional photography devices, as well as smartphones, tablet terminals, wearable devices, portable game machines, etc. equipped with camera functions. It may be.
  • the information processing device 300 includes a control unit 301, a communication unit 302, and a storage unit 303.
  • the control unit 301 is composed of a CPU, RAM, ROM, and the like.
  • the CPU controls the entire information processing apparatus 300 and each part by executing various processes according to the program stored in the ROM and issuing commands.
  • the communication unit 302 is a communication module for communicating with the terminal device 100 and the image pickup device 200.
  • Communication methods include wireless LAN, WAN, WiFi, 4G, 5G, Bluetooth (registered trademark), ZigBee (registered trademark), and the like.
  • the storage unit 303 is a large-capacity storage medium such as a hard disk or a flash memory.
  • the video data transmitted from the image pickup apparatus 200 is sorted into groups in the storage unit 303 and stored.
  • the control unit 301 performs a transmission process of transmitting the coverage instruction information to the terminal device 100 via the communication unit 302.
  • the interview instruction information is created by the interview instructor, and in addition to the specific contents of the interview such as the subject of the interview and the location of the interview, the group ID, the interviewer ID, the interview instruction ID, and the interview instruction corresponding to the interview instruction information. It includes a person ID and the like.
  • the timing of transmitting the interview instruction information may be immediately after the interview requester creates the interview instruction information, or may be when the interview instructor instructs the information processing apparatus 300 to transmit the interview instruction information, or the transmission time may be set in advance.
  • the information processing device 300 may set and automatically transmit.
  • the group ID is information for identifying a group that sorts and saves the video data transmitted from the imaging device 200 for each coverage instruction information.
  • the interviewer ID, the interview instruction ID, and the interview instructor ID are information for identifying the interviewer, the interview instruction, and the interview instructor, respectively.
  • control unit 301 performs the first reception process of receiving the image pickup device identification information transmitted from the terminal device 100 via the communication unit 402.
  • control unit 301 performs a second reception process of receiving the video data transmitted from the image pickup apparatus 200 via the communication unit 302.
  • the received video data is distributed to a group associated with the image pickup apparatus 200 and stored in the storage unit 303.
  • the control unit 301 sets a plurality of groups in the storage unit 303.
  • the storage unit 303 stores the video data transmitted from the image pickup device 200 in the classification of the group that is associated with the coverage instruction information transmitted from the information processing device 300 to the terminal device 100 in advance. Groups can be realized by mechanisms such as folders and directories. Further, it may be realized by using a plurality of physically different storage devices and grouping the individual storage devices.
  • the image pickup device identification information received from the terminal device 100 is also stored in the storage unit 303.
  • the control unit 301 decides in which group the video data created by the interview based on the interview instruction information is to be saved, and the control unit 301 is based on the input from the interview instructor. Set up a group.
  • control unit 301 receives the image pickup device identification information from the terminal device 100 in the first reception process, the control unit 301 receives the group corresponding to the coverage instruction information and the image pickup device transmitted from the terminal device 100 that has received the coverage instruction information. A process of associating with the image pickup apparatus 200 indicated by the identification information is performed. As a result, all the video data transmitted from the image pickup apparatus 200 is distributed and stored in the group associated with the image pickup apparatus 200.
  • control unit 301 when the control unit 301 receives the video data from the image pickup device 200 in the second reception process, the control unit 301 performs a process of distributing the video data to the group associated with the image pickup device 200 which is the transmission source of the video data.
  • the received video data is sorted into groups in the storage unit 303 and stored.
  • the image pickup device 200 may transmit identification information indicating that the source of the video data is the image pickup device 200 associated with the group to the information processing device 300 together with the video data. Good.
  • the video data is edited by an external video processing device or the like that performs a predetermined editing process for broadcasting.
  • the information processing device 300 is configured as described above.
  • the information processing device 300 is composed of a program, and the program may be installed in a server or the like in advance, or may be distributed as a download or a storage medium so that the user can install the program on the server or the like by himself / herself. Further, the part that performs the processing of the information processing apparatus 300 may be configured on the cloud. Further, the information processing device 300 is not only realized by a program, but may also be realized by combining a dedicated device, a circuit, or the like by hardware having the function.
  • the information processing device 300 transmits the coverage instruction information to the terminal device 100, and the terminal device 100 receives the coverage instruction information in step S102.
  • group A, group B, and group C are set in advance in the storage unit 303 of the information processing device 300, and the coverage instruction information is set to correspond to group A. To do. As described above, the association between the interview instruction information and the group needs to be set when the interview instructor creates the interview instruction information.
  • step S103 the connection is established by pairing between the image pickup device 200 and the terminal device 100.
  • the interviewer confirms the interview instruction information on the terminal device 100
  • the interviewer pairs the image pickup device 200 used for performing the interview with the terminal device 100.
  • Pairing can be performed by bringing devices having an NFC function into contact with each other, for example, when NFC is used.
  • pairing is performed by exchanging necessary information such as an authentication code, a session key, an SSID (Service Set Identifier), and identification information such as a serial number between devices.
  • the image pickup apparatus 200 and the terminal apparatus 100 are paired to establish short-range wireless communication.
  • the image pickup device 200 When the communication between the image pickup device 200 and the terminal device 100 is established, the image pickup device 200 then transmits the image pickup device identification information to the terminal device 100 as shown in step S104, and the terminal device 100 sends the image pickup device identification information in step S105. To receive.
  • step S106 the terminal device 100 transmits the information in which the coverage instruction information and the image pickup device identification information are linked to the information processing device 300.
  • step S107 the information processing device 300 receives the information in which the coverage instruction information and the image pickup device identification information are associated with each other.
  • the information processing device 300 performs a process of associating the image pickup device 200 with the group based on the image pickup device identification information.
  • the information processing device 300 receives an image pickup by receiving the image pickup device identification information of the image pickup device 200 associated with the coverage instruction information from the terminal device 100 that has received the coverage instruction information associated with the group A.
  • the device 200 and the group A are linked. As a result, all the video data transmitted from the image pickup apparatus 200 is distributed to the group A in the information processing apparatus 300 and stored.
  • step S109 when the image pickup device 200 takes a picture and the video data is created, the image pickup device 200 transmits the video data to the information processing device 300 in step S110.
  • the interviewer and the image pickup apparatus 200 need not be aware that the storage destination of the video data is the group A, and it is sufficient that the interviewer and the image pickup apparatus 200 are aware that the video data is transmitted to the information processing apparatus 300.
  • step S111 the information processing device 300 receives the video data.
  • step S112 the information processing device 300 distributes the video data to the group A associated with the image pickup device 200 in advance and stores it.
  • the processing of the information processing system 10 in the present technology is performed as described above.
  • the interviewer and the image pickup apparatus 200 can distribute and save the video data into groups simply by transmitting the video data to the information processing apparatus 300 without being aware that the storage destination of the video data is a specific group. it can. This makes it possible to prevent the video data from being accidentally saved in a different group. Further, since it is not necessary to select the transmission destination group on the image pickup apparatus 200 side, the transmission and management of the video data becomes easy.
  • MOJO is journalism in which journalists and the general public use terminal devices to conduct interviews and reports. With the spread of terminal devices such as the Internet and smartphones, even ordinary citizens or freelance journalists who do not have dedicated imaging devices or video editing devices can easily shoot, edit, and provide news materials by using the applications in the terminal devices. MOJO enables more immediate coverage than before.
  • Coverage and coverage in MOJO format consists of, for example, journalists 1000, broadcasting stations 2000, and servers 3000.
  • the broadcasting station 2000, the server 3000, and the imaging device 200 and the terminal device 100 used by the journalist 1000 are connected via a network such as the Internet.
  • the terminal device 100, the image pickup device 200, and the information processing device 300 are the same as those described in the embodiment.
  • Journalist 1000 is a person who goes to the interview destination, which is the site of the incident, conducts interviews, and provides the contents of the interview (video data, image data, audio data, text, etc.) to the broadcasting station 2000.
  • the journalist 1000 interviews using the imaging device 200 and / or the terminal device 100.
  • Broadcasting station 2000 is a business entity and / or equipment that gives an instruction for coverage to journalist 1000, edits the content of coverage provided by journalist 1000, and broadcasts it.
  • the server 3000 is an information processing device 300 according to the present technology, and is also responsible for transmitting and receiving information, data, instructions, and the like between the broadcasting station 2000 and the journalist 1000.
  • the server 3000 may be managed and operated by the broadcasting station 2000 itself or an affiliated company or an affiliated organization of the broadcasting station 2000, or may be managed and operated by a company other than the broadcasting station 2000 and used by the broadcasting station 2000. Good.
  • the server 3000 (information processing device 300) is configured to include a control unit 301, a communication unit 302, and a storage unit 303.
  • the control unit 301 is composed of a CPU, a RAM, a ROM, and the like, and the CPU controls the entire information processing device 300 and each unit by executing various processes according to a program stored in the ROM and issuing a command. ..
  • the communication unit 302 is a communication module for transmitting and receiving various data, various information, and the like to and from the image pickup device 200 and the terminal device 100.
  • Communication methods include wireless LAN, WAN, WiFi, 4G, 5G and the like.
  • the storage unit 303 stores and manages received video data, identification information and functional information of the imaging device 200 and the terminal device 100, video data, and the like.
  • the information processing device 300 may transmit the video data stored in the storage unit 303 as an archive to the image pickup device 200 and the terminal device 100 as needed or requested.
  • Broadcasting station 2000 has at least a control room 2100 and a studio 2200.
  • producers, directors, assistant directors, cameramen, etc. hereinafter collectively referred to as staff
  • broadcasting station 2000 perform work for program broadcasting.
  • the control room 2100 includes at least a control unit 2101, a switcher 2102, a monitor 2103, and a communication unit 2104.
  • the control unit 2101 controls each part and the whole of the control room 2100.
  • the control unit 2101 also transmits and receives video data and the like between the switcher 2102 and the monitor 2103, and also transmits and receives video data and the like between the control room 2100 and the CCU 2201 (Camera Control Unit) of the studio 2200.
  • the switcher 2102 is a device that switches or mixes a plurality of input signals, and is used by, for example, a staff member in charge of switching operations of images displayed on the monitor 2103.
  • the monitor 2103 is a display device that displays various images such as an image before broadcasting, an image for broadcasting, and an image that has been processed for broadcasting.
  • Studio 2200 is equipped with at least CCU2201 and Camera 2202.
  • the CCU 2201 processes and outputs an image captured by the camera 2202, or transmits image data or the like.
  • the camera 2202 captures a caster or the like reporting in the studio 2200.
  • the coverage instruction information and the coverage information are transmitted from the broadcasting station 2000 to the journalist 1000 via the server 3000.
  • the coverage information includes, for example, a date, a journalist's ID, a coverage ID, a coverage location, a title, setting information of an imaging device, and the like.
  • the journalist 1000 transmits the interview contents to the broadcasting station 2000 via the server 3000.
  • the content of the interview includes, for example, video, still image, audio, text, etc. obtained by the interview.
  • the staff composes, records, edits, etc. the program based on the interview contents sent from the journalist 1000, and broadcasts the interview contents in the program.
  • Journalists at MOJO include citizen journalists (citizen journalists), video journalists, and broadcast journalists.
  • Video journalists are staff members of broadcasting station 2000, freelance journalists, etc., and their profession is to provide broadcasting station 2000 with images taken with devices that are more portable than professional photography equipment such as smartphones and digital cameras. Is the one who is. Therefore, video journalists can report faster than broadcast journalists.
  • a broadcast journalist is a staff member of a broadcasting station 2000, a freelance journalist, etc., who is professionally engaged in providing a video shot using a professional shooting device to a broadcasting station 2000. Since professional photography equipment is heavier and larger than terminal devices 100 such as smartphones and imaging devices 200 such as general digital cameras, it arrives at the scene of the incident and starts coverage compared to citizen journalists and video journalists. It takes time. However, since it is shot with a professional shooting device, it is possible to provide detailed coverage with higher image quality than the images shot by citizen journalists and video journalists.
  • FIG. 9 is a first coverage mode of MOJO in which broadcasting is performed based on coverage of a video journalist who uses the terminal device 100 and a broadcast journalist who uses the image pickup device 200 as a professional photography device.
  • this first interview mode when the broadcasting station 2000 learns of the occurrence of the incident, it requests the interview from the video journalist and the broadcast journalist via the server 3000 or directly.
  • the video journalist who received the interview request shoots, edits, etc. as an interview using the terminal device 100.
  • the terminal device 100 is more portable and portable than the professional photography device
  • the video journalist arrives at the incident site earlier than the broadcast journalist who uses the professional photography device. You can do the interview.
  • the broadcasting station 2000 can request a video journalist who is near the scene of the incident and has the terminal device 100 to interview the video journalist as it is.
  • it takes more time to prepare the professional photography equipment than the terminal device 100 it is considered that it may be slower to arrive at the incident site and interview than the broadcast journalist.
  • the video journalist using the terminal device 100 transmits the video data, which is the content of the interview, to the broadcasting station 2000 via the server 3000 when the shooting and editing at the incident occurrence site are completed.
  • the broadcasting station 2000 that has received the video data reports the first report using the video taken by the terminal device 100. This enables more immediate coverage than when only conventional professional photography equipment is used.
  • Such an interview method is suitable for reporting the content of an incident in real time, for example, when an incident occurs during a live broadcast such as a news program broadcast during the day.
  • the video journalist who uses the terminal device 100 can continue shooting as it is at the scene where the incident occurs. Further, the case where the terminal device 100 transmits the edited video data to the broadcasting station 2000 as the content of the interview is shown.
  • the editing performed by the terminal device 100 may be a process for broadcasting, or a video journalist may use it. Only the text data such as the coverage memo may be transmitted to the broadcasting station 2000 as the coverage content together with the video, and the broadcasting station 2000 may edit the processing for broadcasting or the like.
  • a broadcast journalist using professional shooting equipment sends video data to the broadcasting station 2000 via the server 3000 when shooting and editing at the scene of the incident is completed.
  • the broadcasting station 2000 that has received the video data uses the video data to make further reports after the first report. Since the professional shooting device has higher performance than the terminal device 100, it is possible to perform detailed reporting with higher image quality than the image shot by the terminal device 100.
  • Such an interview method is suitable for, for example, to additionally interview an incident interviewed by a video journalist during the day and to broadcast more detailed contents in an evening or evening news program. However, the content may be the original coverage of a broadcast journalist different from the video journalist. Broadcast journalists can also continue shooting at the scene of the incident.
  • FIG. 10 shows a second coverage mode of MOJO in which broadcasting is performed based on coverage of a citizen journalist who uses the terminal device 100 and a broadcast journalist who uses the image pickup device 200 as a professional photography device.
  • an external server 4000 for providing services on the Internet which is different from the server 3000 used by the broadcasting station 2000.
  • Services on the Internet include various SNS (Social Network Service), video distribution sites, blog sites, and Internet TV.
  • the Citizen journalist who encountered the incident takes a picture as an interview using the terminal device 100.
  • the terminal device 100 is superior in portability, portability, and communication function as compared with professional photography equipment, it is considered that citizen journalists can post and provide coverage earlier than broadcast journalists. .. Citizen journalists may also attach text to the footage they shoot. In some cases, the video captured by a citizen journalist may be edited in the server of the broadcasting station 2000 or the broadcasting station 2000.
  • Broadcasting station 2000 regularly searches SNS, video distribution sites, blog sites, etc., and when it finds out that a citizen journalist is posting an incident on the Internet, he requests the citizen journalist to provide information and posts the content. get.
  • the broadcasting station 2000 that acquired the posted content reports using the posted content. This enables more immediate coverage than the coverage and coverage of video and broadcast journalists.
  • the broadcasting station 2000 may request a citizen journalist to receive the supply of coverage contents such as video data in real time. This makes it possible to perform real-time coverage (live broadcasting) using images taken by Citizen journalists.
  • a broadcast journalist using a professional shooting device transmits video data to the broadcasting station 2000 via the server 3000 when shooting and editing are completed.
  • the broadcasting station 2000 that has received the video data uses the video taken by the camera to make further reports after the first report. Since the professional shooting device has higher performance than the terminal device 100, it is possible to perform detailed reporting with higher image quality than the image shot by the terminal device 100.
  • the broadcasting station 2000 can also perform real-time reporting (live broadcasting) using images transmitted from broadcast journalists.
  • the interviewer and the image pickup apparatus 200 simply transmit the video data to the server 3000 (information processing apparatus 300) without being aware that the storage destination of the video data is a specific group, and the video data is grouped. It can be sorted and saved. As a result, it is possible to prevent the video data from being accidentally saved in a different group, and it is also possible to carry out prompt reporting. Further, since it is not necessary to select the transmission destination group on the image pickup apparatus 200 side, the transmission and management of the video data becomes easy.
  • the journalist 1000 (citizen journalist, video journalist, and broadcast journalist) possesses an image pickup device 200 and a terminal device 100, and shoots and edits with the image pickup device 200 at the incident occurrence site. Then, the video data is transmitted to the broadcasting station 2000 via the server 3000. Broadcasting station 2000 broadcasts using video data. It is also possible to give instructions, consultations, meetings, etc. between the broadcasting station 2000 and the journalist 1000 by voice call.
  • the device to be paired with the terminal device 100 is not limited to the camera, but may be a personal computer, a smartphone, a tablet terminal, a wearable device, a voice recorder, a sensor device, or the like.
  • one coverage instruction information is transmitted from the information processing device 300 to the terminal device 100, but there may be a plurality of coverage instruction information.
  • the terminal device 100 presents the plurality of interview instruction information to the interviewer, and after the interviewer selects the interview instruction information, the terminal device 100 and the image pickup device 200 are paired. May be good.
  • the interviewer selects one of the plurality of interview instruction information to perform pairing of the terminal device 100 and one image pickup device 200, and further, another interview instruction among the plurality of interview instruction information. Information may be selected to pair the terminal device 100 with another imaging device. As a result, one terminal device 100 can link a plurality of image pickup devices to a group.
  • imaging devices 200 it is also possible to link a plurality of imaging devices 200 to one interview instruction information.
  • two different imaging devices 200 that is, a smartphone for simple shooting and a professional camera, both video data can be distributed to the same group and saved.
  • the image data is directly transmitted from the image pickup device 200 to the information processing device 300, but the image pickup device 200 transmits the video data to the terminal device 100, and the terminal device 100 transmits the video data to the information processing device 300. You may do so.
  • the information processing device 300 itself has been described as including the communication unit 302 and the storage unit 303, but the information processing device operates in the communication unit and the server device including the storage unit, and the communication unit and the communication unit of the server device and the information processing device 300 operate.
  • a storage unit may be used.
  • the image pickup device 200 transmits the image pickup device function information, which is information indicating its own function, to the terminal device 100 as the image pickup device-related information in addition to the image pickup device identification information, and the terminal device 100 images the information processing device 300.
  • the device function information may be transmitted.
  • the information processing device 300 receives the image pickup device function information, the information processing device 300 performs various processes according to the function of the image pickup device 200.
  • the image pickup device function information includes resolution information (4K, 8K, etc.) indicating the resolution of an image that can be captured by the image pickup device 200, communication function information of the image pickup device (4G / LTE (Long Term Evolution) support, 5G support, etc.), etc. There is.
  • the image pickup device function information is stored in the control unit 201 of the image pickup device 200 as well as the image pickup device identification information.
  • the information processing device 300 uses a transcoder for performing transcoding processing on the image image data. Perform processing such as starting in advance before receiving. This enables quick video processing.
  • the image pickup device function information is information indicating the communication function of the image pickup device 200
  • the communication between the image pickup device 200 and the information processing device 300 may be switched to a communication method using MEC (Mobile Edge Computing).
  • MEC Mobile Edge Computing
  • MEC Mobile Edge Computing
  • the image pickup apparatus 200 and the information processing apparatus 300 communicate with each other via the image processing apparatus 200 and the information processing apparatus 300.
  • processing such as selecting the communication band between the image pickup device 200 and the information processing device 300 or changing the processor may be performed according to the communication method indicated by the image pickup device function information.
  • the communication environment between the image pickup device 200 and the base station is a low-speed communication method (4G / LTE, 3G, etc.) or is higher than the low-speed low-capacity communication method.
  • Whether or not it is a high-speed high-capacity communication method (for example, 5G) capable of high-speed and high-capacity communication may be determined based on information indicating a communication environment.
  • the information indicating the communication environment is, for example, information indicating a communication method established between the image pickup apparatus 200 and the base station, which is transmitted by the imaging apparatus 200 to the information processing apparatus 300 via the base station. It may be.
  • other information transmitted from the image pickup apparatus 200 to the information processing apparatus 300 may include information indicating this communication environment.
  • the information indicating the communication environment is the position information indicating the position of the image pickup device 200, and the information processing device 300 may acquire the position information of the image pickup device 200.
  • the control unit 301 of the information processing device 300 determines the communication environment at the position of the terminal device 100 indicated by the acquired position information by referring to the communication area map stored in advance.
  • the control unit 301 of the information processing device 300 virtualizes the network, divides (slices) network resources, and uses signals for communication.
  • the communication unit 302 is controlled so as to use a network slicing technique that uses different slices according to the priority.
  • the video processing unit of the information processing device 300 improves (up-converts) the resolution of the video when the communication environment determined by the control unit 301 is a low-speed low-capacity communication method (4G / LTE, 3G, etc.). Can also be done. That is, when the communication environment determined by the control unit 301 is a low-speed low-capacity communication method (for example, 4G / LTE, 3G, etc.), the image processing unit of the information processing device 300 determines the resolution of the video data (the image pickup device 200 It is the resolution of the captured image, and is converted into a high resolution (for example, high resolution such as 4K or 8K) image by performing a resolution conversion process for improving the resolution (for example, low resolution such as HD).
  • a high resolution for example, high resolution such as 4K or 8K
  • the video processing unit of the information processing device 300 performs frame rate conversion processing on the video data according to the communication environment of the imaging device 200.
  • the video processing unit of the information processing device 300 improves (up-converts) the frame rate of the video when the communication environment determined by the control unit 301 is a low-speed low-capacity communication method (4G / LTE, 3G, etc.). Conversion processing can be performed. That is, the video processing unit of the information processing device 300 has a frame rate of video data (imaging device 200) when the communication environment determined by the control unit 301 is a low-speed low-capacity communication method (for example, 4G / LTE, 3G, etc.).
  • the frame rate of the captured image is converted into a high frame rate (for example, a high frame rate such as 120p) by performing a frame rate conversion process for improving the frame rate (for example, a low frame rate such as 30p).
  • a high frame rate for example, a high frame rate such as 120p
  • a frame rate conversion process for improving the frame rate for example, a low frame rate such as 30p.
  • the video processing unit of the information processing apparatus 300 has described an example in which the resolution conversion process and the frame rate conversion process are performed individually, but the resolution conversion process and the frame rate conversion process may be performed together. It is possible.
  • the video processing unit performs a frame rate conversion process for lowering (down-converting) the frame rate of the video when the communication environment determined by the control unit 301 is a low-speed low-capacity communication method (4G / LTE, 3G, etc.).
  • a frame rate conversion process for improving (up-converting) the frame rate of the video can be performed. That is, when the communication environment determined by the control unit 301 is a high-speed high-capacity communication method (for example, 5G), the video processing unit of the information processing device 300 has a frame rate of video data (a video image captured by the image pickup device 200).
  • the frame rate is converted into a high frame rate (for example, a high frame rate such as 120p) by performing a frame rate conversion process for improving the frame rate (for example, a low frame rate such as 30p).
  • a high frame rate for example, a high frame rate such as 120p
  • a frame rate conversion process for improving the frame rate for example, a low frame rate such as 30p.
  • the video processing unit of the information processing apparatus 300 has described an example in which the resolution conversion process and the frame rate conversion process are performed individually, but the resolution conversion process and the frame rate conversion process may be performed together. It is possible.
  • the present technology can also have the following configurations.
  • Control that links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and transmits the information linking the coverage instruction information and the image pickup device-related information to the information processing device.
  • a terminal device including a control unit for performing information processing.
  • the information processing device according to (3), wherein the functional information is resolution information of an image that can be captured by the image pickup device.
  • the information processing device according to (3), wherein the functional information is information indicating a communication method of the image pickup device.
  • the information processing device according to any one of (1) to (5), wherein data is transmitted from the image pickup device to the information processing device.
  • a control that links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and transmits the information linking the coverage instruction information and the image pickup device-related information to the information processing device.
  • a control program that causes a computer to execute a control method for a terminal device that performs the above.
  • Send coverage instruction information to the terminal device Based on the image pickup device-related information received from the terminal device and received from the image pickup device by the terminal device, the image pickup device is associated with the group in which the data received from the image pickup device is stored, and the image pickup device is linked.
  • An information processing device including a control unit that controls distribution of data received from the data to the group.
  • the image pickup device-related information is functional information of the image pickup device.
  • the functional information is information indicating a communication method of the image pickup device.
  • the information processing apparatus according to (13), wherein the predetermined communication method is a fifth generation mobile communication system.
  • the functional information is resolution information of an image that can be captured by the image pickup device.
  • the transcoder is activated in advance when the functional information is the resolution information.
  • Send coverage instruction information to the terminal device Based on the image pickup device-related information received from the terminal device and received from the image pickup device by the terminal device, the image pickup device is associated with the group in which the data received from the image pickup device is stored, and the image pickup device is linked.
  • An information processing program that causes a computer to execute an information processing method that controls distribution of data received from a computer to the group.
  • Control that links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and transmits the information linking the coverage instruction information and the image pickup device-related information to the information processing device.
  • a terminal device equipped with a control unit that performs information processing The coverage instruction information is transmitted to the terminal device, Based on the image pickup device-related information received from the terminal device and received from the image pickup device by the terminal device, the image pickup device is associated with the group in which the data received from the image pickup device is stored, and the image pickup device is linked.
  • An information processing system including an information processing device including a control unit that controls distribution of data received from the above groups.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Studio Devices (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

A terminal device according to the present invention comprises a control unit that performs control so that story instruction information received from an information processing device is associated with imaging-device-related information received from an imaging device, and information associating the story instruction information and the imaging-device-related information is sent to the information processing device.

Description

端末装置、制御プログラム、情報処理装置、情報処理プログラムおよび情報処理システムTerminal devices, control programs, information processing devices, information processing programs and information processing systems
　本技術は、端末装置、制御プログラム、情報処理装置、情報処理プログラムおよび情報処理システムに関する。 This technology relates to terminal devices, control programs, information processing devices, information processing programs and information processing systems.
　放送局が例えばニュース番組を制作する場合、どのようなニュースを取材するかの計画を立て、カメラマンなどに取材の依頼、指示を行う。その計画に基づいて、カメラマンにより取材がなされ、映像、画像、音声、テキストなどの取材内容が得られる。取材で収集された取材内容は放送局などの管理用サーバに送信されて蓄積され、その後、編集されて放送されるニュース番組映像が作成される。 When a broadcasting station produces a news program, for example, it makes a plan for what kind of news to cover, and requests and instructs cameramen to cover it. Based on the plan, the cameraman will interview and obtain the contents of the interview such as video, image, audio, and text. The content of the interview collected in the interview is transmitted to a management server such as a broadcasting station and accumulated, and then a news program video to be edited and broadcast is created.
　そのような取材においては、取材からニュース番組放送までの時間の短さ、取材内容の量の多さなどから取材で取得したデータの送信や管理の効率化が求められている。そこで取材指示データ内のタイトル情報に基づいて収録されるファイルに対するファイル名が自動的に付与され、撮像から放送局素材サーバへの取込み処理までの作業を効率的に行う技術が提案されている（特許文献１） In such interviews, it is required to improve the efficiency of transmission and management of the data acquired in the interviews due to the short time from the interviews to the broadcast of news programs and the large amount of contents of the interviews. Therefore, a technology has been proposed in which a file name is automatically assigned to the file to be recorded based on the title information in the interview instruction data, and the work from imaging to importing to the broadcasting station material server is efficiently performed (). Patent Document 1)
特開２００９－２５２３１６号公報JP-A-2009-252316
　近年、放送局所属のカメラマンだけでなく、フリーランスのカメラマンが取材を行うケースも増えてきている。フリーランスのカメラマンにおいては自身が所有するカメラを使用する場合もあれば、放送局のカメラを使用する場合もあり、さらにレンタルしたカメラを使用する場合もある。そのような状況ではカメラマンが使用するカメラおよびそのカメラで撮影した映像データ等の送信を確実に行うことやその映像データ等の管理が難しく、効率化が求められている。 In recent years, not only cameramen belonging to broadcasting stations but also freelance cameramen are increasing the number of cases of interviews. Freelance photographers may use their own cameras, broadcasters' cameras, or even rented cameras. In such a situation, it is difficult to reliably transmit the camera used by the cameraman and the video data taken by the camera, and to manage the video data, etc., and efficiency is required.
　本技術はこのような点に鑑みなされたものであり、取材により取得したデータを効率よく管理することができる端末装置、制御プログラム、情報処理装置、情報処理プログラムおよび情報処理システムを提供することを目的とする。 This technology was made in view of these points, and provides terminal equipment, control programs, information processing equipment, information processing programs, and information processing systems that can efficiently manage the data acquired by interviews. The purpose.
　上述した課題を解決するために、第１の技術は、情報処理装置から受信した取材指示情報と、撮像装置から受信した撮像装置関連情報とを紐付け、取材指示情報と撮像装置関連情報とを紐付けた情報を情報処理装置に送信する制御を行う制御部を備える端末装置である。 In order to solve the above-mentioned problems, the first technique links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and combines the coverage instruction information with the image pickup device-related information. It is a terminal device including a control unit that controls transmission of associated information to an information processing device.
　また、第２の技術は、情報処理装置から受信した取材指示情報と、撮像装置から受信した撮像装置関連情報とを紐付け、取材指示情報と撮像装置関連情報とを紐付けた情報を情報処理装置に送信する制御を行う端末装置の制御方法をコンピュータに実行させる制御プログラムである。 In addition, the second technology links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and processes the information in which the coverage instruction information and the image pickup device-related information are linked. It is a control program that causes a computer to execute a control method of a terminal device that controls transmission to the device.
　また、第３の技術は、端末装置に取材指示情報を送信し、端末装置から受信した、該端末装置が撮像装置から受信した撮像装置関連情報に基づいて、撮像装置と該撮像装置から受信したデータの保存先であるグループとを紐付けて、撮像装置から受信したデータをグループに振り分ける制御を行う制御部を備える情報処理装置である。 Further, in the third technique, the coverage instruction information is transmitted to the terminal device, and the data is received from the image pickup device and the image pickup device based on the image pickup device-related information received from the terminal device and received from the image pickup device. It is an information processing device including a control unit that controls the distribution of data received from an imaging device into groups by associating it with a group that is a data storage destination.
　また、第４の技術は、端末装置に取材指示情報を送信し、端末装置から受信した、該端末装置が撮像装置から受信した撮像装置関連情報に基づいて、撮像装置と該撮像装置から受信したデータの保存先であるグループとを紐付けて、撮像装置から受信したデータをグループに振り分ける制御を行う情報処理方法をコンピュータに実行させる情報処理プログラムである。 Further, in the fourth technique, the coverage instruction information is transmitted to the terminal device, and the data is received from the image pickup device and the image pickup device based on the image pickup device-related information received from the terminal device and received from the image pickup device. This is an information processing program that causes a computer to execute an information processing method that controls the distribution of data received from an imaging device into groups by associating it with a group that is a data storage destination.
　また、第５の技術は、情報処理装置から受信した取材指示情報と、撮像装置から受信した撮像装置関連情報とを紐付け、取材指示情報と撮像装置関連情報とを紐付けた情報を情報処理装置に送信する制御を行う制御部を備える端末装置と、端末装置に取材指示情報を送信し、端末装置から受信した、該端末装置が撮像装置から受信した撮像装置関連情報に基づいて、撮像装置と該撮像装置から受信したデータの保存先であるグループとを紐付けて、撮像装置から受信したデータをグループに振り分ける制御を行う制御部を備える情報処理装置とからなる情報処理システムである。 Further, the fifth technique links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and processes the information in which the coverage instruction information and the image pickup device-related information are linked. An image pickup device based on a terminal device having a control unit that controls transmission to the device, and image pickup device-related information received from the terminal device by transmitting coverage instruction information to the terminal device and received from the image pickup device by the terminal device. It is an information processing system including an information processing device including a control unit that controls to distribute the data received from the imaging device to the group by associating the information with the group that is the storage destination of the data received from the imaging device.
情報処理システム１０の構成を示すブロック図である。It is a block diagram which shows the structure of an information processing system 10. 端末装置１００の構成を示すブロック図である。It is a block diagram which shows the structure of the terminal apparatus 100. 撮像装置２００の構成を示すブロック図である。It is a block diagram which shows the structure of the image pickup apparatus 200. 情報処理装置３００の構成を示すブロック図である。It is a block diagram which shows the structure of the information processing apparatus 300. 情報処理システム１０における処理を示すシーケンス図である。It is a sequence diagram which shows the process in an information processing system 10. 情報処理システム１０における処理の説明図である。It is explanatory drawing of the process in an information processing system 10. 情報処理システム１０における処理の説明図である。It is explanatory drawing of the process in an information processing system 10. ＭＯＪＯの構成の一例を示すブロック図である。It is a block diagram which shows an example of the structure of MOJO. ＭＯＪＯにおける取材の第１の態様の説明図である。It is explanatory drawing of the 1st aspect of coverage in MOJO. ＭＯＪＯにおける取材の第２の態様の説明図である。It is explanatory drawing of the 2nd aspect of coverage in MOJO.
　以下、本技術の実施の形態について図面を参照しながら説明する。なお、説明は以下の順序で行う。
＜１．実施の形態＞
［１－１．情報処理システム１０の構成］
［１－２．端末装置１００の構成］
［１－３．撮像装置２００の構成］
［１－４．情報処理装置３００の構成］
［１－５．情報処理システム１０における処理］
＜２．本技術の応用例＞
［２－１．ＭＯＪＯの構成］
［２－２．ＭＯＪＯにおける取材の第１の態様］
［２－３．ＭＯＪＯにおける取材の第２の態様］
＜３．変形例＞ Hereinafter, embodiments of the present technology will be described with reference to the drawings. The explanation will be given in the following order.
<1. Embodiment>
[1-1. Configuration of information processing system 10]
[1-2. Configuration of terminal device 100]
[1-3. Configuration of image pickup device 200]
[1-4. Configuration of information processing device 300]
[1-5. Processing in Information Processing System 10]
<2. Application example of this technology>
[2-1. MOJO configuration]
[2-2. First aspect of coverage in MOJO]
[2-3. Second aspect of coverage in MOJO]
<3. Modification example>
＜１．実施の形態＞
［１－１．情報処理システム１０の構成］
　まず、図１を参照して情報処理システム１０の構成について説明する。情報処理システム１０は端末装置１００、撮像装置２００および情報処理装置３００とから構成されている。端末装置１００と撮像装置２００は取材を行う取材者が使用するものである。情報処理装置３００は取材者に取材を依頼するディレクターなどの取材指示者が勤務する放送局などにおいて使用されるものである。 <1. Embodiment>
[1-1. Configuration of information processing system 10]
First, the configuration of the information processing system 10 will be described with reference to FIG. The information processing system 10 includes a terminal device 100, an image pickup device 200, and an information processing device 300. The terminal device 100 and the image pickup device 200 are used by the interviewer who conducts the interview. The information processing device 300 is used in a broadcasting station or the like where an interview instructor such as a director who requests an interviewer works.
　端末装置１００と情報処理装置３００、撮像装置２００と情報処理装置３００はそれぞれインターネットなどのネットワークを介して接続されている。また、端末装置１００と撮像装置２００は例えば近距離無線通信などにより接続され、対応付けられる。 The terminal device 100 and the information processing device 300, and the image pickup device 200 and the information processing device 300 are connected to each other via a network such as the Internet. Further, the terminal device 100 and the image pickup device 200 are connected and associated with each other by, for example, short-range wireless communication.
　端末装置１００は情報処理装置３００から取材指示情報を受信して取材指示情報を取材者に提示するものである。取材指示情報は取材指示者によって作成され、取材対象や取材場所など具体的な取材指示の内容を含むものである。 The terminal device 100 receives the coverage instruction information from the information processing device 300 and presents the coverage instruction information to the interviewer. The interview instruction information is created by the interview instructor and includes the specific contents of the interview instruction such as the interview target and the interview location.
　また、端末装置１００は、撮像装置２００から撮像装置２００に関する情報としての撮像装置関連情報を受信し、その撮像装置関連情報と取材指示情報とを紐付けた情報を情報処理装置３００に送信する役割を担うものである。本実施の形態では撮像装置関連情報は撮像装置を識別する撮像装置識別情報であるとして説明を行う。 Further, the terminal device 100 receives the image pickup device-related information as information about the image pickup device 200 from the image pickup device 200, and transmits the information in which the image pickup device-related information and the coverage instruction information are linked to the information processing device 300. Is responsible for. In the present embodiment, the information related to the image pickup device will be described as the image pickup device identification information for identifying the image pickup device.
　撮像装置２００は撮影を行い、取材コンテンツとしての映像データや画像データを生成し、それらを情報処理装置３００に送信する。なお、本実施の形態は撮像装置２００から情報処理装置３００に映像データを送信する場合を例にして説明を行う。 The image pickup device 200 takes a picture, generates video data and image data as coverage contents, and transmits them to the information processing device 300. The present embodiment will be described by taking as an example a case where video data is transmitted from the image pickup apparatus 200 to the information processing apparatus 300.
　情報処理装置３００は端末装置１００に取材指示情報を送信し、端末装置１００から撮像装置関連情報を受信する。さらに、情報処理装置３００は撮像装置２００から送信された映像データを受信する。本実施の形態では、情報処理装置３００は、情報処理装置３００から端末装置１００に送信する取材指示情報と予め紐付けられたグループという分類で撮像装置２００から送信された映像データを保存する。 The information processing device 300 transmits the coverage instruction information to the terminal device 100, and receives the image pickup device-related information from the terminal device 100. Further, the information processing device 300 receives the video data transmitted from the image pickup device 200. In the present embodiment, the information processing device 300 stores the video data transmitted from the image pickup device 200 in the classification of a group associated with the coverage instruction information transmitted from the information processing device 300 to the terminal device 100 in advance.
　この情報処理システム１０は、例えば撮像装置２００で撮影した映像データを用いて放送を行う放送用システムにおいて使用される。 This information processing system 10 is used, for example, in a broadcasting system that broadcasts using video data captured by an imaging device 200.
［１－２．端末装置１００の構成］
　次に図２を参照して端末装置１００の構成について説明する。端末装置１００は制御部１０１、通信部１０２、記憶部１０３、入力部１０４、表示部１０５、マイクロホン１０６、スピーカ１０７、カメラ１０８を備えて構成されている。 [1-2. Configuration of terminal device 100]
Next, the configuration of the terminal device 100 will be described with reference to FIG. The terminal device 100 includes a control unit 101, a communication unit 102, a storage unit 103, an input unit 104, a display unit 105, a microphone 106, a speaker 107, and a camera 108.
　制御部１０１はＣＰＵ（Central Processing Unit）、ＲＡＭ（Random Access Memory）およびＲＯＭ（Read Only Memory）などから構成されている。ＲＯＭには、ＣＰＵにより読み込まれ動作されるプログラムなどが記憶されている。ＲＡＭは、ＣＰＵのワークメモリとして用いられる。ＣＰＵは、ＲＯＭに記憶されたプログラムに従い様々な処理を実行してコマンドの発行を行うことによって、端末装置１００全体および各部を制御する。 The control unit 101 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The ROM stores a program or the like that is read and operated by the CPU. The RAM is used as the work memory of the CPU. The CPU controls the entire terminal device 100 and each part by executing various processes according to the program stored in the ROM and issuing commands.
　また、制御部１０１は通信部１０２を介して、情報処理装置３００から送信された取材指示情報を受信する第１の受信処理を行う。 Further, the control unit 101 performs the first reception process of receiving the coverage instruction information transmitted from the information processing device 300 via the communication unit 102.
　さらに、制御部１０１は通信部１０２を介して、撮像装置２００から送信された撮像装置識別情報を受信する第２の受信処理を行う。そして、制御部１０１は撮像装置識別情報を受信すると、撮像装置関連情報と取材指示情報とを紐付けた情報を、通信部１０２を介して情報処理装置３００に送信する送信処理を行う。 Further, the control unit 101 performs a second reception process of receiving the image pickup device identification information transmitted from the image pickup device 200 via the communication unit 102. Then, when the control unit 101 receives the image pickup device identification information, the control unit 101 performs a transmission process of transmitting the information in which the image pickup device-related information and the interview instruction information are linked to the information processing device 300 via the communication unit 102.
　通信部１０２は、端末装置１００および情報処理装置３００とデータや各種情報の送受信を行なうための通信モジュールである。通信方式としては、無線ＬＡＮ（Local Area Network）やＷＡＮ（Wide Area Network）、ＷｉＦｉ（Wireless Fidelity）、４Ｇ（第４世代移動通信システム）、５Ｇ（第５世代移動通信システム）、Bluetooth（登録商標）、ZigBee（登録商標）などがあり、インターネットおよび他の装置などと接続できる方法であればどのようなものを用いてもよい。なお、端末装置１００と撮像装置２００との通信はＮＦＣやZigBee（登録商標）などの近距離無線通信や、ＷｉＦｉテザリング、ＵＳＢテザリング、Bluetooth（登録商標）テザリングなどのテザリング接続でもよい。 The communication unit 102 is a communication module for transmitting and receiving data and various information to and from the terminal device 100 and the information processing device 300. Communication methods include wireless LAN (Local Area Network), WAN (Wide Area Network), WiFi (Wireless Fidelity), 4G (4th generation mobile communication system), 5G (5th generation mobile communication system), and Bluetooth (registered trademark). ), ZigBee®, etc., and any method that can connect to the Internet and other devices may be used. The communication between the terminal device 100 and the image pickup device 200 may be short-range wireless communication such as NFC or ZigBee (registered trademark), or tethering connection such as WiFi tethering, USB tethering, or Bluetooth (registered trademark) tethering.
　記憶部１０３は、例えばハードディスク、フラッシュメモリなどの大容量記憶媒体である。記憶部１０３には端末装置１００で使用する各種アプリケーションやデータなどが格納されている。 The storage unit 103 is a large-capacity storage medium such as a hard disk or a flash memory. Various applications and data used in the terminal device 100 are stored in the storage unit 103.
　入力部１０４は、端末装置１００に対してユーザが情報やメッセージの入力、各種指示など行うためのものである。入力部１０４に対してユーザから入力がなされると、その入力に応じた制御信号が生成されて制御部１０１に供給される。そして、制御部１０１はその制御信号に対応した各種処理を行う。入力部１０４は物理ボタンの他、タッチパネル、表示部１０５としてのディスプレイと一体に構成されたタッチスクリーンなどがある。 The input unit 104 is for the user to input information and messages to the terminal device 100, perform various instructions, and the like. When an input is made to the input unit 104 by the user, a control signal corresponding to the input is generated and supplied to the control unit 101. Then, the control unit 101 performs various processes corresponding to the control signal. In addition to the physical buttons, the input unit 104 includes a touch panel, a touch screen integrally configured with the display as the display unit 105, and the like.
　表示部１０５は、映像、画像、ＧＵＩなどを表示するディスプレイなどの表示デバイスである。取材指示情報を表示部１０５に表示することにより取材者が取材指示の内容を確認することができる。 The display unit 105 is a display device such as a display that displays images, images, GUIs, and the like. By displaying the interview instruction information on the display unit 105, the interviewer can confirm the content of the interview instruction.
　マイクロホン１０６はユーザが端末装置１００に音声を入力するために用いるものである。また、マイクロホン１０６は端末装置１００と情報処理装置３００間の音声通話、ビデオ通話における音声入力デバイスとしても使用される。 The microphone 106 is used by the user to input voice to the terminal device 100. The microphone 106 is also used as a voice input device in a voice call and a video call between the terminal device 100 and the information processing device 300.
　スピーカ１０７は音声メッセージ、映像の音声などを出力する音声出力デバイスである。スピーカ１０７は端末装置１００と情報処理装置３００間の音声通話、ビデオ通話における音声出力デバイスとしても使用される。 The speaker 107 is an audio output device that outputs audio messages, video audio, and the like. The speaker 107 is also used as a voice output device in a voice call and a video call between the terminal device 100 and the information processing device 300.
　カメラ１０８はレンズ、撮像素子、映像信号処理回路などから構成され、映像や画像を撮影するためのものである。 The camera 108 is composed of a lens, an image sensor, a video signal processing circuit, and the like, and is for capturing a video or an image.
　端末装置１００は以上のようにして構成されている。端末装置１００の具体例としては例えばスマートフォン、タブレット端末、パーソナルコンピュータ、ウェアラブルデバイス、携帯ゲーム機などがある。なお、マイクロホン１０６、スピーカ１０７、カメラ１０８は必須の構成ではない。 The terminal device 100 is configured as described above. Specific examples of the terminal device 100 include smartphones, tablet terminals, personal computers, wearable devices, portable game machines, and the like. The microphone 106, the speaker 107, and the camera 108 are not indispensable configurations.
［１－２．撮像装置２００の構成］
　次に図３のブロック図を参照して撮像装置２００の構成について説明する。撮像装置２００は、制御部２０１、光学撮像系２０２、レンズ駆動ドライバ２０３、撮像素子２０４、画像信号処理部２０５、画像メモリ２０６、記憶部２０７、通信部２０８、入力部２０９、表示部２１０、マイクロホン２１１を備えて構成されている。 [1-2. Configuration of image pickup device 200]
Next, the configuration of the image pickup apparatus 200 will be described with reference to the block diagram of FIG. The image pickup device 200 includes a control unit 201, an optical image pickup system 202, a lens drive driver 203, an image sensor 204, an image signal processing unit 205, an image memory 206, a storage unit 207, a communication unit 208, an input unit 209, a display unit 210, and a microphone. It is configured to include 211.
　制御部２０１は、ＣＰＵ、ＲＡＭおよびＲＯＭなどから構成されている。ＣＰＵがＲＯＭに記憶されたプログラムに従い様々な処理を実行してコマンドの発行を行うことによって撮像装置２００の全体および各部の制御を行う。 The control unit 201 is composed of a CPU, RAM, ROM, and the like. The CPU controls the entire image pickup apparatus 200 and each part by issuing commands by executing various processes according to the program stored in the ROM.
　また、制御部２０１は通信部２０８を介して端末装置１００との接続を制御する。ここで、制御部２０１は通信部２０８を介してペアリングにより通信が確立した端末装置１００に撮像装置２００と情報処理装置３００におけるグループの紐付けに用いられる撮像装置識別情報を送信する処理を行う。 Further, the control unit 201 controls the connection with the terminal device 100 via the communication unit 208. Here, the control unit 201 performs a process of transmitting the image pickup device identification information used for associating the group in the image pickup device 200 and the information processing device 300 to the terminal device 100 whose communication has been established by pairing via the communication unit 208. ..
　撮像装置識別情報としては撮像装置２００のシリアルナンバー、モデルの名称などがある。識別情報は、ＩＭＥＩ（International Mobile Equipment Identifier）などの装置固有の識別番号でもよいし、装置識別専用のＩＤ情報など、個々の装置を識別することができる情報であればどのようなものでもよい。 The image pickup device identification information includes the serial number of the image pickup device 200, the model name, and the like. The identification information may be a device-specific identification number such as IMEI (International Mobile Equipment Identifier), or any information that can identify an individual device, such as ID information dedicated to device identification.
　光学撮像系２０２は、被写体からの光を撮像素子２０４に集光するための撮像レンズ、撮像レンズを移動させてフォーカス合わせやズーミングを行うための駆動機構、シャッタ機構、アイリス機構などから構成されている。これらは制御部２０１、レンズ駆動ドライバ２０３からの制御信号に基づいて駆動される。光学撮像系２０２を介して得られた被写体の光画像は、撮像素子２０４上に結像される。 The optical imaging system 202 includes an imaging lens for concentrating light from a subject on an imaging element 204, a drive mechanism for moving the imaging lens to perform focusing and zooming, a shutter mechanism, an iris mechanism, and the like. There is. These are driven based on the control signals from the control unit 201 and the lens drive driver 203. The optical image of the subject obtained through the optical image pickup system 202 is imaged on the image pickup device 204.
　レンズ駆動ドライバ２０３は、例えばマイコンなどにより構成され、制御部２０１の制御に従い撮像レンズを光軸方向に沿って所定量移動させることにより、目標とする被写体に合焦するようにオートフォーカスを行う。また、制御部２０１からの制御に従い、光学撮像系２０２の駆動機構、シャッタ機構、アイリス機構などの動作を制御する。これにより露光時間（シャッタースピード）の調整、絞り値（Ｆ値）などの調整がなされる。 The lens drive driver 203 is composed of, for example, a microcomputer or the like, and by moving the image pickup lens by a predetermined amount along the optical axis direction under the control of the control unit 201, autofocus is performed so as to focus on the target subject. Further, according to the control from the control unit 201, the operation of the drive mechanism, the shutter mechanism, the iris mechanism, etc. of the optical imaging system 202 is controlled. As a result, the exposure time (shutter speed) and the aperture value (F value) are adjusted.
　撮像素子２０４は、撮像レンズを通して得られた被写体からの入射光を光電変換して電荷量に変換して撮像信号を出力する。そして、撮像素子２０４は画素信号を画像信号処理部２０５に出力する。撮像素子２０４としては、ＣＣＤ（Charge Coupled Device）、ＣＭＯＳ（Complementary Metal Oxide Semiconductor）などが用いられる。 The image sensor 204 photoelectrically converts the incident light from the subject obtained through the image sensor into an electric charge amount and outputs an image pickup signal. Then, the image sensor 204 outputs the pixel signal to the image signal processing unit 205. As the image sensor 204, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like is used.
　画像信号処理部２０５は撮像素子２０４から出力された撮像信号に対して、ＣＤＳ（Correlated Double Sampling）処理によりＳ／Ｎ（Signal／Noise）比を良好に保つためのサンプルホールド、ＡＧＣ（Auto Gain Control）処理、Ａ／Ｄ（Analog/Digital）変換などを行ない、画像信号を作成する。また、画像信号処理部２０５は記録用の画像信号には記録用の処理を施し、表示用の画像信号には表示用の処理を施す。 The image signal processing unit 205 is a sample hold for maintaining a good S / N (Signal / Noise) ratio by CDS (Correlated Double Sampling) processing with respect to the image pickup signal output from the image sensor 204, AGC (Auto Gain Control). ) Processing, A / D (Analog / Digital) conversion, etc. are performed to create an image signal. Further, the image signal processing unit 205 performs a recording process on the image signal for recording and a display process on the image signal for display.
　画像メモリ２０６は、揮発性メモリ、例えば、ＤＲＡＭ（Dynamic Random Access Memory）で構成されるバッファメモリである。画像メモリ２０６は画像信号処理部２０５によって所定の処理が施された画像データを一時的に蓄えておくものである。 The image memory 206 is a volatile memory, for example, a buffer memory composed of a DRAM (Dynamic Random Access Memory). The image memory 206 temporarily stores image data that has been subjected to predetermined processing by the image signal processing unit 205.
　記憶部２０７は、例えば、ハードディスク、フラッシュメモリなどの大容量記憶媒体である。画像信号処理部２０５により記録用の画像処理が施された画像信号は例えばＪＰＥＧ（Joint Photographic Experts Group）などの規格に基づいて圧縮状態または非圧縮状態で保存される。また、保存された画像に関する情報、撮像位置を示す撮像位置情報、撮像日時を示す撮像時刻情報などの付加情報を含むＥＸＩＦ（Exchangeable Image File Format）データもその画像に対応付けられて保存される。さらに、記憶部２０７は端末装置１００および情報処理装置３００と接続する際に必要とする、撮像装置２００を特定する撮像装置識別情報を記憶している。 The storage unit 207 is a large-capacity storage medium such as a hard disk or a flash memory. The image signal subjected to image processing for recording by the image signal processing unit 205 is stored in a compressed state or an uncompressed state based on a standard such as JPEG (Joint Photographic Experts Group). In addition, EXIF (Exchangeable Image File Format) data including additional information such as information about the saved image, imaging position information indicating the imaging position, and imaging time information indicating the imaging date and time is also saved in association with the image. Further, the storage unit 207 stores the image pickup device identification information for identifying the image pickup device 200, which is required when connecting to the terminal device 100 and the information processing device 300.
　通信部２０８は、端末装置１００および情報処理装置３００と各種データや各種情報の送受信を行なうための通信モジュールである。通信は無線ＬＡＮ、ＷＡＮ、ＷｉＦｉ、４Ｇ、５Ｇ、ブロードバンドなどインターネットおよび他の装置などと接続できる方法であればどのようなものを用いてもよい。 The communication unit 208 is a communication module for transmitting and receiving various data and various information to and from the terminal device 100 and the information processing device 300. Any method may be used for communication as long as it can be connected to the Internet and other devices such as wireless LAN, WAN, WiFi, 4G, 5G, and broadband.
　撮像装置２００と端末装置１００との通信はＮＦＣ（Near Field Communication）やZigBee（登録商標）などの近距離無線通信や、ＷｉＦｉテザリング、ＵＳＢ（Universal Serial Bus）テザリング、Bluetooth（登録商標）テザリングなどのテザリング接続でもよい。 Communication between the image pickup device 200 and the terminal device 100 includes short-range wireless communication such as NFC (Near Field Communication) and ZigBee (registered trademark), WiFi tethering, USB (Universal Serial Bus) tethering, Bluetooth (registered trademark) tethering, etc. It may be a tethering connection.
　なお、端末装置１００にペアリングする撮像装置２００を実際に近づけてＮＦＣにより通信するいわゆるＮＦＣタッチ操作を用いることにより、取材者が取材に使用する撮像装置を意識するので、確実に取材指示情報と撮像装置２００とグループとを紐付けることができ、ペアリングする撮像装置を誤ることを防止できる。 By using the so-called NFC touch operation in which the image pickup device 200 paired with the terminal device 100 is actually brought close to the terminal device 100 and communicated by NFC, the interviewer is aware of the image pickup device used for the interview, so that the interview instruction information and the interview instruction information are surely displayed. The image pickup device 200 and the group can be linked, and it is possible to prevent the image pickup device to be paired from being mistaken.
　入力部２０９は撮像装置２００に対してユーザが各種指示など行うためのものである。入力部２０９に対してユーザから入力がなされると、その入力に応じた制御信号が生成されて制御部２０１に供給される。そして、制御部２０１はその制御信号に対応した各種処理を行う。入力部２０９としてはシャッタ入力のためのシャッタボタン、各種操作のための物理ボタンの他、タッチパネル、表示部２１０としてのディスプレイと一体に構成されたタッチスクリーンなどがある。 The input unit 209 is for the user to give various instructions to the image pickup apparatus 200. When an input is made to the input unit 209 by the user, a control signal corresponding to the input is generated and supplied to the control unit 201. Then, the control unit 201 performs various processes corresponding to the control signal. The input unit 209 includes a shutter button for shutter input, a physical button for various operations, a touch panel, a touch screen integrally configured with a display as a display unit 210, and the like.
　表示部２１０は、画像信号処理部２０５によりに表示用の処理が施された表示用の画像信号であるスルー画、画像信号処理部２０５により記録用の画像処理が施されて記憶部２０７に保存された画像／映像、ＧＵＩ（Graphical User Interface）などを表示するディスプレイなどの表示デバイスである。 The display unit 210 is a through image which is an image signal for display that has been processed for display by the image signal processing unit 205, and has been subjected to image processing for recording by the image signal processing unit 205 and stored in the storage unit 207. It is a display device such as a display that displays the image / video, GUI (Graphical User Interface), and the like.
　マイクロホン２１１は映像撮影において音声を収録するためのものである。 The microphone 211 is for recording audio in video recording.
　撮像装置２００は以上のようにして構成されている。撮像装置２００としてはデジタルカメラ、一眼レフカメラ、カムコーダー、業務用カメラ、プロ仕様撮影機器などのカメラ機能に特化した装置の他、カメラ機能を備えるスマートフォン、タブレット端末、ウェアラブルデバイス、携帯ゲーム機などでもよい。 The image pickup device 200 is configured as described above. The image pickup device 200 includes devices specialized in camera functions such as digital cameras, single-lens reflex cameras, camcorders, professional cameras, and professional photography devices, as well as smartphones, tablet terminals, wearable devices, portable game machines, etc. equipped with camera functions. It may be.
［１－４．情報処理装置３００の構成］
　次に図４のブロック図を参照して情報処理装置３００の構成について説明する。情報処理装置３００は、制御部３０１、通信部３０２、記憶部３０３を備えて構成されている。 [1-4. Configuration of information processing device 300]
Next, the configuration of the information processing apparatus 300 will be described with reference to the block diagram of FIG. The information processing device 300 includes a control unit 301, a communication unit 302, and a storage unit 303.
　制御部３０１はＣＰＵ、ＲＡＭおよびＲＯＭなどから構成されている。ＣＰＵは、ＲＯＭに記憶されたプログラムに従い様々な処理を実行してコマンドの発行を行うことによって、情報処理装置３００全体および各部を制御する。 The control unit 301 is composed of a CPU, RAM, ROM, and the like. The CPU controls the entire information processing apparatus 300 and each part by executing various processes according to the program stored in the ROM and issuing commands.
　通信部３０２は、端末装置１００および撮像装置２００と通信を行なうための通信モジュールである。通信方式としては、無線ＬＡＮやＷＡＮ、ＷｉＦｉ、４Ｇ、５Ｇ、Bluetooth（登録商標）、ZigBee（登録商標）などがある。 The communication unit 302 is a communication module for communicating with the terminal device 100 and the image pickup device 200. Communication methods include wireless LAN, WAN, WiFi, 4G, 5G, Bluetooth (registered trademark), ZigBee (registered trademark), and the like.
　記憶部３０３は、例えば、ハードディスク、フラッシュメモリなどの大容量記憶媒体である。撮像装置２００から送信された映像データは記憶部３０３においてグループに振り分けられて保存される。 The storage unit 303 is a large-capacity storage medium such as a hard disk or a flash memory. The video data transmitted from the image pickup apparatus 200 is sorted into groups in the storage unit 303 and stored.
　制御部３０１は、通信部３０２を介して取材指示情報を端末装置１００に送信する送信処理を行う。取材指示情報は、取材指示者が作成し、取材の対象や取材の場所などの具体的な取材の内容の他、取材指示情報に対応したグループのＩＤ、取材者ＩＤ、取材指示ＩＤ、取材指示者ＩＤなどを含むものである。取材指示情報の送信のタイミングは、取材依頼者が取材指示情報を作成した直後でもよいし、取材指示者が取材指示情報の送信を情報処理装置３００に指示した際でもよいし、送信時間を予め設定して情報処理装置３００が自動で送信してもよい。 The control unit 301 performs a transmission process of transmitting the coverage instruction information to the terminal device 100 via the communication unit 302. The interview instruction information is created by the interview instructor, and in addition to the specific contents of the interview such as the subject of the interview and the location of the interview, the group ID, the interviewer ID, the interview instruction ID, and the interview instruction corresponding to the interview instruction information. It includes a person ID and the like. The timing of transmitting the interview instruction information may be immediately after the interview requester creates the interview instruction information, or may be when the interview instructor instructs the information processing apparatus 300 to transmit the interview instruction information, or the transmission time may be set in advance. The information processing device 300 may set and automatically transmit.
　グループＩＤとは、取材指示情報ごとに撮像装置２００から送信された映像データを振り分けて保存するグループを識別するための情報である。 The group ID is information for identifying a group that sorts and saves the video data transmitted from the imaging device 200 for each coverage instruction information.
　取材者ＩＤ、取材指示ＩＤ、取材指示者ＩＤはそれぞれ取材者、取材指示、取材指示者を識別するための情報である。 The interviewer ID, the interview instruction ID, and the interview instructor ID are information for identifying the interviewer, the interview instruction, and the interview instructor, respectively.
　また、制御部３０１は、通信部４０２を介して端末装置１００から送信された撮像装置識別情報を受信する第１の受信処理を行う。 Further, the control unit 301 performs the first reception process of receiving the image pickup device identification information transmitted from the terminal device 100 via the communication unit 402.
　さらに制御部３０１は、通信部３０２を介して撮像装置２００から送信された映像データを受信する第２の受信処理を行う。受信した映像データは撮像装置２００と紐付けられたグループに振り分けられて記憶部３０３に保存される。 Further, the control unit 301 performs a second reception process of receiving the video data transmitted from the image pickup apparatus 200 via the communication unit 302. The received video data is distributed to a group associated with the image pickup apparatus 200 and stored in the storage unit 303.
　制御部３０１は、記憶部３０３に複数のグループを設定する。本実施の形態では記憶部３０３は、情報処理装置３００から端末装置１００に送信する取材指示情報と予め紐付けられたグループという分類で撮像装置２００から送信された映像データを保存する。グループは、フォルダやディレクトリなど仕組みにより実現することができる。また物理的に異なる記憶装置を複数用いて個々の記憶装置をそれぞれグループとすることにより実現してもよい。なお、端末装置１００から受信した撮像装置識別情報なども記憶部３０３に保存される。取材指示者が取材指示情報を作成する際にその取材指示情報に基づいた取材により作成された映像データをどのグループに保存するかを決定し、制御部３０１はその取材指示者からの入力に基づいてグループを設定する。 The control unit 301 sets a plurality of groups in the storage unit 303. In the present embodiment, the storage unit 303 stores the video data transmitted from the image pickup device 200 in the classification of the group that is associated with the coverage instruction information transmitted from the information processing device 300 to the terminal device 100 in advance. Groups can be realized by mechanisms such as folders and directories. Further, it may be realized by using a plurality of physically different storage devices and grouping the individual storage devices. The image pickup device identification information received from the terminal device 100 is also stored in the storage unit 303. When the interview instructor creates the interview instruction information, the control unit 301 decides in which group the video data created by the interview based on the interview instruction information is to be saved, and the control unit 301 is based on the input from the interview instructor. Set up a group.
　また、制御部３０１は、第１の受信処理で端末装置１００から撮像装置識別情報を受信すると、取材指示情報に対応したグループと、その取材指示情報を受信した端末装置１００から送信された撮像装置識別情報で示される撮像装置２００とを紐付ける処理を行う。これにより、撮像装置２００から送信された映像データは全て撮像装置２００と紐付けられたグループに振り分けられて保存されることになる。 Further, when the control unit 301 receives the image pickup device identification information from the terminal device 100 in the first reception process, the control unit 301 receives the group corresponding to the coverage instruction information and the image pickup device transmitted from the terminal device 100 that has received the coverage instruction information. A process of associating with the image pickup apparatus 200 indicated by the identification information is performed. As a result, all the video data transmitted from the image pickup apparatus 200 is distributed and stored in the group associated with the image pickup apparatus 200.
　さらに、制御部３０１は、第２の受信処理で撮像装置２００から映像データを受信すると、その映像データの送信元である撮像装置２００と紐付けられているグループに映像データを振り分ける処理を行う。受信した映像データは記憶部３０３においてグループに振り分けられて保存される。この振り分け処理を行うために、撮像装置２００は、映像データの送信元がグループと紐付けられた撮像装置２００であることを示す識別情報を映像データと共に情報処理装置３００に送信するようにしてもよい。そして映像データは所定の放送用の編集処理を施す外部の映像処理装置などにおいて編集処理が施される。 Further, when the control unit 301 receives the video data from the image pickup device 200 in the second reception process, the control unit 301 performs a process of distributing the video data to the group associated with the image pickup device 200 which is the transmission source of the video data. The received video data is sorted into groups in the storage unit 303 and stored. In order to perform this sorting process, the image pickup device 200 may transmit identification information indicating that the source of the video data is the image pickup device 200 associated with the group to the information processing device 300 together with the video data. Good. Then, the video data is edited by an external video processing device or the like that performs a predetermined editing process for broadcasting.
　情報処理装置３００は以上のようにして構成されている。情報処理装置３００はプログラムで構成され、そのプログラムは予めサーバなどにインストールされていてもよいし、ダウンロード、記憶媒体などで配布されて、ユーザが自らサーバなどにインストールするようにしてもよい。また、情報処理装置３００の処理を行う部分はクラウド上で構成されていてもよい。さらに、情報処理装置３００はプログラムによって実現されるのみでなく、その機能を有するハードウェアによる専用の装置、回路などを組み合わせて実現されてもよい。 The information processing device 300 is configured as described above. The information processing device 300 is composed of a program, and the program may be installed in a server or the like in advance, or may be distributed as a download or a storage medium so that the user can install the program on the server or the like by himself / herself. Further, the part that performs the processing of the information processing apparatus 300 may be configured on the cloud. Further, the information processing device 300 is not only realized by a program, but may also be realized by combining a dedicated device, a circuit, or the like by hardware having the function.
［１－５．情報処理システム１０における処理］
　次に図５のシーケンス図を参照して情報処理システム１０における処理について説明する。なお、予め情報処理装置３００と端末装置１００とはインターネットなどのネットワークで接続されているものとする。 [1-5. Processing in Information Processing System 10]
Next, the processing in the information processing system 10 will be described with reference to the sequence diagram of FIG. It is assumed that the information processing device 300 and the terminal device 100 are connected in advance by a network such as the Internet.
　まずステップＳ１０１に示すように、情報処理装置３００は取材指示情報を端末装置１００に送信し、ステップＳ１０２で端末装置１００が取材指示情報を受信する。 First, as shown in step S101, the information processing device 300 transmits the coverage instruction information to the terminal device 100, and the terminal device 100 receives the coverage instruction information in step S102.
　ここでは図６に示すように、予め情報処理装置３００の記憶部３０３においてグループＡ、グループＢ、グループＣが設定されており、取材指示情報はグループＡに対応するように設定されているものとする。上述したように、この取材指示情報とグループの対応付けは取材指示者が取材指示情報を作成する際に設定しておく必要がある。 Here, as shown in FIG. 6, group A, group B, and group C are set in advance in the storage unit 303 of the information processing device 300, and the coverage instruction information is set to correspond to group A. To do. As described above, the association between the interview instruction information and the group needs to be set when the interview instructor creates the interview instruction information.
　次にステップＳ１０３に示すように、撮像装置２００と端末装置１００間でペアリングにより接続の確立が行われる。取材者は端末装置１００において取材指示情報を確認すると、その取材を行うために使用する撮像装置２００を端末装置１００とペアリングさせる。 Next, as shown in step S103, the connection is established by pairing between the image pickup device 200 and the terminal device 100. When the interviewer confirms the interview instruction information on the terminal device 100, the interviewer pairs the image pickup device 200 used for performing the interview with the terminal device 100.
　ペアリングは、例えばＮＦＣを用いた場合、ＮＦＣ機能を有する装置同士を接触させることにより行うことができる。各種テザリングの場合、認証コードやセッションキー、ＳＳＩＤ（Service Set Identifier）、シリアル番号などの識別情報、などの必要な情報を装置間で交換することによりペアリングを行う。これにより撮像装置２００と端末装置１００とがペアリングして近距離無線通信が確立する。 Pairing can be performed by bringing devices having an NFC function into contact with each other, for example, when NFC is used. In the case of various tethering, pairing is performed by exchanging necessary information such as an authentication code, a session key, an SSID (Service Set Identifier), and identification information such as a serial number between devices. As a result, the image pickup apparatus 200 and the terminal apparatus 100 are paired to establish short-range wireless communication.
　撮像装置２００と端末装置１００との通信が確立すると、次にステップＳ１０４に示すように、撮像装置２００が撮像装置識別情報を端末装置１００に送信し、ステップＳ１０５で端末装置１００が撮像装置識別情報を受信する。 When the communication between the image pickup device 200 and the terminal device 100 is established, the image pickup device 200 then transmits the image pickup device identification information to the terminal device 100 as shown in step S104, and the terminal device 100 sends the image pickup device identification information in step S105. To receive.
　次にステップＳ１０６に示すように、端末装置１００が取材指示情報と撮像装置識別情報とを紐付けた情報を情報処理装置３００に送信する。そして、ステップＳ１０７で情報処理装置３００が、その取材指示情報と撮像装置識別情報とを紐付けた情報を受信する。 Next, as shown in step S106, the terminal device 100 transmits the information in which the coverage instruction information and the image pickup device identification information are linked to the information processing device 300. Then, in step S107, the information processing device 300 receives the information in which the coverage instruction information and the image pickup device identification information are associated with each other.
　次にステップＳ１０８に示すように、情報処理装置３００は撮像装置識別情報に基づいて撮像装置２００とグループの紐付け処理を行う。この説明においてはグループＡと対応付けられた取材指示情報を受信した端末装置１００からその取材指示情報に紐付けられた撮像装置２００の撮像装置識別情報を受信したことにより、情報処理装置３００は撮像装置２００とグループＡを紐付ける。これにより、撮像装置２００から送信された映像データは全て情報処理装置３００においてグループＡに振り分けられて保存されることになる。 Next, as shown in step S108, the information processing device 300 performs a process of associating the image pickup device 200 with the group based on the image pickup device identification information. In this description, the information processing device 300 receives an image pickup by receiving the image pickup device identification information of the image pickup device 200 associated with the coverage instruction information from the terminal device 100 that has received the coverage instruction information associated with the group A. The device 200 and the group A are linked. As a result, all the video data transmitted from the image pickup apparatus 200 is distributed to the group A in the information processing apparatus 300 and stored.
　次にステップＳ１０９に示すように撮像装置２００により撮影が行われて映像データが作成されると、ステップＳ１１０で撮像装置２００は映像データを情報処理装置３００に送信する。この際、取材者および撮像装置２００は映像データの保存先がグループＡであることを何ら意識する必要はなく、情報処理装置３００に送信することさえ認識していれば十分である。そしてステップＳ１１１で情報処理装置３００が映像データを受信する。 Next, as shown in step S109, when the image pickup device 200 takes a picture and the video data is created, the image pickup device 200 transmits the video data to the information processing device 300 in step S110. At this time, the interviewer and the image pickup apparatus 200 need not be aware that the storage destination of the video data is the group A, and it is sufficient that the interviewer and the image pickup apparatus 200 are aware that the video data is transmitted to the information processing apparatus 300. Then, in step S111, the information processing device 300 receives the video data.
　次にステップＳ１１２で、図７に示すように情報処理装置３００は映像データを予め撮像装置２００に紐付けられているグループＡに振り分けて保存する。 Next, in step S112, as shown in FIG. 7, the information processing device 300 distributes the video data to the group A associated with the image pickup device 200 in advance and stores it.
　本技術における情報処理システム１０の処理は以上のようにして行われる。この処理により、取材者および撮像装置２００は映像データの保存先が特定のグループであることを何ら意識することなく、情報処理装置３００に送信するだけで映像データをグループに振り分けて保存することができる。これにより映像データを誤って異なるグループに保存してしまうことを防止することができる。また、撮像装置２００側で送信先のグループを選択する必要がないため、映像データの送信および管理が容易となる。 The processing of the information processing system 10 in the present technology is performed as described above. By this processing, the interviewer and the image pickup apparatus 200 can distribute and save the video data into groups simply by transmitting the video data to the information processing apparatus 300 without being aware that the storage destination of the video data is a specific group. it can. This makes it possible to prevent the video data from being accidentally saved in a different group. Further, since it is not necessary to select the transmission destination group on the image pickup apparatus 200 side, the transmission and management of the video data becomes easy.
＜２．本技術の応用例＞
［２－１．ＭＯＪＯの構成］
　次に本技術の具体的な応用例について説明する。本技術はＭＯＪＯ（Mobile Journalism）と称される新たな報道の仕組みに応用することができる。 <2. Application example of this technology>
[2-1. MOJO configuration]
Next, a specific application example of this technology will be described. This technology can be applied to a new reporting system called MOJO (Mobile Journalism).
　ＭＯＪＯとは、ジャーナリストや一般市民などが端末装置を用いて取材や報道などを行うジャーナリズムのことである。インターネットや、スマートフォン等の端末装置の普及により、専用の撮像装置や映像編集装置を持たない一般市民あるいはフリーのジャーナリストでも端末装置内のアプリケーションを用いることによって報道素材の撮影や編集、提供までを容易に行うことが可能となり、ＭＯＪＯにより従来よりも即時性が高い報道が可能となる。 MOJO is journalism in which journalists and the general public use terminal devices to conduct interviews and reports. With the spread of terminal devices such as the Internet and smartphones, even ordinary citizens or freelance journalists who do not have dedicated imaging devices or video editing devices can easily shoot, edit, and provide news materials by using the applications in the terminal devices. MOJO enables more immediate coverage than before.
　まず図８を参照してＭＯＪＯ形式で取材・報道を行う場合での構成の一例について説明する。ＭＯＪＯ形式での取材・報道は、例えばジャーナリスト１０００、放送局２０００、サーバ３０００とから構成されている。放送局２０００とサーバ３０００、さらにジャーナリスト１０００が使用する撮像装置２００および端末装置１００はインターネットなどのネットワークを介して接続されている。なお、端末装置１００、撮像装置２００、情報処理装置３００は実施の形態で説明したものと同様のものとする。 First, an example of the configuration in the case of interviewing and reporting in the MOJO format will be described with reference to FIG. Coverage and coverage in MOJO format consists of, for example, journalists 1000, broadcasting stations 2000, and servers 3000. The broadcasting station 2000, the server 3000, and the imaging device 200 and the terminal device 100 used by the journalist 1000 are connected via a network such as the Internet. The terminal device 100, the image pickup device 200, and the information processing device 300 are the same as those described in the embodiment.
　ジャーナリスト１０００は事件発生現場である取材先に向かい、取材を行い、放送局２０００に取材内容（映像データ、画像データ、音声データ、テキストなど）を提供する者である。ジャーナリスト１０００は撮像装置２００および／または端末装置１００を用いて取材を行う。 Journalist 1000 is a person who goes to the interview destination, which is the site of the incident, conducts interviews, and provides the contents of the interview (video data, image data, audio data, text, etc.) to the broadcasting station 2000. The journalist 1000 interviews using the imaging device 200 and / or the terminal device 100.
　放送局２０００はジャーナリスト１０００に対して取材の指示を行い、ジャーナリスト１０００から提供された取材内容に所定の放送用の編集処理を施して放送する事業体および／または設備である。 Broadcasting station 2000 is a business entity and / or equipment that gives an instruction for coverage to journalist 1000, edits the content of coverage provided by journalist 1000, and broadcasts it.
　サーバ３０００は本技術に係る情報処理装置３００であり、放送局２０００とジャーナリスト１０００間の情報、データ、指示などの送受信も担うものである。サーバ３０００は放送局２０００自体または放送局２０００の関連会社、関連団体などが管理運営しているものでもよいし、放送局２０００以外の会社が管理運営して放送局２０００が使用しているものでもよい。 The server 3000 is an information processing device 300 according to the present technology, and is also responsible for transmitting and receiving information, data, instructions, and the like between the broadcasting station 2000 and the journalist 1000. The server 3000 may be managed and operated by the broadcasting station 2000 itself or an affiliated company or an affiliated organization of the broadcasting station 2000, or may be managed and operated by a company other than the broadcasting station 2000 and used by the broadcasting station 2000. Good.
　サーバ３０００（情報処理装置３００）は制御部３０１、通信部３０２、記憶部３０３を備えて構成されている。 The server 3000 (information processing device 300) is configured to include a control unit 301, a communication unit 302, and a storage unit 303.
　制御部３０１は、ＣＰＵ、ＲＡＭおよびＲＯＭなどから構成され、ＣＰＵがＲＯＭに記憶されたプログラムに従い様々な処理を実行してコマンドの発行を行うことによって情報処理装置３００の全体および各部の制御を行う。 The control unit 301 is composed of a CPU, a RAM, a ROM, and the like, and the CPU controls the entire information processing device 300 and each unit by executing various processes according to a program stored in the ROM and issuing a command. ..
　通信部３０２は、撮像装置２００および端末装置１００と各種データ、各種情報などの送受信を行なうための通信モジュールである。通信方法としては、無線ＬＡＮ、ＷＡＮ、ＷｉＦｉ、４Ｇ、５Ｇなどがある。 The communication unit 302 is a communication module for transmitting and receiving various data, various information, and the like to and from the image pickup device 200 and the terminal device 100. Communication methods include wireless LAN, WAN, WiFi, 4G, 5G and the like.
　記憶部３０３は、受信した映像データ、撮像装置２００と端末装置１００の識別情報および機能情報、映像データなどを格納、管理するものである。情報処理装置３００はアーカイブとして必要や要求に応じて記憶部３０３に格納してある映像データを撮像装置２００、端末装置１００に送信するようにしてもよい。 The storage unit 303 stores and manages received video data, identification information and functional information of the imaging device 200 and the terminal device 100, video data, and the like. The information processing device 300 may transmit the video data stored in the storage unit 303 as an archive to the image pickup device 200 and the terminal device 100 as needed or requested.
　放送局２０００は、少なくともコントロールルーム２１００とスタジオ２２００を有する。コントロールルーム２１００とスタジオ２２００では放送局２０００のプロデューサー、ディレクター、アシスタントディレクター、カメラマンなど（以下総称してスタッフと称する）が番組放送のための作業を行う。 Broadcasting station 2000 has at least a control room 2100 and a studio 2200. In the control room 2100 and studio 2200, producers, directors, assistant directors, cameramen, etc. (hereinafter collectively referred to as staff) of broadcasting station 2000 perform work for program broadcasting.
　コントロールルーム２１００は少なくとも制御部２１０１、スイッチャ２１０２、モニタ２１０３および通信部２１０４を備える。制御部２１０１はコントロールルーム２１００の各部および全体を制御するものである。制御部２１０１はさらにスイッチャ２１０２とモニタ２１０３間の映像データなどの送受信、コントロールルーム２１００とスタジオ２２００のＣＣＵ２２０１（Camera Control Unit）間における映像データなどの送受信も行う。 The control room 2100 includes at least a control unit 2101, a switcher 2102, a monitor 2103, and a communication unit 2104. The control unit 2101 controls each part and the whole of the control room 2100. The control unit 2101 also transmits and receives video data and the like between the switcher 2102 and the monitor 2103, and also transmits and receives video data and the like between the control room 2100 and the CCU 2201 (Camera Control Unit) of the studio 2200.
　スイッチャ２１０２は複数の入力信号を切り換えたり、混合させたりする装置であり、例えばモニタ２１０３に表示する映像の切り換え操作を担当するスタッフが使用するものである。モニタ２１０３は放送前の映像、放送用の映像、放送用処理を施している映像など、各種映像を表示する表示デバイスである。 The switcher 2102 is a device that switches or mixes a plurality of input signals, and is used by, for example, a staff member in charge of switching operations of images displayed on the monitor 2103. The monitor 2103 is a display device that displays various images such as an image before broadcasting, an image for broadcasting, and an image that has been processed for broadcasting.
　また、スタジオ２２００は少なくともＣＣＵ２２０１およびカメラ２２０２を備える。ＣＣＵ２２０１はカメラ２２０２で撮影した映像に処理を施して出力したり、映像データなどの伝送するものである。カメラ２２０２はスタジオ２２００において報道を行うキャスターなどを撮影するものである。 Also, Studio 2200 is equipped with at least CCU2201 and Camera 2202. The CCU 2201 processes and outputs an image captured by the camera 2202, or transmits image data or the like. The camera 2202 captures a caster or the like reporting in the studio 2200.
　図８に示すように例えば、放送局２０００からサーバ３０００を経由してジャーナリスト１０００に取材指示情報、取材情報が送信される。取材情報とは例えば日付、ジャーナリストのＩＤ、取材ＩＤ、取材場所、タイトル、撮像装置の設定情報などを含むものである。 As shown in FIG. 8, for example, the coverage instruction information and the coverage information are transmitted from the broadcasting station 2000 to the journalist 1000 via the server 3000. The coverage information includes, for example, a date, a journalist's ID, a coverage ID, a coverage location, a title, setting information of an imaging device, and the like.
　そしてその取材指示情報、取材情報に基づいてジャーナリスト１０００が取材を行うとジャーナリスト１０００は取材内容をサーバ３０００を介して放送局２０００に送信する。取材内容とは例えば、取材により得られた映像、静止画像、音声、テキストなどを含むものである。 Then, when the journalist 1000 conducts an interview based on the interview instruction information and the interview information, the journalist 1000 transmits the interview contents to the broadcasting station 2000 via the server 3000. The content of the interview includes, for example, video, still image, audio, text, etc. obtained by the interview.
　放送局２０００においてはスタッフがジャーナリスト１０００から送信された取材内容に基づいて番組の構成、収録、編集などを行い、取材内容を番組内で放送する。 At the broadcasting station 2000, the staff composes, records, edits, etc. the program based on the interview contents sent from the journalist 1000, and broadcasts the interview contents in the program.
［２－２．ＭＯＪＯにおける取材の第１の態様］
　次に図９を参照してＭＯＪＯにおける取材の第１の態様について説明する。 [2-2. First aspect of coverage in MOJO]
Next, the first aspect of the interview in MOJO will be described with reference to FIG.
　ＭＯＪＯにおけるジャーナリストにはシチズンジャーナリスト（市民ジャーナリスト）、ビデオジャーナリスト、ブロードキャストジャーナリストがある。 Journalists at MOJO include citizen journalists (citizen journalists), video journalists, and broadcast journalists.
　シチズンジャーナリストとは、撮影した映像を放送局２０００に提供したり、インターネットに投稿したりする一般の市民である。スマートフォンなどの端末装置の普及により一般の市民も容易に事件を撮影することができるようになったことで生まれた存在である。たまたま事件発生現場に遭遇したような場合に取材を行うため、ビデオジャーナリストとブロードキャストジャーナリストよりも即時性の高い報道を行うことができる。 Citizen journalists are ordinary citizens who provide the captured images to broadcasting station 2000 and post them on the Internet. The spread of terminal devices such as smartphones has made it easier for ordinary citizens to take pictures of incidents. Since we will be interviewing when we happen to encounter the scene of the incident, we can report more immediately than video journalists and broadcast journalists.
　ビデオジャーナリストとは、放送局２０００のスタッフやフリージャーナリストなどであり、スマートフォンやデジタルカメラなどのプロ仕様撮影機器よりは携帯性が高い装置で撮影した映像を放送局２０００に提供することを職業として行っている者である。よってビデオジャーナリストはブロードキャストジャーナリストよりも迅速に報道を行うことができる。 Video journalists are staff members of broadcasting station 2000, freelance journalists, etc., and their profession is to provide broadcasting station 2000 with images taken with devices that are more portable than professional photography equipment such as smartphones and digital cameras. Is the one who is. Therefore, video journalists can report faster than broadcast journalists.
　ブロードキャストジャーナリストとは、放送局２０００のスタッフやフリージャーナリストなどで、プロ仕様撮影機器を使用して撮影した映像を放送局２０００に提供することを職業として行っている者である。プロ仕様撮影機器はスマートフォンなどの端末装置１００や一般的なデジタルカメラなどの撮像装置２００に比べて重く大掛かりであるため、シチズンジャーナリスト、ビデオジャーナリストに比べて事件発生現場に到着して取材を開始するまでに時間がかかる。しかし、プロ用撮影機器で撮影するため、シチズンジャーナリスト、ビデオジャーナリストが撮影した映像よりも高画質で詳細な報道を行うことができる。 A broadcast journalist is a staff member of a broadcasting station 2000, a freelance journalist, etc., who is professionally engaged in providing a video shot using a professional shooting device to a broadcasting station 2000. Since professional photography equipment is heavier and larger than terminal devices 100 such as smartphones and imaging devices 200 such as general digital cameras, it arrives at the scene of the incident and starts coverage compared to citizen journalists and video journalists. It takes time. However, since it is shot with a professional shooting device, it is possible to provide detailed coverage with higher image quality than the images shot by citizen journalists and video journalists.
　図９は、端末装置１００を使用するビデオジャーナリストとプロ用撮影機器としての撮像装置２００を使用するブロードキャストジャーナリストの取材に基づいて放送が行われるＭＯＪＯの第１の取材態様である。 FIG. 9 is a first coverage mode of MOJO in which broadcasting is performed based on coverage of a video journalist who uses the terminal device 100 and a broadcast journalist who uses the image pickup device 200 as a professional photography device.
　この第１の取材態様ではまず放送局２０００は事件の発生を知るとサーバ３０００を介してまたは直接ビデオジャーナリストおよびブロードキャストジャーナリストに取材を依頼する。 In this first interview mode, when the broadcasting station 2000 learns of the occurrence of the incident, it requests the interview from the video journalist and the broadcast journalist via the server 3000 or directly.
　取材依頼を受けたビデオジャーナリストは、端末装置１００を用いて取材としての撮影、編集などを行う。なお、この例では端末装置１００はプロ仕様撮影機器に比べて携帯性、可搬性に優れているものであるため、ビデオジャーナリストはプロ仕様撮影機器を使用するブロードキャストジャーナリストよりも早く事件発生現場に到着して取材を行うことができる。また、放送局２０００は事件発生現場の近くにいて端末装置１００を持っているビデオジャーナリストにそのまま取材をすることを依頼することもできる。一方、プロ仕様撮影機器は端末装置１００よりも準備に時間を要するためブロードキャストジャーナリストよりも事件現場に到着して取材を行うのが遅くなる場合があると考えられる。 The video journalist who received the interview request shoots, edits, etc. as an interview using the terminal device 100. In this example, since the terminal device 100 is more portable and portable than the professional photography device, the video journalist arrives at the incident site earlier than the broadcast journalist who uses the professional photography device. You can do the interview. In addition, the broadcasting station 2000 can request a video journalist who is near the scene of the incident and has the terminal device 100 to interview the video journalist as it is. On the other hand, since it takes more time to prepare the professional photography equipment than the terminal device 100, it is considered that it may be slower to arrive at the incident site and interview than the broadcast journalist.
　端末装置１００を使用しているビデオジャーナリストは事件発生現場における撮影および編集が完了すると取材内容である映像データをサーバ３０００を介して放送局２０００に送信する。映像データを受信した放送局２０００は端末装置１００を用いて撮影された映像を用いて第一報の報道を行う。これにより従来のプロ用撮影機器のみを用いていた場合より即時性の高い報道が可能となる。こうした取材方法は、例えば、日中に放送される報道番組等の生放送中に事件が発生した場合に、リアルタイムで事件の内容を報道する際に適している。なお、端末装置１００を使用するビデオジャーナリストは事件発生現場でそのまま撮影を継続することも可能である。また、端末装置１００が取材内容として編集が完了した映像データを放送局２０００に送信する場合を示したが、例えば、端末装置１００が行う編集とは放送用の処理でもよいし、あるいはビデオジャーナリストは取材メモ等のテキストデータのみを映像とともに取材内容として放送局２０００に送信し、放送局２０００側で放送用の処理等の編集が行われてもよい。 The video journalist using the terminal device 100 transmits the video data, which is the content of the interview, to the broadcasting station 2000 via the server 3000 when the shooting and editing at the incident occurrence site are completed. The broadcasting station 2000 that has received the video data reports the first report using the video taken by the terminal device 100. This enables more immediate coverage than when only conventional professional photography equipment is used. Such an interview method is suitable for reporting the content of an incident in real time, for example, when an incident occurs during a live broadcast such as a news program broadcast during the day. The video journalist who uses the terminal device 100 can continue shooting as it is at the scene where the incident occurs. Further, the case where the terminal device 100 transmits the edited video data to the broadcasting station 2000 as the content of the interview is shown. For example, the editing performed by the terminal device 100 may be a process for broadcasting, or a video journalist may use it. Only the text data such as the coverage memo may be transmitted to the broadcasting station 2000 as the coverage content together with the video, and the broadcasting station 2000 may edit the processing for broadcasting or the like.
　プロ仕様撮影機器を使用しているブロードキャストジャーナリストは事件発生現場における撮影および編集が完了すると映像データをサーバ３０００を介して放送局２０００に送信する。映像データを受信した放送局２０００はその映像データを用いて第一報後のさらなる報道を行う。プロ仕様撮影機器は端末装置１００よりも高性能であるため、端末装置１００により撮影された映像よりも高画質で詳細な報道を行うことができる。こうした取材方法は、例えば日中にビデオジャーナリストによって取材された事件について、追加で取材を行なって夕方や夜の報道番組でさらに詳しい内容を放送する際に適している。ただし、ビデオジャーナリストとは異なるブロードキャストジャーナリストの独自の取材内容であってもよい。なお、ブロードキャストジャーナリストも事件発生現場でそのまま撮影を継続することも可能である。 A broadcast journalist using professional shooting equipment sends video data to the broadcasting station 2000 via the server 3000 when shooting and editing at the scene of the incident is completed. The broadcasting station 2000 that has received the video data uses the video data to make further reports after the first report. Since the professional shooting device has higher performance than the terminal device 100, it is possible to perform detailed reporting with higher image quality than the image shot by the terminal device 100. Such an interview method is suitable for, for example, to additionally interview an incident interviewed by a video journalist during the day and to broadcast more detailed contents in an evening or evening news program. However, the content may be the original coverage of a broadcast journalist different from the video journalist. Broadcast journalists can also continue shooting at the scene of the incident.
［２－３．ＭＯＪＯにおける取材の第２の態様］
　図１０は端末装置１００を使用するシチズンジャーナリストとプロ用撮影機器としての撮像装置２００を使用するブロードキャストジャーナリストの取材に基づいて放送が行われるＭＯＪＯの第２の取材態様を示すものである。 [2-3. Second aspect of coverage in MOJO]
FIG. 10 shows a second coverage mode of MOJO in which broadcasting is performed based on coverage of a citizen journalist who uses the terminal device 100 and a broadcast journalist who uses the image pickup device 200 as a professional photography device.
　この第２の取材態様においては放送局２０００が使用するサーバ３０００等とは別のインターネットにおけるサービスを提供するための外部サーバ４０００が存在する。インターネットにおけるサービスには各種ＳＮＳ（Social Network Service）、動画配信サイト、ブログサイト、インターネットテレビなどがある。 In this second coverage mode, there is an external server 4000 for providing services on the Internet, which is different from the server 3000 used by the broadcasting station 2000. Services on the Internet include various SNS (Social Network Service), video distribution sites, blog sites, and Internet TV.
　シチズンジャーナリストは放送局２０００と雇用関係のない一般の市民であるため、この第２の取材態様においては放送局２０００とシチズンジャーナリストは事件の発生を別々に知ることになる。よってシチズンジャーナリストは放送局２０００からの取材依頼がなくても自由意思で取材を行う。シチズンジャーナリストは偶然自らが事件を発見したり、事件に遭遇すると直ちに取材として撮影、編集を行うことができる。 Since the Citizen journalist is a general citizen who has no employment relationship with the broadcasting station 2000, in this second interview mode, the broadcasting station 2000 and the Citizen journalist will know the occurrence of the incident separately. Therefore, Citizen journalists voluntarily conduct interviews even if there is no interview request from the broadcasting station 2000. Citizen journalists can shoot and edit as an interview as soon as they discover an incident by chance or encounter an incident.
　事件に遭遇したシチズンジャーナリストは、端末装置１００を用いて取材としての撮影などを行う。なお、一般的に端末装置１００はプロ仕様撮影機器に比べて携帯性、可搬性、通信機能に優れているためシチズンジャーナリストはブロードキャストジャーナリストよりも早く取材内容を投稿、提供することができると考えられる。なお、シチズンジャーナリストは撮影した映像にテキストを添付したりする場合もある。また、シチズンジャーナリストが撮影した映像に対して放送局２０００や放送局２０００のサーバ内で編集作業が行われる場合もある。 The Citizen journalist who encountered the incident takes a picture as an interview using the terminal device 100. In general, since the terminal device 100 is superior in portability, portability, and communication function as compared with professional photography equipment, it is considered that citizen journalists can post and provide coverage earlier than broadcast journalists. .. Citizen journalists may also attach text to the footage they shoot. In some cases, the video captured by a citizen journalist may be edited in the server of the broadcasting station 2000 or the broadcasting station 2000.
　端末装置１００を使用しているシチズンジャーナリストは撮影および編集が完了すると取材内容をインターネット上のＳＮＳや動画配信サイトなどに投稿する。これが放送局２０００を介さない第一報の報道となる。これにより放送局２０００により行われる従来の報道よりも即時性の高い報道が可能となる。 Citizen journalists using the terminal device 100 post the content of the interview to SNS or video distribution sites on the Internet when shooting and editing are completed. This is the first report without going through the broadcasting station 2000. This enables more immediate coverage than the conventional coverage provided by the broadcasting station 2000.
　放送局２０００はＳＮＳ、動画配信サイト、ブログサイトなどを定期的に検索し、シチズンジャーナリストが事件についてインターネット上に投稿をしていることを把握したらそのシチズンジャーナリストに情報提供依頼を行い、投稿内容を取得する。 Broadcasting station 2000 regularly searches SNS, video distribution sites, blog sites, etc., and when it finds out that a citizen journalist is posting an incident on the Internet, he requests the citizen journalist to provide information and posts the content. get.
　投稿内容を取得した放送局２０００はその投稿内容を用いて報道を行う。これによりビデオジャーナリストおよびブロードキャストジャーナリストの取材と報道より即時性の高い報道が可能となる。 The broadcasting station 2000 that acquired the posted content reports using the posted content. This enables more immediate coverage than the coverage and coverage of video and broadcast journalists.
　また、放送局２０００はシチズンジャーナリストに依頼してリアルタイムに映像データなどの取材内容の供給を受けるようにしてもよい。これによりシチズンジャーナリストが撮影した映像を使ってリアルタイムの報道（生中継）を行うことが可能となる。 In addition, the broadcasting station 2000 may request a citizen journalist to receive the supply of coverage contents such as video data in real time. This makes it possible to perform real-time coverage (live broadcasting) using images taken by Citizen journalists.
　また、プロ仕様撮影機器を使用しているブロードキャストジャーナリストは撮影および編集が完了すると映像データをサーバ３０００を介して放送局２０００に送信する。映像データを受信した放送局２０００はカメラを用いて撮影された映像を用いて第一報後のさらなる報道を行う。プロ仕様撮影機器は端末装置１００よりも高性能であるため、端末装置１００により撮影された映像よりもより高画質で詳細な報道を行うことができる。また、放送局２０００はブロードキャストジャーナリストから送信される映像を使ってリアルタイムの報道（生中継）を行うことも可能となる。 In addition, a broadcast journalist using a professional shooting device transmits video data to the broadcasting station 2000 via the server 3000 when shooting and editing are completed. The broadcasting station 2000 that has received the video data uses the video taken by the camera to make further reports after the first report. Since the professional shooting device has higher performance than the terminal device 100, it is possible to perform detailed reporting with higher image quality than the image shot by the terminal device 100. In addition, the broadcasting station 2000 can also perform real-time reporting (live broadcasting) using images transmitted from broadcast journalists.
　ＭＯＪＯの取材態様の例は以上のようになっている。なお図９および図１０の取材の態様はあくまで一例である。 The above is an example of MOJO's coverage. It should be noted that the modes of coverage in FIGS. 9 and 10 are merely examples.
　このような報道では、取材者が得た映像データなどの取材内容を適切に振り分けて確実に保存すべき場所に保存することが重要となる。本技術によれば、取材者および撮像装置２００は映像データの保存先が特定のグループであることを何ら意識することなく、サーバ３０００（情報処理装置３００）に送信するだけで映像データをグループに振り分けて保存することができる。これにより映像データを誤って異なるグループに保存してしまうことを防止することができ、迅速な報道を行うことも可能になる。また、撮像装置２００側で送信先のグループを選択する必要がないため、映像データの送信および管理が容易となる。 In such reports, it is important to properly sort out the contents of the interview, such as the video data obtained by the interviewer, and save it in a place where it should be surely saved. According to the present technology, the interviewer and the image pickup apparatus 200 simply transmit the video data to the server 3000 (information processing apparatus 300) without being aware that the storage destination of the video data is a specific group, and the video data is grouped. It can be sorted and saved. As a result, it is possible to prevent the video data from being accidentally saved in a different group, and it is also possible to carry out prompt reporting. Further, since it is not necessary to select the transmission destination group on the image pickup apparatus 200 side, the transmission and management of the video data becomes easy.
　具体的にはジャーナリスト１０００（シチズンジャーナリスト、ビデオジャーナリストおよびブロードキャストジャーナリスト）は撮像装置２００と端末装置１００を所持し、事件発生現場において撮像装置２００で撮影および編集を行う。そして映像データをサーバ３０００を介して放送局２０００に送信する。放送局２０００は映像データを用いて放送を行う。なお、音声通話により放送局２０００とジャーナリスト１０００間で指示、相談、打ち合わせなどをすることも可能である。 Specifically, the journalist 1000 (citizen journalist, video journalist, and broadcast journalist) possesses an image pickup device 200 and a terminal device 100, and shoots and edits with the image pickup device 200 at the incident occurrence site. Then, the video data is transmitted to the broadcasting station 2000 via the server 3000. Broadcasting station 2000 broadcasts using video data. It is also possible to give instructions, consultations, meetings, etc. between the broadcasting station 2000 and the journalist 1000 by voice call.
＜３．変形例＞
　以上、本技術の実施の形態について具体的に説明したが、本技術は上述の実施の形態に限定されるものではなく、本技術の技術的思想に基づく各種の変形が可能である。 <3. Modification example>
Although the embodiments of the present technology have been specifically described above, the present technology is not limited to the above-described embodiments, and various modifications based on the technical idea of the present technology are possible.
　実施の形態では映像データを取材コンテンツの具体例として説明を行ったが、画像データ、音声データ、テキストデータ、統計データ、測定データ、プログラム、アプリケーション用データなどあらゆるデータに本技術は適用可能である。したがって、端末装置１００とペアリングする装置はカメラに限られず、パーソナルコンピュータ、スマートフォン、タブレット端末、ウェアラブルデバイス、ボイスレコーダ、センサ装置などでもよい。 In the embodiment, video data has been described as a specific example of coverage content, but this technology can be applied to all kinds of data such as image data, audio data, text data, statistical data, measurement data, programs, and application data. .. Therefore, the device to be paired with the terminal device 100 is not limited to the camera, but may be a personal computer, a smartphone, a tablet terminal, a wearable device, a voice recorder, a sensor device, or the like.
　実施の形態では情報処理装置３００から端末装置１００に１つの取材指示情報を送信したが、取材指示情報は複数であってもよい。取材指示情報が複数である場合、端末装置１００において複数の取材指示情報を取材者に提示し、取材者が取材指示情報の選択した後に端末装置１００と撮像装置２００のペアリングを行うようにしてもよい。 In the embodiment, one coverage instruction information is transmitted from the information processing device 300 to the terminal device 100, but there may be a plurality of coverage instruction information. When there are a plurality of interview instruction information, the terminal device 100 presents the plurality of interview instruction information to the interviewer, and after the interviewer selects the interview instruction information, the terminal device 100 and the image pickup device 200 are paired. May be good.
　また、取材者が複数の取材指示情報のうちの一の取材指示情報を選択して端末装置１００と一の撮像装置２００のペアリングを行い、さらに複数の取材指示情報のうちの他の取材指示情報を選択して端末装置１００と他の撮像装置のペアリングを行うようにしてもよい。これにより、１台の端末装置１００で複数の撮像装置とグループとの紐付けを行うことができる。 In addition, the interviewer selects one of the plurality of interview instruction information to perform pairing of the terminal device 100 and one image pickup device 200, and further, another interview instruction among the plurality of interview instruction information. Information may be selected to pair the terminal device 100 with another imaging device. As a result, one terminal device 100 can link a plurality of image pickup devices to a group.
　さらに、１つの取材指示情報に対して複数の撮像装置２００を紐付けることも可能である。これにより、例えば簡易撮影用のスマートフォンと業務用カメラという異なる２つの撮像装置２００で同じ取材対象を取材した場合、どちらの映像データも同じグループに振り分けて保存することができる。 Furthermore, it is also possible to link a plurality of imaging devices 200 to one interview instruction information. As a result, for example, when the same coverage target is covered by two different imaging devices 200, that is, a smartphone for simple shooting and a professional camera, both video data can be distributed to the same group and saved.
　実施の形態では撮像装置２００から情報処理装置３００に映像データを直接送信したが、撮像装置２００は端末装置１００に映像データを送信し、端末装置１００が情報処理装置３００にその映像データを送信するようにしてもよい。 In the embodiment, the image data is directly transmitted from the image pickup device 200 to the information processing device 300, but the image pickup device 200 transmits the video data to the terminal device 100, and the terminal device 100 transmits the video data to the information processing device 300. You may do so.
　実施の形態では情報処理装置３００自体が通信部３０２、記憶部３０３を備えるとして説明を行ったが、情報処理装置は通信部、記憶部を備えるサーバ装置において動作し、そのサーバ装置の通信部および記憶部を使用するようにしてもよい。 In the embodiment, the information processing device 300 itself has been described as including the communication unit 302 and the storage unit 303, but the information processing device operates in the communication unit and the server device including the storage unit, and the communication unit and the communication unit of the server device and the information processing device 300 operate. A storage unit may be used.
　撮像装置２００は撮像装置関連情報として、撮像装置識別情報に加えてさらに、自身が有する機能を示す情報である撮像装置機能情報を端末装置１００に送信し、端末装置１００は情報処理装置３００に撮像装置機能情報を送信するようにしてもよい。情報処理装置３００は、撮像装置機能情報を受信した場合、撮像装置２００の機能に応じて種々の処理を行う。 The image pickup device 200 transmits the image pickup device function information, which is information indicating its own function, to the terminal device 100 as the image pickup device-related information in addition to the image pickup device identification information, and the terminal device 100 images the information processing device 300. The device function information may be transmitted. When the information processing device 300 receives the image pickup device function information, the information processing device 300 performs various processes according to the function of the image pickup device 200.
　撮像装置機能情報としては、撮像装置２００が撮影可能な映像の解像度を示す解像度情報（４Ｋ、８Ｋなど）、撮像装置の通信機能情報（４Ｇ／ＬＴＥ（Long Term Evolution）対応、５Ｇ対応など）などがある。撮像装置機能情報は撮像装置識別情報と同様に撮像装置２００の制御部２０１に保存されている。 The image pickup device function information includes resolution information (4K, 8K, etc.) indicating the resolution of an image that can be captured by the image pickup device 200, communication function information of the image pickup device (4G / LTE (Long Term Evolution) support, 5G support, etc.), etc. There is. The image pickup device function information is stored in the control unit 201 of the image pickup device 200 as well as the image pickup device identification information.
　撮像装置機能情報が、撮像装置２００が撮影可能な映像の解像度（４Ｋ、８Ｋなど）を示す情報である場合、例えば情報処理装置３００は映像にトランスコード処理を施すためのトランスコーダを映像データを受信する前に予め起動させておく、などの処理を行う。これにより迅速な映像処理が可能となる。 When the image pickup device function information is information indicating the resolution (4K, 8K, etc.) of the image that can be captured by the image pickup device 200, for example, the information processing device 300 uses a transcoder for performing transcoding processing on the image image data. Perform processing such as starting in advance before receiving. This enables quick video processing.
　また、撮像装置機能情報が撮像装置２００の通信機能を示す情報である場合、撮像装置２００と情報処理装置３００間の通信をＭＥＣ（Mobile Edge Computing）を用いた通信方式に切り替えるようにしてもよい。ＭＥＣとは通信網のエッジである基地局などに、サーバややストレージを配置して、遅延低減や負荷分散を実現する仕組みであり、撮像装置２００と情報処理装置３００との間に介在するエッジサーバを介して撮像装置２００と情報処理装置３００とが通信を行うことになる。 Further, when the image pickup device function information is information indicating the communication function of the image pickup device 200, the communication between the image pickup device 200 and the information processing device 300 may be switched to a communication method using MEC (Mobile Edge Computing). .. MEC is a mechanism that realizes delay reduction and load balancing by arranging a server or storage at a base station or the like, which is the edge of a communication network, and is an edge server intervening between the image pickup device 200 and the information processing device 300. The image pickup apparatus 200 and the information processing apparatus 300 communicate with each other via the image processing apparatus 200 and the information processing apparatus 300.
　また、撮像装置機能情報で示される通信方式に応じて撮像装置２００と情報処理装置３００間の通信の帯域を選択する、プロセッサを変更するなどの処理を行うようにしてもよい。 Further, processing such as selecting the communication band between the image pickup device 200 and the information processing device 300 or changing the processor may be performed according to the communication method indicated by the image pickup device function information.
　また、変形例に係る情報処理装置３００の制御部３０１は、撮像装置２００と基地局間の通信環境が、低速通信方式（４Ｇ／ＬＴＥ、３Ｇ等）であるか、低速低容量通信方式よりも高速高容量の通信が可能な高速高容量通信方式（例えば、５Ｇ）であるかを、通信環境を示す情報に基づき判定してもよい。ここで、通信環境を示す情報は、例えば撮像装置２００と基地局との間で確立している通信方式を示す情報であり、撮像装置２００が基地局を介して情報処理装置３００に送信するものであってもよい。この場合、撮像装置２００から情報処理装置３００に送信する他の情報に、この通信環境を示す情報を含めてもよい。また、通信環境を示す情報は、撮像装置２００の位置を示す位置情報であり、情報処理装置３００が撮像装置２００の位置情報を取得するものであってもよい。この場合、情報処理装置３００の制御部３０１は、事前に記憶する通信エリアマップを参照することで、取得した位置情報が示す端末装置１００の位置における通信環境を判定する。情報処理装置３００の制御部３０１は、判定した通信環境が高速高容量通信方式（例えば、５Ｇ）である場合に、ネットワークを仮想化してネットワークリソースを分割（スライス）し、通信する信号の用途や優先度に応じてスライスを使い分けるネットワークスライシングの技術を用いるように通信部３０２を制御する。 Further, in the control unit 301 of the information processing device 300 according to the modified example, the communication environment between the image pickup device 200 and the base station is a low-speed communication method (4G / LTE, 3G, etc.) or is higher than the low-speed low-capacity communication method. Whether or not it is a high-speed high-capacity communication method (for example, 5G) capable of high-speed and high-capacity communication may be determined based on information indicating a communication environment. Here, the information indicating the communication environment is, for example, information indicating a communication method established between the image pickup apparatus 200 and the base station, which is transmitted by the imaging apparatus 200 to the information processing apparatus 300 via the base station. It may be. In this case, other information transmitted from the image pickup apparatus 200 to the information processing apparatus 300 may include information indicating this communication environment. Further, the information indicating the communication environment is the position information indicating the position of the image pickup device 200, and the information processing device 300 may acquire the position information of the image pickup device 200. In this case, the control unit 301 of the information processing device 300 determines the communication environment at the position of the terminal device 100 indicated by the acquired position information by referring to the communication area map stored in advance. When the determined communication environment is a high-speed, high-capacity communication method (for example, 5G), the control unit 301 of the information processing device 300 virtualizes the network, divides (slices) network resources, and uses signals for communication. The communication unit 302 is controlled so as to use a network slicing technique that uses different slices according to the priority.
　情報処理装置３００の映像処理部は、制御部３０１が判定した通信環境が低速低容量通信方式（４Ｇ／ＬＴＥ、３Ｇ等）である場合に、映像の解像度を向上（アップコンバート）させる解像度変換処理を行うこともできる。すなわち、情報処理装置３００の映像処理部は、制御部３０１が判定した通信環境が低速低容量通信方式（例えば、４Ｇ／ＬＴＥ、３Ｇ等）である場合に、映像データの解像度（撮像装置２００が撮像した映像の解像度であり、例えばＨＤ等の低解像度）を向上させる解像度変換処理を行うことで高解像度（例えば４Ｋや８Ｋ等の高解像度）の映像に解像度変換する。 The video processing unit of the information processing device 300 improves (up-converts) the resolution of the video when the communication environment determined by the control unit 301 is a low-speed low-capacity communication method (4G / LTE, 3G, etc.). Can also be done. That is, when the communication environment determined by the control unit 301 is a low-speed low-capacity communication method (for example, 4G / LTE, 3G, etc.), the image processing unit of the information processing device 300 determines the resolution of the video data (the image pickup device 200 It is the resolution of the captured image, and is converted into a high resolution (for example, high resolution such as 4K or 8K) image by performing a resolution conversion process for improving the resolution (for example, low resolution such as HD).
　さらに、変形例に係る情報処理装置３００の映像処理部は、撮像装置２００の通信環境に応じて、映像データに対するフレームレート変換処理を行う。情報処理装置３００の映像処理部は、制御部３０１が判定した通信環境が低速低容量通信方式（４Ｇ／ＬＴＥ、３Ｇ等）である場合に、映像のフレームレートを向上（アップコンバート）させるフレームレート変換処理を行うことができる。すなわち、情報処理装置３００の映像処理部は、制御部３０１が判定した通信環境が低速低容量通信方式（例えば、４Ｇ／ＬＴＥ、３Ｇ等）である場合に、映像データのフレームレート（撮像装置２００が撮像した映像のフレームレートであり、例えば３０ｐ等のローフレームレート）を向上させるフレームレート変換処理を行うことでハイフレームレート（例えば１２０ｐ等のハイフレームレート）の映像にフレームレート変換する。なお、上記の例では、情報処理装置３００の映像処理部が、解像度変換処理とフレームレート変換処理をそれぞれ個別に行う例を説明したが、解像度変換処理とフレームレート変換処理をあわせて行うことも可能である。 Further, the video processing unit of the information processing device 300 according to the modified example performs frame rate conversion processing on the video data according to the communication environment of the imaging device 200. The video processing unit of the information processing device 300 improves (up-converts) the frame rate of the video when the communication environment determined by the control unit 301 is a low-speed low-capacity communication method (4G / LTE, 3G, etc.). Conversion processing can be performed. That is, the video processing unit of the information processing device 300 has a frame rate of video data (imaging device 200) when the communication environment determined by the control unit 301 is a low-speed low-capacity communication method (for example, 4G / LTE, 3G, etc.). Is the frame rate of the captured image, and the frame rate is converted into a high frame rate (for example, a high frame rate such as 120p) by performing a frame rate conversion process for improving the frame rate (for example, a low frame rate such as 30p). In the above example, the video processing unit of the information processing apparatus 300 has described an example in which the resolution conversion process and the frame rate conversion process are performed individually, but the resolution conversion process and the frame rate conversion process may be performed together. It is possible.
　なお、映像処理部は、制御部３０１が判定した通信環境が低速低容量通信方式（４Ｇ／ＬＴＥ、３Ｇ等）である場合に、映像のフレームレートを低下（ダウンコンバート）させるフレームレート変換処理を行うのではなく、制御部３０１が判定した通信環境が高速高容量通信方式（例えば、５Ｇ）である場合に、映像のフレームレートを向上（アップコンバート）させるフレームレート変換処理を行うこともできる。すなわち、情報処理装置３００の映像処理部は、制御部３０１が判定した通信環境が高速高容量通信方式（例えば、５Ｇ）である場合に、映像データのフレームレート（撮像装置２００が撮像した映像のフレームレートであり、例えば３０ｐ等のローフレームレート）を向上させるフレームレート変換処理を行うことでハイフレームレート（例えば１２０ｐ等のハイフレームレート）の映像にフレームレート変換する。なお、上記の例では、情報処理装置３００の映像処理部が、解像度変換処理とフレームレート変換処理をそれぞれ個別に行う例を説明したが、解像度変換処理とフレームレート変換処理をあわせて行うことも可能である。 The video processing unit performs a frame rate conversion process for lowering (down-converting) the frame rate of the video when the communication environment determined by the control unit 301 is a low-speed low-capacity communication method (4G / LTE, 3G, etc.). Instead, when the communication environment determined by the control unit 301 is a high-speed, high-capacity communication method (for example, 5G), a frame rate conversion process for improving (up-converting) the frame rate of the video can be performed. That is, when the communication environment determined by the control unit 301 is a high-speed high-capacity communication method (for example, 5G), the video processing unit of the information processing device 300 has a frame rate of video data (a video image captured by the image pickup device 200). It is a frame rate, and the frame rate is converted into a high frame rate (for example, a high frame rate such as 120p) by performing a frame rate conversion process for improving the frame rate (for example, a low frame rate such as 30p). In the above example, the video processing unit of the information processing apparatus 300 has described an example in which the resolution conversion process and the frame rate conversion process are performed individually, but the resolution conversion process and the frame rate conversion process may be performed together. It is possible.
　本技術は以下のような構成も取ることができる。
（１）
　情報処理装置から受信した取材指示情報と、撮像装置から受信した撮像装置関連情報とを紐付け、前記取材指示情報と前記撮像装置関連情報とを紐付けた情報を前記情報処理装置に送信する制御を行う制御部
を備える端末装置。
（２）
　前記撮像装置関連情報は前記撮像装置の識別情報である（１）に記載の端末装置。
（３）
　前記撮像装置関連情報は前記撮像装置の機能情報である（１）または（２）に記載の端末装置。
（４）
　前記機能情報は前記撮像装置で撮影可能な映像の解像度情報である（３）に記載の情報処理装置。
（５）
　前記機能情報は前記撮像装置の通信方式を示す情報である（３）に記載の情報処理装置。
（６）
　前記撮像装置から前記情報処理装置にデータが送信される（１）から（５）のいずれかに記載の情報処理装置。
（７）
　情報処理装置から受信した取材指示情報と、撮像装置から受信した撮像装置関連情報とを紐付け、前記取材指示情報と前記撮像装置関連情報とを紐付けた情報を前記情報処理装置に送信する制御を行う
端末装置の制御方法をコンピュータに実行させる制御プログラム。
（８）
　端末装置に取材指示情報を送信し、
　前記端末装置から受信した、該端末装置が撮像装置から受信した撮像装置関連情報に基づいて、前記撮像装置と該撮像装置から受信したデータの保存先であるグループとを紐付けて、前記撮像装置から受信したデータを前記グループに振り分ける制御を行う制御部
を備える情報処理装置。
（９）
　前記グループは前記取材指示情報と予め対応付けられている（８）に記載の情報処理装置。
（１０）
　前記撮像装置関連情報は前記撮像装置の識別情報である（８）または（９）に記載の情報処理装置。
（１１）
　前記撮像装置関連情報は前記撮像装置の機能情報である（８）から（１０）のいずれかに記載の情報処理装置。
（１２）
　前記機能情報は、前記撮像装置の通信方式を示す情報である（１１）に記載の情報処理装置。
（１３）
　前記通信方式情報により前記撮像装置が所定の通信方式に対応している場合、エッジサーバを経由した通信を行う（１２）に記載の情報処理装置。
（１４）
　前記所定の通信方式とは第５世代移動通信システムである（１３）に記載の情報処理装置。
（１５）
　前記機能情報は、前記撮像装置で撮影可能な映像の解像度情報である（１１）に記載の情報処理装置。
（１６）
　前記機能情報が前記解像度情報である場合、トランスコーダを予め起動させる（１５）に記載の情報処理装置。
（１７）
　端末装置に取材指示情報を送信し、
　前記端末装置から受信した、該端末装置が撮像装置から受信した撮像装置関連情報に基づいて、前記撮像装置と該撮像装置から受信したデータの保存先であるグループとを紐付けて、前記撮像装置から受信したデータを前記グループに振り分ける制御を行う
情報処理方法をコンピュータに実行させる情報処理プログラム。
（１８）
　情報処理装置から受信した取材指示情報と、撮像装置から受信した撮像装置関連情報とを紐付け、前記取材指示情報と前記撮像装置関連情報とを紐付けた情報を前記情報処理装置に送信する制御を行う制御部
を備える端末装置と、
　前記端末装置に取材指示情報を送信し、
　前記端末装置から受信した、該端末装置が撮像装置から受信した撮像装置関連情報に基づいて、前記撮像装置と該撮像装置から受信したデータの保存先であるグループとを紐付けて、前記撮像装置から受信したデータを前記グループに振り分ける制御を行う制御部
を備える情報処理装置と
からなる情報処理システム。 The present technology can also have the following configurations.
(1)
Control that links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and transmits the information linking the coverage instruction information and the image pickup device-related information to the information processing device. A terminal device including a control unit for performing information processing.
(2)
The terminal device according to (1), wherein the image pickup device-related information is identification information of the image pickup device.
(3)
The terminal device according to (1) or (2), which is the functional information of the image pickup device.
(4)
The information processing device according to (3), wherein the functional information is resolution information of an image that can be captured by the image pickup device.
(5)
The information processing device according to (3), wherein the functional information is information indicating a communication method of the image pickup device.
(6)
The information processing device according to any one of (1) to (5), wherein data is transmitted from the image pickup device to the information processing device.
(7)
A control that links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and transmits the information linking the coverage instruction information and the image pickup device-related information to the information processing device. A control program that causes a computer to execute a control method for a terminal device that performs the above.
(8)
Send coverage instruction information to the terminal device,
Based on the image pickup device-related information received from the terminal device and received from the image pickup device by the terminal device, the image pickup device is associated with the group in which the data received from the image pickup device is stored, and the image pickup device is linked. An information processing device including a control unit that controls distribution of data received from the data to the group.
(9)
The information processing apparatus according to (8), wherein the group is associated with the interview instruction information in advance.
(10)
The information processing device according to (8) or (9), wherein the image pickup device-related information is identification information of the image pickup device.
(11)
The information processing device according to any one of (8) to (10), wherein the image pickup device-related information is functional information of the image pickup device.
(12)
The information processing device according to (11), wherein the functional information is information indicating a communication method of the image pickup device.
(13)
The information processing device according to (12), wherein when the imaging device supports a predetermined communication method based on the communication method information, communication is performed via an edge server.
(14)
The information processing apparatus according to (13), wherein the predetermined communication method is a fifth generation mobile communication system.
(15)
The information processing device according to (11), wherein the functional information is resolution information of an image that can be captured by the image pickup device.
(16)
The information processing apparatus according to (15), wherein the transcoder is activated in advance when the functional information is the resolution information.
(17)
Send coverage instruction information to the terminal device,
Based on the image pickup device-related information received from the terminal device and received from the image pickup device by the terminal device, the image pickup device is associated with the group in which the data received from the image pickup device is stored, and the image pickup device is linked. An information processing program that causes a computer to execute an information processing method that controls distribution of data received from a computer to the group.
(18)
Control that links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and transmits the information linking the coverage instruction information and the image pickup device-related information to the information processing device. A terminal device equipped with a control unit that performs information processing
The coverage instruction information is transmitted to the terminal device,
Based on the image pickup device-related information received from the terminal device and received from the image pickup device by the terminal device, the image pickup device is associated with the group in which the data received from the image pickup device is stored, and the image pickup device is linked. An information processing system including an information processing device including a control unit that controls distribution of data received from the above groups.
１０・・・・情報処理システム
１００・・・端末装置
２００・・・撮像装置
３００・・・情報処理装置 10 ... Information processing system 100 ... Terminal device 200 ... Imaging device 300 ... Information processing device

Claims (18)

  1. 　情報処理装置から受信した取材指示情報と、撮像装置から受信した撮像装置関連情報とを紐付け、前記取材指示情報と前記撮像装置関連情報とを紐付けた情報を前記情報処理装置に送信する制御を行う制御部
    を備える端末装置。     Control that links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and transmits the information linking the coverage instruction information and the image pickup device-related information to the information processing device. A terminal device including a control unit for performing information processing.
  2. 　前記撮像装置関連情報は前記撮像装置の識別情報である
    請求項１に記載の端末装置。     The terminal device according to claim 1, wherein the image pickup device-related information is identification information of the image pickup device.
  3. 　前記撮像装置関連情報は前記撮像装置の機能情報である
    請求項１に記載の端末装置。     The terminal device according to claim 1, wherein the image pickup device-related information is functional information of the image pickup device.
  4. 　前記機能情報は前記撮像装置で撮影可能な映像の解像度情報である
    請求項３に記載の情報処理装置。     The information processing device according to claim 3, wherein the functional information is resolution information of an image that can be captured by the image pickup device.
  5. 　前記機能情報は前記撮像装置の通信方式を示す情報である
    請求項３に記載の情報処理装置。     The information processing device according to claim 3, wherein the functional information is information indicating a communication method of the image pickup device.
  6. 　前記撮像装置から前記情報処理装置にデータが送信される
    請求項１に記載の情報処理装置。     The information processing device according to claim 1, wherein data is transmitted from the image pickup device to the information processing device.
  7. 　情報処理装置から受信した取材指示情報と、撮像装置から受信した撮像装置関連情報とを紐付け、前記取材指示情報と前記撮像装置関連情報とを紐付けた情報を前記情報処理装置に送信する制御を行う
    端末装置の制御方法をコンピュータに実行させる制御プログラム。     A control that links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and transmits the information linking the coverage instruction information and the image pickup device-related information to the information processing device. A control program that causes a computer to execute a control method for a terminal device that performs the above.
  8. 　端末装置に取材指示情報を送信し、
    　前記端末装置から受信した、該端末装置が撮像装置から受信した撮像装置関連情報に基づいて、前記撮像装置と該撮像装置から受信したデータの保存先であるグループとを紐付けて、前記撮像装置から受信したデータを前記グループに振り分ける制御を行う制御部
    を備える情報処理装置。     Send coverage instruction information to the terminal device,
    Based on the image pickup device-related information received from the terminal device and received from the image pickup device by the terminal device, the image pickup device is associated with the group in which the data received from the image pickup device is stored, and the image pickup device is linked. An information processing device including a control unit that controls distribution of data received from the data to the group.
  9. 　前記グループは前記取材指示情報と予め対応付けられている
    請求項８に記載の情報処理装置。     The information processing device according to claim 8, wherein the group is associated with the coverage instruction information in advance.
  10. 　前記撮像装置関連情報は前記撮像装置の識別情報である
    請求項８に記載の情報処理装置。     The information processing device according to claim 8, wherein the information related to the image pickup device is identification information of the image pickup device.
  11. 　前記撮像装置関連情報は前記撮像装置の機能情報である
    請求項８に記載の情報処理装置。     The information processing device according to claim 8, wherein the information related to the image pickup device is functional information of the image pickup device.
  12. 　前記機能情報は、前記撮像装置の通信方式を示す情報である
    請求項１１に記載の情報処理装置。     The information processing device according to claim 11, wherein the functional information is information indicating a communication method of the image pickup device.
  13. 　前記通信方式情報により前記撮像装置が所定の通信方式に対応している場合、エッジサーバを経由した通信を行う
    請求項１２に記載の情報処理装置。     The information processing device according to claim 12, wherein when the imaging device corresponds to a predetermined communication method based on the communication method information, communication is performed via an edge server.
  14. 　前記所定の通信方式とは第５世代移動通信システムである
    請求項１３に記載の情報処理装置。     The information processing device according to claim 13, wherein the predetermined communication method is a fifth-generation mobile communication system.
  15. 　前記機能情報は、前記撮像装置で撮影可能な映像の解像度情報である
    請求項１１に記載の情報処理装置。     The information processing device according to claim 11, wherein the functional information is resolution information of an image that can be captured by the imaging device.
  16. 　前記機能情報が前記解像度情報である場合、トランスコーダを予め起動させる
    請求項１５に記載の情報処理装置。     The information processing device according to claim 15, wherein when the functional information is the resolution information, the transcoder is activated in advance.
  17. 　端末装置に取材指示情報を送信し、
    　前記端末装置から受信した、該端末装置が撮像装置から受信した撮像装置関連情報に基づいて、前記撮像装置と該撮像装置から受信したデータの保存先であるグループとを紐付けて、前記撮像装置から受信したデータを前記グループに振り分ける制御を行う
    情報処理方法をコンピュータに実行させる情報処理プログラム。     Send coverage instruction information to the terminal device,
    Based on the image pickup device-related information received from the terminal device and received from the image pickup device by the terminal device, the image pickup device is associated with the group in which the data received from the image pickup device is stored, and the image pickup device is linked. An information processing program that causes a computer to execute an information processing method that controls distribution of data received from a computer to the group.
  18. 　情報処理装置から受信した取材指示情報と、撮像装置から受信した撮像装置関連情報とを紐付け、前記取材指示情報と前記撮像装置関連情報とを紐付けた情報を前記情報処理装置に送信する制御を行う制御部
    を備える端末装置と、
    　前記端末装置に取材指示情報を送信し、
    　前記端末装置から受信した、該端末装置が撮像装置から受信した撮像装置関連情報に基づいて、前記撮像装置と該撮像装置から受信したデータの保存先であるグループとを紐付けて、前記撮像装置から受信したデータを前記グループに振り分ける制御を行う制御部
    を備える情報処理装置と
    からなる情報処理システム。     Control that links the coverage instruction information received from the information processing device with the image pickup device-related information received from the image pickup device, and transmits the information linking the coverage instruction information and the image pickup device-related information to the information processing device. A terminal device equipped with a control unit that performs information processing
    The coverage instruction information is transmitted to the terminal device,
    Based on the image pickup device-related information received from the terminal device and received from the image pickup device by the terminal device, the image pickup device is associated with the group in which the data received from the image pickup device is stored, and the image pickup device is linked. An information processing system including an information processing device including a control unit that controls distribution of data received from the above groups.
PCT/JP2020/045488 2019-12-09 2020-12-07 Terminal device, control program, information processing device, information processing program, and information processing system WO2021117679A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019222218 2019-12-09
JP2019-222218 2019-12-09

Publications (1)

Publication Number Publication Date
WO2021117679A1 true WO2021117679A1 (en) 2021-06-17

Family

ID=76330361

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/045488 WO2021117679A1 (en) 2019-12-09 2020-12-07 Terminal device, control program, information processing device, information processing program, and information processing system

Country Status (1)

Country Link
WO (1) WO2021117679A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010186270A (en) * 2009-02-10 2010-08-26 Canon Inc Image managing device and method
JP2010288002A (en) * 2009-06-10 2010-12-24 Ikegami Tsushinki Co Ltd Method of setting file name
WO2018123714A1 (en) * 2016-12-27 2018-07-05 ソニー株式会社 Camera, camera processing method, server, server processing method, and information processing device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010186270A (en) * 2009-02-10 2010-08-26 Canon Inc Image managing device and method
JP2010288002A (en) * 2009-06-10 2010-12-24 Ikegami Tsushinki Co Ltd Method of setting file name
WO2018123714A1 (en) * 2016-12-27 2018-07-05 ソニー株式会社 Camera, camera processing method, server, server processing method, and information processing device

Similar Documents

Publication Publication Date Title
US9692963B2 (en) Method and electronic apparatus for sharing photographing setting values, and sharing system
CN103108217A (en) Method, apparatus and system for prioritising content for distribution
WO2021095598A1 (en) Information processing device, information processing method, information processing program, terminal device, terminal device control method, and control program
US11681748B2 (en) Video streaming with feedback using mobile device
JP5094704B2 (en) Content sharing system and content sharing method
CN103905710A (en) Image capture method, and mobile terminal and device thereof
US9277013B2 (en) Storing local session data at a user equipment and selectively transmitting group session data to group session targets based on dynamic playback relevance information
US20170180436A1 (en) Upload of Multimedia Content
WO2021117679A1 (en) Terminal device, control program, information processing device, information processing program, and information processing system
US11082363B2 (en) Communication apparatus performing multi-camera live streaming, control method therefor, and storage medium
US10944817B2 (en) Systems and methods for segmented data transmission
JP2003219389A (en) Video distribution method, system, and apparatus, user terminal, video distribution program, and storage medium storing the video distribution program
KR101529139B1 (en) Method and apparatus for providing user interface menu of multi-angle video capturing
WO2021131349A1 (en) Imaging device, imaging device control method, control program, information processing device, information processing device control method, and control program
CN104883469A (en) Communication device, imaging system, and server
WO2021153507A1 (en) Imaging device, control method for imaging device, control program, information processing device, control method for information processing device, and control program
CN114631326B (en) Information processing apparatus, information processing method, information processing program, terminal apparatus, and method and program for controlling terminal apparatus
US11190812B2 (en) Communication apparatus, control method for controlling the same, and recording medium for the same
US10728451B2 (en) Communication device for communicating with external device, method for controlling the same, and recording medium
US11115470B1 (en) Photograph sharing system
WO2017203789A1 (en) Difference image generation method, image restoration method, difference detection device, image restoration device, and monitoring method
WO2018137393A1 (en) Image processing method and electronic device
CN112911386B (en) Material processing method, device, electronic equipment and readable storage medium
US11729267B2 (en) Photograph sharing system
KR100991423B1 (en) Realtime image service system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20899831

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: JP

122 Ep: pct application non-entry in european phase

Ref document number: 20899831

Country of ref document: EP

Kind code of ref document: A1