JP2022122179A - Information processing system, information processing method, and information processing program - Google Patents

Abstract

To provide an information processing device, an information processing method, and an information processing program that can reduce the production cost of telop data.SOLUTION: An information processing device acquires material data from a first terminal, generates telop data based on the acquired material data, and provides image data including at least the generated telop data to the first terminal. The first terminal uses a web conference system to display the provided image data. A second terminal communicates with a first application via the web conference system, acquires the image data displayed on a first display device, and displays the image data.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing system, an information processing method, and an information processing program.

2. Description of the Related Art Conventionally, there is a system for generating a telop image to be superimposed on video data captured by a camera or the like. For example, Patent Literature 1 describes a telop display system that generates telop image data for displaying a telop image within a predetermined display area of a video monitor set in advance. The generated telop image data is superimposed on the video data captured by the camera for television broadcasting.

JP 2018-196076 A

However, in the conventional technology, a company that produces telops needs to install a device for producing telops for each device that uses telop data. In some cases, the cost of
Also, when the generated telop data is transmitted and received via a communication line, the cost of using the telop data increases due to the introduction of a device for constructing a dedicated system used for transmitting and receiving the telop data. There was a case.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an information processing system, an information processing method, and an information processing program capable of reducing the cost of using telop data.

(1) In order to solve the above problems, the information processing system includes a first terminal, which is a client terminal in the web conference system, and another client terminal in the web conference system, which is the first terminal via the web conference system. An information processing system comprising a second terminal connected to the terminal and an information processing device communicably connected to the first terminal, wherein the information processing device includes an acquisition unit that acquires material data from the first terminal a generating unit for generating telop data based on the material data acquired by the acquiring unit; and a providing unit for providing image data including at least the telop data generated by the generating unit to the first terminal; The first terminal has a first application for using the web conference system and a first display device for displaying image data provided by the providing unit, and the second terminal obtains via the web conference system and a second display device for displaying the image data displayed on the first display device.

(2) In the information processing system of the embodiment, the first display device includes a main monitor that displays telop data settings and a second monitor that displays image data. image data to be displayed on a second monitor shared by

(3) Also, in the information processing system of the embodiment, the first application has a telop data setting function that displays telop data settings on the main monitor to enable setting of telop data, or a It may include plug-in software having at least one of image data display functions for displaying image data.

(4) Further, in the information processing system of the embodiment, the second terminal includes a capture unit that captures a display screen of image data displayed on the second display device, and a third display that captures the display screen captured by the capture unit. and an output unit for outputting to the device.

(5) Further, in the information processing system of the embodiment, the second terminal provides input data input by the user of the second terminal to the first application, and the first application receives the input data obtained from the second terminal. may be provided to the information processing apparatus as material data.

(6) In the information processing system of the embodiment, the second terminal may provide the first application with text data input by the user of the second terminal as input data.

(7) In the information processing system of the embodiment, the second terminal may provide the first application with voice data input by the user of the second terminal as input data.

(8) Further, in the information processing system of the embodiment, the second terminal may determine a display area for displaying image data corresponding to the second display device.

(9) In order to solve the above problems, the information processing method is to provide a first terminal, which is a client terminal in the web conference system, and another client terminal, which is another client terminal in the web conference system, to the first terminal via the web conference system. and an information processing device communicably connected to the first terminal, the information processing method being executed in the information processing device, the first terminal a generating step of generating telop data based on the material data obtained in the obtaining step; and providing image data including at least the telop data generated in the generating step to the first terminal. a launching step of launching a first application for using the web conference system executed on the first terminal; and a first display step of displaying the image data provided in the providing step. and a second display device step of displaying the image data to be displayed in the first display step acquired via the Web conference system, executed in the second terminal.

(10) In order to solve the above problem, the information processing program is a first terminal, which is a client terminal in the web conference system, and another client terminal in the web conference system, which is the first terminal via the web conference system. and an information processing device communicably connected to the first terminal, wherein the information processing device executes a material from the first terminal an acquisition function for acquiring data, a generation function for generating telop data based on the material data acquired by the acquisition function, and a provision function for providing image data including at least the telop data generated by the generation function to the first terminal and realizing, in the first terminal, a first application function for using the web conference system and a first display function for displaying image data provided in the providing function, and realizing a second terminal In the above, a second display function for displaying the image data to be displayed by the first display function acquired via the web conference system is realized.

According to one embodiment of the present invention, an information processing apparatus acquires material data from a first terminal, generates telop data based on the acquired material data, and generates image data including at least the generated telop data. The first terminal uses the Web conference system to display the provided image data, and the second terminal communicates with the first application via the Web conference system to By acquiring the image data to be displayed on the display device and displaying the image data, the cost of using the telop data can be reduced.

It is a block diagram showing an example of a system configuration of an information processing system in an embodiment. FIG. 3 is a diagram showing a first display example of a display device used in the information processing system according to the embodiment; FIG. 7 is a diagram showing a second display example of the display device used in the information processing system in the embodiment; FIG. 12 is a diagram showing a third display example of the display device used in the information processing system in the embodiment; FIG. 12 is a diagram showing a fourth display example of the display device used in the information processing system in the embodiment; FIG. 12 is a diagram showing a fifth display example of the display device used in the information processing system according to the embodiment; FIG. 12 is a diagram showing a sixth display example of the display device used in the information processing system according to the embodiment; FIG. 12 is a diagram showing a seventh display example of the display device used in the information processing system according to the embodiment; It is a block diagram showing an example of hardware constitutions of an information processor in an embodiment. 4 is a flow chart showing an example of the operation of the information processing device according to the embodiment; 4 is a flow chart showing an example of the operation of the first terminal in the embodiment; 4 is a flow chart showing an example of the operation of the second terminal in the embodiment;

Hereinafter, an information processing system, an information processing method, and an information processing program according to an embodiment of the present invention will be described in detail with reference to the drawings.

First, the configuration of the information processing system will be described with reference to FIG. FIG. 1 is a block diagram showing an example of the system configuration of an information processing system according to an embodiment.

In FIG. 1 , an information processing system 100 has an information processing device 1 , a web conference server 2 , a first terminal 3 and a second terminal 4 . The information processing device 1 , the web conference server 2 , the first terminal 3 and the second terminal 4 are communicably connected via a network 9 . FIG. 1 illustrates the configuration and connection method of the information processing system 100, and does not limit the configuration and connection method of the information processing system 100. FIG.

The information processing device 1 includes functional units of a communication control unit 11 , an authentication unit 12 , a storage unit 13 , an acquisition unit 14 , a UI provision unit 15 , a judgment unit 16 , a generation unit 17 and a provision unit 18 . Each functional unit of the information processing apparatus 1 according to the present embodiment will be described as a functional module realized by the information processing program (software) according to the present embodiment.

The communication control unit 11 controls communication with the first terminal 3 connected via the network 9 .

The authentication unit 12 uses the communication control unit 11 to authenticate the user of the first terminal 3 . A user of the first terminal 3 is a person who is authorized to use functions provided by the information processing apparatus 1 communicably connected to the first terminal 3 . A user of the first terminal 3 is, for example, an operator who operates the first terminal 3 . The authentication unit 12 authenticates a user having user authority by using, for example, a login ID and a password assigned to each user. Note that the user in this embodiment does not have to be a specified individual. For example, when one login ID is used by multiple people in sequence, the user can be the person currently using the user ID. Note that the authentication unit 12 may use authentication methods other than authentication using a login ID and a password (for example, biometric authentication, magnetic card authentication, etc.).

The storage unit 13 stores user information. User information includes, for example, authentication information including a login ID and password, setting information for generating telop data set for each user, material data (to be described later) stored for each user, and the like.

The acquisition unit 14 acquires material data. Material data is data that is the basis for generating telop data, which will be described later. The telop data is generated based on part or all of the material data. That is, the material data may include portions that are not converted to telop data. The material data is, for example, text data including character strings, voice data including voice information, graphic data represented by vector data or the like, image data including image information, or a combination thereof. The acquisition unit 14 acquires material data from inside the information processing device 1 (for example, the storage unit 13 ) or from the first terminal 3 . FIG. 1 illustrates a case where the acquisition unit 14 acquires material data from the first terminal 3 . Note that the first terminal 3 may acquire material data from the second terminal 4 and provide the acquired material data to the acquisition unit 14 .

In this embodiment, "acquisition" of data may be pull-type data acquisition such as download, or push-type data acquisition for receiving data transmitted from another device. . For example, the acquisition unit 14 provides a UI (User Interface) for inputting or selecting material data to be provided to the first terminal 3, and the user of the first terminal 3 operates the displayed UI. Material data may be acquired by

The text data is, for example, data manually input from a keyboard (not shown) by the user of the first terminal 3 or the user of the second terminal 4 . Data manually input from the keyboard by the user of the second terminal 4 is acquired by the first terminal 3 and provided to the acquiring unit 14 . The text data may also include time information, weather information, traffic information, breaking news, subtitles, and the like.

The voice data is, for example, data provided to the acquisition unit 14 after the first terminal 3 acquires the voice input by the user of the second terminal 4 through a microphone (not shown). Note that the voice data may include character information generated by voice recognition.

The image data is, for example, data that the first terminal 3 acquires an image selected or input by the user of the second terminal 4 and provided to the acquisition unit 14 . Note that the image data may include character information generated by image recognition.

The UI providing unit 15 provides a UI for setting telop data. The setting of telop data is a setting for determining the telop data to be generated. Alternatively, it may be the display shape of a telop or the like. The UI providing unit 15 may, for example, provide a UI to the first application of the first terminal 3 so that telop data can be set via the first application. Also, the UI providing unit 15 may be a web server that provides a web page to the first terminal 3 . The first terminal 3 can set the telop data by displaying the UI provided from the UI providing unit 15 on the web browser or the plug-in software 311 described later. The storage unit 13 may store setting contents set by the UI provided by the UI providing unit 15 .

The UI providing unit 15 may provide the first terminal 3 with a preview screen of telop data generated by the generating unit 17, which will be described later.

The determination unit 16 determines the type of material data (text data, audio data, or image data) acquired by the acquisition unit 14 and recognizes the contents of the material data. For example, if the material data is text data, the determination unit 16 determines the number of characters or the type of characters (for example, kanji or hiragana). Further, when the material data is voice data, the determination unit 16 may recognize the contents of the voice and generate text data. Further, when the material data is image data, the determination unit 16 may recognize the number of pixels of the image.

The generation unit 17 generates telop data based on the determination made by the determination unit 16 and the settings set in the UI. For example, if the material data is text data, the generation unit 17 determines the size of the characters of the telop data or the display speed ( telop data is generated by determining the number of characters to be displayed in one second) and the like. Further, when the material data is voice data, the generation unit 17 may determine the character size, display speed, or the like of text data generated in voice recognition to generate telop data. Further, when the material data is image data, the generation unit 17 may generate telop data in which the number of pixels of the image is changed based on the number of pixels of the recognized image and the number of pixels of the display area of the telop. Note that the UI may designate a portion of the material data to be used as telop data. For example, it may specify the first 10 characters in text data, or specify a specific portion in image data. The generation unit 17 generates the material data of the specified portion as telop data.

Note that the telop in the present embodiment means character information, symbol information, and graphic information superimposed, inserted, or synthesized (hereinafter sometimes referred to as "superimposition, etc.") on an original image such as a moving image or a still image. , audio information or image information, or a combination thereof (hereinafter sometimes referred to as "character information, etc."). The telop data is data used for displaying telops, and may be, for example, vector data before being rasterized or raster data after being rasterized. Also, the telop data generated by the generation unit 17 may be image data including at least telop data.

The original image on which the telop data is superimposed, etc., is a display screen shared in a Web conference system, which will be described later. Note that the original image may be a television image used for television broadcasting, a moving image used for a moving image distribution service, a display image displayed on a large display device, or the like. In this embodiment, the data used for the telop superimposed on the original image is the telop data. A telop may be called a caption, subtitle, ticker, alert, superimpose, etc., depending on the region, content, or format used, and is included in the telop of the present embodiment.

The providing unit 18 provides image data including at least the telop data generated by the generating unit 17 to the first terminal 3 connected via the network 9 . The image data provided from the providing unit 18 to the first terminal 3 is used in the first terminal 3 . For example, the first terminal 3 displays on the first display device 32 image data including at least the telop data provided by the providing unit 18 . Further, the first terminal 3 may use the provided image data for television broadcasting, moving images used for moving image distribution services, display images displayed on a large display device, or the like. The provided data provided by the providing unit 18 may be, for example, communication data encoded according to a communication protocol via the network 9, or encrypted data encrypted in a predetermined encryption method. .

The providing unit 18 may provide, as image data, telop data in a data format corresponding to the input of a transmission device that transmits telop data, to another terminal (not shown). For example, the providing unit 18 may provide a signal conforming to the video electronics standard of the serial digital interface (SDI) or data including the signal. The providing unit 18 may send the telop data in accordance with the sending timing of the sending device. Also, the providing unit 18 may send the telop data in response to a request from the sending device.

The web conference server 2, the first terminal 3 and the second terminal 4 can constitute a web conference system in this embodiment. A web conference is a communication means for client terminals connected to the network 9 to exchange or share data such as video, audio, or text in real time. A web conference system is a system for holding a web conference. The Web conference system in this embodiment may be of a server-client system or a peer-to-peer system. The web conference server 2 is a service terminal that services the web conference, and the first terminal 3 and the second terminal 4 are client terminals that receive the web conference service (participate in the web conference). Note that FIG. 1 illustrates a case where two terminals, the first terminal 3 and the second terminal 4, participate in the Web conference. good.

For example, in the server-client system, the Web conference server 2 provides Web conference services as a server to the first terminal 3 and the second terminal 4, which are client terminals. The first terminal 3 and the second terminal 4 may each log in to the web conference server 2 and exchange data such as images via the web conference server 2 to use the web conference service. . Note that the Web conference server 2 may be a cloud server constructed on the cloud of the Internet.

In the peer-to-peer method, the Web conference server 2 provides or provides connection destination information such as the URL (Uniform Resource Locator) or IP (Internet Protocol) address of the communication destination to the first terminal 3 and the second terminal 4. Communication between the first terminal 3 and the second terminal 4 may be established based on the connection destination information. After the communication between the first terminal 3 and the second terminal 4 is established, the first terminal 3 and the second terminal 4 may directly exchange data such as images without going through the Web conference server 2. .

The first terminal 3 and the second terminal 4 are client terminals that participate in the web conference. The first terminal 3 and the second terminal 4 may be, for example, general-purpose devices such as desktop PCs, notebook PCs, tablet PCs, and smartphones, or may be devices dedicated to web conferences. Among the client terminals of the Web conference, a terminal that provides and shares data such as video is called a host terminal, and a terminal that shares data such as video provided from the host terminal is called a guest terminal. In FIG. 1, the first terminal 3 exemplifies a host terminal that provides data such as video to the second terminal 4 using the Web conference system. The second terminal 4 exemplifies a guest terminal to which data such as video is provided from the first terminal 3 using the web conference system. For example, in a web conference, the terminal that held the conference (started the web conference) can be the host terminal. A host terminal and a guest terminal in the web conference system can be set for each web conference. Also, the host terminal and the guest terminal may be switched during the Web conference. Also, a plurality of guest terminals can participate in the Web conference, and guest terminals other than the second terminal 4 may participate.

The first terminal 3 has a first application 31 and a first display device 32 . The first application 31 has plug-in software 311 . The first display device 32 also has a main monitor 321 and a second monitor 322 . The second terminal 4 has a second application 41 , a second display device 42 , a capture section 43 , an output section 44 and a third display device 45 . The second application 41 has plug-in software 411 . The second display device 42 also has a main monitor 421 and a second monitor 422 .

The first application 31 and the second application 41 are application software for using the web conference system. For example, the first application 31 logs into the web conference server 2 and starts a web conference so that the first terminal 3 serves as the host terminal. The second application 41 logs in to the web conference server 2 and participates in the web conference so that the second terminal 4 serves as a guest terminal. The first application 31 provides data such as video to the second terminal 4, which is a guest terminal participating in the started web conference. The first application 31 and the second application 41 are application software for using the web conference system. Note that the first application 31 or the second application 41 can be implemented as a dedicated application executed on a PC, smartphone, or the like, for example. Also, the first application 31 or the second application 41 may be implemented by a web browser.

The plug-in software 311 is software for adding a function for using the information processing device 1 to the first application 31 . The plug-in software 311 has a telop data setting function that displays telop data settings on the first display device 32 to enable setting of telop data, or displays image data acquired from the providing unit 18 of the information processing apparatus 1. It has at least one function of displaying image data to be displayed. Plug-in software 311 may have other functions. The plug-in software 311 is activated, for example, by the user operating a toolbar or ribbon on the display screen of the first application 31 displayed on the first display device 32 . If the first application 31 is implemented by a web browser, the plug-in software 311 may be implemented as a web browser plug-in.

The first display device 32 has at least a main monitor 321 and a second monitor 322 . The second display device 42 has at least a main monitor 421 and a second monitor 422 . The first application 31 and the second application 41 can share the display screens of the first display device 32 and the second display device 42 via the web conference system. For example, the first application 31 and the second application 41 can share the display screen displayed on the main monitor 321 of the first terminal 3 on the main monitor 421 of the second terminal 4 . Also, the first application 31 and the second application 41 can share the display screen displayed on the second monitor 322 of the first terminal 3 by displaying it on the second monitor 422 of the second terminal 4 .

The main monitor 321 and the second monitor 322 in this embodiment are display areas in the first display device 32, respectively. Similarly, a main monitor 421 and a second monitor 422 are display areas in the second display device 42, respectively. The main monitor 321 and the second monitor 322 may be displayed on separate display devices (for example, a liquid crystal monitor, etc.), or each area may be displayed on one display device. good too. Similarly, the main monitor 421 and the second monitor 422 may be displayed on separate display devices, or may be displayed on a single display device.

The main monitor 321 in this embodiment is a display area for displaying the UI for the telop data setting function. The UI for the telop data setting function is provided by the UI providing unit 15, for example. The second monitor 322 is a display area for displaying image data acquired from the providing unit 18 . The image data displayed on the second monitor 322 includes telop data generated by the generator 17 . By displaying the display screen displayed on the second monitor 322 on the second monitor 422, it is possible to share the display screen for displaying image data including telop data.

The display areas of the main monitor 321 and the second monitor 322 can be set by the user of the first terminal 3 . For example, if the first terminal 3 has one or more display devices, the user sets part of the display area of the display device to the main monitor 321 and sets another part of the display area of the display device to the second monitor 322. May be set. Also, if the first terminal 3 has two or more display devices, the user can set any one display device as the main monitor 321 and set the other one as the second monitor 322. good. In addition, the display area may have three or more display areas. For example, there may be a display area such as a third monitor (not shown).

Similarly, the display areas of the main monitor 421 and the second monitor 422 can be set by the user of the second terminal 4 . For example, if the second terminal 4 has one or more display devices, the user sets part of the display area of the display device to the main monitor 421 and sets another part of the display area of the display device to the second monitor 422. May be set. Also, if the second terminal 4 has two or more display devices, the user can set any one display device as the main monitor 421 and set the other one as the second monitor 422. good.

<Telop data setting function>
The telop data setting function is a function for setting the telop data generated by the generation unit 17 described above. The setting of the telop data includes, for example, selection of material data used for the telop data, setting of the display range of the telop, setting of the character size, font or color of the telop. The plug-in software 311 displays a UI for setting telop data on the main monitor 321 so that the user can use the telop data setting function.

For example, in selecting material data to be used for telop data, the user of the first terminal 3, which is the host terminal of the web conference, selects the input data input by the user of the second terminal 4, which is the guest terminal, as material data. can do. The input data input by the user of the second terminal 4 is, for example, text data, voice data, or image data. The text data is input by the user operating a keyboard (not shown) of the second terminal 4, for example. Voice data is input by, for example, collecting the user's voice from a microphone (not shown) of the second terminal 4 . Also, image data is input by the user selecting an image (pictogram or the like) stored in the second terminal 4, for example. The input data can be input using, for example, the chat function of the web conference system. The chat function is a function that provides input data such as text data entered by a participant in a web conference (user of the host terminal or user of the guest terminal) to the terminals of other participants in real time and shares it. . There are types of chats, such as text chats, voice chats, and video chats. By selecting the input data input by the user of the second terminal 4 as the material data, the input data such as text data provided by the participant of the Web conference (guest terminal user) can be easily turned into telop data. becomes possible. The input data input to the second terminal 4 may be telops corresponding to different displays. For example, each second terminal 4 may be recognized and the display color of the telop data may be changed according to the terminal.

In addition, in selecting material data to be used for telop data, the user of the host terminal may select information to be notified to the participants of the Web conference (guest terminal users) as material data. The information to be notified to the participants of the Web conference is, for example, an advertisement or notice of goods or services. The information to be notified to the participants of the Web conference may include lyrics of music, text data of teletext, moving image data of sign language, or the like. As a result, the user of the host terminal can easily convert the information to be notified to the participants of the Web conference into telop data.

In addition, in selecting material data to be used for telop data, the user of the host terminal may select information to be displayed on the third display device 45, which will be described later, as material data. The information displayed on the third display device 45 is, for example, match information indicating the progress of a sport match such as baseball, soccer, volleyball, or basketball. The match information is information displayed on a large monitor at the match venue. By selecting match information as material data, for example, in a multi-purpose venue where matches of multiple types of sports can be held, it is possible to easily generate telops suitable for each sport.

<Image data display function>
The image data display function is a function of displaying image data provided from the providing unit 18 . The plug-in software 311 displays the image data provided by the provider 18 on the second monitor 322 . For example, the plug-in software 311 acquires image data provided by the providing unit 18, converts the number of pixels to a number suitable for display on the second monitor 322, and displays the image data. The user of the first terminal 3 can confirm the telop data generated by the image data displayed on the second monitor 322 . The image data displayed on the second monitor 322 is displayed and shared on the second monitor 422 of the second terminal 4, which is a guest terminal of the Web conference. Thereby, the second terminal 4 can easily acquire the image data including the telop data generated by the information processing device 1 .

The capture unit 43 captures the display screen of the image data displayed on the second monitor 422 of the second display device 42 . Capturing the display screen means recording part or all of the still image or moving image displayed on the second monitor 422 in a memory (not shown) in a readable manner. The display screen is captured by, for example, the user's operation of the second terminal 4 .

The output unit 44 outputs video data of the display screen captured by the capture unit 43 to the third display device 45 . The third display device 45 is, for example, a large screen, digital signage, or the like installed in public facilities, sports stadiums, commercial facilities, streets, or the like. By outputting the display screen of the image data captured by the capture unit 43 to the third display device 45 , the image data including the telop data can be easily used on the third display device 45 .

Network 9 is, for example, the Internet. The network 9 may include, for example, mobile phone base stations, wireless LAN access points, and the like.

In the information processing system 100, the communication control unit 11, the authentication unit 12, the storage unit 13, the acquisition unit 14, the UI provision unit 15, the determination unit 16, the generation unit 17, the provision unit 18, the first Functional units of the first application 31 and the first display device 32 of the terminal 3, and the second application 41, the second display device 42, the capture unit 43, the output unit 44, and the third display device 45 of the second terminal 4 shows an example of the functional units of the information processing system 100, and does not limit the functions that the information processing system 100 has. For example, the information processing system 100 does not need to have all the functional units described above, and may have some of the functional units. Also, the information processing system 100 may have functions other than those described above. For example, the information processing system 100 may have an input function for inputting information and an output function for notifying the operating state of the device using an LED lamp or the like.

Further, as described above, each functional unit included in the information processing system 100 has been described as being realized by software. However, at least one or more of the functional units included in the information processing system 100 may be realized by hardware.

Further, one of the functional units included in the information processing system 100 may be implemented by dividing one functional unit into a plurality of functional units. Further, any two or more of the functional units included in the information processing system 100 may be integrated into one functional unit and implemented. That is, FIG. 1 expresses the functions of the information processing system 100 by functional blocks, and does not indicate that each functional unit is configured by a separate program file or the like, for example.

Further, the information processing device 1 may be a device realized by one housing, or may be a system realized by a plurality of devices connected via a network or the like. For example, the information processing device 1 may realize part or all of its functions by another virtual device such as a cloud service provided by a cloud computing system. That is, the information processing apparatus 1 may implement at least one or more of the functional units described above in another device. The information processing device 1 may be a general-purpose computer such as a desktop PC, or a dedicated device with limited functions.

Next, display screens displayed in the information processing system will be described with reference to FIGS. 2 to 8. FIG. 2 to 7, the first display device 32 has a main monitor 321 and a second monitor 322, and the second display device 42 has a main monitor 421 and a second monitor 422. FIG. Also, the third display device 45 displays the captured image of the second monitor 422 . The main monitor 321 and the second monitor 322 exemplify input person screens visually recognized by an input person who inputs telops. 4 illustrates a shared screen.

FIG. 2 is a diagram showing a first display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 2, the third display device 45 is a large display device installed in a baseball stadium. The third display device 45 displays a display screen showing baseball game information. The main monitor 321 displays a telop setting UI for generating image data used for the display screen of the third display device 45 . A second monitor 322 displays image data including telop data generated by settings based on the UI displayed on the main monitor 321 . In this embodiment, the case where the display screen (full screen) displayed on the second monitor 322 is displayed as a telop is exemplified. On the second monitor 322, match information such as baseball scores and player names is displayed as telops in a predetermined format. The display screens of the main monitor 321 and the second monitor 322 are shared with the main monitor 421 and the second monitor 422 via the web conference system. The display screen of the second monitor 422 is captured and displayed on the third display device 45 . This makes it possible to reduce the cost of creating telop data at the site where the third display device 45 is installed. 2 to 7 exemplify the case where the display screen of the main monitor 321 is also shared with the main monitor 421, but the display screen of the main monitor 321 may not be shared.

FIG. 3 is a diagram showing a second display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 3, as in FIG. 2, the third display device 45 is a large display device installed in a baseball stadium. The third display device 45 displays a display screen when a home run is hit. The second monitor 322 displays image data including telop data of text data of “home run” generated by settings based on the UI displayed on the main monitor 321 . Note that the text data of “homerun” may be provided by the user of the second terminal 4 .

FIG. 4 is a diagram showing a third display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 4, the third display device 45 is a large display device installed on a soccer field. The third display device 45 displays soccer game information. The second monitor 322 displays image data including telop data of match information generated by settings based on the UI displayed on the main monitor 321 . The game information includes text data of team names, image data of team marks, and text data indicating the score status.

FIG. 5 is a diagram showing a fourth display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 5, as in FIG. 4, the third display device 45 is a large display device installed on a soccer field. The third display device 45 displays a display screen showing additional time. The second monitor 322 displays image data including telop data of additional time text data generated by settings based on the UI displayed on the main monitor 321 . The text data indicating the numerical value of the additional time may be provided by the user of the second terminal 4 .

FIG. 6 is a diagram showing a fifth display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 5, the third display device 45 is a large display device installed in a gymnasium that serves as a volleyball match venue. The third display device 45 displays volleyball match information. In this embodiment, it is possible to easily display a display screen suitable for each sport even in a place such as a gymnasium where matches of various sports are held.

FIG. 7 is a diagram showing a sixth display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 6, similarly to FIG. 5, the third display device 45 is a large display device installed in a gymnasium that serves as a volleyball game venue. The third display device 45 displays volleyball match information different from that shown in FIG. In this embodiment, it is possible to easily display various game information.

FIG. 8 is a diagram showing a seventh display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 8, the second display device 42 displays a display screen on a client terminal of a Web conference in which a plurality of participants (eight participants in the figure) are participating. A shared screen shared by the host terminal of the Web conference is displayed on the upper right of the display screen. On the shared screen, telops 1001, 1002, 1003, and 1004 are superimposed on the live video of the concert hall. A comment input field 1011 is displayed on the display screen of the second display device 42 . A telop 1001 and a telop 1003 are superimposed on the live image are telop data whose source data is text data or image data such as an advertisement to be notified to the guest terminal, which is input from the host terminal. The telop 1002 is generated by superimposing telop data, which uses comments input from the comment input field 1011 of each guest terminal as material data, on the live video. The telop 1004 is obtained by superimposing telop data, which is obtained by converting the voice of the music being played into text data as material information, onto the live video. The host terminal of the web conference can reduce the cost of distributing the telop data by sharing the image data including the telop data generated in the information processing apparatus 1 with the client terminal in the web conference. Note that different telop data may be distributed to each participant on the display screen of the second display device 42 .

Next, the hardware configuration of the information processing device 1 will be described with reference to FIG. 9 . FIG. 9 is a block diagram showing an example of the hardware configuration of the information processing device 1 according to the embodiment.

The information processing apparatus 1 has a CPU (Central Processing Unit) 101 , a RAM (Random Access Memory) 102 , a ROM (Read Only Memory) 103 , an I/O device 104 and a communication I/F (Interface) 105 . The information processing device 1 is a device that executes the information processing program described with reference to FIG.

The CPU 101 controls the user terminal by executing an information processing program stored in the RAM 102 or ROM 103 . The information processing program is acquired, for example, from a recording medium recording the program or from a program distribution server via a network, installed in ROM 103, read out by CPU 101, and executed.

The I/O device 104 has an operation input function and a display function (operation display function). The I/O device 104 is, for example, a touch panel. The touch panel enables the user of the information processing device 1 to perform operation input using a fingertip, a touch pen, or the like. The I/O device 104 in this embodiment uses a touch panel having an operation display function. may have. In that case, the display screen of the touch panel can be implemented as the display screen of the display device, and the operation of the touch panel can be implemented as the operation of the operation input device. Note that the I/O device 104 may be implemented in various forms such as a head-mounted type, glasses type, wristwatch type display, and the like.

Communication I/F 105 is an I/F for communication. The communication I/F 105 executes short-range wireless communication such as wireless LAN, wired LAN, and infrared. Although the figure shows only the communication I/F 105 as a communication I/F, the information processing apparatus 1 may have respective communication I/Fs in a plurality of communication methods.

Next, the operation of the information processing device 1 will be described with reference to FIG. FIG. 10 is a flow chart showing an example of the operation of the information processing device 1 according to the embodiment. It is assumed that the information processing apparatus 1 executes the operations in the flowcharts shown below, but each operation can be executed by each functional unit of the information processing apparatus 1 described above.

In FIG. 10, the information processing apparatus 1 provides a UI including a login screen and a telop data setting screen for the user who is the host terminal to log in (step S11). The UI can be provided, for example, by providing a web page to the first terminal 3 that has accessed the predetermined network address of the information processing device 1 .

After executing the process of step S11, the information processing device 1 determines whether or not the login of the user of the first terminal 3 has succeeded (step S12). Whether or not the login has succeeded can be determined by whether or not the authentication has succeeded in the authentication unit 12 . If it is determined that the login has not succeeded (step S12: NO), the information processing apparatus 1 repeats the process of step S12 and waits for the login to succeed.

On the other hand, if it is determined that the login was successful (step S12: YES), the information processing apparatus 1 determines whether material data used for telop data has been acquired (step S13). Whether or not the material data has been acquired can be determined, for example, by whether or not the acquisition unit 14 has acquired the material data. When determining that the material data has not been acquired (step S13: NO), the information processing apparatus 1 repeats the process of step S13 and waits for the material data to be acquired.

On the other hand, if it is determined that the material data has been acquired (step S13: YES), the information processing apparatus 1 determines the type of material data (text data, voice data or image data), and recognizes the content of each material data. (step S14). For example, if the material data is text data, the information processing device 1 recognizes the number of characters in the text data and the type of text (for example, kanji, hiragana, alphanumeric characters, etc.). Further, when the material data is voice data, the information processing device 1 recognizes the number of characters of the text data generated in the voice recognition. Also, when the material data is image data, the information processing device 1 recognizes the number of pixels of the recognized image.

After executing the process of step S14, the information processing apparatus 1 generates telop data based on the obtained material data and the display area of the telop (step S15). Generation of telop data can be executed by the function of the generation unit 17 described above. After executing the process of step S15, the information processing device 1 provides image data including at least the telop data generated in step S15 to the first terminal 3 (step S16). After executing the process of step S16, the information processing apparatus 1 ends the operation shown in the flowchart.

The illustrated flowchart shows an example of the operation of the information processing device 1 and does not limit the operation of the information processing device 1 .

Next, the operation of the first terminal 3 will be described using FIG. FIG. 11 is a flow chart showing an example of the operation of the first terminal 3 in the embodiment. In the following description, it is assumed that the first terminal 3 executes the operations in the flowcharts shown below, but each operation can be executed by each functional unit of the first terminal 3 described above.

In FIG. 11, the first terminal 3 activates the web conference system (step S21). Activation of the web conference system is executed, for example, by activating the first application 31 and accessing the web conference server 2 .

After executing the process of step S21, the first terminal 3 determines whether or not the login of the user of the first terminal 3 has succeeded (step S22). Whether or not the login is successful can be determined by receiving notification from the information processing apparatus 1 as to whether or not the authentication is successful in the authentication unit 12 . If it is determined that the login has not succeeded (step S22: NO), the first terminal 3 repeats the process of step S12 and waits for the login to succeed.

On the other hand, if it is determined that the login was successful (step S22: YES), the first terminal 3 determines whether material data used for telop data has been obtained from the second terminal 4 (step S23). The material data acquired from the second terminal 4 is, for example, chat data provided from the second terminal 4 in a web conference. When determining that the material data has not been acquired (step S23: NO), the first terminal 3 repeats the process of step S23 and waits for the material data to be acquired. Although FIG. 11 illustrates the case where the material data is obtained from the second terminal 4, the material data may be obtained from the first terminal 3 or another device.

On the other hand, when determining that the material data has been acquired (step S23: YES), the first terminal 3 provides the acquired material data to the information processing device 1 (step S24). After executing the process of step S24, the first terminal 3 determines whether image data including telop data generated by the information processing device 1 has been acquired (step S25). When determining that the image data has not been acquired (step S25: NO), the first terminal 3 repeats the process of step S25 and waits for image data acquisition.

On the other hand, if it is determined that the image data has been acquired (step S25: YES), the first terminal 3 shares the display screen of the acquired image data with the second terminal 4, which is the client terminal of the Web conference (step S26). . The sharing of the display screen can be executed in the display of the image data on the first display device 32, the display of the image data on the first display device 32, and the display of the display screen provided to the second terminal 4 in the Web conference. can. After executing the process of step S26, the first terminal 3 ends the operation shown in the flowchart.

Note that the illustrated flowchart shows an example of the operation of the first terminal 3 and does not limit the operation of the first terminal 3 .

Next, the operation of the second terminal 4 will be described using FIG. FIG. 12 is a flow chart showing an example of the operation of the second terminal 4 in the embodiment. Although it is assumed that the second terminal 4 executes the operations in the flowcharts shown below, each operation can be executed by each functional unit of the second terminal 4 described above.

In FIG. 12, the second terminal 4 activates the web conference system (step S31). Activation of the web conference system is executed, for example, by activating the second application 41 and accessing the web conference server 2 . Access to the web conference server 2 is executed, for example, by entering the conference room number of the web conference started by the first terminal 3, which is the host terminal. That is, it is assumed that the second terminal 4 in FIG. 12 can participate in the Web conference as a client terminal only by inputting the conference room number.

After executing the process of step S31, the second terminal 4 provides the material data to the first terminal 3 (step S32). The material data is provided, for example, by providing chat data through a web conference chat function.

After executing the process of step S31, the second terminal 4 shares the display screen of the first terminal 3, which is the host terminal of the Web conference, as a client terminal (step S33). The sharing of the display screen can be executed in the display of the image data on the first display device 32, the display of the image data on the first display device 32, and the display of the display screen provided to the second terminal 4 in the Web conference. can. After executing the process of step S33, the second terminal 4 ends the operation shown in the flowchart.

Note that the illustrated flowchart shows an example of the operation of the second terminal 4 and does not limit the operation of the second terminal 4 . For example, the second terminal 4 may capture the shared display screen in step S33 and display it on the third display device 45 .

It should be noted that a program for realizing the functions constituting the apparatus described in this embodiment may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed. , the above-described various processes of the present embodiment may be performed. Note that the “computer system” referred to here may include hardware such as an OS and peripheral devices. The "computer system" also includes the home page providing environment (or display environment) if the WWW system is used. In addition, "computer-readable recording medium" means writable non-volatile memory such as flexible disk, magneto-optical disk, ROM, flash memory, etc., portable medium such as CD-ROM, hard disk built in computer system, etc. storage device.

Furthermore, "computer-readable recording medium" means a volatile memory (e.g., DRAM (Dynamic Random Access Memory)), which holds a program for a certain period of time. Further, the above program may be transmitted from a computer system storing this program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in a transmission medium. Here, the "transmission medium" for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. Further, the program may be for realizing part of the functions described above. Furthermore, a so-called difference file (difference program), which realizes the functions described above in combination with a program already recorded in the computer system, may be used.

Although the embodiments of the present invention have been described above with reference to the drawings, the specific configuration is not limited to these embodiments, and various modifications are possible without departing from the scope of the present invention. be

For example, in the present embodiment, the second terminal 4 has the second application 41 as a method of acquiring image data to be displayed on the first display device acquired via the Web conference system, 2 illustrates the case where the application 41 acquires image data. Here, the second application 41 may be implemented as a dedicated application or web browser plug-in software as described above, or may be implemented as a web browser function that does not require plug-in software. However, the second terminal 4 may not have the second application 41 . For example, the second terminal 4 may be a display system that passively receives image data to be displayed on the first display device 32 . The second terminal 4 may receive the screen data shared by the host terminal and display it on the second display device 42 using the screen sharing function of the Web conference system.

REFERENCE SIGNS LIST 100 information processing system 1 information processing device 11 communication control unit 12 authentication unit 13 storage unit 14 acquisition unit 15 UI provision unit 16 determination unit 17 generation unit 18 provision unit 2 Web conference server 3 first terminal 31 first application 311 plug-in software 32 first display device 321 main monitor 322 second monitor 4 second terminal 41 second application 411 plug-in software 42 second display device 421 main monitor 422 second monitor 43 capture section 44 output section 45 third display device 9 network 101 CPU
102 RAMs
103 ROMs
104 I/O device 105 Communication I/F
1001, 1002, 1003, 1004 Telop 1011 Comment input field

Claims (10)

a first terminal that is a client terminal in the web conference system;
a second terminal, which is another client terminal in the web conference system and is connected to the first terminal via the web conference system;
and an information processing device communicably connected to the first terminal, wherein
The information processing device is
an acquisition unit that acquires material data from the first terminal;
a generation unit that generates telop data based on the material data acquired by the acquisition unit;
a providing unit that provides image data including at least telop data generated by the generating unit to the first terminal;
The first terminal is
a first application for using the web conference system;
a first display device for displaying the image data provided by the providing unit;
the second terminal,
An information processing system comprising a second display device for displaying the image data to be displayed on the first display device acquired via the web conference system. The first display device includes a main monitor that displays settings of the telop data and a second monitor that displays the image data,
2. The information processing system according to claim 1, wherein said second terminal acquires said image data displayed on said second monitor shared via said Web conference system. The first application has a telop data setting function that displays the setting of the telop data on the main monitor to enable setting of the telop data, or an image data display that displays the image data provided from the providing unit. 3. An information processing system according to claim 2, comprising plug-in software having at least one of the functions. the second terminal,
a capture unit that captures a display screen of the image data displayed on the second display device;
4. The information processing system according to any one of claims 1 to 3, further comprising an output unit that outputs said display screen captured by said capture unit to a third display device. The second terminal provides input data entered by a user of the second terminal to the first application,
5. The information processing system according to claim 1, wherein said first application provides said input data acquired from said second terminal as said material data to said information processing device. 6. The information processing system according to claim 5, wherein said second terminal provides text data input by a user of said second terminal as said input data to said first application. 7. The information processing system according to claim 5, wherein said second terminal provides said first application with voice data input by a user of said second terminal as said input data. the second terminal,
8. The information processing system according to any one of claims 1 to 7, wherein a display area for displaying said image data is determined corresponding to said second display device. A first terminal that is a client terminal in a web conference system, a second terminal that is another client terminal in the web conference system and is connected to the first terminal via the web conference system, and the first terminal and an information processing device communicatively connected to an information processing method executed in an information processing system,
executed in the information processing device,
an acquisition step of acquiring material data from the first terminal;
a generation step of generating telop data based on the material data acquired in the acquisition step;
a providing step of providing image data including at least the telop data generated in the generating step to the first terminal;
Executed at the first terminal;
a starting step of starting a first application for using the web conference system;
a first display step of displaying the image data provided in the providing step;
executed at the second terminal;
An information processing method, comprising: a second display step of displaying the image data displayed in the first display step acquired via the web conference system. A first terminal that is a client terminal in the web conference system, a second terminal that is another client terminal in the web conference system and is connected to the first terminal, and is communicably connected to the first terminal. An information processing program executed in an information processing system including an information processing device,
In the information processing device,
an acquisition function for acquiring material data from the first terminal;
a generation function that generates telop data based on the material data acquired by the acquisition function;
a providing function of providing image data including at least telop data generated by the generating function to the first terminal,
At the first terminal,
a first application function for using the web conference system;
realizing a first display function for displaying the image data provided by the providing function,
At the second terminal,
An information processing program for realizing a second display function of displaying the image data displayed by the first display function acquired via a web conference system.

Images